2024-04-06T11:59:46.399 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-06T11:59:46.399 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948 --owner scheduled_teuthology@teuthology --verbose -- /home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948/orig.config.yaml 2024-04-06T11:59:46.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T11:59:46.551 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948 branch: reef description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7638948' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific ' name: teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 800ec6d64a7fa0648ad53edfc6e50b41fc4cd674 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3144 sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 sleep_before_teardown: 0 subset: 362/512 suite: fs suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 800ec6d64a7fa0648ad53edfc6e50b41fc4cd674 targets: smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG0ZE6RtwwSo6p8HLaMoC1J5aLse6I4LubuFJ+ln4Yzco0itQRDDrNJwDF2QV7q4GTv3fuDj6agfYzTa/4E0tGA= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKelDZDzSpoPGpF/Z7ah+k4H++JSMNI6zUbgmTkEaX8udFK9Cxm/VcVrFPHC0sKu1jOHncs9GovOq4zg0SWCqKk= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: pacific exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: pacific cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:pacific roleless: true - print: '**** done end installing pacific cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: d7d6e60867cadf19fbfd7655a551ae7d58060757 timestamp: 2024-04-03_22:24:02 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-06T11:59:46.551 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa; will attempt to use it 2024-04-06T11:59:46.552 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks 2024-04-06T11:59:46.552 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-06T11:59:46.554 INFO:teuthology.task.internal:Checking packages... 2024-04-06T11:59:46.577 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '052adcadd0534eddb0d73c5afbc083a84cd9dc46' 2024-04-06T11:59:46.577 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-06T11:59:46.577 INFO:teuthology.packaging:ref: None 2024-04-06T11:59:46.577 INFO:teuthology.packaging:tag: None 2024-04-06T11:59:46.577 INFO:teuthology.packaging:branch: reef 2024-04-06T11:59:46.577 INFO:teuthology.packaging:sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T11:59:46.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-06T11:59:46.874 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1169.g37f5b3f8 2024-04-06T11:59:46.879 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-06T11:59:46.886 INFO:teuthology.task.internal:no buildpackages task found 2024-04-06T11:59:46.886 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-06T11:59:46.910 INFO:teuthology.task.internal:Saving configuration 2024-04-06T11:59:46.930 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-06T11:59:46.937 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-06T11:59:46.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-06 11:54:20.509822', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG0ZE6RtwwSo6p8HLaMoC1J5aLse6I4LubuFJ+ln4Yzco0itQRDDrNJwDF2QV7q4GTv3fuDj6agfYzTa/4E0tGA='} 2024-04-06T11:59:46.988 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-06 11:54:20.511545', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKelDZDzSpoPGpF/Z7ah+k4H++JSMNI6zUbgmTkEaX8udFK9Cxm/VcVrFPHC0sKu1jOHncs9GovOq4zg0SWCqKk='} 2024-04-06T11:59:46.988 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-06T11:59:46.996 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-06T11:59:46.996 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-06T11:59:46.996 INFO:teuthology.run_tasks:Running task console_log... 2024-04-06T11:59:47.094 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8f466363a0>, signals=[15]) 2024-04-06T11:59:47.094 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-06T11:59:47.100 INFO:teuthology.task.internal:Opening connections... 2024-04-06T11:59:47.101 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T11:59:47.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T11:59:47.181 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-04-06T11:59:47.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T11:59:47.255 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-06T11:59:47.261 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-04-06T11:59:47.286 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-04-06T11:59:47.286 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-06T11:59:47.348 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-04-06T11:59:47.349 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T11:59:47.349 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-06T11:59:47.349 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T11:59:47.349 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-04-06T11:59:47.373 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-04-06T11:59:47.396 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-04-06T11:59:47.397 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-06T11:59:47.457 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-04-06T11:59:47.457 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-06T11:59:47.458 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-06T11:59:47.458 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-06T11:59:47.487 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-06T11:59:47.495 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-06T11:59:47.519 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-06T11:59:47.519 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-04-06T11:59:47.521 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-04-06T11:59:47.541 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-06T11:59:47.547 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-06T11:59:47.547 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-04-06T11:59:47.583 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-04-06T11:59:47.617 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-06T11:59:47.667 INFO:teuthology.run_tasks:Running task kernel... 2024-04-06T11:59:47.682 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-06T11:59:47.682 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-06T11:59:47.683 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-06T11:59:47.683 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-06T11:59:47.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T11:59:47.704 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-06T11:59:47.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T11:59:47.705 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-04-06T11:59:47.766 INFO:teuthology.orchestra.run.smithi195.stdout:4.18.0-489.el8.x86_64 2024-04-06T11:59:47.766 INFO:teuthology.task.kernel:Running kernel on smithi195: 4.18.0-489.el8.x86_64 2024-04-06T11:59:47.766 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-04-06T11:59:47.767 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-489.el8.x86_64 2024-04-06T11:59:47.767 INFO:teuthology.task.kernel:Running kernel on smithi152: 4.18.0-489.el8.x86_64 2024-04-06T11:59:47.767 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2024-04-06T11:59:51.254 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - AppStream 29 MB/s | 28 MB 00:00 2024-04-06T11:59:51.426 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - AppStream 28 MB/s | 28 MB 00:01 2024-04-06T11:59:56.954 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-06T11:59:57.392 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-04-06T11:59:58.788 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras 82 kB/s | 18 kB 00:00 2024-04-06T11:59:59.163 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras common packages 29 kB/s | 7.7 kB 00:00 2024-04-06T11:59:59.390 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-06T11:59:59.425 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras 50 kB/s | 18 kB 00:00 2024-04-06T11:59:59.810 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 7.7 kB 00:00 2024-04-06T12:00:00.053 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-04-06T12:00:01.281 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-06T12:00:05.146 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 461 kB/s | 24 kB 00:00 2024-04-06T12:00:08.193 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-06T12:00:08.193 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-06T12:00:08.319 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:00:08.319 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:00:08.319 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:00:08.319 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:00:08.320 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:00:08.320 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 4.18.0-548.el8 baseos 10 M 2024-04-06T12:00:08.320 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:00:08.320 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 4.18.0-548.el8 baseos 44 M 2024-04-06T12:00:08.320 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 4.18.0-548.el8 baseos 36 M 2024-04-06T12:00:08.320 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:00:08.320 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:00:08.320 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:00:08.320 INFO:teuthology.orchestra.run.smithi152.stdout:Install 3 Packages 2024-04-06T12:00:08.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:00:08.322 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 90 M 2024-04-06T12:00:08.322 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 96 M 2024-04-06T12:00:08.322 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:00:14.783 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 16 MB 00:15 2024-04-06T12:00:16.180 INFO:teuthology.orchestra.run.smithi152.stdout:(1/3): kernel-4.18.0-548.el8.x86_64.rpm 15 MB/s | 10 MB 00:00 2024-04-06T12:00:16.980 INFO:teuthology.orchestra.run.smithi152.stdout:(2/3): kernel-modules-4.18.0-548.el8.x86_64.rpm 24 MB/s | 36 MB 00:01 2024-04-06T12:00:17.488 INFO:teuthology.orchestra.run.smithi152.stdout:(3/3): kernel-core-4.18.0-548.el8.x86_64.rpm 22 MB/s | 44 MB 00:02 2024-04-06T12:00:17.489 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:00:17.489 INFO:teuthology.orchestra.run.smithi152.stdout:Total 9.9 MB/s | 90 MB 00:09 2024-04-06T12:00:18.176 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:00:18.572 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 375 kB/s | 24 kB 00:00 2024-04-06T12:00:18.620 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:00:18.620 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:00:19.880 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:00:19.914 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:00:21.635 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-06T12:00:21.636 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-06T12:00:21.741 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:00:21.742 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:00:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:00:21.742 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:00:21.742 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:00:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 4.18.0-548.el8 baseos 10 M 2024-04-06T12:00:21.742 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:00:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core x86_64 4.18.0-548.el8 baseos 44 M 2024-04-06T12:00:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules x86_64 4.18.0-548.el8 baseos 36 M 2024-04-06T12:00:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:00:21.743 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:00:21.743 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:00:21.743 INFO:teuthology.orchestra.run.smithi195.stdout:Install 3 Packages 2024-04-06T12:00:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:00:21.743 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 90 M 2024-04-06T12:00:21.744 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 96 M 2024-04-06T12:00:21.744 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:00:22.727 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:00:23.369 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-4.18.0-548.el8.x86_64 1/3 2024-04-06T12:00:24.040 INFO:teuthology.orchestra.run.smithi195.stdout:(1/3): kernel-4.18.0-548.el8.x86_64.rpm 12 MB/s | 10 MB 00:00 2024-04-06T12:00:24.847 INFO:teuthology.orchestra.run.smithi195.stdout:(2/3): kernel-modules-4.18.0-548.el8.x86_64.rpm 22 MB/s | 36 MB 00:01 2024-04-06T12:00:25.566 INFO:teuthology.orchestra.run.smithi195.stdout:(3/3): kernel-core-4.18.0-548.el8.x86_64.rpm 18 MB/s | 44 MB 00:02 2024-04-06T12:00:25.566 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:00:25.566 INFO:teuthology.orchestra.run.smithi195.stdout:Total 24 MB/s | 90 MB 00:03 2024-04-06T12:00:26.247 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:00:26.666 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:00:26.667 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:00:26.941 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-4.18.0-548.el8.x86_64 1/3 2024-04-06T12:00:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-4.18.0-548.el8.x86_64 2/3 2024-04-06T12:00:27.912 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:00:27.953 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:00:30.711 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:00:30.765 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-4.18.0-548.el8.x86_64 2/3 2024-04-06T12:00:31.068 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:00:31.239 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-core-4.18.0-548.el8.x86_64 1/3 2024-04-06T12:00:34.860 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-4.18.0-548.el8.x86_64 1/3 2024-04-06T12:00:35.272 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-4.18.0-548.el8.x86_64 2/3 2024-04-06T12:00:38.711 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-4.18.0-548.el8.x86_64 2/3 2024-04-06T12:00:39.038 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:00:53.120 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:00:53.144 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:00:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:00:53.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-4.18.0-548.el8.x86_64 1/3 2024-04-06T12:00:53.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-4.18.0-548.el8.x86_64 2/3 2024-04-06T12:00:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:00:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:00:54.017 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:00:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-4.18.0-548.el8.x86_64 kernel-core-4.18.0-548.el8.x86_64 2024-04-06T12:00:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-4.18.0-548.el8.x86_64 2024-04-06T12:00:54.017 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:00:54.017 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:00:54.162 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-04-06T12:00:54.382 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-548.el8.x86_64 2024-04-06T12:00:54.382 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-548.el8.x86_64 2024-04-06T12:00:54.382 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-548.el8.x86_64 2024-04-06T12:00:54.382 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-06T12:00:54.382 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-06T12:00:54.382 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-04-06T12:00:54.382 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2024-04-06T12:00:54.382 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-04-06T12:00:54.594 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-548.el8.x86_64 2024-04-06T12:00:54.594 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-548.el8.x86_64 2024-04-06T12:00:54.594 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.02 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 129.el8 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:Group : System Environment/Base 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 9265586 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-04-06T12:00:54.628 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:Relocations : (not relocatable) 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : CentOS BuildSystem 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-04-06T12:00:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:00:54.630 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-04-06T12:00:54.630 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-06T12:00:54.631 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 4.18.0-548.el8.x86_64 2024-04-06T12:00:54.631 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-06T12:00:56.538 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-04-06T12:00:58.932 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-04-06T12:00:58.933 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-04-06T12:00:58.963 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.nMEnu2V9AR 2024-04-06T12:00:58.963 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nMEnu2V9AR 2024-04-06T12:00:59.038 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.nMEnu2V9AR 2024-04-06T12:00:59.187 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.nMEnu2V9AR is 6KB 2024-04-06T12:00:59.235 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.nMEnu2V9AR 2024-04-06T12:00:59.252 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-04-06T12:00:59.335 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-06T12:00:59.335 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-06T12:00:59.335 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-06T12:00:59.335 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-548.el8.x86_64.conf 2024-04-06T12:00:59.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-548.el8.x86_64 2024-04-06T12:00:59.502 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-04-06T12:01:00.840 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:01:00.863 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:01:01.213 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:01:01.213 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-4.18.0-548.el8.x86_64 1/3 2024-04-06T12:01:01.213 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-core-4.18.0-548.el8.x86_64 2/3 2024-04-06T12:01:01.694 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-4.18.0-548.el8.x86_64 3/3 2024-04-06T12:01:01.695 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:01:01.695 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:01:01.695 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-4.18.0-548.el8.x86_64 kernel-core-4.18.0-548.el8.x86_64 2024-04-06T12:01:01.695 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-4.18.0-548.el8.x86_64 2024-04-06T12:01:01.695 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:01:01.695 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:01:01.838 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-04-06T12:01:02.058 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-4.18.0-548.el8.x86_64 2024-04-06T12:01:02.059 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-548.el8.x86_64 2024-04-06T12:01:02.059 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-548.el8.x86_64 2024-04-06T12:01:02.059 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-06T12:01:02.059 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-06T12:01:02.059 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-04-06T12:01:02.059 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2024-04-06T12:01:02.059 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-04-06T12:01:02.271 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-4.18.0-548.el8.x86_64 2024-04-06T12:01:02.271 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-548.el8.x86_64 2024-04-06T12:01:02.271 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2024-04-06T12:01:02.304 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.02 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 129.el8 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Group : System Environment/Base 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 9265586 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-06T12:01:02.305 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:Relocations : (not relocatable) 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : CentOS BuildSystem 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : CentOS 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2024-04-06T12:01:02.306 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:01:02.307 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2024-04-06T12:01:02.307 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-06T12:01:02.307 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 4.18.0-548.el8.x86_64 2024-04-06T12:01:02.308 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-06T12:01:03.717 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-04-06T12:01:05.680 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-04-06T12:01:05.682 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-06T12:01:05.711 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.I9M5NVzmU3 2024-04-06T12:01:05.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.I9M5NVzmU3 2024-04-06T12:01:05.785 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.I9M5NVzmU3 2024-04-06T12:01:05.926 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.I9M5NVzmU3 is 6KB 2024-04-06T12:01:05.976 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.I9M5NVzmU3 2024-04-06T12:01:05.994 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2024-04-06T12:01:06.082 INFO:teuthology.orchestra.run.smithi195.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-06T12:01:06.082 INFO:teuthology.orchestra.run.smithi195.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-06T12:01:06.082 INFO:teuthology.orchestra.run.smithi195.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-06T12:01:06.082 INFO:teuthology.orchestra.run.smithi195.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-548.el8.x86_64.conf 2024-04-06T12:01:06.084 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-548.el8.x86_64 2024-04-06T12:01:06.227 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-04-06T12:01:29.526 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-06T12:01:29.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-06T12:01:29.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T12:01:36.235 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-06T12:01:36.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-06T12:01:36.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T12:01:48.062 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-06T12:01:54.718 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-06T12:01:57.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-06T12:01:57.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T12:02:00.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-06T12:02:03.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-06T12:02:03.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T12:02:12.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-06T12:02:12.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T12:03:03.777 DEBUG:teuthology.orchestra.remote:timed out 2024-04-06T12:03:12.146 DEBUG:teuthology.orchestra.remote:timed out 2024-04-06T12:03:15.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-06T12:03:15.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T12:03:16.078 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-06T12:03:16.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-06T12:03:16.381 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-548.el8.x86_64"... 2024-04-06T12:03:16.381 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-06T12:03:16.399 INFO:teuthology.orchestra.run.smithi195.stdout:4.18.0-548.el8.x86_64 2024-04-06T12:03:16.399 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-548.el8.x86_64 vs 4.18.0-548.el8.x86_64 2024-04-06T12:03:16.399 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-06T12:03:16.399 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-06T12:03:17.401 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-06T12:03:17.401 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-06T12:03:17.495 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-04-06T12:03:17.508 DEBUG:teuthology.parallel:result is None 2024-04-06T12:03:27.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-06T12:03:27.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T12:03:27.518 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-04-06T12:03:27.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-06T12:03:27.825 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-548.el8.x86_64"... 2024-04-06T12:03:27.825 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-04-06T12:03:27.845 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-548.el8.x86_64 2024-04-06T12:03:27.845 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-548.el8.x86_64 vs 4.18.0-548.el8.x86_64 2024-04-06T12:03:27.846 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-06T12:03:27.846 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-06T12:03:28.846 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-06T12:03:28.847 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-06T12:03:28.924 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2024-04-06T12:03:28.940 DEBUG:teuthology.parallel:result is None 2024-04-06T12:03:28.967 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-06T12:03:28.976 INFO:teuthology.task.internal:Creating test directory... 2024-04-06T12:03:28.976 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-06T12:03:28.979 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-06T12:03:29.000 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-06T12:03:29.008 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-06T12:03:29.040 INFO:teuthology.task.internal:Creating archive directory... 2024-04-06T12:03:29.040 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-06T12:03:29.043 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-06T12:03:29.086 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-06T12:03:29.093 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-06T12:03:29.093 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-06T12:03:29.124 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-06T12:03:29.159 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-06T12:03:29.160 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-06T12:03:29.170 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-06T12:03:29.171 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-06T12:03:29.173 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-06T12:03:29.181 INFO:teuthology.task.internal:Configuring sudo... 2024-04-06T12:03:29.181 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-06T12:03:29.215 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-06T12:03:29.244 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-06T12:03:29.253 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-06T12:03:29.253 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-06T12:03:29.285 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-06T12:03:29.303 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-06T12:03:29.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-06T12:03:29.437 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-06T12:03:29.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-06T12:03:29.565 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:03:29.565 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-06T12:03:29.631 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-06T12:03:29.677 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-06T12:03:29.735 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-06T12:03:29.822 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-06T12:03:29.864 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:03:29.864 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-06T12:03:29.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-04-06T12:03:29.935 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-04-06T12:03:29.985 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-06T12:03:30.035 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-06T12:03:30.310 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-06T12:03:30.320 INFO:teuthology.task.internal:Starting timer... 2024-04-06T12:03:30.320 INFO:teuthology.run_tasks:Running task pcp... 2024-04-06T12:03:30.367 INFO:teuthology.run_tasks:Running task selinux... 2024-04-06T12:03:30.400 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-06T12:03:30.400 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-04-06T12:03:30.481 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-04-06T12:03:30.482 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-04-06T12:03:30.561 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-04-06T12:03:30.562 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-06T12:03:30.562 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-04-06T12:03:30.621 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-04-06T12:03:30.621 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-04-06T12:03:30.658 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-04-06T12:03:30.658 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-04-06T12:03:30.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-06T12:03:30.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T12:03:30.685 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-06T12:03:30.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T12:03:30.726 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-06T12:03:30.726 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-04-06T12:03:30.753 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-04-06T12:03:30.792 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-06T12:03:30.803 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-06T12:03:30.809 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-06T12:03:30.963 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-06T12:03:30.979 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-06T12:03:30.980 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-06T12:09:18.341 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-04-06T12:09:18.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-06T12:09:18.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T12:09:18.418 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-04-06T12:09:18.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-06T12:09:18.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-06T12:09:18.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-06T12:09:18.568 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-06T12:09:18.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-06T12:09:18.637 INFO:teuthology.run_tasks:Running task clock... 2024-04-06T12:09:18.648 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-06T12:09:18.648 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-06T12:09:18.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-06T12:09:18.651 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-06T12:09:18.651 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-06T12:09:18.680 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-06T12:09:18.693 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-06T12:09:18.711 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-06T12:09:18.725 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-06T12:09:18.752 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-04-06T12:09:18.763 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-04-06T12:09:18.776 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-06T12:09:18.790 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-06T12:09:18.794 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-04-06T12:09:18.804 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-04-06T12:09:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-06T12:09:18.831 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-06T12:09:18.866 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2024-04-06T12:09:18.869 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-06T12:09:18.869 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-04-06T12:09:18.869 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:09:18.869 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:09:18.869 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:09:18.870 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:09:18.893 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2024-04-06T12:09:18.897 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-06T12:09:18.897 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-06T12:09:18.897 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:09:18.897 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:09:18.897 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:09:18.897 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:09:18.898 INFO:teuthology.run_tasks:Running task pexec... 2024-04-06T12:09:18.907 INFO:teuthology.task.pexec:Executing custom commands... 2024-04-06T12:09:18.907 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:09:18.907 DEBUG:teuthology.orchestra.run.smithi152:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-06T12:09:18.908 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi195.front.sepia.ceph.com 2024-04-06T12:09:18.908 DEBUG:teuthology.orchestra.run.smithi195:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-06T12:09:19.669 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:22 ago on Sat 06 Apr 2024 12:07:57 PM UTC. 2024-04-06T12:09:19.696 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:22 ago on Sat 06 Apr 2024 12:07:57 PM UTC. 2024-04-06T12:09:21.775 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:09:21.777 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:09:21.777 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:09:21.777 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:09:21.777 INFO:teuthology.orchestra.run.smithi152.stdout:Resetting modules: 2024-04-06T12:09:21.777 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools 2024-04-06T12:09:21.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:09:21.777 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:09:21.777 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:09:21.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:09:21.795 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:09:21.796 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:09:21.796 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:09:21.796 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:09:21.796 INFO:teuthology.orchestra.run.smithi195.stdout:Resetting modules: 2024-04-06T12:09:21.796 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools 2024-04-06T12:09:21.796 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:09:21.797 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:09:21.797 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:09:21.797 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:09:22.033 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:09:22.081 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:09:22.864 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:25 ago on Sat 06 Apr 2024 12:07:57 PM UTC. 2024-04-06T12:09:22.914 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:25 ago on Sat 06 Apr 2024 12:07:57 PM UTC. 2024-04-06T12:09:25.000 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:09:25.037 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:09:25.037 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout:Installing group/module packages: 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-04-06T12:09:25.038 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout:Installing module profiles: 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools/common 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools rhel8 2024-04-06T12:09:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:09:25.040 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:09:25.040 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:09:25.040 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2024-04-06T12:09:25.040 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:09:25.040 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 27 M 2024-04-06T12:09:25.040 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 91 M 2024-04-06T12:09:25.040 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:09:25.050 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:09:25.087 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout:Installing group/module packages: 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-04-06T12:09:25.088 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout:Installing module profiles: 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools/common 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout:Enabling module streams: 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools rhel8 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:09:25.089 INFO:teuthology.orchestra.run.smithi195.stdout:Install 13 Packages 2024-04-06T12:09:25.090 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:09:25.090 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 27 M 2024-04-06T12:09:25.090 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 91 M 2024-04-06T12:09:25.091 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:09:25.212 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 5.7 MB/s | 689 kB 00:00 2024-04-06T12:09:25.245 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 6.6 MB/s | 1.0 MB 00:00 2024-04-06T12:09:25.287 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 504 kB/s | 38 kB 00:00 2024-04-06T12:09:25.312 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 3.8 MB/s | 258 kB 00:00 2024-04-06T12:09:25.354 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 4.2 MB/s | 180 kB 00:00 2024-04-06T12:09:25.421 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 372 kB/s | 25 kB 00:00 2024-04-06T12:09:25.480 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): netavark-1.10.3-1.module_el8+951+32019c 21 MB/s | 4.1 MB 00:00 2024-04-06T12:09:25.485 INFO:teuthology.orchestra.run.smithi195.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 3.2 MB/s | 689 kB 00:00 2024-04-06T12:09:25.505 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.1 MB/s | 94 kB 00:00 2024-04-06T12:09:25.519 INFO:teuthology.orchestra.run.smithi195.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 4.1 MB/s | 1.0 MB 00:00 2024-04-06T12:09:25.538 INFO:teuthology.orchestra.run.smithi195.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 756 kB/s | 38 kB 00:00 2024-04-06T12:09:25.603 INFO:teuthology.orchestra.run.smithi195.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 3.0 MB/s | 258 kB 00:00 2024-04-06T12:09:25.622 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): buildah-1.33.6-2.module_el8+976+1136073 18 MB/s | 9.6 MB 00:00 2024-04-06T12:09:25.645 INFO:teuthology.orchestra.run.smithi195.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 4.2 MB/s | 180 kB 00:00 2024-04-06T12:09:25.656 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 1.6 MB/s | 53 kB 00:00 2024-04-06T12:09:25.695 INFO:teuthology.orchestra.run.smithi195.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 491 kB/s | 25 kB 00:00 2024-04-06T12:09:25.748 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 10 MB/s | 2.5 MB 00:00 2024-04-06T12:09:25.762 INFO:teuthology.orchestra.run.smithi195.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2024-04-06T12:09:25.773 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 350 kB/s | 41 kB 00:00 2024-04-06T12:09:25.881 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 22 MB/s | 8.8 MB 00:00 2024-04-06T12:09:25.882 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:09:25.882 INFO:teuthology.orchestra.run.smithi152.stdout:Total 33 MB/s | 27 MB 00:00 2024-04-06T12:09:25.921 INFO:teuthology.orchestra.run.smithi195.stdout:(8/13): netavark-1.10.3-1.module_el8+951+32019c 11 MB/s | 4.1 MB 00:00 2024-04-06T12:09:26.063 INFO:teuthology.orchestra.run.smithi195.stdout:(9/13): buildah-1.33.6-2.module_el8+976+1136073 12 MB/s | 9.6 MB 00:00 2024-04-06T12:09:26.105 INFO:teuthology.orchestra.run.smithi195.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 1.2 MB/s | 53 kB 00:00 2024-04-06T12:09:26.150 INFO:teuthology.orchestra.run.smithi195.stdout:(11/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 11 MB/s | 2.5 MB 00:00 2024-04-06T12:09:26.151 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:09:26.172 INFO:teuthology.orchestra.run.smithi195.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 612 kB/s | 41 kB 00:00 2024-04-06T12:09:26.173 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:09:26.173 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:09:26.348 INFO:teuthology.orchestra.run.smithi195.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 15 MB/s | 8.8 MB 00:00 2024-04-06T12:09:26.348 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:09:26.348 INFO:teuthology.orchestra.run.smithi195.stdout:Total 22 MB/s | 27 MB 00:01 2024-04-06T12:09:26.436 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:09:26.439 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:09:26.617 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:09:26.639 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:09:26.639 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:09:26.901 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:09:26.904 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:09:27.148 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:09:27.592 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:09:28.104 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-04-06T12:09:28.306 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-04-06T12:09:28.502 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-04-06T12:09:28.574 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-04-06T12:09:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-04-06T12:09:28.756 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-04-06T12:09:28.917 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-04-06T12:09:28.945 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-04-06T12:09:29.139 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-04-06T12:09:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-04-06T12:09:29.521 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-04-06T12:09:29.903 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-04-06T12:09:30.511 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-04-06T12:09:30.764 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-04-06T12:09:30.873 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-04-06T12:09:30.985 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-04-06T12:09:31.124 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-04-06T12:09:31.345 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-04-06T12:09:31.444 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-04-06T12:09:31.647 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-06T12:09:31.800 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-04-06T12:09:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-06T12:09:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-06T12:09:32.068 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-06T12:09:32.221 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-06T12:09:32.383 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-06T12:09:32.492 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-06T12:09:32.492 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-06T12:09:32.493 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-06T12:09:32.813 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-06T12:09:32.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-04-06T12:09:32.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-04-06T12:09:32.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-04-06T12:09:32.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-04-06T12:09:32.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-04-06T12:09:32.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-04-06T12:09:32.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-04-06T12:09:32.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-04-06T12:09:32.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-04-06T12:09:32.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-04-06T12:09:32.815 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-06T12:09:32.815 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-06T12:09:32.988 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-04-06T12:09:32.988 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:09:32.988 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:09:32.988 INFO:teuthology.orchestra.run.smithi152.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-04-06T12:09:32.988 INFO:teuthology.orchestra.run.smithi152.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-04-06T12:09:32.988 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-04-06T12:09:32.988 INFO:teuthology.orchestra.run.smithi152.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:09:32.989 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:09:33.308 DEBUG:teuthology.parallel:result is None 2024-04-06T12:09:33.399 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-04-06T12:09:33.399 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:09:33.399 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:09:33.399 INFO:teuthology.orchestra.run.smithi195.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-04-06T12:09:33.399 INFO:teuthology.orchestra.run.smithi195.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-04-06T12:09:33.399 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-04-06T12:09:33.399 INFO:teuthology.orchestra.run.smithi195.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-04-06T12:09:33.399 INFO:teuthology.orchestra.run.smithi195.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-04-06T12:09:33.399 INFO:teuthology.orchestra.run.smithi195.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-04-06T12:09:33.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-04-06T12:09:33.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-06T12:09:33.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-06T12:09:33.400 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-04-06T12:09:33.400 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-04-06T12:09:33.400 INFO:teuthology.orchestra.run.smithi195.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-04-06T12:09:33.400 INFO:teuthology.orchestra.run.smithi195.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-06T12:09:33.400 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:09:33.400 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:09:33.723 DEBUG:teuthology.parallel:result is None 2024-04-06T12:09:33.723 INFO:teuthology.run_tasks:Running task install... 2024-04-06T12:09:33.732 DEBUG:teuthology.task.install:project ceph 2024-04-06T12:09:33.732 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '052adcadd0534eddb0d73c5afbc083a84cd9dc46'}} 2024-04-06T12:09:33.732 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '052adcadd0534eddb0d73c5afbc083a84cd9dc46'} 2024-04-06T12:09:33.732 INFO:teuthology.task.install:Using flavor: default 2024-04-06T12:09:33.741 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-06T12:09:33.741 INFO:teuthology.task.install:extra packages: [] 2024-04-06T12:09:33.741 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '052adcadd0534eddb0d73c5afbc083a84cd9dc46', 'tag': None, 'wait_for_package': False} 2024-04-06T12:09:33.741 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-06T12:09:33.742 INFO:teuthology.packaging:ref: None 2024-04-06T12:09:33.742 INFO:teuthology.packaging:tag: None 2024-04-06T12:09:33.742 INFO:teuthology.packaging:branch: pacific 2024-04-06T12:09:33.742 INFO:teuthology.packaging:sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:09:33.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-04-06T12:09:33.744 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '052adcadd0534eddb0d73c5afbc083a84cd9dc46', 'tag': None, 'wait_for_package': False} 2024-04-06T12:09:33.744 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-06T12:09:33.744 INFO:teuthology.packaging:ref: None 2024-04-06T12:09:33.744 INFO:teuthology.packaging:tag: None 2024-04-06T12:09:33.744 INFO:teuthology.packaging:branch: pacific 2024-04-06T12:09:33.744 INFO:teuthology.packaging:sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:09:33.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-04-06T12:09:34.058 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/ 2024-04-06T12:09:34.059 INFO:teuthology.task.install.rpm:Package version is 16.2.15-0 2024-04-06T12:09:34.072 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/ 2024-04-06T12:09:34.072 INFO:teuthology.task.install.rpm:Package version is 16.2.15-0 2024-04-06T12:09:34.103 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-06T12:09:34.103 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:09:34.103 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-06T12:09:34.114 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-06T12:09:34.114 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:09:34.114 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-06T12:09:34.134 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-06T12:09:34.134 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-06T12:09:34.134 INFO:teuthology.packaging:ref: None 2024-04-06T12:09:34.134 INFO:teuthology.packaging:tag: None 2024-04-06T12:09:34.134 INFO:teuthology.packaging:branch: pacific 2024-04-06T12:09:34.135 INFO:teuthology.packaging:sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:09:34.135 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-06T12:09:34.142 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-06T12:09:34.142 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-06T12:09:34.142 INFO:teuthology.packaging:ref: None 2024-04-06T12:09:34.143 INFO:teuthology.packaging:tag: None 2024-04-06T12:09:34.143 INFO:teuthology.packaging:branch: pacific 2024-04-06T12:09:34.143 INFO:teuthology.packaging:sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:09:34.143 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-06T12:09:34.204 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-06T12:09:34.211 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-06T12:09:34.283 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-06T12:09:34.287 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-06T12:09:34.350 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-04-06T12:09:34.351 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-04-06T12:09:34.354 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-04-06T12:09:34.356 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-04-06T12:09:34.615 INFO:teuthology.orchestra.run.smithi152.stdout:76 files removed 2024-04-06T12:09:34.625 INFO:teuthology.orchestra.run.smithi195.stdout:76 files removed 2024-04-06T12:09:34.643 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw 2024-04-06T12:09:34.652 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw 2024-04-06T12:09:35.129 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 988 kB/s | 76 kB 00:00 2024-04-06T12:09:35.135 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 1.0 MB/s | 76 kB 00:00 2024-04-06T12:09:35.238 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 217 kB/s | 15 kB 00:00 2024-04-06T12:09:35.266 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 159 kB/s | 15 kB 00:00 2024-04-06T12:09:35.343 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2024-04-06T12:09:35.383 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 20 kB/s | 1.7 kB 00:00 2024-04-06T12:09:36.089 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - AppStream 38 MB/s | 28 MB 00:00 2024-04-06T12:09:36.650 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - AppStream 22 MB/s | 28 MB 00:01 2024-04-06T12:09:42.073 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-04-06T12:09:42.359 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-06T12:09:44.191 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras 38 kB/s | 18 kB 00:00 2024-04-06T12:09:44.327 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras 47 kB/s | 18 kB 00:00 2024-04-06T12:09:44.450 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras common packages 51 kB/s | 7.7 kB 00:00 2024-04-06T12:09:44.578 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras common packages 54 kB/s | 7.7 kB 00:00 2024-04-06T12:09:45.652 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - PowerTools 5.0 MB/s | 4.9 MB 00:00 2024-04-06T12:09:45.677 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - PowerTools 4.3 MB/s | 4.9 MB 00:01 2024-04-06T12:09:46.705 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-06T12:09:46.752 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-06T12:09:47.478 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 26 MB/s | 16 MB 00:00 2024-04-06T12:09:48.641 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 16 MB 00:01 2024-04-06T12:09:51.403 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 388 kB/s | 24 kB 00:00 2024-04-06T12:09:52.381 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 422 kB/s | 24 kB 00:00 2024-04-06T12:09:55.093 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:09:55.095 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:09:55.095 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-04-06T12:09:55.095 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:16.2.15-0.el8 ceph 12 M 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:16.2.15-0.el8 ceph 4.2 M 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:16.2.15-0.el8 ceph 6.1 M 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:16.2.15-0.el8 ceph 24 M 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:16.2.15-0.el8 ceph 26 k 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-06T12:09:55.096 INFO:teuthology.orchestra.run.smithi152.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:16.2.15-0.el8 ceph 825 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:16.2.15-0.el8 ceph 494 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:16.2.15-0.el8 ceph 3.8 M 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:16.2.15-0.el8 ceph 45 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:16.2.15-0.el8 ceph 99 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:16.2.15-0.el8 ceph 215 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-06T12:09:55.097 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:16.2.15-0.el8 ceph 389 k 2024-04-06T12:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:16.2.15-0.el8 ceph 369 k 2024-04-06T12:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:16.2.15-0.el8 ceph 114 k 2024-04-06T12:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout:Install 21 Packages 2024-04-06T12:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2024-04-06T12:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:09:55.099 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 58 M 2024-04-06T12:09:55.099 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:09:56.011 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:16.2.15-0.el8 ceph 12 M 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:16.2.15-0.el8 ceph 4.2 M 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:16.2.15-0.el8 ceph 6.1 M 2024-04-06T12:09:56.014 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:16.2.15-0.el8 ceph 24 M 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:16.2.15-0.el8 ceph 26 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:16.2.15-0.el8 ceph 825 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:16.2.15-0.el8 ceph 494 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:16.2.15-0.el8 ceph 3.8 M 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:16.2.15-0.el8 ceph 45 k 2024-04-06T12:09:56.015 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:16.2.15-0.el8 ceph 99 k 2024-04-06T12:09:56.016 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:16.2.15-0.el8 ceph 215 k 2024-04-06T12:09:56.017 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-06T12:09:56.017 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:16.2.15-0.el8 ceph 389 k 2024-04-06T12:09:56.017 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:16.2.15-0.el8 ceph 369 k 2024-04-06T12:09:56.017 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:16.2.15-0.el8 ceph 114 k 2024-04-06T12:09:56.017 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:09:56.017 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:09:56.017 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:09:56.017 INFO:teuthology.orchestra.run.smithi195.stdout:Install 21 Packages 2024-04-06T12:09:56.017 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 2 Packages 2024-04-06T12:09:56.018 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:09:56.018 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 58 M 2024-04-06T12:09:56.018 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:09:56.521 INFO:teuthology.orchestra.run.smithi152.stdout:(1/23): ceph-base-16.2.15-0.el8.x86_64.rpm 15 MB/s | 6.1 MB 00:00 2024-04-06T12:09:56.537 INFO:teuthology.orchestra.run.smithi152.stdout:(2/23): ceph-selinux-16.2.15-0.el8.x86_64.rpm 1.5 MB/s | 26 kB 00:00 2024-04-06T12:09:56.574 INFO:teuthology.orchestra.run.smithi195.stdout:(1/23): ceph-base-16.2.15-0.el8.x86_64.rpm 43 MB/s | 6.1 MB 00:00 2024-04-06T12:09:56.600 INFO:teuthology.orchestra.run.smithi195.stdout:(2/23): ceph-selinux-16.2.15-0.el8.x86_64.rpm 1.0 MB/s | 26 kB 00:00 2024-04-06T12:09:56.634 INFO:teuthology.orchestra.run.smithi195.stdout:(3/23): libcephfs2-16.2.15-0.el8.x86_64.rpm 24 MB/s | 825 kB 00:00 2024-04-06T12:09:56.667 INFO:teuthology.orchestra.run.smithi195.stdout:(4/23): libradosstriper1-16.2.15-0.el8.x86_64.r 14 MB/s | 494 kB 00:00 2024-04-06T12:09:56.671 INFO:teuthology.orchestra.run.smithi152.stdout:(3/23): ceph-radosgw-16.2.15-0.el8.x86_64.rpm 21 MB/s | 12 MB 00:00 2024-04-06T12:09:56.704 INFO:teuthology.orchestra.run.smithi152.stdout:(4/23): libcephfs2-16.2.15-0.el8.x86_64.rpm 4.8 MB/s | 825 kB 00:00 2024-04-06T12:09:56.746 INFO:teuthology.orchestra.run.smithi152.stdout:(5/23): libradosstriper1-16.2.15-0.el8.x86_64.r 6.4 MB/s | 494 kB 00:00 2024-04-06T12:09:56.759 INFO:teuthology.orchestra.run.smithi195.stdout:(5/23): librgw2-16.2.15-0.el8.x86_64.rpm 42 MB/s | 3.8 MB 00:00 2024-04-06T12:09:56.772 INFO:teuthology.orchestra.run.smithi152.stdout:(6/23): python3-ceph-argparse-16.2.15-0.el8.x86 1.8 MB/s | 45 kB 00:00 2024-04-06T12:09:56.784 INFO:teuthology.orchestra.run.smithi195.stdout:(6/23): python3-ceph-argparse-16.2.15-0.el8.x86 1.8 MB/s | 45 kB 00:00 2024-04-06T12:09:56.797 INFO:teuthology.orchestra.run.smithi152.stdout:(7/23): python3-ceph-common-16.2.15-0.el8.x86_6 3.9 MB/s | 99 kB 00:00 2024-04-06T12:09:56.809 INFO:teuthology.orchestra.run.smithi195.stdout:(7/23): python3-ceph-common-16.2.15-0.el8.x86_6 3.9 MB/s | 99 kB 00:00 2024-04-06T12:09:56.822 INFO:teuthology.orchestra.run.smithi152.stdout:(8/23): python3-cephfs-16.2.15-0.el8.x86_64.rpm 8.4 MB/s | 215 kB 00:00 2024-04-06T12:09:56.835 INFO:teuthology.orchestra.run.smithi195.stdout:(8/23): python3-cephfs-16.2.15-0.el8.x86_64.rpm 8.4 MB/s | 215 kB 00:00 2024-04-06T12:09:56.856 INFO:teuthology.orchestra.run.smithi152.stdout:(9/23): python3-rados-16.2.15-0.el8.x86_64.rpm 11 MB/s | 389 kB 00:00 2024-04-06T12:09:56.860 INFO:teuthology.orchestra.run.smithi195.stdout:(9/23): python3-rados-16.2.15-0.el8.x86_64.rpm 15 MB/s | 389 kB 00:00 2024-04-06T12:09:56.894 INFO:teuthology.orchestra.run.smithi195.stdout:(10/23): python3-rbd-16.2.15-0.el8.x86_64.rpm 11 MB/s | 369 kB 00:00 2024-04-06T12:09:56.914 INFO:teuthology.orchestra.run.smithi152.stdout:(10/23): python3-rbd-16.2.15-0.el8.x86_64.rpm 6.2 MB/s | 369 kB 00:00 2024-04-06T12:09:56.919 INFO:teuthology.orchestra.run.smithi195.stdout:(11/23): python3-rgw-16.2.15-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2024-04-06T12:09:56.940 INFO:teuthology.orchestra.run.smithi152.stdout:(11/23): python3-rgw-16.2.15-0.el8.x86_64.rpm 4.4 MB/s | 114 kB 00:00 2024-04-06T12:09:57.007 INFO:teuthology.orchestra.run.smithi152.stdout:(12/23): librgw2-16.2.15-0.el8.x86_64.rpm 13 MB/s | 3.8 MB 00:00 2024-04-06T12:09:57.078 INFO:teuthology.orchestra.run.smithi195.stdout:(12/23): ceph-radosgw-16.2.15-0.el8.x86_64.rpm 18 MB/s | 12 MB 00:00 2024-04-06T12:09:57.291 INFO:teuthology.orchestra.run.smithi152.stdout:(13/23): ceph-common-16.2.15-0.el8.x86_64.rpm 21 MB/s | 24 MB 00:01 2024-04-06T12:09:57.341 INFO:teuthology.orchestra.run.smithi152.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 778 kB/s | 259 kB 00:00 2024-04-06T12:09:57.361 INFO:teuthology.orchestra.run.smithi195.stdout:(13/23): ceph-common-16.2.15-0.el8.x86_64.rpm 26 MB/s | 24 MB 00:00 2024-04-06T12:09:57.366 INFO:teuthology.orchestra.run.smithi152.stdout:(15/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.6 MB/s | 677 kB 00:00 2024-04-06T12:09:57.387 INFO:teuthology.orchestra.run.smithi195.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 842 kB/s | 259 kB 00:00 2024-04-06T12:09:57.429 INFO:teuthology.orchestra.run.smithi195.stdout:(15/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.3 MB/s | 677 kB 00:00 2024-04-06T12:09:57.454 INFO:teuthology.orchestra.run.smithi195.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 477 kB/s | 44 kB 00:00 2024-04-06T12:09:57.516 INFO:teuthology.orchestra.run.smithi152.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 195 kB/s | 44 kB 00:00 2024-04-06T12:09:57.542 INFO:teuthology.orchestra.run.smithi152.stdout:(17/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 235 kB/s | 47 kB 00:00 2024-04-06T12:09:57.563 INFO:teuthology.orchestra.run.smithi195.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 1.6 MB/s | 181 kB 00:00 2024-04-06T12:09:57.588 INFO:teuthology.orchestra.run.smithi195.stdout:(18/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 234 kB/s | 47 kB 00:00 2024-04-06T12:09:57.613 INFO:teuthology.orchestra.run.smithi195.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2024-04-06T12:09:57.638 INFO:teuthology.orchestra.run.smithi195.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2024-04-06T12:09:57.696 INFO:teuthology.orchestra.run.smithi195.stdout:(21/23): libunwind-1.3.1-3.el8.x86_64.rpm 694 kB/s | 75 kB 00:00 2024-04-06T12:09:57.772 INFO:teuthology.orchestra.run.smithi195.stdout:(22/23): librados2-16.2.15-0.el8.x86_64.rpm 24 MB/s | 3.7 MB 00:00 2024-04-06T12:09:57.831 INFO:teuthology.orchestra.run.smithi195.stdout:(23/23): librbd1-16.2.15-0.el8.x86_64.rpm 22 MB/s | 4.2 MB 00:00 2024-04-06T12:09:57.833 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:09:57.833 INFO:teuthology.orchestra.run.smithi195.stdout:Total 32 MB/s | 58 MB 00:01 2024-04-06T12:09:57.834 INFO:teuthology.orchestra.run.smithi152.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 655 kB/s | 306 kB 00:00 2024-04-06T12:09:57.859 INFO:teuthology.orchestra.run.smithi152.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 185 kB/s | 59 kB 00:00 2024-04-06T12:09:57.877 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:09:57.924 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:09:57.924 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:09:57.934 INFO:teuthology.orchestra.run.smithi152.stdout:(20/23): librados2-16.2.15-0.el8.x86_64.rpm 50 MB/s | 3.7 MB 00:00 2024-04-06T12:09:57.959 INFO:teuthology.orchestra.run.smithi152.stdout:(21/23): libunwind-1.3.1-3.el8.x86_64.rpm 599 kB/s | 75 kB 00:00 2024-04-06T12:09:58.035 INFO:teuthology.orchestra.run.smithi152.stdout:(22/23): librbd1-16.2.15-0.el8.x86_64.rpm 42 MB/s | 4.2 MB 00:00 2024-04-06T12:09:58.060 INFO:teuthology.orchestra.run.smithi152.stdout:(23/23): leveldb-1.22-1.el8.x86_64.rpm 333 kB/s | 181 kB 00:00 2024-04-06T12:09:58.061 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:09:58.062 INFO:teuthology.orchestra.run.smithi152.stdout:Total 20 MB/s | 58 MB 00:02 2024-04-06T12:09:58.104 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:09:58.151 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:09:58.151 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:09:58.458 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:09:58.462 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:09:58.508 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:09:58.511 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:09:59.489 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:09:59.714 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-04-06T12:09:59.861 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:09:59.897 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-06T12:10:00.086 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-04-06T12:10:00.272 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-06T12:10:00.290 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-06T12:10:00.488 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:16.2.15-0.el8.x86_64 3/25 2024-04-06T12:10:00.581 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.15-0.el8.x86_64 3/25 2024-04-06T12:10:00.662 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-06T12:10:00.808 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:16.2.15-0.el8.x86_64 4/25 2024-04-06T12:10:00.847 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:16.2.15-0.el8.x86_64 3/25 2024-04-06T12:10:00.968 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.15-0.el8.x86_64 3/25 2024-04-06T12:10:01.013 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-04-06T12:10:01.206 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:16.2.15-0.el8.x86_64 4/25 2024-04-06T12:10:01.406 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-04-06T12:10:01.418 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-04-06T12:10:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:16.2.15-0.el8.x86_64 6/25 2024-04-06T12:10:01.677 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.15-0.el8.x86_64 6/25 2024-04-06T12:10:01.825 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-04-06T12:10:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-04-06T12:10:01.997 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:16.2.15-0.el8.x86_64 6/25 2024-04-06T12:10:02.048 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.15-0.el8.x86_64 6/25 2024-04-06T12:10:02.261 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-04-06T12:10:02.358 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-04-06T12:10:02.513 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:16.2.15-0.el8.x86_64 9/25 2024-04-06T12:10:02.592 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:16.2.15-0.el8.x86_64 9/25 2024-04-06T12:10:02.747 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-04-06T12:10:02.776 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-04-06T12:10:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:16.2.15-0.el8.x86_64 9/25 2024-04-06T12:10:02.959 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 11/25 2024-04-06T12:10:02.971 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:16.2.15-0.el8.x86_64 9/25 2024-04-06T12:10:03.125 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:16.2.15-0.el8.x86_64 12/25 2024-04-06T12:10:03.169 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-04-06T12:10:03.319 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 11/25 2024-04-06T12:10:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:16.2.15-0.el8.x86_64 13/25 2024-04-06T12:10:03.500 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:16.2.15-0.el8.x86_64 12/25 2024-04-06T12:10:03.546 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:16.2.15-0.el8.x86_64 14/25 2024-04-06T12:10:03.679 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:16.2.15-0.el8.x86_64 15/25 2024-04-06T12:10:03.723 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:16.2.15-0.el8.x86_64 13/25 2024-04-06T12:10:03.729 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:16.2.15-0.el8.x86_64 15/25 2024-04-06T12:10:03.922 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:16.2.15-0.el8.x86_64 14/25 2024-04-06T12:10:04.113 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:16.2.15-0.el8.x86_64 15/25 2024-04-06T12:10:04.191 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:16.2.15-0.el8.x86_64 15/25 2024-04-06T12:10:04.297 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-04-06T12:10:04.763 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-04-06T12:10:04.951 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-04-06T12:10:05.033 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-04-06T12:10:05.130 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:16.2.15-0.el8.x86_64 19/25 2024-04-06T12:10:05.222 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-04-06T12:10:05.419 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-04-06T12:10:05.606 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:16.2.15-0.el8.x86_64 19/25 2024-04-06T12:10:07.630 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-04-06T12:10:07.829 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-04-06T12:10:08.120 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-04-06T12:10:08.346 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-04-06T12:10:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-04-06T12:10:08.831 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:16.2.15-0.el8.x86_64 21/25 2024-04-06T12:10:08.936 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64 21/25 2024-04-06T12:10:09.052 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-04-06T12:10:09.112 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:16.2.15-0.el8.x86_64 22/25 2024-04-06T12:10:09.346 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:16.2.15-0.el8.x86_64 21/25 2024-04-06T12:10:09.457 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64 21/25 2024-04-06T12:10:09.604 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:16.2.15-0.el8.x86_64 22/25 2024-04-06T12:10:28.267 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:16.2.15-0.el8.x86_64 22/25 2024-04-06T12:10:28.267 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-04-06T12:10:28.267 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-04-06T12:10:28.268 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2024-04-06T12:10:28.268 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /run 2024-04-06T12:10:28.268 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-04-06T12:10:28.268 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-04-06T12:10:28.268 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-04-06T12:10:28.268 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-04-06T12:10:28.268 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2024-04-06T12:10:28.268 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:10:28.749 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:16.2.15-0.el8.x86_64 22/25 2024-04-06T12:10:28.749 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-04-06T12:10:28.749 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-04-06T12:10:28.750 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2024-04-06T12:10:28.750 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /run 2024-04-06T12:10:28.750 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-04-06T12:10:28.750 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-04-06T12:10:28.750 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-04-06T12:10:28.750 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-04-06T12:10:28.750 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2024-04-06T12:10:28.750 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:10:29.478 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:16.2.15-0.el8.x86_64 23/25 2024-04-06T12:10:29.558 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64 23/25 2024-04-06T12:10:29.558 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-06T12:10:29.786 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-06T12:10:29.786 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-06T12:10:29.934 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:16.2.15-0.el8.x86_64 23/25 2024-04-06T12:10:30.047 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64 23/25 2024-04-06T12:10:30.047 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-06T12:10:30.261 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-06T12:10:30.262 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-06T12:10:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:16.2.15-0.el8.x86_64 1/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:16.2.15-0.el8.x86_64 2/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:16.2.15-0.el8.x86_64 3/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:16.2.15-0.el8.x86_64 4/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:16.2.15-0.el8.x86_64 6/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:16.2.15-0.el8.x86_64 7/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 8/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:16.2.15-0.el8.x86_64 9/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:16.2.15-0.el8.x86_64 10/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:16.2.15-0.el8.x86_64 11/25 2024-04-06T12:10:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:16.2.15-0.el8.x86_64 12/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:16.2.15-0.el8.x86_64 13/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.15-0.el8.x86_64 22/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-06T12:10:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.15-0.el8.x86_64 24/25 2024-04-06T12:10:30.978 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-06T12:10:30.978 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:16.2.15-0.el8.x86_64 1/25 2024-04-06T12:10:30.978 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:16.2.15-0.el8.x86_64 2/25 2024-04-06T12:10:30.978 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:16.2.15-0.el8.x86_64 3/25 2024-04-06T12:10:30.978 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:16.2.15-0.el8.x86_64 4/25 2024-04-06T12:10:30.978 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-04-06T12:10:30.978 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:16.2.15-0.el8.x86_64 6/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:16.2.15-0.el8.x86_64 7/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 8/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:16.2.15-0.el8.x86_64 9/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:16.2.15-0.el8.x86_64 10/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:16.2.15-0.el8.x86_64 11/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:16.2.15-0.el8.x86_64 12/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:16.2.15-0.el8.x86_64 13/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-04-06T12:10:30.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-04-06T12:10:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-04-06T12:10:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.15-0.el8.x86_64 22/25 2024-04-06T12:10:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-06T12:10:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.15-0.el8.x86_64 24/25 2024-04-06T12:10:31.388 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-06T12:10:31.388 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:10:31.388 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-04-06T12:10:31.388 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:16.2.15-0.el8.x86_64 librbd1-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.388 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: leveldb-1.22-1.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-06T12:10:31.389 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-06T12:10:31.390 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.390 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.390 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.390 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-06T12:10:31.390 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.390 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.390 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.390 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:10:31.390 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:10:31.706 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-test 2024-04-06T12:10:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-06T12:10:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:10:31.781 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-04-06T12:10:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:16.2.15-0.el8.x86_64 librbd1-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.781 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:10:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: leveldb-1.22-1.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-06T12:10:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:16.2.15-0.el8.x86_64 2024-04-06T12:10:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:10:31.783 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:10:32.090 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-test 2024-04-06T12:10:32.441 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:40 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:10:32.825 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:41 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:10:34.075 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:10:34.076 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:10:34.076 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:10:34.076 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:10:34.076 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:10:34.076 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:16.2.15-0.el8 ceph 52 M 2024-04-06T12:10:34.076 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:10:34.076 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-06T12:10:34.077 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:16.2.15-0.el8 ceph 174 k 2024-04-06T12:10:34.077 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-06T12:10:34.077 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-06T12:10:34.077 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-06T12:10:34.077 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:10:34.077 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:10:34.077 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:10:34.077 INFO:teuthology.orchestra.run.smithi195.stdout:Install 6 Packages 2024-04-06T12:10:34.077 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:10:34.078 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 53 M 2024-04-06T12:10:34.078 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 197 M 2024-04-06T12:10:34.078 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:10:34.183 INFO:teuthology.orchestra.run.smithi195.stdout:(1/6): libcephsqlite-16.2.15-0.el8.x86_64.rpm 3.2 MB/s | 174 kB 00:00 2024-04-06T12:10:34.225 INFO:teuthology.orchestra.run.smithi195.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 2.1 MB/s | 203 kB 00:00 2024-04-06T12:10:34.267 INFO:teuthology.orchestra.run.smithi195.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-06T12:10:34.292 INFO:teuthology.orchestra.run.smithi195.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2024-04-06T12:10:34.318 INFO:teuthology.orchestra.run.smithi195.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-04-06T12:10:34.459 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:16.2.15-0.el8 ceph 52 M 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:16.2.15-0.el8 ceph 174 k 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-06T12:10:34.461 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:10:34.462 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:10:34.462 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:10:34.462 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2024-04-06T12:10:34.462 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:10:34.462 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 53 M 2024-04-06T12:10:34.462 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 197 M 2024-04-06T12:10:34.463 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:10:34.704 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): libcephsqlite-16.2.15-0.el8.x86_64.rpm 3.0 MB/s | 174 kB 00:00 2024-04-06T12:10:34.738 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 2.2 MB/s | 203 kB 00:00 2024-04-06T12:10:34.788 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2024-04-06T12:10:34.838 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): oniguruma-6.8.2-3.el8.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-04-06T12:10:34.863 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 942 kB/s | 71 kB 00:00 2024-04-06T12:10:35.518 INFO:teuthology.orchestra.run.smithi195.stdout:(6/6): ceph-test-16.2.15-0.el8.x86_64.rpm 38 MB/s | 52 MB 00:01 2024-04-06T12:10:35.520 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:10:35.520 INFO:teuthology.orchestra.run.smithi195.stdout:Total 37 MB/s | 53 MB 00:01 2024-04-06T12:10:35.562 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:10:35.572 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): ceph-test-16.2.15-0.el8.x86_64.rpm 56 MB/s | 52 MB 00:00 2024-04-06T12:10:35.574 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:10:35.574 INFO:teuthology.orchestra.run.smithi152.stdout:Total 48 MB/s | 53 MB 00:01 2024-04-06T12:10:35.583 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:10:35.583 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:10:35.616 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:10:35.637 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:10:35.637 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:10:35.885 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:10:35.888 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:10:35.936 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:10:35.939 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:10:36.356 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:10:36.412 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:10:36.555 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-04-06T12:10:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-04-06T12:10:36.760 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-04-06T12:10:36.853 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-04-06T12:10:36.909 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-06T12:10:36.975 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-06T12:10:36.989 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-06T12:10:37.042 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-06T12:10:37.172 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-04-06T12:10:37.264 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-04-06T12:10:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:16.2.15-0.el8.x86_64 5/6 2024-04-06T12:10:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:16.2.15-0.el8.x86_64 5/6 2024-04-06T12:10:41.944 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:16.2.15-0.el8.x86_64 5/6 2024-04-06T12:10:42.048 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:16.2.15-0.el8.x86_64 5/6 2024-04-06T12:10:42.180 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:16.2.15-0.el8.x86_64 6/6 2024-04-06T12:10:42.306 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:16.2.15-0.el8.x86_64 6/6 2024-04-06T12:10:42.457 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-test-2:16.2.15-0.el8.x86_64 6/6 2024-04-06T12:10:42.458 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:16.2.15-0.el8.x86_64 1/6 2024-04-06T12:10:42.458 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:16.2.15-0.el8.x86_64 2/6 2024-04-06T12:10:42.458 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-04-06T12:10:42.458 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-04-06T12:10:42.458 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-04-06T12:10:42.600 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-test-2:16.2.15-0.el8.x86_64 6/6 2024-04-06T12:10:42.600 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:16.2.15-0.el8.x86_64 1/6 2024-04-06T12:10:42.600 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:16.2.15-0.el8.x86_64 2/6 2024-04-06T12:10:42.600 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-04-06T12:10:42.600 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-04-06T12:10:42.600 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-04-06T12:10:42.925 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-04-06T12:10:42.925 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:10:42.925 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:10:42.925 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:16.2.15-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-06T12:10:42.926 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:16.2.15-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-04-06T12:10:42.926 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-04-06T12:10:42.926 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:10:42.926 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:10:43.048 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-04-06T12:10:43.048 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:10:43.048 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:10:43.048 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:16.2.15-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-06T12:10:43.048 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:16.2.15-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-04-06T12:10:43.048 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-04-06T12:10:43.049 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:10:43.049 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:10:43.164 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph 2024-04-06T12:10:43.301 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph 2024-04-06T12:10:43.910 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:51 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:10:44.038 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:53 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:10:45.551 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:16.2.15-0.el8 ceph 6.3 k 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:16.2.15-0.el8 ceph 2.4 M 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:16.2.15-0.el8 ceph 1.6 M 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:16.2.15-0.el8 ceph-noarch 245 k 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:16.2.15-0.el8 ceph 5.2 M 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:16.2.15-0.el8 ceph 19 M 2024-04-06T12:10:45.555 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-06T12:10:45.556 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout:Install 32 Packages 2024-04-06T12:10:45.557 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:10:45.558 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 32 M 2024-04-06T12:10:45.558 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 104 M 2024-04-06T12:10:45.558 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:10:45.697 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:10:45.701 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:16.2.15-0.el8 ceph 6.3 k 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:16.2.15-0.el8 ceph 2.4 M 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:16.2.15-0.el8 ceph 1.6 M 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:16.2.15-0.el8 ceph-noarch 245 k 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:16.2.15-0.el8 ceph 5.2 M 2024-04-06T12:10:45.702 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:16.2.15-0.el8 ceph 19 M 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-06T12:10:45.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:10:45.704 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:10:45.705 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:10:45.705 INFO:teuthology.orchestra.run.smithi152.stdout:Install 32 Packages 2024-04-06T12:10:45.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:10:45.705 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 32 M 2024-04-06T12:10:45.705 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 104 M 2024-04-06T12:10:45.705 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:10:46.106 INFO:teuthology.orchestra.run.smithi152.stdout:(1/32): ceph-16.2.15-0.el8.x86_64.rpm 104 kB/s | 6.3 kB 00:00 2024-04-06T12:10:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:(1/32): ceph-16.2.15-0.el8.x86_64.rpm 82 kB/s | 6.3 kB 00:00 2024-04-06T12:10:46.220 INFO:teuthology.orchestra.run.smithi195.stdout:(2/32): ceph-mds-16.2.15-0.el8.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-04-06T12:10:46.222 INFO:teuthology.orchestra.run.smithi152.stdout:(2/32): ceph-mds-16.2.15-0.el8.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-04-06T12:10:46.262 INFO:teuthology.orchestra.run.smithi195.stdout:(3/32): ceph-mgr-16.2.15-0.el8.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-04-06T12:10:46.273 INFO:teuthology.orchestra.run.smithi152.stdout:(3/32): ceph-mgr-16.2.15-0.el8.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-04-06T12:10:46.304 INFO:teuthology.orchestra.run.smithi195.stdout:(4/32): ceph-mgr-modules-core-16.2.15-0.el8.noa 5.7 MB/s | 245 kB 00:00 2024-04-06T12:10:46.306 INFO:teuthology.orchestra.run.smithi152.stdout:(4/32): ceph-mgr-modules-core-16.2.15-0.el8.noa 7.2 MB/s | 245 kB 00:00 2024-04-06T12:10:46.388 INFO:teuthology.orchestra.run.smithi195.stdout:(5/32): ceph-mon-16.2.15-0.el8.x86_64.rpm 19 MB/s | 5.2 MB 00:00 2024-04-06T12:10:46.398 INFO:teuthology.orchestra.run.smithi152.stdout:(5/32): ceph-mon-16.2.15-0.el8.x86_64.rpm 18 MB/s | 5.2 MB 00:00 2024-04-06T12:10:46.446 INFO:teuthology.orchestra.run.smithi195.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 667 kB/s | 39 kB 00:00 2024-04-06T12:10:46.448 INFO:teuthology.orchestra.run.smithi152.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-04-06T12:10:46.471 INFO:teuthology.orchestra.run.smithi195.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 941 kB/s | 157 kB 00:00 2024-04-06T12:10:46.490 INFO:teuthology.orchestra.run.smithi152.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.4 MB/s | 103 kB 00:00 2024-04-06T12:10:46.505 INFO:teuthology.orchestra.run.smithi195.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.7 MB/s | 103 kB 00:00 2024-04-06T12:10:46.515 INFO:teuthology.orchestra.run.smithi152.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 331 kB/s | 39 kB 00:00 2024-04-06T12:10:46.522 INFO:teuthology.orchestra.run.smithi195.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2024-04-06T12:10:46.541 INFO:teuthology.orchestra.run.smithi152.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2024-04-06T12:10:46.600 INFO:teuthology.orchestra.run.smithi152.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 5.3 MB/s | 457 kB 00:00 2024-04-06T12:10:46.706 INFO:teuthology.orchestra.run.smithi195.stdout:(10/32): ceph-osd-16.2.15-0.el8.x86_64.rpm 38 MB/s | 19 MB 00:00 2024-04-06T12:10:46.731 INFO:teuthology.orchestra.run.smithi195.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.0 MB/s | 457 kB 00:00 2024-04-06T12:10:46.808 INFO:teuthology.orchestra.run.smithi152.stdout:(11/32): ceph-osd-16.2.15-0.el8.x86_64.rpm 32 MB/s | 19 MB 00:00 2024-04-06T12:10:46.900 INFO:teuthology.orchestra.run.smithi152.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 693 kB/s | 249 kB 00:00 2024-04-06T12:10:46.923 INFO:teuthology.orchestra.run.smithi195.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 621 kB/s | 249 kB 00:00 2024-04-06T12:10:46.948 INFO:teuthology.orchestra.run.smithi195.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 502 kB/s | 109 kB 00:00 2024-04-06T12:10:47.032 INFO:teuthology.orchestra.run.smithi195.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 1.9 MB/s | 641 kB 00:00 2024-04-06T12:10:47.050 INFO:teuthology.orchestra.run.smithi152.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 291 kB/s | 44 kB 00:00 2024-04-06T12:10:47.084 INFO:teuthology.orchestra.run.smithi152.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 1.3 MB/s | 641 kB 00:00 2024-04-06T12:10:47.109 INFO:teuthology.orchestra.run.smithi152.stdout:(15/32): python3-pycparser-2.14-14.el8.noarch.r 363 kB/s | 109 kB 00:00 2024-04-06T12:10:47.185 INFO:teuthology.orchestra.run.smithi152.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.3 MB/s | 185 kB 00:00 2024-04-06T12:10:47.243 INFO:teuthology.orchestra.run.smithi152.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2024-04-06T12:10:47.274 INFO:teuthology.orchestra.run.smithi195.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 124 kB/s | 44 kB 00:00 2024-04-06T12:10:47.323 INFO:teuthology.orchestra.run.smithi152.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 725 kB/s | 173 kB 00:00 2024-04-06T12:10:47.352 INFO:teuthology.orchestra.run.smithi152.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 162 kB/s | 18 kB 00:00 2024-04-06T12:10:47.386 INFO:teuthology.orchestra.run.smithi152.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 777 kB/s | 49 kB 00:00 2024-04-06T12:10:47.411 INFO:teuthology.orchestra.run.smithi152.stdout:(21/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.2 MB/s | 384 kB 00:00 2024-04-06T12:10:47.432 INFO:teuthology.orchestra.run.smithi195.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 383 kB/s | 185 kB 00:00 2024-04-06T12:10:47.436 INFO:teuthology.orchestra.run.smithi152.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 700 kB/s | 59 kB 00:00 2024-04-06T12:10:47.470 INFO:teuthology.orchestra.run.smithi152.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2024-04-06T12:10:47.495 INFO:teuthology.orchestra.run.smithi152.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 320 kB/s | 19 kB 00:00 2024-04-06T12:10:47.499 INFO:teuthology.orchestra.run.smithi195.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 369 kB/s | 173 kB 00:00 2024-04-06T12:10:47.521 INFO:teuthology.orchestra.run.smithi152.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2024-04-06T12:10:47.525 INFO:teuthology.orchestra.run.smithi195.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2024-04-06T12:10:47.537 INFO:teuthology.orchestra.run.smithi152.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 356 kB/s | 24 kB 00:00 2024-04-06T12:10:47.554 INFO:teuthology.orchestra.run.smithi152.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 496 kB/s | 29 kB 00:00 2024-04-06T12:10:47.571 INFO:teuthology.orchestra.run.smithi152.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 546 kB/s | 27 kB 00:00 2024-04-06T12:10:47.621 INFO:teuthology.orchestra.run.smithi152.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.0 MB/s | 255 kB 00:00 2024-04-06T12:10:47.630 INFO:teuthology.orchestra.run.smithi195.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 134 kB/s | 18 kB 00:00 2024-04-06T12:10:47.647 INFO:teuthology.orchestra.run.smithi152.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2024-04-06T12:10:47.659 INFO:teuthology.orchestra.run.smithi195.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.0 MB/s | 384 kB 00:00 2024-04-06T12:10:47.672 INFO:teuthology.orchestra.run.smithi152.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.1 MB/s | 251 kB 00:00 2024-04-06T12:10:47.684 INFO:teuthology.orchestra.run.smithi195.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 307 kB/s | 49 kB 00:00 2024-04-06T12:10:47.689 INFO:teuthology.orchestra.run.smithi152.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 343 kB/s | 23 kB 00:00 2024-04-06T12:10:47.690 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:10:47.691 INFO:teuthology.orchestra.run.smithi152.stdout:Total 16 MB/s | 32 MB 00:01 2024-04-06T12:10:47.742 INFO:teuthology.orchestra.run.smithi195.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 527 kB/s | 59 kB 00:00 2024-04-06T12:10:47.772 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:10:47.784 INFO:teuthology.orchestra.run.smithi195.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2024-04-06T12:10:47.811 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:10:47.811 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:10:47.826 INFO:teuthology.orchestra.run.smithi195.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2024-04-06T12:10:47.852 INFO:teuthology.orchestra.run.smithi195.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 172 kB/s | 19 kB 00:00 2024-04-06T12:10:47.885 INFO:teuthology.orchestra.run.smithi195.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 238 kB/s | 24 kB 00:00 2024-04-06T12:10:47.927 INFO:teuthology.orchestra.run.smithi195.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 291 kB/s | 29 kB 00:00 2024-04-06T12:10:47.961 INFO:teuthology.orchestra.run.smithi195.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 253 kB/s | 27 kB 00:00 2024-04-06T12:10:48.061 INFO:teuthology.orchestra.run.smithi195.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.4 MB/s | 255 kB 00:00 2024-04-06T12:10:48.086 INFO:teuthology.orchestra.run.smithi195.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.5 MB/s | 251 kB 00:00 2024-04-06T12:10:48.112 INFO:teuthology.orchestra.run.smithi195.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 567 kB/s | 85 kB 00:00 2024-04-06T12:10:48.126 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:10:48.129 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:10:48.162 INFO:teuthology.orchestra.run.smithi195.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 229 kB/s | 23 kB 00:00 2024-04-06T12:10:48.163 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:10:48.163 INFO:teuthology.orchestra.run.smithi195.stdout:Total 12 MB/s | 32 MB 00:02 2024-04-06T12:10:48.244 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:10:48.282 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:10:48.282 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:10:48.613 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:10:48.616 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:10:49.267 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:10:49.487 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-06T12:10:49.706 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-06T12:10:49.745 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:10:49.955 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-06T12:10:49.977 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-06T12:10:50.171 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-06T12:10:50.238 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-06T12:10:50.385 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-06T12:10:50.481 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-06T12:10:50.565 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-06T12:10:50.703 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-06T12:10:50.734 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-06T12:10:50.884 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-06T12:10:50.945 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-06T12:10:51.049 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-06T12:10:51.169 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-06T12:10:51.233 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-06T12:10:51.436 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-06T12:10:51.440 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-06T12:10:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-06T12:10:51.670 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-06T12:10:51.841 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-06T12:10:51.945 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-06T12:10:52.095 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-06T12:10:52.320 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-06T12:10:52.336 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-06T12:10:52.609 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-06T12:10:52.681 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-06T12:10:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-06T12:10:52.924 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-06T12:10:53.063 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-06T12:10:53.096 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-06T12:10:53.273 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-06T12:10:53.370 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-06T12:10:53.564 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-06T12:10:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-06T12:10:53.855 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-06T12:10:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-06T12:10:54.083 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-06T12:10:54.093 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-06T12:10:54.260 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-06T12:10:54.265 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-06T12:10:54.418 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-06T12:10:54.546 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-06T12:10:54.677 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-06T12:10:54.790 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-06T12:10:54.868 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-06T12:10:55.010 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-06T12:10:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-06T12:10:55.351 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-06T12:10:55.381 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-06T12:10:55.642 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-06T12:10:55.682 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-06T12:10:56.008 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 27/32 2024-04-06T12:10:56.060 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 27/32 2024-04-06T12:10:56.272 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:16.2.15-0.el8.x86_64 28/32 2024-04-06T12:10:56.282 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:16.2.15-0.el8.x86_64 28/32 2024-04-06T12:10:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64 28/32 2024-04-06T12:10:57.810 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64 28/32 2024-04-06T12:10:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:16.2.15-0.el8.x86_64 29/32 2024-04-06T12:10:57.996 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:16.2.15-0.el8.x86_64 29/32 2024-04-06T12:10:58.432 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64 29/32 2024-04-06T12:10:58.439 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64 29/32 2024-04-06T12:10:58.632 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:16.2.15-0.el8.x86_64 30/32 2024-04-06T12:10:58.649 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:16.2.15-0.el8.x86_64 30/32 2024-04-06T12:10:58.849 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64 30/32 2024-04-06T12:10:58.866 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64 30/32 2024-04-06T12:10:59.063 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:16.2.15-0.el8.x86_64 31/32 2024-04-06T12:10:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:16.2.15-0.el8.x86_64 31/32 2024-04-06T12:10:59.081 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64 31/32 2024-04-06T12:10:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64 31/32 2024-04-06T12:10:59.212 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:16.2.15-0.el8.x86_64 32/32 2024-04-06T12:10:59.238 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:16.2.15-0.el8.x86_64 32/32 2024-04-06T12:10:59.605 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-2:16.2.15-0.el8.x86_64 32/32 2024-04-06T12:10:59.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:16.2.15-0.el8.x86_64 1/32 2024-04-06T12:10:59.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:16.2.15-0.el8.x86_64 2/32 2024-04-06T12:10:59.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:16.2.15-0.el8.x86_64 3/32 2024-04-06T12:10:59.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:16.2.15-0.el8.x86_64 4/32 2024-04-06T12:10:59.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:16.2.15-0.el8.x86_64 5/32 2024-04-06T12:10:59.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 6/32 2024-04-06T12:10:59.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-06T12:10:59.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-06T12:10:59.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-06T12:10:59.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-06T12:10:59.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-06T12:10:59.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-06T12:10:59.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-06T12:10:59.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-06T12:10:59.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-06T12:10:59.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-06T12:10:59.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-06T12:10:59.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-06T12:10:59.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-06T12:10:59.657 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-2:16.2.15-0.el8.x86_64 32/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:16.2.15-0.el8.x86_64 1/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:16.2.15-0.el8.x86_64 2/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:16.2.15-0.el8.x86_64 3/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:16.2.15-0.el8.x86_64 4/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:16.2.15-0.el8.x86_64 5/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 6/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-06T12:10:59.658 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-06T12:10:59.659 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-06T12:10:59.660 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-06T12:10:59.660 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-06T12:10:59.660 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-06T12:10:59.660 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-06T12:11:00.508 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-06T12:11:00.508 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:11:00.508 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-06T12:11:00.509 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-2.6-1.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-06T12:11:00.510 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-06T12:11:00.511 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-06T12:11:00.511 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-06T12:11:00.511 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:00.511 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:00.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-06T12:11:00.524 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:00.524 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:11:00.524 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.524 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.524 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.524 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-06T12:11:00.525 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-2.6-1.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-06T12:11:00.526 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:00.527 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:00.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-base 2024-04-06T12:11:00.828 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-base 2024-04-06T12:11:01.514 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:10 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:01.583 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:09 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:03.103 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-base-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:11:03.137 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-base-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:11:03.151 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:03.153 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-04-06T12:11:03.153 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:03.185 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:03.186 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-06T12:11:03.186 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:03.260 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install cephadm 2024-04-06T12:11:03.338 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install cephadm 2024-04-06T12:11:04.009 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:13 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:04.085 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:12 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:05.684 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:05.685 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:05.685 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:11:05.685 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:05.685 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:11:05.685 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:16.2.15-0.el8 ceph-noarch 85 k 2024-04-06T12:11:05.686 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:05.686 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:11:05.686 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:05.686 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-04-06T12:11:05.686 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:05.686 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 85 k 2024-04-06T12:11:05.686 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 352 k 2024-04-06T12:11:05.686 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:11:05.718 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:05.718 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:05.719 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:11:05.719 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:05.719 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:11:05.719 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:16.2.15-0.el8 ceph-noarch 85 k 2024-04-06T12:11:05.719 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:05.719 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:11:05.719 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:05.719 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-04-06T12:11:05.719 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:05.720 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 85 k 2024-04-06T12:11:05.720 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 352 k 2024-04-06T12:11:05.720 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:11:05.752 INFO:teuthology.orchestra.run.smithi152.stdout:cephadm-16.2.15-0.el8.noarch.rpm 1.3 MB/s | 85 kB 00:00 2024-04-06T12:11:05.752 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:05.752 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.3 MB/s | 85 kB 00:00 2024-04-06T12:11:05.752 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:11:05.759 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:11:05.759 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:11:05.761 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:11:05.764 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:11:05.769 INFO:teuthology.orchestra.run.smithi195.stdout:cephadm-16.2.15-0.el8.noarch.rpm 1.7 MB/s | 85 kB 00:00 2024-04-06T12:11:05.770 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:05.770 INFO:teuthology.orchestra.run.smithi195.stdout:Total 1.6 MB/s | 85 kB 00:00 2024-04-06T12:11:05.770 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:11:05.777 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:11:05.777 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:11:05.779 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:11:05.782 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:11:05.827 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:11:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:11:06.326 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:16.2.15-0.el8.noarch 1/1 2024-04-06T12:11:06.335 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:16.2.15-0.el8.noarch 1/1 2024-04-06T12:11:06.516 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:16.2.15-0.el8.noarch 1/1 2024-04-06T12:11:06.535 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:16.2.15-0.el8.noarch 1/1 2024-04-06T12:11:06.744 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:16.2.15-0.el8.noarch 1/1 2024-04-06T12:11:06.759 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:16.2.15-0.el8.noarch 1/1 2024-04-06T12:11:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:16.2.15-0.el8.noarch 1/1 2024-04-06T12:11:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:07.095 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:11:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:16.2.15-0.el8.noarch 2024-04-06T12:11:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:07.095 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:16.2.15-0.el8.noarch 1/1 2024-04-06T12:11:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:07.155 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:11:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:16.2.15-0.el8.noarch 2024-04-06T12:11:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:07.155 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:07.322 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-immutable-object-cache 2024-04-06T12:11:07.380 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-immutable-object-cache 2024-04-06T12:11:08.079 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:17 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:08.136 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:16 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:09.717 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:09.718 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:09.718 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:16.2.15-0.el8 ceph 161 k 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 161 k 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 470 k 2024-04-06T12:11:09.719 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:11:09.760 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:09.761 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:09.761 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-04-06T12:11:09.761 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:09.761 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:11:09.761 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:16.2.15-0.el8 ceph 161 k 2024-04-06T12:11:09.761 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:09.761 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:11:09.761 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:09.761 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-04-06T12:11:09.762 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:09.762 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 161 k 2024-04-06T12:11:09.762 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 470 k 2024-04-06T12:11:09.762 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:11:09.808 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-immutable-object-cache-16.2.15-0.el8.x86_6 3.4 MB/s | 161 kB 00:00 2024-04-06T12:11:09.809 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:09.809 INFO:teuthology.orchestra.run.smithi195.stdout:Total 3.3 MB/s | 161 kB 00:00 2024-04-06T12:11:09.809 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:11:09.820 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:11:09.820 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:11:09.868 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:11:09.871 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:11:09.987 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:11:10.211 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:10.332 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-immutable-object-cache-16.2.15-0.el8.x86_6 263 kB/s | 161 kB 00:00 2024-04-06T12:11:10.332 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:10.333 INFO:teuthology.orchestra.run.smithi152.stdout:Total 262 kB/s | 161 kB 00:00 2024-04-06T12:11:10.333 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:11:10.345 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:11:10.346 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:11:10.399 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:11:10.402 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:11:10.628 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:11:10.886 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:11.022 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:11.022 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:11.022 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:11:11.022 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:11.023 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:11.023 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:11.280 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr 2024-04-06T12:11:11.303 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:11.678 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:11.678 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:11.678 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:11:11.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:11.678 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:11.678 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:11.924 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr 2024-04-06T12:11:12.039 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:20 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:12.686 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:21 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:13.619 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-mgr-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:11:13.667 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:13.668 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-06T12:11:13.668 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:13.776 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-dashboard 2024-04-06T12:11:14.273 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-mgr-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:11:14.321 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:14.323 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-04-06T12:11:14.323 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:14.458 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-dashboard 2024-04-06T12:11:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:22 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:15.209 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:24 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:16.148 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:16.2.15-0.el8 ceph-noarch 3.1 M 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:16.2.15-0.el8 ceph-noarch 24 k 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:16.2.15-0.el8 ceph-noarch 15 k 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-06T12:11:16.150 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-06T12:11:16.151 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:16.151 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:11:16.151 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:16.151 INFO:teuthology.orchestra.run.smithi195.stdout:Install 6 Packages 2024-04-06T12:11:16.151 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:16.152 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 3.4 M 2024-04-06T12:11:16.152 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 22 M 2024-04-06T12:11:16.152 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:11:16.311 INFO:teuthology.orchestra.run.smithi195.stdout:(1/6): ceph-grafana-dashboards-16.2.15-0.el8.no 318 kB/s | 24 kB 00:00 2024-04-06T12:11:16.453 INFO:teuthology.orchestra.run.smithi195.stdout:(2/6): ceph-mgr-dashboard-16.2.15-0.el8.noarch. 14 MB/s | 3.1 MB 00:00 2024-04-06T12:11:16.470 INFO:teuthology.orchestra.run.smithi195.stdout:(3/6): ceph-prometheus-alerts-16.2.15-0.el8.noa 63 kB/s | 15 kB 00:00 2024-04-06T12:11:16.487 INFO:teuthology.orchestra.run.smithi195.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 242 kB/s | 43 kB 00:00 2024-04-06T12:11:16.712 INFO:teuthology.orchestra.run.smithi195.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 130 kB/s | 34 kB 00:00 2024-04-06T12:11:16.846 INFO:teuthology.orchestra.run.smithi195.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 523 kB/s | 196 kB 00:00 2024-04-06T12:11:16.849 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:16.849 INFO:teuthology.orchestra.run.smithi195.stdout:Total 4.9 MB/s | 3.4 MB 00:00 2024-04-06T12:11:16.859 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:11:16.869 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:11:16.869 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:11:16.875 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:16.876 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:16.876 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:16.2.15-0.el8 ceph-noarch 3.1 M 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:16.2.15-0.el8 ceph-noarch 24 k 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:16.2.15-0.el8 ceph-noarch 15 k 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:16.877 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2024-04-06T12:11:16.878 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:16.878 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 3.4 M 2024-04-06T12:11:16.878 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 22 M 2024-04-06T12:11:16.878 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:11:17.020 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:11:17.023 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:11:17.034 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): ceph-grafana-dashboards-16.2.15-0.el8.no 340 kB/s | 24 kB 00:00 2024-04-06T12:11:17.059 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): ceph-prometheus-alerts-16.2.15-0.el8.noa 153 kB/s | 15 kB 00:00 2024-04-06T12:11:17.126 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): ceph-mgr-dashboard-16.2.15-0.el8.noarch. 19 MB/s | 3.1 MB 00:00 2024-04-06T12:11:17.177 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 287 kB/s | 34 kB 00:00 2024-04-06T12:11:17.201 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.6 MB/s | 196 kB 00:00 2024-04-06T12:11:17.260 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): python3-jwt-1.6.1-2.el8.noarch.rpm 189 kB/s | 43 kB 00:00 2024-04-06T12:11:17.262 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:17.262 INFO:teuthology.orchestra.run.smithi152.stdout:Total 8.9 MB/s | 3.4 MB 00:00 2024-04-06T12:11:17.272 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:11:17.281 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:11:17.282 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:11:17.319 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:11:17.440 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:11:17.442 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:11:17.499 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-04-06T12:11:17.710 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-04-06T12:11:17.721 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:11:17.929 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-04-06T12:11:17.941 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-04-06T12:11:18.032 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 4/6 2024-04-06T12:11:18.186 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-04-06T12:11:18.421 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-04-06T12:11:18.591 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 4/6 2024-04-06T12:11:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 5/6 2024-04-06T12:11:19.320 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 6/6 2024-04-06T12:11:19.604 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 6/6 2024-04-06T12:11:19.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 1/6 2024-04-06T12:11:19.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2/6 2024-04-06T12:11:19.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 3/6 2024-04-06T12:11:19.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-04-06T12:11:19.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-04-06T12:11:19.629 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 5/6 2024-04-06T12:11:19.893 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 6/6 2024-04-06T12:11:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-04-06T12:11:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:20.012 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:11:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 2024-04-06T12:11:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2024-04-06T12:11:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 2024-04-06T12:11:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-06T12:11:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-06T12:11:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-06T12:11:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:20.013 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:20.147 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-06T12:11:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 6/6 2024-04-06T12:11:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 1/6 2024-04-06T12:11:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2/6 2024-04-06T12:11:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 3/6 2024-04-06T12:11:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-04-06T12:11:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-04-06T12:11:20.614 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-04-06T12:11:20.614 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:20.615 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:11:20.615 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 2024-04-06T12:11:20.615 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2024-04-06T12:11:20.615 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 2024-04-06T12:11:20.615 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-06T12:11:20.615 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-06T12:11:20.615 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-06T12:11:20.616 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:20.616 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:20.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-06T12:11:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:28 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:21.493 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:30 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:22.516 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:22.517 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-04-06T12:11:22.517 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-06T12:11:22.517 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-04-06T12:11:22.517 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.15-0.el8 ceph-noarch 8.6 M 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-04-06T12:11:22.518 INFO:teuthology.orchestra.run.smithi195.stdout:Install 8 Packages 2024-04-06T12:11:22.519 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:22.519 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 37 M 2024-04-06T12:11:22.519 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 210 M 2024-04-06T12:11:22.519 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:11:23.001 INFO:teuthology.orchestra.run.smithi195.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2024-04-06T12:11:23.067 INFO:teuthology.orchestra.run.smithi195.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2024-04-06T12:11:23.109 INFO:teuthology.orchestra.run.smithi195.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 5.3 MB/s | 225 kB 00:00 2024-04-06T12:11:23.122 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================ 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================ 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.15-0.el8 ceph-noarch 8.6 M 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-06T12:11:23.123 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-06T12:11:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-06T12:11:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-06T12:11:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-06T12:11:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:23.124 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:11:23.124 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================ 2024-04-06T12:11:23.124 INFO:teuthology.orchestra.run.smithi152.stdout:Install 8 Packages 2024-04-06T12:11:23.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:23.125 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 37 M 2024-04-06T12:11:23.125 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 210 M 2024-04-06T12:11:23.125 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:11:23.160 INFO:teuthology.orchestra.run.smithi195.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 24 MB/s | 3.7 MB 00:00 2024-04-06T12:11:23.277 INFO:teuthology.orchestra.run.smithi195.stdout:(5/8): ceph-mgr-diskprediction-local-16.2.15-0. 17 MB/s | 8.6 MB 00:00 2024-04-06T12:11:23.519 INFO:teuthology.orchestra.run.smithi195.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 35 MB/s | 14 MB 00:00 2024-04-06T12:11:23.522 INFO:teuthology.orchestra.run.smithi152.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.15-0. 58 MB/s | 8.6 MB 00:00 2024-04-06T12:11:23.544 INFO:teuthology.orchestra.run.smithi195.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 646 kB/s | 172 kB 00:00 2024-04-06T12:11:23.636 INFO:teuthology.orchestra.run.smithi195.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.3 MB/s | 645 kB 00:00 2024-04-06T12:11:23.636 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:23.636 INFO:teuthology.orchestra.run.smithi195.stdout:Total 33 MB/s | 37 MB 00:01 2024-04-06T12:11:23.697 INFO:teuthology.orchestra.run.smithi152.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2024-04-06T12:11:23.764 INFO:teuthology.orchestra.run.smithi152.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2024-04-06T12:11:23.789 INFO:teuthology.orchestra.run.smithi152.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.4 MB/s | 225 kB 00:00 2024-04-06T12:11:23.865 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:11:23.883 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:11:23.883 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:11:24.106 INFO:teuthology.orchestra.run.smithi152.stdout:(5/8): python3-scipy-1.0.0-21.module_el8+762+77 41 MB/s | 14 MB 00:00 2024-04-06T12:11:24.182 INFO:teuthology.orchestra.run.smithi152.stdout:(6/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 5.7 MB/s | 3.7 MB 00:00 2024-04-06T12:11:24.214 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:11:24.217 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:11:24.257 INFO:teuthology.orchestra.run.smithi152.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.3 MB/s | 645 kB 00:00 2024-04-06T12:11:24.365 INFO:teuthology.orchestra.run.smithi152.stdout:(8/8): libquadmath-8.5.0-21.el8.x86_64.rpm 667 kB/s | 172 kB 00:00 2024-04-06T12:11:24.366 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:24.366 INFO:teuthology.orchestra.run.smithi152.stdout:Total 30 MB/s | 37 MB 00:01 2024-04-06T12:11:24.594 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:11:24.612 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:11:24.612 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:11:24.768 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:11:24.900 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-06T12:11:24.940 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:11:24.943 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:11:25.033 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-06T12:11:25.217 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-06T12:11:25.520 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:11:25.684 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-06T12:11:25.813 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-06T12:11:25.818 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-06T12:11:25.991 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-06T12:11:26.000 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-06T12:11:26.583 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-06T12:11:26.586 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-06T12:11:26.717 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-06T12:11:27.092 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-06T12:11:27.409 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-06T12:11:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-06T12:11:27.992 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-06T12:11:28.187 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-06T12:11:28.325 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-06T12:11:29.027 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-06T12:11:29.363 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-06T12:11:29.600 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-06T12:11:29.733 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-06T12:11:31.005 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-06T12:11:31.356 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-06T12:11:31.749 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 8/8 2024-04-06T12:11:32.095 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 8/8 2024-04-06T12:11:32.095 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 1/8 2024-04-06T12:11:32.096 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-06T12:11:32.096 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-06T12:11:32.096 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-06T12:11:32.096 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-06T12:11:32.096 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-06T12:11:32.096 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-06T12:11:32.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-06T12:11:32.519 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:32.519 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:11:32.519 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 2024-04-06T12:11:32.519 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-06T12:11:32.519 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-06T12:11:32.519 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-06T12:11:32.520 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-06T12:11:32.520 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-06T12:11:32.520 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-06T12:11:32.520 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-06T12:11:32.520 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:32.520 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:32.662 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-rook 2024-04-06T12:11:32.674 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-06T12:11:33.237 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 8/8 2024-04-06T12:11:33.408 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:41 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:33.838 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 8/8 2024-04-06T12:11:33.838 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 1/8 2024-04-06T12:11:33.838 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-06T12:11:33.838 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-06T12:11:33.839 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-06T12:11:33.839 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-06T12:11:33.839 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-06T12:11:33.839 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-06T12:11:34.250 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-06T12:11:34.251 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-06T12:11:34.251 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:34.251 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:34.383 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-rook 2024-04-06T12:11:35.038 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:16.2.15-0.el8 ceph-noarch 27 k 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-06T12:11:35.040 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout:Install 13 Packages 2024-04-06T12:11:35.041 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:35.042 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 1.9 M 2024-04-06T12:11:35.042 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 24 M 2024-04-06T12:11:35.042 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:11:35.138 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:44 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:35.436 INFO:teuthology.orchestra.run.smithi195.stdout:(1/13): ceph-mgr-rook-16.2.15-0.el8.noarch.rpm 425 kB/s | 27 kB 00:00 2024-04-06T12:11:35.453 INFO:teuthology.orchestra.run.smithi195.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 327 kB/s | 27 kB 00:00 2024-04-06T12:11:35.470 INFO:teuthology.orchestra.run.smithi195.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 203 kB/s | 20 kB 00:00 2024-04-06T12:11:35.504 INFO:teuthology.orchestra.run.smithi195.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2024-04-06T12:11:35.529 INFO:teuthology.orchestra.run.smithi195.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.8 MB/s | 110 kB 00:00 2024-04-06T12:11:35.646 INFO:teuthology.orchestra.run.smithi195.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 283 kB/s | 33 kB 00:00 2024-04-06T12:11:35.671 INFO:teuthology.orchestra.run.smithi195.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 255 kB/s | 43 kB 00:00 2024-04-06T12:11:35.688 INFO:teuthology.orchestra.run.smithi195.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 387 kB/s | 16 kB 00:00 2024-04-06T12:11:35.714 INFO:teuthology.orchestra.run.smithi195.stdout:(9/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 637 kB/s | 155 kB 00:00 2024-04-06T12:11:35.864 INFO:teuthology.orchestra.run.smithi195.stdout:(10/13): python3-kubernetes-11.0.0-6.el8.noarch 6.6 MB/s | 1.2 MB 00:00 2024-04-06T12:11:35.889 INFO:teuthology.orchestra.run.smithi195.stdout:(11/13): python3-google-auth-1.1.1-10.el8.noarc 373 kB/s | 81 kB 00:00 2024-04-06T12:11:35.940 INFO:teuthology.orchestra.run.smithi195.stdout:(12/13): python3-rsa-4.9-2.el8.noarch.rpm 290 kB/s | 64 kB 00:00 2024-04-06T12:11:35.964 INFO:teuthology.orchestra.run.smithi195.stdout:(13/13): python3-websocket-client-0.56.0-5.el8. 610 kB/s | 61 kB 00:00 2024-04-06T12:11:35.967 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:35.967 INFO:teuthology.orchestra.run.smithi195.stdout:Total 2.1 MB/s | 1.9 MB 00:00 2024-04-06T12:11:36.019 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:11:36.035 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:11:36.035 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:11:36.121 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:11:36.124 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:11:36.680 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:11:36.782 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:36.783 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:16.2.15-0.el8 ceph-noarch 27 k 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-06T12:11:36.784 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-06T12:11:36.785 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-06T12:11:36.785 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-06T12:11:36.785 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-06T12:11:36.785 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-06T12:11:36.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:36.785 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:11:36.785 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:36.785 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2024-04-06T12:11:36.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:36.786 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 1.9 M 2024-04-06T12:11:36.786 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 24 M 2024-04-06T12:11:36.786 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:11:36.913 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-04-06T12:11:37.234 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-04-06T12:11:37.405 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): ceph-mgr-rook-16.2.15-0.el8.noarch.rpm 644 kB/s | 27 kB 00:00 2024-04-06T12:11:37.444 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-04-06T12:11:37.455 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 286 kB/s | 27 kB 00:00 2024-04-06T12:11:37.480 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 169 kB/s | 20 kB 00:00 2024-04-06T12:11:37.531 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2024-04-06T12:11:37.556 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.4 MB/s | 110 kB 00:00 2024-04-06T12:11:37.664 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-04-06T12:11:37.715 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 232 kB/s | 43 kB 00:00 2024-04-06T12:11:37.749 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 579 kB/s | 155 kB 00:00 2024-04-06T12:11:37.824 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 123 kB/s | 33 kB 00:00 2024-04-06T12:11:37.897 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-04-06T12:11:37.982 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 61 kB/s | 16 kB 00:00 2024-04-06T12:11:38.099 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 232 kB/s | 81 kB 00:00 2024-04-06T12:11:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-04-06T12:11:38.333 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 183 kB/s | 64 kB 00:00 2024-04-06T12:11:38.408 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-04-06T12:11:38.450 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 175 kB/s | 61 kB 00:00 2024-04-06T12:11:38.525 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.7 MB/s | 1.2 MB 00:00 2024-04-06T12:11:38.526 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:38.526 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.1 MB/s | 1.9 MB 00:01 2024-04-06T12:11:38.584 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:11:38.600 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:11:38.600 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:11:38.663 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-04-06T12:11:38.688 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:11:38.691 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:11:39.357 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:11:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-04-06T12:11:39.755 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-04-06T12:11:39.790 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-04-06T12:11:40.013 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-04-06T12:11:40.017 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-04-06T12:11:40.235 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-04-06T12:11:40.263 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-04-06T12:11:40.406 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-04-06T12:11:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-04-06T12:11:40.556 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:16.2.15-0.el8.noarch 13/13 2024-04-06T12:11:40.752 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-04-06T12:11:40.835 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.15-0.el8.noarch 13/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:16.2.15-0.el8.noarch 1/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-04-06T12:11:40.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-04-06T12:11:41.060 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-04-06T12:11:41.302 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-04-06T12:11:41.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-04-06T12:11:41.318 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:41.318 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:16.2.15-0.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-06T12:11:41.319 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-06T12:11:41.320 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-06T12:11:41.320 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-06T12:11:41.320 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:41.320 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:41.446 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-cephadm 2024-04-06T12:11:42.209 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:50 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-04-06T12:11:42.637 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-04-06T12:11:42.871 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-04-06T12:11:43.055 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-04-06T12:11:43.214 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:16.2.15-0.el8.noarch 13/13 2024-04-06T12:11:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.15-0.el8.noarch 13/13 2024-04-06T12:11:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:16.2.15-0.el8.noarch 1/13 2024-04-06T12:11:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-04-06T12:11:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-04-06T12:11:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-04-06T12:11:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-04-06T12:11:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-04-06T12:11:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-04-06T12:11:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-04-06T12:11:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-04-06T12:11:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-04-06T12:11:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-04-06T12:11:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-04-06T12:11:43.836 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:16.2.15-0.el8 ceph-noarch 116 k 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-04-06T12:11:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:43.838 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:11:43.838 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:43.838 INFO:teuthology.orchestra.run.smithi195.stdout:Install 6 Packages 2024-04-06T12:11:43.838 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:43.838 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 5.9 M 2024-04-06T12:11:43.839 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 24 M 2024-04-06T12:11:43.839 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:11:43.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-04-06T12:11:43.959 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:43.959 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:11:43.959 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:16.2.15-0.el8.noarch 2024-04-06T12:11:43.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-06T12:11:43.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:43.960 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:44.084 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-cephadm 2024-04-06T12:11:44.273 INFO:teuthology.orchestra.run.smithi195.stdout:(1/6): ceph-mgr-cephadm-16.2.15-0.el8.noarch.rp 1.4 MB/s | 116 kB 00:00 2024-04-06T12:11:44.332 INFO:teuthology.orchestra.run.smithi195.stdout:(2/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 4.0 MB/s | 578 kB 00:00 2024-04-06T12:11:44.424 INFO:teuthology.orchestra.run.smithi195.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2024-04-06T12:11:44.532 INFO:teuthology.orchestra.run.smithi195.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 82 kB/s | 21 kB 00:00 2024-04-06T12:11:44.757 INFO:teuthology.orchestra.run.smithi195.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 146 kB/s | 49 kB 00:00 2024-04-06T12:11:44.832 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:53 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:44.899 INFO:teuthology.orchestra.run.smithi195.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 626 kB/s | 355 kB 00:00 2024-04-06T12:11:44.900 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:44.900 INFO:teuthology.orchestra.run.smithi195.stdout:Total 5.5 MB/s | 5.9 MB 00:01 2024-04-06T12:11:44.951 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:11:44.961 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:11:44.961 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:11:45.069 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:11:45.072 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:11:45.357 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:11:45.613 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-04-06T12:11:45.874 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-04-06T12:11:46.445 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:16.2.15-0.el8 ceph-noarch 116 k 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-06T12:11:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-04-06T12:11:46.447 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:46.447 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:11:46.447 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:46.447 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2024-04-06T12:11:46.447 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:46.447 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 5.9 M 2024-04-06T12:11:46.447 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 24 M 2024-04-06T12:11:46.448 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:11:46.582 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): ceph-mgr-cephadm-16.2.15-0.el8.noarch.rp 2.3 MB/s | 116 kB 00:00 2024-04-06T12:11:46.690 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 3.6 MB/s | 578 kB 00:00 2024-04-06T12:11:46.774 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 110 kB/s | 21 kB 00:00 2024-04-06T12:11:46.798 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-04-06T12:11:46.858 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2024-04-06T12:11:46.883 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 451 kB/s | 49 kB 00:00 2024-04-06T12:11:47.016 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.1 MB/s | 355 kB 00:00 2024-04-06T12:11:47.017 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:47.017 INFO:teuthology.orchestra.run.smithi152.stdout:Total 10 MB/s | 5.9 MB 00:00 2024-04-06T12:11:47.068 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:11:47.077 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:11:47.077 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:11:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-04-06T12:11:47.190 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:11:47.193 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:11:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-04-06T12:11:47.476 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:11:47.555 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 6/6 2024-04-06T12:11:47.771 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-04-06T12:11:47.838 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 6/6 2024-04-06T12:11:47.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 1/6 2024-04-06T12:11:47.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-04-06T12:11:47.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-04-06T12:11:47.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-04-06T12:11:47.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-04-06T12:11:48.032 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-04-06T12:11:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-04-06T12:11:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:48.248 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:11:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:16.2.15-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2024-04-06T12:11:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2024-04-06T12:11:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.10.1-4.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2024-04-06T12:11:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:48.249 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:48.392 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-fuse 2024-04-06T12:11:48.995 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-04-06T12:11:49.144 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:57 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:49.517 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-04-06T12:11:49.779 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-04-06T12:11:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 6/6 2024-04-06T12:11:50.284 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 6/6 2024-04-06T12:11:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 1/6 2024-04-06T12:11:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-04-06T12:11:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-04-06T12:11:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-04-06T12:11:50.285 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-04-06T12:11:50.680 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-04-06T12:11:50.680 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:50.680 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:11:50.680 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:16.2.15-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2024-04-06T12:11:50.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2024-04-06T12:11:50.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.10.1-4.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2024-04-06T12:11:50.680 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:50.680 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:50.776 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:50.776 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:11:50.776 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:50.776 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:11:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:16.2.15-0.el8 ceph 911 k 2024-04-06T12:11:50.777 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-06T12:11:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-06T12:11:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:50.777 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:11:50.777 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:50.777 INFO:teuthology.orchestra.run.smithi195.stdout:Install 2 Packages 2024-04-06T12:11:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:50.778 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 994 k 2024-04-06T12:11:50.778 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 2.8 M 2024-04-06T12:11:50.778 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:11:50.811 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-fuse 2024-04-06T12:11:50.958 INFO:teuthology.orchestra.run.smithi195.stdout:(1/2): ceph-fuse-16.2.15-0.el8.x86_64.rpm 7.0 MB/s | 911 kB 00:00 2024-04-06T12:11:51.008 INFO:teuthology.orchestra.run.smithi195.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 468 kB/s | 83 kB 00:00 2024-04-06T12:11:51.009 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:51.009 INFO:teuthology.orchestra.run.smithi195.stdout:Total 4.2 MB/s | 994 kB 00:00 2024-04-06T12:11:51.019 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:11:51.039 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:11:51.040 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:11:51.126 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:11:51.129 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:11:51.296 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:11:51.569 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:00 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-06T12:11:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:16.2.15-0.el8.x86_64 2/2 2024-04-06T12:11:52.175 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-fuse-2:16.2.15-0.el8.x86_64 2/2 2024-04-06T12:11:52.175 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:16.2.15-0.el8.x86_64 1/2 2024-04-06T12:11:52.849 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-06T12:11:52.849 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:52.849 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:11:52.849 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:16.2.15-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-06T12:11:52.849 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:52.849 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:53.071 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados-devel 2024-04-06T12:11:53.187 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:53.187 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:53.187 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:11:53.187 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:53.187 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:11:53.188 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:16.2.15-0.el8 ceph 911 k 2024-04-06T12:11:53.188 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-04-06T12:11:53.188 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-06T12:11:53.188 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:53.188 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:11:53.188 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:53.188 INFO:teuthology.orchestra.run.smithi152.stdout:Install 2 Packages 2024-04-06T12:11:53.188 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:53.189 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 994 k 2024-04-06T12:11:53.189 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 2.8 M 2024-04-06T12:11:53.189 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:11:53.311 INFO:teuthology.orchestra.run.smithi152.stdout:(1/2): ceph-fuse-16.2.15-0.el8.x86_64.rpm 13 MB/s | 911 kB 00:00 2024-04-06T12:11:53.459 INFO:teuthology.orchestra.run.smithi152.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 382 kB/s | 83 kB 00:00 2024-04-06T12:11:53.460 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:53.460 INFO:teuthology.orchestra.run.smithi152.stdout:Total 3.6 MB/s | 994 kB 00:00 2024-04-06T12:11:53.469 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:11:53.490 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:11:53.490 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:11:53.576 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:11:53.579 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:11:53.748 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:11:53.834 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:01 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:54.011 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-06T12:11:54.246 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:16.2.15-0.el8.x86_64 2/2 2024-04-06T12:11:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-fuse-2:16.2.15-0.el8.x86_64 2/2 2024-04-06T12:11:54.679 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:16.2.15-0.el8.x86_64 1/2 2024-04-06T12:11:55.056 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-06T12:11:55.057 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:55.057 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:11:55.057 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:16.2.15-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-06T12:11:55.057 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:55.057 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:55.286 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados-devel 2024-04-06T12:11:55.453 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:16.2.15-0.el8 ceph 131 k 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-04-06T12:11:55.454 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 131 k 2024-04-06T12:11:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 432 k 2024-04-06T12:11:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:11:55.523 INFO:teuthology.orchestra.run.smithi195.stdout:librados-devel-16.2.15-0.el8.x86_64.rpm 1.9 MB/s | 131 kB 00:00 2024-04-06T12:11:55.523 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:55.524 INFO:teuthology.orchestra.run.smithi195.stdout:Total 1.9 MB/s | 131 kB 00:00 2024-04-06T12:11:55.524 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:11:55.529 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:11:55.529 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:11:55.578 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:11:55.581 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:11:55.703 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:11:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:56.052 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:05 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:11:56.218 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:56.614 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:56.615 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:56.615 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:11:56.615 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:56.615 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:11:56.615 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:56.852 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs2 2024-04-06T12:11:57.609 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:05 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:11:57.700 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:11:57.700 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:16.2.15-0.el8 ceph 131 k 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 131 k 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 432 k 2024-04-06T12:11:57.701 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:11:57.755 INFO:teuthology.orchestra.run.smithi152.stdout:librados-devel-16.2.15-0.el8.x86_64.rpm 2.4 MB/s | 131 kB 00:00 2024-04-06T12:11:57.755 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:11:57.756 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.3 MB/s | 131 kB 00:00 2024-04-06T12:11:57.756 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:11:57.761 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:11:57.761 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:11:57.810 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:11:57.813 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:11:57.923 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:11:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:58.461 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:58.844 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:11:58.845 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:58.845 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:11:58.845 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:16.2.15-0.el8.x86_64 2024-04-06T12:11:58.845 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:11:58.845 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:11:59.038 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs2 2024-04-06T12:11:59.150 INFO:teuthology.orchestra.run.smithi195.stdout:Package libcephfs2-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:11:59.197 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:11:59.198 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-06T12:11:59.198 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:11:59.673 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs-devel 2024-04-06T12:11:59.798 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:08 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:00.435 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:08 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:01.379 INFO:teuthology.orchestra.run.smithi152.stdout:Package libcephfs2-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:01.429 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:01.430 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-04-06T12:12:01.430 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:01.533 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs-devel 2024-04-06T12:12:02.063 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:02.065 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:02.065 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:12:02.065 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:02.065 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:12:02.065 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:16.2.15-0.el8 ceph 25 k 2024-04-06T12:12:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:02.066 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:12:02.066 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:02.066 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-04-06T12:12:02.066 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:02.066 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 25 k 2024-04-06T12:12:02.067 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 107 k 2024-04-06T12:12:02.067 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:12:02.121 INFO:teuthology.orchestra.run.smithi195.stdout:libcephfs-devel-16.2.15-0.el8.x86_64.rpm 461 kB/s | 25 kB 00:00 2024-04-06T12:12:02.121 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:12:02.121 INFO:teuthology.orchestra.run.smithi195.stdout:Total 450 kB/s | 25 kB 00:00 2024-04-06T12:12:02.122 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:12:02.125 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:12:02.125 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:12:02.127 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:12:02.130 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:12:02.179 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:12:02.288 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:11 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:02.393 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:02.665 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:03.055 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:03.055 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:03.055 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:12:03.056 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:16.2.15-0.el8.x86_64 2024-04-06T12:12:03.056 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:03.056 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:03.186 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados2 2024-04-06T12:12:03.902 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:16.2.15-0.el8 ceph 25 k 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-04-06T12:12:03.903 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:03.904 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 25 k 2024-04-06T12:12:03.904 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 107 k 2024-04-06T12:12:03.904 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:12:03.932 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:11 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:03.959 INFO:teuthology.orchestra.run.smithi152.stdout:libcephfs-devel-16.2.15-0.el8.x86_64.rpm 462 kB/s | 25 kB 00:00 2024-04-06T12:12:03.959 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:12:03.960 INFO:teuthology.orchestra.run.smithi152.stdout:Total 452 kB/s | 25 kB 00:00 2024-04-06T12:12:03.960 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:12:03.963 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:12:03.963 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:12:03.965 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:12:03.968 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:12:04.015 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:12:04.218 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:04.482 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:04.844 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:04.844 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:04.844 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:12:04.845 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:16.2.15-0.el8.x86_64 2024-04-06T12:12:04.845 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:04.845 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:04.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados2 2024-04-06T12:12:05.517 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-06T12:12:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:05.668 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librbd1 2024-04-06T12:12:05.726 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:14 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:06.427 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:14 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:07.297 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:07.347 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:07.348 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-04-06T12:12:07.348 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:07.455 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librbd1 2024-04-06T12:12:08.001 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:08.049 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:08.050 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-06T12:12:08.050 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:08.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rados 2024-04-06T12:12:08.205 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:17 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:08.904 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:16 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:09.787 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:09.834 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:09.835 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-04-06T12:12:09.835 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:09.941 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rados 2024-04-06T12:12:10.490 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rados-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:10.538 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:10.539 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-06T12:12:10.539 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:10.649 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rgw 2024-04-06T12:12:10.705 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:19 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:11.400 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:19 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:12.297 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rados-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:12.347 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:12.348 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-04-06T12:12:12.348 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:12.463 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rgw 2024-04-06T12:12:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rgw-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:13.030 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:13.031 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-06T12:12:13.031 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:13.145 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-cephfs 2024-04-06T12:12:13.210 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:22 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:13.898 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:21 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:14.787 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rgw-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:14.834 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:14.836 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-04-06T12:12:14.836 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:14.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-cephfs 2024-04-06T12:12:15.462 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-cephfs-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:15.511 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:15.512 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-06T12:12:15.512 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:15.640 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rbd 2024-04-06T12:12:15.705 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:24 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:16.393 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:24 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:17.287 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-cephfs-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:17.336 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:17.337 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-04-06T12:12:17.337 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:17.442 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rbd 2024-04-06T12:12:17.982 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rbd-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:18.033 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:18.033 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-06T12:12:18.033 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:18.148 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-fuse 2024-04-06T12:12:18.202 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:27 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:18.894 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:26 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:19.810 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rbd-2:16.2.15-0.el8.x86_64 is already installed. 2024-04-06T12:12:19.858 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:19.860 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-04-06T12:12:19.860 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:19.973 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-fuse 2024-04-06T12:12:20.508 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:20.509 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:20.509 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:12:20.509 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:20.509 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:12:20.509 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:16.2.15-0.el8 ceph 88 k 2024-04-06T12:12:20.509 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:20.509 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:12:20.509 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:20.510 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-04-06T12:12:20.510 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:20.510 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 88 k 2024-04-06T12:12:20.510 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 240 k 2024-04-06T12:12:20.510 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:12:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-fuse-16.2.15-0.el8.x86_64.rpm 889 kB/s | 88 kB 00:00 2024-04-06T12:12:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:12:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:Total 879 kB/s | 88 kB 00:00 2024-04-06T12:12:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:12:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:12:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:12:20.670 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:12:20.673 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:12:20.720 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:29 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:12:21.199 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:21.487 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:21.869 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:21.869 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:21.869 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:12:21.869 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:16.2.15-0.el8.x86_64 2024-04-06T12:12:21.869 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:21.869 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:22.092 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-mirror 2024-04-06T12:12:22.355 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:22.355 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:22.356 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:12:22.356 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:22.356 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:12:22.356 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:16.2.15-0.el8 ceph 88 k 2024-04-06T12:12:22.356 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:22.356 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:12:22.356 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:22.356 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-04-06T12:12:22.356 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:22.357 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 88 k 2024-04-06T12:12:22.357 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 240 k 2024-04-06T12:12:22.357 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:12:22.398 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-fuse-16.2.15-0.el8.x86_64.rpm 2.1 MB/s | 88 kB 00:00 2024-04-06T12:12:22.399 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:12:22.399 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.0 MB/s | 88 kB 00:00 2024-04-06T12:12:22.399 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:12:22.408 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:12:22.409 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:12:22.457 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:12:22.460 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:12:22.833 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:12:22.849 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:30 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:23.310 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:23.735 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:12:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:16.2.15-0.el8.x86_64 2024-04-06T12:12:23.735 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:23.735 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:23.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-mirror 2024-04-06T12:12:24.423 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-04-06T12:12:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:24.425 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 3.7 M 2024-04-06T12:12:24.425 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 15 M 2024-04-06T12:12:24.425 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:12:24.609 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-mirror-16.2.15-0.el8.x86_64.rpm 20 MB/s | 3.7 MB 00:00 2024-04-06T12:12:24.609 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:12:24.609 INFO:teuthology.orchestra.run.smithi195.stdout:Total 20 MB/s | 3.7 MB 00:00 2024-04-06T12:12:24.610 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:12:24.621 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:12:24.621 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:12:24.685 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:12:24.688 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:12:24.731 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:33 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:25.129 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:12:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:25.754 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:26.133 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:26.133 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:26.133 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:12:26.133 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:16.2.15-0.el8.x86_64 2024-04-06T12:12:26.133 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:26.133 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:26.340 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-04-06T12:12:26.341 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:26.342 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 3.7 M 2024-04-06T12:12:26.342 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 15 M 2024-04-06T12:12:26.342 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:12:26.415 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-nbd 2024-04-06T12:12:26.461 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-mirror-16.2.15-0.el8.x86_64.rpm 31 MB/s | 3.7 MB 00:00 2024-04-06T12:12:26.461 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:12:26.462 INFO:teuthology.orchestra.run.smithi152.stdout:Total 30 MB/s | 3.7 MB 00:00 2024-04-06T12:12:26.462 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:12:26.473 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:12:26.473 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:12:26.536 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:12:26.538 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:12:26.978 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:12:27.185 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:35 ago on Sat 06 Apr 2024 12:09:52 PM UTC. 2024-04-06T12:12:27.195 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:27.646 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:28.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:28.009 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:28.009 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:12:28.009 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:16.2.15-0.el8.x86_64 2024-04-06T12:12:28.009 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:28.009 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:28.355 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-nbd 2024-04-06T12:12:28.814 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-06T12:12:28.814 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:28.814 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-06T12:12:28.814 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:28.814 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-06T12:12:28.815 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:16.2.15-0.el8 ceph 175 k 2024-04-06T12:12:28.815 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:28.815 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-06T12:12:28.815 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-06T12:12:28.815 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-04-06T12:12:28.815 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:28.815 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 175 k 2024-04-06T12:12:28.816 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 523 k 2024-04-06T12:12:28.816 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-06T12:12:28.878 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-nbd-16.2.15-0.el8.x86_64.rpm 2.7 MB/s | 175 kB 00:00 2024-04-06T12:12:28.879 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:12:28.879 INFO:teuthology.orchestra.run.smithi195.stdout:Total 2.7 MB/s | 175 kB 00:00 2024-04-06T12:12:28.879 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-06T12:12:28.890 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-06T12:12:28.890 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-06T12:12:28.939 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-06T12:12:28.942 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-06T12:12:29.061 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-06T12:12:29.122 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:38 ago on Sat 06 Apr 2024 12:09:51 PM UTC. 2024-04-06T12:12:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:29.560 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:29.942 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:29.942 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:29.943 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-06T12:12:29.943 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:16.2.15-0.el8.x86_64 2024-04-06T12:12:29.943 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:12:29.943 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-06T12:12:30.153 DEBUG:teuthology.parallel:result is None 2024-04-06T12:12:30.761 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-04-06T12:12:30.762 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:30.762 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-04-06T12:12:30.762 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:30.762 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-04-06T12:12:30.762 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:16.2.15-0.el8 ceph 175 k 2024-04-06T12:12:30.762 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:30.762 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-04-06T12:12:30.762 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-04-06T12:12:30.762 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-04-06T12:12:30.763 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:30.763 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 175 k 2024-04-06T12:12:30.763 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 523 k 2024-04-06T12:12:30.763 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-04-06T12:12:30.814 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-nbd-16.2.15-0.el8.x86_64.rpm 3.4 MB/s | 175 kB 00:00 2024-04-06T12:12:30.814 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-04-06T12:12:30.814 INFO:teuthology.orchestra.run.smithi152.stdout:Total 3.3 MB/s | 175 kB 00:00 2024-04-06T12:12:30.815 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-04-06T12:12:30.825 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-04-06T12:12:30.825 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-04-06T12:12:30.875 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-04-06T12:12:30.878 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-04-06T12:12:30.989 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-04-06T12:12:31.172 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:31.463 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:31.886 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-04-06T12:12:31.886 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:31.886 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-04-06T12:12:31.886 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:16.2.15-0.el8.x86_64 2024-04-06T12:12:31.886 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:12:31.886 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-04-06T12:12:32.123 DEBUG:teuthology.parallel:result is None 2024-04-06T12:12:32.124 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-06T12:12:32.124 INFO:teuthology.packaging:ref: None 2024-04-06T12:12:32.124 INFO:teuthology.packaging:tag: None 2024-04-06T12:12:32.124 INFO:teuthology.packaging:branch: pacific 2024-04-06T12:12:32.124 INFO:teuthology.packaging:sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:12:32.124 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-04-06T12:12:32.329 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-06T12:12:32.352 INFO:teuthology.orchestra.run.smithi152.stdout:16.2.15-0.el8 2024-04-06T12:12:32.353 INFO:teuthology.packaging:The installed version of ceph is 16.2.15-0.el8 2024-04-06T12:12:32.353 INFO:teuthology.task.install:The correct ceph version 16.2.15-0 is installed. 2024-04-06T12:12:32.355 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-06T12:12:32.355 INFO:teuthology.packaging:ref: None 2024-04-06T12:12:32.355 INFO:teuthology.packaging:tag: None 2024-04-06T12:12:32.355 INFO:teuthology.packaging:branch: pacific 2024-04-06T12:12:32.355 INFO:teuthology.packaging:sha1: 052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:12:32.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-04-06T12:12:32.559 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-06T12:12:32.587 INFO:teuthology.orchestra.run.smithi195.stdout:16.2.15-0.el8 2024-04-06T12:12:32.587 INFO:teuthology.packaging:The installed version of ceph is 16.2.15-0.el8 2024-04-06T12:12:32.587 INFO:teuthology.task.install:The correct ceph version 16.2.15-0 is installed. 2024-04-06T12:12:32.589 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-06T12:12:32.589 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:12:32.589 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-06T12:12:32.616 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:12:32.617 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-06T12:12:32.658 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-06T12:12:32.659 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:12:32.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-04-06T12:12:32.685 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-06T12:12:32.752 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:12:32.752 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-04-06T12:12:32.783 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-06T12:12:32.852 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-06T12:12:32.853 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:12:32.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-06T12:12:32.879 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-06T12:12:32.946 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:12:32.946 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-06T12:12:32.974 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-06T12:12:33.043 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-06T12:12:33.043 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:12:33.043 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-04-06T12:12:33.069 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-06T12:12:33.136 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:12:33.136 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-04-06T12:12:33.164 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-06T12:12:33.232 INFO:teuthology.run_tasks:Running task print... 2024-04-06T12:12:33.241 INFO:teuthology.task.print:**** done install task... 2024-04-06T12:12:33.241 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-06T12:12:33.337 INFO:tasks.cephadm:Config: {'cephadm_branch': 'pacific', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:pacific', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '052adcadd0534eddb0d73c5afbc083a84cd9dc46'} 2024-04-06T12:12:33.337 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:pacific 2024-04-06T12:12:33.337 INFO:tasks.cephadm:Cluster fsid is f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:12:33.337 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-06T12:12:33.337 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-06T12:12:33.338 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi152': '172.21.15.152', 'mon.smithi195': '172.21.15.195'} 2024-04-06T12:12:33.338 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-06T12:12:33.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2024-04-06T12:12:33.365 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2024-04-06T12:12:33.393 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref pacific)... 2024-04-06T12:12:33.393 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-06T12:12:33.622 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Apr 6 12:12 /home/ubuntu/cephtest/cephadm 2024-04-06T12:12:33.622 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-06T12:12:33.768 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Apr 6 12:12 /home/ubuntu/cephtest/cephadm 2024-04-06T12:12:33.768 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-06T12:12:33.787 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-06T12:12:33.815 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:pacific on all hosts... 2024-04-06T12:12:33.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific pull 2024-04-06T12:12:33.830 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific pull 2024-04-06T12:12:35.116 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-04-06T12:12:35.122 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-04-06T12:12:59.343 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:12:59.343 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)", 2024-04-06T12:12:59.343 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0", 2024-04-06T12:12:59.344 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2024-04-06T12:12:59.344 INFO:teuthology.orchestra.run.smithi152.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a917adc3f5c2fb88f02feae5d8f667631e1c7fa0b341817d32f1d6fd5cd1bec1" 2024-04-06T12:12:59.344 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-04-06T12:12:59.344 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:13:06.386 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-06T12:13:06.387 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)", 2024-04-06T12:13:06.387 INFO:teuthology.orchestra.run.smithi195.stdout: "image_id": "727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0", 2024-04-06T12:13:06.387 INFO:teuthology.orchestra.run.smithi195.stdout: "repo_digests": [ 2024-04-06T12:13:06.387 INFO:teuthology.orchestra.run.smithi195.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a917adc3f5c2fb88f02feae5d8f667631e1c7fa0b341817d32f1d6fd5cd1bec1" 2024-04-06T12:13:06.387 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-06T12:13:06.387 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-06T12:13:06.408 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2024-04-06T12:13:06.444 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2024-04-06T12:13:06.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2024-04-06T12:13:06.515 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2024-04-06T12:13:06.543 INFO:tasks.cephadm:Writing seed config... 2024-04-06T12:13:06.544 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-06T12:13:06.544 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-06T12:13:06.545 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-06T12:13:06.546 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-06T12:13:06.547 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-06T12:13:06.548 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:13:06.548 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-06T12:13:06.575 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f2af90de-f40e-11ee-b649-cb9ed24678a4 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-06T12:13:06.575 DEBUG:teuthology.orchestra.run.smithi152:mon.smithi152> sudo journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi152.service 2024-04-06T12:13:06.617 INFO:tasks.cephadm:Bootstrapping... 2024-04-06T12:13:06.618 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific -v bootstrap --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.152 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-06T12:13:06.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:-- Logs begin at Sat 2024-04-06 12:02:33 UTC. -- 2024-04-06T12:13:06.824 INFO:teuthology.orchestra.run.smithi152.stderr:-------------------------------------------------------------------------------- 2024-04-06T12:13:06.824 INFO:teuthology.orchestra.run.smithi152.stderr:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:pacific', '-v', 'bootstrap', '--fsid', 'f2af90de-f40e-11ee-b649-cb9ed24678a4', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.152', '--skip-admin-label'] 2024-04-06T12:13:06.845 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: 4.9.4-dev 2024-04-06T12:13:06.859 INFO:teuthology.orchestra.run.smithi152.stderr:Verifying podman|docker is present... 2024-04-06T12:13:06.878 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: 4.9.4-dev 2024-04-06T12:13:06.893 INFO:teuthology.orchestra.run.smithi152.stderr:Verifying lvm2 is present... 2024-04-06T12:13:06.893 INFO:teuthology.orchestra.run.smithi152.stderr:Verifying time synchronization is in place... 2024-04-06T12:13:06.899 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-04-06T12:13:06.906 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: inactive 2024-04-06T12:13:06.911 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: enabled 2024-04-06T12:13:06.917 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: active 2024-04-06T12:13:06.917 INFO:teuthology.orchestra.run.smithi152.stderr:Unit chronyd.service is enabled and running 2024-04-06T12:13:06.917 INFO:teuthology.orchestra.run.smithi152.stderr:Repeating the final host check... 2024-04-06T12:13:06.937 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: 4.9.4-dev 2024-04-06T12:13:06.949 INFO:teuthology.orchestra.run.smithi152.stderr:podman (/bin/podman) version 4.9.4 is present 2024-04-06T12:13:06.949 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl is present 2024-04-06T12:13:06.949 INFO:teuthology.orchestra.run.smithi152.stderr:lvcreate is present 2024-04-06T12:13:06.954 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-04-06T12:13:06.960 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: inactive 2024-04-06T12:13:06.965 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: enabled 2024-04-06T12:13:06.971 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: active 2024-04-06T12:13:06.972 INFO:teuthology.orchestra.run.smithi152.stderr:Unit chronyd.service is enabled and running 2024-04-06T12:13:06.972 INFO:teuthology.orchestra.run.smithi152.stderr:Host looks OK 2024-04-06T12:13:06.972 INFO:teuthology.orchestra.run.smithi152.stderr:Cluster fsid: f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:06.972 INFO:teuthology.orchestra.run.smithi152.stderr:Acquiring lock 140520149252584 on /run/cephadm/f2af90de-f40e-11ee-b649-cb9ed24678a4.lock 2024-04-06T12:13:06.972 INFO:teuthology.orchestra.run.smithi152.stderr:Lock 140520149252584 acquired on /run/cephadm/f2af90de-f40e-11ee-b649-cb9ed24678a4.lock 2024-04-06T12:13:06.972 INFO:teuthology.orchestra.run.smithi152.stderr:Verifying IP 172.21.15.152 port 3300 ... 2024-04-06T12:13:06.973 INFO:teuthology.orchestra.run.smithi152.stderr:Verifying IP 172.21.15.152 port 6789 ... 2024-04-06T12:13:06.973 INFO:teuthology.orchestra.run.smithi152.stderr:Base mon IP(s) is [172.21.15.152:3300, 172.21.15.152:6789], mon addrv is [v2:172.21.15.152:3300,v1:172.21.15.152:6789] 2024-04-06T12:13:06.977 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.152 metric 100 2024-04-06T12:13:06.977 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.152 metric 100 2024-04-06T12:13:06.979 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-04-06T12:13:06.979 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-06T12:13:06.979 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1747sec hoplimit 64 pref medium 2024-04-06T12:13:06.982 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-06T12:13:06.982 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-04-06T12:13:06.982 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-04-06T12:13:06.982 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-06T12:13:06.982 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-04-06T12:13:06.982 INFO:teuthology.orchestra.run.smithi152.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-04-06T12:13:06.983 INFO:teuthology.orchestra.run.smithi152.stderr:Mon IP `172.21.15.152` is in CIDR network `172.21.0.0/20` 2024-04-06T12:13:06.984 INFO:teuthology.orchestra.run.smithi152.stderr:Mon IP `172.21.15.152` is in CIDR network `172.21.0.0/20` 2024-04-06T12:13:06.984 INFO:teuthology.orchestra.run.smithi152.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-06T12:13:06.984 INFO:teuthology.orchestra.run.smithi152.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-06T12:13:06.985 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-04-06T12:13:07.060 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: Trying to pull quay.ceph.io/ceph-ci/ceph:pacific... 2024-04-06T12:13:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: Getting image source signatures 2024-04-06T12:13:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: Copying blob sha256:efbf2990d792dd99354c95f0e06c6d4330413e38e584cb30666e2a0d35649b94 2024-04-06T12:13:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-04-06T12:13:07.143 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: Copying config sha256:727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0 2024-04-06T12:13:07.285 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: Writing manifest to image destination 2024-04-06T12:13:07.446 INFO:teuthology.orchestra.run.smithi152.stderr:/bin/podman: 727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0 2024-04-06T12:13:07.953 INFO:teuthology.orchestra.run.smithi152.stderr:ceph: ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable) 2024-04-06T12:13:08.603 INFO:teuthology.orchestra.run.smithi152.stderr:Ceph version: ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable) 2024-04-06T12:13:08.603 INFO:teuthology.orchestra.run.smithi152.stderr:Extracting ceph user uid/gid from container image... 2024-04-06T12:13:09.160 INFO:teuthology.orchestra.run.smithi152.stderr:stat: 167 167 2024-04-06T12:13:09.726 INFO:teuthology.orchestra.run.smithi152.stderr:Creating initial keys... 2024-04-06T12:13:10.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-authtool: AQBWPBFmE6AhCRAADDEXpYKTxkj0h+gu6alnpQ== 2024-04-06T12:13:11.808 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-authtool: AQBXPBFmlOabKhAAh6Soxn9f4mAElxjrZ3xSrw== 2024-04-06T12:13:13.014 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-authtool: AQBYPBFmEphZNxAAQ2JcETygMKa7HkDMqOQTeQ== 2024-04-06T12:13:13.548 INFO:teuthology.orchestra.run.smithi152.stderr:Creating initial monmap... 2024-04-06T12:13:14.179 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-06T12:13:14.179 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:14.179 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-06T12:13:14.730 INFO:teuthology.orchestra.run.smithi152.stderr:monmaptool for smithi152 [v2:172.21.15.152:3300,v1:172.21.15.152:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-06T12:13:14.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/monmaptool: set fsid to f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:14.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-06T12:13:14.730 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:13:14.731 INFO:teuthology.orchestra.run.smithi152.stderr:Creating mon... 2024-04-06T12:13:15.278 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.161+0000 7fbdb7876880 0 set uid:gid to 167:167 (ceph:ceph) 2024-04-06T12:13:15.278 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.161+0000 7fbdb7876880 1 imported monmap: 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: epoch 0 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: last_changed 2024-04-06T12:13:14.047153+0000 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: created 2024-04-06T12:13:14.047153+0000 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.161+0000 7fbdb7876880 0 /usr/bin/ceph-mon: set fsid to f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: RocksDB version: 6.8.1 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Compile date Mar 4 2024 2024-04-06T12:13:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: DB SUMMARY 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi152/store.db dir, Total Num: 0, files: 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi152/store.db: 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.error_if_exists: 0 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.create_if_missing: 1 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.paranoid_checks: 1 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.env: 0x561476bc9080 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.fs: Posix File System 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.info_log: 0x561478ea7300 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_file_opening_threads: 16 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.statistics: (nil) 2024-04-06T12:13:15.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.use_fsync: 0 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_log_file_size: 0 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.keep_log_file_num: 1000 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.recycle_log_file_num: 0 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.allow_fallocate: 1 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.allow_mmap_reads: 0 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.allow_mmap_writes: 0 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.use_direct_reads: 0 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.create_missing_column_families: 0 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.db_log_dir: 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi152/store.db 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-04-06T12:13:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_subcompactions: 1 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_background_flushes: -1 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.advise_random_on_open: 1 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.db_write_buffer_size: 0 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.write_buffer_manager: 0x561478ead950 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-04-06T12:13:15.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.rate_limiter: (nil) 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.wal_recovery_mode: 2 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.enable_thread_tracking: 0 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.enable_pipelined_write: 0 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.unordered_write: 0 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.row_cache: None 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.wal_filter: None 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.allow_ingest_behind: 0 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.preserve_deletes: 0 2024-04-06T12:13:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.two_write_queues: 0 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.manual_wal_flush: 0 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.atomic_flush: 0 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.log_readahead_size: 0 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_background_jobs: 2 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_background_compactions: -1 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_total_wal_size: 0 2024-04-06T12:13:15.284 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.max_open_files: -1 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.bytes_per_sync: 0 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Options.compaction_readahead_size: 0 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Compression algorithms supported: 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: kZSTD supported: 0 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: kXpressCompression supported: 0 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: kLZ4HCCompression supported: 1 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: kLZ4Compression supported: 1 2024-04-06T12:13:15.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: kBZip2Compression supported: 0 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: kZlibCompression supported: 1 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: kSnappyCompression supported: 1 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.162+0000 7fbdb7876880 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000001 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.merge_operator: 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_filter: None 2024-04-06T12:13:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_filter_factory: None 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561478dbdd18) 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: index_type: 0 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: checksum: 1 2024-04-06T12:13:15.287 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: block_cache: 0x561478df2d10 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-04-06T12:13:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: format_version: 2 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: block_align: 0 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.write_buffer_size: 33554432 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_write_buffer_number: 2 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compression: NoCompression 2024-04-06T12:13:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.bottommost_compression: Disabled 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.prefix_extractor: nullptr 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.num_levels: 7 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-04-06T12:13:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compression_opts.level: 32767 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compression_opts.strategy: 0 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compression_opts.enabled: false 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.target_file_size_base: 67108864 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-06T12:13:15.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.arena_block_size: 4194304 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.disable_auto_compactions: 0 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-06T12:13:15.292 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.table_properties_collectors: 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.inplace_update_support: 0 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.bloom_locality: 0 2024-04-06T12:13:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.max_successive_merges: 0 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.paranoid_file_checks: 0 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.force_consistency_checks: 0 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.report_bg_io_stats: 0 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.ttl: 2592000 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.163+0000 7fbdb7876880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.164+0000 7fbdb7876880 4 rocksdb: DB pointer 0x561478ebb800 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.164+0000 7fbda06e9700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.164+0000 7fbda06e9700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-04-06T12:13:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-06T12:13:15.295 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-04-06T12:13:15.296 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-04-06T12:13:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.166+0000 7fbdb7876880 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.166+0000 7fbdb7876880 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-04-06T12:13:15.298 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph-mon: debug 2024-04-06T12:13:15.166+0000 7fbdb7876880 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi152 for mon.smithi152 2024-04-06T12:13:15.713 INFO:teuthology.orchestra.run.smithi152.stderr:create mon.smithi152 on 2024-04-06T12:13:15.724 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-04-06T12:13:15.812 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-06T12:13:15.904 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4.target → /etc/systemd/system/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4.target. 2024-04-06T12:13:15.905 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4.target → /etc/systemd/system/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4.target. 2024-04-06T12:13:16.114 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Failed to reset failed state of unit ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi152.service: Unit ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi152.service not loaded. 2024-04-06T12:13:16.120 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Created symlink /etc/systemd/system/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4.target.wants/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi152.service → /etc/systemd/system/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@.service. 2024-04-06T12:13:16.837 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: disabled 2024-04-06T12:13:16.844 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: inactive 2024-04-06T12:13:16.845 INFO:teuthology.orchestra.run.smithi152.stderr:firewalld.service is not enabled 2024-04-06T12:13:16.845 INFO:teuthology.orchestra.run.smithi152.stderr:Not possible to enable service . firewalld.service is not available 2024-04-06T12:13:16.845 INFO:teuthology.orchestra.run.smithi152.stderr:Waiting for mon to start... 2024-04-06T12:13:16.845 INFO:teuthology.orchestra.run.smithi152.stderr:Waiting for mon... 2024-04-06T12:13:17.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:16 smithi152 bash[39201]: 8d43ba5ac93e3fdb67df78e9903adbdf11b0731e28637ea43a8bc2674e7ad7fa 2024-04-06T12:13:17.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:16 smithi152 systemd[1]: Started Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:13:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.338+0000 7f28a7c9d700 1 Processor -- start 2024-04-06T12:13:17.340 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.339+0000 7f28a7c9d700 1 -- start start 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.339+0000 7f28a7c9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a00fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.339+0000 7f28a7c9d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00fc7e0 con 0x7f28a00fbed0 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.339+0000 7f28a5a39700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a00fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.339+0000 7f28a5a39700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a00fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33152/0 (socket says 172.21.15.152:33152) 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.339+0000 7f28a5a39700 1 -- 172.21.15.152:0/3914231142 learned_addr learned my addr 172.21.15.152:0/3914231142 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a5a39700 1 -- 172.21.15.152:0/3914231142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00fc920 con 0x7f28a00fbed0 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a5a39700 1 --2- 172.21.15.152:0/3914231142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a00fc2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f2894009730 tx=0x7f28940090f0).ready entity=mon.0 client_cookie=e5e61926b365b695 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a4a37700 1 -- 172.21.15.152:0/3914231142 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f289400b6e0 con 0x7f28a00fbed0 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a4a37700 1 -- 172.21.15.152:0/3914231142 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289400b840 con 0x7f28a00fbed0 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a4a37700 1 -- 172.21.15.152:0/3914231142 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f289400bb10 con 0x7f28a00fbed0 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a7c9d700 1 -- 172.21.15.152:0/3914231142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 msgr2=0x7f28a00fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a7c9d700 1 --2- 172.21.15.152:0/3914231142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a00fc2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f2894009730 tx=0x7f28940090f0).stop 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a7c9d700 1 -- 172.21.15.152:0/3914231142 shutdown_connections 2024-04-06T12:13:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a7c9d700 1 --2- 172.21.15.152:0/3914231142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a00fc2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:17.342 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.340+0000 7f28a7c9d700 1 -- 172.21.15.152:0/3914231142 >> 172.21.15.152:0/3914231142 conn(0x7f28a00f76f0 msgr2=0x7f28a00f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:17.342 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.341+0000 7f28a7c9d700 1 -- 172.21.15.152:0/3914231142 shutdown_connections 2024-04-06T12:13:17.342 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.341+0000 7f28a7c9d700 1 -- 172.21.15.152:0/3914231142 wait complete. 2024-04-06T12:13:17.342 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.341+0000 7f28a7c9d700 1 Processor -- start 2024-04-06T12:13:17.342 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.341+0000 7f28a7c9d700 1 -- start start 2024-04-06T12:13:17.342 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.341+0000 7f28a7c9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a010a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:17.342 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.341+0000 7f28a7c9d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a010a9b0 con 0x7f28a00fbed0 2024-04-06T12:13:17.342 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.341+0000 7f28a5a39700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a010a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:17.342 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.341+0000 7f28a5a39700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a010a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33160/0 (socket says 172.21.15.152:33160) 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.341+0000 7f28a5a39700 1 -- 172.21.15.152:0/267386824 learned_addr learned my addr 172.21.15.152:0/267386824 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.342+0000 7f28a5a39700 1 -- 172.21.15.152:0/267386824 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894009370 con 0x7f28a00fbed0 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.342+0000 7f28a5a39700 1 --2- 172.21.15.152:0/267386824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a010a4c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f2894000c00 tx=0x7f2894017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.342+0000 7f2892ffd700 1 -- 172.21.15.152:0/267386824 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2894011cc0 con 0x7f28a00fbed0 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.342+0000 7f2892ffd700 1 -- 172.21.15.152:0/267386824 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2894011e20 con 0x7f28a00fbed0 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.342+0000 7f28a7c9d700 1 -- 172.21.15.152:0/267386824 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a010abb0 con 0x7f28a00fbed0 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.342+0000 7f2892ffd700 1 -- 172.21.15.152:0/267386824 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f289401d590 con 0x7f28a00fbed0 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.342+0000 7f28a7c9d700 1 -- 172.21.15.152:0/267386824 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a010afc0 con 0x7f28a00fbed0 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.342+0000 7f2892ffd700 1 -- 172.21.15.152:0/267386824 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f289401da20 con 0x7f28a00fbed0 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.342+0000 7f2892ffd700 1 -- 172.21.15.152:0/267386824 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2894026b50 con 0x7f28a00fbed0 2024-04-06T12:13:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.343+0000 7f28a7c9d700 1 -- 172.21.15.152:0/267386824 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a0046ce0 con 0x7f28a00fbed0 2024-04-06T12:13:17.344 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.345+0000 7f2892ffd700 1 -- 172.21.15.152:0/267386824 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f2894021030 con 0x7f28a00fbed0 2024-04-06T12:13:17.412 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.412+0000 7f28a7c9d700 1 -- 172.21.15.152:0/267386824 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f28a0103f50 con 0x7f28a00fbed0 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.412+0000 7f2892ffd700 1 -- 172.21.15.152:0/267386824 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f289402f430 con 0x7f28a00fbed0 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: cluster: 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: id: f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: services: 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi152 (age 0.646136s) 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mgr: no daemons active 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: data: 2024-04-06T12:13:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: pgs: 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.413+0000 7f28a7c9d700 1 -- 172.21.15.152:0/267386824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 msgr2=0x7f28a010a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.413+0000 7f28a7c9d700 1 --2- 172.21.15.152:0/267386824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a010a4c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f2894000c00 tx=0x7f2894017000).stop 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.413+0000 7f28a7c9d700 1 -- 172.21.15.152:0/267386824 shutdown_connections 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.413+0000 7f28a7c9d700 1 --2- 172.21.15.152:0/267386824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28a00fbed0 0x7f28a010a4c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.413+0000 7f28a7c9d700 1 -- 172.21.15.152:0/267386824 >> 172.21.15.152:0/267386824 conn(0x7f28a00f76f0 msgr2=0x7f28a00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.413+0000 7f28a7c9d700 1 -- 172.21.15.152:0/267386824 shutdown_connections 2024-04-06T12:13:17.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:17.413+0000 7f28a7c9d700 1 -- 172.21.15.152:0/267386824 wait complete. 2024-04-06T12:13:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: cluster 2024-04-06T12:13:16.767363+0000 mon.smithi152 (mon.0) 2 : cluster [INF] mon.smithi152 is new leader, mons smithi152 in quorum (ranks 0) 2024-04-06T12:13:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: cluster 2024-04-06T12:13:16.767541+0000 mon.smithi152 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2024-04-06T12:13:18.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: cluster 2024-04-06T12:13:16.770545+0000 mon.smithi152 (mon.0) 4 : cluster [DBG] fsmap 2024-04-06T12:13:18.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: cluster 2024-04-06T12:13:16.773299+0000 mon.smithi152 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-04-06T12:13:18.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: cluster 2024-04-06T12:13:16.773748+0000 mon.smithi152 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-04-06T12:13:18.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: audit 2024-04-06T12:13:17.413460+0000 mon.smithi152 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.152:0/267386824' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-06T12:13:18.055 INFO:teuthology.orchestra.run.smithi152.stderr:mon is available 2024-04-06T12:13:18.055 INFO:teuthology.orchestra.run.smithi152.stderr:Assimilating anything we can from ceph.conf... 2024-04-06T12:13:18.523 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.506+0000 7f8119996700 1 Processor -- start 2024-04-06T12:13:18.523 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.506+0000 7f8119996700 1 -- start start 2024-04-06T12:13:18.523 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8119996700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f81140fd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:18.523 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8119996700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140fd900 con 0x7f81140fcff0 2024-04-06T12:13:18.523 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8112ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f81140fd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8112ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f81140fd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33176/0 (socket says 172.21.15.152:33176) 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8112ffd700 1 -- 172.21.15.152:0/583314799 learned_addr learned my addr 172.21.15.152:0/583314799 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8112ffd700 1 -- 172.21.15.152:0/583314799 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140fda40 con 0x7f81140fcff0 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8112ffd700 1 --2- 172.21.15.152:0/583314799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f81140fd410 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f80fc009730 tx=0x7f80fc0090f0).ready entity=mon.0 client_cookie=20489f6bfe92bbfc server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8111ffb700 1 -- 172.21.15.152:0/583314799 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80fc00b6e0 con 0x7f81140fcff0 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8111ffb700 1 -- 172.21.15.152:0/583314799 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc00b840 con 0x7f81140fcff0 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.507+0000 7f8111ffb700 1 -- 172.21.15.152:0/583314799 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80fc00bb10 con 0x7f81140fcff0 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.508+0000 7f8119996700 1 -- 172.21.15.152:0/583314799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 msgr2=0x7f81140fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.508+0000 7f8119996700 1 --2- 172.21.15.152:0/583314799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f81140fd410 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f80fc009730 tx=0x7f80fc0090f0).stop 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.508+0000 7f8119996700 1 -- 172.21.15.152:0/583314799 shutdown_connections 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.508+0000 7f8119996700 1 --2- 172.21.15.152:0/583314799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f81140fd410 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.508+0000 7f8119996700 1 -- 172.21.15.152:0/583314799 >> 172.21.15.152:0/583314799 conn(0x7f81140f8810 msgr2=0x7f81140fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.508+0000 7f8119996700 1 -- 172.21.15.152:0/583314799 shutdown_connections 2024-04-06T12:13:18.524 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.508+0000 7f8119996700 1 -- 172.21.15.152:0/583314799 wait complete. 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.508+0000 7f8119996700 1 Processor -- start 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8119996700 1 -- start start 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8119996700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f8114073da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8119996700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8114072220 con 0x7f81140fcff0 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8112ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f8114073da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8112ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f8114073da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33182/0 (socket says 172.21.15.152:33182) 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8112ffd700 1 -- 172.21.15.152:0/1801906607 learned_addr learned my addr 172.21.15.152:0/1801906607 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8112ffd700 1 -- 172.21.15.152:0/1801906607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc009370 con 0x7f81140fcff0 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8112ffd700 1 --2- 172.21.15.152:0/1801906607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f8114073da0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f80fc000c00 tx=0x7f80fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f810bfff700 1 -- 172.21.15.152:0/1801906607 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80fc011cc0 con 0x7f81140fcff0 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f810bfff700 1 -- 172.21.15.152:0/1801906607 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc011e20 con 0x7f81140fcff0 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f810bfff700 1 -- 172.21.15.152:0/1801906607 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80fc01d590 con 0x7f81140fcff0 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8119996700 1 -- 172.21.15.152:0/1801906607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81140723c0 con 0x7f81140fcff0 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.509+0000 7f8119996700 1 -- 172.21.15.152:0/1801906607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81140727d0 con 0x7f81140fcff0 2024-04-06T12:13:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.510+0000 7f810bfff700 1 -- 172.21.15.152:0/1801906607 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f80fc01da20 con 0x7f81140fcff0 2024-04-06T12:13:18.526 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.510+0000 7f810bfff700 1 -- 172.21.15.152:0/1801906607 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f80fc026b10 con 0x7f81140fcff0 2024-04-06T12:13:18.526 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.510+0000 7f8119996700 1 -- 172.21.15.152:0/1801906607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8114046ce0 con 0x7f81140fcff0 2024-04-06T12:13:18.526 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.513+0000 7f810bfff700 1 -- 172.21.15.152:0/1801906607 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f80fc021030 con 0x7f81140fcff0 2024-04-06T12:13:18.576 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.577+0000 7f8119996700 1 -- 172.21.15.152:0/1801906607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f81140fe330 con 0x7f81140fcff0 2024-04-06T12:13:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.580+0000 7f810bfff700 1 -- 172.21.15.152:0/1801906607 <== mon.0 v2:172.21.15.152:3300/0 7 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f80fc019840 con 0x7f81140fcff0 2024-04-06T12:13:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.580+0000 7f810bfff700 1 -- 172.21.15.152:0/1801906607 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+456 (secure 0 0 0) 0x7f80fc036430 con 0x7f81140fcff0 2024-04-06T12:13:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: [global] 2024-04-06T12:13:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: fsid = f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: log_to_journald = false 2024-04-06T12:13:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.152:3300,v1:172.21.15.152:6789] 2024-04-06T12:13:18.582 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-04-06T12:13:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-04-06T12:13:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-04-06T12:13:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-04-06T12:13:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: [mgr] 2024-04-06T12:13:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-04-06T12:13:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: [osd] 2024-04-06T12:13:18.586 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-04-06T12:13:18.586 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-04-06T12:13:18.586 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-04-06T12:13:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-04-06T12:13:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-04-06T12:13:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.582+0000 7f8119996700 1 -- 172.21.15.152:0/1801906607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 msgr2=0x7f8114073da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.582+0000 7f8119996700 1 --2- 172.21.15.152:0/1801906607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f8114073da0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f80fc000c00 tx=0x7f80fc017000).stop 2024-04-06T12:13:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.582+0000 7f8119996700 1 -- 172.21.15.152:0/1801906607 shutdown_connections 2024-04-06T12:13:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.582+0000 7f8119996700 1 --2- 172.21.15.152:0/1801906607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81140fcff0 0x7f8114073da0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.582+0000 7f8119996700 1 -- 172.21.15.152:0/1801906607 >> 172.21.15.152:0/1801906607 conn(0x7f81140f8810 msgr2=0x7f81140ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.582+0000 7f8119996700 1 -- 172.21.15.152:0/1801906607 shutdown_connections 2024-04-06T12:13:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:18.582+0000 7f8119996700 1 -- 172.21.15.152:0/1801906607 wait complete. 2024-04-06T12:13:18.855 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: audit 2024-04-06T12:13:18.578758+0000 mon.smithi152 (mon.0) 8 : audit [INF] from='client.? 172.21.15.152:0/1801906607' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-06T12:13:18.856 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: audit 2024-04-06T12:13:18.581831+0000 mon.smithi152 (mon.0) 9 : audit [INF] from='client.? 172.21.15.152:0/1801906607' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-06T12:13:19.117 INFO:teuthology.orchestra.run.smithi152.stderr:Generating new minimal ceph.conf... 2024-04-06T12:13:19.652 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.650+0000 7fbb92fa3700 1 Processor -- start 2024-04-06T12:13:19.652 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.650+0000 7fbb92fa3700 1 -- start start 2024-04-06T12:13:19.652 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.650+0000 7fbb92fa3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c0ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.650+0000 7fbb92fa3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c1000b0 con 0x7fbb8c071c60 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.650+0000 7fbb90d3f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c0ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.650+0000 7fbb90d3f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c0ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33196/0 (socket says 172.21.15.152:33196) 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.650+0000 7fbb90d3f700 1 -- 172.21.15.152:0/2954155784 learned_addr learned my addr 172.21.15.152:0/2954155784 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.651+0000 7fbb90d3f700 1 -- 172.21.15.152:0/2954155784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c1001f0 con 0x7fbb8c071c60 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.651+0000 7fbb90d3f700 1 --2- 172.21.15.152:0/2954155784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c0ffbc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fbb80009730 tx=0x7fbb800090f0).ready entity=mon.0 client_cookie=32616c7deaae8d66 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.651+0000 7fbb8b7fe700 1 -- 172.21.15.152:0/2954155784 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb8000b6e0 con 0x7fbb8c071c60 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.651+0000 7fbb8b7fe700 1 -- 172.21.15.152:0/2954155784 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbb8000bc90 con 0x7fbb8c071c60 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.651+0000 7fbb8b7fe700 1 -- 172.21.15.152:0/2954155784 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb80011c70 con 0x7fbb8c071c60 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.652+0000 7fbb92fa3700 1 -- 172.21.15.152:0/2954155784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 msgr2=0x7fbb8c0ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.652+0000 7fbb92fa3700 1 --2- 172.21.15.152:0/2954155784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c0ffbc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fbb80009730 tx=0x7fbb800090f0).stop 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.652+0000 7fbb92fa3700 1 -- 172.21.15.152:0/2954155784 shutdown_connections 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.652+0000 7fbb92fa3700 1 --2- 172.21.15.152:0/2954155784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c0ffbc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:19.653 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.652+0000 7fbb92fa3700 1 -- 172.21.15.152:0/2954155784 >> 172.21.15.152:0/2954155784 conn(0x7fbb8c0f76a0 msgr2=0x7fbb8c0f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.652+0000 7fbb92fa3700 1 -- 172.21.15.152:0/2954155784 shutdown_connections 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.652+0000 7fbb92fa3700 1 -- 172.21.15.152:0/2954155784 wait complete. 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.652+0000 7fbb92fa3700 1 Processor -- start 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb92fa3700 1 -- start start 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb92fa3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c10bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb92fa3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c10c280 con 0x7fbb8c071c60 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb90d3f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c10bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb90d3f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c10bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33204/0 (socket says 172.21.15.152:33204) 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb90d3f700 1 -- 172.21.15.152:0/918237736 learned_addr learned my addr 172.21.15.152:0/918237736 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb90d3f700 1 -- 172.21.15.152:0/918237736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009370 con 0x7fbb8c071c60 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb90d3f700 1 --2- 172.21.15.152:0/918237736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c10bd90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fbb80000c00 tx=0x7fbb800090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb89ffb700 1 -- 172.21.15.152:0/918237736 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb8001a610 con 0x7fbb8c071c60 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb89ffb700 1 -- 172.21.15.152:0/918237736 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbb8001abc0 con 0x7fbb8c071c60 2024-04-06T12:13:19.654 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb89ffb700 1 -- 172.21.15.152:0/918237736 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb80022a20 con 0x7fbb8c071c60 2024-04-06T12:13:19.655 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.653+0000 7fbb92fa3700 1 -- 172.21.15.152:0/918237736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c10c480 con 0x7fbb8c071c60 2024-04-06T12:13:19.655 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.654+0000 7fbb92fa3700 1 -- 172.21.15.152:0/918237736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c10d090 con 0x7fbb8c071c60 2024-04-06T12:13:19.655 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.654+0000 7fbb89ffb700 1 -- 172.21.15.152:0/918237736 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fbb80023450 con 0x7fbb8c071c60 2024-04-06T12:13:19.655 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.654+0000 7fbb89ffb700 1 -- 172.21.15.152:0/918237736 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbb80019390 con 0x7fbb8c071c60 2024-04-06T12:13:19.655 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.655+0000 7fbb92fa3700 1 -- 172.21.15.152:0/918237736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c05a310 con 0x7fbb8c071c60 2024-04-06T12:13:19.655 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.657+0000 7fbb89ffb700 1 -- 172.21.15.152:0/918237736 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fbb80028060 con 0x7fbb8c071c60 2024-04-06T12:13:19.719 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.720+0000 7fbb92fa3700 1 -- 172.21.15.152:0/918237736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fbb8c100f50 con 0x7fbb8c071c60 2024-04-06T12:13:19.719 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.721+0000 7fbb89ffb700 1 -- 172.21.15.152:0/918237736 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fbb8001e070 con 0x7fbb8c071c60 2024-04-06T12:13:19.720 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.721+0000 7fbb92fa3700 1 -- 172.21.15.152:0/918237736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 msgr2=0x7fbb8c10bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:19.721 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.721+0000 7fbb92fa3700 1 --2- 172.21.15.152:0/918237736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c10bd90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fbb80000c00 tx=0x7fbb800090f0).stop 2024-04-06T12:13:19.721 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.722+0000 7fbb92fa3700 1 -- 172.21.15.152:0/918237736 shutdown_connections 2024-04-06T12:13:19.721 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.722+0000 7fbb92fa3700 1 --2- 172.21.15.152:0/918237736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8c071c60 0x7fbb8c10bd90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:19.721 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.722+0000 7fbb92fa3700 1 -- 172.21.15.152:0/918237736 >> 172.21.15.152:0/918237736 conn(0x7fbb8c0f76a0 msgr2=0x7fbb8c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:19.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.722+0000 7fbb92fa3700 1 -- 172.21.15.152:0/918237736 shutdown_connections 2024-04-06T12:13:19.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:19.722+0000 7fbb92fa3700 1 -- 172.21.15.152:0/918237736 wait complete. 2024-04-06T12:13:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: audit 2024-04-06T12:13:19.722011+0000 mon.smithi152 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.152:0/918237736' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:13:20.357 INFO:teuthology.orchestra.run.smithi152.stderr:Restarting the monitor... 2024-04-06T12:13:20.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:20 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:13:20.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:20 smithi152 bash[39541]: Error: no container with name or ID "ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon.smithi152" found: no such container 2024-04-06T12:13:20.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: debug 2024-04-06T12:13:20.624+0000 7fda855ab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-04-06T12:13:20.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39215]: debug 2024-04-06T12:13:20.624+0000 7fda855ab700 -1 mon.smithi152@0(leader) e1 *** Got Signal Terminated *** 2024-04-06T12:13:21.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 bash[39579]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152 2024-04-06T12:13:21.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 systemd[1]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi152.service: Succeeded. 2024-04-06T12:13:21.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 systemd[1]: Stopped Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:13:21.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 systemd[1]: Starting Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:13:22.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.965+0000 7fbbbac1a880 0 set uid:gid to 167:167 (ceph:ceph) 2024-04-06T12:13:22.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.965+0000 7fbbbac1a880 0 ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable), process ceph-mon, pid 7 2024-04-06T12:13:22.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.965+0000 7fbbbac1a880 0 pidfile_write: ignore empty --pid-file 2024-04-06T12:13:22.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.969+0000 7fbbbac1a880 0 load: jerasure load: lrc load: isa 2024-04-06T12:13:22.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: RocksDB version: 6.8.1 2024-04-06T12:13:22.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-06T12:13:22.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Compile date Mar 4 2024 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: DB SUMMARY 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: CURRENT file: CURRENT 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: IDENTITY file: IDENTITY 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi152/store.db dir, Total Num: 1, files: 000004.sst 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi152/store.db: 000006.log size: 100032 ; 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.error_if_exists: 0 2024-04-06T12:13:22.280 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.create_if_missing: 0 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.paranoid_checks: 1 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.env: 0x5628c37ca080 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.fs: Posix File System 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.info_log: 0x5628c4eec560 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_file_opening_threads: 16 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.statistics: (nil) 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.use_fsync: 0 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_log_file_size: 0 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.keep_log_file_num: 1000 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.recycle_log_file_num: 0 2024-04-06T12:13:22.281 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.allow_fallocate: 1 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.allow_mmap_reads: 0 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.allow_mmap_writes: 0 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.use_direct_reads: 0 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.create_missing_column_families: 0 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.db_log_dir: 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi152/store.db 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_subcompactions: 1 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_background_flushes: -1 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-04-06T12:13:22.282 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.advise_random_on_open: 1 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.db_write_buffer_size: 0 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.write_buffer_manager: 0x5628c5bde3f0 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.rate_limiter: (nil) 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.wal_recovery_mode: 2 2024-04-06T12:13:22.283 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.enable_thread_tracking: 0 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.enable_pipelined_write: 0 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.unordered_write: 0 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.row_cache: None 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.wal_filter: None 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.allow_ingest_behind: 0 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.preserve_deletes: 0 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.two_write_queues: 0 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.manual_wal_flush: 0 2024-04-06T12:13:22.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.atomic_flush: 0 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.log_readahead_size: 0 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_background_jobs: 2 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_background_compactions: -1 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_total_wal_size: 0 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-04-06T12:13:22.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_open_files: -1 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.bytes_per_sync: 0 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_readahead_size: 0 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Compression algorithms supported: 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: kZSTD supported: 0 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: kXpressCompression supported: 0 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: kLZ4HCCompression supported: 1 2024-04-06T12:13:22.286 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: kLZ4Compression supported: 1 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: kBZip2Compression supported: 0 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: kZlibCompression supported: 1 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: kSnappyCompression supported: 1 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000005 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.merge_operator: 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_filter: None 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_filter_factory: None 2024-04-06T12:13:22.287 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5628c4e91d10) 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cache_index_and_filter_blocks: 1 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: pin_top_level_index_and_filter: 1 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: index_type: 0 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: data_block_index_type: 0 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: index_shortening: 1 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: data_block_hash_table_util_ratio: 0.750000 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: hash_index_allow_collision: 1 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: checksum: 1 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: no_block_cache: 0 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: block_cache: 0x5628c4ec6f10 2024-04-06T12:13:22.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: block_cache_name: BinnedLRUCache 2024-04-06T12:13:22.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: block_cache_options: 2024-04-06T12:13:22.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: capacity : 536870912 2024-04-06T12:13:22.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: num_shard_bits : 4 2024-04-06T12:13:22.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: strict_capacity_limit : 0 2024-04-06T12:13:22.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: high_pri_pool_ratio: 0.000 2024-04-06T12:13:22.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: block_cache_compressed: (nil) 2024-04-06T12:13:22.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: persistent_cache: (nil) 2024-04-06T12:13:22.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: block_size: 4096 2024-04-06T12:13:22.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: block_size_deviation: 10 2024-04-06T12:13:22.290 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: block_restart_interval: 16 2024-04-06T12:13:22.290 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: index_block_restart_interval: 1 2024-04-06T12:13:22.290 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: metadata_block_size: 4096 2024-04-06T12:13:22.290 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: partition_filters: 0 2024-04-06T12:13:22.290 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: use_delta_encoding: 1 2024-04-06T12:13:22.290 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-06T12:13:22.290 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: whole_key_filtering: 1 2024-04-06T12:13:22.290 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: verify_compression: 0 2024-04-06T12:13:22.290 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: read_amp_bytes_per_bit: 0 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: format_version: 2 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: enable_index_compression: 1 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: block_align: 0 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.write_buffer_size: 33554432 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_write_buffer_number: 2 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compression: NoCompression 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.bottommost_compression: Disabled 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.prefix_extractor: nullptr 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.num_levels: 7 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-06T12:13:22.291 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compression_opts.level: 32767 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compression_opts.strategy: 0 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compression_opts.enabled: false 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-06T12:13:22.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.target_file_size_base: 67108864 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-06T12:13:22.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.arena_block_size: 4194304 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.disable_auto_compactions: 0 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-06T12:13:22.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.table_properties_collectors: 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.inplace_update_support: 0 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.bloom_locality: 0 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.max_successive_merges: 0 2024-04-06T12:13:22.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.paranoid_file_checks: 0 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.force_consistency_checks: 0 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.report_bg_io_stats: 0 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.ttl: 2592000 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.970+0000 7fbbbac1a880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.971+0000 7fbbbac1a880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.971+0000 7fbbbac1a880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.971+0000 7fbbbac1a880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1712405601972150, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.971+0000 7fbbbac1a880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.971+0000 7fbbbac1a880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.971+0000 7fbbbac1a880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1712405601972986, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 95411, "table_properties": {"data_size": 93506, "index_size": 382, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12918, "raw_average_key_size": 49, "raw_value_size": 86400, "raw_average_value_size": 332, "num_data_blocks": 12, "num_entries": 260, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1712405601, "oldest_key_time": 3, "file_creation_time": 0}} 2024-04-06T12:13:22.296 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.971+0000 7fbbbac1a880 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.972+0000 7fbbbac1a880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1712405601973366, "job": 1, "event": "recovery_finished"} 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.972+0000 7fbbbac1a880 4 rocksdb: DB pointer 0x5628c4f8f800 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.973+0000 7fbba1a0c700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.973+0000 7fbba1a0c700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ** DB Stats ** 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T12:13:22.297 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T12:13:22.298 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-06T12:13:22.298 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-06T12:13:22.298 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T12:13:22.298 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.298 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ** Compaction Stats [default] ** 2024-04-06T12:13:22.298 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-06T12:13:22.298 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: L0 2/0 94.87 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.8 0.00 0.00 1 0.001 0 0 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Sum 2/0 94.87 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.8 0.00 0.00 1 0.001 0 0 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.8 0.00 0.00 1 0.001 0 0 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ** Compaction Stats [default] ** 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 160.8 0.00 0.00 1 0.001 0 0 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Flush(GB): cumulative 0.000, interval 0.000 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-06T12:13:22.299 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: AddFile(Total Files): cumulative 0, interval 0 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: AddFile(L0 Files): cumulative 0, interval 0 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: AddFile(Keys): cumulative 0, interval 0 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Cumulative compaction: 0.00 GB write, 33.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Interval compaction: 0.00 GB write, 33.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ** File Read Latency Histogram By Level [default] ** 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ** Compaction Stats [default] ** 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:13:22.300 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: L0 2/0 94.87 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.8 0.00 0.00 1 0.001 0 0 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Sum 2/0 94.87 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.8 0.00 0.00 1 0.001 0 0 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ** Compaction Stats [default] ** 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 160.8 0.00 0.00 1 0.001 0 0 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Flush(GB): cumulative 0.000, interval 0.000 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: AddFile(Total Files): cumulative 0, interval 0 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: AddFile(L0 Files): cumulative 0, interval 0 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: AddFile(Keys): cumulative 0, interval 0 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Cumulative compaction: 0.00 GB write, 32.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:13:22.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: ** File Read Latency Histogram By Level [default] ** 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.973+0000 7fbbbac1a880 0 starting mon.smithi152 rank 0 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi152 fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.974+0000 7fbbbac1a880 1 mon.smithi152@-1(???) e1 preinit fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.974+0000 7fbbbac1a880 0 mon.smithi152@-1(???).mds e1 new map 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.974+0000 7fbbbac1a880 0 mon.smithi152@-1(???).mds e1 print_map 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: e1 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: legacy client fscid: -1 2024-04-06T12:13:22.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: No filesystems configured 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.974+0000 7fbbbac1a880 0 mon.smithi152@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.974+0000 7fbbbac1a880 0 mon.smithi152@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.974+0000 7fbbbac1a880 0 mon.smithi152@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.974+0000 7fbbbac1a880 0 mon.smithi152@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:19.722011+0000 mon.smithi152 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.152:0/918237736' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:13:21.974+0000 7fbbbac1a880 1 mon.smithi152@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:21.991611+0000 mon.smithi152 (mon.0) 1 : cluster [INF] mon.smithi152 is new leader, mons smithi152 in quorum (ranks 0) 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:21.991681+0000 mon.smithi152 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2024-04-06T12:13:22.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:21.992072+0000 mon.smithi152 (mon.0) 3 : cluster [DBG] fsmap 2024-04-06T12:13:22.304 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:21.992101+0000 mon.smithi152 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-04-06T12:13:22.304 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:21.992471+0000 mon.smithi152 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-04-06T12:13:22.437 INFO:teuthology.orchestra.run.smithi152.stderr:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-06T12:13:22.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:22 smithi152 bash[39702]: e3764b960024459acb8ac533b23cd0759113655aae68edd1045cdd3c62bec208 2024-04-06T12:13:22.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:22 smithi152 systemd[1]: Started Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:13:26.172 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.310+0000 7fec44129700 1 Processor -- start 2024-04-06T12:13:26.172 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.310+0000 7fec44129700 1 -- start start 2024-04-06T12:13:26.173 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.310+0000 7fec44129700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c0fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:26.173 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.310+0000 7fec44129700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c0fc7e0 con 0x7fec3c0fbed0 2024-04-06T12:13:26.173 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.310+0000 7fec41ec5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c0fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:26.173 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.310+0000 7fec41ec5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c0fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34154/0 (socket says 172.21.15.152:34154) 2024-04-06T12:13:26.173 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.310+0000 7fec41ec5700 1 -- 172.21.15.152:0/2566266322 learned_addr learned my addr 172.21.15.152:0/2566266322 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:26.173 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.311+0000 7fec41ec5700 1 -- 172.21.15.152:0/2566266322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c0fc920 con 0x7fec3c0fbed0 2024-04-06T12:13:26.173 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.311+0000 7fec41ec5700 1 --2- 172.21.15.152:0/2566266322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c0fc2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fec34009e50 tx=0x7fec34009840).ready entity=mon.0 client_cookie=1727ce4a90121a70 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:26.174 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.311+0000 7fec40ec3700 1 -- 172.21.15.152:0/2566266322 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec3400ba20 con 0x7fec3c0fbed0 2024-04-06T12:13:26.174 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.311+0000 7fec40ec3700 1 -- 172.21.15.152:0/2566266322 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fec34013420 con 0x7fec3c0fbed0 2024-04-06T12:13:26.174 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.311+0000 7fec40ec3700 1 -- 172.21.15.152:0/2566266322 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec340075e0 con 0x7fec3c0fbed0 2024-04-06T12:13:26.174 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.311+0000 7fec44129700 1 -- 172.21.15.152:0/2566266322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 msgr2=0x7fec3c0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:26.174 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.311+0000 7fec44129700 1 --2- 172.21.15.152:0/2566266322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c0fc2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fec34009e50 tx=0x7fec34009840).stop 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.312+0000 7fec44129700 1 -- 172.21.15.152:0/2566266322 shutdown_connections 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.312+0000 7fec44129700 1 --2- 172.21.15.152:0/2566266322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c0fc2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.312+0000 7fec44129700 1 -- 172.21.15.152:0/2566266322 >> 172.21.15.152:0/2566266322 conn(0x7fec3c0f76f0 msgr2=0x7fec3c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.312+0000 7fec44129700 1 -- 172.21.15.152:0/2566266322 shutdown_connections 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.312+0000 7fec44129700 1 -- 172.21.15.152:0/2566266322 wait complete. 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.312+0000 7fec44129700 1 Processor -- start 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.312+0000 7fec44129700 1 -- start start 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.312+0000 7fec44129700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c10ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.312+0000 7fec44129700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c071c80 con 0x7fec3c0fbed0 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec41ec5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c10ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:26.175 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec41ec5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c10ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34160/0 (socket says 172.21.15.152:34160) 2024-04-06T12:13:26.176 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec41ec5700 1 -- 172.21.15.152:0/3209625583 learned_addr learned my addr 172.21.15.152:0/3209625583 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:26.176 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec41ec5700 1 -- 172.21.15.152:0/3209625583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34009ae0 con 0x7fec3c0fbed0 2024-04-06T12:13:26.176 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec41ec5700 1 --2- 172.21.15.152:0/3209625583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c10ead0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fec3400bc30 tx=0x7fec34009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:26.176 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec32ffd700 1 -- 172.21.15.152:0/3209625583 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec34007400 con 0x7fec3c0fbed0 2024-04-06T12:13:26.176 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec32ffd700 1 -- 172.21.15.152:0/3209625583 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fec340092e0 con 0x7fec3c0fbed0 2024-04-06T12:13:26.176 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec32ffd700 1 -- 172.21.15.152:0/3209625583 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec3401ca20 con 0x7fec3c0fbed0 2024-04-06T12:13:26.176 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec44129700 1 -- 172.21.15.152:0/3209625583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c071e80 con 0x7fec3c0fbed0 2024-04-06T12:13:26.177 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec44129700 1 -- 172.21.15.152:0/3209625583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c10f180 con 0x7fec3c0fbed0 2024-04-06T12:13:26.177 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec32ffd700 1 -- 172.21.15.152:0/3209625583 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fec34003040 con 0x7fec3c0fbed0 2024-04-06T12:13:26.177 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.313+0000 7fec32ffd700 1 -- 172.21.15.152:0/3209625583 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fec34025cf0 con 0x7fec3c0fbed0 2024-04-06T12:13:26.177 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.314+0000 7fec44129700 1 -- 172.21.15.152:0/3209625583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c05a310 con 0x7fec3c0fbed0 2024-04-06T12:13:26.177 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.316+0000 7fec32ffd700 1 -- 172.21.15.152:0/3209625583 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fec34018040 con 0x7fec3c0fbed0 2024-04-06T12:13:26.177 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.380+0000 7fec44129700 1 -- 172.21.15.152:0/3209625583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fec3c046ce0 con 0x7fec3c0fbed0 2024-04-06T12:13:26.177 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.383+0000 7fec32ffd700 1 -- 172.21.15.152:0/3209625583 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fec3c046ce0 con 0x7fec3c0fbed0 2024-04-06T12:13:26.177 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.383+0000 7fec44129700 1 -- 172.21.15.152:0/3209625583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 msgr2=0x7fec3c10ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:26.178 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.383+0000 7fec44129700 1 --2- 172.21.15.152:0/3209625583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c10ead0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fec3400bc30 tx=0x7fec34009840).stop 2024-04-06T12:13:26.178 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.384+0000 7fec44129700 1 -- 172.21.15.152:0/3209625583 shutdown_connections 2024-04-06T12:13:26.178 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.384+0000 7fec44129700 1 --2- 172.21.15.152:0/3209625583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec3c0fbed0 0x7fec3c10ead0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:26.178 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.384+0000 7fec44129700 1 -- 172.21.15.152:0/3209625583 >> 172.21.15.152:0/3209625583 conn(0x7fec3c0f76f0 msgr2=0x7fec3c0f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:26.178 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.384+0000 7fec44129700 1 -- 172.21.15.152:0/3209625583 shutdown_connections 2024-04-06T12:13:26.178 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:25.384+0000 7fec44129700 1 -- 172.21.15.152:0/3209625583 wait complete. 2024-04-06T12:13:26.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:25.384177+0000 mon.smithi152 (mon.0) 6 : audit [INF] from='client.? 172.21.15.152:0/3209625583' entity='client.admin' 2024-04-06T12:13:30.948 INFO:teuthology.orchestra.run.smithi152.stderr:Wrote config to /etc/ceph/ceph.conf 2024-04-06T12:13:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-06T12:13:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:Creating mgr... 2024-04-06T12:13:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:Verifying port 9283 ... 2024-04-06T12:13:31.076 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Failed to reset failed state of unit ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mgr.smithi152.lynahm.service: Unit ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mgr.smithi152.lynahm.service not loaded. 2024-04-06T12:13:31.083 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: Created symlink /etc/systemd/system/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4.target.wants/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mgr.smithi152.lynahm.service → /etc/systemd/system/ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@.service. 2024-04-06T12:13:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: disabled 2024-04-06T12:13:33.604 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: inactive 2024-04-06T12:13:33.605 INFO:teuthology.orchestra.run.smithi152.stderr:firewalld.service is not enabled 2024-04-06T12:13:33.605 INFO:teuthology.orchestra.run.smithi152.stderr:Not possible to enable service . firewalld.service is not available 2024-04-06T12:13:33.613 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: disabled 2024-04-06T12:13:33.621 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: inactive 2024-04-06T12:13:33.622 INFO:teuthology.orchestra.run.smithi152.stderr:firewalld.service is not enabled 2024-04-06T12:13:33.622 INFO:teuthology.orchestra.run.smithi152.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-06T12:13:33.622 INFO:teuthology.orchestra.run.smithi152.stderr:Waiting for mgr to start... 2024-04-06T12:13:33.622 INFO:teuthology.orchestra.run.smithi152.stderr:Waiting for mgr... 2024-04-06T12:13:34.183 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.183+0000 7f3740a06700 1 Processor -- start 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.183+0000 7f3740a06700 1 -- start start 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.184+0000 7f3740a06700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c0ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.184+0000 7f3740a06700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c100180 con 0x7f373c071c20 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.184+0000 7f373a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c0ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.184+0000 7f373a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c0ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43648/0 (socket says 172.21.15.152:43648) 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.184+0000 7f373a59c700 1 -- 172.21.15.152:0/1452395601 learned_addr learned my addr 172.21.15.152:0/1452395601 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.184+0000 7f373a59c700 1 -- 172.21.15.152:0/1452395601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c1002c0 con 0x7f373c071c20 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.185+0000 7f373a59c700 1 --2- 172.21.15.152:0/1452395601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c0ffc90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f372c009730 tx=0x7f372c0090f0).ready entity=mon.0 client_cookie=73df46753f9a3d91 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.185+0000 7f373959a700 1 -- 172.21.15.152:0/1452395601 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f372c00b770 con 0x7f373c071c20 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.185+0000 7f373959a700 1 -- 172.21.15.152:0/1452395601 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f372c00bd20 con 0x7f373c071c20 2024-04-06T12:13:34.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.185+0000 7f373959a700 1 -- 172.21.15.152:0/1452395601 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f372c011cc0 con 0x7f373c071c20 2024-04-06T12:13:34.188 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.185+0000 7f3740a06700 1 -- 172.21.15.152:0/1452395601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 msgr2=0x7f373c0ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:34.188 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.185+0000 7f3740a06700 1 --2- 172.21.15.152:0/1452395601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c0ffc90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f372c009730 tx=0x7f372c0090f0).stop 2024-04-06T12:13:34.188 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.185+0000 7f3740a06700 1 -- 172.21.15.152:0/1452395601 shutdown_connections 2024-04-06T12:13:34.188 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.185+0000 7f3740a06700 1 --2- 172.21.15.152:0/1452395601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c0ffc90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:34.188 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.186+0000 7f3740a06700 1 -- 172.21.15.152:0/1452395601 >> 172.21.15.152:0/1452395601 conn(0x7f373c0f76f0 msgr2=0x7f373c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:34.188 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.186+0000 7f3740a06700 1 -- 172.21.15.152:0/1452395601 shutdown_connections 2024-04-06T12:13:34.188 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.186+0000 7f3740a06700 1 -- 172.21.15.152:0/1452395601 wait complete. 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.186+0000 7f3740a06700 1 Processor -- start 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.187+0000 7f3740a06700 1 -- start start 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.187+0000 7f3740a06700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c10be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.187+0000 7f3740a06700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c10c320 con 0x7f373c071c20 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.187+0000 7f373a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c10be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.187+0000 7f373a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c10be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43650/0 (socket says 172.21.15.152:43650) 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.187+0000 7f373a59c700 1 -- 172.21.15.152:0/1056992972 learned_addr learned my addr 172.21.15.152:0/1056992972 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.187+0000 7f373a59c700 1 -- 172.21.15.152:0/1056992972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c009370 con 0x7f373c071c20 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.187+0000 7f373a59c700 1 --2- 172.21.15.152:0/1056992972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c10be30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f372c011630 tx=0x7f372c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.187+0000 7f372b7fe700 1 -- 172.21.15.152:0/1056992972 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f372c011ae0 con 0x7f373c071c20 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.188+0000 7f372b7fe700 1 -- 172.21.15.152:0/1056992972 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f372c00be90 con 0x7f373c071c20 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.188+0000 7f3740a06700 1 -- 172.21.15.152:0/1056992972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c10c520 con 0x7f373c071c20 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.188+0000 7f372b7fe700 1 -- 172.21.15.152:0/1056992972 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f372c01aaf0 con 0x7f373c071c20 2024-04-06T12:13:34.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.188+0000 7f3740a06700 1 -- 172.21.15.152:0/1056992972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c10c930 con 0x7f373c071c20 2024-04-06T12:13:34.190 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.188+0000 7f372b7fe700 1 -- 172.21.15.152:0/1056992972 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f372c023660 con 0x7f373c071c20 2024-04-06T12:13:34.190 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.188+0000 7f372b7fe700 1 -- 172.21.15.152:0/1056992972 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f372c0223b0 con 0x7f373c071c20 2024-04-06T12:13:34.190 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.189+0000 7f3740a06700 1 -- 172.21.15.152:0/1056992972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c046ce0 con 0x7f373c071c20 2024-04-06T12:13:34.190 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.191+0000 7f372b7fe700 1 -- 172.21.15.152:0/1056992972 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f372c01e020 con 0x7f373c071c20 2024-04-06T12:13:34.267 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.261+0000 7f3740a06700 1 -- 172.21.15.152:0/1056992972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f373c105ca0 con 0x7f373c071c20 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.261+0000 7f372b7fe700 1 -- 172.21.15.152:0/1056992972 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1250 (secure 0 0 0) 0x7f372c011400 con 0x7f373c071c20 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: { 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "fsid": "f2af90de-f40e-11ee-b649-cb9ed24678a4", 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "health": { 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "checks": {}, 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "mutes": [] 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "quorum": [ 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 0 2024-04-06T12:13:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ], 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "quorum_names": [ 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "smithi152" 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ], 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "quorum_age": 12, 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "monmap": { 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_mons": 1 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "osdmap": { 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_osds": 0, 2024-04-06T12:13:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "pgmap": { 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_pools": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_objects": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-04-06T12:13:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "bytes_total": 0 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "fsmap": { 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "by_rank": [], 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "up:standby": 0 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "mgrmap": { 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "available": false, 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "modules": [ 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "iostat", 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "nfs", 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "restful" 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ], 2024-04-06T12:13:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "services": {} 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "servicemap": { 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "modified": "2024-04-06T12:13:16.768906+0000", 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "services": {} 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "progress_events": {} 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: } 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.263+0000 7f3740a06700 1 -- 172.21.15.152:0/1056992972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 msgr2=0x7f373c10be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.263+0000 7f3740a06700 1 --2- 172.21.15.152:0/1056992972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c10be30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f372c011630 tx=0x7f372c0090f0).stop 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.263+0000 7f3740a06700 1 -- 172.21.15.152:0/1056992972 shutdown_connections 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.263+0000 7f3740a06700 1 --2- 172.21.15.152:0/1056992972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f373c071c20 0x7f373c10be30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.263+0000 7f3740a06700 1 -- 172.21.15.152:0/1056992972 >> 172.21.15.152:0/1056992972 conn(0x7f373c0f76f0 msgr2=0x7f373c0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:34.272 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.263+0000 7f3740a06700 1 -- 172.21.15.152:0/1056992972 shutdown_connections 2024-04-06T12:13:34.273 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:34.263+0000 7f3740a06700 1 -- 172.21.15.152:0/1056992972 wait complete. 2024-04-06T12:13:34.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:34.262559+0000 mon.smithi152 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.152:0/1056992972' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-06T12:13:34.901 INFO:teuthology.orchestra.run.smithi152.stderr:mgr not available, waiting (1/15)... 2024-04-06T12:13:37.460 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.461+0000 7f9b2b7c1700 1 Processor -- start 2024-04-06T12:13:37.463 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.461+0000 7f9b2b7c1700 1 -- start start 2024-04-06T12:13:37.463 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b2b7c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b240ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:37.463 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b2b7c1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b24100120 con 0x7f9b24071c60 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b2955d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b240ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b2955d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b240ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43656/0 (socket says 172.21.15.152:43656) 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b2955d700 1 -- 172.21.15.152:0/729160932 learned_addr learned my addr 172.21.15.152:0/729160932 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b2955d700 1 -- 172.21.15.152:0/729160932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24100260 con 0x7f9b24071c60 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b2955d700 1 --2- 172.21.15.152:0/729160932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b240ffc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9b20009730 tx=0x7f9b200090f0).ready entity=mon.0 client_cookie=d1fe15d0389f67a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b1bfff700 1 -- 172.21.15.152:0/729160932 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2000b6e0 con 0x7f9b24071c60 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b1bfff700 1 -- 172.21.15.152:0/729160932 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f9b2000bc90 con 0x7f9b24071c60 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.462+0000 7f9b1bfff700 1 -- 172.21.15.152:0/729160932 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b20011c70 con 0x7f9b24071c60 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.463+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/729160932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 msgr2=0x7f9b240ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.463+0000 7f9b2b7c1700 1 --2- 172.21.15.152:0/729160932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b240ffc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9b20009730 tx=0x7f9b200090f0).stop 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.463+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/729160932 shutdown_connections 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.463+0000 7f9b2b7c1700 1 --2- 172.21.15.152:0/729160932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b240ffc30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.463+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/729160932 >> 172.21.15.152:0/729160932 conn(0x7f9b240f76f0 msgr2=0x7f9b240f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:37.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.463+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/729160932 shutdown_connections 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.463+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/729160932 wait complete. 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.464+0000 7f9b2b7c1700 1 Processor -- start 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.464+0000 7f9b2b7c1700 1 -- start start 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.464+0000 7f9b2b7c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b2410be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.464+0000 7f9b2b7c1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2410c2f0 con 0x7f9b24071c60 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.464+0000 7f9b2955d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b2410be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.464+0000 7f9b2955d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b2410be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43668/0 (socket says 172.21.15.152:43668) 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.464+0000 7f9b2955d700 1 -- 172.21.15.152:0/3824959302 learned_addr learned my addr 172.21.15.152:0/3824959302 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.464+0000 7f9b2955d700 1 -- 172.21.15.152:0/3824959302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b20009370 con 0x7f9b24071c60 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.465+0000 7f9b2955d700 1 --2- 172.21.15.152:0/3824959302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b2410be00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9b2000c010 tx=0x7f9b200090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:37.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.465+0000 7f9b1a7fc700 1 -- 172.21.15.152:0/3824959302 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2001a610 con 0x7f9b24071c60 2024-04-06T12:13:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.465+0000 7f9b1a7fc700 1 -- 172.21.15.152:0/3824959302 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f9b2001abc0 con 0x7f9b24071c60 2024-04-06T12:13:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.465+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/3824959302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2410c4f0 con 0x7f9b24071c60 2024-04-06T12:13:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.465+0000 7f9b1a7fc700 1 -- 172.21.15.152:0/3824959302 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b20022a20 con 0x7f9b24071c60 2024-04-06T12:13:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.465+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/3824959302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2410c900 con 0x7f9b24071c60 2024-04-06T12:13:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.465+0000 7f9b1a7fc700 1 -- 172.21.15.152:0/3824959302 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9b20023450 con 0x7f9b24071c60 2024-04-06T12:13:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.465+0000 7f9b1a7fc700 1 -- 172.21.15.152:0/3824959302 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9b2002c3a0 con 0x7f9b24071c60 2024-04-06T12:13:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.466+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/3824959302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b24046ce0 con 0x7f9b24071c60 2024-04-06T12:13:37.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.468+0000 7f9b1a7fc700 1 -- 172.21.15.152:0/3824959302 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f9b20028060 con 0x7f9b24071c60 2024-04-06T12:13:37.536 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.536+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/3824959302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9b24100f20 con 0x7f9b24071c60 2024-04-06T12:13:37.536 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.536+0000 7f9b1a7fc700 1 -- 172.21.15.152:0/3824959302 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1250 (secure 0 0 0) 0x7f9b24100f20 con 0x7f9b24071c60 2024-04-06T12:13:37.536 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.536 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: { 2024-04-06T12:13:37.536 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "fsid": "f2af90de-f40e-11ee-b649-cb9ed24678a4", 2024-04-06T12:13:37.536 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "health": { 2024-04-06T12:13:37.536 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-04-06T12:13:37.537 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "checks": {}, 2024-04-06T12:13:37.537 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "mutes": [] 2024-04-06T12:13:37.537 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:37.537 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-04-06T12:13:37.537 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "quorum": [ 2024-04-06T12:13:37.537 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 0 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ], 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "quorum_names": [ 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "smithi152" 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ], 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "quorum_age": 15, 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "monmap": { 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_mons": 1 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "osdmap": { 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:37.541 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_osds": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "pgmap": { 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_pools": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_objects": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-04-06T12:13:37.542 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "bytes_total": 0 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "fsmap": { 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "by_rank": [], 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "up:standby": 0 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "mgrmap": { 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "available": false, 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "modules": [ 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "iostat", 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "nfs", 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "restful" 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ], 2024-04-06T12:13:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "services": {} 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "servicemap": { 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "modified": "2024-04-06T12:13:16.768906+0000", 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "services": {} 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "progress_events": {} 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: } 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.537+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/3824959302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 msgr2=0x7f9b2410be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.537+0000 7f9b2b7c1700 1 --2- 172.21.15.152:0/3824959302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b2410be00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9b2000c010 tx=0x7f9b200090f0).stop 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.537+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/3824959302 shutdown_connections 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.537+0000 7f9b2b7c1700 1 --2- 172.21.15.152:0/3824959302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b24071c60 0x7f9b2410be00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.537+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/3824959302 >> 172.21.15.152:0/3824959302 conn(0x7f9b240f76f0 msgr2=0x7f9b240f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.537+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/3824959302 shutdown_connections 2024-04-06T12:13:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:37.538+0000 7f9b2b7c1700 1 -- 172.21.15.152:0/3824959302 wait complete. 2024-04-06T12:13:37.891 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:37.537759+0000 mon.smithi152 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.152:0/3824959302' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-06T12:13:38.243 INFO:teuthology.orchestra.run.smithi152.stderr:mgr not available, waiting (2/15)... 2024-04-06T12:13:39.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:38.838530+0000 mon.smithi152 (mon.0) 9 : cluster [INF] Activating manager daemon smithi152.lynahm 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:38.841290+0000 mon.smithi152 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi152.lynahm(active, starting, since 0.00285772s) 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.841973+0000 mon.smithi152 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.842177+0000 mon.smithi152 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.842303+0000 mon.smithi152 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.842440+0000 mon.smithi152 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.842601+0000 mon.smithi152 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:38.856576+0000 mon.smithi152 (mon.0) 16 : cluster [INF] Manager daemon smithi152.lynahm is now available 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.865193+0000 mon.smithi152 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.869801+0000 mon.smithi152 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.872416+0000 mon.smithi152 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/trash_purge_schedule"}]: dispatch 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.875432+0000 mon.smithi152 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' 2024-04-06T12:13:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:38.877340+0000 mon.smithi152 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.152:0/864240541' entity='mgr.smithi152.lynahm' 2024-04-06T12:13:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.786+0000 7f5bc66eb700 1 Processor -- start 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.786+0000 7f5bc66eb700 1 -- start start 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.786+0000 7f5bc66eb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.786+0000 7f5bc66eb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0100160 con 0x7f5bc0071c20 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.786+0000 7f5bbffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.786+0000 7f5bbffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43724/0 (socket says 172.21.15.152:43724) 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.786+0000 7f5bbffff700 1 -- 172.21.15.152:0/3833880979 learned_addr learned my addr 172.21.15.152:0/3833880979 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.786+0000 7f5bbffff700 1 -- 172.21.15.152:0/3833880979 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc01002a0 con 0x7f5bc0071c20 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.786+0000 7f5bbffff700 1 --2- 172.21.15.152:0/3833880979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00ffc70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5bb0009730 tx=0x7f5bb00090f0).ready entity=mon.0 client_cookie=17e8ff7fa418b52e server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bbeffd700 1 -- 172.21.15.152:0/3833880979 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bb000b770 con 0x7f5bc0071c20 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bbeffd700 1 -- 172.21.15.152:0/3833880979 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f5bb000bd20 con 0x7f5bc0071c20 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bbeffd700 1 -- 172.21.15.152:0/3833880979 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bb0011cc0 con 0x7f5bc0071c20 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bc66eb700 1 -- 172.21.15.152:0/3833880979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 msgr2=0x7f5bc00ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bc66eb700 1 --2- 172.21.15.152:0/3833880979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00ffc70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5bb0009730 tx=0x7f5bb00090f0).stop 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bc66eb700 1 -- 172.21.15.152:0/3833880979 shutdown_connections 2024-04-06T12:13:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bc66eb700 1 --2- 172.21.15.152:0/3833880979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00ffc70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:40.788 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bc66eb700 1 -- 172.21.15.152:0/3833880979 >> 172.21.15.152:0/3833880979 conn(0x7f5bc00f76f0 msgr2=0x7f5bc00f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:40.788 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bc66eb700 1 -- 172.21.15.152:0/3833880979 shutdown_connections 2024-04-06T12:13:40.788 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.787+0000 7f5bc66eb700 1 -- 172.21.15.152:0/3833880979 wait complete. 2024-04-06T12:13:40.788 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.788+0000 7f5bc66eb700 1 Processor -- start 2024-04-06T12:13:40.788 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.788+0000 7f5bc66eb700 1 -- start start 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.788+0000 7f5bc66eb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.788+0000 7f5bc66eb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00fbb70 con 0x7f5bc0071c20 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.788+0000 7f5bbffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.788+0000 7f5bbffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43730/0 (socket says 172.21.15.152:43730) 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.789+0000 7f5bbffff700 1 -- 172.21.15.152:0/799471947 learned_addr learned my addr 172.21.15.152:0/799471947 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.789+0000 7f5bbffff700 1 -- 172.21.15.152:0/799471947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0009370 con 0x7f5bc0071c20 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.789+0000 7f5bbffff700 1 --2- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00fd6f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5bb0011630 tx=0x7f5bb00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.789+0000 7f5bbd7fa700 1 -- 172.21.15.152:0/799471947 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bb0011400 con 0x7f5bc0071c20 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.789+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc00fbd10 con 0x7f5bc0071c20 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.789+0000 7f5bbd7fa700 1 -- 172.21.15.152:0/799471947 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f5bb0010e70 con 0x7f5bc0071c20 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.789+0000 7f5bbd7fa700 1 -- 172.21.15.152:0/799471947 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bb001ab90 con 0x7f5bc0071c20 2024-04-06T12:13:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.789+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc00fc120 con 0x7f5bc0071c20 2024-04-06T12:13:40.791 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.790+0000 7f5bbd7fa700 1 -- 172.21.15.152:0/799471947 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 3) v1 ==== 38515+0+0 (secure 0 0 0) 0x7f5bb001a400 con 0x7f5bc0071c20 2024-04-06T12:13:40.791 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.790+0000 7f5bbd7fa700 1 --2- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5ba8032470 0x7f5ba8034930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:40.791 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.790+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc0046ce0 con 0x7f5bc0071c20 2024-04-06T12:13:40.791 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.790+0000 7f5bbd7fa700 1 -- 172.21.15.152:0/799471947 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5bb0044580 con 0x7f5bc0071c20 2024-04-06T12:13:40.791 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.790+0000 7f5bbf7fe700 1 --2- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5ba8032470 0x7f5ba8034930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:40.791 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.791+0000 7f5bbf7fe700 1 --2- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5ba8032470 0x7f5ba8034930 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f5bb4009780 tx=0x7f5bb4006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:40.794 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:40.795+0000 7f5bbd7fa700 1 -- 172.21.15.152:0/799471947 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5bb001e020 con 0x7f5bc0071c20 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.020+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5bc0100f60 con 0x7f5bc0071c20 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.021+0000 7f5bbd7fa700 1 -- 172.21.15.152:0/799471947 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f5bb0019390 con 0x7f5bc0071c20 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: { 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "fsid": "f2af90de-f40e-11ee-b649-cb9ed24678a4", 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "health": { 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "checks": {}, 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "mutes": [] 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-04-06T12:13:41.022 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "quorum": [ 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 0 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ], 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "quorum_names": [ 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "smithi152" 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ], 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "quorum_age": 19, 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "monmap": { 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_mons": 1 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "osdmap": { 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:41.023 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_osds": 0, 2024-04-06T12:13:41.024 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-04-06T12:13:41.024 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "pgmap": { 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_pools": 0, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_objects": 0, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "bytes_total": 0 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "fsmap": { 2024-04-06T12:13:41.025 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "by_rank": [], 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "up:standby": 0 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "mgrmap": { 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "available": true, 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "modules": [ 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "iostat", 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "nfs", 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "restful" 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ], 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "services": {} 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:41.026 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "servicemap": { 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 1, 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "modified": "2024-04-06T12:13:16.768906+0000", 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "services": {} 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: }, 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "progress_events": {} 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: } 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.022+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5ba8032470 msgr2=0x7f5ba8034930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.022+0000 7f5bc66eb700 1 --2- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5ba8032470 0x7f5ba8034930 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f5bb4009780 tx=0x7f5bb4006cc0).stop 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.022+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 msgr2=0x7f5bc00fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.022+0000 7f5bc66eb700 1 --2- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00fd6f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5bb0011630 tx=0x7f5bb00090f0).stop 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.023+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 shutdown_connections 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.023+0000 7f5bc66eb700 1 --2- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5ba8032470 0x7f5ba8034930 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.023+0000 7f5bc66eb700 1 --2- 172.21.15.152:0/799471947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bc0071c20 0x7f5bc00fd6f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.023+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 >> 172.21.15.152:0/799471947 conn(0x7f5bc00f76f0 msgr2=0x7f5bc00f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.023+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 shutdown_connections 2024-04-06T12:13:41.027 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:41.023+0000 7f5bc66eb700 1 -- 172.21.15.152:0/799471947 wait complete. 2024-04-06T12:13:41.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:39.844630+0000 mon.smithi152 (mon.0) 22 : cluster [DBG] mgrmap e3: smithi152.lynahm(active, since 1.0062s) 2024-04-06T12:13:41.624 INFO:teuthology.orchestra.run.smithi152.stderr:mgr is available 2024-04-06T12:13:41.887 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:41.022112+0000 mon.smithi152 (mon.0) 23 : audit [DBG] from='client.? 172.21.15.152:0/799471947' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-06T12:13:42.183 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.182+0000 7f6e5422f700 1 Processor -- start 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.182+0000 7f6e5422f700 1 -- start start 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.182+0000 7f6e5422f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.182+0000 7f6e5422f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c074120 con 0x7f6e4c073d00 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.182+0000 7f6e51fcb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.182+0000 7f6e51fcb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c0722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43736/0 (socket says 172.21.15.152:43736) 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.182+0000 7f6e51fcb700 1 -- 172.21.15.152:0/1416445026 learned_addr learned my addr 172.21.15.152:0/1416445026 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e51fcb700 1 -- 172.21.15.152:0/1416445026 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c072790 con 0x7f6e4c073d00 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e51fcb700 1 --2- 172.21.15.152:0/1416445026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c0722a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f6e48009730 tx=0x7f6e480090f0).ready entity=mon.0 client_cookie=a7b9f117a2217087 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e50fc9700 1 -- 172.21.15.152:0/1416445026 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e4800b6e0 con 0x7f6e4c073d00 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e50fc9700 1 -- 172.21.15.152:0/1416445026 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6e4800bc90 con 0x7f6e4c073d00 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e50fc9700 1 -- 172.21.15.152:0/1416445026 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e48011c70 con 0x7f6e4c073d00 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e5422f700 1 -- 172.21.15.152:0/1416445026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 msgr2=0x7f6e4c0722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e5422f700 1 --2- 172.21.15.152:0/1416445026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c0722a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f6e48009730 tx=0x7f6e480090f0).stop 2024-04-06T12:13:42.184 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e5422f700 1 -- 172.21.15.152:0/1416445026 shutdown_connections 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e5422f700 1 --2- 172.21.15.152:0/1416445026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c0722a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e5422f700 1 -- 172.21.15.152:0/1416445026 >> 172.21.15.152:0/1416445026 conn(0x7f6e4c0f87e0 msgr2=0x7f6e4c0fac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e5422f700 1 -- 172.21.15.152:0/1416445026 shutdown_connections 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.183+0000 7f6e5422f700 1 -- 172.21.15.152:0/1416445026 wait complete. 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.184+0000 7f6e5422f700 1 Processor -- start 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.184+0000 7f6e5422f700 1 -- start start 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.184+0000 7f6e5422f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c10e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.184+0000 7f6e5422f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c10e500 con 0x7f6e4c073d00 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.184+0000 7f6e51fcb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c10e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.184+0000 7f6e51fcb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c10e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43752/0 (socket says 172.21.15.152:43752) 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.184+0000 7f6e51fcb700 1 -- 172.21.15.152:0/4145982781 learned_addr learned my addr 172.21.15.152:0/4145982781 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.185+0000 7f6e51fcb700 1 -- 172.21.15.152:0/4145982781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009370 con 0x7f6e4c073d00 2024-04-06T12:13:42.185 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.185+0000 7f6e51fcb700 1 --2- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c10e010 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f6e48000c00 tx=0x7f6e480090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:42.186 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.185+0000 7f6e42ffd700 1 -- 172.21.15.152:0/4145982781 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e4801a610 con 0x7f6e4c073d00 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.185+0000 7f6e42ffd700 1 -- 172.21.15.152:0/4145982781 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6e4801abc0 con 0x7f6e4c073d00 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.185+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c10e700 con 0x7f6e4c073d00 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.185+0000 7f6e42ffd700 1 -- 172.21.15.152:0/4145982781 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e48022a20 con 0x7f6e4c073d00 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.185+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c10eb10 con 0x7f6e4c073d00 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.186+0000 7f6e42ffd700 1 -- 172.21.15.152:0/4145982781 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) v1 ==== 38621+0+0 (secure 0 0 0) 0x7f6e48022c90 con 0x7f6e4c073d00 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.186+0000 7f6e42ffd700 1 --2- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f6e38032610 0x7f6e38034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.186+0000 7f6e42ffd700 1 -- 172.21.15.152:0/4145982781 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6e48044730 con 0x7f6e4c073d00 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.186+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c046ce0 con 0x7f6e4c073d00 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.186+0000 7f6e517ca700 1 --2- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f6e38032610 0x7f6e38034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:42.187 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.187+0000 7f6e517ca700 1 --2- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f6e38032610 0x7f6e38034ad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f6e3c009780 tx=0x7f6e3c006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:42.189 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.191+0000 7f6e42ffd700 1 -- 172.21.15.152:0/4145982781 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6e4801e080 con 0x7f6e4c073d00 2024-04-06T12:13:42.351 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.352+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6e4c1031a0 con 0x7f6e4c073d00 2024-04-06T12:13:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.353+0000 7f6e42ffd700 1 -- 172.21.15.152:0/4145982781 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+398 (secure 0 0 0) 0x7f6e4801ad30 con 0x7f6e4c073d00 2024-04-06T12:13:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: [global] 2024-04-06T12:13:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: fsid = f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: log_to_journald = false 2024-04-06T12:13:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: [mgr] 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: [osd] 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-04-06T12:13:42.355 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f6e38032610 msgr2=0x7f6e38034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:42.356 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 --2- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f6e38032610 0x7f6e38034ad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f6e3c009780 tx=0x7f6e3c006cc0).stop 2024-04-06T12:13:42.356 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 msgr2=0x7f6e4c10e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:42.356 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 --2- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c10e010 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f6e48000c00 tx=0x7f6e480090f0).stop 2024-04-06T12:13:42.356 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 shutdown_connections 2024-04-06T12:13:42.356 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 --2- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f6e38032610 0x7f6e38034ad0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:42.356 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 --2- 172.21.15.152:0/4145982781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e4c073d00 0x7f6e4c10e010 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:42.356 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 >> 172.21.15.152:0/4145982781 conn(0x7f6e4c0f87e0 msgr2=0x7f6e4c0fa250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:42.356 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 shutdown_connections 2024-04-06T12:13:42.356 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:42.355+0000 7f6e5422f700 1 -- 172.21.15.152:0/4145982781 wait complete. 2024-04-06T12:13:42.872 INFO:teuthology.orchestra.run.smithi152.stderr:Enabling cephadm module... 2024-04-06T12:13:43.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:41.844363+0000 mon.smithi152 (mon.0) 24 : cluster [DBG] mgrmap e4: smithi152.lynahm(active, since 3s) 2024-04-06T12:13:43.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:42.353888+0000 mon.smithi152 (mon.0) 25 : audit [INF] from='client.? 172.21.15.152:0/4145982781' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-06T12:13:43.485 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.456+0000 7fae8382e700 1 Processor -- start 2024-04-06T12:13:43.485 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.457+0000 7fae8382e700 1 -- start start 2024-04-06T12:13:43.485 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.457+0000 7fae8382e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c0fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:43.485 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.457+0000 7fae8382e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0fc7e0 con 0x7fae7c0fbed0 2024-04-06T12:13:43.485 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.457+0000 7fae815ca700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c0fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:43.485 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.457+0000 7fae815ca700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c0fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51752/0 (socket says 172.21.15.152:51752) 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.457+0000 7fae815ca700 1 -- 172.21.15.152:0/538852253 learned_addr learned my addr 172.21.15.152:0/538852253 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.457+0000 7fae815ca700 1 -- 172.21.15.152:0/538852253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0fc920 con 0x7fae7c0fbed0 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.457+0000 7fae815ca700 1 --2- 172.21.15.152:0/538852253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c0fc2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fae6c00b9d0 tx=0x7fae6c00b3b0).ready entity=mon.0 client_cookie=520dd9c5ce72a000 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae73fff700 1 -- 172.21.15.152:0/538852253 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae6c00dbd0 con 0x7fae7c0fbed0 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae73fff700 1 -- 172.21.15.152:0/538852253 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fae6c00dd30 con 0x7fae7c0fbed0 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae73fff700 1 -- 172.21.15.152:0/538852253 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae6c00f620 con 0x7fae7c0fbed0 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae8382e700 1 -- 172.21.15.152:0/538852253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 msgr2=0x7fae7c0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae8382e700 1 --2- 172.21.15.152:0/538852253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c0fc2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fae6c00b9d0 tx=0x7fae6c00b3b0).stop 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae8382e700 1 -- 172.21.15.152:0/538852253 shutdown_connections 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae8382e700 1 --2- 172.21.15.152:0/538852253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c0fc2f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae8382e700 1 -- 172.21.15.152:0/538852253 >> 172.21.15.152:0/538852253 conn(0x7fae7c0f76f0 msgr2=0x7fae7c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae8382e700 1 -- 172.21.15.152:0/538852253 shutdown_connections 2024-04-06T12:13:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.458+0000 7fae8382e700 1 -- 172.21.15.152:0/538852253 wait complete. 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.459+0000 7fae8382e700 1 Processor -- start 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.459+0000 7fae8382e700 1 -- start start 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.459+0000 7fae8382e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c109b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.459+0000 7fae8382e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c10a040 con 0x7fae7c0fbed0 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.459+0000 7fae815ca700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.459+0000 7fae815ca700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51756/0 (socket says 172.21.15.152:51756) 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.459+0000 7fae815ca700 1 -- 172.21.15.152:0/1428312968 learned_addr learned my addr 172.21.15.152:0/1428312968 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.460+0000 7fae815ca700 1 -- 172.21.15.152:0/1428312968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c00b610 con 0x7fae7c0fbed0 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.460+0000 7fae815ca700 1 --2- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c109b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fae6c00d650 tx=0x7fae6c00b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.460+0000 7fae727fc700 1 -- 172.21.15.152:0/1428312968 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae6c00fa70 con 0x7fae7c0fbed0 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.460+0000 7fae727fc700 1 -- 172.21.15.152:0/1428312968 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fae6c019450 con 0x7fae7c0fbed0 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.460+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c10a240 con 0x7fae7c0fbed0 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.460+0000 7fae727fc700 1 -- 172.21.15.152:0/1428312968 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae6c023600 con 0x7fae7c0fbed0 2024-04-06T12:13:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.460+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c10a650 con 0x7fae7c0fbed0 2024-04-06T12:13:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.460+0000 7fae727fc700 1 -- 172.21.15.152:0/1428312968 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) v1 ==== 38621+0+0 (secure 0 0 0) 0x7fae6c0238c0 con 0x7fae7c0fbed0 2024-04-06T12:13:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.461+0000 7fae727fc700 1 --2- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7fae68032590 0x7fae68034a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.461+0000 7fae727fc700 1 -- 172.21.15.152:0/1428312968 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fae6c047830 con 0x7fae7c0fbed0 2024-04-06T12:13:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.461+0000 7fae80dc9700 1 --2- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7fae68032590 0x7fae68034a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.461+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c05a310 con 0x7fae7c0fbed0 2024-04-06T12:13:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.461+0000 7fae80dc9700 1 --2- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7fae68032590 0x7fae68034a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fae78009780 tx=0x7fae78006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.465+0000 7fae727fc700 1 -- 172.21.15.152:0/1428312968 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fae6c014020 con 0x7fae7c0fbed0 2024-04-06T12:13:43.668 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.669+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fae7c0fdc20 con 0x7fae7c0fbed0 2024-04-06T12:13:43.850 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.852+0000 7fae727fc700 1 -- 172.21.15.152:0/1428312968 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fae6c02d960 con 0x7fae7c0fbed0 2024-04-06T12:13:43.851 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.852+0000 7fae727fc700 1 -- 172.21.15.152:0/1428312968 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fae6c006030 con 0x7fae7c0fbed0 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.854+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7fae68032590 msgr2=0x7fae68034a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.854+0000 7fae8382e700 1 --2- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7fae68032590 0x7fae68034a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fae78009780 tx=0x7fae78006cc0).stop 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.854+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 msgr2=0x7fae7c109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.854+0000 7fae8382e700 1 --2- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c109b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fae6c00d650 tx=0x7fae6c00b3b0).stop 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.854+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 shutdown_connections 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.854+0000 7fae8382e700 1 --2- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7fae68032590 0x7fae68034a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.854+0000 7fae8382e700 1 --2- 172.21.15.152:0/1428312968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae7c0fbed0 0x7fae7c109b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.854+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 >> 172.21.15.152:0/1428312968 conn(0x7fae7c0f76f0 msgr2=0x7fae7c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.854+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 shutdown_connections 2024-04-06T12:13:43.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:43.855+0000 7fae8382e700 1 -- 172.21.15.152:0/1428312968 wait complete. 2024-04-06T12:13:44.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:43.670588+0000 mon.smithi152 (mon.0) 26 : audit [INF] from='client.? 172.21.15.152:0/1428312968' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-06T12:13:45.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:43.853731+0000 mon.smithi152 (mon.0) 27 : audit [INF] from='client.? 172.21.15.152:0/1428312968' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-06T12:13:45.224 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:43.853783+0000 mon.smithi152 (mon.0) 28 : cluster [DBG] mgrmap e5: smithi152.lynahm(active, since 5s) 2024-04-06T12:13:45.277 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.277+0000 7f5e43a11700 1 Processor -- start 2024-04-06T12:13:45.277 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.277+0000 7f5e43a11700 1 -- start start 2024-04-06T12:13:45.277 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.277+0000 7f5e43a11700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c0ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:45.277 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.277+0000 7f5e43a11700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c1001a0 con 0x7f5e3c071be0 2024-04-06T12:13:45.277 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.277+0000 7f5e417ad700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c0ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:45.277 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.277+0000 7f5e417ad700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c0ffcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51796/0 (socket says 172.21.15.152:51796) 2024-04-06T12:13:45.277 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.278+0000 7f5e417ad700 1 -- 172.21.15.152:0/3853034198 learned_addr learned my addr 172.21.15.152:0/3853034198 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:45.278 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.278+0000 7f5e417ad700 1 -- 172.21.15.152:0/3853034198 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c1002e0 con 0x7f5e3c071be0 2024-04-06T12:13:45.278 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.278+0000 7f5e417ad700 1 --2- 172.21.15.152:0/3853034198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c0ffcb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5e38009730 tx=0x7f5e380090f0).ready entity=mon.0 client_cookie=383fc719e5529883 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:45.278 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.278+0000 7f5e33fff700 1 -- 172.21.15.152:0/3853034198 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e3800b6e0 con 0x7f5e3c071be0 2024-04-06T12:13:45.278 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.278+0000 7f5e33fff700 1 -- 172.21.15.152:0/3853034198 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f5e3800bc90 con 0x7f5e3c071be0 2024-04-06T12:13:45.278 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.278+0000 7f5e33fff700 1 -- 172.21.15.152:0/3853034198 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e38011c70 con 0x7f5e3c071be0 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.279+0000 7f5e43a11700 1 -- 172.21.15.152:0/3853034198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 msgr2=0x7f5e3c0ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.279+0000 7f5e43a11700 1 --2- 172.21.15.152:0/3853034198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c0ffcb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5e38009730 tx=0x7f5e380090f0).stop 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.279+0000 7f5e43a11700 1 -- 172.21.15.152:0/3853034198 shutdown_connections 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.279+0000 7f5e43a11700 1 --2- 172.21.15.152:0/3853034198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c0ffcb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.279+0000 7f5e43a11700 1 -- 172.21.15.152:0/3853034198 >> 172.21.15.152:0/3853034198 conn(0x7f5e3c0f76f0 msgr2=0x7f5e3c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.279+0000 7f5e43a11700 1 -- 172.21.15.152:0/3853034198 shutdown_connections 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.279+0000 7f5e43a11700 1 -- 172.21.15.152:0/3853034198 wait complete. 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.280+0000 7f5e43a11700 1 Processor -- start 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.280+0000 7f5e43a11700 1 -- start start 2024-04-06T12:13:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.280+0000 7f5e43a11700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c10be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.280+0000 7f5e43a11700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c10c310 con 0x7f5e3c071be0 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.280+0000 7f5e417ad700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c10be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.280+0000 7f5e417ad700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c10be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51808/0 (socket says 172.21.15.152:51808) 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.280+0000 7f5e417ad700 1 -- 172.21.15.152:0/2880753718 learned_addr learned my addr 172.21.15.152:0/2880753718 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.281+0000 7f5e417ad700 1 -- 172.21.15.152:0/2880753718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38009370 con 0x7f5e3c071be0 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.281+0000 7f5e417ad700 1 --2- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c10be20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5e3800c010 tx=0x7f5e380090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.281+0000 7f5e327fc700 1 -- 172.21.15.152:0/2880753718 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e3801a610 con 0x7f5e3c071be0 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.281+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c10c510 con 0x7f5e3c071be0 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.281+0000 7f5e327fc700 1 -- 172.21.15.152:0/2880753718 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f5e3801abc0 con 0x7f5e3c071be0 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.281+0000 7f5e327fc700 1 -- 172.21.15.152:0/2880753718 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e38022a20 con 0x7f5e3c071be0 2024-04-06T12:13:45.281 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.281+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c10c920 con 0x7f5e3c071be0 2024-04-06T12:13:45.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.282+0000 7f5e327fc700 1 -- 172.21.15.152:0/2880753718 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f5e38022d00 con 0x7f5e3c071be0 2024-04-06T12:13:45.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.282+0000 7f5e327fc700 1 --2- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5e28032610 0x7f5e28034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:45.282 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.282+0000 7f5e327fc700 1 -- 172.21.15.152:0/2880753718 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5e380223b0 con 0x7f5e3c071be0 2024-04-06T12:13:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.282+0000 7f5e40fac700 1 -- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5e28032610 msgr2=0x7f5e28034ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3532590768 2024-04-06T12:13:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.282+0000 7f5e40fac700 1 --2- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5e28032610 0x7f5e28034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:13:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.282+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c046ce0 con 0x7f5e3c071be0 2024-04-06T12:13:45.285 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.287+0000 7f5e327fc700 1 -- 172.21.15.152:0/2880753718 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5e3801e070 con 0x7f5e3c071be0 2024-04-06T12:13:45.482 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.483+0000 7f5e40fac700 1 -- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5e28032610 msgr2=0x7f5e28034ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3532590768 2024-04-06T12:13:45.482 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.483+0000 7f5e40fac700 1 --2- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5e28032610 0x7f5e28034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-04-06T12:13:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.506+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f5e3c105b60 con 0x7f5e3c071be0 2024-04-06T12:13:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.506+0000 7f5e327fc700 1 -- 172.21.15.152:0/2880753718 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f5e38018b80 con 0x7f5e3c071be0 2024-04-06T12:13:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: { 2024-04-06T12:13:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 5, 2024-04-06T12:13:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "available": true, 2024-04-06T12:13:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "active_name": "smithi152.lynahm", 2024-04-06T12:13:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_standby": 0 2024-04-06T12:13:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: } 2024-04-06T12:13:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.508+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5e28032610 msgr2=0x7f5e28034ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T12:13:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.508+0000 7f5e43a11700 1 --2- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5e28032610 0x7f5e28034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:13:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.508+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 msgr2=0x7f5e3c10be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.508+0000 7f5e43a11700 1 --2- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c10be20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5e3800c010 tx=0x7f5e380090f0).stop 2024-04-06T12:13:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.509+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 shutdown_connections 2024-04-06T12:13:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.509+0000 7f5e43a11700 1 --2- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f5e28032610 0x7f5e28034ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:13:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.509+0000 7f5e43a11700 1 --2- 172.21.15.152:0/2880753718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c071be0 0x7f5e3c10be20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.509+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 >> 172.21.15.152:0/2880753718 conn(0x7f5e3c0f76f0 msgr2=0x7f5e3c0f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.509+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 shutdown_connections 2024-04-06T12:13:45.509 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:45.509+0000 7f5e43a11700 1 -- 172.21.15.152:0/2880753718 wait complete. 2024-04-06T12:13:46.211 INFO:teuthology.orchestra.run.smithi152.stderr:Waiting for the mgr to restart... 2024-04-06T12:13:46.212 INFO:teuthology.orchestra.run.smithi152.stderr:Waiting for mgr epoch 5... 2024-04-06T12:13:46.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:45.507682+0000 mon.smithi152 (mon.0) 29 : audit [DBG] from='client.? 172.21.15.152:0/2880753718' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-06T12:13:46.773 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.773+0000 7f8520474700 1 Processor -- start 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.773+0000 7f8520474700 1 -- start start 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.773+0000 7f8520474700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f85180fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.773+0000 7f8520474700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180fc7e0 con 0x7f85180fbed0 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.774+0000 7f851e210700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f85180fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.774+0000 7f851e210700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f85180fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51814/0 (socket says 172.21.15.152:51814) 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.774+0000 7f851e210700 1 -- 172.21.15.152:0/552748719 learned_addr learned my addr 172.21.15.152:0/552748719 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.774+0000 7f851e210700 1 -- 172.21.15.152:0/552748719 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180fc920 con 0x7f85180fbed0 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.774+0000 7f851e210700 1 --2- 172.21.15.152:0/552748719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f85180fc2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8514009730 tx=0x7f85140090f0).ready entity=mon.0 client_cookie=e09406f82a5ea42f server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.774+0000 7f851d20e700 1 -- 172.21.15.152:0/552748719 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f851400b6e0 con 0x7f85180fbed0 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.774+0000 7f851d20e700 1 -- 172.21.15.152:0/552748719 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f851400bc90 con 0x7f85180fbed0 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.774+0000 7f851d20e700 1 -- 172.21.15.152:0/552748719 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8514011c70 con 0x7f85180fbed0 2024-04-06T12:13:46.774 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.775+0000 7f8520474700 1 -- 172.21.15.152:0/552748719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 msgr2=0x7f85180fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:46.776 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.775+0000 7f8520474700 1 --2- 172.21.15.152:0/552748719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f85180fc2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8514009730 tx=0x7f85140090f0).stop 2024-04-06T12:13:46.776 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.775+0000 7f8520474700 1 -- 172.21.15.152:0/552748719 shutdown_connections 2024-04-06T12:13:46.776 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.775+0000 7f8520474700 1 --2- 172.21.15.152:0/552748719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f85180fc2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.775+0000 7f8520474700 1 -- 172.21.15.152:0/552748719 >> 172.21.15.152:0/552748719 conn(0x7f85180f76f0 msgr2=0x7f85180f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.775+0000 7f8520474700 1 -- 172.21.15.152:0/552748719 shutdown_connections 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.775+0000 7f8520474700 1 -- 172.21.15.152:0/552748719 wait complete. 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.776+0000 7f8520474700 1 Processor -- start 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.776+0000 7f8520474700 1 -- start start 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.776+0000 7f8520474700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f851810be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.776+0000 7f8520474700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851810c2f0 con 0x7f85180fbed0 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.776+0000 7f851e210700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f851810be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.776+0000 7f851e210700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f851810be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51824/0 (socket says 172.21.15.152:51824) 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.776+0000 7f851e210700 1 -- 172.21.15.152:0/2485243236 learned_addr learned my addr 172.21.15.152:0/2485243236 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.777+0000 7f851e210700 1 -- 172.21.15.152:0/2485243236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514009370 con 0x7f85180fbed0 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.777+0000 7f851e210700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f851810be00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8514011870 tx=0x7f85140090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.777+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f851401a610 con 0x7f85180fbed0 2024-04-06T12:13:46.777 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.777+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f851401abc0 con 0x7f85180fbed0 2024-04-06T12:13:46.778 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.777+0000 7f8520474700 1 -- 172.21.15.152:0/2485243236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851810c4f0 con 0x7f85180fbed0 2024-04-06T12:13:46.778 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.777+0000 7f8520474700 1 -- 172.21.15.152:0/2485243236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851810c900 con 0x7f85180fbed0 2024-04-06T12:13:46.778 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.777+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8514022a30 con 0x7f85180fbed0 2024-04-06T12:13:46.779 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.778+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f851401a770 con 0x7f85180fbed0 2024-04-06T12:13:46.779 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.778+0000 7f850f7fe700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 0x7f8504034b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:46.779 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.778+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 --> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8504035230 con 0x7f85040326b0 2024-04-06T12:13:46.779 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.779+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8514048220 con 0x7f85180fbed0 2024-04-06T12:13:46.779 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.779+0000 7f851da0f700 1 -- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 msgr2=0x7f8504034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3532590768 2024-04-06T12:13:46.779 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.779+0000 7f851da0f700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 0x7f8504034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:13:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.980+0000 7f851da0f700 1 -- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 msgr2=0x7f8504034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3532590768 2024-04-06T12:13:46.979 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:46.980+0000 7f851da0f700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 0x7f8504034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-04-06T12:13:47.380 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:47.381+0000 7f851da0f700 1 -- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 msgr2=0x7f8504034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3532590768 2024-04-06T12:13:47.380 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:47.381+0000 7f851da0f700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 0x7f8504034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-04-06T12:13:48.181 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:48.182+0000 7f851da0f700 1 -- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 msgr2=0x7f8504034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3532590768 2024-04-06T12:13:48.181 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:48.182+0000 7f851da0f700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 0x7f8504034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-04-06T12:13:49.213 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:49.214+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mgrmap(e 6) v1 ==== 38456+0+0 (secure 0 0 0) 0x7f8514018320 con 0x7f85180fbed0 2024-04-06T12:13:49.213 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:49.214+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 msgr2=0x7f8504034b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T12:13:49.213 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:49.214+0000 7f850f7fe700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 0x7f8504034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:13:49.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:49.213085+0000 mon.smithi152 (mon.0) 30 : cluster [INF] Active manager daemon smithi152.lynahm restarted 2024-04-06T12:13:49.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:49.213299+0000 mon.smithi152 (mon.0) 31 : cluster [INF] Activating manager daemon smithi152.lynahm 2024-04-06T12:13:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:49.215992+0000 mon.smithi152 (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-04-06T12:13:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:49.216106+0000 mon.smithi152 (mon.0) 33 : cluster [DBG] mgrmap e6: smithi152.lynahm(active, starting, since 0.00288429s) 2024-04-06T12:13:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.217112+0000 mon.smithi152 (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:13:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.217787+0000 mon.smithi152 (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:13:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.218425+0000 mon.smithi152 (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:13:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.218555+0000 mon.smithi152 (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:13:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.218678+0000 mon.smithi152 (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:13:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:49.232675+0000 mon.smithi152 (mon.0) 39 : cluster [INF] Manager daemon smithi152.lynahm is now available 2024-04-06T12:13:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.244522+0000 mon.smithi152 (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:13:50.214 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.215+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 7) v1 ==== 38526+0+0 (secure 0 0 0) 0x7f8514048be0 con 0x7f85180fbed0 2024-04-06T12:13:50.215 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.215+0000 7f850f7fe700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f8504035fd0 0x7f85040383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:50.215 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.215+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8504035230 con 0x7f8504035fd0 2024-04-06T12:13:50.215 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.216+0000 7f851da0f700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f8504035fd0 0x7f85040383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:50.215 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.216+0000 7f851da0f700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f8504035fd0 0x7f85040383c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f8508003850 tx=0x7f8508006ea0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:50.216 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.217+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f8504035230 con 0x7f8504035fd0 2024-04-06T12:13:50.222 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.223+0000 7f8520474700 1 -- 172.21.15.152:0/2485243236 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f851805a310 con 0x7f8504035fd0 2024-04-06T12:13:50.223 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f850f7fe700 1 -- 172.21.15.152:0/2485243236 <== mgr.14116 v2:172.21.15.152:6800/1790713151 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f851805a310 con 0x7f8504035fd0 2024-04-06T12:13:50.223 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: { 2024-04-06T12:13:50.223 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-04-06T12:13:50.223 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "initialized": true 2024-04-06T12:13:50.223 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: } 2024-04-06T12:13:50.223 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 -- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f8504035fd0 msgr2=0x7f85040383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:50.224 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f8504035fd0 0x7f85040383c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f8508003850 tx=0x7f8508006ea0).stop 2024-04-06T12:13:50.224 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 -- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 msgr2=0x7f851810be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:50.224 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f851810be00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8514011870 tx=0x7f85140090f0).stop 2024-04-06T12:13:50.224 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 -- 172.21.15.152:0/2485243236 shutdown_connections 2024-04-06T12:13:50.225 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f8504035fd0 0x7f85040383c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:50.225 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85180fbed0 0x7f851810be00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:50.225 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 --2- 172.21.15.152:0/2485243236 >> [v2:172.21.15.152:6800/3532590768,v1:172.21.15.152:6801/3532590768] conn(0x7f85040326b0 0x7f8504034b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:13:50.225 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 -- 172.21.15.152:0/2485243236 >> 172.21.15.152:0/2485243236 conn(0x7f85180f76f0 msgr2=0x7f8518071870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:50.225 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 -- 172.21.15.152:0/2485243236 shutdown_connections 2024-04-06T12:13:50.225 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:50.224+0000 7f8520474700 1 -- 172.21.15.152:0/2485243236 wait complete. 2024-04-06T12:13:50.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:13:49.241901+0000 mgr.smithi152.lynahm (mgr.14116) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-04-06T12:13:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.330289+0000 mon.smithi152 (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:13:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.331337+0000 mon.smithi152 (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:13:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.332864+0000 mon.smithi152 (mon.0) 43 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:13:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.334711+0000 mon.smithi152 (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:13:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.348238+0000 mon.smithi152 (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:13:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:49.350761+0000 mon.smithi152 (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/trash_purge_schedule"}]: dispatch 2024-04-06T12:13:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:50.218880+0000 mon.smithi152 (mon.0) 47 : cluster [DBG] mgrmap e7: smithi152.lynahm(active, since 1.00566s) 2024-04-06T12:13:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:mgr epoch 5 is available 2024-04-06T12:13:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:Setting orchestrator backend to cephadm... 2024-04-06T12:13:51.447 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.447+0000 7f5bdc0f6700 1 Processor -- start 2024-04-06T12:13:51.447 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.447+0000 7f5bdc0f6700 1 -- start start 2024-04-06T12:13:51.447 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.447+0000 7f5bdc0f6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd40ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:51.447 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.447+0000 7f5bdc0f6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4100160 con 0x7f5bd4071c20 2024-04-06T12:13:51.447 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.448+0000 7f5bd9e92700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd40ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:51.448 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.448+0000 7f5bd9e92700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd40ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51866/0 (socket says 172.21.15.152:51866) 2024-04-06T12:13:51.448 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.448+0000 7f5bd9e92700 1 -- 172.21.15.152:0/204907542 learned_addr learned my addr 172.21.15.152:0/204907542 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:51.448 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.448+0000 7f5bd9e92700 1 -- 172.21.15.152:0/204907542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd41002a0 con 0x7f5bd4071c20 2024-04-06T12:13:51.448 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.448+0000 7f5bd9e92700 1 --2- 172.21.15.152:0/204907542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd40ffc70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5bc4009730 tx=0x7f5bc40090f0).ready entity=mon.0 client_cookie=546568d049f72d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:51.448 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.448+0000 7f5bd8e90700 1 -- 172.21.15.152:0/204907542 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bc400b770 con 0x7f5bd4071c20 2024-04-06T12:13:51.448 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.448+0000 7f5bd8e90700 1 -- 172.21.15.152:0/204907542 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f5bc400bd20 con 0x7f5bd4071c20 2024-04-06T12:13:51.448 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.448+0000 7f5bd8e90700 1 -- 172.21.15.152:0/204907542 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bc4011cc0 con 0x7f5bd4071c20 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.449+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/204907542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 msgr2=0x7f5bd40ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.449+0000 7f5bdc0f6700 1 --2- 172.21.15.152:0/204907542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd40ffc70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5bc4009730 tx=0x7f5bc40090f0).stop 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.449+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/204907542 shutdown_connections 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.449+0000 7f5bdc0f6700 1 --2- 172.21.15.152:0/204907542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd40ffc70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.449+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/204907542 >> 172.21.15.152:0/204907542 conn(0x7f5bd40f76f0 msgr2=0x7f5bd40f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.449+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/204907542 shutdown_connections 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.449+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/204907542 wait complete. 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.450+0000 7f5bdc0f6700 1 Processor -- start 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.450+0000 7f5bdc0f6700 1 -- start start 2024-04-06T12:13:51.451 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.450+0000 7f5bdc0f6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd410dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.450+0000 7f5bdc0f6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd410e490 con 0x7f5bd4071c20 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.450+0000 7f5bd9e92700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd410dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.450+0000 7f5bd9e92700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd410dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51878/0 (socket says 172.21.15.152:51878) 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.450+0000 7f5bd9e92700 1 -- 172.21.15.152:0/2986239222 learned_addr learned my addr 172.21.15.152:0/2986239222 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.450+0000 7f5bd9e92700 1 -- 172.21.15.152:0/2986239222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4009370 con 0x7f5bd4071c20 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.450+0000 7f5bd9e92700 1 --2- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd410dfa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5bc4011630 tx=0x7f5bc40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.451+0000 7f5bcaffd700 1 -- 172.21.15.152:0/2986239222 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bc4011ae0 con 0x7f5bd4071c20 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.451+0000 7f5bcaffd700 1 -- 172.21.15.152:0/2986239222 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f5bc400be90 con 0x7f5bd4071c20 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.451+0000 7f5bcaffd700 1 -- 172.21.15.152:0/2986239222 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bc401aaf0 con 0x7f5bd4071c20 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.451+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd410e690 con 0x7f5bd4071c20 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.451+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd410eaa0 con 0x7f5bd4071c20 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.451+0000 7f5bcaffd700 1 -- 172.21.15.152:0/2986239222 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f5bc4023400 con 0x7f5bd4071c20 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.452+0000 7f5bcaffd700 1 --2- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5bc0032660 0x7f5bc0034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.452+0000 7f5bcaffd700 1 -- 172.21.15.152:0/2986239222 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f5bc4044f60 con 0x7f5bd4071c20 2024-04-06T12:13:51.452 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.452+0000 7f5bd9691700 1 --2- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5bc0032660 0x7f5bc0034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:51.453 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.452+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd405a310 con 0x7f5bd4071c20 2024-04-06T12:13:51.453 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.452+0000 7f5bd9691700 1 --2- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5bc0032660 0x7f5bc0034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5bd0009780 tx=0x7f5bd0006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:51.455 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.457+0000 7f5bcaffd700 1 -- 172.21.15.152:0/2986239222 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5bc401e080 con 0x7f5bd4071c20 2024-04-06T12:13:51.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:50.218074+0000 mgr.smithi152.lynahm (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-06T12:13:51.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:50.224877+0000 mgr.smithi152.lynahm (mgr.14116) 3 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-06T12:13:51.630 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.632+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bd4107df0 con 0x7f5bc0032660 2024-04-06T12:13:51.638 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.639+0000 7f5bcaffd700 1 -- 172.21.15.152:0/2986239222 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5bd4107df0 con 0x7f5bc0032660 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5bc0032660 msgr2=0x7f5bc0034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 --2- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5bc0032660 0x7f5bc0034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5bd0009780 tx=0x7f5bd0006cc0).stop 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 msgr2=0x7f5bd410dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 --2- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd410dfa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5bc4011630 tx=0x7f5bc40090f0).stop 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 shutdown_connections 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 --2- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5bc0032660 0x7f5bc0034b20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 --2- 172.21.15.152:0/2986239222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd4071c20 0x7f5bd410dfa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 >> 172.21.15.152:0/2986239222 conn(0x7f5bd40f76f0 msgr2=0x7f5bd40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 shutdown_connections 2024-04-06T12:13:51.641 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:51.641+0000 7f5bdc0f6700 1 -- 172.21.15.152:0/2986239222 wait complete. 2024-04-06T12:13:52.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:13:51.332757+0000 mon.smithi152 (mon.0) 48 : cluster [DBG] mgrmap e8: smithi152.lynahm(active, since 2s) 2024-04-06T12:13:52.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:51.633891+0000 mgr.smithi152.lynahm (mgr.14116) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:13:52.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:51.640332+0000 mon.smithi152 (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:13:52.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:51.658832+0000 mon.smithi152 (mon.0) 50 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:13:52.817 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.815+0000 7f34d10bb700 1 Processor -- start 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.815+0000 7f34d10bb700 1 -- start start 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34d10bb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34d10bb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc074120 con 0x7f34cc073d00 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34cad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34cad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc0722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40184/0 (socket says 172.21.15.152:40184) 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34cad9d700 1 -- 172.21.15.152:0/360481687 learned_addr learned my addr 172.21.15.152:0/360481687 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34cad9d700 1 -- 172.21.15.152:0/360481687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc072790 con 0x7f34cc073d00 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34cad9d700 1 --2- 172.21.15.152:0/360481687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc0722a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f34c0009730 tx=0x7f34c00090f0).ready entity=mon.0 client_cookie=77a06d0cac2eefb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34c9d9b700 1 -- 172.21.15.152:0/360481687 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34c000b6e0 con 0x7f34cc073d00 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34c9d9b700 1 -- 172.21.15.152:0/360481687 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f34c000bc90 con 0x7f34cc073d00 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.816+0000 7f34c9d9b700 1 -- 172.21.15.152:0/360481687 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34c0011c70 con 0x7f34cc073d00 2024-04-06T12:13:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.817+0000 7f34d10bb700 1 -- 172.21.15.152:0/360481687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 msgr2=0x7f34cc0722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.817+0000 7f34d10bb700 1 --2- 172.21.15.152:0/360481687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc0722a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f34c0009730 tx=0x7f34c00090f0).stop 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.817+0000 7f34d10bb700 1 -- 172.21.15.152:0/360481687 shutdown_connections 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.817+0000 7f34d10bb700 1 --2- 172.21.15.152:0/360481687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc0722a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.817+0000 7f34d10bb700 1 -- 172.21.15.152:0/360481687 >> 172.21.15.152:0/360481687 conn(0x7f34cc0f87e0 msgr2=0x7f34cc0fac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.817+0000 7f34d10bb700 1 -- 172.21.15.152:0/360481687 shutdown_connections 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.817+0000 7f34d10bb700 1 -- 172.21.15.152:0/360481687 wait complete. 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.818+0000 7f34d10bb700 1 Processor -- start 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.818+0000 7f34d10bb700 1 -- start start 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.818+0000 7f34d10bb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc10e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.818+0000 7f34d10bb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc10e500 con 0x7f34cc073d00 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.818+0000 7f34cad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc10e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.818+0000 7f34cad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc10e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40200/0 (socket says 172.21.15.152:40200) 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.818+0000 7f34cad9d700 1 -- 172.21.15.152:0/1444332253 learned_addr learned my addr 172.21.15.152:0/1444332253 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.819+0000 7f34cad9d700 1 -- 172.21.15.152:0/1444332253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0009370 con 0x7f34cc073d00 2024-04-06T12:13:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.819+0000 7f34cad9d700 1 --2- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc10e010 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f34c000c010 tx=0x7f34c00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:52.820 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.819+0000 7f34b3fff700 1 -- 172.21.15.152:0/1444332253 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34c001a610 con 0x7f34cc073d00 2024-04-06T12:13:52.820 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.819+0000 7f34b3fff700 1 -- 172.21.15.152:0/1444332253 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f34c001abc0 con 0x7f34cc073d00 2024-04-06T12:13:52.820 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.819+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34cc10e700 con 0x7f34cc073d00 2024-04-06T12:13:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.819+0000 7f34b3fff700 1 -- 172.21.15.152:0/1444332253 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34c0022a20 con 0x7f34cc073d00 2024-04-06T12:13:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.819+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34cc10eb10 con 0x7f34cc073d00 2024-04-06T12:13:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.820+0000 7f34b3fff700 1 -- 172.21.15.152:0/1444332253 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f34c0022c90 con 0x7f34cc073d00 2024-04-06T12:13:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.820+0000 7f34b3fff700 1 --2- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f34b4032660 0x7f34b4034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.820+0000 7f34b3fff700 1 -- 172.21.15.152:0/1444332253 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f34c0044b70 con 0x7f34cc073d00 2024-04-06T12:13:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.820+0000 7f34ca59c700 1 --2- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f34b4032660 0x7f34b4034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.820+0000 7f34ca59c700 1 --2- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f34b4032660 0x7f34b4034b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f34bc009780 tx=0x7f34bc006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.820+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34cc05a310 con 0x7f34cc073d00 2024-04-06T12:13:52.824 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.825+0000 7f34b3fff700 1 -- 172.21.15.152:0/1444332253 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f34c001e070 con 0x7f34cc073d00 2024-04-06T12:13:52.989 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.990+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f34cc107e40 con 0x7f34b4032660 2024-04-06T12:13:52.989 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.990+0000 7f34b3fff700 1 -- 172.21.15.152:0/1444332253 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f34cc107e40 con 0x7f34b4032660 2024-04-06T12:13:52.989 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: value unchanged 2024-04-06T12:13:52.992 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.992+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f34b4032660 msgr2=0x7f34b4034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:52.992 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.992+0000 7f34d10bb700 1 --2- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f34b4032660 0x7f34b4034b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f34bc009780 tx=0x7f34bc006cc0).stop 2024-04-06T12:13:52.992 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.992+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 msgr2=0x7f34cc10e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:52.992 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.992+0000 7f34d10bb700 1 --2- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc10e010 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f34c000c010 tx=0x7f34c00090f0).stop 2024-04-06T12:13:52.992 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.992+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 shutdown_connections 2024-04-06T12:13:52.992 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.992+0000 7f34d10bb700 1 --2- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f34b4032660 0x7f34b4034b20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:52.993 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.992+0000 7f34d10bb700 1 --2- 172.21.15.152:0/1444332253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34cc073d00 0x7f34cc10e010 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:52.993 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.992+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 >> 172.21.15.152:0/1444332253 conn(0x7f34cc0f87e0 msgr2=0x7f34cc0fa250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:52.993 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.993+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 shutdown_connections 2024-04-06T12:13:52.993 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:52.993+0000 7f34d10bb700 1 -- 172.21.15.152:0/1444332253 wait complete. 2024-04-06T12:13:53.652 INFO:teuthology.orchestra.run.smithi152.stderr:Generating ssh key... 2024-04-06T12:13:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.148+0000 7f243f191700 1 Processor -- start 2024-04-06T12:13:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.148+0000 7f243f191700 1 -- start start 2024-04-06T12:13:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.148+0000 7f243f191700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f24380fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.148+0000 7f243f191700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380fc7e0 con 0x7f24380fbed0 2024-04-06T12:13:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.148+0000 7f243cf2d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f24380fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.148+0000 7f243cf2d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f24380fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40206/0 (socket says 172.21.15.152:40206) 2024-04-06T12:13:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.148+0000 7f243cf2d700 1 -- 172.21.15.152:0/1400495155 learned_addr learned my addr 172.21.15.152:0/1400495155 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.148+0000 7f243cf2d700 1 -- 172.21.15.152:0/1400495155 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380fc920 con 0x7f24380fbed0 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.148+0000 7f243cf2d700 1 --2- 172.21.15.152:0/1400495155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f24380fc2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f242c009730 tx=0x7f242c0090f0).ready entity=mon.0 client_cookie=3b9861f5b42df38a server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f24377fe700 1 -- 172.21.15.152:0/1400495155 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f242c00b6e0 con 0x7f24380fbed0 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f24377fe700 1 -- 172.21.15.152:0/1400495155 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f242c00bc90 con 0x7f24380fbed0 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f24377fe700 1 -- 172.21.15.152:0/1400495155 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f242c011c70 con 0x7f24380fbed0 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f243f191700 1 -- 172.21.15.152:0/1400495155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 msgr2=0x7f24380fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f243f191700 1 --2- 172.21.15.152:0/1400495155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f24380fc2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f242c009730 tx=0x7f242c0090f0).stop 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f243f191700 1 -- 172.21.15.152:0/1400495155 shutdown_connections 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f243f191700 1 --2- 172.21.15.152:0/1400495155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f24380fc2f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f243f191700 1 -- 172.21.15.152:0/1400495155 >> 172.21.15.152:0/1400495155 conn(0x7f24380f76f0 msgr2=0x7f24380f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f243f191700 1 -- 172.21.15.152:0/1400495155 shutdown_connections 2024-04-06T12:13:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.149+0000 7f243f191700 1 -- 172.21.15.152:0/1400495155 wait complete. 2024-04-06T12:13:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f243f191700 1 Processor -- start 2024-04-06T12:13:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f243f191700 1 -- start start 2024-04-06T12:13:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f243f191700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f243810ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f243f191700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438071c80 con 0x7f24380fbed0 2024-04-06T12:13:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f243cf2d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f243810ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f243cf2d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f243810ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40220/0 (socket says 172.21.15.152:40220) 2024-04-06T12:13:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f243cf2d700 1 -- 172.21.15.152:0/532325748 learned_addr learned my addr 172.21.15.152:0/532325748 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f243cf2d700 1 -- 172.21.15.152:0/532325748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c009370 con 0x7f24380fbed0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f243cf2d700 1 --2- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f243810ead0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f242c0115c0 tx=0x7f242c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f2435ffb700 1 -- 172.21.15.152:0/532325748 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f242c01a610 con 0x7f24380fbed0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f2435ffb700 1 -- 172.21.15.152:0/532325748 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f242c01abc0 con 0x7f24380fbed0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.150+0000 7f2435ffb700 1 -- 172.21.15.152:0/532325748 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f242c022a40 con 0x7f24380fbed0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.151+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2438071e80 con 0x7f24380fbed0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.151+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243810f180 con 0x7f24380fbed0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.151+0000 7f2435ffb700 1 -- 172.21.15.152:0/532325748 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f242c022cb0 con 0x7f24380fbed0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.151+0000 7f2435ffb700 1 --2- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2428032630 0x7f2428034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.152+0000 7f2435ffb700 1 -- 172.21.15.152:0/532325748 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f242c044ad0 con 0x7f24380fbed0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.152+0000 7f2437fff700 1 --2- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2428032630 0x7f2428034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.152+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243805a310 con 0x7f24380fbed0 2024-04-06T12:13:54.249 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.152+0000 7f2437fff700 1 --2- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2428032630 0x7f2428034af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2424009780 tx=0x7f2424006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:54.250 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.156+0000 7f2435ffb700 1 -- 172.21.15.152:0/532325748 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f242c01e080 con 0x7f24380fbed0 2024-04-06T12:13:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:52.991702+0000 mgr.smithi152.lynahm (mgr.14116) 5 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:13:54.322 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.323+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f2438104c00 con 0x7f2428032630 2024-04-06T12:13:54.798 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.799+0000 7f2435ffb700 1 -- 172.21.15.152:0/532325748 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2438104c00 con 0x7f2428032630 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.801+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2428032630 msgr2=0x7f2428034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.801+0000 7f243f191700 1 --2- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2428032630 0x7f2428034af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2424009780 tx=0x7f2424006cc0).stop 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.801+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 msgr2=0x7f243810ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.801+0000 7f243f191700 1 --2- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f243810ead0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f242c0115c0 tx=0x7f242c0090f0).stop 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.801+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 shutdown_connections 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.801+0000 7f243f191700 1 --2- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2428032630 0x7f2428034af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.801+0000 7f243f191700 1 --2- 172.21.15.152:0/532325748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24380fbed0 0x7f243810ead0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.801+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 >> 172.21.15.152:0/532325748 conn(0x7f24380f76f0 msgr2=0x7f24380f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.802+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 shutdown_connections 2024-04-06T12:13:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:54.802+0000 7f243f191700 1 -- 172.21.15.152:0/532325748 wait complete. 2024-04-06T12:13:56.045 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.043+0000 7ff2565ee700 1 Processor -- start 2024-04-06T12:13:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.043+0000 7ff2565ee700 1 -- start start 2024-04-06T12:13:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff2565ee700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff2500fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff2565ee700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500fc7e0 con 0x7ff2500fbed0 2024-04-06T12:13:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff24ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff2500fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff24ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff2500fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40226/0 (socket says 172.21.15.152:40226) 2024-04-06T12:13:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff24ffff700 1 -- 172.21.15.152:0/33331757 learned_addr learned my addr 172.21.15.152:0/33331757 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff24ffff700 1 -- 172.21.15.152:0/33331757 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2500fc920 con 0x7ff2500fbed0 2024-04-06T12:13:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff24ffff700 1 --2- 172.21.15.152:0/33331757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff2500fc2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff240009730 tx=0x7ff2400090f0).ready entity=mon.0 client_cookie=cb0830c6e1574f46 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff24effd700 1 -- 172.21.15.152:0/33331757 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff24000b6e0 con 0x7ff2500fbed0 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff24effd700 1 -- 172.21.15.152:0/33331757 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff24000bc90 con 0x7ff2500fbed0 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.044+0000 7ff24effd700 1 -- 172.21.15.152:0/33331757 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff240011c70 con 0x7ff2500fbed0 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.045+0000 7ff2565ee700 1 -- 172.21.15.152:0/33331757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 msgr2=0x7ff2500fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.045+0000 7ff2565ee700 1 --2- 172.21.15.152:0/33331757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff2500fc2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff240009730 tx=0x7ff2400090f0).stop 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.045+0000 7ff2565ee700 1 -- 172.21.15.152:0/33331757 shutdown_connections 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.045+0000 7ff2565ee700 1 --2- 172.21.15.152:0/33331757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff2500fc2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.045+0000 7ff2565ee700 1 -- 172.21.15.152:0/33331757 >> 172.21.15.152:0/33331757 conn(0x7ff2500f76f0 msgr2=0x7ff2500f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.045+0000 7ff2565ee700 1 -- 172.21.15.152:0/33331757 shutdown_connections 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.045+0000 7ff2565ee700 1 -- 172.21.15.152:0/33331757 wait complete. 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.046+0000 7ff2565ee700 1 Processor -- start 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.046+0000 7ff2565ee700 1 -- start start 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.046+0000 7ff2565ee700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff250071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:56.047 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.046+0000 7ff2565ee700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25010c8c0 con 0x7ff2500fbed0 2024-04-06T12:13:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.046+0000 7ff24ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff250071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.046+0000 7ff24ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff250071c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40230/0 (socket says 172.21.15.152:40230) 2024-04-06T12:13:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.046+0000 7ff24ffff700 1 -- 172.21.15.152:0/2645069001 learned_addr learned my addr 172.21.15.152:0/2645069001 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.047+0000 7ff24ffff700 1 -- 172.21.15.152:0/2645069001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240009370 con 0x7ff2500fbed0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.047+0000 7ff24ffff700 1 --2- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff250071c10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff2400115c0 tx=0x7ff2400090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.047+0000 7ff24d7fa700 1 -- 172.21.15.152:0/2645069001 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff24001a610 con 0x7ff2500fbed0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.047+0000 7ff24d7fa700 1 -- 172.21.15.152:0/2645069001 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff24001abc0 con 0x7ff2500fbed0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.047+0000 7ff24d7fa700 1 -- 172.21.15.152:0/2645069001 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff240022a40 con 0x7ff2500fbed0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.047+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff250110ed0 con 0x7ff2500fbed0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.047+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff250111220 con 0x7ff2500fbed0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.048+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff250046ce0 con 0x7ff2500fbed0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.048+0000 7ff24d7fa700 1 -- 172.21.15.152:0/2645069001 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7ff240022d00 con 0x7ff2500fbed0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.048+0000 7ff24d7fa700 1 --2- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff2380325e0 0x7ff238034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.048+0000 7ff24d7fa700 1 -- 172.21.15.152:0/2645069001 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7ff240044c00 con 0x7ff2500fbed0 2024-04-06T12:13:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.048+0000 7ff24f7fe700 1 --2- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff2380325e0 0x7ff238034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:56.050 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.048+0000 7ff24f7fe700 1 --2- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff2380325e0 0x7ff238034aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff244009780 tx=0x7ff244006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:56.051 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.052+0000 7ff24d7fa700 1 -- 172.21.15.152:0/2645069001 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff24002bd20 con 0x7ff2500fbed0 2024-04-06T12:13:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.214+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ff250059120 con 0x7ff2380325e0 2024-04-06T12:13:56.214 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.215+0000 7ff24d7fa700 1 -- 172.21.15.152:0/2645069001 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7ff250059120 con 0x7ff2380325e0 2024-04-06T12:13:56.214 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr3STYOnpakcg7vcDvilVPHWMC8S8ecNh+tLNBeK4uJIyfljnw5pQk8wkXY20zDuz6iCrC168+zwPo8JpdyahDf9OP49uBd/7LeRJQI4N5ij/X0vmKXQig+p4jatNGyaUCH0z5js+bD5UYKE4w4+tydsRyluAzx1Qodn5MMU2KvEzez6PK/sJUsOu04dBU8rCBaktRtHo+SfauVVgYvyOHTIPS/+GeMJsJ684CfLrW/utBOYTg0o0voEZI/iIlRs7cKkwWW8na4LqQmfJReU1rPYzjuyob9sc0CJCkkilyHQJzeTei+8xBV5pVO5J2QBTAYGwWEBlOXN2RwjkDPLeXS4SQMySAVY0FhrTDsbp/MFeJzCvGADDZF8NR+e9U0d3BHSMxOPmm6fgKwlonXI5W7EWDD3rI838oESK7mXxPwH84KNVhgr8Xq6PCFOwd1yUzOHlpimodIBKg8Vb/mNbSVijgdwm1tbIoM/hMcntibB9ahNqeGJipcp/B+FcoQg0= ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:13:56.216 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff2380325e0 msgr2=0x7ff238034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:56.216 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 --2- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff2380325e0 0x7ff238034aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff244009780 tx=0x7ff244006cc0).stop 2024-04-06T12:13:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 msgr2=0x7ff250071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 --2- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff250071c10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff2400115c0 tx=0x7ff2400090f0).stop 2024-04-06T12:13:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 shutdown_connections 2024-04-06T12:13:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 --2- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff2380325e0 0x7ff238034aa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 --2- 172.21.15.152:0/2645069001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2500fbed0 0x7ff250071c10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 >> 172.21.15.152:0/2645069001 conn(0x7ff2500f76f0 msgr2=0x7ff2500f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 shutdown_connections 2024-04-06T12:13:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:56.217+0000 7ff2565ee700 1 -- 172.21.15.152:0/2645069001 wait complete. 2024-04-06T12:13:56.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:54.325065+0000 mgr.smithi152.lynahm (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:13:56.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:13:54.325260+0000 mgr.smithi152.lynahm (mgr.14116) 7 : cephadm [INF] Generating ssh key... 2024-04-06T12:13:56.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:54.798119+0000 mon.smithi152 (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:13:56.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:54.799956+0000 mon.smithi152 (mon.0) 52 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:13:56.867 INFO:teuthology.orchestra.run.smithi152.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-06T12:13:56.868 INFO:teuthology.orchestra.run.smithi152.stderr:Adding key to root@localhost authorized_keys... 2024-04-06T12:13:56.868 INFO:teuthology.orchestra.run.smithi152.stderr:Adding host smithi152... 2024-04-06T12:13:57.140 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:56.216350+0000 mgr.smithi152.lynahm (mgr.14116) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:13:57.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.411+0000 7f6c145bf700 1 Processor -- start 2024-04-06T12:13:57.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.411+0000 7f6c145bf700 1 -- start start 2024-04-06T12:13:57.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c145bf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c0fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:57.414 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c145bf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0fc7e0 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c1235b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c0fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c1235b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c0fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40232/0 (socket says 172.21.15.152:40232) 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c1235b700 1 -- 172.21.15.152:0/1002754322 learned_addr learned my addr 172.21.15.152:0/1002754322 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c1235b700 1 -- 172.21.15.152:0/1002754322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0fc920 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c1235b700 1 --2- 172.21.15.152:0/1002754322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c0fc2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6c08009730 tx=0x7f6c080090f0).ready entity=mon.0 client_cookie=212415f80bace6fb server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c11359700 1 -- 172.21.15.152:0/1002754322 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0800b6e0 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c11359700 1 -- 172.21.15.152:0/1002754322 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6c0800bc90 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.412+0000 7f6c11359700 1 -- 172.21.15.152:0/1002754322 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c08011c70 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.413+0000 7f6c145bf700 1 -- 172.21.15.152:0/1002754322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 msgr2=0x7f6c0c0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.413+0000 7f6c145bf700 1 --2- 172.21.15.152:0/1002754322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c0fc2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6c08009730 tx=0x7f6c080090f0).stop 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.413+0000 7f6c145bf700 1 -- 172.21.15.152:0/1002754322 shutdown_connections 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.413+0000 7f6c145bf700 1 --2- 172.21.15.152:0/1002754322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c0fc2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.413+0000 7f6c145bf700 1 -- 172.21.15.152:0/1002754322 >> 172.21.15.152:0/1002754322 conn(0x7f6c0c0f76f0 msgr2=0x7f6c0c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:57.415 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.413+0000 7f6c145bf700 1 -- 172.21.15.152:0/1002754322 shutdown_connections 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.413+0000 7f6c145bf700 1 -- 172.21.15.152:0/1002754322 wait complete. 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.414+0000 7f6c145bf700 1 Processor -- start 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.414+0000 7f6c145bf700 1 -- start start 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.414+0000 7f6c145bf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.414+0000 7f6c145bf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c10a0b0 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.414+0000 7f6c1235b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.414+0000 7f6c1235b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40242/0 (socket says 172.21.15.152:40242) 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.414+0000 7f6c1235b700 1 -- 172.21.15.152:0/4249435470 learned_addr learned my addr 172.21.15.152:0/4249435470 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.415+0000 7f6c1235b700 1 -- 172.21.15.152:0/4249435470 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c08009370 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.415+0000 7f6c1235b700 1 --2- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c109bc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6c080115c0 tx=0x7f6c080090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.415+0000 7f6c037fe700 1 -- 172.21.15.152:0/4249435470 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0801a610 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.415+0000 7f6c037fe700 1 -- 172.21.15.152:0/4249435470 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6c0801abc0 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.417 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.415+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c10a2b0 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.417 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.415+0000 7f6c037fe700 1 -- 172.21.15.152:0/4249435470 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c08022a40 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.417 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.415+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c10a6c0 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.417 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.416+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c046ce0 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.418 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.416+0000 7f6c037fe700 1 -- 172.21.15.152:0/4249435470 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f6c08022cb0 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.418 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.416+0000 7f6c037fe700 1 --2- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f6bf8034880 0x7f6bf8036d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:57.418 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.417+0000 7f6c037fe700 1 -- 172.21.15.152:0/4249435470 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f6c08044fb0 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.418 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.417+0000 7f6c11b5a700 1 --2- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f6bf8034880 0x7f6bf8036d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:57.418 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.417+0000 7f6c11b5a700 1 --2- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f6bf8034880 0x7f6bf8036d40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f6bfc009780 tx=0x7f6bfc006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:57.419 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.421+0000 7f6c037fe700 1 -- 172.21.15.152:0/4249435470 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6c0806df60 con 0x7f6c0c0fbed0 2024-04-06T12:13:57.586 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:57.588+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "addr": "172.21.15.152", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c0c10afa0 con 0x7f6bf8034880 2024-04-06T12:13:58.202 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: Added host 'smithi152' with addr '172.21.15.152' 2024-04-06T12:13:58.202 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.202+0000 7f6c037fe700 1 -- 172.21.15.152:0/4249435470 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6c0c10afa0 con 0x7f6bf8034880 2024-04-06T12:13:58.203 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f6bf8034880 msgr2=0x7f6bf8036d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:58.204 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 --2- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f6bf8034880 0x7f6bf8036d40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f6bfc009780 tx=0x7f6bfc006cc0).stop 2024-04-06T12:13:58.204 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 msgr2=0x7f6c0c109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:58.204 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 --2- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c109bc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6c080115c0 tx=0x7f6c080090f0).stop 2024-04-06T12:13:58.204 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 shutdown_connections 2024-04-06T12:13:58.204 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 --2- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f6bf8034880 0x7f6bf8036d40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:58.204 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 --2- 172.21.15.152:0/4249435470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fbed0 0x7f6c0c109bc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:58.204 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 >> 172.21.15.152:0/4249435470 conn(0x7f6c0c0f76f0 msgr2=0x7f6c0c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:58.204 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 shutdown_connections 2024-04-06T12:13:58.204 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:58.204+0000 7f6c145bf700 1 -- 172.21.15.152:0/4249435470 wait complete. 2024-04-06T12:13:58.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:57 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:57.589985+0000 mgr.smithi152.lynahm (mgr.14116) 9 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "addr": "172.21.15.152", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:13:58.927 INFO:teuthology.orchestra.run.smithi152.stderr:Deploying mon service with default placement... 2024-04-06T12:13:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:58.202666+0000 mon.smithi152 (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:13:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:13:58.202944+0000 mgr.smithi152.lynahm (mgr.14116) 10 : cephadm [INF] Added host smithi152 2024-04-06T12:13:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:13:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:58.238660+0000 mon.smithi152 (mon.0) 54 : audit [DBG] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:13:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.742+0000 7f12d7662700 1 Processor -- start 2024-04-06T12:13:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.743+0000 7f12d7662700 1 -- start start 2024-04-06T12:13:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.743+0000 7f12d7662700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d00fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.743+0000 7f12d7662700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00fc7e0 con 0x7f12d00fbed0 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.743+0000 7f12d53fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d00fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.743+0000 7f12d53fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d00fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40250/0 (socket says 172.21.15.152:40250) 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.743+0000 7f12d53fe700 1 -- 172.21.15.152:0/4223287987 learned_addr learned my addr 172.21.15.152:0/4223287987 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.743+0000 7f12d53fe700 1 -- 172.21.15.152:0/4223287987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00fc920 con 0x7f12d00fbed0 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.743+0000 7f12d53fe700 1 --2- 172.21.15.152:0/4223287987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d00fc2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f12c0009730 tx=0x7f12c00090f0).ready entity=mon.0 client_cookie=b42d572448b5a40f server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12c7fff700 1 -- 172.21.15.152:0/4223287987 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12c000b6e0 con 0x7f12d00fbed0 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12c7fff700 1 -- 172.21.15.152:0/4223287987 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f12c000bc90 con 0x7f12d00fbed0 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12c7fff700 1 -- 172.21.15.152:0/4223287987 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12c0011c70 con 0x7f12d00fbed0 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12d7662700 1 -- 172.21.15.152:0/4223287987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 msgr2=0x7f12d00fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12d7662700 1 --2- 172.21.15.152:0/4223287987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d00fc2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f12c0009730 tx=0x7f12c00090f0).stop 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12d7662700 1 -- 172.21.15.152:0/4223287987 shutdown_connections 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12d7662700 1 --2- 172.21.15.152:0/4223287987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d00fc2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12d7662700 1 -- 172.21.15.152:0/4223287987 >> 172.21.15.152:0/4223287987 conn(0x7f12d00f76f0 msgr2=0x7f12d00f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12d7662700 1 -- 172.21.15.152:0/4223287987 shutdown_connections 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.744+0000 7f12d7662700 1 -- 172.21.15.152:0/4223287987 wait complete. 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.745+0000 7f12d7662700 1 Processor -- start 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.745+0000 7f12d7662700 1 -- start start 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.745+0000 7f12d7662700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d0102160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.745+0000 7f12d7662700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01005e0 con 0x7f12d00fbed0 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.745+0000 7f12d53fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d0102160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.745+0000 7f12d53fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d0102160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40266/0 (socket says 172.21.15.152:40266) 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.745+0000 7f12d53fe700 1 -- 172.21.15.152:0/1826029072 learned_addr learned my addr 172.21.15.152:0/1826029072 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.745+0000 7f12d53fe700 1 -- 172.21.15.152:0/1826029072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0009370 con 0x7f12d00fbed0 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.746+0000 7f12d53fe700 1 --2- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d0102160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f12c00115c0 tx=0x7f12c00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.746+0000 7f12c67fc700 1 -- 172.21.15.152:0/1826029072 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12c001a610 con 0x7f12d00fbed0 2024-04-06T12:13:59.755 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.746+0000 7f12c67fc700 1 -- 172.21.15.152:0/1826029072 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f12c001abc0 con 0x7f12d00fbed0 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.746+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d0100780 con 0x7f12d00fbed0 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.746+0000 7f12c67fc700 1 -- 172.21.15.152:0/1826029072 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12c0022a40 con 0x7f12d00fbed0 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.746+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d0100b90 con 0x7f12d00fbed0 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.747+0000 7f12c67fc700 1 -- 172.21.15.152:0/1826029072 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f12c0022d00 con 0x7f12d00fbed0 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.747+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d0046ce0 con 0x7f12d00fbed0 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.747+0000 7f12c67fc700 1 --2- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f12bc0325e0 0x7f12bc034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.747+0000 7f12c67fc700 1 -- 172.21.15.152:0/1826029072 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f12c0044ec0 con 0x7f12d00fbed0 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.747+0000 7f12d4bfd700 1 --2- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f12bc0325e0 0x7f12bc034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.747+0000 7f12d4bfd700 1 --2- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f12bc0325e0 0x7f12bc034aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f12cc009780 tx=0x7f12cc006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:13:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.751+0000 7f12c67fc700 1 -- 172.21.15.152:0/1826029072 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f12c0018320 con 0x7f12d00fbed0 2024-04-06T12:13:59.929 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.930+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f12d0100dd0 con 0x7f12bc0325e0 2024-04-06T12:13:59.933 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.934+0000 7f12c67fc700 1 -- 172.21.15.152:0/1826029072 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f12d0100dd0 con 0x7f12bc0325e0 2024-04-06T12:13:59.933 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: Scheduled mon update... 2024-04-06T12:13:59.936 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.936+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f12bc0325e0 msgr2=0x7f12bc034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:59.936 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.936+0000 7f12d7662700 1 --2- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f12bc0325e0 0x7f12bc034aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f12cc009780 tx=0x7f12cc006cc0).stop 2024-04-06T12:13:59.936 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.936+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 msgr2=0x7f12d0102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:13:59.936 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.936+0000 7f12d7662700 1 --2- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d0102160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f12c00115c0 tx=0x7f12c00090f0).stop 2024-04-06T12:13:59.936 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.936+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 shutdown_connections 2024-04-06T12:13:59.936 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.936+0000 7f12d7662700 1 --2- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f12bc0325e0 0x7f12bc034aa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:59.936 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.936+0000 7f12d7662700 1 --2- 172.21.15.152:0/1826029072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12d00fbed0 0x7f12d0102160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:13:59.936 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.936+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 >> 172.21.15.152:0/1826029072 conn(0x7f12d00f76f0 msgr2=0x7f12d0071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:13:59.937 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.937+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 shutdown_connections 2024-04-06T12:13:59.937 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:13:59.937+0000 7f12d7662700 1 -- 172.21.15.152:0/1826029072 wait complete. 2024-04-06T12:14:00.750 INFO:teuthology.orchestra.run.smithi152.stderr:Deploying mgr service with default placement... 2024-04-06T12:14:01.006 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:59.932110+0000 mgr.smithi152.lynahm (mgr.14116) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:01.006 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:13:59.933208+0000 mgr.smithi152.lynahm (mgr.14116) 12 : cephadm [INF] Saving service mon spec with placement count:5 2024-04-06T12:14:01.007 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:13:59.935631+0000 mon.smithi152 (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:01.655 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.653+0000 7f5b1f6fd700 1 Processor -- start 2024-04-06T12:14:01.655 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.653+0000 7f5b1f6fd700 1 -- start start 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.653+0000 7f5b1f6fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.653+0000 7f5b1f6fd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18100120 con 0x7f5b18071c60 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.653+0000 7f5b1d499700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.653+0000 7f5b1d499700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40276/0 (socket says 172.21.15.152:40276) 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.653+0000 7f5b1d499700 1 -- 172.21.15.152:0/3528888798 learned_addr learned my addr 172.21.15.152:0/3528888798 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b1d499700 1 -- 172.21.15.152:0/3528888798 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b18100260 con 0x7f5b18071c60 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b1d499700 1 --2- 172.21.15.152:0/3528888798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180ffc30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5b14009730 tx=0x7f5b140090f0).ready entity=mon.0 client_cookie=dd069211c0a8e269 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b0ffff700 1 -- 172.21.15.152:0/3528888798 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b1400b6e0 con 0x7f5b18071c60 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b0ffff700 1 -- 172.21.15.152:0/3528888798 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5b1400bcd0 con 0x7f5b18071c60 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b0ffff700 1 -- 172.21.15.152:0/3528888798 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b14011cb0 con 0x7f5b18071c60 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/3528888798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 msgr2=0x7f5b180ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b1f6fd700 1 --2- 172.21.15.152:0/3528888798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180ffc30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5b14009730 tx=0x7f5b140090f0).stop 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/3528888798 shutdown_connections 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b1f6fd700 1 --2- 172.21.15.152:0/3528888798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180ffc30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.654+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/3528888798 >> 172.21.15.152:0/3528888798 conn(0x7f5b180f76f0 msgr2=0x7f5b180f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.655+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/3528888798 shutdown_connections 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.655+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/3528888798 wait complete. 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.655+0000 7f5b1f6fd700 1 Processor -- start 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.655+0000 7f5b1f6fd700 1 -- start start 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b1f6fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180fd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b1f6fd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180fbb30 con 0x7f5b18071c60 2024-04-06T12:14:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b1d499700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b1d499700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180fd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40286/0 (socket says 172.21.15.152:40286) 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b1d499700 1 -- 172.21.15.152:0/1795719273 learned_addr learned my addr 172.21.15.152:0/1795719273 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b1d499700 1 -- 172.21.15.152:0/1795719273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14009370 con 0x7f5b18071c60 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b1d499700 1 --2- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180fd6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5b140118b0 tx=0x7f5b140090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b0e7fc700 1 -- 172.21.15.152:0/1795719273 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b1400be40 con 0x7f5b18071c60 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b0e7fc700 1 -- 172.21.15.152:0/1795719273 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5b1401aad0 con 0x7f5b18071c60 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b0e7fc700 1 -- 172.21.15.152:0/1795719273 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b14023a80 con 0x7f5b18071c60 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b180fbcd0 con 0x7f5b18071c60 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.656+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b180fc0e0 con 0x7f5b18071c60 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.657+0000 7f5b0e7fc700 1 -- 172.21.15.152:0/1795719273 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f5b14023c70 con 0x7f5b18071c60 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.657+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b18046ce0 con 0x7f5b18071c60 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.658+0000 7f5b0e7fc700 1 --2- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5b04032660 0x7f5b04034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.658+0000 7f5b0e7fc700 1 -- 172.21.15.152:0/1795719273 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f5b14044a40 con 0x7f5b18071c60 2024-04-06T12:14:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.658+0000 7f5b1cc98700 1 --2- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5b04032660 0x7f5b04034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:01.659 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.658+0000 7f5b1cc98700 1 --2- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5b04032660 0x7f5b04034b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f5b08009780 tx=0x7f5b08006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:01.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.662+0000 7f5b0e7fc700 1 -- 172.21.15.152:0/1795719273 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5b14021320 con 0x7f5b18071c60 2024-04-06T12:14:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.851+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b18105d10 con 0x7f5b04032660 2024-04-06T12:14:01.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.856+0000 7f5b0e7fc700 1 -- 172.21.15.152:0/1795719273 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5b18105d10 con 0x7f5b04032660 2024-04-06T12:14:01.854 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-04-06T12:14:01.857 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.858+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5b04032660 msgr2=0x7f5b04034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:01.857 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.858+0000 7f5b1f6fd700 1 --2- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5b04032660 0x7f5b04034b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f5b08009780 tx=0x7f5b08006cc0).stop 2024-04-06T12:14:01.857 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.858+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 msgr2=0x7f5b180fd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:01.857 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.858+0000 7f5b1f6fd700 1 --2- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180fd6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5b140118b0 tx=0x7f5b140090f0).stop 2024-04-06T12:14:01.857 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.858+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 shutdown_connections 2024-04-06T12:14:01.857 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.858+0000 7f5b1f6fd700 1 --2- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f5b04032660 0x7f5b04034b20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:01.857 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.858+0000 7f5b1f6fd700 1 --2- 172.21.15.152:0/1795719273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b18071c60 0x7f5b180fd6b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:01.857 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.858+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 >> 172.21.15.152:0/1795719273 conn(0x7f5b180f76f0 msgr2=0x7f5b180f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:01.858 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.859+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 shutdown_connections 2024-04-06T12:14:01.858 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:01.859+0000 7f5b1f6fd700 1 -- 172.21.15.152:0/1795719273 wait complete. 2024-04-06T12:14:02.444 INFO:teuthology.orchestra.run.smithi152.stderr:Deploying crash service with default placement... 2024-04-06T12:14:02.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:01.357645+0000 mon.smithi152 (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:02.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:01.591995+0000 mon.smithi152 (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:02.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:01.853337+0000 mgr.smithi152.lynahm (mgr.14116) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:02.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:01.854269+0000 mgr.smithi152.lynahm (mgr.14116) 14 : cephadm [INF] Saving service mgr spec with placement count:2 2024-04-06T12:14:02.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:01.856674+0000 mon.smithi152 (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:03.126 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.110+0000 7fd515af0700 1 Processor -- start 2024-04-06T12:14:03.126 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd515af0700 1 -- start start 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd515af0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd5100ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd515af0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd510100120 con 0x7fd510071c60 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd50f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd5100ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd50f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd5100ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34264/0 (socket says 172.21.15.152:34264) 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd50f7fe700 1 -- 172.21.15.152:0/2940654992 learned_addr learned my addr 172.21.15.152:0/2940654992 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd50f7fe700 1 -- 172.21.15.152:0/2940654992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510100260 con 0x7fd510071c60 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd50f7fe700 1 --2- 172.21.15.152:0/2940654992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd5100ffc30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd504009730 tx=0x7fd5040090f0).ready entity=mon.0 client_cookie=dac6079d1326fb47 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd50e7fc700 1 -- 172.21.15.152:0/2940654992 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd50400b6e0 con 0x7fd510071c60 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd50e7fc700 1 -- 172.21.15.152:0/2940654992 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fd50400bcd0 con 0x7fd510071c60 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.111+0000 7fd50e7fc700 1 -- 172.21.15.152:0/2940654992 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd504011cb0 con 0x7fd510071c60 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.112+0000 7fd515af0700 1 -- 172.21.15.152:0/2940654992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 msgr2=0x7fd5100ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.112+0000 7fd515af0700 1 --2- 172.21.15.152:0/2940654992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd5100ffc30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd504009730 tx=0x7fd5040090f0).stop 2024-04-06T12:14:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.112+0000 7fd515af0700 1 -- 172.21.15.152:0/2940654992 shutdown_connections 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.112+0000 7fd515af0700 1 --2- 172.21.15.152:0/2940654992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd5100ffc30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.112+0000 7fd515af0700 1 -- 172.21.15.152:0/2940654992 >> 172.21.15.152:0/2940654992 conn(0x7fd5100f76f0 msgr2=0x7fd5100f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.112+0000 7fd515af0700 1 -- 172.21.15.152:0/2940654992 shutdown_connections 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.112+0000 7fd515af0700 1 -- 172.21.15.152:0/2940654992 wait complete. 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.113+0000 7fd515af0700 1 Processor -- start 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.113+0000 7fd515af0700 1 -- start start 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.113+0000 7fd515af0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd51010bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.113+0000 7fd515af0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51010c390 con 0x7fd510071c60 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.113+0000 7fd50f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd51010bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.113+0000 7fd50f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd51010bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34268/0 (socket says 172.21.15.152:34268) 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.113+0000 7fd50f7fe700 1 -- 172.21.15.152:0/918643883 learned_addr learned my addr 172.21.15.152:0/918643883 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.114+0000 7fd50f7fe700 1 -- 172.21.15.152:0/918643883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504009370 con 0x7fd510071c60 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.114+0000 7fd50f7fe700 1 --2- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd51010bea0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd5040118b0 tx=0x7fd5040090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.114+0000 7fd50cff9700 1 -- 172.21.15.152:0/918643883 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd50400be40 con 0x7fd510071c60 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.114+0000 7fd50cff9700 1 -- 172.21.15.152:0/918643883 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fd50401aad0 con 0x7fd510071c60 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.114+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51010c590 con 0x7fd510071c60 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.114+0000 7fd50cff9700 1 -- 172.21.15.152:0/918643883 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd504023a80 con 0x7fd510071c60 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.114+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51010c9a0 con 0x7fd510071c60 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.115+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd510046ce0 con 0x7fd510071c60 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.115+0000 7fd50cff9700 1 -- 172.21.15.152:0/918643883 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fd50401ac40 con 0x7fd510071c60 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.115+0000 7fd50cff9700 1 --2- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fd4f8032610 0x7fd4f8034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.115+0000 7fd50cff9700 1 -- 172.21.15.152:0/918643883 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fd504044d90 con 0x7fd510071c60 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.116+0000 7fd50effd700 1 --2- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fd4f8032610 0x7fd4f8034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.116+0000 7fd50effd700 1 --2- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fd4f8032610 0x7fd4f8034ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd500009780 tx=0x7fd500006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:03.129 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.119+0000 7fd50cff9700 1 -- 172.21.15.152:0/918643883 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd504019980 con 0x7fd510071c60 2024-04-06T12:14:03.293 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.294+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fd51010d140 con 0x7fd4f8032610 2024-04-06T12:14:03.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.298+0000 7fd50cff9700 1 -- 172.21.15.152:0/918643883 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fd51010d140 con 0x7fd4f8032610 2024-04-06T12:14:03.297 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: Scheduled crash update... 2024-04-06T12:14:03.299 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fd4f8032610 msgr2=0x7fd4f8034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:03.300 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 --2- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fd4f8032610 0x7fd4f8034ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd500009780 tx=0x7fd500006cc0).stop 2024-04-06T12:14:03.300 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 msgr2=0x7fd51010bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:03.300 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 --2- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd51010bea0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd5040118b0 tx=0x7fd5040090f0).stop 2024-04-06T12:14:03.300 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 shutdown_connections 2024-04-06T12:14:03.300 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 --2- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fd4f8032610 0x7fd4f8034ad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:03.300 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 --2- 172.21.15.152:0/918643883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd510071c60 0x7fd51010bea0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:03.300 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 >> 172.21.15.152:0/918643883 conn(0x7fd5100f76f0 msgr2=0x7fd5100f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:03.300 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 shutdown_connections 2024-04-06T12:14:03.300 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:03.300+0000 7fd515af0700 1 -- 172.21.15.152:0/918643883 wait complete. 2024-04-06T12:14:04.121 INFO:teuthology.orchestra.run.smithi152.stderr:Deploying prometheus service with default placement... 2024-04-06T12:14:04.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:03.296235+0000 mgr.smithi152.lynahm (mgr.14116) 15 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:04.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:03.297139+0000 mgr.smithi152.lynahm (mgr.14116) 16 : cephadm [INF] Saving service crash spec with placement * 2024-04-06T12:14:04.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:03.299420+0000 mon.smithi152 (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:04.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:03.522908+0000 mon.smithi152 (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.680+0000 7f2f1f491700 1 Processor -- start 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.680+0000 7f2f1f491700 1 -- start start 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.680+0000 7f2f1f491700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f180ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.680+0000 7f2f1f491700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f181001a0 con 0x7f2f18071be0 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.680+0000 7f2f1d22d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f180ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.680+0000 7f2f1d22d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f180ffcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34270/0 (socket says 172.21.15.152:34270) 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.680+0000 7f2f1d22d700 1 -- 172.21.15.152:0/3412696993 learned_addr learned my addr 172.21.15.152:0/3412696993 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.681+0000 7f2f1d22d700 1 -- 172.21.15.152:0/3412696993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f181002e0 con 0x7f2f18071be0 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.681+0000 7f2f1d22d700 1 --2- 172.21.15.152:0/3412696993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f180ffcb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2f14009730 tx=0x7f2f140090f0).ready entity=mon.0 client_cookie=d7e756a44a38a701 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.681+0000 7f2f0ffff700 1 -- 172.21.15.152:0/3412696993 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f1400b6e0 con 0x7f2f18071be0 2024-04-06T12:14:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.681+0000 7f2f0ffff700 1 -- 172.21.15.152:0/3412696993 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2f1400bcd0 con 0x7f2f18071be0 2024-04-06T12:14:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.681+0000 7f2f0ffff700 1 -- 172.21.15.152:0/3412696993 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f14011cb0 con 0x7f2f18071be0 2024-04-06T12:14:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.682+0000 7f2f1f491700 1 -- 172.21.15.152:0/3412696993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 msgr2=0x7f2f180ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.682+0000 7f2f1f491700 1 --2- 172.21.15.152:0/3412696993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f180ffcb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2f14009730 tx=0x7f2f140090f0).stop 2024-04-06T12:14:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.682+0000 7f2f1f491700 1 -- 172.21.15.152:0/3412696993 shutdown_connections 2024-04-06T12:14:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.682+0000 7f2f1f491700 1 --2- 172.21.15.152:0/3412696993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f180ffcb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.682+0000 7f2f1f491700 1 -- 172.21.15.152:0/3412696993 >> 172.21.15.152:0/3412696993 conn(0x7f2f180f76f0 msgr2=0x7f2f180f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.682+0000 7f2f1f491700 1 -- 172.21.15.152:0/3412696993 shutdown_connections 2024-04-06T12:14:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.682+0000 7f2f1f491700 1 -- 172.21.15.152:0/3412696993 wait complete. 2024-04-06T12:14:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.683+0000 7f2f1f491700 1 Processor -- start 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.683+0000 7f2f1f491700 1 -- start start 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.683+0000 7f2f1f491700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f1810beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.683+0000 7f2f1f491700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1810c3a0 con 0x7f2f18071be0 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.683+0000 7f2f1d22d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f1810beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.683+0000 7f2f1d22d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f1810beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34276/0 (socket says 172.21.15.152:34276) 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.683+0000 7f2f1d22d700 1 -- 172.21.15.152:0/1322219047 learned_addr learned my addr 172.21.15.152:0/1322219047 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.683+0000 7f2f1d22d700 1 -- 172.21.15.152:0/1322219047 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f14009370 con 0x7f2f18071be0 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.683+0000 7f2f1d22d700 1 --2- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f1810beb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2f140118b0 tx=0x7f2f140090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.684+0000 7f2f0e7fc700 1 -- 172.21.15.152:0/1322219047 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f1400be40 con 0x7f2f18071be0 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.684+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1810c5a0 con 0x7f2f18071be0 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.684+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1810c9b0 con 0x7f2f18071be0 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.684+0000 7f2f0e7fc700 1 -- 172.21.15.152:0/1322219047 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2f1401aad0 con 0x7f2f18071be0 2024-04-06T12:14:04.684 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.684+0000 7f2f0e7fc700 1 -- 172.21.15.152:0/1322219047 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f14023930 con 0x7f2f18071be0 2024-04-06T12:14:04.685 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.685+0000 7f2f0e7fc700 1 -- 172.21.15.152:0/1322219047 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f2f14023b20 con 0x7f2f18071be0 2024-04-06T12:14:04.685 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.685+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc005120 con 0x7f2f18071be0 2024-04-06T12:14:04.685 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.685+0000 7f2f0e7fc700 1 --2- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2f04032660 0x7f2f04034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:04.685 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.685+0000 7f2f0e7fc700 1 -- 172.21.15.152:0/1322219047 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f2f14044770 con 0x7f2f18071be0 2024-04-06T12:14:04.686 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.685+0000 7f2f1ca2c700 1 --2- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2f04032660 0x7f2f04034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:04.686 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.686+0000 7f2f1ca2c700 1 --2- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2f04032660 0x7f2f04034b20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f2f08009780 tx=0x7f2f08006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:04.689 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.690+0000 7f2f0e7fc700 1 -- 172.21.15.152:0/1322219047 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2f1402bd20 con 0x7f2f18071be0 2024-04-06T12:14:04.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.869+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f2efc000bc0 con 0x7f2f04032660 2024-04-06T12:14:04.872 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.874+0000 7f2f0e7fc700 1 -- 172.21.15.152:0/1322219047 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f2efc000bc0 con 0x7f2f04032660 2024-04-06T12:14:04.873 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: Scheduled prometheus update... 2024-04-06T12:14:04.875 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2f04032660 msgr2=0x7f2f04034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:04.875 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 --2- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2f04032660 0x7f2f04034b20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f2f08009780 tx=0x7f2f08006cc0).stop 2024-04-06T12:14:04.875 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 msgr2=0x7f2f1810beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:04.876 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 --2- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f1810beb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2f140118b0 tx=0x7f2f140090f0).stop 2024-04-06T12:14:04.876 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 shutdown_connections 2024-04-06T12:14:04.876 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 --2- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f2f04032660 0x7f2f04034b20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:04.876 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 --2- 172.21.15.152:0/1322219047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f18071be0 0x7f2f1810beb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:04.876 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 >> 172.21.15.152:0/1322219047 conn(0x7f2f180f76f0 msgr2=0x7f2f180f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:04.876 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 shutdown_connections 2024-04-06T12:14:04.876 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:04.876+0000 7f2f1f491700 1 -- 172.21.15.152:0/1322219047 wait complete. 2024-04-06T12:14:06.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:04.871711+0000 mgr.smithi152.lynahm (mgr.14116) 17 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:06.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:04.872602+0000 mgr.smithi152.lynahm (mgr.14116) 18 : cephadm [INF] Saving service prometheus spec with placement count:1 2024-04-06T12:14:06.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:04.874993+0000 mon.smithi152 (mon.0) 61 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:06.279 INFO:teuthology.orchestra.run.smithi152.stderr:Deploying grafana service with default placement... 2024-04-06T12:14:06.867 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.854+0000 7fe1a2753700 1 Processor -- start 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe1a2753700 1 -- start start 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe1a2753700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c0ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe1a2753700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c1001a0 con 0x7fe19c071c00 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c0ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c0ffcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34290/0 (socket says 172.21.15.152:34290) 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe19bfff700 1 -- 172.21.15.152:0/248790148 learned_addr learned my addr 172.21.15.152:0/248790148 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe19bfff700 1 -- 172.21.15.152:0/248790148 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c1002e0 con 0x7fe19c071c00 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe19bfff700 1 --2- 172.21.15.152:0/248790148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c0ffcb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe184009730 tx=0x7fe1840090f0).ready entity=mon.0 client_cookie=7a8b0c07935b169c server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe19affd700 1 -- 172.21.15.152:0/248790148 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe18400b6e0 con 0x7fe19c071c00 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe19affd700 1 -- 172.21.15.152:0/248790148 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe18400bcd0 con 0x7fe19c071c00 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.855+0000 7fe19affd700 1 -- 172.21.15.152:0/248790148 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe184011cb0 con 0x7fe19c071c00 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.856+0000 7fe1a2753700 1 -- 172.21.15.152:0/248790148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 msgr2=0x7fe19c0ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.856+0000 7fe1a2753700 1 --2- 172.21.15.152:0/248790148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c0ffcb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe184009730 tx=0x7fe1840090f0).stop 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.856+0000 7fe1a2753700 1 -- 172.21.15.152:0/248790148 shutdown_connections 2024-04-06T12:14:06.868 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.856+0000 7fe1a2753700 1 --2- 172.21.15.152:0/248790148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c0ffcb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.856+0000 7fe1a2753700 1 -- 172.21.15.152:0/248790148 >> 172.21.15.152:0/248790148 conn(0x7fe19c0f76f0 msgr2=0x7fe19c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.856+0000 7fe1a2753700 1 -- 172.21.15.152:0/248790148 shutdown_connections 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.856+0000 7fe1a2753700 1 -- 172.21.15.152:0/248790148 wait complete. 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.857+0000 7fe1a2753700 1 Processor -- start 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.857+0000 7fe1a2753700 1 -- start start 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.857+0000 7fe1a2753700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c10be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.857+0000 7fe1a2753700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c10c370 con 0x7fe19c071c00 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.857+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c10be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.857+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c10be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34300/0 (socket says 172.21.15.152:34300) 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.857+0000 7fe19bfff700 1 -- 172.21.15.152:0/869426082 learned_addr learned my addr 172.21.15.152:0/869426082 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.857+0000 7fe19bfff700 1 -- 172.21.15.152:0/869426082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184009370 con 0x7fe19c071c00 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.857+0000 7fe19bfff700 1 --2- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c10be80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe1840118b0 tx=0x7fe1840090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.858+0000 7fe1997fa700 1 -- 172.21.15.152:0/869426082 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe18400be40 con 0x7fe19c071c00 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.858+0000 7fe1997fa700 1 -- 172.21.15.152:0/869426082 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe18401aad0 con 0x7fe19c071c00 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.858+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19c10c570 con 0x7fe19c071c00 2024-04-06T12:14:06.869 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.858+0000 7fe1997fa700 1 -- 172.21.15.152:0/869426082 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1840239e0 con 0x7fe19c071c00 2024-04-06T12:14:06.870 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.858+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c10c980 con 0x7fe19c071c00 2024-04-06T12:14:06.870 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.858+0000 7fe1997fa700 1 -- 172.21.15.152:0/869426082 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fe184023c50 con 0x7fe19c071c00 2024-04-06T12:14:06.870 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.859+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19c046ce0 con 0x7fe19c071c00 2024-04-06T12:14:06.870 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.859+0000 7fe1997fa700 1 --2- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fe188032630 0x7fe188034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:06.870 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.859+0000 7fe1997fa700 1 -- 172.21.15.152:0/869426082 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fe184044830 con 0x7fe19c071c00 2024-04-06T12:14:06.870 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.859+0000 7fe19b7fe700 1 --2- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fe188032630 0x7fe188034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:06.870 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.859+0000 7fe19b7fe700 1 --2- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fe188032630 0x7fe188034af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe18c009780 tx=0x7fe18c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:06.870 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:06.863+0000 7fe1997fa700 1 -- 172.21.15.152:0/869426082 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe18402bb40 con 0x7fe19c071c00 2024-04-06T12:14:07.035 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.037+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fe19c10d260 con 0x7fe188032630 2024-04-06T12:14:07.039 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.041+0000 7fe1997fa700 1 -- 172.21.15.152:0/869426082 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fe19c10d260 con 0x7fe188032630 2024-04-06T12:14:07.039 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: Scheduled grafana update... 2024-04-06T12:14:07.042 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fe188032630 msgr2=0x7fe188034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:07.042 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 --2- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fe188032630 0x7fe188034af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe18c009780 tx=0x7fe18c006cc0).stop 2024-04-06T12:14:07.042 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 msgr2=0x7fe19c10be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:07.042 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 --2- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c10be80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe1840118b0 tx=0x7fe1840090f0).stop 2024-04-06T12:14:07.042 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 shutdown_connections 2024-04-06T12:14:07.042 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 --2- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fe188032630 0x7fe188034af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:07.042 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 --2- 172.21.15.152:0/869426082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c071c00 0x7fe19c10be80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:07.042 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 >> 172.21.15.152:0/869426082 conn(0x7fe19c0f76f0 msgr2=0x7fe19c0f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:07.043 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 shutdown_connections 2024-04-06T12:14:07.043 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:07.043+0000 7fe1a2753700 1 -- 172.21.15.152:0/869426082 wait complete. 2024-04-06T12:14:07.687 INFO:teuthology.orchestra.run.smithi152.stderr:Deploying node-exporter service with default placement... 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.236+0000 7f4a72b38700 1 Processor -- start 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.236+0000 7f4a72b38700 1 -- start start 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.236+0000 7f4a72b38700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c0fc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.236+0000 7f4a72b38700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0fcd60 con 0x7f4a6c0fc450 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.236+0000 7f4a708d4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c0fc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.237+0000 7f4a708d4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c0fc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34316/0 (socket says 172.21.15.152:34316) 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.237+0000 7f4a708d4700 1 -- 172.21.15.152:0/2042698206 learned_addr learned my addr 172.21.15.152:0/2042698206 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.237+0000 7f4a708d4700 1 -- 172.21.15.152:0/2042698206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c0fcea0 con 0x7f4a6c0fc450 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.237+0000 7f4a708d4700 1 --2- 172.21.15.152:0/2042698206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c0fc870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4a64009e50 tx=0x7f4a64009840).ready entity=mon.0 client_cookie=5fc9b996ea495380 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.237+0000 7f4a6b7fe700 1 -- 172.21.15.152:0/2042698206 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a6400ba20 con 0x7f4a6c0fc450 2024-04-06T12:14:08.237 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.237+0000 7f4a6b7fe700 1 -- 172.21.15.152:0/2042698206 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4a6400bb80 con 0x7f4a6c0fc450 2024-04-06T12:14:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.237+0000 7f4a6b7fe700 1 -- 172.21.15.152:0/2042698206 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a64007400 con 0x7f4a6c0fc450 2024-04-06T12:14:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 -- 172.21.15.152:0/2042698206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 msgr2=0x7f4a6c0fc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 --2- 172.21.15.152:0/2042698206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c0fc870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4a64009e50 tx=0x7f4a64009840).stop 2024-04-06T12:14:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 -- 172.21.15.152:0/2042698206 shutdown_connections 2024-04-06T12:14:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 --2- 172.21.15.152:0/2042698206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c0fc870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 -- 172.21.15.152:0/2042698206 >> 172.21.15.152:0/2042698206 conn(0x7f4a6c0f6e20 msgr2=0x7f4a6c0f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 -- 172.21.15.152:0/2042698206 shutdown_connections 2024-04-06T12:14:08.238 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 -- 172.21.15.152:0/2042698206 wait complete. 2024-04-06T12:14:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 Processor -- start 2024-04-06T12:14:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 -- start start 2024-04-06T12:14:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.238+0000 7f4a72b38700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c10ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a72b38700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c10b230 con 0x7f4a6c0fc450 2024-04-06T12:14:08.240 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a708d4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c10ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a708d4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c10ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34326/0 (socket says 172.21.15.152:34326) 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a708d4700 1 -- 172.21.15.152:0/3249941296 learned_addr learned my addr 172.21.15.152:0/3249941296 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a708d4700 1 -- 172.21.15.152:0/3249941296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a64009ae0 con 0x7f4a6c0fc450 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a708d4700 1 --2- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c10ad40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4a64014ff0 tx=0x7f4a64009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a69ffb700 1 -- 172.21.15.152:0/3249941296 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a64007680 con 0x7f4a6c0fc450 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a69ffb700 1 -- 172.21.15.152:0/3249941296 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4a64007c70 con 0x7f4a6c0fc450 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c10b430 con 0x7f4a6c0fc450 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a69ffb700 1 -- 172.21.15.152:0/3249941296 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a6401caa0 con 0x7f4a6c0fc450 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.239+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c10b840 con 0x7f4a6c0fc450 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.240+0000 7f4a69ffb700 1 -- 172.21.15.152:0/3249941296 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f4a64003040 con 0x7f4a6c0fc450 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.240+0000 7f4a69ffb700 1 --2- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4a54032610 0x7f4a54034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.240+0000 7f4a69ffb700 1 -- 172.21.15.152:0/3249941296 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f4a64044060 con 0x7f4a6c0fc450 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.240+0000 7f4a6bfff700 1 --2- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4a54032610 0x7f4a54034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.241+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c0fdbc0 con 0x7f4a6c0fc450 2024-04-06T12:14:08.241 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.241+0000 7f4a6bfff700 1 --2- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4a54032610 0x7f4a54034ad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f4a60009780 tx=0x7f4a60006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:08.244 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.245+0000 7f4a69ffb700 1 -- 172.21.15.152:0/3249941296 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4a640077e0 con 0x7f4a6c0fc450 2024-04-06T12:14:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:07.038716+0000 mgr.smithi152.lynahm (mgr.14116) 19 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:07.039538+0000 mgr.smithi152.lynahm (mgr.14116) 20 : cephadm [INF] Saving service grafana spec with placement count:1 2024-04-06T12:14:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:07.041863+0000 mon.smithi152 (mon.0) 62 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:08.416 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.418+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a6c0fdd80 con 0x7f4a54032610 2024-04-06T12:14:08.420 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.422+0000 7f4a69ffb700 1 -- 172.21.15.152:0/3249941296 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f4a6c0fdd80 con 0x7f4a54032610 2024-04-06T12:14:08.421 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2024-04-06T12:14:08.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.424+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4a54032610 msgr2=0x7f4a54034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:08.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.424+0000 7f4a72b38700 1 --2- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4a54032610 0x7f4a54034ad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f4a60009780 tx=0x7f4a60006cc0).stop 2024-04-06T12:14:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.424+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 msgr2=0x7f4a6c10ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.424+0000 7f4a72b38700 1 --2- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c10ad40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4a64014ff0 tx=0x7f4a64009840).stop 2024-04-06T12:14:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.424+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 shutdown_connections 2024-04-06T12:14:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.424+0000 7f4a72b38700 1 --2- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4a54032610 0x7f4a54034ad0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.424+0000 7f4a72b38700 1 --2- 172.21.15.152:0/3249941296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a6c0fc450 0x7f4a6c10ad40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.424+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 >> 172.21.15.152:0/3249941296 conn(0x7f4a6c0f6e20 msgr2=0x7f4a6c0f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.425+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 shutdown_connections 2024-04-06T12:14:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:08.425+0000 7f4a72b38700 1 -- 172.21.15.152:0/3249941296 wait complete. 2024-04-06T12:14:09.028 INFO:teuthology.orchestra.run.smithi152.stderr:Deploying alertmanager service with default placement... 2024-04-06T12:14:09.659 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.619+0000 7fcbff7db700 1 Processor -- start 2024-04-06T12:14:09.659 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.619+0000 7fcbff7db700 1 -- start start 2024-04-06T12:14:09.659 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.619+0000 7fcbff7db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:09.659 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.619+0000 7fcbff7db700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf80fc7e0 con 0x7fcbf80fbed0 2024-04-06T12:14:09.659 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.619+0000 7fcbfd577700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:09.659 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.619+0000 7fcbfd577700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf80fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34328/0 (socket says 172.21.15.152:34328) 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.619+0000 7fcbfd577700 1 -- 172.21.15.152:0/3459442444 learned_addr learned my addr 172.21.15.152:0/3459442444 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.619+0000 7fcbfd577700 1 -- 172.21.15.152:0/3459442444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf80fc920 con 0x7fcbf80fbed0 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbfd577700 1 --2- 172.21.15.152:0/3459442444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf80fc2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fcbf4009730 tx=0x7fcbf40090f0).ready entity=mon.0 client_cookie=904df3a81a39c620 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbeffff700 1 -- 172.21.15.152:0/3459442444 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbf400b6e0 con 0x7fcbf80fbed0 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbeffff700 1 -- 172.21.15.152:0/3459442444 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fcbf400bcd0 con 0x7fcbf80fbed0 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbeffff700 1 -- 172.21.15.152:0/3459442444 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbf4011cb0 con 0x7fcbf80fbed0 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbff7db700 1 -- 172.21.15.152:0/3459442444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 msgr2=0x7fcbf80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbff7db700 1 --2- 172.21.15.152:0/3459442444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf80fc2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fcbf4009730 tx=0x7fcbf40090f0).stop 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbff7db700 1 -- 172.21.15.152:0/3459442444 shutdown_connections 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbff7db700 1 --2- 172.21.15.152:0/3459442444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf80fc2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbff7db700 1 -- 172.21.15.152:0/3459442444 >> 172.21.15.152:0/3459442444 conn(0x7fcbf80f76f0 msgr2=0x7fcbf80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbff7db700 1 -- 172.21.15.152:0/3459442444 shutdown_connections 2024-04-06T12:14:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.620+0000 7fcbff7db700 1 -- 172.21.15.152:0/3459442444 wait complete. 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.621+0000 7fcbff7db700 1 Processor -- start 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.621+0000 7fcbff7db700 1 -- start start 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.621+0000 7fcbff7db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf810be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.621+0000 7fcbff7db700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf810c320 con 0x7fcbf80fbed0 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.621+0000 7fcbfd577700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf810be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.621+0000 7fcbfd577700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf810be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34340/0 (socket says 172.21.15.152:34340) 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.621+0000 7fcbfd577700 1 -- 172.21.15.152:0/2677863212 learned_addr learned my addr 172.21.15.152:0/2677863212 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.622+0000 7fcbfd577700 1 -- 172.21.15.152:0/2677863212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf4009370 con 0x7fcbf80fbed0 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.622+0000 7fcbfd577700 1 --2- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf810be30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcbf4002f40 tx=0x7fcbf40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.622+0000 7fcbee7fc700 1 -- 172.21.15.152:0/2677863212 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbf401a590 con 0x7fcbf80fbed0 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.622+0000 7fcbee7fc700 1 -- 172.21.15.152:0/2677863212 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fcbf401ab80 con 0x7fcbf80fbed0 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.622+0000 7fcbee7fc700 1 -- 172.21.15.152:0/2677863212 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbf4022aa0 con 0x7fcbf80fbed0 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.622+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf810c520 con 0x7fcbf80fbed0 2024-04-06T12:14:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.622+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf810c930 con 0x7fcbf80fbed0 2024-04-06T12:14:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.623+0000 7fcbee7fc700 1 -- 172.21.15.152:0/2677863212 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fcbf4022d60 con 0x7fcbf80fbed0 2024-04-06T12:14:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.623+0000 7fcbee7fc700 1 --2- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fcbe4032610 0x7fcbe4034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.623+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf8046ce0 con 0x7fcbf80fbed0 2024-04-06T12:14:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.623+0000 7fcbee7fc700 1 -- 172.21.15.152:0/2677863212 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fcbf4044b30 con 0x7fcbf80fbed0 2024-04-06T12:14:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.623+0000 7fcbfcd76700 1 --2- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fcbe4032610 0x7fcbe4034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.623+0000 7fcbfcd76700 1 --2- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fcbe4032610 0x7fcbe4034ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fcbe8009780 tx=0x7fcbe8006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.627+0000 7fcbee7fc700 1 -- 172.21.15.152:0/2677863212 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcbf4018500 con 0x7fcbf80fbed0 2024-04-06T12:14:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:08.419796+0000 mgr.smithi152.lynahm (mgr.14116) 21 : audit [DBG] from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:08.420677+0000 mgr.smithi152.lynahm (mgr.14116) 22 : cephadm [INF] Saving service node-exporter spec with placement * 2024-04-06T12:14:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:08.423030+0000 mon.smithi152 (mon.0) 63 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:09.798 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.801+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbf810d130 con 0x7fcbe4032610 2024-04-06T12:14:09.802 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.805+0000 7fcbee7fc700 1 -- 172.21.15.152:0/2677863212 <== mgr.14116 v2:172.21.15.152:6800/1790713151 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fcbf810d130 con 0x7fcbe4032610 2024-04-06T12:14:09.802 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2024-04-06T12:14:09.805 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fcbe4032610 msgr2=0x7fcbe4034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:09.805 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 --2- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fcbe4032610 0x7fcbe4034ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fcbe8009780 tx=0x7fcbe8006cc0).stop 2024-04-06T12:14:09.805 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 msgr2=0x7fcbf810be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:09.805 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 --2- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf810be30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcbf4002f40 tx=0x7fcbf40090f0).stop 2024-04-06T12:14:09.806 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 shutdown_connections 2024-04-06T12:14:09.806 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 --2- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fcbe4032610 0x7fcbe4034ad0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:09.806 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 --2- 172.21.15.152:0/2677863212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf80fbed0 0x7fcbf810be30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:09.806 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 >> 172.21.15.152:0/2677863212 conn(0x7fcbf80f76f0 msgr2=0x7fcbf8071890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:09.806 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 shutdown_connections 2024-04-06T12:14:09.806 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:09.807+0000 7fcbff7db700 1 -- 172.21.15.152:0/2677863212 wait complete. 2024-04-06T12:14:11.001 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.984+0000 7fec11d91700 1 Processor -- start 2024-04-06T12:14:11.001 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.984+0000 7fec11d91700 1 -- start start 2024-04-06T12:14:11.001 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.984+0000 7fec11d91700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c0ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:11.001 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.984+0000 7fec11d91700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c071fa0 con 0x7fec0c071b80 2024-04-06T12:14:11.001 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.984+0000 7fec0b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c0ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:11.001 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.984+0000 7fec0b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c0ffd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34346/0 (socket says 172.21.15.152:34346) 2024-04-06T12:14:11.001 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.984+0000 7fec0b7fe700 1 -- 172.21.15.152:0/4039687984 learned_addr learned my addr 172.21.15.152:0/4039687984 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:11.001 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.984+0000 7fec0b7fe700 1 -- 172.21.15.152:0/4039687984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c100200 con 0x7fec0c071b80 2024-04-06T12:14:11.001 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.984+0000 7fec0b7fe700 1 --2- 172.21.15.152:0/4039687984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c0ffd10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7febfc009730 tx=0x7febfc0090f0).ready entity=mon.0 client_cookie=1a56acd9f784b3e server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec0a7fc700 1 -- 172.21.15.152:0/4039687984 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febfc00b6e0 con 0x7fec0c071b80 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec0a7fc700 1 -- 172.21.15.152:0/4039687984 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7febfc00bcd0 con 0x7fec0c071b80 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec0a7fc700 1 -- 172.21.15.152:0/4039687984 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febfc011cb0 con 0x7fec0c071b80 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec11d91700 1 -- 172.21.15.152:0/4039687984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 msgr2=0x7fec0c0ffd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec11d91700 1 --2- 172.21.15.152:0/4039687984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c0ffd10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7febfc009730 tx=0x7febfc0090f0).stop 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec11d91700 1 -- 172.21.15.152:0/4039687984 shutdown_connections 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec11d91700 1 --2- 172.21.15.152:0/4039687984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c0ffd10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec11d91700 1 -- 172.21.15.152:0/4039687984 >> 172.21.15.152:0/4039687984 conn(0x7fec0c0f76f0 msgr2=0x7fec0c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec11d91700 1 -- 172.21.15.152:0/4039687984 shutdown_connections 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.985+0000 7fec11d91700 1 -- 172.21.15.152:0/4039687984 wait complete. 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.986+0000 7fec11d91700 1 Processor -- start 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.986+0000 7fec11d91700 1 -- start start 2024-04-06T12:14:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.986+0000 7fec11d91700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c10bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.986+0000 7fec11d91700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c10c3b0 con 0x7fec0c071b80 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.986+0000 7fec0b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c10bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.986+0000 7fec0b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c10bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34362/0 (socket says 172.21.15.152:34362) 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.986+0000 7fec0b7fe700 1 -- 172.21.15.152:0/1102613882 learned_addr learned my addr 172.21.15.152:0/1102613882 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.986+0000 7fec0b7fe700 1 -- 172.21.15.152:0/1102613882 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc009370 con 0x7fec0c071b80 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.987+0000 7fec0b7fe700 1 --2- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c10bec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7febfc0118b0 tx=0x7febfc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.987+0000 7fec08ff9700 1 -- 172.21.15.152:0/1102613882 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febfc00be40 con 0x7fec0c071b80 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.987+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c10c5b0 con 0x7fec0c071b80 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.987+0000 7fec08ff9700 1 -- 172.21.15.152:0/1102613882 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7febfc01aad0 con 0x7fec0c071b80 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.987+0000 7fec08ff9700 1 -- 172.21.15.152:0/1102613882 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febfc023a80 con 0x7fec0c071b80 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.987+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c10c9c0 con 0x7fec0c071b80 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.987+0000 7fec08ff9700 1 -- 172.21.15.152:0/1102613882 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7febfc023cc0 con 0x7fec0c071b80 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.988+0000 7fec08ff9700 1 --2- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7febf4032610 0x7febf4034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.988+0000 7fec08ff9700 1 -- 172.21.15.152:0/1102613882 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7febfc044850 con 0x7fec0c071b80 2024-04-06T12:14:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.988+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c046ce0 con 0x7fec0c071b80 2024-04-06T12:14:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.988+0000 7fec0affd700 1 --2- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7febf4032610 0x7febf4034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.988+0000 7fec0affd700 1 --2- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7febf4032610 0x7febf4034ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fec00009780 tx=0x7fec00006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:10.992+0000 7fec08ff9700 1 -- 172.21.15.152:0/1102613882 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7febfc01e070 con 0x7fec0c071b80 2024-04-06T12:14:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:09.220272+0000 mgr.smithi152.lynahm (mgr.14116) 23 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:09.801780+0000 mgr.smithi152.lynahm (mgr.14116) 24 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:09.802629+0000 mgr.smithi152.lynahm (mgr.14116) 25 : cephadm [INF] Saving service alertmanager spec with placement count:1 2024-04-06T12:14:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:09.804855+0000 mon.smithi152 (mon.0) 64 : audit [INF] from='mgr.14116 172.21.15.152:0/3724196575' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:11.156 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.159+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fec0c100f80 con 0x7fec0c071b80 2024-04-06T12:14:11.159 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.162+0000 7fec08ff9700 1 -- 172.21.15.152:0/1102613882 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7febfc021320 con 0x7fec0c071b80 2024-04-06T12:14:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7febf4032610 msgr2=0x7febf4034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 --2- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7febf4032610 0x7febf4034ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fec00009780 tx=0x7fec00006cc0).stop 2024-04-06T12:14:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 msgr2=0x7fec0c10bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 --2- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c10bec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7febfc0118b0 tx=0x7febfc0090f0).stop 2024-04-06T12:14:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 shutdown_connections 2024-04-06T12:14:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 --2- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7febf4032610 0x7febf4034ad0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 --2- 172.21.15.152:0/1102613882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec0c071b80 0x7fec0c10bec0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 >> 172.21.15.152:0/1102613882 conn(0x7fec0c0f76f0 msgr2=0x7fec0c0f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 shutdown_connections 2024-04-06T12:14:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:11.164+0000 7fec11d91700 1 -- 172.21.15.152:0/1102613882 wait complete. 2024-04-06T12:14:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.421+0000 7f953bcd6700 1 Processor -- start 2024-04-06T12:14:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.421+0000 7f953bcd6700 1 -- start start 2024-04-06T12:14:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.421+0000 7f953bcd6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.421+0000 7f953bcd6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9534100180 con 0x7f9534071c40 2024-04-06T12:14:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.421+0000 7f9539a72700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.421+0000 7f9539a72700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34226/0 (socket says 172.21.15.152:34226) 2024-04-06T12:14:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.421+0000 7f9539a72700 1 -- 172.21.15.152:0/64274685 learned_addr learned my addr 172.21.15.152:0/64274685 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.422+0000 7f9539a72700 1 -- 172.21.15.152:0/64274685 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95341002c0 con 0x7f9534071c40 2024-04-06T12:14:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.422+0000 7f9539a72700 1 --2- 172.21.15.152:0/64274685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340ffc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9530009730 tx=0x7f95300090f0).ready entity=mon.0 client_cookie=1790c96966eb8ed2 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.422+0000 7f9538a70700 1 -- 172.21.15.152:0/64274685 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f953000b6e0 con 0x7f9534071c40 2024-04-06T12:14:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.422+0000 7f9538a70700 1 -- 172.21.15.152:0/64274685 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f953000bcd0 con 0x7f9534071c40 2024-04-06T12:14:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.422+0000 7f9538a70700 1 -- 172.21.15.152:0/64274685 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9530011cb0 con 0x7f9534071c40 2024-04-06T12:14:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.422+0000 7f953bcd6700 1 -- 172.21.15.152:0/64274685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 msgr2=0x7f95340ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.422+0000 7f953bcd6700 1 --2- 172.21.15.152:0/64274685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340ffc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9530009730 tx=0x7f95300090f0).stop 2024-04-06T12:14:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.423+0000 7f953bcd6700 1 -- 172.21.15.152:0/64274685 shutdown_connections 2024-04-06T12:14:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.423+0000 7f953bcd6700 1 --2- 172.21.15.152:0/64274685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340ffc90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.423+0000 7f953bcd6700 1 -- 172.21.15.152:0/64274685 >> 172.21.15.152:0/64274685 conn(0x7f95340f7750 msgr2=0x7f95340f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.423+0000 7f953bcd6700 1 -- 172.21.15.152:0/64274685 shutdown_connections 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.423+0000 7f953bcd6700 1 -- 172.21.15.152:0/64274685 wait complete. 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.423+0000 7f953bcd6700 1 Processor -- start 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.423+0000 7f953bcd6700 1 -- start start 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.423+0000 7f953bcd6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340fd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.423+0000 7f953bcd6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95340fbb90 con 0x7f9534071c40 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f9539a72700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f9539a72700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340fd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34236/0 (socket says 172.21.15.152:34236) 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f9539a72700 1 -- 172.21.15.152:0/575442660 learned_addr learned my addr 172.21.15.152:0/575442660 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f9539a72700 1 -- 172.21.15.152:0/575442660 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530009370 con 0x7f9534071c40 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f9539a72700 1 --2- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340fd710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f9530012fc0 tx=0x7f95300090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f952affd700 1 -- 172.21.15.152:0/575442660 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f953001a640 con 0x7f9534071c40 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f952affd700 1 -- 172.21.15.152:0/575442660 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f953001ac30 con 0x7f9534071c40 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95340fbd30 con 0x7f9534071c40 2024-04-06T12:14:12.425 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f952affd700 1 -- 172.21.15.152:0/575442660 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9530023c90 con 0x7f9534071c40 2024-04-06T12:14:12.426 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.424+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95340fc140 con 0x7f9534071c40 2024-04-06T12:14:12.427 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.425+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9534046ce0 con 0x7f9534071c40 2024-04-06T12:14:12.427 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.425+0000 7f952affd700 1 -- 172.21.15.152:0/575442660 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f9530023410 con 0x7f9534071c40 2024-04-06T12:14:12.427 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.425+0000 7f952affd700 1 --2- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f9520032610 0x7f9520034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:12.427 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.425+0000 7f952affd700 1 -- 172.21.15.152:0/575442660 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f95300449c0 con 0x7f9534071c40 2024-04-06T12:14:12.427 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.426+0000 7f9539271700 1 --2- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f9520032610 0x7f9520034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:12.427 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.426+0000 7f9539271700 1 --2- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f9520032610 0x7f9520034ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9524009780 tx=0x7f9524006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:12.428 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.430+0000 7f952affd700 1 -- 172.21.15.152:0/575442660 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9530019570 con 0x7f9534071c40 2024-04-06T12:14:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:11.161999+0000 mon.smithi152 (mon.0) 65 : audit [INF] from='client.? 172.21.15.152:0/1102613882' entity='client.admin' 2024-04-06T12:14:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:11.220525+0000 mgr.smithi152.lynahm (mgr.14116) 26 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:12.592 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.593+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f9534100f80 con 0x7f9534071c40 2024-04-06T12:14:12.595 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.596+0000 7f952affd700 1 -- 172.21.15.152:0/575442660 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f953001e020 con 0x7f9534071c40 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f9520032610 msgr2=0x7f9520034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 --2- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f9520032610 0x7f9520034ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9524009780 tx=0x7f9524006cc0).stop 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 msgr2=0x7f95340fd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 --2- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340fd710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f9530012fc0 tx=0x7f95300090f0).stop 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 shutdown_connections 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 --2- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f9520032610 0x7f9520034ad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 --2- 172.21.15.152:0/575442660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9534071c40 0x7f95340fd710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 >> 172.21.15.152:0/575442660 conn(0x7f95340f7750 msgr2=0x7f95340f9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 shutdown_connections 2024-04-06T12:14:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:12.598+0000 7f953bcd6700 1 -- 172.21.15.152:0/575442660 wait complete. 2024-04-06T12:14:13.220 INFO:teuthology.orchestra.run.smithi152.stderr:Enabling the dashboard module... 2024-04-06T12:14:13.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:13 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:12.597449+0000 mon.smithi152 (mon.0) 66 : audit [INF] from='client.? 172.21.15.152:0/575442660' entity='client.admin' 2024-04-06T12:14:13.792 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.789+0000 7f4880675700 1 Processor -- start 2024-04-06T12:14:13.792 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.789+0000 7f4880675700 1 -- start start 2024-04-06T12:14:13.792 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.789+0000 7f4880675700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f48780fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:13.792 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.789+0000 7f4880675700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780fc7e0 con 0x7f48780fbed0 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.789+0000 7f487e411700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f48780fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.789+0000 7f487e411700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f48780fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34252/0 (socket says 172.21.15.152:34252) 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.789+0000 7f487e411700 1 -- 172.21.15.152:0/1290899797 learned_addr learned my addr 172.21.15.152:0/1290899797 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.790+0000 7f487e411700 1 -- 172.21.15.152:0/1290899797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48780fc920 con 0x7f48780fbed0 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.790+0000 7f487e411700 1 --2- 172.21.15.152:0/1290899797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f48780fc2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4874009730 tx=0x7f48740090f0).ready entity=mon.0 client_cookie=e0b43de3afc906e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.790+0000 7f487d40f700 1 -- 172.21.15.152:0/1290899797 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f487400b6e0 con 0x7f48780fbed0 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.790+0000 7f487d40f700 1 -- 172.21.15.152:0/1290899797 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f487400bcd0 con 0x7f48780fbed0 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.790+0000 7f487d40f700 1 -- 172.21.15.152:0/1290899797 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4874011cb0 con 0x7f48780fbed0 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.790+0000 7f4880675700 1 -- 172.21.15.152:0/1290899797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 msgr2=0x7f48780fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:13.793 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 --2- 172.21.15.152:0/1290899797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f48780fc2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4874009730 tx=0x7f48740090f0).stop 2024-04-06T12:14:13.794 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 -- 172.21.15.152:0/1290899797 shutdown_connections 2024-04-06T12:14:13.794 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 --2- 172.21.15.152:0/1290899797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f48780fc2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:13.794 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 -- 172.21.15.152:0/1290899797 >> 172.21.15.152:0/1290899797 conn(0x7f48780f76f0 msgr2=0x7f48780f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:13.794 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 -- 172.21.15.152:0/1290899797 shutdown_connections 2024-04-06T12:14:13.794 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 -- 172.21.15.152:0/1290899797 wait complete. 2024-04-06T12:14:13.794 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 Processor -- start 2024-04-06T12:14:13.794 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 -- start start 2024-04-06T12:14:13.794 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f4878109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.791+0000 7f4880675700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487810a0f0 con 0x7f48780fbed0 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f487e411700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f4878109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f487e411700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f4878109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34266/0 (socket says 172.21.15.152:34266) 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f487e411700 1 -- 172.21.15.152:0/977563507 learned_addr learned my addr 172.21.15.152:0/977563507 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f487e411700 1 -- 172.21.15.152:0/977563507 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874009370 con 0x7f48780fbed0 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f487e411700 1 --2- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f4878109c00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f48740118b0 tx=0x7f48740090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f486f7fe700 1 -- 172.21.15.152:0/977563507 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f487400be40 con 0x7f48780fbed0 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f486f7fe700 1 -- 172.21.15.152:0/977563507 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f487400bad0 con 0x7f48780fbed0 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487810a2f0 con 0x7f48780fbed0 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f486f7fe700 1 -- 172.21.15.152:0/977563507 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f487401aaa0 con 0x7f48780fbed0 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.792+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487810a700 con 0x7f48780fbed0 2024-04-06T12:14:13.795 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.793+0000 7f486f7fe700 1 -- 172.21.15.152:0/977563507 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f487401ad20 con 0x7f48780fbed0 2024-04-06T12:14:13.796 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.793+0000 7f486f7fe700 1 --2- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4864034860 0x7f4864036d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:13.796 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.793+0000 7f486f7fe700 1 -- 172.21.15.152:0/977563507 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f4874044d10 con 0x7f48780fbed0 2024-04-06T12:14:13.796 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.793+0000 7f487dc10700 1 --2- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4864034860 0x7f4864036d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:13.796 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.793+0000 7f487dc10700 1 --2- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4864034860 0x7f4864036d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4868009780 tx=0x7f4868006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:13.796 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.794+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487805a310 con 0x7f48780fbed0 2024-04-06T12:14:13.796 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:13.798+0000 7f486f7fe700 1 -- 172.21.15.152:0/977563507 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f487401e070 con 0x7f48780fbed0 2024-04-06T12:14:13.999 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.000+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f4878046ce0 con 0x7f48780fbed0 2024-04-06T12:14:14.597 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.598+0000 7f486f7fe700 1 -- 172.21.15.152:0/977563507 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f4874019390 con 0x7f48780fbed0 2024-04-06T12:14:14.598 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.600+0000 7f486f7fe700 1 -- 172.21.15.152:0/977563507 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f4874019dc0 con 0x7f48780fbed0 2024-04-06T12:14:14.601 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4864034860 msgr2=0x7f4864036d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:14.601 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 --2- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4864034860 0x7f4864036d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4868009780 tx=0x7f4868006cc0).stop 2024-04-06T12:14:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 msgr2=0x7f4878109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 --2- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f4878109c00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f48740118b0 tx=0x7f48740090f0).stop 2024-04-06T12:14:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 shutdown_connections 2024-04-06T12:14:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 --2- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7f4864034860 0x7f4864036d20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 --2- 172.21.15.152:0/977563507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48780fbed0 0x7f4878109c00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 >> 172.21.15.152:0/977563507 conn(0x7f48780f76f0 msgr2=0x7f4878100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 shutdown_connections 2024-04-06T12:14:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:14.602+0000 7f4880675700 1 -- 172.21.15.152:0/977563507 wait complete. 2024-04-06T12:14:14.967 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:13.220797+0000 mgr.smithi152.lynahm (mgr.14116) 27 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:14.967 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:14.001683+0000 mon.smithi152 (mon.0) 67 : audit [INF] from='client.? 172.21.15.152:0/977563507' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-06T12:14:15.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:14.601121+0000 mon.smithi152 (mon.0) 68 : audit [INF] from='client.? 172.21.15.152:0/977563507' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-06T12:14:15.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:14.601175+0000 mon.smithi152 (mon.0) 69 : cluster [DBG] mgrmap e9: smithi152.lynahm(active, since 25s) 2024-04-06T12:14:16.087 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.086+0000 7fbf73875700 1 Processor -- start 2024-04-06T12:14:16.087 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.086+0000 7fbf73875700 1 -- start start 2024-04-06T12:14:16.087 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.086+0000 7fbf73875700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c0fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.086+0000 7fbf73875700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0fc7e0 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.087+0000 7fbf71611700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c0fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.087+0000 7fbf71611700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c0fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34288/0 (socket says 172.21.15.152:34288) 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.087+0000 7fbf71611700 1 -- 172.21.15.152:0/961885702 learned_addr learned my addr 172.21.15.152:0/961885702 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.087+0000 7fbf71611700 1 -- 172.21.15.152:0/961885702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c0fc920 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.087+0000 7fbf71611700 1 --2- 172.21.15.152:0/961885702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c0fc2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fbf68009730 tx=0x7fbf680090f0).ready entity=mon.0 client_cookie=92644923a26d33d server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.087+0000 7fbf63fff700 1 -- 172.21.15.152:0/961885702 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf6800b6e0 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.087+0000 7fbf63fff700 1 -- 172.21.15.152:0/961885702 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbf6800bcd0 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.087+0000 7fbf63fff700 1 -- 172.21.15.152:0/961885702 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf68011cb0 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.088+0000 7fbf73875700 1 -- 172.21.15.152:0/961885702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 msgr2=0x7fbf6c0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.088+0000 7fbf73875700 1 --2- 172.21.15.152:0/961885702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c0fc2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fbf68009730 tx=0x7fbf680090f0).stop 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.088+0000 7fbf73875700 1 -- 172.21.15.152:0/961885702 shutdown_connections 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.088+0000 7fbf73875700 1 --2- 172.21.15.152:0/961885702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c0fc2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:16.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.088+0000 7fbf73875700 1 -- 172.21.15.152:0/961885702 >> 172.21.15.152:0/961885702 conn(0x7fbf6c0f76f0 msgr2=0x7fbf6c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:16.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.088+0000 7fbf73875700 1 -- 172.21.15.152:0/961885702 shutdown_connections 2024-04-06T12:14:16.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.088+0000 7fbf73875700 1 -- 172.21.15.152:0/961885702 wait complete. 2024-04-06T12:14:16.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.089+0000 7fbf73875700 1 Processor -- start 2024-04-06T12:14:16.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.089+0000 7fbf73875700 1 -- start start 2024-04-06T12:14:16.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.089+0000 7fbf73875700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:16.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.089+0000 7fbf73875700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c10a0b0 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.089+0000 7fbf71611700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:16.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.090+0000 7fbf71611700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34298/0 (socket says 172.21.15.152:34298) 2024-04-06T12:14:16.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.090+0000 7fbf71611700 1 -- 172.21.15.152:0/2664756172 learned_addr learned my addr 172.21.15.152:0/2664756172 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:16.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.090+0000 7fbf71611700 1 -- 172.21.15.152:0/2664756172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68009370 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.090+0000 7fbf71611700 1 --2- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c109bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbf68002f40 tx=0x7fbf680090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.090+0000 7fbf627fc700 1 -- 172.21.15.152:0/2664756172 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf6801a590 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.090+0000 7fbf627fc700 1 -- 172.21.15.152:0/2664756172 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbf6801ab80 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.090+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6c10a2b0 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.090+0000 7fbf627fc700 1 -- 172.21.15.152:0/2664756172 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf68022aa0 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.090+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c10a6c0 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.091+0000 7fbf627fc700 1 -- 172.21.15.152:0/2664756172 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7fbf68022d20 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.091+0000 7fbf627fc700 1 --2- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fbf580348b0 0x7fbf58036d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.091+0000 7fbf627fc700 1 -- 172.21.15.152:0/2664756172 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fbf68044b20 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.091+0000 7fbf70e10700 1 -- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fbf580348b0 msgr2=0x7fbf58036d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1790713151 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.091+0000 7fbf70e10700 1 --2- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fbf580348b0 0x7fbf58036d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:14:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.091+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c05a310 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.095 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.096+0000 7fbf627fc700 1 -- 172.21.15.152:0/2664756172 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbf6801e020 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.290 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.292+0000 7fbf70e10700 1 -- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fbf580348b0 msgr2=0x7fbf58036d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1790713151 2024-04-06T12:14:16.291 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.292+0000 7fbf70e10700 1 --2- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fbf580348b0 0x7fbf58036d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-04-06T12:14:16.310 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.310+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fbf6c103950 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.310 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.311+0000 7fbf627fc700 1 -- 172.21.15.152:0/2664756172 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fbf68018d80 con 0x7fbf6c0fbed0 2024-04-06T12:14:16.310 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: { 2024-04-06T12:14:16.310 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "epoch": 9, 2024-04-06T12:14:16.310 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "available": true, 2024-04-06T12:14:16.310 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "active_name": "smithi152.lynahm", 2024-04-06T12:14:16.310 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "num_standby": 0 2024-04-06T12:14:16.310 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: } 2024-04-06T12:14:16.312 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fbf580348b0 msgr2=0x7fbf58036d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T12:14:16.312 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 --2- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fbf580348b0 0x7fbf58036d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:14:16.312 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 msgr2=0x7fbf6c109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:16.312 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 --2- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c109bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbf68002f40 tx=0x7fbf680090f0).stop 2024-04-06T12:14:16.312 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 shutdown_connections 2024-04-06T12:14:16.312 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 --2- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7fbf580348b0 0x7fbf58036d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:14:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 --2- 172.21.15.152:0/2664756172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf6c0fbed0 0x7fbf6c109bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 >> 172.21.15.152:0/2664756172 conn(0x7fbf6c0f76f0 msgr2=0x7fbf6c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 shutdown_connections 2024-04-06T12:14:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:16.313+0000 7fbf73875700 1 -- 172.21.15.152:0/2664756172 wait complete. 2024-04-06T12:14:16.846 INFO:teuthology.orchestra.run.smithi152.stderr:Waiting for the mgr to restart... 2024-04-06T12:14:16.846 INFO:teuthology.orchestra.run.smithi152.stderr:Waiting for mgr epoch 9... 2024-04-06T12:14:17.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:16.312124+0000 mon.smithi152 (mon.0) 70 : audit [DBG] from='client.? 172.21.15.152:0/2664756172' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-06T12:14:17.461 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.459+0000 7ff8ff4da700 1 Processor -- start 2024-04-06T12:14:17.461 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.459+0000 7ff8ff4da700 1 -- start start 2024-04-06T12:14:17.461 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.459+0000 7ff8ff4da700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:17.461 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.459+0000 7ff8ff4da700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f80fc7e0 con 0x7ff8f80fbed0 2024-04-06T12:14:17.461 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.460+0000 7ff8fd276700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.460+0000 7ff8fd276700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f80fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34310/0 (socket says 172.21.15.152:34310) 2024-04-06T12:14:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.460+0000 7ff8fd276700 1 -- 172.21.15.152:0/633802442 learned_addr learned my addr 172.21.15.152:0/633802442 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.460+0000 7ff8fd276700 1 -- 172.21.15.152:0/633802442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f80fc920 con 0x7ff8f80fbed0 2024-04-06T12:14:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.460+0000 7ff8fd276700 1 --2- 172.21.15.152:0/633802442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f80fc2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff8f4009730 tx=0x7ff8f40090f0).ready entity=mon.0 client_cookie=8afd7199de66fea1 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.460+0000 7ff8effff700 1 -- 172.21.15.152:0/633802442 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8f400b6e0 con 0x7ff8f80fbed0 2024-04-06T12:14:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.460+0000 7ff8effff700 1 -- 172.21.15.152:0/633802442 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff8f400bcd0 con 0x7ff8f80fbed0 2024-04-06T12:14:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.460+0000 7ff8effff700 1 -- 172.21.15.152:0/633802442 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8f4011cb0 con 0x7ff8f80fbed0 2024-04-06T12:14:17.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.461+0000 7ff8ff4da700 1 -- 172.21.15.152:0/633802442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 msgr2=0x7ff8f80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:17.464 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.461+0000 7ff8ff4da700 1 --2- 172.21.15.152:0/633802442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f80fc2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff8f4009730 tx=0x7ff8f40090f0).stop 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.461+0000 7ff8ff4da700 1 -- 172.21.15.152:0/633802442 shutdown_connections 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.461+0000 7ff8ff4da700 1 --2- 172.21.15.152:0/633802442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f80fc2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.461+0000 7ff8ff4da700 1 -- 172.21.15.152:0/633802442 >> 172.21.15.152:0/633802442 conn(0x7ff8f80f76f0 msgr2=0x7ff8f80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.461+0000 7ff8ff4da700 1 -- 172.21.15.152:0/633802442 shutdown_connections 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.461+0000 7ff8ff4da700 1 -- 172.21.15.152:0/633802442 wait complete. 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.462+0000 7ff8ff4da700 1 Processor -- start 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.462+0000 7ff8ff4da700 1 -- start start 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.462+0000 7ff8ff4da700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f810ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.462+0000 7ff8ff4da700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8071ce0 con 0x7ff8f80fbed0 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.462+0000 7ff8fd276700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f810ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.462+0000 7ff8fd276700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f810ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34324/0 (socket says 172.21.15.152:34324) 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.462+0000 7ff8fd276700 1 -- 172.21.15.152:0/2279186740 learned_addr learned my addr 172.21.15.152:0/2279186740 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.462+0000 7ff8fd276700 1 -- 172.21.15.152:0/2279186740 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f4009370 con 0x7ff8f80fbed0 2024-04-06T12:14:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.463+0000 7ff8fd276700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f810ead0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff8f4002f40 tx=0x7ff8f40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.463+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8f401a590 con 0x7ff8f80fbed0 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.463+0000 7ff8ff4da700 1 -- 172.21.15.152:0/2279186740 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f8071ee0 con 0x7ff8f80fbed0 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.463+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff8f401ab80 con 0x7ff8f80fbed0 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.463+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8f4022aa0 con 0x7ff8f80fbed0 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.463+0000 7ff8ff4da700 1 -- 172.21.15.152:0/2279186740 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f810f180 con 0x7ff8f80fbed0 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.464+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7ff8f4022d30 con 0x7ff8f80fbed0 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.464+0000 7ff8ee7fc700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 0x7ff8e4034b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.464+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 --> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8e4035230 con 0x7ff8e40326b0 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.464+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7ff8f4044b50 con 0x7ff8f80fbed0 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.464+0000 7ff8fca75700 1 -- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 msgr2=0x7ff8e4034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1790713151 2024-04-06T12:14:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.464+0000 7ff8fca75700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 0x7ff8e4034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:14:17.664 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.665+0000 7ff8fca75700 1 -- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 msgr2=0x7ff8e4034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1790713151 2024-04-06T12:14:17.664 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:17.665+0000 7ff8fca75700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 0x7ff8e4034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-04-06T12:14:18.064 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:18.066+0000 7ff8fca75700 1 -- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 msgr2=0x7ff8e4034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1790713151 2024-04-06T12:14:18.065 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:18.066+0000 7ff8fca75700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 0x7ff8e4034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-04-06T12:14:18.866 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:18.867+0000 7ff8fca75700 1 -- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 msgr2=0x7ff8e4034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1790713151 2024-04-06T12:14:18.866 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:18.867+0000 7ff8fca75700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 0x7ff8e4034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-04-06T12:14:19.995 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:19.996+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mgrmap(e 10) v1 ==== 38469+0+0 (secure 0 0 0) 0x7ff8f40103a0 con 0x7ff8f80fbed0 2024-04-06T12:14:19.995 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:19.996+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 msgr2=0x7ff8e4034b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T12:14:19.995 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:19.996+0000 7ff8ee7fc700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 0x7ff8e4034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:14:20.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:19.995099+0000 mon.smithi152 (mon.0) 71 : cluster [INF] Active manager daemon smithi152.lynahm restarted 2024-04-06T12:14:20.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:19.995416+0000 mon.smithi152 (mon.0) 72 : cluster [INF] Activating manager daemon smithi152.lynahm 2024-04-06T12:14:20.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:19.998437+0000 mon.smithi152 (mon.0) 73 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-04-06T12:14:20.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:19.998540+0000 mon.smithi152 (mon.0) 74 : cluster [DBG] mgrmap e10: smithi152.lynahm(active, starting, since 0.00326632s) 2024-04-06T12:14:20.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:19.999370+0000 mon.smithi152 (mon.0) 75 : audit [DBG] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:14:20.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:19.999984+0000 mon.smithi152 (mon.0) 76 : audit [DBG] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:14:20.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:20.000719+0000 mon.smithi152 (mon.0) 77 : audit [DBG] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:14:20.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:20.000864+0000 mon.smithi152 (mon.0) 78 : audit [DBG] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:14:20.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:20.000997+0000 mon.smithi152 (mon.0) 79 : audit [DBG] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:14:20.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:20.014967+0000 mon.smithi152 (mon.0) 80 : cluster [INF] Manager daemon smithi152.lynahm is now available 2024-04-06T12:14:20.996 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:20.997+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 11) v1 ==== 38539+0+0 (secure 0 0 0) 0x7ff8f4028060 con 0x7ff8f80fbed0 2024-04-06T12:14:20.996 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:20.997+0000 7ff8ee7fc700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7ff8e4035fe0 0x7ff8e40383d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:20.997 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:20.997+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 --> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8e4035230 con 0x7ff8e4035fe0 2024-04-06T12:14:20.997 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:20.998+0000 7ff8fca75700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7ff8e4035fe0 0x7ff8e40383d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:20.997 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:20.998+0000 7ff8fca75700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7ff8e4035fe0 0x7ff8e40383d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff8e8003850 tx=0x7ff8e8009350).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:20.997 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:20.999+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 <== mgr.14156 v2:172.21.15.152:6800/3882192194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7ff8e4035230 con 0x7ff8e4035fe0 2024-04-06T12:14:21.004 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.005+0000 7ff8ff4da700 1 -- 172.21.15.152:0/2279186740 --> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff8f805a310 con 0x7ff8e4035fe0 2024-04-06T12:14:21.004 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.005+0000 7ff8ee7fc700 1 -- 172.21.15.152:0/2279186740 <== mgr.14156 v2:172.21.15.152:6800/3882192194 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7ff8f805a310 con 0x7ff8e4035fe0 2024-04-06T12:14:21.004 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: { 2024-04-06T12:14:21.005 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-04-06T12:14:21.005 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: "initialized": true 2024-04-06T12:14:21.005 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: } 2024-04-06T12:14:21.005 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 -- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7ff8e4035fe0 msgr2=0x7ff8e40383d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:21.005 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7ff8e4035fe0 0x7ff8e40383d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff8e8003850 tx=0x7ff8e8009350).stop 2024-04-06T12:14:21.005 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 -- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 msgr2=0x7ff8f810ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:21.005 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f810ead0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff8f4002f40 tx=0x7ff8f40090f0).stop 2024-04-06T12:14:21.005 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 -- 172.21.15.152:0/2279186740 shutdown_connections 2024-04-06T12:14:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7ff8e4035fe0 0x7ff8e40383d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8f80fbed0 0x7ff8f810ead0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 --2- 172.21.15.152:0/2279186740 >> [v2:172.21.15.152:6800/1790713151,v1:172.21.15.152:6801/1790713151] conn(0x7ff8e40326b0 0x7ff8e4034b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:14:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 -- 172.21.15.152:0/2279186740 >> 172.21.15.152:0/2279186740 conn(0x7ff8f80f76f0 msgr2=0x7ff8f80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 -- 172.21.15.152:0/2279186740 shutdown_connections 2024-04-06T12:14:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:21.006+0000 7ff8ff4da700 1 -- 172.21.15.152:0/2279186740 wait complete. 2024-04-06T12:14:21.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:20.109956+0000 mon.smithi152 (mon.0) 81 : audit [DBG] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:14:21.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:20.111501+0000 mon.smithi152 (mon.0) 82 : audit [DBG] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:14:21.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:20.138061+0000 mon.smithi152 (mon.0) 83 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:14:21.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:20.141759+0000 mon.smithi152 (mon.0) 84 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/trash_purge_schedule"}]: dispatch 2024-04-06T12:14:21.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:21.000612+0000 mon.smithi152 (mon.0) 85 : cluster [DBG] mgrmap e11: smithi152.lynahm(active, since 1.00534s) 2024-04-06T12:14:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:mgr epoch 9 is available 2024-04-06T12:14:22.141 INFO:teuthology.orchestra.run.smithi152.stderr:Generating a dashboard self-signed certificate... 2024-04-06T12:14:22.144 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:20.999791+0000 mgr.smithi152.lynahm (mgr.14156) 1 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-06T12:14:22.144 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:21.006840+0000 mgr.smithi152.lynahm (mgr.14156) 2 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-06T12:14:22.144 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:21.666452+0000 mon.smithi152 (mon.0) 86 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:22.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.710+0000 7f023aab4700 1 Processor -- start 2024-04-06T12:14:22.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.710+0000 7f023aab4700 1 -- start start 2024-04-06T12:14:22.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f023aab4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f02340fd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:22.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f023aab4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02340fdec0 con 0x7f02340fd5b0 2024-04-06T12:14:22.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f0238850700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f02340fd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:22.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f0238850700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f02340fd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46808/0 (socket says 172.21.15.152:46808) 2024-04-06T12:14:22.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f0238850700 1 -- 172.21.15.152:0/4215653893 learned_addr learned my addr 172.21.15.152:0/4215653893 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:22.722 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f0238850700 1 -- 172.21.15.152:0/4215653893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340fe000 con 0x7f02340fd5b0 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f0238850700 1 --2- 172.21.15.152:0/4215653893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f02340fd9d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0228009730 tx=0x7f02280090f0).ready entity=mon.0 client_cookie=a363423785963f54 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f02337fe700 1 -- 172.21.15.152:0/4215653893 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f022800b6e0 con 0x7f02340fd5b0 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f02337fe700 1 -- 172.21.15.152:0/4215653893 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f022800bcd0 con 0x7f02340fd5b0 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.711+0000 7f02337fe700 1 -- 172.21.15.152:0/4215653893 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0228011cb0 con 0x7f02340fd5b0 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.712+0000 7f023aab4700 1 -- 172.21.15.152:0/4215653893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 msgr2=0x7f02340fd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.712+0000 7f023aab4700 1 --2- 172.21.15.152:0/4215653893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f02340fd9d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0228009730 tx=0x7f02280090f0).stop 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.712+0000 7f023aab4700 1 -- 172.21.15.152:0/4215653893 shutdown_connections 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.712+0000 7f023aab4700 1 --2- 172.21.15.152:0/4215653893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f02340fd9d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.712+0000 7f023aab4700 1 -- 172.21.15.152:0/4215653893 >> 172.21.15.152:0/4215653893 conn(0x7f02340f6e20 msgr2=0x7f02340f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:22.723 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.712+0000 7f023aab4700 1 -- 172.21.15.152:0/4215653893 shutdown_connections 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.712+0000 7f023aab4700 1 -- 172.21.15.152:0/4215653893 wait complete. 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.712+0000 7f023aab4700 1 Processor -- start 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.712+0000 7f023aab4700 1 -- start start 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f023aab4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f023410df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f023aab4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023410e450 con 0x7f02340fd5b0 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f0238850700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f023410df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f0238850700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f023410df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46820/0 (socket says 172.21.15.152:46820) 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f0238850700 1 -- 172.21.15.152:0/1319553902 learned_addr learned my addr 172.21.15.152:0/1319553902 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f0238850700 1 -- 172.21.15.152:0/1319553902 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009370 con 0x7f02340fd5b0 2024-04-06T12:14:22.724 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f0238850700 1 --2- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f023410df60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f0228006ba0 tx=0x7f02280090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f0231f76700 1 -- 172.21.15.152:0/1319553902 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f022801a640 con 0x7f02340fd5b0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023410e650 con 0x7f02340fd5b0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f0231f76700 1 -- 172.21.15.152:0/1319553902 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f022801ac30 con 0x7f02340fd5b0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f0231f76700 1 -- 172.21.15.152:0/1319553902 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0228022b60 con 0x7f02340fd5b0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.713+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023410ea60 con 0x7f02340fd5b0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.714+0000 7f0231f76700 1 -- 172.21.15.152:0/1319553902 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 12) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f02280223b0 con 0x7f02340fd5b0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.714+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0234046ce0 con 0x7f02340fd5b0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.714+0000 7f0231f76700 1 --2- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0224032660 0x7f0224034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.714+0000 7f0231f76700 1 -- 172.21.15.152:0/1319553902 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f0228044c50 con 0x7f02340fd5b0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.715+0000 7f0233fff700 1 --2- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0224032660 0x7f0224034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.715+0000 7f0233fff700 1 --2- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0224032660 0x7f0224034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f0220009780 tx=0x7f0220006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:22.725 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.719+0000 7f0231f76700 1 -- 172.21.15.152:0/1319553902 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f022801ada0 con 0x7f02340fd5b0 2024-04-06T12:14:22.894 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.896+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 --> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f023410f340 con 0x7f0224032660 2024-04-06T12:14:22.984 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.985+0000 7f0231f76700 1 -- 172.21.15.152:0/1319553902 <== mgr.14156 v2:172.21.15.152:6800/3882192194 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f023410f340 con 0x7f0224032660 2024-04-06T12:14:22.984 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: Self-signed certificate created 2024-04-06T12:14:22.986 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0224032660 msgr2=0x7f0224034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:22.986 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 --2- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0224032660 0x7f0224034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f0220009780 tx=0x7f0220006cc0).stop 2024-04-06T12:14:22.986 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 msgr2=0x7f023410df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:22.986 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 --2- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f023410df60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f0228006ba0 tx=0x7f02280090f0).stop 2024-04-06T12:14:22.986 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 shutdown_connections 2024-04-06T12:14:22.987 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 --2- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0224032660 0x7f0224034b20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:22.987 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 --2- 172.21.15.152:0/1319553902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02340fd5b0 0x7f023410df60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:22.987 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 >> 172.21.15.152:0/1319553902 conn(0x7f02340f6e20 msgr2=0x7f02340f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:22.987 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 shutdown_connections 2024-04-06T12:14:22.987 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:22.987+0000 7f023aab4700 1 -- 172.21.15.152:0/1319553902 wait complete. 2024-04-06T12:14:24.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:22.667839+0000 mon.smithi152 (mon.0) 87 : cluster [DBG] mgrmap e12: smithi152.lynahm(active, since 2s) 2024-04-06T12:14:24.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:22.897595+0000 mgr.smithi152.lynahm (mgr.14156) 3 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:24.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:22.983993+0000 mon.smithi152 (mon.0) 88 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:24.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:22.985830+0000 mon.smithi152 (mon.0) 89 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:24.122 INFO:teuthology.orchestra.run.smithi152.stderr:Creating initial admin user... 2024-04-06T12:14:25.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.072+0000 7f09353ee700 1 Processor -- start 2024-04-06T12:14:25.088 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.072+0000 7f09353ee700 1 -- start start 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.072+0000 7f09353ee700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f09300ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.072+0000 7f09353ee700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0930071fc0 con 0x7f0930071ba0 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.072+0000 7f092effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f09300ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.072+0000 7f092effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f09300ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46826/0 (socket says 172.21.15.152:46826) 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.072+0000 7f092effd700 1 -- 172.21.15.152:0/962838811 learned_addr learned my addr 172.21.15.152:0/962838811 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f092effd700 1 -- 172.21.15.152:0/962838811 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09301001e0 con 0x7f0930071ba0 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f092effd700 1 --2- 172.21.15.152:0/962838811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f09300ffcf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0924009730 tx=0x7f09240090f0).ready entity=mon.0 client_cookie=792e7ed8525b38a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f092dffb700 1 -- 172.21.15.152:0/962838811 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f092400b6e0 con 0x7f0930071ba0 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f092dffb700 1 -- 172.21.15.152:0/962838811 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f092400bcd0 con 0x7f0930071ba0 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f092dffb700 1 -- 172.21.15.152:0/962838811 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0924011cb0 con 0x7f0930071ba0 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f09353ee700 1 -- 172.21.15.152:0/962838811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 msgr2=0x7f09300ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f09353ee700 1 --2- 172.21.15.152:0/962838811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f09300ffcf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0924009730 tx=0x7f09240090f0).stop 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f09353ee700 1 -- 172.21.15.152:0/962838811 shutdown_connections 2024-04-06T12:14:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f09353ee700 1 --2- 172.21.15.152:0/962838811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f09300ffcf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.073+0000 7f09353ee700 1 -- 172.21.15.152:0/962838811 >> 172.21.15.152:0/962838811 conn(0x7f09300f76f0 msgr2=0x7f09300f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.074+0000 7f09353ee700 1 -- 172.21.15.152:0/962838811 shutdown_connections 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.074+0000 7f09353ee700 1 -- 172.21.15.152:0/962838811 wait complete. 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.074+0000 7f09353ee700 1 Processor -- start 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.074+0000 7f09353ee700 1 -- start start 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.074+0000 7f09353ee700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f093010be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.074+0000 7f09353ee700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093010c330 con 0x7f0930071ba0 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f092effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f093010be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f092effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f093010be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46836/0 (socket says 172.21.15.152:46836) 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f092effd700 1 -- 172.21.15.152:0/541020681 learned_addr learned my addr 172.21.15.152:0/541020681 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f092effd700 1 -- 172.21.15.152:0/541020681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0924009370 con 0x7f0930071ba0 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f092effd700 1 --2- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f093010be40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f09240118b0 tx=0x7f09240090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:25.090 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f0917fff700 1 -- 172.21.15.152:0/541020681 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f092400bad0 con 0x7f0930071ba0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f0917fff700 1 -- 172.21.15.152:0/541020681 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0924011ad0 con 0x7f0930071ba0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093010c530 con 0x7f0930071ba0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f0917fff700 1 -- 172.21.15.152:0/541020681 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f092401aa50 con 0x7f0930071ba0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.075+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093010c940 con 0x7f0930071ba0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.076+0000 7f0917fff700 1 -- 172.21.15.152:0/541020681 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 12) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f092401ad10 con 0x7f0930071ba0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.076+0000 7f0917fff700 1 --2- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0918032660 0x7f0918034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.076+0000 7f0917fff700 1 -- 172.21.15.152:0/541020681 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f0924045180 con 0x7f0930071ba0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.076+0000 7f092e7fc700 1 --2- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0918032660 0x7f0918034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.076+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0930046ce0 con 0x7f0930071ba0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.076+0000 7f092e7fc700 1 --2- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0918032660 0x7f0918034b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f0920009780 tx=0x7f0920006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:25.091 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.081+0000 7f0917fff700 1 -- 172.21.15.152:0/541020681 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f092401e070 con 0x7f0930071ba0 2024-04-06T12:14:25.265 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.266+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 --> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0930100f60 con 0x7f0918032660 2024-04-06T12:14:25.483 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.485+0000 7f0917fff700 1 -- 172.21.15.152:0/541020681 <== mgr.14156 v2:172.21.15.152:6800/3882192194 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f0930100f60 con 0x7f0918032660 2024-04-06T12:14:25.484 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$UdAU3wO1Bcf.IfMTeoZF0uLpXqhdmsQSohudQjZj2VfOhcNLSkVvW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1712405665, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-06T12:14:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0918032660 msgr2=0x7f0918034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 --2- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0918032660 0x7f0918034b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f0920009780 tx=0x7f0920006cc0).stop 2024-04-06T12:14:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 msgr2=0x7f093010be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 --2- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f093010be40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f09240118b0 tx=0x7f09240090f0).stop 2024-04-06T12:14:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 shutdown_connections 2024-04-06T12:14:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 --2- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f0918032660 0x7f0918034b20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 --2- 172.21.15.152:0/541020681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0930071ba0 0x7f093010be40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 >> 172.21.15.152:0/541020681 conn(0x7f09300f76f0 msgr2=0x7f09300f9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 shutdown_connections 2024-04-06T12:14:25.487 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:25.487+0000 7f09353ee700 1 -- 172.21.15.152:0/541020681 wait complete. 2024-04-06T12:14:26.192 INFO:teuthology.orchestra.run.smithi152.stderr:Fetching dashboard port number... 2024-04-06T12:14:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.728+0000 7f9798e22700 1 Processor -- start 2024-04-06T12:14:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.729+0000 7f9798e22700 1 -- start start 2024-04-06T12:14:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.729+0000 7f9798e22700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f97940fc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.729+0000 7f9798e22700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940fc820 con 0x7f97940fbf10 2024-04-06T12:14:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.729+0000 7f979259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f97940fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.729+0000 7f979259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f97940fc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46840/0 (socket says 172.21.15.152:46840) 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.729+0000 7f979259c700 1 -- 172.21.15.152:0/2502324456 learned_addr learned my addr 172.21.15.152:0/2502324456 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.729+0000 7f979259c700 1 -- 172.21.15.152:0/2502324456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940fc960 con 0x7f97940fbf10 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.729+0000 7f979259c700 1 --2- 172.21.15.152:0/2502324456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f97940fc330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f977c009730 tx=0x7f977c0090f0).ready entity=mon.0 client_cookie=b59791da0d757e79 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f979159a700 1 -- 172.21.15.152:0/2502324456 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f977c00b6e0 con 0x7f97940fbf10 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f979159a700 1 -- 172.21.15.152:0/2502324456 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f977c00bcd0 con 0x7f97940fbf10 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f979159a700 1 -- 172.21.15.152:0/2502324456 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f977c011cb0 con 0x7f97940fbf10 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f9798e22700 1 -- 172.21.15.152:0/2502324456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 msgr2=0x7f97940fc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f9798e22700 1 --2- 172.21.15.152:0/2502324456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f97940fc330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f977c009730 tx=0x7f977c0090f0).stop 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f9798e22700 1 -- 172.21.15.152:0/2502324456 shutdown_connections 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f9798e22700 1 --2- 172.21.15.152:0/2502324456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f97940fc330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f9798e22700 1 -- 172.21.15.152:0/2502324456 >> 172.21.15.152:0/2502324456 conn(0x7f97940f7750 msgr2=0x7f97940f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f9798e22700 1 -- 172.21.15.152:0/2502324456 shutdown_connections 2024-04-06T12:14:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.730+0000 7f9798e22700 1 -- 172.21.15.152:0/2502324456 wait complete. 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.731+0000 7f9798e22700 1 Processor -- start 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.731+0000 7f9798e22700 1 -- start start 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.731+0000 7f9798e22700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f979410be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.731+0000 7f9798e22700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979410c2f0 con 0x7f97940fbf10 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.731+0000 7f979259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f979410be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.731+0000 7f979259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f979410be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46846/0 (socket says 172.21.15.152:46846) 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.731+0000 7f979259c700 1 -- 172.21.15.152:0/646780426 learned_addr learned my addr 172.21.15.152:0/646780426 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.732+0000 7f979259c700 1 -- 172.21.15.152:0/646780426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c009370 con 0x7f97940fbf10 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.732+0000 7f979259c700 1 --2- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f979410be00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f977c006ba0 tx=0x7f977c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.732+0000 7f978b7fe700 1 -- 172.21.15.152:0/646780426 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f977c01a640 con 0x7f97940fbf10 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.732+0000 7f978b7fe700 1 -- 172.21.15.152:0/646780426 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f977c01ac30 con 0x7f97940fbf10 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.732+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979410c4f0 con 0x7f97940fbf10 2024-04-06T12:14:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.732+0000 7f978b7fe700 1 -- 172.21.15.152:0/646780426 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f977c022b60 con 0x7f97940fbf10 2024-04-06T12:14:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.732+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979410c900 con 0x7f97940fbf10 2024-04-06T12:14:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.733+0000 7f978b7fe700 1 -- 172.21.15.152:0/646780426 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7f977c0223b0 con 0x7f97940fbf10 2024-04-06T12:14:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.733+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9794046ce0 con 0x7f97940fbf10 2024-04-06T12:14:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.733+0000 7f978b7fe700 1 --2- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f9780032750 0x7f9780034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.733+0000 7f978b7fe700 1 -- 172.21.15.152:0/646780426 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f977c044cb0 con 0x7f97940fbf10 2024-04-06T12:14:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.733+0000 7f9791d9b700 1 --2- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f9780032750 0x7f9780034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.733+0000 7f9791d9b700 1 --2- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f9780032750 0x7f9780034c10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9784009780 tx=0x7f9784006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:26.736 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.737+0000 7f978b7fe700 1 -- 172.21.15.152:0/646780426 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f977c01ada0 con 0x7f97940fbf10 2024-04-06T12:14:26.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:25.268377+0000 mgr.smithi152.lynahm (mgr.14156) 4 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:26.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:25.485919+0000 mon.smithi152 (mon.0) 90 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:26.898 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.898+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f97940fdc60 con 0x7f97940fbf10 2024-04-06T12:14:26.898 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.899+0000 7f978b7fe700 1 -- 172.21.15.152:0/646780426 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f977c01e0b0 con 0x7f97940fbf10 2024-04-06T12:14:26.898 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 8443 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f9780032750 msgr2=0x7f9780034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 --2- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f9780032750 0x7f9780034c10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9784009780 tx=0x7f9784006cc0).stop 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 msgr2=0x7f979410be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 --2- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f979410be00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f977c006ba0 tx=0x7f977c0090f0).stop 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 shutdown_connections 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 --2- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f9780032750 0x7f9780034c10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 --2- 172.21.15.152:0/646780426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97940fbf10 0x7f979410be00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 >> 172.21.15.152:0/646780426 conn(0x7f97940f7750 msgr2=0x7f97940718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 shutdown_connections 2024-04-06T12:14:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:26.900+0000 7f9798e22700 1 -- 172.21.15.152:0/646780426 wait complete. 2024-04-06T12:14:27.603 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:26.487460+0000 mon.smithi152 (mon.0) 91 : cluster [DBG] mgrmap e13: smithi152.lynahm(active, since 6s) 2024-04-06T12:14:27.603 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:26.899874+0000 mon.smithi152 (mon.0) 92 : audit [DBG] from='client.? 172.21.15.152:0/646780426' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-06T12:14:27.610 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: disabled 2024-04-06T12:14:27.617 INFO:teuthology.orchestra.run.smithi152.stderr:systemctl: inactive 2024-04-06T12:14:27.618 INFO:teuthology.orchestra.run.smithi152.stderr:firewalld.service is not enabled 2024-04-06T12:14:27.618 INFO:teuthology.orchestra.run.smithi152.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-06T12:14:27.621 INFO:teuthology.orchestra.run.smithi152.stderr:Ceph Dashboard is now available at: 2024-04-06T12:14:27.621 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:27.621 INFO:teuthology.orchestra.run.smithi152.stderr: URL: https://smithi152.front.sepia.ceph.com:8443/ 2024-04-06T12:14:27.621 INFO:teuthology.orchestra.run.smithi152.stderr: User: admin 2024-04-06T12:14:27.621 INFO:teuthology.orchestra.run.smithi152.stderr: Password: og4pbrehdc 2024-04-06T12:14:27.621 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:27.621 INFO:teuthology.orchestra.run.smithi152.stderr:Enabling autotune for osd_memory_target 2024-04-06T12:14:28.255 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.228+0000 7fcb46f85700 1 Processor -- start 2024-04-06T12:14:28.255 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.228+0000 7fcb46f85700 1 -- start start 2024-04-06T12:14:28.255 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.228+0000 7fcb46f85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb401020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:28.255 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.228+0000 7fcb46f85700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb400fdaa0 con 0x7fcb40071be0 2024-04-06T12:14:28.255 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.228+0000 7fcb44d21700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb401020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:28.255 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.228+0000 7fcb44d21700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb401020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46852/0 (socket says 172.21.15.152:46852) 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.228+0000 7fcb44d21700 1 -- 172.21.15.152:0/4023403384 learned_addr learned my addr 172.21.15.152:0/4023403384 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb44d21700 1 -- 172.21.15.152:0/4023403384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb401025a0 con 0x7fcb40071be0 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb44d21700 1 --2- 172.21.15.152:0/4023403384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb401020b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fcb34009730 tx=0x7fcb340090f0).ready entity=mon.0 client_cookie=bafb288b125ba62a server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb3f7fe700 1 -- 172.21.15.152:0/4023403384 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb3400b6e0 con 0x7fcb40071be0 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb3f7fe700 1 -- 172.21.15.152:0/4023403384 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fcb3400bcd0 con 0x7fcb40071be0 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb3f7fe700 1 -- 172.21.15.152:0/4023403384 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb34011cb0 con 0x7fcb40071be0 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb46f85700 1 -- 172.21.15.152:0/4023403384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 msgr2=0x7fcb401020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb46f85700 1 --2- 172.21.15.152:0/4023403384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb401020b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fcb34009730 tx=0x7fcb340090f0).stop 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb46f85700 1 -- 172.21.15.152:0/4023403384 shutdown_connections 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb46f85700 1 --2- 172.21.15.152:0/4023403384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb401020b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb46f85700 1 -- 172.21.15.152:0/4023403384 >> 172.21.15.152:0/4023403384 conn(0x7fcb400f76f0 msgr2=0x7fcb400f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb46f85700 1 -- 172.21.15.152:0/4023403384 shutdown_connections 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.229+0000 7fcb46f85700 1 -- 172.21.15.152:0/4023403384 wait complete. 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.230+0000 7fcb46f85700 1 Processor -- start 2024-04-06T12:14:28.256 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.230+0000 7fcb46f85700 1 -- start start 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.230+0000 7fcb46f85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb4010e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.230+0000 7fcb46f85700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4010e500 con 0x7fcb40071be0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.230+0000 7fcb44d21700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb4010e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.230+0000 7fcb44d21700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb4010e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46866/0 (socket says 172.21.15.152:46866) 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.230+0000 7fcb44d21700 1 -- 172.21.15.152:0/1626469969 learned_addr learned my addr 172.21.15.152:0/1626469969 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.230+0000 7fcb44d21700 1 -- 172.21.15.152:0/1626469969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb34009370 con 0x7fcb40071be0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.231+0000 7fcb44d21700 1 --2- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb4010e010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcb340118b0 tx=0x7fcb340090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.231+0000 7fcb3dffb700 1 -- 172.21.15.152:0/1626469969 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb3400be40 con 0x7fcb40071be0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.231+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4010e700 con 0x7fcb40071be0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.231+0000 7fcb3dffb700 1 -- 172.21.15.152:0/1626469969 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fcb3401aad0 con 0x7fcb40071be0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.231+0000 7fcb3dffb700 1 -- 172.21.15.152:0/1626469969 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb34023a80 con 0x7fcb40071be0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.231+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4010eb10 con 0x7fcb40071be0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.232+0000 7fcb3dffb700 1 -- 172.21.15.152:0/1626469969 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7fcb34023cc0 con 0x7fcb40071be0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.232+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb40046ce0 con 0x7fcb40071be0 2024-04-06T12:14:28.257 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.232+0000 7fcb3dffb700 1 --2- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fcb30032700 0x7fcb30034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:28.258 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.232+0000 7fcb3dffb700 1 -- 172.21.15.152:0/1626469969 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fcb34044d30 con 0x7fcb40071be0 2024-04-06T12:14:28.258 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.232+0000 7fcb3ffff700 1 --2- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fcb30032700 0x7fcb30034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:28.258 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.232+0000 7fcb3ffff700 1 --2- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fcb30032700 0x7fcb30034bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fcb2c009780 tx=0x7fcb2c006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:28.258 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.237+0000 7fcb3dffb700 1 -- 172.21.15.152:0/1626469969 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcb34021320 con 0x7fcb40071be0 2024-04-06T12:14:28.398 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.399+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fcb401031a0 con 0x7fcb40071be0 2024-04-06T12:14:28.398 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.399+0000 7fcb3dffb700 1 -- 172.21.15.152:0/1626469969 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fcb3401e0c0 con 0x7fcb40071be0 2024-04-06T12:14:28.400 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.401+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fcb30032700 msgr2=0x7fcb30034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.401+0000 7fcb46f85700 1 --2- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fcb30032700 0x7fcb30034bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fcb2c009780 tx=0x7fcb2c006cc0).stop 2024-04-06T12:14:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.401+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 msgr2=0x7fcb4010e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.401+0000 7fcb46f85700 1 --2- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb4010e010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcb340118b0 tx=0x7fcb340090f0).stop 2024-04-06T12:14:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.401+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 shutdown_connections 2024-04-06T12:14:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.401+0000 7fcb46f85700 1 --2- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fcb30032700 0x7fcb30034bc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.401+0000 7fcb46f85700 1 --2- 172.21.15.152:0/1626469969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb40071be0 0x7fcb4010e010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.401+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 >> 172.21.15.152:0/1626469969 conn(0x7fcb400f76f0 msgr2=0x7fcb400f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.402+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 shutdown_connections 2024-04-06T12:14:28.401 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:28.402+0000 7fcb46f85700 1 -- 172.21.15.152:0/1626469969 wait complete. 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.686+0000 7fbf4db84700 1 Processor -- start 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.686+0000 7fbf4db84700 1 -- start start 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.686+0000 7fbf4db84700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf480fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.686+0000 7fbf4db84700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480fc7e0 con 0x7fbf480fbed0 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.686+0000 7fbf477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf480fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.686+0000 7fbf477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf480fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46882/0 (socket says 172.21.15.152:46882) 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.686+0000 7fbf477fe700 1 -- 172.21.15.152:0/504180548 learned_addr learned my addr 172.21.15.152:0/504180548 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.686+0000 7fbf477fe700 1 -- 172.21.15.152:0/504180548 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480fc920 con 0x7fbf480fbed0 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.686+0000 7fbf477fe700 1 --2- 172.21.15.152:0/504180548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf480fc2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fbf38009730 tx=0x7fbf380090f0).ready entity=mon.0 client_cookie=e36f8343ce6ab43 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf467fc700 1 -- 172.21.15.152:0/504180548 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf3800b6e0 con 0x7fbf480fbed0 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf467fc700 1 -- 172.21.15.152:0/504180548 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbf3800bcd0 con 0x7fbf480fbed0 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf467fc700 1 -- 172.21.15.152:0/504180548 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf38011cb0 con 0x7fbf480fbed0 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf4db84700 1 -- 172.21.15.152:0/504180548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 msgr2=0x7fbf480fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf4db84700 1 --2- 172.21.15.152:0/504180548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf480fc2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fbf38009730 tx=0x7fbf380090f0).stop 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf4db84700 1 -- 172.21.15.152:0/504180548 shutdown_connections 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf4db84700 1 --2- 172.21.15.152:0/504180548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf480fc2f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf4db84700 1 -- 172.21.15.152:0/504180548 >> 172.21.15.152:0/504180548 conn(0x7fbf480f76f0 msgr2=0x7fbf480f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf4db84700 1 -- 172.21.15.152:0/504180548 shutdown_connections 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.687+0000 7fbf4db84700 1 -- 172.21.15.152:0/504180548 wait complete. 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.688+0000 7fbf4db84700 1 Processor -- start 2024-04-06T12:14:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.688+0000 7fbf4db84700 1 -- start start 2024-04-06T12:14:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf4db84700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf4810eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf4db84700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48071c80 con 0x7fbf480fbed0 2024-04-06T12:14:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf4810eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf4810eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46898/0 (socket says 172.21.15.152:46898) 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf477fe700 1 -- 172.21.15.152:0/3994223369 learned_addr learned my addr 172.21.15.152:0/3994223369 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf477fe700 1 -- 172.21.15.152:0/3994223369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38009370 con 0x7fbf480fbed0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf477fe700 1 --2- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf4810eb10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fbf380118b0 tx=0x7fbf380090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf44ff9700 1 -- 172.21.15.152:0/3994223369 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf3800be40 con 0x7fbf480fbed0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf48071e80 con 0x7fbf480fbed0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf44ff9700 1 -- 172.21.15.152:0/3994223369 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbf3800bad0 con 0x7fbf480fbed0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf44ff9700 1 -- 172.21.15.152:0/3994223369 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf3801aaa0 con 0x7fbf480fbed0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.689+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4810f1c0 con 0x7fbf480fbed0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.690+0000 7fbf44ff9700 1 -- 172.21.15.152:0/3994223369 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7fbf38023410 con 0x7fbf480fbed0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.690+0000 7fbf44ff9700 1 --2- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fbf30032700 0x7fbf30034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.690+0000 7fbf44ff9700 1 -- 172.21.15.152:0/3994223369 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fbf38044f90 con 0x7fbf480fbed0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.690+0000 7fbf46ffd700 1 --2- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fbf30032700 0x7fbf30034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.690+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4805a310 con 0x7fbf480fbed0 2024-04-06T12:14:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.691+0000 7fbf46ffd700 1 --2- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fbf30032700 0x7fbf30034bc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fbf3c009780 tx=0x7fbf3c006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:29.694 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.695+0000 7fbf44ff9700 1 -- 172.21.15.152:0/3994223369 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbf3801e070 con 0x7fbf480fbed0 2024-04-06T12:14:29.947 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.948+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fbf480fdc20 con 0x7fbf480fbed0 2024-04-06T12:14:29.949 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.950+0000 7fbf44ff9700 1 -- 172.21.15.152:0/3994223369 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v29)=0 set mgr/dashboard/cluster/status v29) v1 ==== 153+0+0 (secure 0 0 0) 0x7fbf38021710 con 0x7fbf480fbed0 2024-04-06T12:14:29.952 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fbf30032700 msgr2=0x7fbf30034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 --2- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fbf30032700 0x7fbf30034bc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fbf3c009780 tx=0x7fbf3c006cc0).stop 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 msgr2=0x7fbf4810eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 --2- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf4810eb10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fbf380118b0 tx=0x7fbf380090f0).stop 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 shutdown_connections 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 --2- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fbf30032700 0x7fbf30034bc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 --2- 172.21.15.152:0/3994223369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf480fbed0 0x7fbf4810eb10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 >> 172.21.15.152:0/3994223369 conn(0x7fbf480f76f0 msgr2=0x7fbf480f9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 shutdown_connections 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: 2024-04-06T12:14:29.952+0000 7fbf4db84700 1 -- 172.21.15.152:0/3994223369 wait complete. 2024-04-06T12:14:29.953 INFO:teuthology.orchestra.run.smithi152.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-04-06T12:14:30.651 INFO:teuthology.orchestra.run.smithi152.stderr:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-06T12:14:30.651 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:30.651 INFO:teuthology.orchestra.run.smithi152.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-06T12:14:30.651 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:30.651 INFO:teuthology.orchestra.run.smithi152.stderr:Or, if you are only running a single cluster on this host: 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:Please consider enabling telemetry to help improve Ceph: 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr: ceph telemetry on 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:For more information see: 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr: https://docs.ceph.com/en/pacific/mgr/telemetry/ 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-06T12:14:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:Bootstrap complete. 2024-04-06T12:14:30.691 INFO:tasks.cephadm:Fetching config... 2024-04-06T12:14:30.692 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:14:30.692 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-06T12:14:30.751 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-06T12:14:30.751 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:14:30.752 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-06T12:14:30.810 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-06T12:14:30.810 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:14:30.810 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/keyring of=/dev/stdout 2024-04-06T12:14:30.879 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-06T12:14:30.879 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:14:30.879 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-06T12:14:30.937 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-06T12:14:30.938 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr3STYOnpakcg7vcDvilVPHWMC8S8ecNh+tLNBeK4uJIyfljnw5pQk8wkXY20zDuz6iCrC168+zwPo8JpdyahDf9OP49uBd/7LeRJQI4N5ij/X0vmKXQig+p4jatNGyaUCH0z5js+bD5UYKE4w4+tydsRyluAzx1Qodn5MMU2KvEzez6PK/sJUsOu04dBU8rCBaktRtHo+SfauVVgYvyOHTIPS/+GeMJsJ684CfLrW/utBOYTg0o0voEZI/iIlRs7cKkwWW8na4LqQmfJReU1rPYzjuyob9sc0CJCkkilyHQJzeTei+8xBV5pVO5J2QBTAYGwWEBlOXN2RwjkDPLeXS4SQMySAVY0FhrTDsbp/MFeJzCvGADDZF8NR+e9U0d3BHSMxOPmm6fgKwlonXI5W7EWDD3rI838oESK7mXxPwH84KNVhgr8Xq6PCFOwd1yUzOHlpimodIBKg8Vb/mNbSVijgdwm1tbIoM/hMcntibB9ahNqeGJipcp/B+FcoQg0= ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-06T12:14:31.017 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr3STYOnpakcg7vcDvilVPHWMC8S8ecNh+tLNBeK4uJIyfljnw5pQk8wkXY20zDuz6iCrC168+zwPo8JpdyahDf9OP49uBd/7LeRJQI4N5ij/X0vmKXQig+p4jatNGyaUCH0z5js+bD5UYKE4w4+tydsRyluAzx1Qodn5MMU2KvEzez6PK/sJUsOu04dBU8rCBaktRtHo+SfauVVgYvyOHTIPS/+GeMJsJ684CfLrW/utBOYTg0o0voEZI/iIlRs7cKkwWW8na4LqQmfJReU1rPYzjuyob9sc0CJCkkilyHQJzeTei+8xBV5pVO5J2QBTAYGwWEBlOXN2RwjkDPLeXS4SQMySAVY0FhrTDsbp/MFeJzCvGADDZF8NR+e9U0d3BHSMxOPmm6fgKwlonXI5W7EWDD3rI838oESK7mXxPwH84KNVhgr8Xq6PCFOwd1yUzOHlpimodIBKg8Vb/mNbSVijgdwm1tbIoM/hMcntibB9ahNqeGJipcp/B+FcoQg0= ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:14:31.029 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr3STYOnpakcg7vcDvilVPHWMC8S8ecNh+tLNBeK4uJIyfljnw5pQk8wkXY20zDuz6iCrC168+zwPo8JpdyahDf9OP49uBd/7LeRJQI4N5ij/X0vmKXQig+p4jatNGyaUCH0z5js+bD5UYKE4w4+tydsRyluAzx1Qodn5MMU2KvEzez6PK/sJUsOu04dBU8rCBaktRtHo+SfauVVgYvyOHTIPS/+GeMJsJ684CfLrW/utBOYTg0o0voEZI/iIlRs7cKkwWW8na4LqQmfJReU1rPYzjuyob9sc0CJCkkilyHQJzeTei+8xBV5pVO5J2QBTAYGwWEBlOXN2RwjkDPLeXS4SQMySAVY0FhrTDsbp/MFeJzCvGADDZF8NR+e9U0d3BHSMxOPmm6fgKwlonXI5W7EWDD3rI838oESK7mXxPwH84KNVhgr8Xq6PCFOwd1yUzOHlpimodIBKg8Vb/mNbSVijgdwm1tbIoM/hMcntibB9ahNqeGJipcp/B+FcoQg0= ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-06T12:14:31.073 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr3STYOnpakcg7vcDvilVPHWMC8S8ecNh+tLNBeK4uJIyfljnw5pQk8wkXY20zDuz6iCrC168+zwPo8JpdyahDf9OP49uBd/7LeRJQI4N5ij/X0vmKXQig+p4jatNGyaUCH0z5js+bD5UYKE4w4+tydsRyluAzx1Qodn5MMU2KvEzez6PK/sJUsOu04dBU8rCBaktRtHo+SfauVVgYvyOHTIPS/+GeMJsJ684CfLrW/utBOYTg0o0voEZI/iIlRs7cKkwWW8na4LqQmfJReU1rPYzjuyob9sc0CJCkkilyHQJzeTei+8xBV5pVO5J2QBTAYGwWEBlOXN2RwjkDPLeXS4SQMySAVY0FhrTDsbp/MFeJzCvGADDZF8NR+e9U0d3BHSMxOPmm6fgKwlonXI5W7EWDD3rI838oESK7mXxPwH84KNVhgr8Xq6PCFOwd1yUzOHlpimodIBKg8Vb/mNbSVijgdwm1tbIoM/hMcntibB9ahNqeGJipcp/B+FcoQg0= ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:14:31.085 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-06T12:14:31.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:29.951698+0000 mon.smithi152 (mon.0) 93 : audit [INF] from='client.? 172.21.15.152:0/3994223369' entity='client.admin' 2024-04-06T12:14:34.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.924+0000 7f598f1ba700 1 -- 172.21.15.152:0/643656057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 msgr2=0x7f59880f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:34.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.924+0000 7f598f1ba700 1 --2- 172.21.15.152:0/643656057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 0x7f59880f79e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f597c004770 tx=0x7f597c009cb0).stop 2024-04-06T12:14:34.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.924+0000 7f598f1ba700 1 -- 172.21.15.152:0/643656057 shutdown_connections 2024-04-06T12:14:34.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.924+0000 7f598f1ba700 1 --2- 172.21.15.152:0/643656057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 0x7f59880f79e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:34.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.924+0000 7f598f1ba700 1 -- 172.21.15.152:0/643656057 >> 172.21.15.152:0/643656057 conn(0x7f59880f2d40 msgr2=0x7f59880f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.924+0000 7f598f1ba700 1 -- 172.21.15.152:0/643656057 shutdown_connections 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.924+0000 7f598f1ba700 1 -- 172.21.15.152:0/643656057 wait complete. 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.925+0000 7f598f1ba700 1 Processor -- start 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.925+0000 7f598f1ba700 1 -- start start 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.925+0000 7f598f1ba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 0x7f5988109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.925+0000 7f598f1ba700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5988109f30 con 0x7f59880f75c0 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.925+0000 7f598cf56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 0x7f5988109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.925+0000 7f598cf56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 0x7f5988109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44334/0 (socket says 172.21.15.152:44334) 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.925+0000 7f598cf56700 1 -- 172.21.15.152:0/140560775 learned_addr learned my addr 172.21.15.152:0/140560775 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.925+0000 7f598cf56700 1 -- 172.21.15.152:0/140560775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c005040 con 0x7f59880f75c0 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.926+0000 7f598cf56700 1 --2- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 0x7f5988109a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f597c009300 tx=0x7f597c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.926+0000 7f5985ffb700 1 -- 172.21.15.152:0/140560775 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f597c018070 con 0x7f59880f75c0 2024-04-06T12:14:34.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.926+0000 7f5985ffb700 1 -- 172.21.15.152:0/140560775 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f597c009890 con 0x7f59880f75c0 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.926+0000 7f5985ffb700 1 -- 172.21.15.152:0/140560775 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f597c01c400 con 0x7f59880f75c0 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.926+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598810a130 con 0x7f59880f75c0 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.926+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598810a5c0 con 0x7f59880f75c0 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.927+0000 7f5985ffb700 1 -- 172.21.15.152:0/140560775 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7f597c01d420 con 0x7f59880f75c0 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.927+0000 7f5985ffb700 1 --2- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5978032750 0x7f5978034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.927+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5988046ce0 con 0x7f59880f75c0 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.927+0000 7f5985ffb700 1 -- 172.21.15.152:0/140560775 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f597c044640 con 0x7f59880f75c0 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.927+0000 7f5987fff700 1 --2- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5978032750 0x7f5978034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.927+0000 7f5987fff700 1 --2- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5978032750 0x7f5978034c10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f5974009780 tx=0x7f5974006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:34.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:33.932+0000 7f5985ffb700 1 -- 172.21.15.152:0/140560775 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f597c025b40 con 0x7f59880f75c0 2024-04-06T12:14:34.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.103+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f59880fd1a0 con 0x7f59880f75c0 2024-04-06T12:14:34.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.108+0000 7f5985ffb700 1 -- 172.21.15.152:0/140560775 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f597c025b40 con 0x7f59880f75c0 2024-04-06T12:14:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5978032750 msgr2=0x7f5978034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 --2- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5978032750 0x7f5978034c10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f5974009780 tx=0x7f5974006cc0).stop 2024-04-06T12:14:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 msgr2=0x7f5988109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 --2- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 0x7f5988109a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f597c009300 tx=0x7f597c009cb0).stop 2024-04-06T12:14:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 shutdown_connections 2024-04-06T12:14:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 --2- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5978032750 0x7f5978034c10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 --2- 172.21.15.152:0/140560775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59880f75c0 0x7f5988109a40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 >> 172.21.15.152:0/140560775 conn(0x7f59880f2d40 msgr2=0x7f59880f3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 shutdown_connections 2024-04-06T12:14:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:34.110+0000 7f598f1ba700 1 -- 172.21.15.152:0/140560775 wait complete. 2024-04-06T12:14:34.675 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-06T12:14:34.675 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-06T12:14:35.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:34.109038+0000 mon.smithi152 (mon.0) 94 : audit [INF] from='client.? 172.21.15.152:0/140560775' entity='client.admin' 2024-04-06T12:14:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.543+0000 7f45aa813700 1 -- 172.21.15.152:0/2726520364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 msgr2=0x7f45a40f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.543+0000 7f45aa813700 1 --2- 172.21.15.152:0/2726520364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 0x7f45a40f79e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4598004770 tx=0x7f4598009cb0).stop 2024-04-06T12:14:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.543+0000 7f45aa813700 1 -- 172.21.15.152:0/2726520364 shutdown_connections 2024-04-06T12:14:37.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.543+0000 7f45aa813700 1 --2- 172.21.15.152:0/2726520364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 0x7f45a40f79e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.543+0000 7f45aa813700 1 -- 172.21.15.152:0/2726520364 >> 172.21.15.152:0/2726520364 conn(0x7f45a40f2d20 msgr2=0x7f45a40f5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.543+0000 7f45aa813700 1 -- 172.21.15.152:0/2726520364 shutdown_connections 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.543+0000 7f45aa813700 1 -- 172.21.15.152:0/2726520364 wait complete. 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.543+0000 7f45aa813700 1 Processor -- start 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.543+0000 7f45aa813700 1 -- start start 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45aa813700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 0x7f45a4107810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45aa813700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4107d00 con 0x7f45a40f75c0 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45a3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 0x7f45a4107810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45a3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 0x7f45a4107810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44356/0 (socket says 172.21.15.152:44356) 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45a3fff700 1 -- 172.21.15.152:0/1669581445 learned_addr learned my addr 172.21.15.152:0/1669581445 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45a3fff700 1 -- 172.21.15.152:0/1669581445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598005040 con 0x7f45a40f75c0 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45a3fff700 1 --2- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 0x7f45a4107810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f4598009300 tx=0x7f4598009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45a17fa700 1 -- 172.21.15.152:0/1669581445 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4598018070 con 0x7f45a40f75c0 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45a17fa700 1 -- 172.21.15.152:0/1669581445 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4598009890 con 0x7f45a40f75c0 2024-04-06T12:14:37.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a4107f00 con 0x7f45a40f75c0 2024-04-06T12:14:37.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45a17fa700 1 -- 172.21.15.152:0/1669581445 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f459801c400 con 0x7f45a40f75c0 2024-04-06T12:14:37.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.544+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a4108390 con 0x7f45a40f75c0 2024-04-06T12:14:37.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.545+0000 7f45a17fa700 1 -- 172.21.15.152:0/1669581445 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7f459801d420 con 0x7f45a40f75c0 2024-04-06T12:14:37.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.545+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a4046ce0 con 0x7f45a40f75c0 2024-04-06T12:14:37.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.545+0000 7f45a17fa700 1 --2- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f458c032750 0x7f458c034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:37.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.545+0000 7f45a17fa700 1 -- 172.21.15.152:0/1669581445 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f45980445a0 con 0x7f45a40f75c0 2024-04-06T12:14:37.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.545+0000 7f45a37fe700 1 --2- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f458c032750 0x7f458c034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:37.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.546+0000 7f45a37fe700 1 --2- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f458c032750 0x7f458c034c10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4594009780 tx=0x7f4594006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:37.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.550+0000 7f45a17fa700 1 -- 172.21.15.152:0/1669581445 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f459801cb90 con 0x7f45a40f75c0 2024-04-06T12:14:37.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.730+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 --> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f45a40f3e80 con 0x7f458c032750 2024-04-06T12:14:37.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.734+0000 7f45a17fa700 1 -- 172.21.15.152:0/1669581445 <== mgr.14156 v2:172.21.15.152:6800/3882192194 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f45a40f3e80 con 0x7f458c032750 2024-04-06T12:14:37.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f458c032750 msgr2=0x7f458c034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:37.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 --2- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f458c032750 0x7f458c034c10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4594009780 tx=0x7f4594006cc0).stop 2024-04-06T12:14:37.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 msgr2=0x7f45a4107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:37.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 --2- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 0x7f45a4107810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f4598009300 tx=0x7f4598009cb0).stop 2024-04-06T12:14:37.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 shutdown_connections 2024-04-06T12:14:37.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 --2- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f458c032750 0x7f458c034c10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:37.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 --2- 172.21.15.152:0/1669581445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45a40f75c0 0x7f45a4107810 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:37.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 >> 172.21.15.152:0/1669581445 conn(0x7f45a40f2d20 msgr2=0x7f45a40f3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:37.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 shutdown_connections 2024-04-06T12:14:37.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:37.736+0000 7f45aa813700 1 -- 172.21.15.152:0/1669581445 wait complete. 2024-04-06T12:14:38.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:37.326857+0000 mon.smithi152 (mon.0) 95 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:38.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:37.672540+0000 mon.smithi152 (mon.0) 96 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:14:38.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:37.676528+0000 mon.smithi152 (mon.0) 97 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:38.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:37.735405+0000 mon.smithi152 (mon.0) 98 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:38.426 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2024-04-06T12:14:38.426 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:14:38.426 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2024-04-06T12:14:38.447 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:14:38.447 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:14:38.508 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2024-04-06T12:14:38.508 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch host add smithi195 2024-04-06T12:14:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:37.684601+0000 mgr.smithi152.lynahm (mgr.14156) 5 : cephadm [INF] Deploying daemon alertmanager.smithi152 on smithi152 2024-04-06T12:14:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:37.732062+0000 mgr.smithi152.lynahm (mgr.14156) 6 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.887+0000 7f60d98bd700 1 -- 172.21.15.152:0/498195868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 msgr2=0x7f60d40f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.887+0000 7f60d98bd700 1 --2- 172.21.15.152:0/498195868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 0x7f60d40f79e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f60c4009ae0 tx=0x7f60c4004d10).stop 2024-04-06T12:14:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.887+0000 7f60d98bd700 1 -- 172.21.15.152:0/498195868 shutdown_connections 2024-04-06T12:14:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.887+0000 7f60d98bd700 1 --2- 172.21.15.152:0/498195868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 0x7f60d40f79e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:40.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.887+0000 7f60d98bd700 1 -- 172.21.15.152:0/498195868 >> 172.21.15.152:0/498195868 conn(0x7f60d40f2d40 msgr2=0x7f60d40f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.887+0000 7f60d98bd700 1 -- 172.21.15.152:0/498195868 shutdown_connections 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.887+0000 7f60d98bd700 1 -- 172.21.15.152:0/498195868 wait complete. 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.888+0000 7f60d98bd700 1 Processor -- start 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.888+0000 7f60d98bd700 1 -- start start 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.888+0000 7f60d98bd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 0x7f60d4107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.888+0000 7f60d98bd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d4107d30 con 0x7f60d40f75c0 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.888+0000 7f60d2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 0x7f60d4107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.888+0000 7f60d2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 0x7f60d4107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44384/0 (socket says 172.21.15.152:44384) 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.888+0000 7f60d2ffd700 1 -- 172.21.15.152:0/1718676314 learned_addr learned my addr 172.21.15.152:0/1718676314 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.888+0000 7f60d2ffd700 1 -- 172.21.15.152:0/1718676314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40097c0 con 0x7f60d40f75c0 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.888+0000 7f60d2ffd700 1 --2- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 0x7f60d4107840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f60c400b7e0 tx=0x7f60c4004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:40.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.889+0000 7f60cbfff700 1 -- 172.21.15.152:0/1718676314 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60c4018070 con 0x7f60d40f75c0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.889+0000 7f60cbfff700 1 -- 172.21.15.152:0/1718676314 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f60c4007e50 con 0x7f60d40f75c0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.889+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d4107f30 con 0x7f60d40f75c0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.889+0000 7f60cbfff700 1 -- 172.21.15.152:0/1718676314 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60c4013420 con 0x7f60d40f75c0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.889+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d41083c0 con 0x7f60d40f75c0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.889+0000 7f60cbfff700 1 -- 172.21.15.152:0/1718676314 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7f60c401d420 con 0x7f60d40f75c0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.889+0000 7f60cbfff700 1 --2- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f60c0032700 0x7f60c0034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.890+0000 7f60cbfff700 1 -- 172.21.15.152:0/1718676314 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f60c40448a0 con 0x7f60d40f75c0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.890+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d4046ce0 con 0x7f60d40f75c0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.890+0000 7f60d27fc700 1 --2- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f60c0032700 0x7f60c0034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.890+0000 7f60d27fc700 1 --2- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f60c0032700 0x7f60c0034bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f60bc009780 tx=0x7f60bc006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:40.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:40.894+0000 7f60cbfff700 1 -- 172.21.15.152:0/1718676314 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f60c401b760 con 0x7f60d40f75c0 2024-04-06T12:14:41.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.064+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 --> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7f60d40f3ea0 con 0x7f60c0032700 2024-04-06T12:14:41.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:40.002097+0000 mgr.smithi152.lynahm (mgr.14156) 7 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:41.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.704+0000 7f60cbfff700 1 -- 172.21.15.152:0/1718676314 <== mgr.14156 v2:172.21.15.152:6800/3882192194 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f60d40f3ea0 con 0x7f60c0032700 2024-04-06T12:14:41.703 INFO:teuthology.orchestra.run.smithi152.stdout:Added host 'smithi195' with addr '172.21.15.195' 2024-04-06T12:14:41.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.706+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f60c0032700 msgr2=0x7f60c0034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:41.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.706+0000 7f60d98bd700 1 --2- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f60c0032700 0x7f60c0034bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f60bc009780 tx=0x7f60bc006cc0).stop 2024-04-06T12:14:41.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.707+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 msgr2=0x7f60d4107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:41.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.707+0000 7f60d98bd700 1 --2- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 0x7f60d4107840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f60c400b7e0 tx=0x7f60c4004d10).stop 2024-04-06T12:14:41.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.707+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 shutdown_connections 2024-04-06T12:14:41.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.707+0000 7f60d98bd700 1 --2- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f60c0032700 0x7f60c0034bc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:41.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.707+0000 7f60d98bd700 1 --2- 172.21.15.152:0/1718676314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40f75c0 0x7f60d4107840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:41.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.707+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 >> 172.21.15.152:0/1718676314 conn(0x7f60d40f2d40 msgr2=0x7f60d40f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:41.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.707+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 shutdown_connections 2024-04-06T12:14:41.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:41.707+0000 7f60d98bd700 1 -- 172.21.15.152:0/1718676314 wait complete. 2024-04-06T12:14:42.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:41.066324+0000 mgr.smithi152.lynahm (mgr.14156) 8 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:42.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:41.704967+0000 mon.smithi152 (mon.0) 99 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:43.075 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch host ls --format=json 2024-04-06T12:14:43.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:41.705270+0000 mgr.smithi152.lynahm (mgr.14156) 9 : cephadm [INF] Added host smithi195 2024-04-06T12:14:43.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:42.002338+0000 mgr.smithi152.lynahm (mgr.14156) 10 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:45.636 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:44.002596+0000 mgr.smithi152.lynahm (mgr.14156) 11 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:47.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:46.002940+0000 mgr.smithi152.lynahm (mgr.14156) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:47.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.833+0000 7fa1c2c78700 1 -- 172.21.15.152:0/2244700045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 msgr2=0x7fa1bc0f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:47.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.833+0000 7fa1c2c78700 1 --2- 172.21.15.152:0/2244700045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 0x7fa1bc0f79e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa1b0004770 tx=0x7fa1b0009cb0).stop 2024-04-06T12:14:47.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.833+0000 7fa1c2c78700 1 -- 172.21.15.152:0/2244700045 shutdown_connections 2024-04-06T12:14:47.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.833+0000 7fa1c2c78700 1 --2- 172.21.15.152:0/2244700045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 0x7fa1bc0f79e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:47.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.833+0000 7fa1c2c78700 1 -- 172.21.15.152:0/2244700045 >> 172.21.15.152:0/2244700045 conn(0x7fa1bc0f2d40 msgr2=0x7fa1bc0f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:47.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.833+0000 7fa1c2c78700 1 -- 172.21.15.152:0/2244700045 shutdown_connections 2024-04-06T12:14:47.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.833+0000 7fa1c2c78700 1 -- 172.21.15.152:0/2244700045 wait complete. 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c2c78700 1 Processor -- start 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c2c78700 1 -- start start 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c2c78700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 0x7fa1bc107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c2c78700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc107d30 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c0a14700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 0x7fa1bc107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c0a14700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 0x7fa1bc107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49806/0 (socket says 172.21.15.152:49806) 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c0a14700 1 -- 172.21.15.152:0/1282087495 learned_addr learned my addr 172.21.15.152:0/1282087495 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c0a14700 1 -- 172.21.15.152:0/1282087495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0005040 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c0a14700 1 --2- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 0x7fa1bc107840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa1b00099b0 tx=0x7fa1b0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1b9ffb700 1 -- 172.21.15.152:0/1282087495 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1b0018070 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc107f30 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1b9ffb700 1 -- 172.21.15.152:0/1282087495 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa1b0013730 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.834+0000 7fa1b9ffb700 1 -- 172.21.15.152:0/1282087495 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1b001d460 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.835+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc1083c0 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.836+0000 7fa1b9ffb700 1 -- 172.21.15.152:0/1282087495 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7fa1b001d720 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.836+0000 7fa1b9ffb700 1 --2- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fa1ac0326d0 0x7fa1ac034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:47.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.836+0000 7fa1b9ffb700 1 -- 172.21.15.152:0/1282087495 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fa1b00442b0 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.836+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc046ce0 con 0x7fa1bc0f75c0 2024-04-06T12:14:47.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.836+0000 7fa1bbfff700 1 --2- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fa1ac0326d0 0x7fa1ac034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:47.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.836+0000 7fa1bbfff700 1 --2- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fa1ac0326d0 0x7fa1ac034b90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa1a8009780 tx=0x7fa1a8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:47.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:47.840+0000 7fa1b9ffb700 1 -- 172.21.15.152:0/1282087495 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa1b001ad70 con 0x7fa1bc0f75c0 2024-04-06T12:14:48.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.020+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 --> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1bc0f3ea0 con 0x7fa1ac0326d0 2024-04-06T12:14:48.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.021+0000 7fa1b9ffb700 1 -- 172.21.15.152:0/1282087495 <== mgr.14156 v2:172.21.15.152:6800/3882192194 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7fa1bc0f3ea0 con 0x7fa1ac0326d0 2024-04-06T12:14:48.020 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:14:48.020 INFO:teuthology.orchestra.run.smithi152.stdout:[{"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}, {"addr": "172.21.15.195", "hostname": "smithi195", "labels": [], "status": ""}] 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fa1ac0326d0 msgr2=0x7fa1ac034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 --2- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fa1ac0326d0 0x7fa1ac034b90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa1a8009780 tx=0x7fa1a8006cc0).stop 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 msgr2=0x7fa1bc107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 --2- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 0x7fa1bc107840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa1b00099b0 tx=0x7fa1b0009cb0).stop 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 shutdown_connections 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 --2- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fa1ac0326d0 0x7fa1ac034b90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 --2- 172.21.15.152:0/1282087495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1bc0f75c0 0x7fa1bc107840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 >> 172.21.15.152:0/1282087495 conn(0x7fa1bc0f2d40 msgr2=0x7fa1bc0f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 shutdown_connections 2024-04-06T12:14:48.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:48.023+0000 7fa1c2c78700 1 -- 172.21.15.152:0/1282087495 wait complete. 2024-04-06T12:14:49.220 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-06T12:14:49.220 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd crush tunables default 2024-04-06T12:14:49.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:48.003229+0000 mgr.smithi152.lynahm (mgr.14156) 13 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:49.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:48.022003+0000 mgr.smithi152.lynahm (mgr.14156) 14 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T12:14:49.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:48.901690+0000 mon.smithi152 (mon.0) 100 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:49.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:48.903321+0000 mon.smithi152 (mon.0) 101 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:14:49.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:48.905055+0000 mon.smithi152 (mon.0) 102 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-06T12:14:49.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:48.905599+0000 mon.smithi152 (mon.0) 103 : audit [DBG] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:14:50.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:48.906095+0000 mgr.smithi152.lynahm (mgr.14156) 15 : cephadm [INF] Deploying daemon crash.smithi152 on smithi152 2024-04-06T12:14:50.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:50.136713+0000 mon.smithi152 (mon.0) 104 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:51.673 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:50.003560+0000 mgr.smithi152.lynahm (mgr.14156) 16 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:51.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.363+0000 7f3ae254f700 1 -- 172.21.15.152:0/4045668033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 msgr2=0x7f3adc0fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:51.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.363+0000 7f3ae254f700 1 --2- 172.21.15.152:0/4045668033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 0x7f3adc0fa190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f3acc004770 tx=0x7f3acc009cb0).stop 2024-04-06T12:14:51.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.363+0000 7f3ae254f700 1 -- 172.21.15.152:0/4045668033 shutdown_connections 2024-04-06T12:14:51.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.363+0000 7f3ae254f700 1 --2- 172.21.15.152:0/4045668033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 0x7f3adc0fa190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:51.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.363+0000 7f3ae254f700 1 -- 172.21.15.152:0/4045668033 >> 172.21.15.152:0/4045668033 conn(0x7f3adc0f1c10 msgr2=0x7f3adc0f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.363+0000 7f3ae254f700 1 -- 172.21.15.152:0/4045668033 shutdown_connections 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.364+0000 7f3ae254f700 1 -- 172.21.15.152:0/4045668033 wait complete. 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.364+0000 7f3ae254f700 1 Processor -- start 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.364+0000 7f3ae254f700 1 -- start start 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.364+0000 7f3ae254f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 0x7f3adc0f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.364+0000 7f3ae254f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0f6090 con 0x7f3adc0611f0 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.364+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 0x7f3adc0f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.364+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 0x7f3adc0f7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49824/0 (socket says 172.21.15.152:49824) 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.364+0000 7f3adbfff700 1 -- 172.21.15.152:0/1077709203 learned_addr learned my addr 172.21.15.152:0/1077709203 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.365+0000 7f3adbfff700 1 -- 172.21.15.152:0/1077709203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc005040 con 0x7f3adc0611f0 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.365+0000 7f3adbfff700 1 --2- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 0x7f3adc0f7c10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f3acc004740 tx=0x7f3acc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.365+0000 7f3ad97fa700 1 -- 172.21.15.152:0/1077709203 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3acc018070 con 0x7f3adc0611f0 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.365+0000 7f3ad97fa700 1 -- 172.21.15.152:0/1077709203 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3acc013e30 con 0x7f3adc0611f0 2024-04-06T12:14:51.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.365+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc0f6230 con 0x7f3adc0611f0 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.365+0000 7f3ad97fa700 1 -- 172.21.15.152:0/1077709203 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3acc01d600 con 0x7f3adc0611f0 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.365+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc0f66c0 con 0x7f3adc0611f0 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.366+0000 7f3ad97fa700 1 -- 172.21.15.152:0/1077709203 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7f3acc01d830 con 0x7f3adc0611f0 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.366+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc05a310 con 0x7f3adc0611f0 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.366+0000 7f3ad97fa700 1 --2- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3ac4032700 0x7f3ac4034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.366+0000 7f3ad97fa700 1 -- 172.21.15.152:0/1077709203 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f3acc044910 con 0x7f3adc0611f0 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.366+0000 7f3adb7fe700 1 --2- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3ac4032700 0x7f3ac4034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.366+0000 7f3adb7fe700 1 --2- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3ac4032700 0x7f3ac4034bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3ad0009780 tx=0x7f3ad0006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.370+0000 7f3ad97fa700 1 -- 172.21.15.152:0/1077709203 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3acc01b6f0 con 0x7f3adc0611f0 2024-04-06T12:14:51.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:51.541+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3adc0fd090 con 0x7f3adc0611f0 2024-04-06T12:14:52.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.341+0000 7f3ad97fa700 1 -- 172.21.15.152:0/1077709203 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3acc01b900 con 0x7f3adc0611f0 2024-04-06T12:14:52.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.343+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3ac4032700 msgr2=0x7f3ac4034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:52.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.343+0000 7f3ae254f700 1 --2- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3ac4032700 0x7f3ac4034bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3ad0009780 tx=0x7f3ad0006cc0).stop 2024-04-06T12:14:52.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.344+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 msgr2=0x7f3adc0f7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:52.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.344+0000 7f3ae254f700 1 --2- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 0x7f3adc0f7c10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f3acc004740 tx=0x7f3acc009cb0).stop 2024-04-06T12:14:52.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.344+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 shutdown_connections 2024-04-06T12:14:52.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.344+0000 7f3ae254f700 1 --2- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3ac4032700 0x7f3ac4034bc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:52.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.344+0000 7f3ae254f700 1 --2- 172.21.15.152:0/1077709203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3adc0611f0 0x7f3adc0f7c10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:52.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.344+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 >> 172.21.15.152:0/1077709203 conn(0x7f3adc0f1c10 msgr2=0x7f3adc0f25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:52.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.348+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 shutdown_connections 2024-04-06T12:14:52.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:14:52.348+0000 7f3ae254f700 1 -- 172.21.15.152:0/1077709203 wait complete. 2024-04-06T12:14:52.347 INFO:teuthology.orchestra.run.smithi152.stderr:adjusted tunables profile to default 2024-04-06T12:14:52.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:51.542568+0000 mon.smithi152 (mon.0) 105 : audit [INF] from='client.? 172.21.15.152:0/1077709203' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-06T12:14:53.194 INFO:tasks.cephadm:Adding mon.smithi152 on smithi152 2024-04-06T12:14:53.194 INFO:tasks.cephadm:Adding mon.smithi195 on smithi195 2024-04-06T12:14:53.195 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch apply mon '2;smithi152:172.21.15.152=smithi152;smithi195:172.21.15.195=smithi195' 2024-04-06T12:14:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:52.003970+0000 mgr.smithi152.lynahm (mgr.14156) 17 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:52.342742+0000 mon.smithi152 (mon.0) 106 : audit [INF] from='client.? 172.21.15.152:0/1077709203' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-06T12:14:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:52.342784+0000 mon.smithi152 (mon.0) 107 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-04-06T12:14:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:52.494886+0000 mon.smithi152 (mon.0) 108 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:52.563783+0000 mon.smithi152 (mon.0) 109 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:52.565545+0000 mon.smithi152 (mon.0) 110 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:52.567528+0000 mon.smithi152 (mon.0) 111 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-06T12:14:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:52.567850+0000 mgr.smithi152.lynahm (mgr.14156) 18 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-06T12:14:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:52.570422+0000 mon.smithi152 (mon.0) 112 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:52.578136+0000 mgr.smithi152.lynahm (mgr.14156) 19 : cephadm [INF] Deploying daemon grafana.smithi152 on smithi152 2024-04-06T12:14:55.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.058+0000 7fab56844700 1 -- 172.21.15.195:0/2801250930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 msgr2=0x7fab500fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:55.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.058+0000 7fab56844700 1 --2- 172.21.15.195:0/2801250930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 0x7fab500fa190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fab40004770 tx=0x7fab40009cb0).stop 2024-04-06T12:14:55.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.058+0000 7fab56844700 1 -- 172.21.15.195:0/2801250930 shutdown_connections 2024-04-06T12:14:55.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.058+0000 7fab56844700 1 --2- 172.21.15.195:0/2801250930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 0x7fab500fa190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:55.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.058+0000 7fab56844700 1 -- 172.21.15.195:0/2801250930 >> 172.21.15.195:0/2801250930 conn(0x7fab500f1c10 msgr2=0x7fab500f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:55.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.058+0000 7fab56844700 1 -- 172.21.15.195:0/2801250930 shutdown_connections 2024-04-06T12:14:55.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.058+0000 7fab56844700 1 -- 172.21.15.195:0/2801250930 wait complete. 2024-04-06T12:14:55.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.059+0000 7fab56844700 1 Processor -- start 2024-04-06T12:14:55.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.059+0000 7fab56844700 1 -- start start 2024-04-06T12:14:55.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.059+0000 7fab56844700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 0x7fab501077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:55.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.059+0000 7fab56844700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab50107cc0 con 0x7fab500611f0 2024-04-06T12:14:55.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.059+0000 7fab4ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 0x7fab501077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:55.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.059+0000 7fab4ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 0x7fab501077d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:45336/0 (socket says 172.21.15.195:45336) 2024-04-06T12:14:55.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.059+0000 7fab4ffff700 1 -- 172.21.15.195:0/1236575 learned_addr learned my addr 172.21.15.195:0/1236575 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:14:55.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.060+0000 7fab4ffff700 1 -- 172.21.15.195:0/1236575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40005040 con 0x7fab500611f0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.060+0000 7fab4ffff700 1 --2- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 0x7fab501077d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fab40004740 tx=0x7fab40009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.060+0000 7fab4d7fa700 1 -- 172.21.15.195:0/1236575 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab40018070 con 0x7fab500611f0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.060+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab50107ec0 con 0x7fab500611f0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.060+0000 7fab4d7fa700 1 -- 172.21.15.195:0/1236575 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fab40013e30 con 0x7fab500611f0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.060+0000 7fab4d7fa700 1 -- 172.21.15.195:0/1236575 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab4001d600 con 0x7fab500611f0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.060+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab50108350 con 0x7fab500611f0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.061+0000 7fab4d7fa700 1 -- 172.21.15.195:0/1236575 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7fab4001d830 con 0x7fab500611f0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.061+0000 7fab4d7fa700 1 --2- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fab3c032700 0x7fab3c034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.061+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab50046ce0 con 0x7fab500611f0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.061+0000 7fab4d7fa700 1 -- 172.21.15.195:0/1236575 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fab400449e0 con 0x7fab500611f0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.061+0000 7fab4f7fe700 1 --2- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fab3c032700 0x7fab3c034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:55.061 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.061+0000 7fab4f7fe700 1 --2- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fab3c032700 0x7fab3c034bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fab38009780 tx=0x7fab38006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:55.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.066+0000 7fab4d7fa700 1 -- 172.21.15.195:0/1236575 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fab4001b550 con 0x7fab500611f0 2024-04-06T12:14:55.233 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.234+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 --> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi152:172.21.15.152=smithi152;smithi195:172.21.15.195=smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7fab50109400 con 0x7fab3c032700 2024-04-06T12:14:55.241 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.242+0000 7fab4d7fa700 1 -- 172.21.15.195:0/1236575 <== mgr.14156 v2:172.21.15.152:6800/3882192194 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fab50109400 con 0x7fab3c032700 2024-04-06T12:14:55.241 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mon update... 2024-04-06T12:14:55.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fab3c032700 msgr2=0x7fab3c034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:55.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 --2- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fab3c032700 0x7fab3c034bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fab38009780 tx=0x7fab38006cc0).stop 2024-04-06T12:14:55.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 msgr2=0x7fab501077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:55.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 --2- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 0x7fab501077d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fab40004740 tx=0x7fab40009cb0).stop 2024-04-06T12:14:55.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 shutdown_connections 2024-04-06T12:14:55.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 --2- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fab3c032700 0x7fab3c034bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:55.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 --2- 172.21.15.195:0/1236575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab500611f0 0x7fab501077d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:55.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 >> 172.21.15.195:0/1236575 conn(0x7fab500f1c10 msgr2=0x7fab500f25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:55.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 shutdown_connections 2024-04-06T12:14:55.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:55.244+0000 7fab56844700 1 -- 172.21.15.195:0/1236575 wait complete. 2024-04-06T12:14:55.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:54.004364+0000 mgr.smithi152.lynahm (mgr.14156) 20 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:55.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:55.139785+0000 mon.smithi152 (mon.0) 113 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:55.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:55.243762+0000 mon.smithi152 (mon.0) 114 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:14:55.778 DEBUG:teuthology.orchestra.run.smithi195:mon.smithi195> sudo journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi195.service 2024-04-06T12:14:55.781 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:14:55.781 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:14:55.810 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:-- Logs begin at Sat 2024-04-06 12:02:27 UTC. -- 2024-04-06T12:14:56.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:55.236932+0000 mgr.smithi152.lynahm (mgr.14156) 21 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi152:172.21.15.152=smithi152;smithi195:172.21.15.195=smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:14:56.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:14:55.238653+0000 mgr.smithi152.lynahm (mgr.14156) 22 : cephadm [INF] Saving service mon spec with placement smithi152:172.21.15.152=smithi152;smithi195:172.21.15.195=smithi195;count:2 2024-04-06T12:14:57.542 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.542+0000 7fe786936700 1 -- 172.21.15.195:0/1560218845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 msgr2=0x7fe7800f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.542+0000 7fe786936700 1 --2- 172.21.15.195:0/1560218845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 0x7fe7800f68d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fe770004770 tx=0x7fe770009cb0).stop 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.542+0000 7fe786936700 1 -- 172.21.15.195:0/1560218845 shutdown_connections 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.542+0000 7fe786936700 1 --2- 172.21.15.195:0/1560218845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 0x7fe7800f68d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.542+0000 7fe786936700 1 -- 172.21.15.195:0/1560218845 >> 172.21.15.195:0/1560218845 conn(0x7fe7800f1c10 msgr2=0x7fe7800f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.542+0000 7fe786936700 1 -- 172.21.15.195:0/1560218845 shutdown_connections 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.542+0000 7fe786936700 1 -- 172.21.15.195:0/1560218845 wait complete. 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.542+0000 7fe786936700 1 Processor -- start 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.543+0000 7fe786936700 1 -- start start 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.543+0000 7fe786936700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 0x7fe780107820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.543+0000 7fe786936700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe780107d10 con 0x7fe7800f64b0 2024-04-06T12:14:57.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.543+0000 7fe77ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 0x7fe780107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:57.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.543+0000 7fe77ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 0x7fe780107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:32830/0 (socket says 172.21.15.195:32830) 2024-04-06T12:14:57.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.543+0000 7fe77ffff700 1 -- 172.21.15.195:0/1755668577 learned_addr learned my addr 172.21.15.195:0/1755668577 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:14:57.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.543+0000 7fe77ffff700 1 -- 172.21.15.195:0/1755668577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe770005040 con 0x7fe7800f64b0 2024-04-06T12:14:57.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.543+0000 7fe77ffff700 1 --2- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 0x7fe780107820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe770009300 tx=0x7fe770009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:57.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.544+0000 7fe77d7fa700 1 -- 172.21.15.195:0/1755668577 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe770018070 con 0x7fe7800f64b0 2024-04-06T12:14:57.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.544+0000 7fe77d7fa700 1 -- 172.21.15.195:0/1755668577 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe770009890 con 0x7fe7800f64b0 2024-04-06T12:14:57.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.544+0000 7fe77d7fa700 1 -- 172.21.15.195:0/1755668577 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe77001c400 con 0x7fe7800f64b0 2024-04-06T12:14:57.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.544+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe780107f10 con 0x7fe7800f64b0 2024-04-06T12:14:57.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.544+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7801083a0 con 0x7fe7800f64b0 2024-04-06T12:14:57.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.544+0000 7fe77d7fa700 1 -- 172.21.15.195:0/1755668577 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7fe77001d420 con 0x7fe7800f64b0 2024-04-06T12:14:57.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.545+0000 7fe77d7fa700 1 --2- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fe768032750 0x7fe768034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:14:57.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.545+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe780046ce0 con 0x7fe7800f64b0 2024-04-06T12:14:57.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.545+0000 7fe77d7fa700 1 -- 172.21.15.195:0/1755668577 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fe770044660 con 0x7fe7800f64b0 2024-04-06T12:14:57.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.545+0000 7fe77f7fe700 1 --2- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fe768032750 0x7fe768034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:14:57.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.545+0000 7fe77f7fe700 1 --2- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fe768032750 0x7fe768034c10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe774009780 tx=0x7fe774006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:14:57.548 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.550+0000 7fe77d7fa700 1 -- 172.21.15.195:0/1755668577 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe77001b760 con 0x7fe7800f64b0 2024-04-06T12:14:57.773 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.774+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe7800fbfa0 con 0x7fe7800f64b0 2024-04-06T12:14:57.774 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.775+0000 7fe77d7fa700 1 -- 172.21.15.195:0/1755668577 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fe77001b370 con 0x7fe7800f64b0 2024-04-06T12:14:57.774 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:14:57.774 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:13:14.047153Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T12:14:57.775 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.776+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fe768032750 msgr2=0x7fe768034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:57.775 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.776+0000 7fe786936700 1 --2- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fe768032750 0x7fe768034c10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe774009780 tx=0x7fe774006cc0).stop 2024-04-06T12:14:57.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.776+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 msgr2=0x7fe780107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:14:57.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.776+0000 7fe786936700 1 --2- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 0x7fe780107820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe770009300 tx=0x7fe770009cb0).stop 2024-04-06T12:14:57.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.776+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 shutdown_connections 2024-04-06T12:14:57.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.776+0000 7fe786936700 1 --2- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fe768032750 0x7fe768034c10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:57.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.776+0000 7fe786936700 1 --2- 172.21.15.195:0/1755668577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7800f64b0 0x7fe780107820 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:14:57.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.776+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 >> 172.21.15.195:0/1755668577 conn(0x7fe7800f1c10 msgr2=0x7fe780060dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:14:57.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.777+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 shutdown_connections 2024-04-06T12:14:57.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:14:57.777+0000 7fe786936700 1 -- 172.21.15.195:0/1755668577 wait complete. 2024-04-06T12:14:57.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:57 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:56.004563+0000 mgr.smithi152.lynahm (mgr.14156) 23 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:14:57.777 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-06T12:14:58.753 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:14:57.776381+0000 mon.smithi152 (mon.0) 115 : audit [DBG] from='client.? 172.21.15.195:0/1755668577' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:14:59.451 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:14:59.451 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:14:59.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:14:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:14:58.004816+0000 mgr.smithi152.lynahm (mgr.14156) 24 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:01.250 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.251+0000 7fd8eaa82700 1 -- 172.21.15.195:0/4083640148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 msgr2=0x7fd8e40f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:01.251 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.251+0000 7fd8eaa82700 1 --2- 172.21.15.195:0/4083640148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 0x7fd8e40f68d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fd8d8004770 tx=0x7fd8d8009cb0).stop 2024-04-06T12:15:01.251 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.251+0000 7fd8eaa82700 1 -- 172.21.15.195:0/4083640148 shutdown_connections 2024-04-06T12:15:01.251 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.251+0000 7fd8eaa82700 1 --2- 172.21.15.195:0/4083640148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 0x7fd8e40f68d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:01.251 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.251+0000 7fd8eaa82700 1 -- 172.21.15.195:0/4083640148 >> 172.21.15.195:0/4083640148 conn(0x7fd8e40f1c10 msgr2=0x7fd8e40f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:01.251 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.251+0000 7fd8eaa82700 1 -- 172.21.15.195:0/4083640148 shutdown_connections 2024-04-06T12:15:01.251 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.251+0000 7fd8eaa82700 1 -- 172.21.15.195:0/4083640148 wait complete. 2024-04-06T12:15:01.253 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.252+0000 7fd8eaa82700 1 Processor -- start 2024-04-06T12:15:01.253 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.252+0000 7fd8eaa82700 1 -- start start 2024-04-06T12:15:01.253 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.252+0000 7fd8eaa82700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 0x7fd8e4106720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.252+0000 7fd8eaa82700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e4106c10 con 0x7fd8e40f64b0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8e881e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 0x7fd8e4106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8e881e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 0x7fd8e4106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:32848/0 (socket says 172.21.15.195:32848) 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8e881e700 1 -- 172.21.15.195:0/3727369945 learned_addr learned my addr 172.21.15.195:0/3727369945 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8e881e700 1 -- 172.21.15.195:0/3727369945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8005040 con 0x7fd8e40f64b0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8e881e700 1 --2- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 0x7fd8e4106720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fd8d8009300 tx=0x7fd8d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8e1f76700 1 -- 172.21.15.195:0/3727369945 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8d801a070 con 0x7fd8e40f64b0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8e1f76700 1 -- 172.21.15.195:0/3727369945 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fd8d801f8b0 con 0x7fd8e40f64b0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e4106e10 con 0x7fd8e40f64b0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8e1f76700 1 -- 172.21.15.195:0/3727369945 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8d801e630 con 0x7fd8e40f64b0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.253+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e41072a0 con 0x7fd8e40f64b0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.254+0000 7fd8e1f76700 1 -- 172.21.15.195:0/3727369945 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7fd8d801fa20 con 0x7fd8e40f64b0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.254+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e4046ce0 con 0x7fd8e40f64b0 2024-04-06T12:15:01.254 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.254+0000 7fd8e1f76700 1 --2- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fd8d4032730 0x7fd8d4034bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:01.255 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.254+0000 7fd8e1f76700 1 -- 172.21.15.195:0/3727369945 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fd8d8046900 con 0x7fd8e40f64b0 2024-04-06T12:15:01.255 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.255+0000 7fd8e3fff700 1 --2- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fd8d4032730 0x7fd8d4034bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:01.255 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.255+0000 7fd8e3fff700 1 --2- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fd8d4032730 0x7fd8d4034bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd8d0009780 tx=0x7fd8d0006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:01.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.260+0000 7fd8e1f76700 1 -- 172.21.15.195:0/3727369945 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd8d8029440 con 0x7fd8e40f64b0 2024-04-06T12:15:01.483 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.484+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd8e4108150 con 0x7fd8e40f64b0 2024-04-06T12:15:01.484 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.485+0000 7fd8e1f76700 1 -- 172.21.15.195:0/3727369945 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fd8d801d370 con 0x7fd8e40f64b0 2024-04-06T12:15:01.484 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:15:01.484 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:13:14.047153Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T12:15:01.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.486+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fd8d4032730 msgr2=0x7fd8d4034bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:01.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.486+0000 7fd8eaa82700 1 --2- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fd8d4032730 0x7fd8d4034bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd8d0009780 tx=0x7fd8d0006cc0).stop 2024-04-06T12:15:01.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.486+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 msgr2=0x7fd8e4106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:01.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.486+0000 7fd8eaa82700 1 --2- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 0x7fd8e4106720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fd8d8009300 tx=0x7fd8d8009cb0).stop 2024-04-06T12:15:01.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.486+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 shutdown_connections 2024-04-06T12:15:01.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.486+0000 7fd8eaa82700 1 --2- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7fd8d4032730 0x7fd8d4034bf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:01.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.487+0000 7fd8eaa82700 1 --2- 172.21.15.195:0/3727369945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8e40f64b0 0x7fd8e4106720 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:01.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.487+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 >> 172.21.15.195:0/3727369945 conn(0x7fd8e40f1c10 msgr2=0x7fd8e40f2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:01.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.487+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 shutdown_connections 2024-04-06T12:15:01.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:01.487+0000 7fd8eaa82700 1 -- 172.21.15.195:0/3727369945 wait complete. 2024-04-06T12:15:01.487 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-06T12:15:01.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:00.005013+0000 mgr.smithi152.lynahm (mgr.14156) 25 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:02.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:01.486483+0000 mon.smithi152 (mon.0) 116 : audit [DBG] from='client.? 172.21.15.195:0/3727369945' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:03.150 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:15:03.151 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:15:03.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:02.005257+0000 mgr.smithi152.lynahm (mgr.14156) 26 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:04.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.918+0000 7f5fecb67700 1 -- 172.21.15.195:0/1133525883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 msgr2=0x7f5fe80f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:04.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.918+0000 7f5fecb67700 1 --2- 172.21.15.195:0/1133525883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 0x7f5fe80f79e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5fd8004770 tx=0x7f5fd8009cb0).stop 2024-04-06T12:15:04.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.918+0000 7f5fecb67700 1 -- 172.21.15.195:0/1133525883 shutdown_connections 2024-04-06T12:15:04.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.918+0000 7f5fecb67700 1 --2- 172.21.15.195:0/1133525883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 0x7f5fe80f79e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:04.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.918+0000 7f5fecb67700 1 -- 172.21.15.195:0/1133525883 >> 172.21.15.195:0/1133525883 conn(0x7f5fe80f2d40 msgr2=0x7f5fe80f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.918+0000 7f5fecb67700 1 -- 172.21.15.195:0/1133525883 shutdown_connections 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.918+0000 7f5fecb67700 1 -- 172.21.15.195:0/1133525883 wait complete. 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.919+0000 7f5fecb67700 1 Processor -- start 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.919+0000 7f5fecb67700 1 -- start start 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.919+0000 7f5fecb67700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 0x7f5fe8107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.919+0000 7f5fecb67700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8107d30 con 0x7f5fe80f75c0 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.919+0000 7f5fe659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 0x7f5fe8107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.919+0000 7f5fe659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 0x7f5fe8107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:32870/0 (socket says 172.21.15.195:32870) 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.919+0000 7f5fe659c700 1 -- 172.21.15.195:0/1088758332 learned_addr learned my addr 172.21.15.195:0/1088758332 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.920+0000 7f5fe659c700 1 -- 172.21.15.195:0/1088758332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8005040 con 0x7f5fe80f75c0 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.920+0000 7f5fe659c700 1 --2- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 0x7f5fe8107840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f5fd8009300 tx=0x7f5fd8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.920+0000 7f5fd77fe700 1 -- 172.21.15.195:0/1088758332 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fd8018070 con 0x7f5fe80f75c0 2024-04-06T12:15:04.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.920+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe8107f30 con 0x7f5fe80f75c0 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.920+0000 7f5fd77fe700 1 -- 172.21.15.195:0/1088758332 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5fd8009890 con 0x7f5fe80f75c0 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.920+0000 7f5fd77fe700 1 -- 172.21.15.195:0/1088758332 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fd801c400 con 0x7f5fe80f75c0 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.920+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe81083c0 con 0x7f5fe80f75c0 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.921+0000 7f5fd77fe700 1 -- 172.21.15.195:0/1088758332 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7f5fd801d420 con 0x7f5fe80f75c0 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.921+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe8046ce0 con 0x7f5fe80f75c0 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.921+0000 7f5fd77fe700 1 --2- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5fd0032700 0x7f5fd0034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.921+0000 7f5fd77fe700 1 -- 172.21.15.195:0/1088758332 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f5fd80445c0 con 0x7f5fe80f75c0 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.921+0000 7f5fe5d9b700 1 --2- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5fd0032700 0x7f5fd0034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.922+0000 7f5fe5d9b700 1 --2- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5fd0032700 0x7f5fd0034bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5fdc009780 tx=0x7f5fdc006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:04.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:04.926+0000 7f5fd77fe700 1 -- 172.21.15.195:0/1088758332 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5fd8025d20 con 0x7f5fe80f75c0 2024-04-06T12:15:05.147 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.148+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5fe8109270 con 0x7f5fe80f75c0 2024-04-06T12:15:05.147 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.148+0000 7f5fd77fe700 1 -- 172.21.15.195:0/1088758332 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f5fd8025b40 con 0x7f5fe80f75c0 2024-04-06T12:15:05.148 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:15:05.148 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:13:14.047153Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T12:15:05.149 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5fd0032700 msgr2=0x7f5fd0034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:05.149 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 --2- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5fd0032700 0x7f5fd0034bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5fdc009780 tx=0x7f5fdc006cc0).stop 2024-04-06T12:15:05.149 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 msgr2=0x7f5fe8107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:05.149 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 --2- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 0x7f5fe8107840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f5fd8009300 tx=0x7f5fd8009cb0).stop 2024-04-06T12:15:05.149 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 shutdown_connections 2024-04-06T12:15:05.149 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 --2- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f5fd0032700 0x7f5fd0034bc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:05.149 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 --2- 172.21.15.195:0/1088758332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe80f75c0 0x7f5fe8107840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:05.149 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 >> 172.21.15.195:0/1088758332 conn(0x7f5fe80f2d40 msgr2=0x7f5fe80f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:05.150 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 shutdown_connections 2024-04-06T12:15:05.150 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:05.150+0000 7f5fecb67700 1 -- 172.21.15.195:0/1088758332 wait complete. 2024-04-06T12:15:05.150 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-06T12:15:05.680 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:04.005521+0000 mgr.smithi152.lynahm (mgr.14156) 27 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:05.680 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:05.149962+0000 mon.smithi152 (mon.0) 117 : audit [DBG] from='client.? 172.21.15.195:0/1088758332' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:06.786 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:15:06.786 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:15:07.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:05.985832+0000 mon.smithi152 (mon.0) 118 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:07.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:05.987815+0000 mgr.smithi152.lynahm (mgr.14156) 28 : cephadm [INF] Deploying daemon node-exporter.smithi152 on smithi152 2024-04-06T12:15:07.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:06.005715+0000 mgr.smithi152.lynahm (mgr.14156) 29 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:08.666 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.667+0000 7f412576f700 1 -- 172.21.15.195:0/2618233788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 msgr2=0x7f41200f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:08.666 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.667+0000 7f412576f700 1 --2- 172.21.15.195:0/2618233788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 0x7f41200f79e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4108004990 tx=0x7f4108009c50).stop 2024-04-06T12:15:08.666 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.667+0000 7f412576f700 1 -- 172.21.15.195:0/2618233788 shutdown_connections 2024-04-06T12:15:08.666 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.667+0000 7f412576f700 1 --2- 172.21.15.195:0/2618233788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 0x7f41200f79e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:08.666 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.667+0000 7f412576f700 1 -- 172.21.15.195:0/2618233788 >> 172.21.15.195:0/2618233788 conn(0x7f41200f2de0 msgr2=0x7f41200f5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:08.666 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.667+0000 7f412576f700 1 -- 172.21.15.195:0/2618233788 shutdown_connections 2024-04-06T12:15:08.666 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.667+0000 7f412576f700 1 -- 172.21.15.195:0/2618233788 wait complete. 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.667+0000 7f412576f700 1 Processor -- start 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.667+0000 7f412576f700 1 -- start start 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.668+0000 7f412576f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 0x7f4120107830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.668+0000 7f412576f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4120107d20 con 0x7f41200f75c0 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.668+0000 7f411effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 0x7f4120107830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.668+0000 7f411effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 0x7f4120107830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:59682/0 (socket says 172.21.15.195:59682) 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.668+0000 7f411effd700 1 -- 172.21.15.195:0/3643949800 learned_addr learned my addr 172.21.15.195:0/3643949800 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.668+0000 7f411effd700 1 -- 172.21.15.195:0/3643949800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080045d0 con 0x7f41200f75c0 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.668+0000 7f411effd700 1 --2- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 0x7f4120107830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4108004550 tx=0x7f4108009c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:08.668 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.669+0000 7f4117fff700 1 -- 172.21.15.195:0/3643949800 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f410800e040 con 0x7f41200f75c0 2024-04-06T12:15:08.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.669+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4120107f20 con 0x7f41200f75c0 2024-04-06T12:15:08.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.669+0000 7f4117fff700 1 -- 172.21.15.195:0/3643949800 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f41080097c0 con 0x7f41200f75c0 2024-04-06T12:15:08.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.669+0000 7f4117fff700 1 -- 172.21.15.195:0/3643949800 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f410801fbb0 con 0x7f41200f75c0 2024-04-06T12:15:08.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.669+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41201083b0 con 0x7f41200f75c0 2024-04-06T12:15:08.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.669+0000 7f4117fff700 1 -- 172.21.15.195:0/3643949800 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 38689+0+0 (secure 0 0 0) 0x7f4108029440 con 0x7f41200f75c0 2024-04-06T12:15:08.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.670+0000 7f4117fff700 1 --2- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f410c0326d0 0x7f410c034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:08.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.670+0000 7f4117fff700 1 -- 172.21.15.195:0/3643949800 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f4108044100 con 0x7f41200f75c0 2024-04-06T12:15:08.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.670+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4120046ce0 con 0x7f41200f75c0 2024-04-06T12:15:08.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.670+0000 7f411e7fc700 1 --2- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f410c0326d0 0x7f410c034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:08.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.670+0000 7f411e7fc700 1 --2- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f410c0326d0 0x7f410c034b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4110009780 tx=0x7f4110006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:08.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.675+0000 7f4117fff700 1 -- 172.21.15.195:0/3643949800 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4108013950 con 0x7f41200f75c0 2024-04-06T12:15:08.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.896+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f41200fd180 con 0x7f41200f75c0 2024-04-06T12:15:08.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.897+0000 7f4117fff700 1 -- 172.21.15.195:0/3643949800 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f4108010230 con 0x7f41200f75c0 2024-04-06T12:15:08.896 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:15:08.896 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:13:14.047153Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f410c0326d0 msgr2=0x7f410c034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 --2- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f410c0326d0 0x7f410c034b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4110009780 tx=0x7f4110006cc0).stop 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 msgr2=0x7f4120107830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 --2- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 0x7f4120107830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4108004550 tx=0x7f4108009c50).stop 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 shutdown_connections 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 --2- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f410c0326d0 0x7f410c034b90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 --2- 172.21.15.195:0/3643949800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41200f75c0 0x7f4120107830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 >> 172.21.15.195:0/3643949800 conn(0x7f41200f2de0 msgr2=0x7f41200f3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 shutdown_connections 2024-04-06T12:15:08.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:08.899+0000 7f412576f700 1 -- 172.21.15.195:0/3643949800 wait complete. 2024-04-06T12:15:08.899 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-06T12:15:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:08.005968+0000 mgr.smithi152.lynahm (mgr.14156) 30 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:08.898811+0000 mon.smithi152 (mon.0) 119 : audit [DBG] from='client.? 172.21.15.195:0/3643949800' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:10.443 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:15:10.443 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:15:10.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:09.206605+0000 mon.smithi152 (mon.0) 120 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:10.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:09.208782+0000 mon.smithi152 (mon.0) 121 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-06T12:15:10.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:10.144445+0000 mon.smithi152 (mon.0) 122 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:10.212830+0000 mon.smithi152 (mon.0) 123 : audit [INF] from='mgr.14156 172.21.15.152:0/4230870338' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-06T12:15:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:10.212888+0000 mon.smithi152 (mon.0) 124 : cluster [DBG] mgrmap e14: smithi152.lynahm(active, since 50s) 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.389+0000 7f400758d700 1 -- 172.21.15.195:0/636401453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 msgr2=0x7f40000f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.389+0000 7f400758d700 1 --2- 172.21.15.195:0/636401453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 0x7f40000f79e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f3ff0004770 tx=0x7f3ff0009cb0).stop 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.389+0000 7f400758d700 1 -- 172.21.15.195:0/636401453 shutdown_connections 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.389+0000 7f400758d700 1 --2- 172.21.15.195:0/636401453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 0x7f40000f79e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.389+0000 7f400758d700 1 -- 172.21.15.195:0/636401453 >> 172.21.15.195:0/636401453 conn(0x7f40000f2d40 msgr2=0x7f40000f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.389+0000 7f400758d700 1 -- 172.21.15.195:0/636401453 shutdown_connections 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.389+0000 7f400758d700 1 -- 172.21.15.195:0/636401453 wait complete. 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.389+0000 7f400758d700 1 Processor -- start 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f400758d700 1 -- start start 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f400758d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 0x7f4000107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:12.408 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f400758d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4000107d30 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f4005329700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 0x7f4000107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f4005329700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 0x7f4000107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:59692/0 (socket says 172.21.15.195:59692) 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f4005329700 1 -- 172.21.15.195:0/871492601 learned_addr learned my addr 172.21.15.195:0/871492601 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f4005329700 1 -- 172.21.15.195:0/871492601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff0005040 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f4005329700 1 --2- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 0x7f4000107840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3ff0009300 tx=0x7f3ff0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f3ff67fc700 1 -- 172.21.15.195:0/871492601 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ff0018070 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4000107f30 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f3ff67fc700 1 -- 172.21.15.195:0/871492601 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3ff0009890 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f3ff67fc700 1 -- 172.21.15.195:0/871492601 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ff001c400 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.390+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40001083c0 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.391+0000 7f3ff67fc700 1 -- 172.21.15.195:0/871492601 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 14) v1 ==== 38703+0+0 (secure 0 0 0) 0x7f3ff001d420 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.391+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4000046ce0 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.391+0000 7f3ff67fc700 1 --2- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3fec032750 0x7f3fec034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.391+0000 7f3ff67fc700 1 -- 172.21.15.195:0/871492601 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f3ff00446d0 con 0x7f40000f75c0 2024-04-06T12:15:12.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.391+0000 7f4004b28700 1 -- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3fec032750 msgr2=0x7f3fec034c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3882192194 2024-04-06T12:15:12.410 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.391+0000 7f4004b28700 1 --2- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3fec032750 0x7f3fec034c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:15:12.410 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.401+0000 7f3ff67fc700 1 -- 172.21.15.195:0/871492601 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3ff001b370 con 0x7f40000f75c0 2024-04-06T12:15:12.591 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.592+0000 7f4004b28700 1 -- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3fec032750 msgr2=0x7f3fec034c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3882192194 2024-04-06T12:15:12.591 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.592+0000 7f4004b28700 1 --2- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3fec032750 0x7f3fec034c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-04-06T12:15:12.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.623+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4000109270 con 0x7f40000f75c0 2024-04-06T12:15:12.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.624+0000 7f3ff67fc700 1 -- 172.21.15.195:0/871492601 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f3ff001b370 con 0x7f40000f75c0 2024-04-06T12:15:12.624 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:15:12.624 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:13:14.047153Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T12:15:12.625 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3fec032750 msgr2=0x7f3fec034c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T12:15:12.625 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 --2- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3fec032750 0x7f3fec034c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:15:12.625 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 msgr2=0x7f4000107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:12.625 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 --2- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 0x7f4000107840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3ff0009300 tx=0x7f3ff0009cb0).stop 2024-04-06T12:15:12.625 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 shutdown_connections 2024-04-06T12:15:12.626 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 --2- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:6800/3882192194,v1:172.21.15.152:6801/3882192194] conn(0x7f3fec032750 0x7f3fec034c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:15:12.626 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 --2- 172.21.15.195:0/871492601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40000f75c0 0x7f4000107840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:12.626 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 >> 172.21.15.195:0/871492601 conn(0x7f40000f2d40 msgr2=0x7f40000f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:12.626 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 shutdown_connections 2024-04-06T12:15:12.626 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:12.626+0000 7f400758d700 1 -- 172.21.15.195:0/871492601 wait complete. 2024-04-06T12:15:12.626 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-06T12:15:12.966 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:12.625786+0000 mon.smithi152 (mon.0) 125 : audit [DBG] from='client.? 172.21.15.195:0/871492601' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:14.319 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:15:14.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:15.483779+0000 mon.smithi152 (mon.0) 126 : cluster [INF] Active manager daemon smithi152.lynahm restarted 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:15.484093+0000 mon.smithi152 (mon.0) 127 : cluster [INF] Activating manager daemon smithi152.lynahm 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:15.489660+0000 mon.smithi152 (mon.0) 128 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:15.489763+0000 mon.smithi152 (mon.0) 129 : cluster [DBG] mgrmap e15: smithi152.lynahm(active, starting, since 0.00580764s) 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.490509+0000 mon.smithi152 (mon.0) 130 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.491160+0000 mon.smithi152 (mon.0) 131 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.491953+0000 mon.smithi152 (mon.0) 132 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.492087+0000 mon.smithi152 (mon.0) 133 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.492229+0000 mon.smithi152 (mon.0) 134 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:15:15.725 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:15.505487+0000 mon.smithi152 (mon.0) 135 : cluster [INF] Manager daemon smithi152.lynahm is now available 2024-04-06T12:15:16.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.218+0000 7f71c22cd700 1 -- 172.21.15.195:0/113106143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 msgr2=0x7f71bc0fa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:16.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.218+0000 7f71c22cd700 1 --2- 172.21.15.195:0/113106143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 0x7f71bc0fa250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f71ac004770 tx=0x7f71ac009cb0).stop 2024-04-06T12:15:16.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.219+0000 7f71c22cd700 1 -- 172.21.15.195:0/113106143 shutdown_connections 2024-04-06T12:15:16.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.219+0000 7f71c22cd700 1 --2- 172.21.15.195:0/113106143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 0x7f71bc0fa250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:16.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.219+0000 7f71c22cd700 1 -- 172.21.15.195:0/113106143 >> 172.21.15.195:0/113106143 conn(0x7f71bc0f1c10 msgr2=0x7f71bc0f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:16.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.219+0000 7f71c22cd700 1 -- 172.21.15.195:0/113106143 shutdown_connections 2024-04-06T12:15:16.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.219+0000 7f71c22cd700 1 -- 172.21.15.195:0/113106143 wait complete. 2024-04-06T12:15:16.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.219+0000 7f71c22cd700 1 Processor -- start 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.219+0000 7f71c22cd700 1 -- start start 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.220+0000 7f71c22cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 0x7f71bc1077f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.220+0000 7f71c22cd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc107ce0 con 0x7f71bc061130 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.220+0000 7f71bbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 0x7f71bc1077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.220+0000 7f71bbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 0x7f71bc1077f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:59718/0 (socket says 172.21.15.195:59718) 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.220+0000 7f71bbfff700 1 -- 172.21.15.195:0/1328196365 learned_addr learned my addr 172.21.15.195:0/1328196365 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.220+0000 7f71bbfff700 1 -- 172.21.15.195:0/1328196365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac005040 con 0x7f71bc061130 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.220+0000 7f71bbfff700 1 --2- 172.21.15.195:0/1328196365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 0x7f71bc1077f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f71ac004740 tx=0x7f71ac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.221+0000 7f71b9775700 1 -- 172.21.15.195:0/1328196365 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71ac018070 con 0x7f71bc061130 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.221+0000 7f71b9775700 1 -- 172.21.15.195:0/1328196365 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f71ac013e30 con 0x7f71bc061130 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.221+0000 7f71c22cd700 1 -- 172.21.15.195:0/1328196365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc107ee0 con 0x7f71bc061130 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.221+0000 7f71b9775700 1 -- 172.21.15.195:0/1328196365 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71ac01d600 con 0x7f71bc061130 2024-04-06T12:15:16.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.221+0000 7f71c22cd700 1 -- 172.21.15.195:0/1328196365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc108370 con 0x7f71bc061130 2024-04-06T12:15:16.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.221+0000 7f71b9775700 1 -- 172.21.15.195:0/1328196365 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 15) v1 ==== 38483+0+0 (secure 0 0 0) 0x7f71ac01d760 con 0x7f71bc061130 2024-04-06T12:15:16.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.222+0000 7f71b9775700 1 -- 172.21.15.195:0/1328196365 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f71ac045310 con 0x7f71bc061130 2024-04-06T12:15:16.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.222+0000 7f71c22cd700 1 -- 172.21.15.195:0/1328196365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc046ce0 con 0x7f71bc061130 2024-04-06T12:15:16.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.226+0000 7f71b9775700 1 -- 172.21.15.195:0/1328196365 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f71ac01bdd0 con 0x7f71bc061130 2024-04-06T12:15:16.466 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.468+0000 7f71c22cd700 1 -- 172.21.15.195:0/1328196365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f71bc109090 con 0x7f71bc061130 2024-04-06T12:15:16.466 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.468+0000 7f71b9775700 1 -- 172.21.15.195:0/1328196365 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f71ac01b370 con 0x7f71bc061130 2024-04-06T12:15:16.466 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:15:16.466 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:13:14.047153Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T12:15:16.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.470+0000 7f71c22cd700 1 -- 172.21.15.195:0/1328196365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 msgr2=0x7f71bc1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:16.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.470+0000 7f71c22cd700 1 --2- 172.21.15.195:0/1328196365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 0x7f71bc1077f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f71ac004740 tx=0x7f71ac009cb0).stop 2024-04-06T12:15:16.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.470+0000 7f71c22cd700 1 -- 172.21.15.195:0/1328196365 shutdown_connections 2024-04-06T12:15:16.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.470+0000 7f71c22cd700 1 --2- 172.21.15.195:0/1328196365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc061130 0x7f71bc1077f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:16.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.470+0000 7f71c22cd700 1 -- 172.21.15.195:0/1328196365 >> 172.21.15.195:0/1328196365 conn(0x7f71bc0f1c10 msgr2=0x7f71bc0f2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:16.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.470+0000 7f71c22cd700 1 -- 172.21.15.195:0/1328196365 shutdown_connections 2024-04-06T12:15:16.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:16.470+0000 7f71c22cd700 1 -- 172.21.15.195:0/1328196365 wait complete. 2024-04-06T12:15:16.469 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-06T12:15:17.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.600929+0000 mon.smithi152 (mon.0) 136 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:15:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.602491+0000 mon.smithi152 (mon.0) 137 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:15:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.635668+0000 mon.smithi152 (mon.0) 138 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.647200+0000 mon.smithi152 (mon.0) 139 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:15:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:15.652945+0000 mon.smithi152 (mon.0) 140 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/trash_purge_schedule"}]: dispatch 2024-04-06T12:15:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:16.075588+0000 mon.smithi152 (mon.0) 141 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:16.338041+0000 mon.smithi152 (mon.0) 142 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:16.468927+0000 mon.smithi152 (mon.0) 143 : audit [DBG] from='client.? 172.21.15.195:0/1328196365' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:16.490171+0000 mon.smithi152 (mon.0) 144 : cluster [DBG] mgrmap e16: smithi152.lynahm(active, since 1.00622s) 2024-04-06T12:15:18.105 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:15:18.105 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:15:18.851 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:17.542553+0000 mon.smithi152 (mon.0) 145 : cluster [DBG] mgrmap e17: smithi152.lynahm(active, since 2s) 2024-04-06T12:15:20.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.361+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/650074623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 msgr2=0x7f7c540f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:20.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.361+0000 7f7c5a5c0700 1 --2- 172.21.15.195:0/650074623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 0x7f7c540f68d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f7c44004770 tx=0x7f7c44009cb0).stop 2024-04-06T12:15:20.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.361+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/650074623 shutdown_connections 2024-04-06T12:15:20.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.361+0000 7f7c5a5c0700 1 --2- 172.21.15.195:0/650074623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 0x7f7c540f68d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:20.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.361+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/650074623 >> 172.21.15.195:0/650074623 conn(0x7f7c540f1c10 msgr2=0x7f7c540f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:20.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.361+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/650074623 shutdown_connections 2024-04-06T12:15:20.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.361+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/650074623 wait complete. 2024-04-06T12:15:20.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.362+0000 7f7c5a5c0700 1 Processor -- start 2024-04-06T12:15:20.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.362+0000 7f7c5a5c0700 1 -- start start 2024-04-06T12:15:20.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.362+0000 7f7c5a5c0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 0x7f7c540fe490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:20.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.362+0000 7f7c5a5c0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540fc910 con 0x7f7c540f64b0 2024-04-06T12:15:20.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.362+0000 7f7c53fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 0x7f7c540fe490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:20.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.362+0000 7f7c53fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 0x7f7c540fe490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:39628/0 (socket says 172.21.15.195:39628) 2024-04-06T12:15:20.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.362+0000 7f7c53fff700 1 -- 172.21.15.195:0/873331213 learned_addr learned my addr 172.21.15.195:0/873331213 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:15:20.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.362+0000 7f7c53fff700 1 -- 172.21.15.195:0/873331213 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44005040 con 0x7f7c540f64b0 2024-04-06T12:15:20.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.363+0000 7f7c53fff700 1 --2- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 0x7f7c540fe490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7c44009300 tx=0x7f7c44009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.363+0000 7f7c517fa700 1 -- 172.21.15.195:0/873331213 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c44018070 con 0x7f7c540f64b0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.363+0000 7f7c517fa700 1 -- 172.21.15.195:0/873331213 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7c44009890 con 0x7f7c540f64b0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.363+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c540fcab0 con 0x7f7c540f64b0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.363+0000 7f7c517fa700 1 -- 172.21.15.195:0/873331213 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c4401c400 con 0x7f7c540f64b0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.363+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c540fcf40 con 0x7f7c540f64b0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.363+0000 7f7c517fa700 1 -- 172.21.15.195:0/873331213 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) v1 ==== 38747+0+0 (secure 0 0 0) 0x7f7c4401c6c0 con 0x7f7c540f64b0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.364+0000 7f7c517fa700 1 --2- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7c3c0327f0 0x7f7c3c034cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.364+0000 7f7c517fa700 1 -- 172.21.15.195:0/873331213 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f7c440456e0 con 0x7f7c540f64b0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.364+0000 7f7c537fe700 1 --2- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7c3c0327f0 0x7f7c3c034cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.364+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5405a310 con 0x7f7c540f64b0 2024-04-06T12:15:20.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.364+0000 7f7c537fe700 1 --2- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7c3c0327f0 0x7f7c3c034cb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7c48009780 tx=0x7f7c48006cc0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:20.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.369+0000 7f7c517fa700 1 -- 172.21.15.195:0/873331213 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7c44024300 con 0x7f7c540f64b0 2024-04-06T12:15:20.597 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.599+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7c540fd640 con 0x7f7c540f64b0 2024-04-06T12:15:20.597 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.599+0000 7f7c517fa700 1 -- 172.21.15.195:0/873331213 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f7c4401bb60 con 0x7f7c540f64b0 2024-04-06T12:15:20.598 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:15:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:13:14.047153Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T12:15:20.599 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7c3c0327f0 msgr2=0x7f7c3c034cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:20.599 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 --2- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7c3c0327f0 0x7f7c3c034cb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7c48009780 tx=0x7f7c48006cc0).stop 2024-04-06T12:15:20.599 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 msgr2=0x7f7c540fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:20.599 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 --2- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 0x7f7c540fe490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7c44009300 tx=0x7f7c44009cb0).stop 2024-04-06T12:15:20.600 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 shutdown_connections 2024-04-06T12:15:20.600 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 --2- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7c3c0327f0 0x7f7c3c034cb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:20.600 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 --2- 172.21.15.195:0/873331213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c540f64b0 0x7f7c540fe490 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:20.600 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 >> 172.21.15.195:0/873331213 conn(0x7f7c540f1c10 msgr2=0x7f7c54060dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:20.600 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 shutdown_connections 2024-04-06T12:15:20.600 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:20.601+0000 7f7c5a5c0700 1 -- 172.21.15.195:0/873331213 wait complete. 2024-04-06T12:15:20.600 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-06T12:15:21.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:20.599887+0000 mon.smithi152 (mon.0) 146 : audit [DBG] from='client.? 172.21.15.195:0/873331213' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:22.277 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:15:22.278 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:15:22.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:21.302423+0000 mon.smithi152 (mon.0) 147 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:22.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:21.808301+0000 mon.smithi152 (mon.0) 148 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:22.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.087007+0000 mon.smithi152 (mon.0) 149 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:15:23.779 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.342771+0000 mon.smithi152 (mon.0) 150 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:23.779 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.343289+0000 mon.smithi152 (mon.0) 151 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:15:23.780 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.343979+0000 mon.smithi152 (mon.0) 152 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:23.780 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.344548+0000 mon.smithi152 (mon.0) 153 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:15:23.780 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:22.345584+0000 mgr.smithi152.lynahm (mgr.14196) 1 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:15:23.780 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:22.345843+0000 mgr.smithi152.lynahm (mgr.14196) 2 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:15:23.780 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:22.365667+0000 mgr.smithi152.lynahm (mgr.14196) 3 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:15:23.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:22.368264+0000 mgr.smithi152.lynahm (mgr.14196) 4 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:15:23.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.395322+0000 mon.smithi152 (mon.0) 154 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:23.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.398716+0000 mon.smithi152 (mon.0) 155 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:23.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.402666+0000 mon.smithi152 (mon.0) 156 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:23.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.404249+0000 mon.smithi152 (mon.0) 157 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:15:23.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.407816+0000 mon.smithi152 (mon.0) 158 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-06T12:15:23.782 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:22.408406+0000 mon.smithi152 (mon.0) 159 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:23.782 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:22.408879+0000 mgr.smithi152.lynahm (mgr.14196) 5 : cephadm [INF] Deploying daemon crash.smithi195 on smithi195 2024-04-06T12:15:25.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.470+0000 7fb917609700 1 -- 172.21.15.195:0/695453025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 msgr2=0x7fb9100fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.470+0000 7fb917609700 1 --2- 172.21.15.195:0/695453025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 0x7fb9100fda00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb90c004770 tx=0x7fb90c009cb0).stop 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.471+0000 7fb917609700 1 -- 172.21.15.195:0/695453025 shutdown_connections 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.471+0000 7fb917609700 1 --2- 172.21.15.195:0/695453025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 0x7fb9100fda00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.471+0000 7fb917609700 1 -- 172.21.15.195:0/695453025 >> 172.21.15.195:0/695453025 conn(0x7fb9100f3220 msgr2=0x7fb9100f5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.471+0000 7fb917609700 1 -- 172.21.15.195:0/695453025 shutdown_connections 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.471+0000 7fb917609700 1 -- 172.21.15.195:0/695453025 wait complete. 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.471+0000 7fb917609700 1 Processor -- start 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.471+0000 7fb917609700 1 -- start start 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.472+0000 7fb917609700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 0x7fb91010d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.472+0000 7fb917609700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91010de40 con 0x7fb9100fd620 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.472+0000 7fb9153a5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 0x7fb91010d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:25.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.472+0000 7fb9153a5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 0x7fb91010d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:39638/0 (socket says 172.21.15.195:39638) 2024-04-06T12:15:25.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.472+0000 7fb9153a5700 1 -- 172.21.15.195:0/3206200754 learned_addr learned my addr 172.21.15.195:0/3206200754 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:15:25.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.472+0000 7fb9153a5700 1 -- 172.21.15.195:0/3206200754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c005040 con 0x7fb9100fd620 2024-04-06T12:15:25.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.472+0000 7fb9153a5700 1 --2- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 0x7fb91010d950 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb90c004740 tx=0x7fb90c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:25.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.473+0000 7fb9067fc700 1 -- 172.21.15.195:0/3206200754 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90c018070 con 0x7fb9100fd620 2024-04-06T12:15:25.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.473+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91010e040 con 0x7fb9100fd620 2024-04-06T12:15:25.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.473+0000 7fb9067fc700 1 -- 172.21.15.195:0/3206200754 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb90c009860 con 0x7fb9100fd620 2024-04-06T12:15:25.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.473+0000 7fb9067fc700 1 -- 172.21.15.195:0/3206200754 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90c01c5b0 con 0x7fb9100fd620 2024-04-06T12:15:25.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.473+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91010e450 con 0x7fb9100fd620 2024-04-06T12:15:25.473 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.474+0000 7fb9067fc700 1 -- 172.21.15.195:0/3206200754 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) v1 ==== 38747+0+0 (secure 0 0 0) 0x7fb90c01c820 con 0x7fb9100fd620 2024-04-06T12:15:25.473 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.474+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91005f150 con 0x7fb9100fd620 2024-04-06T12:15:25.473 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.474+0000 7fb9067fc700 1 --2- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb8fc0327d0 0x7fb8fc034c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:25.473 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.474+0000 7fb9067fc700 1 -- 172.21.15.195:0/3206200754 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fb90c0440c0 con 0x7fb9100fd620 2024-04-06T12:15:25.473 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.474+0000 7fb914ba4700 1 --2- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb8fc0327d0 0x7fb8fc034c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:25.473 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.475+0000 7fb914ba4700 1 --2- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb8fc0327d0 0x7fb8fc034c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb900009780 tx=0x7fb900006cc0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:25.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.479+0000 7fb9067fc700 1 -- 172.21.15.195:0/3206200754 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb90c024b40 con 0x7fb9100fd620 2024-04-06T12:15:25.733 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.735+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb910108fd0 con 0x7fb9100fd620 2024-04-06T12:15:25.733 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.736+0000 7fb9067fc700 1 -- 172.21.15.195:0/3206200754 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fb90c022210 con 0x7fb9100fd620 2024-04-06T12:15:25.734 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:15:25.734 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:13:14.047153Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T12:15:25.735 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb8fc0327d0 msgr2=0x7fb8fc034c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 --2- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb8fc0327d0 0x7fb8fc034c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb900009780 tx=0x7fb900006cc0).stop 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 msgr2=0x7fb91010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 --2- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 0x7fb91010d950 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb90c004740 tx=0x7fb90c009cb0).stop 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 shutdown_connections 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 --2- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb8fc0327d0 0x7fb8fc034c90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 --2- 172.21.15.195:0/3206200754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9100fd620 0x7fb91010d950 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 >> 172.21.15.195:0/3206200754 conn(0x7fb9100f3220 msgr2=0x7fb9100f3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 shutdown_connections 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:25.737+0000 7fb917609700 1 -- 172.21.15.195:0/3206200754 wait complete. 2024-04-06T12:15:25.736 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-06T12:15:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:25.736230+0000 mon.smithi152 (mon.0) 160 : audit [DBG] from='client.? 172.21.15.195:0/3206200754' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:27.493 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:15:27.493 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:15:27.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:26.174389+0000 mon.smithi152 (mon.0) 161 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:27.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:26.176495+0000 mon.smithi152 (mon.0) 162 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:15:27.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:26.178600+0000 mon.smithi152 (mon.0) 163 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-06T12:15:27.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:26.179351+0000 mon.smithi152 (mon.0) 164 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:15:27.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:26.180122+0000 mon.smithi152 (mon.0) 165 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:27.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:26.180737+0000 mgr.smithi152.lynahm (mgr.14196) 6 : cephadm [INF] Deploying daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:15:29.848 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.850+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3265227722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 msgr2=0x7f9c380f8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.850+0000 7f9c3eb68700 1 --2- 172.21.15.195:0/3265227722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 0x7f9c380f8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f9c2c004770 tx=0x7f9c2c009cb0).stop 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.850+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3265227722 shutdown_connections 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.850+0000 7f9c3eb68700 1 --2- 172.21.15.195:0/3265227722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 0x7f9c380f8a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.850+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3265227722 >> 172.21.15.195:0/3265227722 conn(0x7f9c3806c440 msgr2=0x7f9c3806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.850+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3265227722 shutdown_connections 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.850+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3265227722 wait complete. 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c3eb68700 1 Processor -- start 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c3eb68700 1 -- start start 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c3eb68700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 0x7f9c3810d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:29.849 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c3eb68700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3810de20 con 0x7f9c380f8690 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c3c904700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 0x7f9c3810d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c3c904700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 0x7f9c3810d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.195:51070/0 (socket says 172.21.15.195:51070) 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c3c904700 1 -- 172.21.15.195:0/3409956110 learned_addr learned my addr 172.21.15.195:0/3409956110 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c3c904700 1 -- 172.21.15.195:0/3409956110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c005040 con 0x7f9c380f8690 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c3c904700 1 --2- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 0x7f9c3810d930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f9c2c004740 tx=0x7f9c2c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.851+0000 7f9c35ffb700 1 -- 172.21.15.195:0/3409956110 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c2c018070 con 0x7f9c380f8690 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.852+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3810e020 con 0x7f9c380f8690 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.852+0000 7f9c35ffb700 1 -- 172.21.15.195:0/3409956110 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9c2c009860 con 0x7f9c380f8690 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.852+0000 7f9c35ffb700 1 -- 172.21.15.195:0/3409956110 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c2c01c5b0 con 0x7f9c380f8690 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.852+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3810e430 con 0x7f9c380f8690 2024-04-06T12:15:29.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.853+0000 7f9c35ffb700 1 -- 172.21.15.195:0/3409956110 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) v1 ==== 38747+0+0 (secure 0 0 0) 0x7f9c2c01c820 con 0x7f9c380f8690 2024-04-06T12:15:29.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.853+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3805f1f0 con 0x7f9c380f8690 2024-04-06T12:15:29.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.853+0000 7f9c35ffb700 1 --2- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9c280327d0 0x7f9c28034c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:29.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.853+0000 7f9c35ffb700 1 -- 172.21.15.195:0/3409956110 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f9c2c044100 con 0x7f9c380f8690 2024-04-06T12:15:29.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.853+0000 7f9c37fff700 1 --2- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9c280327d0 0x7f9c28034c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:29.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.853+0000 7f9c37fff700 1 --2- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9c280327d0 0x7f9c28034c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9c24009780 tx=0x7f9c24006cc0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:29.856 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:29.858+0000 7f9c35ffb700 1 -- 172.21.15.195:0/3409956110 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9c2c024d50 con 0x7f9c380f8690 2024-04-06T12:15:30.098 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.100+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9c38108fb0 con 0x7f9c380f8690 2024-04-06T12:15:30.100 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.102+0000 7f9c35ffb700 1 -- 172.21.15.195:0/3409956110 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f9c2c0242f0 con 0x7f9c380f8690 2024-04-06T12:15:30.100 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:15:30.100 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:13:14.047153Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-06T12:15:30.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9c280327d0 msgr2=0x7f9c28034c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:30.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 --2- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9c280327d0 0x7f9c28034c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9c24009780 tx=0x7f9c24006cc0).stop 2024-04-06T12:15:30.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 msgr2=0x7f9c3810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:30.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 --2- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 0x7f9c3810d930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f9c2c004740 tx=0x7f9c2c009cb0).stop 2024-04-06T12:15:30.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 shutdown_connections 2024-04-06T12:15:30.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 --2- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9c280327d0 0x7f9c28034c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:30.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 --2- 172.21.15.195:0/3409956110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c380f8690 0x7f9c3810d930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:30.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 >> 172.21.15.195:0/3409956110 conn(0x7f9c3806c440 msgr2=0x7f9c380f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:30.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 shutdown_connections 2024-04-06T12:15:30.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:30.104+0000 7f9c3eb68700 1 -- 172.21.15.195:0/3409956110 wait complete. 2024-04-06T12:15:30.104 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-06T12:15:30.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:29.101730+0000 mon.smithi152 (mon.0) 166 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:30.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:29.103772+0000 mon.smithi152 (mon.0) 167 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:15:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:29.104556+0000 mon.smithi152 (mon.0) 168 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:29.105226+0000 mgr.smithi152.lynahm (mgr.14196) 7 : cephadm [INF] Deploying daemon mon.smithi195 on smithi195 2024-04-06T12:15:31.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:31 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:30.102934+0000 mon.smithi152 (mon.0) 169 : audit [DBG] from='client.? 172.21.15.195:0/3409956110' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:31.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:31 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:30.638633+0000 mon.smithi152 (mon.0) 170 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:32.187 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-06T12:15:32.188 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mon dump -f json 2024-04-06T12:15:33.823 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: debug 2024-04-06T12:15:33.746+0000 7fcecacc8700 1 mon.smithi195@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-04-06T12:15:34.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:34 smithi195 bash[42839]: 2fb68a318ff3d0c7d93fa645c21d3f500762663b24103ffa7c8dd13fb9c9c07a 2024-04-06T12:15:34.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:34 smithi195 systemd[1]: Started Ceph mon.smithi195 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:15:39.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:33.753617+0000 mon.smithi152 (mon.0) 172 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:15:39.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:33.753791+0000 mon.smithi152 (mon.0) 173 : cluster [INF] mon.smithi152 calling monitor election 2024-04-06T12:15:39.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:33.769054+0000 mon.smithi152 (mon.0) 174 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:34.357686+0000 mon.smithi152 (mon.0) 175 : audit [DBG] from='mgr.? 172.21.15.195:0/3076723631' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:15:39.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:34.750798+0000 mon.smithi152 (mon.0) 176 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:35.493544+0000 mgr.smithi152.lynahm (mgr.14196) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:35.750735+0000 mon.smithi152 (mon.0) 177 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:35.751846+0000 mon.smithi195 (mon.1) 1 : cluster [INF] mon.smithi195 calling monitor election 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:36.751138+0000 mon.smithi152 (mon.0) 178 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:37.493895+0000 mgr.smithi152.lynahm (mgr.14196) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:37.750979+0000 mon.smithi152 (mon.0) 179 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:38.751227+0000 mon.smithi152 (mon.0) 180 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:38.782760+0000 mon.smithi152 (mon.0) 181 : cluster [INF] mon.smithi152 is new leader, mons smithi152,smithi195 in quorum (ranks 0,1) 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:38.786928+0000 mon.smithi152 (mon.0) 182 : cluster [DBG] monmap e2: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:38.799612+0000 mon.smithi152 (mon.0) 183 : cluster [DBG] fsmap 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:38.799658+0000 mon.smithi152 (mon.0) 184 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:38.799887+0000 mon.smithi152 (mon.0) 185 : cluster [DBG] mgrmap e17: smithi152.lynahm(active, since 23s) 2024-04-06T12:15:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:38.800139+0000 mon.smithi152 (mon.0) 186 : cluster [INF] overall HEALTH_OK 2024-04-06T12:15:39.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:38.800732+0000 mon.smithi152 (mon.0) 187 : cluster [DBG] Standby manager daemon smithi195.ausetj started 2024-04-06T12:15:39.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:38.802053+0000 mon.smithi152 (mon.0) 188 : audit [DBG] from='mgr.? 172.21.15.195:0/3076723631' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:15:39.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:38.804306+0000 mon.smithi152 (mon.0) 189 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:39.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:38.804497+0000 mon.smithi152 (mon.0) 190 : audit [DBG] from='mgr.? 172.21.15.195:0/3076723631' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:15:39.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:38.804931+0000 mon.smithi152 (mon.0) 191 : audit [DBG] from='mgr.? 172.21.15.195:0/3076723631' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:15:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:33.753617+0000 mon.smithi152 (mon.0) 172 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:15:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:33.753791+0000 mon.smithi152 (mon.0) 173 : cluster [INF] mon.smithi152 calling monitor election 2024-04-06T12:15:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:33.769054+0000 mon.smithi152 (mon.0) 174 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:34.357686+0000 mon.smithi152 (mon.0) 175 : audit [DBG] from='mgr.? 172.21.15.195:0/3076723631' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:34.750798+0000 mon.smithi152 (mon.0) 176 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:35.493544+0000 mgr.smithi152.lynahm (mgr.14196) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:35.750735+0000 mon.smithi152 (mon.0) 177 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:35.751846+0000 mon.smithi195 (mon.1) 1 : cluster [INF] mon.smithi195 calling monitor election 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:36.751138+0000 mon.smithi152 (mon.0) 178 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:37.493895+0000 mgr.smithi152.lynahm (mgr.14196) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:37.750979+0000 mon.smithi152 (mon.0) 179 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:38.751227+0000 mon.smithi152 (mon.0) 180 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:38.782760+0000 mon.smithi152 (mon.0) 181 : cluster [INF] mon.smithi152 is new leader, mons smithi152,smithi195 in quorum (ranks 0,1) 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:38.786928+0000 mon.smithi152 (mon.0) 182 : cluster [DBG] monmap e2: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:38.799612+0000 mon.smithi152 (mon.0) 183 : cluster [DBG] fsmap 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:38.799658+0000 mon.smithi152 (mon.0) 184 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-04-06T12:15:39.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:38.799887+0000 mon.smithi152 (mon.0) 185 : cluster [DBG] mgrmap e17: smithi152.lynahm(active, since 23s) 2024-04-06T12:15:39.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:38.800139+0000 mon.smithi152 (mon.0) 186 : cluster [INF] overall HEALTH_OK 2024-04-06T12:15:39.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:38.800732+0000 mon.smithi152 (mon.0) 187 : cluster [DBG] Standby manager daemon smithi195.ausetj started 2024-04-06T12:15:39.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:38.802053+0000 mon.smithi152 (mon.0) 188 : audit [DBG] from='mgr.? 172.21.15.195:0/3076723631' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:15:39.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:38.804306+0000 mon.smithi152 (mon.0) 189 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:39.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:38.804497+0000 mon.smithi152 (mon.0) 190 : audit [DBG] from='mgr.? 172.21.15.195:0/3076723631' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:15:39.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:38.804931+0000 mon.smithi152 (mon.0) 191 : audit [DBG] from='mgr.? 172.21.15.195:0/3076723631' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:15:39.517 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.518+0000 7f24c0930700 1 -- 172.21.15.195:0/1350848289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a8003400 msgr2=0x7f24a8005890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:39.518 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.518+0000 7f24c0930700 1 --2- 172.21.15.195:0/1350848289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a8003400 0x7f24a8005890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f24bc0f6590 tx=0x7f24a4002040).stop 2024-04-06T12:15:39.518 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.518+0000 7f24c0930700 1 -- 172.21.15.195:0/1350848289 shutdown_connections 2024-04-06T12:15:39.518 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.518+0000 7f24c0930700 1 --2- 172.21.15.195:0/1350848289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a8003400 0x7f24a8005890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:39.518 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.518+0000 7f24c0930700 1 -- 172.21.15.195:0/1350848289 >> 172.21.15.195:0/1350848289 conn(0x7f24bc06c440 msgr2=0x7f24bc06c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:39.518 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.518+0000 7f24c0930700 1 -- 172.21.15.195:0/1350848289 shutdown_connections 2024-04-06T12:15:39.518 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.518+0000 7f24c0930700 1 -- 172.21.15.195:0/1350848289 wait complete. 2024-04-06T12:15:39.520 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.519+0000 7f24c0930700 1 Processor -- start 2024-04-06T12:15:39.520 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.519+0000 7f24c0930700 1 -- start start 2024-04-06T12:15:39.520 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24c0930700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 0x7f24bc0fe900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:39.520 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24c0930700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24bc0fedf0 0x7f24bc0ff250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:39.520 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24c0930700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc113bd0 con 0x7f24bc0fedf0 2024-04-06T12:15:39.520 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24c0930700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc113d10 con 0x7f24a8003400 2024-04-06T12:15:39.520 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24ba59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 0x7f24bc0fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:39.520 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24ba59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 0x7f24bc0fe900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:36298/0 (socket says 172.21.15.195:36298) 2024-04-06T12:15:39.520 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24ba59c700 1 -- 172.21.15.195:0/1864934395 learned_addr learned my addr 172.21.15.195:0/1864934395 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24ba59c700 1 -- 172.21.15.195:0/1864934395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 msgr2=0x7f24bc0fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24ba59c700 1 -- 172.21.15.195:0/1864934395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 msgr2=0x7f24bc0fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24ba59c700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 0x7f24bc0fe900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24ba59c700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 0x7f24bc0fe900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24b9d9b700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24bc0fedf0 0x7f24bc0ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24b9d9b700 1 -- 172.21.15.195:0/1864934395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 msgr2=0x7f24bc0fe900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24b9d9b700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 0x7f24bc0fe900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24b9d9b700 1 -- 172.21.15.195:0/1864934395 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a4005040 con 0x7f24bc0fedf0 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24b9d9b700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24bc0fedf0 0x7f24bc0ff250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f24ac00b460 tx=0x7f24ac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.520+0000 7f24b37fe700 1 -- 172.21.15.195:0/1864934395 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24ac00f6f0 con 0x7f24bc0fedf0 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.521+0000 7f24b37fe700 1 -- 172.21.15.195:0/1864934395 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f24ac00fce0 con 0x7f24bc0fedf0 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.521+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24bc113f70 con 0x7f24bc0fedf0 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.521+0000 7f24b37fe700 1 -- 172.21.15.195:0/1864934395 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24ac011ce0 con 0x7f24bc0fedf0 2024-04-06T12:15:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.521+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24bc1144b0 con 0x7f24bc0fedf0 2024-04-06T12:15:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.522+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24bc05f1f0 con 0x7f24bc0fedf0 2024-04-06T12:15:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.522+0000 7f24b37fe700 1 -- 172.21.15.195:0/1864934395 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f24ac00f850 con 0x7f24bc0fedf0 2024-04-06T12:15:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.522+0000 7f24b37fe700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f249c061280 0x7f249c063740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.522+0000 7f24b37fe700 1 -- 172.21.15.195:0/1864934395 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f24ac07b5f0 con 0x7f24bc0fedf0 2024-04-06T12:15:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.523+0000 7f24ba59c700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f249c061280 0x7f249c063740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.523+0000 7f24ba59c700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f249c061280 0x7f249c063740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f24a4004fd0 tx=0x7f24a4002040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:39.526 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.527+0000 7f24b37fe700 1 -- 172.21.15.195:0/1864934395 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f24ac04cb70 con 0x7f24bc0fedf0 2024-04-06T12:15:39.753 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.754+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f24bc05a310 con 0x7f24bc0fedf0 2024-04-06T12:15:39.754 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.755+0000 7f24b37fe700 1 -- 172.21.15.195:0/1864934395 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1013 (secure 0 0 0) 0x7f24ac050190 con 0x7f24bc0fedf0 2024-04-06T12:15:39.754 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-06T12:15:39.754 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","modified":"2024-04-06T12:15:33.750797Z","created":"2024-04-06T12:13:14.047153Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi195","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-06T12:15:39.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f249c061280 msgr2=0x7f249c063740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:39.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f249c061280 0x7f249c063740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f24a4004fd0 tx=0x7f24a4002040).stop 2024-04-06T12:15:39.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24bc0fedf0 msgr2=0x7f24bc0ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:39.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24bc0fedf0 0x7f24bc0ff250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f24ac00b460 tx=0x7f24ac009060).stop 2024-04-06T12:15:39.756 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 shutdown_connections 2024-04-06T12:15:39.756 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f249c061280 0x7f249c063740 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:39.756 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a8003400 0x7f24bc0fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:39.756 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 --2- 172.21.15.195:0/1864934395 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24bc0fedf0 0x7f24bc0ff250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:39.756 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 >> 172.21.15.195:0/1864934395 conn(0x7f24bc06c440 msgr2=0x7f24bc0f5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:39.756 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 shutdown_connections 2024-04-06T12:15:39.756 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:15:39.756+0000 7f24c0930700 1 -- 172.21.15.195:0/1864934395 wait complete. 2024-04-06T12:15:39.756 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2024-04-06T12:15:40.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:15:38.806076+0000 mgr.smithi152.lynahm (mgr.14196) 10 : cephadm [INF] Deploying daemon node-exporter.smithi195 on smithi195 2024-04-06T12:15:40.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:38.862291+0000 mon.smithi152 (mon.0) 192 : cluster [DBG] mgrmap e18: smithi152.lynahm(active, since 23s), standbys: smithi195.ausetj 2024-04-06T12:15:40.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:38.862451+0000 mon.smithi152 (mon.0) 193 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi195.ausetj", "id": "smithi195.ausetj"}]: dispatch 2024-04-06T12:15:40.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:39.751085+0000 mon.smithi152 (mon.0) 194 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:40.051 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:39.756208+0000 mon.smithi152 (mon.0) 195 : audit [DBG] from='client.? 172.21.15.195:0/1864934395' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:40.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:38.806076+0000 mgr.smithi152.lynahm (mgr.14196) 10 : cephadm [INF] Deploying daemon node-exporter.smithi195 on smithi195 2024-04-06T12:15:40.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:38.862291+0000 mon.smithi152 (mon.0) 192 : cluster [DBG] mgrmap e18: smithi152.lynahm(active, since 23s), standbys: smithi195.ausetj 2024-04-06T12:15:40.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:38.862451+0000 mon.smithi152 (mon.0) 193 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi195.ausetj", "id": "smithi195.ausetj"}]: dispatch 2024-04-06T12:15:40.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:39.751085+0000 mon.smithi152 (mon.0) 194 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:15:40.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:39.756208+0000 mon.smithi152 (mon.0) 195 : audit [DBG] from='client.? 172.21.15.195:0/1864934395' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-06T12:15:40.663 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-06T12:15:40.663 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph config generate-minimal-conf 2024-04-06T12:15:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:39.494260+0000 mgr.smithi152.lynahm (mgr.14196) 11 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:40.644431+0000 mon.smithi152 (mon.0) 196 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:39.494260+0000 mgr.smithi152.lynahm (mgr.14196) 11 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:40.644431+0000 mon.smithi152 (mon.0) 196 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.638+0000 7fb0e383e700 1 -- 172.21.15.152:0/6284863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc0fd620 msgr2=0x7fb0dc0fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.638+0000 7fb0e383e700 1 --2- 172.21.15.152:0/6284863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc0fd620 0x7fb0dc0fda00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fb0cc009ae0 tx=0x7fb0cc004d10).stop 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.638+0000 7fb0e383e700 1 -- 172.21.15.152:0/6284863 shutdown_connections 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.638+0000 7fb0e383e700 1 --2- 172.21.15.152:0/6284863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc0fd620 0x7fb0dc0fda00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.638+0000 7fb0e383e700 1 -- 172.21.15.152:0/6284863 >> 172.21.15.152:0/6284863 conn(0x7fb0dc0f3220 msgr2=0x7fb0dc0f5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.638+0000 7fb0e383e700 1 -- 172.21.15.152:0/6284863 shutdown_connections 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.638+0000 7fb0e383e700 1 -- 172.21.15.152:0/6284863 wait complete. 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e383e700 1 Processor -- start 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e383e700 1 -- start start 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e383e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0dc0fd620 0x7fb0dc10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e383e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc10def0 0x7fb0dc1079e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:42.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e383e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc10e4c0 con 0x7fb0dc10def0 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e383e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc10e600 con 0x7fb0dc0fd620 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e0dd9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc10def0 0x7fb0dc1079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e0dd9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc10def0 0x7fb0dc1079e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33942/0 (socket says 172.21.15.152:33942) 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e0dd9700 1 -- 172.21.15.152:0/3003115678 learned_addr learned my addr 172.21.15.152:0/3003115678 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e15da700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0dc0fd620 0x7fb0dc10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e0dd9700 1 -- 172.21.15.152:0/3003115678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0dc0fd620 msgr2=0x7fb0dc10da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e0dd9700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0dc0fd620 0x7fb0dc10da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e0dd9700 1 -- 172.21.15.152:0/3003115678 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0097c0 con 0x7fb0dc10def0 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e0dd9700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc10def0 0x7fb0dc1079e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb0d000b550 tx=0x7fb0d00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0da7fc700 1 -- 172.21.15.152:0/3003115678 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d000f6f0 con 0x7fb0dc10def0 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0da7fc700 1 -- 172.21.15.152:0/3003115678 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb0d000fce0 con 0x7fb0dc10def0 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0da7fc700 1 -- 172.21.15.152:0/3003115678 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d0011ce0 con 0x7fb0dc10def0 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.639+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc107f90 con 0x7fb0dc10def0 2024-04-06T12:15:42.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.640+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc108550 con 0x7fb0dc10def0 2024-04-06T12:15:42.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.640+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc05f150 con 0x7fb0dc10def0 2024-04-06T12:15:42.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.641+0000 7fb0da7fc700 1 -- 172.21.15.152:0/3003115678 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fb0d000f850 con 0x7fb0dc10def0 2024-04-06T12:15:42.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.641+0000 7fb0da7fc700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb0c4061280 0x7fb0c4063740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:42.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.641+0000 7fb0da7fc700 1 -- 172.21.15.152:0/3003115678 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fb0d007b720 con 0x7fb0dc10def0 2024-04-06T12:15:42.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.641+0000 7fb0e15da700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb0c4061280 0x7fb0c4063740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:42.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.641+0000 7fb0e15da700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb0c4061280 0x7fb0c4063740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb0cc003380 tx=0x7fb0cc004d10).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:42.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.645+0000 7fb0da7fc700 1 -- 172.21.15.152:0/3003115678 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb0d0050670 con 0x7fb0dc10def0 2024-04-06T12:15:42.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.809+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb0dc101630 con 0x7fb0dc10def0 2024-04-06T12:15:42.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.809+0000 7fb0da7fc700 1 -- 172.21.15.152:0/3003115678 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7fb0d0050260 con 0x7fb0dc10def0 2024-04-06T12:15:42.808 INFO:teuthology.orchestra.run.smithi152.stdout:# minimal ceph.conf for f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:15:42.808 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2024-04-06T12:15:42.808 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:15:42.808 INFO:teuthology.orchestra.run.smithi152.stdout: mon_host = [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2024-04-06T12:15:42.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb0c4061280 msgr2=0x7fb0c4063740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb0c4061280 0x7fb0c4063740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb0cc003380 tx=0x7fb0cc004d10).stop 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc10def0 msgr2=0x7fb0dc1079e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc10def0 0x7fb0dc1079e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb0d000b550 tx=0x7fb0d00090f0).stop 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 shutdown_connections 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb0c4061280 0x7fb0c4063740 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0dc0fd620 0x7fb0dc10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 --2- 172.21.15.152:0/3003115678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0dc10def0 0x7fb0dc1079e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 >> 172.21.15.152:0/3003115678 conn(0x7fb0dc0f3220 msgr2=0x7fb0dc0f3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 shutdown_connections 2024-04-06T12:15:42.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:42.811+0000 7fb0e383e700 1 -- 172.21.15.152:0/3003115678 wait complete. 2024-04-06T12:15:43.141 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:41.494609+0000 mgr.smithi152.lynahm (mgr.14196) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:43.142 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:42.415719+0000 mon.smithi152 (mon.0) 197 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:43.142 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:42.810542+0000 mon.smithi152 (mon.0) 198 : audit [DBG] from='client.? 172.21.15.152:0/3003115678' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:43.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:41.494609+0000 mgr.smithi152.lynahm (mgr.14196) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:43.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:42.415719+0000 mon.smithi152 (mon.0) 197 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:43.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:42.810542+0000 mon.smithi152 (mon.0) 198 : audit [DBG] from='client.? 172.21.15.152:0/3003115678' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:43.451 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-06T12:15:43.451 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:15:43.451 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2024-04-06T12:15:43.482 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:15:43.482 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:15:43.549 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:15:43.549 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2024-04-06T12:15:43.581 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:15:43.581 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:15:43.648 INFO:tasks.cephadm:Deploying OSDs... 2024-04-06T12:15:43.649 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:15:43.649 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-04-06T12:15:43.667 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-06T12:15:43.667 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-04-06T12:15:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-06T12:15:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T12:15:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 170034 Links: 1 2024-04-06T12:15:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:15:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T12:15:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-04-06 12:15:06.445341722 +0000 2024-04-06T12:15:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-04-06 12:08:47.076385172 +0000 2024-04-06T12:15:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-04-06 12:08:47.076385172 +0000 2024-04-06T12:15:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2024-04-06T12:15:43.726 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-06T12:15:43.791 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-04-06T12:15:43.791 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-04-06T12:15:43.791 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000240743 s, 2.1 MB/s 2024-04-06T12:15:43.792 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-06T12:15:43.851 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-04-06T12:15:43.909 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-06T12:15:43.909 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T12:15:43.909 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 161483 Links: 1 2024-04-06T12:15:43.910 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:15:43.910 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T12:15:43.910 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-04-06 12:15:06.445341722 +0000 2024-04-06T12:15:43.910 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-04-06 12:08:47.419381031 +0000 2024-04-06T12:15:43.910 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-04-06 12:08:47.419381031 +0000 2024-04-06T12:15:43.910 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2024-04-06T12:15:43.910 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-06T12:15:43.975 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-04-06T12:15:43.975 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-04-06T12:15:43.975 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000217601 s, 2.4 MB/s 2024-04-06T12:15:43.976 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-06T12:15:44.035 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-04-06T12:15:44.093 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-06T12:15:44.093 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T12:15:44.093 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 161547 Links: 1 2024-04-06T12:15:44.093 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:15:44.093 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T12:15:44.094 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-04-06 12:15:06.445341722 +0000 2024-04-06T12:15:44.094 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-04-06 12:08:47.769376805 +0000 2024-04-06T12:15:44.094 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-04-06 12:08:47.769376805 +0000 2024-04-06T12:15:44.094 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2024-04-06T12:15:44.094 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-06T12:15:44.157 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:42.429668+0000 mgr.smithi152.lynahm (mgr.14196) 13 : cephadm [INF] Deploying daemon prometheus.smithi195 on smithi195 2024-04-06T12:15:44.158 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-04-06T12:15:44.158 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-04-06T12:15:44.159 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000174573 s, 2.9 MB/s 2024-04-06T12:15:44.160 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-06T12:15:44.219 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-04-06T12:15:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-06T12:15:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T12:15:44.277 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 161605 Links: 1 2024-04-06T12:15:44.277 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:15:44.277 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T12:15:44.278 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-04-06 12:15:06.445341722 +0000 2024-04-06T12:15:44.278 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-04-06 12:08:48.146372253 +0000 2024-04-06T12:15:44.278 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-04-06 12:08:48.146372253 +0000 2024-04-06T12:15:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2024-04-06T12:15:44.278 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-06T12:15:44.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:15:42.429668+0000 mgr.smithi152.lynahm (mgr.14196) 13 : cephadm [INF] Deploying daemon prometheus.smithi195 on smithi195 2024-04-06T12:15:44.343 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-04-06T12:15:44.343 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-04-06T12:15:44.343 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00026687 s, 1.9 MB/s 2024-04-06T12:15:44.344 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-06T12:15:44.403 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:15:44.403 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-04-06T12:15:44.421 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-06T12:15:44.422 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-04-06T12:15:44.479 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-06T12:15:44.479 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T12:15:44.479 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 171042 Links: 1 2024-04-06T12:15:44.479 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:15:44.479 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T12:15:44.479 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-06 12:15:39.257927613 +0000 2024-04-06T12:15:44.479 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-06 12:08:47.061032349 +0000 2024-04-06T12:15:44.479 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-06 12:08:47.061032349 +0000 2024-04-06T12:15:44.479 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-04-06T12:15:44.480 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-06T12:15:44.545 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-06T12:15:44.545 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-06T12:15:44.545 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000107278 s, 4.8 MB/s 2024-04-06T12:15:44.546 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-06T12:15:44.606 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-04-06T12:15:44.664 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-06T12:15:44.664 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T12:15:44.665 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 168439 Links: 1 2024-04-06T12:15:44.665 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:15:44.665 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T12:15:44.665 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-06 12:15:39.258927593 +0000 2024-04-06T12:15:44.665 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-06 12:08:47.384026093 +0000 2024-04-06T12:15:44.665 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-06 12:08:47.384026093 +0000 2024-04-06T12:15:44.665 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-04-06T12:15:44.665 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-06T12:15:44.730 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-06T12:15:44.730 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-06T12:15:44.730 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.9953e-05 s, 5.1 MB/s 2024-04-06T12:15:44.731 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-06T12:15:44.790 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-04-06T12:15:44.848 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-06T12:15:44.848 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T12:15:44.849 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 170267 Links: 1 2024-04-06T12:15:44.849 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:15:44.849 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T12:15:44.849 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-06 12:15:39.258927593 +0000 2024-04-06T12:15:44.849 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-06 12:08:47.708019818 +0000 2024-04-06T12:15:44.849 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-06 12:08:47.708019818 +0000 2024-04-06T12:15:44.849 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-04-06T12:15:44.849 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-06T12:15:44.914 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-06T12:15:44.914 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-06T12:15:44.914 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000112128 s, 4.6 MB/s 2024-04-06T12:15:44.915 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-06T12:15:44.974 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-04-06T12:15:45.033 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-06T12:15:45.033 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-06T12:15:45.033 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 170345 Links: 1 2024-04-06T12:15:45.033 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:15:45.033 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-06T12:15:45.033 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-06 12:15:39.258927593 +0000 2024-04-06T12:15:45.034 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-06 12:08:48.057013059 +0000 2024-04-06T12:15:45.034 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-06 12:08:48.057013059 +0000 2024-04-06T12:15:45.034 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-04-06T12:15:45.034 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-06T12:15:45.099 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-06T12:15:45.099 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-06T12:15:45.099 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000117901 s, 4.3 MB/s 2024-04-06T12:15:45.100 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-06T12:15:45.158 INFO:tasks.cephadm:Deploying osd.0 on smithi152 with /dev/vg_nvme/lv_4... 2024-04-06T12:15:45.159 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-06T12:15:45.185 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:43.495002+0000 mgr.smithi152.lynahm (mgr.14196) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:45.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:43.495002+0000 mgr.smithi152.lynahm (mgr.14196) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:46.871 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:45.495305+0000 mgr.smithi152.lynahm (mgr.14196) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:46.871 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:45.649221+0000 mon.smithi152 (mon.0) 199 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:45.495305+0000 mgr.smithi152.lynahm (mgr.14196) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:45.649221+0000 mon.smithi152 (mon.0) 199 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:47.432 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-06T12:15:47.432 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-06T12:15:47.432 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2024-04-06T12:15:47.433 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2024-04-06T12:15:47.433 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0138015 s, 760 MB/s 2024-04-06T12:15:47.433 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2024-04-06T12:15:48.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2024-04-06T12:15:49.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:47.495532+0000 mgr.smithi152.lynahm (mgr.14196) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:47.495532+0000 mgr.smithi152.lynahm (mgr.14196) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:50.969 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:49.495770+0000 mgr.smithi152.lynahm (mgr.14196) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:51.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:49.495770+0000 mgr.smithi152.lynahm (mgr.14196) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:51.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.913+0000 7fdfc4edd700 1 -- 172.21.15.152:0/2517495690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 msgr2=0x7fdfc00f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:51.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.913+0000 7fdfc4edd700 1 --2- 172.21.15.152:0/2517495690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 0x7fdfc00f6b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fdfb0009b60 tx=0x7fdfb0004d10).stop 2024-04-06T12:15:51.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.913+0000 7fdfc4edd700 1 -- 172.21.15.152:0/2517495690 shutdown_connections 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.913+0000 7fdfc4edd700 1 --2- 172.21.15.152:0/2517495690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc00f7990 0x7fdfc00f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.913+0000 7fdfc4edd700 1 --2- 172.21.15.152:0/2517495690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 0x7fdfc00f6b10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.913+0000 7fdfc4edd700 1 -- 172.21.15.152:0/2517495690 >> 172.21.15.152:0/2517495690 conn(0x7fdfc00f1e50 msgr2=0x7fdfc00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.913+0000 7fdfc4edd700 1 -- 172.21.15.152:0/2517495690 shutdown_connections 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.913+0000 7fdfc4edd700 1 -- 172.21.15.152:0/2517495690 wait complete. 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.914+0000 7fdfc4edd700 1 Processor -- start 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.914+0000 7fdfc4edd700 1 -- start start 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.914+0000 7fdfc4edd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 0x7fdfc0108000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.914+0000 7fdfc4edd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc00f7990 0x7fdfc01084f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.914+0000 7fdfc4edd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0108b30 con 0x7fdfc00f66f0 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.914+0000 7fdfc4edd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0108c70 con 0x7fdfc00f7990 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfbe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 0x7fdfc0108000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfbe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 0x7fdfc0108000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33960/0 (socket says 172.21.15.152:33960) 2024-04-06T12:15:51.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfbe59c700 1 -- 172.21.15.152:0/1503757228 learned_addr learned my addr 172.21.15.152:0/1503757228 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfbe59c700 1 -- 172.21.15.152:0/1503757228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc00f7990 msgr2=0x7fdfc01084f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfbe59c700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc00f7990 0x7fdfc01084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfbe59c700 1 -- 172.21.15.152:0/1503757228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00097c0 con 0x7fdfc00f66f0 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfbe59c700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 0x7fdfc0108000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdfb000bc10 tx=0x7fdfb0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfb77fe700 1 -- 172.21.15.152:0/1503757228 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb000e070 con 0x7fdfc00f66f0 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfb77fe700 1 -- 172.21.15.152:0/1503757228 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fdfb001d8b0 con 0x7fdfc00f66f0 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc010d6b0 con 0x7fdfc00f66f0 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfb77fe700 1 -- 172.21.15.152:0/1503757228 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb0018070 con 0x7fdfc00f66f0 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.915+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc010db90 con 0x7fdfc00f66f0 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.916+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc00fef30 con 0x7fdfc00f66f0 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.916+0000 7fdfb77fe700 1 -- 172.21.15.152:0/1503757228 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fdfb001da20 con 0x7fdfc00f66f0 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.917+0000 7fdfb77fe700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fdfac061160 0x7fdfac063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:15:51.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.917+0000 7fdfb77fe700 1 -- 172.21.15.152:0/1503757228 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fdfb007ced0 con 0x7fdfc00f66f0 2024-04-06T12:15:51.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.917+0000 7fdfbdd9b700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fdfac061160 0x7fdfac063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:15:51.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.917+0000 7fdfbdd9b700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fdfac061160 0x7fdfac063620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdfa8009700 tx=0x7fdfa8006c30).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:15:51.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:50.921+0000 7fdfb77fe700 1 -- 172.21.15.152:0/1503757228 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fdfb0051e20 con 0x7fdfc00f66f0 2024-04-06T12:15:51.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:15:51.094+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfc00fbdd0 con 0x7fdfac061160 2024-04-06T12:15:51.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:51.096290+0000 mgr.smithi152.lynahm (mgr.14196) 18 : audit [DBG] from='client.14224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:15:51.882 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:51.098865+0000 mon.smithi152 (mon.0) 200 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:15:51.882 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:51.100823+0000 mon.smithi152 (mon.0) 201 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:15:51.882 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:51.101337+0000 mon.smithi152 (mon.0) 202 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:52.003 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:51.096290+0000 mgr.smithi152.lynahm (mgr.14196) 18 : audit [DBG] from='client.14224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:15:52.003 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:51.098865+0000 mon.smithi152 (mon.0) 200 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:15:52.003 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:51.100823+0000 mon.smithi152 (mon.0) 201 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:15:52.003 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:51.101337+0000 mon.smithi152 (mon.0) 202 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:53.019 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:51.496126+0000 mgr.smithi152.lynahm (mgr.14196) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:53.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:51.496126+0000 mgr.smithi152.lynahm (mgr.14196) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:54.731 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:53.291202+0000 mon.smithi152 (mon.0) 203 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:54.731 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:53.292119+0000 mon.smithi152 (mon.0) 204 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:15:54.731 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:53.496407+0000 mgr.smithi152.lynahm (mgr.14196) 20 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:54.731 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:53.523953+0000 mon.smithi152 (mon.0) 205 : audit [INF] from='client.? 172.21.15.152:0/1699561469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb0a62c1-5f47-450c-8e9e-4e02c899eda3"}]: dispatch 2024-04-06T12:15:54.731 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:53.527458+0000 mon.smithi152 (mon.0) 206 : audit [INF] from='client.? 172.21.15.152:0/1699561469' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb0a62c1-5f47-450c-8e9e-4e02c899eda3"}]': finished 2024-04-06T12:15:54.732 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:53.527494+0000 mon.smithi152 (mon.0) 207 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-04-06T12:15:54.732 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:53.527594+0000 mon.smithi152 (mon.0) 208 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:15:54.732 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:54.093737+0000 mon.smithi152 (mon.0) 209 : audit [DBG] from='client.? 172.21.15.152:0/3794532612' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:15:54.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:53.291202+0000 mon.smithi152 (mon.0) 203 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:54.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:53.292119+0000 mon.smithi152 (mon.0) 204 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:15:54.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:53.496407+0000 mgr.smithi152.lynahm (mgr.14196) 20 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:54.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:53.523953+0000 mon.smithi152 (mon.0) 205 : audit [INF] from='client.? 172.21.15.152:0/1699561469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb0a62c1-5f47-450c-8e9e-4e02c899eda3"}]: dispatch 2024-04-06T12:15:54.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:53.527458+0000 mon.smithi152 (mon.0) 206 : audit [INF] from='client.? 172.21.15.152:0/1699561469' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb0a62c1-5f47-450c-8e9e-4e02c899eda3"}]': finished 2024-04-06T12:15:54.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:53.527494+0000 mon.smithi152 (mon.0) 207 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-04-06T12:15:54.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:53.527594+0000 mon.smithi152 (mon.0) 208 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:15:54.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:54.093737+0000 mon.smithi152 (mon.0) 209 : audit [DBG] from='client.? 172.21.15.152:0/3794532612' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:15:57.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:55.496707+0000 mgr.smithi152.lynahm (mgr.14196) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:55.653572+0000 mon.smithi152 (mon.0) 210 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:55.948705+0000 mon.smithi152 (mon.0) 211 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:55.949322+0000 mon.smithi152 (mon.0) 212 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:55.949884+0000 mon.smithi152 (mon.0) 213 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:55.950653+0000 mgr.smithi152.lynahm (mgr.14196) 22 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:55.950881+0000 mgr.smithi152.lynahm (mgr.14196) 23 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:55.973090+0000 mon.smithi152 (mon.0) 214 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:55.992969+0000 mon.smithi152 (mon.0) 215 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:55.996994+0000 mon.smithi152 (mon.0) 216 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:56.001090+0000 mgr.smithi152.lynahm (mgr.14196) 24 : cephadm [INF] Reconfiguring mon.smithi152 (unknown last config time)... 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:56.001510+0000 mon.smithi152 (mon.0) 217 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:15:57.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:56.002200+0000 mon.smithi152 (mon.0) 218 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:15:57.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:56.002773+0000 mon.smithi152 (mon.0) 219 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:57.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:56.003356+0000 mgr.smithi152.lynahm (mgr.14196) 25 : cephadm [INF] Reconfiguring daemon mon.smithi152 on smithi152 2024-04-06T12:15:57.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:55.496707+0000 mgr.smithi152.lynahm (mgr.14196) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:57.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:55.653572+0000 mon.smithi152 (mon.0) 210 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:55.948705+0000 mon.smithi152 (mon.0) 211 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:55.949322+0000 mon.smithi152 (mon.0) 212 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:55.949884+0000 mon.smithi152 (mon.0) 213 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:15:55.950653+0000 mgr.smithi152.lynahm (mgr.14196) 22 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:15:55.950881+0000 mgr.smithi152.lynahm (mgr.14196) 23 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:55.973090+0000 mon.smithi152 (mon.0) 214 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:55.992969+0000 mon.smithi152 (mon.0) 215 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:55.996994+0000 mon.smithi152 (mon.0) 216 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:15:56.001090+0000 mgr.smithi152.lynahm (mgr.14196) 24 : cephadm [INF] Reconfiguring mon.smithi152 (unknown last config time)... 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:56.001510+0000 mon.smithi152 (mon.0) 217 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:56.002200+0000 mon.smithi152 (mon.0) 218 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:56.002773+0000 mon.smithi152 (mon.0) 219 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:15:57.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:15:56.003356+0000 mgr.smithi152.lynahm (mgr.14196) 25 : cephadm [INF] Reconfiguring daemon mon.smithi152 on smithi152 2024-04-06T12:15:58.985 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:15:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:57.497009+0000 mgr.smithi152.lynahm (mgr.14196) 26 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:15:59.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:15:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:57.497009+0000 mgr.smithi152.lynahm (mgr.14196) 26 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:59.317032+0000 mon.smithi152 (mon.0) 220 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:59.317516+0000 mgr.smithi152.lynahm (mgr.14196) 27 : cephadm [INF] Reconfiguring mgr.smithi152.lynahm (unknown last config time)... 2024-04-06T12:16:00.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:59.317755+0000 mon.smithi152 (mon.0) 221 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.lynahm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:16:00.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:59.318341+0000 mon.smithi152 (mon.0) 222 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:16:00.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:15:59.318801+0000 mon.smithi152 (mon.0) 223 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:00.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:15:59.319234+0000 mgr.smithi152.lynahm (mgr.14196) 28 : cephadm [INF] Reconfiguring daemon mgr.smithi152.lynahm on smithi152 2024-04-06T12:16:00.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:15:59.497256+0000 mgr.smithi152.lynahm (mgr.14196) 29 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:59.317032+0000 mon.smithi152 (mon.0) 220 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:15:59.317516+0000 mgr.smithi152.lynahm (mgr.14196) 27 : cephadm [INF] Reconfiguring mgr.smithi152.lynahm (unknown last config time)... 2024-04-06T12:16:00.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:59.317755+0000 mon.smithi152 (mon.0) 221 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.lynahm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:16:00.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:59.318341+0000 mon.smithi152 (mon.0) 222 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:16:00.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:15:59.318801+0000 mon.smithi152 (mon.0) 223 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:00.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:15:59.319234+0000 mgr.smithi152.lynahm (mgr.14196) 28 : cephadm [INF] Reconfiguring daemon mgr.smithi152.lynahm on smithi152 2024-04-06T12:16:00.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:15:59.497256+0000 mgr.smithi152.lynahm (mgr.14196) 29 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:02.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:01.497597+0000 mgr.smithi152.lynahm (mgr.14196) 30 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:02.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:01.637900+0000 mon.smithi152 (mon.0) 224 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:02.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:01.638490+0000 mgr.smithi152.lynahm (mgr.14196) 31 : cephadm [INF] Reconfiguring alertmanager.smithi152 (dependencies changed)... 2024-04-06T12:16:02.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:01.644312+0000 mgr.smithi152.lynahm (mgr.14196) 32 : cephadm [INF] Reconfiguring daemon alertmanager.smithi152 on smithi152 2024-04-06T12:16:03.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:01.497597+0000 mgr.smithi152.lynahm (mgr.14196) 30 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:03.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:01.637900+0000 mon.smithi152 (mon.0) 224 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:03.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:01.638490+0000 mgr.smithi152.lynahm (mgr.14196) 31 : cephadm [INF] Reconfiguring alertmanager.smithi152 (dependencies changed)... 2024-04-06T12:16:03.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:01.644312+0000 mgr.smithi152.lynahm (mgr.14196) 32 : cephadm [INF] Reconfiguring daemon alertmanager.smithi152 on smithi152 2024-04-06T12:16:03.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:03.065674+0000 mon.smithi152 (mon.0) 225 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-06T12:16:03.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:03.066266+0000 mon.smithi152 (mon.0) 226 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:03.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:03.066707+0000 mgr.smithi152.lynahm (mgr.14196) 33 : cephadm [INF] Deploying daemon osd.0 on smithi152 2024-04-06T12:16:04.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:03.065674+0000 mon.smithi152 (mon.0) 225 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-06T12:16:04.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:03.066266+0000 mon.smithi152 (mon.0) 226 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:04.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:03.066707+0000 mgr.smithi152.lynahm (mgr.14196) 33 : cephadm [INF] Deploying daemon osd.0 on smithi152 2024-04-06T12:16:04.998 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:03.497982+0000 mgr.smithi152.lynahm (mgr.14196) 34 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:05.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:03.497982+0000 mgr.smithi152.lynahm (mgr.14196) 34 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:06.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:05.498307+0000 mgr.smithi152.lynahm (mgr.14196) 35 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:07.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:05.498307+0000 mgr.smithi152.lynahm (mgr.14196) 35 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:09.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:07.498673+0000 mgr.smithi152.lynahm (mgr.14196) 36 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:09.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:08.213617+0000 mon.smithi152 (mon.0) 227 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:09.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:08.214137+0000 mgr.smithi152.lynahm (mgr.14196) 37 : cephadm [INF] Reconfiguring crash.smithi152 (monmap changed)... 2024-04-06T12:16:09.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:08.214378+0000 mon.smithi152 (mon.0) 228 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:16:09.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:08.214983+0000 mon.smithi152 (mon.0) 229 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:09.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:08.215434+0000 mgr.smithi152.lynahm (mgr.14196) 38 : cephadm [INF] Reconfiguring daemon crash.smithi152 on smithi152 2024-04-06T12:16:09.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:07.498673+0000 mgr.smithi152.lynahm (mgr.14196) 36 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:09.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:08.213617+0000 mon.smithi152 (mon.0) 227 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:09.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:08.214137+0000 mgr.smithi152.lynahm (mgr.14196) 37 : cephadm [INF] Reconfiguring crash.smithi152 (monmap changed)... 2024-04-06T12:16:09.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:08.214378+0000 mon.smithi152 (mon.0) 228 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:16:09.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:08.214983+0000 mon.smithi152 (mon.0) 229 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:09.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:08.215434+0000 mgr.smithi152.lynahm (mgr.14196) 38 : cephadm [INF] Reconfiguring daemon crash.smithi152 on smithi152 2024-04-06T12:16:11.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:09.498993+0000 mgr.smithi152.lynahm (mgr.14196) 39 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:09.498993+0000 mgr.smithi152.lynahm (mgr.14196) 39 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:13.485 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:13 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:11.499289+0000 mgr.smithi152.lynahm (mgr.14196) 40 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:13 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:11.499289+0000 mgr.smithi152.lynahm (mgr.14196) 40 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:14.888 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:13.499572+0000 mgr.smithi152.lynahm (mgr.14196) 41 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:14.888 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:13.610635+0000 mon.smithi152 (mon.0) 230 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:15.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:13.499572+0000 mgr.smithi152.lynahm (mgr.14196) 41 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:15.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:13.610635+0000 mon.smithi152 (mon.0) 230 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:16.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:15.499884+0000 mgr.smithi152.lynahm (mgr.14196) 42 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:16.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:15.669734+0000 mon.smithi152 (mon.0) 231 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:16.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:15.670259+0000 mgr.smithi152.lynahm (mgr.14196) 43 : cephadm [INF] Reconfiguring grafana.smithi152 (dependencies changed)... 2024-04-06T12:16:16.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:15.700916+0000 mgr.smithi152.lynahm (mgr.14196) 44 : cephadm [INF] Reconfiguring daemon grafana.smithi152 on smithi152 2024-04-06T12:16:17.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:15.499884+0000 mgr.smithi152.lynahm (mgr.14196) 42 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:17.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:15.669734+0000 mon.smithi152 (mon.0) 231 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:17.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:15.670259+0000 mgr.smithi152.lynahm (mgr.14196) 43 : cephadm [INF] Reconfiguring grafana.smithi152 (dependencies changed)... 2024-04-06T12:16:17.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:15.700916+0000 mgr.smithi152.lynahm (mgr.14196) 44 : cephadm [INF] Reconfiguring daemon grafana.smithi152 on smithi152 2024-04-06T12:16:17.648 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 0 on host 'smithi152' 2024-04-06T12:16:17.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.649+0000 7fdfb77fe700 1 -- 172.21.15.152:0/1503757228 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdfc00fbdd0 con 0x7fdfac061160 2024-04-06T12:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.651+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fdfac061160 msgr2=0x7fdfac063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.651+0000 7fdfc4edd700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fdfac061160 0x7fdfac063620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdfa8009700 tx=0x7fdfa8006c30).stop 2024-04-06T12:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.652+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 msgr2=0x7fdfc0108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.652+0000 7fdfc4edd700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 0x7fdfc0108000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdfb000bc10 tx=0x7fdfb0004d10).stop 2024-04-06T12:16:17.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.652+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 shutdown_connections 2024-04-06T12:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.652+0000 7fdfc4edd700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fdfac061160 0x7fdfac063620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.652+0000 7fdfc4edd700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdfc00f66f0 0x7fdfc0108000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.652+0000 7fdfc4edd700 1 --2- 172.21.15.152:0/1503757228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc00f7990 0x7fdfc01084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.652+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 >> 172.21.15.152:0/1503757228 conn(0x7fdfc00f1e50 msgr2=0x7fdfc0060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.652+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 shutdown_connections 2024-04-06T12:16:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:17.652+0000 7fdfc4edd700 1 -- 172.21.15.152:0/1503757228 wait complete. 2024-04-06T12:16:17.928 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:17.513159+0000 mon.smithi152 (mon.0) 232 : audit [INF] from='osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-06T12:16:17.928 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:17.649943+0000 mon.smithi152 (mon.0) 233 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:18.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:17.513159+0000 mon.smithi152 (mon.0) 232 : audit [INF] from='osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-06T12:16:18.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:17.649943+0000 mon.smithi152 (mon.0) 233 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:18.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:17.500164+0000 mgr.smithi152.lynahm (mgr.14196) 45 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:18.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:17.680287+0000 mon.smithi152 (mon.0) 234 : audit [INF] from='osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-06T12:16:18.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:17.680332+0000 mon.smithi152 (mon.0) 235 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-04-06T12:16:18.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:17.680420+0000 mon.smithi152 (mon.0) 236 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:18.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:17.680783+0000 mon.smithi152 (mon.0) 237 : audit [INF] from='osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:16:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:17.500164+0000 mgr.smithi152.lynahm (mgr.14196) 45 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:17.680287+0000 mon.smithi152 (mon.0) 234 : audit [INF] from='osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-06T12:16:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:17.680332+0000 mon.smithi152 (mon.0) 235 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-04-06T12:16:19.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:17.680420+0000 mon.smithi152 (mon.0) 236 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:19.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:17.680783+0000 mon.smithi152 (mon.0) 237 : audit [INF] from='osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:16:19.756 DEBUG:teuthology.orchestra.run.smithi152:osd.0> sudo journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.0.service 2024-04-06T12:16:19.758 INFO:tasks.cephadm:Deploying osd.1 on smithi152 with /dev/vg_nvme/lv_3... 2024-04-06T12:16:19.758 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-06T12:16:19.788 INFO:journalctl@ceph.osd.0.smithi152.stdout:-- Logs begin at Sat 2024-04-06 12:02:33 UTC. -- 2024-04-06T12:16:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:18.681985+0000 mon.smithi152 (mon.0) 238 : audit [INF] from='osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-04-06T12:16:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:18.682038+0000 mon.smithi152 (mon.0) 239 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-04-06T12:16:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:18.683053+0000 mon.smithi152 (mon.0) 240 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:20.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:18.688184+0000 mon.smithi152 (mon.0) 241 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:18.681985+0000 mon.smithi152 (mon.0) 238 : audit [INF] from='osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-04-06T12:16:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:18.682038+0000 mon.smithi152 (mon.0) 239 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-04-06T12:16:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:18.683053+0000 mon.smithi152 (mon.0) 240 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:18.688184+0000 mon.smithi152 (mon.0) 241 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:21.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:18.549624+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:16:21.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:18.549752+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:16:21.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:19.500369+0000 mgr.smithi152.lynahm (mgr.14196) 46 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:21.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:19.685565+0000 mon.smithi152 (mon.0) 242 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:21.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:19.689081+0000 mon.smithi152 (mon.0) 243 : cluster [INF] osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] boot 2024-04-06T12:16:21.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:19.689113+0000 mon.smithi152 (mon.0) 244 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-04-06T12:16:21.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:19.689545+0000 mon.smithi152 (mon.0) 245 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:18.549624+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:16:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:18.549752+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:16:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:19.500369+0000 mgr.smithi152.lynahm (mgr.14196) 46 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-06T12:16:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:19.685565+0000 mon.smithi152 (mon.0) 242 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:19.689081+0000 mon.smithi152 (mon.0) 243 : cluster [INF] osd.0 [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] boot 2024-04-06T12:16:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:19.689113+0000 mon.smithi152 (mon.0) 244 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-04-06T12:16:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:19.689545+0000 mon.smithi152 (mon.0) 245 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:16:21.890 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:20.697477+0000 mon.smithi152 (mon.0) 246 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-04-06T12:16:22.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:20.697477+0000 mon.smithi152 (mon.0) 246 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-04-06T12:16:22.802 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-06T12:16:22.802 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-06T12:16:22.802 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2024-04-06T12:16:22.803 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2024-04-06T12:16:22.803 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111608 s, 940 MB/s 2024-04-06T12:16:22.803 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2024-04-06T12:16:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:21.500615+0000 mgr.smithi152.lynahm (mgr.14196) 47 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:21.500615+0000 mgr.smithi152.lynahm (mgr.14196) 47 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:23.837 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2024-04-06T12:16:24.748 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:23.501050+0000 mgr.smithi152.lynahm (mgr.14196) 48 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:25.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:23.501050+0000 mgr.smithi152.lynahm (mgr.14196) 48 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 -- 172.21.15.152:0/2592531277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 msgr2=0x7f74e00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 --2- 172.21.15.152:0/2592531277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 0x7f74e00f9110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f74c80047f0 tx=0x7f74c8009cb0).stop 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 -- 172.21.15.152:0/2592531277 shutdown_connections 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 --2- 172.21.15.152:0/2592531277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 0x7f74e00f9110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 --2- 172.21.15.152:0/2592531277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74e00f7a10 0x7f74e00f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 -- 172.21.15.152:0/2592531277 >> 172.21.15.152:0/2592531277 conn(0x7f74e00f3150 msgr2=0x7f74e00f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 -- 172.21.15.152:0/2592531277 shutdown_connections 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 -- 172.21.15.152:0/2592531277 wait complete. 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 Processor -- start 2024-04-06T12:16:26.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.213+0000 7f74e627b700 1 -- start start 2024-04-06T12:16:26.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74e627b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74e00f7a10 0x7f74e01081b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:16:26.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74e627b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 0x7f74e01086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:16:26.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74e627b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0108c50 con 0x7f74e00f8cb0 2024-04-06T12:16:26.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74e627b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0108d90 con 0x7f74e00f7a10 2024-04-06T12:16:26.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74df7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 0x7f74e01086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:16:26.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74df7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 0x7f74e01086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33086/0 (socket says 172.21.15.152:33086) 2024-04-06T12:16:26.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74df7fe700 1 -- 172.21.15.152:0/4065598706 learned_addr learned my addr 172.21.15.152:0/4065598706 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74dffff700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74e00f7a10 0x7f74e01081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74df7fe700 1 -- 172.21.15.152:0/4065598706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74e00f7a10 msgr2=0x7f74e01081b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74df7fe700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74e00f7a10 0x7f74e01081b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74df7fe700 1 -- 172.21.15.152:0/4065598706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8005040 con 0x7f74e00f8cb0 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74dffff700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74e00f7a10 0x7f74e01081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74df7fe700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 0x7f74e01086a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f74c8013470 tx=0x7f74c8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74dd775700 1 -- 172.21.15.152:0/4065598706 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c800e030 con 0x7f74e00f8cb0 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e010d7d0 con 0x7f74e00f8cb0 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74dd775700 1 -- 172.21.15.152:0/4065598706 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f74c8007e90 con 0x7f74e00f8cb0 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74dd775700 1 -- 172.21.15.152:0/4065598706 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c8018070 con 0x7f74e00f8cb0 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.214+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e010dd10 con 0x7f74e00f8cb0 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.215+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e005fb50 con 0x7f74e00f8cb0 2024-04-06T12:16:26.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.216+0000 7f74dd775700 1 -- 172.21.15.152:0/4065598706 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f74c801d420 con 0x7f74e00f8cb0 2024-04-06T12:16:26.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.216+0000 7f74dd775700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f74cc061180 0x7f74cc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:16:26.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.216+0000 7f74dd775700 1 -- 172.21.15.152:0/4065598706 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1849+0+0 (secure 0 0 0) 0x7f74c807cfa0 con 0x7f74e00f8cb0 2024-04-06T12:16:26.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.216+0000 7f74dffff700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f74cc061180 0x7f74cc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:16:26.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.216+0000 7f74dffff700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f74cc061180 0x7f74cc063640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f74e00f8b10 tx=0x7f74d000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:16:26.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.220+0000 7f74dd775700 1 -- 172.21.15.152:0/4065598706 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f74c8051cf0 con 0x7f74e00f8cb0 2024-04-06T12:16:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:25.183218+0000 mon.smithi152 (mon.0) 247 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:25.183733+0000 mgr.smithi152.lynahm (mgr.14196) 49 : cephadm [INF] Reconfiguring crash.smithi195 (monmap changed)... 2024-04-06T12:16:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:25.183987+0000 mon.smithi152 (mon.0) 248 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:16:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:25.184589+0000 mon.smithi152 (mon.0) 249 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:25.185020+0000 mgr.smithi152.lynahm (mgr.14196) 50 : cephadm [INF] Reconfiguring daemon crash.smithi195 on smithi195 2024-04-06T12:16:26.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:26.390+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f74e0102170 con 0x7f74cc061180 2024-04-06T12:16:26.523 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:25.183218+0000 mon.smithi152 (mon.0) 247 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:26.523 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:25.183733+0000 mgr.smithi152.lynahm (mgr.14196) 49 : cephadm [INF] Reconfiguring crash.smithi195 (monmap changed)... 2024-04-06T12:16:26.523 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:25.183987+0000 mon.smithi152 (mon.0) 248 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:16:26.523 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:25.184589+0000 mon.smithi152 (mon.0) 249 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:26.523 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:25.185020+0000 mgr.smithi152.lynahm (mgr.14196) 50 : cephadm [INF] Reconfiguring daemon crash.smithi195 on smithi195 2024-04-06T12:16:27.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:25.501453+0000 mgr.smithi152.lynahm (mgr.14196) 51 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:27.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:26.394792+0000 mon.smithi152 (mon.0) 250 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:16:27.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:26.396576+0000 mon.smithi152 (mon.0) 251 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:16:27.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:26.397091+0000 mon.smithi152 (mon.0) 252 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:27.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:26.568462+0000 mon.smithi152 (mon.0) 253 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:27.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:26.569361+0000 mon.smithi152 (mon.0) 254 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:16:27.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:26.570108+0000 mon.smithi152 (mon.0) 255 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:16:27.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:26.570653+0000 mon.smithi152 (mon.0) 256 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:27.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:25.501453+0000 mgr.smithi152.lynahm (mgr.14196) 51 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:27.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:26.394792+0000 mon.smithi152 (mon.0) 250 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:16:27.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:26.396576+0000 mon.smithi152 (mon.0) 251 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:16:27.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:26.397091+0000 mon.smithi152 (mon.0) 252 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:27.474 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:26.568462+0000 mon.smithi152 (mon.0) 253 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:27.474 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:26.569361+0000 mon.smithi152 (mon.0) 254 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:16:27.474 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:26.570108+0000 mon.smithi152 (mon.0) 255 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:16:27.474 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:26.570653+0000 mon.smithi152 (mon.0) 256 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:28.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:26.392664+0000 mgr.smithi152.lynahm (mgr.14196) 52 : audit [DBG] from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:16:28.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:26.569069+0000 mgr.smithi152.lynahm (mgr.14196) 53 : cephadm [INF] Reconfiguring mgr.smithi195.ausetj (monmap changed)... 2024-04-06T12:16:28.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:26.571162+0000 mgr.smithi152.lynahm (mgr.14196) 54 : cephadm [INF] Reconfiguring daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:16:28.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:27.846982+0000 mon.smithi152 (mon.0) 257 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:28.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:27.855982+0000 mon.smithi152 (mon.0) 258 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:16:28.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:27.856611+0000 mon.smithi152 (mon.0) 259 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:16:28.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:27.857252+0000 mon.smithi152 (mon.0) 260 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:28.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:26.392664+0000 mgr.smithi152.lynahm (mgr.14196) 52 : audit [DBG] from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:16:28.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:26.569069+0000 mgr.smithi152.lynahm (mgr.14196) 53 : cephadm [INF] Reconfiguring mgr.smithi195.ausetj (monmap changed)... 2024-04-06T12:16:28.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:26.571162+0000 mgr.smithi152.lynahm (mgr.14196) 54 : cephadm [INF] Reconfiguring daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:16:28.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:27.846982+0000 mon.smithi152 (mon.0) 257 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:28.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:27.855982+0000 mon.smithi152 (mon.0) 258 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:16:28.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:27.856611+0000 mon.smithi152 (mon.0) 259 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:16:28.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:27.857252+0000 mon.smithi152 (mon.0) 260 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:29.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:27.501902+0000 mgr.smithi152.lynahm (mgr.14196) 55 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:29.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:27.855732+0000 mgr.smithi152.lynahm (mgr.14196) 56 : cephadm [INF] Reconfiguring mon.smithi195 (monmap changed)... 2024-04-06T12:16:29.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:27.857763+0000 mgr.smithi152.lynahm (mgr.14196) 57 : cephadm [INF] Reconfiguring daemon mon.smithi195 on smithi195 2024-04-06T12:16:29.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:28.866678+0000 mon.smithi152 (mon.0) 261 : audit [INF] from='client.? 172.21.15.152:0/2843974620' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9490187-6df1-4d4f-bfd3-a2da32d3a669"}]: dispatch 2024-04-06T12:16:29.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:28.870301+0000 mon.smithi152 (mon.0) 262 : audit [INF] from='client.? 172.21.15.152:0/2843974620' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9490187-6df1-4d4f-bfd3-a2da32d3a669"}]': finished 2024-04-06T12:16:29.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:28.870338+0000 mon.smithi152 (mon.0) 263 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-04-06T12:16:29.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:28.870464+0000 mon.smithi152 (mon.0) 264 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:29.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:27.501902+0000 mgr.smithi152.lynahm (mgr.14196) 55 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:29.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:27.855732+0000 mgr.smithi152.lynahm (mgr.14196) 56 : cephadm [INF] Reconfiguring mon.smithi195 (monmap changed)... 2024-04-06T12:16:29.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:27.857763+0000 mgr.smithi152.lynahm (mgr.14196) 57 : cephadm [INF] Reconfiguring daemon mon.smithi195 on smithi195 2024-04-06T12:16:29.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:28.866678+0000 mon.smithi152 (mon.0) 261 : audit [INF] from='client.? 172.21.15.152:0/2843974620' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9490187-6df1-4d4f-bfd3-a2da32d3a669"}]: dispatch 2024-04-06T12:16:29.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:28.870301+0000 mon.smithi152 (mon.0) 262 : audit [INF] from='client.? 172.21.15.152:0/2843974620' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9490187-6df1-4d4f-bfd3-a2da32d3a669"}]': finished 2024-04-06T12:16:29.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:28.870338+0000 mon.smithi152 (mon.0) 263 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-04-06T12:16:29.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:28.870464+0000 mon.smithi152 (mon.0) 264 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:30.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.253357+0000 mon.smithi152 (mon.0) 265 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:30.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.256057+0000 mon.smithi152 (mon.0) 266 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:16:30.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.256410+0000 mgr.smithi152.lynahm (mgr.14196) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.257281+0000 mon.smithi152 (mon.0) 267 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi152.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.257595+0000 mgr.smithi152.lynahm (mgr.14196) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi152.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.261455+0000 mon.smithi152 (mon.0) 268 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.267947+0000 mon.smithi152 (mon.0) 269 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.271006+0000 mon.smithi152 (mon.0) 270 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi152.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.275732+0000 mon.smithi152 (mon.0) 271 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.280599+0000 mon.smithi152 (mon.0) 272 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.284181+0000 mon.smithi152 (mon.0) 273 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.288717+0000 mon.smithi152 (mon.0) 274 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.291109+0000 mon.smithi152 (mon.0) 275 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:16:30.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.517085+0000 mon.smithi152 (mon.0) 276 : audit [DBG] from='client.? 172.21.15.152:0/4061003815' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:16:30.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.253357+0000 mon.smithi152 (mon.0) 265 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.256057+0000 mon.smithi152 (mon.0) 266 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.256410+0000 mgr.smithi152.lynahm (mgr.14196) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.257281+0000 mon.smithi152 (mon.0) 267 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi152.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.257595+0000 mgr.smithi152.lynahm (mgr.14196) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi152.front.sepia.ceph.com:9093"}]: dispatch 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.261455+0000 mon.smithi152 (mon.0) 268 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.267947+0000 mon.smithi152 (mon.0) 269 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.271006+0000 mon.smithi152 (mon.0) 270 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi152.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.275732+0000 mon.smithi152 (mon.0) 271 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.280599+0000 mon.smithi152 (mon.0) 272 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.284181+0000 mon.smithi152 (mon.0) 273 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.288717+0000 mon.smithi152 (mon.0) 274 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.291109+0000 mon.smithi152 (mon.0) 275 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:16:30.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.517085+0000 mon.smithi152 (mon.0) 276 : audit [DBG] from='client.? 172.21.15.152:0/4061003815' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:16:31.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:31 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.268328+0000 mgr.smithi152.lynahm (mgr.14196) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:16:31.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:31 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.271375+0000 mgr.smithi152.lynahm (mgr.14196) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi152.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T12:16:31.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:31 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.281010+0000 mgr.smithi152.lynahm (mgr.14196) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:16:31.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:31 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:29.284527+0000 mgr.smithi152.lynahm (mgr.14196) 63 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T12:16:31.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:31 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:29.502139+0000 mgr.smithi152.lynahm (mgr.14196) 64 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:31.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:31 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.268328+0000 mgr.smithi152.lynahm (mgr.14196) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:16:31.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:31 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.271375+0000 mgr.smithi152.lynahm (mgr.14196) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi152.front.sepia.ceph.com:3000"}]: dispatch 2024-04-06T12:16:31.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:31 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.281010+0000 mgr.smithi152.lynahm (mgr.14196) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:16:31.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:31 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:29.284527+0000 mgr.smithi152.lynahm (mgr.14196) 63 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi195.front.sepia.ceph.com:9095"}]: dispatch 2024-04-06T12:16:31.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:31 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:29.502139+0000 mgr.smithi152.lynahm (mgr.14196) 64 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:33.173 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:31.502356+0000 mgr.smithi152.lynahm (mgr.14196) 65 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:33.173 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:31.905429+0000 mon.smithi152 (mon.0) 277 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:33.173 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:32.718351+0000 mon.smithi152 (mon.0) 278 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:31.502356+0000 mgr.smithi152.lynahm (mgr.14196) 65 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:31.905429+0000 mon.smithi152 (mon.0) 277 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:32.718351+0000 mon.smithi152 (mon.0) 278 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:35.062 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:33.502634+0000 mgr.smithi152.lynahm (mgr.14196) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:35.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:33.502634+0000 mgr.smithi152.lynahm (mgr.14196) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:37.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:35.502894+0000 mgr.smithi152.lynahm (mgr.14196) 67 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:37.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:35.502894+0000 mgr.smithi152.lynahm (mgr.14196) 67 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:37.153964+0000 mgr.smithi152.lynahm (mgr.14196) 68 : cephadm [INF] Detected new or changed devices on smithi152 2024-04-06T12:16:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:37.160316+0000 mon.smithi152 (mon.0) 279 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:38.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:37.500511+0000 mon.smithi152 (mon.0) 280 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:16:38.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:37.504805+0000 mon.smithi152 (mon.0) 281 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:38.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:37.505654+0000 mon.smithi152 (mon.0) 282 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:38.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:37.506162+0000 mon.smithi152 (mon.0) 283 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:16:38.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:37.509466+0000 mon.smithi152 (mon.0) 284 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:38.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:37.512634+0000 mon.smithi152 (mon.0) 285 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:16:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:37.153964+0000 mgr.smithi152.lynahm (mgr.14196) 68 : cephadm [INF] Detected new or changed devices on smithi152 2024-04-06T12:16:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:37.160316+0000 mon.smithi152 (mon.0) 279 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:37.500511+0000 mon.smithi152 (mon.0) 280 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:16:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:37.504805+0000 mon.smithi152 (mon.0) 281 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:37.505654+0000 mon.smithi152 (mon.0) 282 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:37.506162+0000 mon.smithi152 (mon.0) 283 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:16:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:37.509466+0000 mon.smithi152 (mon.0) 284 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:37.512634+0000 mon.smithi152 (mon.0) 285 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:16:39.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:37.501020+0000 mgr.smithi152.lynahm (mgr.14196) 69 : cephadm [INF] Adjusting osd_memory_target on smithi152 to 13922M 2024-04-06T12:16:39.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:37.503138+0000 mgr.smithi152.lynahm (mgr.14196) 70 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:39.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:37.501020+0000 mgr.smithi152.lynahm (mgr.14196) 69 : cephadm [INF] Adjusting osd_memory_target on smithi152 to 13922M 2024-04-06T12:16:39.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:37.503138+0000 mgr.smithi152.lynahm (mgr.14196) 70 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:39.257100+0000 mon.smithi152 (mon.0) 286 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-06T12:16:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:39.257676+0000 mon.smithi152 (mon.0) 287 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:39.258176+0000 mgr.smithi152.lynahm (mgr.14196) 71 : cephadm [INF] Deploying daemon osd.1 on smithi152 2024-04-06T12:16:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:40.115524+0000 mon.smithi152 (mon.0) 288 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:39.257100+0000 mon.smithi152 (mon.0) 286 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-06T12:16:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:39.257676+0000 mon.smithi152 (mon.0) 287 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:39.258176+0000 mgr.smithi152.lynahm (mgr.14196) 71 : cephadm [INF] Deploying daemon osd.1 on smithi152 2024-04-06T12:16:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:40.115524+0000 mon.smithi152 (mon.0) 288 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:41.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:39.503436+0000 mgr.smithi152.lynahm (mgr.14196) 72 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:41.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:39.503436+0000 mgr.smithi152.lynahm (mgr.14196) 72 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:43.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:41.503785+0000 mgr.smithi152.lynahm (mgr.14196) 73 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:43.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:43.108038+0000 mon.smithi152 (mon.0) 289 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:43.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:43.108687+0000 mon.smithi152 (mon.0) 290 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:43.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:43.109260+0000 mon.smithi152 (mon.0) 291 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:16:43.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:43.112405+0000 mon.smithi152 (mon.0) 292 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:43.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:41.503785+0000 mgr.smithi152.lynahm (mgr.14196) 73 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:43.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:43.108038+0000 mon.smithi152 (mon.0) 289 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:43.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:43.108687+0000 mon.smithi152 (mon.0) 290 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:43.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:43.109260+0000 mon.smithi152 (mon.0) 291 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:16:43.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:43.112405+0000 mon.smithi152 (mon.0) 292 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:45.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:43.504064+0000 mgr.smithi152.lynahm (mgr.14196) 74 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:45.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:43.504064+0000 mgr.smithi152.lynahm (mgr.14196) 74 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:47.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:45.504274+0000 mgr.smithi152.lynahm (mgr.14196) 75 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:47.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:46.173168+0000 mon.smithi152 (mon.0) 293 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:47.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:46.185094+0000 mon.smithi152 (mon.0) 294 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:16:47.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:45.504274+0000 mgr.smithi152.lynahm (mgr.14196) 75 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:47.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:46.173168+0000 mon.smithi152 (mon.0) 293 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:47.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:46.185094+0000 mon.smithi152 (mon.0) 294 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:16:49.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:47.504585+0000 mgr.smithi152.lynahm (mgr.14196) 76 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:49.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:48.634741+0000 mon.smithi152 (mon.0) 295 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:49.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:49 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:47.504585+0000 mgr.smithi152.lynahm (mgr.14196) 76 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:49.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:49 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:48.634741+0000 mon.smithi152 (mon.0) 295 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:50.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:50.044460+0000 mon.smithi152 (mon.0) 296 : audit [INF] from='osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-06T12:16:50.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.512+0000 7f74dd775700 1 -- 172.21.15.152:0/4065598706 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f74e0102170 con 0x7f74cc061180 2024-04-06T12:16:50.511 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 1 on host 'smithi152' 2024-04-06T12:16:50.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.514+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f74cc061180 msgr2=0x7f74cc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:16:50.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.514+0000 7f74e627b700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f74cc061180 0x7f74cc063640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f74e00f8b10 tx=0x7f74d000b040).stop 2024-04-06T12:16:50.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.514+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 msgr2=0x7f74e01086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:16:50.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.514+0000 7f74e627b700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 0x7f74e01086a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f74c8013470 tx=0x7f74c8009cb0).stop 2024-04-06T12:16:50.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.515+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 shutdown_connections 2024-04-06T12:16:50.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.515+0000 7f74e627b700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f74cc061180 0x7f74cc063640 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:50.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.515+0000 7f74e627b700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74e00f7a10 0x7f74e01081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:50.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.515+0000 7f74e627b700 1 --2- 172.21.15.152:0/4065598706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e00f8cb0 0x7f74e01086a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:50.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.515+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 >> 172.21.15.152:0/4065598706 conn(0x7f74e00f3150 msgr2=0x7f74e00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:16:50.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.515+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 shutdown_connections 2024-04-06T12:16:50.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:50.515+0000 7f74e627b700 1 -- 172.21.15.152:0/4065598706 wait complete. 2024-04-06T12:16:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:50.044460+0000 mon.smithi152 (mon.0) 296 : audit [INF] from='osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-06T12:16:51.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:49.504961+0000 mgr.smithi152.lynahm (mgr.14196) 77 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:51.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:50.183543+0000 mon.smithi152 (mon.0) 297 : audit [INF] from='osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-06T12:16:51.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:50.183618+0000 mon.smithi152 (mon.0) 298 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-04-06T12:16:51.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:50.183714+0000 mon.smithi152 (mon.0) 299 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:51.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:50.184055+0000 mon.smithi152 (mon.0) 300 : audit [INF] from='osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:16:51.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:50.513163+0000 mon.smithi152 (mon.0) 301 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:51.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:49.504961+0000 mgr.smithi152.lynahm (mgr.14196) 77 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:51.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:50.183543+0000 mon.smithi152 (mon.0) 297 : audit [INF] from='osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-06T12:16:51.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:50.183618+0000 mon.smithi152 (mon.0) 298 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-04-06T12:16:51.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:50.183714+0000 mon.smithi152 (mon.0) 299 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:51.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:50.184055+0000 mon.smithi152 (mon.0) 300 : audit [INF] from='osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:16:51.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:50.513163+0000 mon.smithi152 (mon.0) 301 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:51.939 DEBUG:teuthology.orchestra.run.smithi152:osd.1> sudo journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.1.service 2024-04-06T12:16:51.942 INFO:tasks.cephadm:Deploying osd.2 on smithi152 with /dev/vg_nvme/lv_2... 2024-04-06T12:16:51.942 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-06T12:16:51.972 INFO:journalctl@ceph.osd.1.smithi152.stdout:-- Logs begin at Sat 2024-04-06 12:02:33 UTC. -- 2024-04-06T12:16:52.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:51.185383+0000 mon.smithi152 (mon.0) 302 : audit [INF] from='osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-04-06T12:16:52.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:51.185440+0000 mon.smithi152 (mon.0) 303 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-04-06T12:16:52.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:51.185764+0000 mon.smithi152 (mon.0) 304 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:52.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:51.189286+0000 mon.smithi152 (mon.0) 305 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:51.185383+0000 mon.smithi152 (mon.0) 302 : audit [INF] from='osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-04-06T12:16:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:51.185440+0000 mon.smithi152 (mon.0) 303 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-04-06T12:16:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:51.185764+0000 mon.smithi152 (mon.0) 304 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:51.189286+0000 mon.smithi152 (mon.0) 305 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:51.020016+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:16:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:51.020118+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:16:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:51.505268+0000 mgr.smithi152.lynahm (mgr.14196) 78 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:52.189768+0000 mon.smithi152 (mon.0) 306 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:52.193363+0000 mon.smithi152 (mon.0) 307 : cluster [INF] osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] boot 2024-04-06T12:16:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:52.193391+0000 mon.smithi152 (mon.0) 308 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-04-06T12:16:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:52.193816+0000 mon.smithi152 (mon.0) 309 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:52.592158+0000 mon.smithi152 (mon.0) 310 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:51.020016+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:16:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:51.020118+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:16:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:51.505268+0000 mgr.smithi152.lynahm (mgr.14196) 78 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-06T12:16:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:52.189768+0000 mon.smithi152 (mon.0) 306 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:53.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:52.193363+0000 mon.smithi152 (mon.0) 307 : cluster [INF] osd.1 [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] boot 2024-04-06T12:16:53.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:52.193391+0000 mon.smithi152 (mon.0) 308 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-04-06T12:16:53.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:52.193816+0000 mon.smithi152 (mon.0) 309 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:16:53.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:52.592158+0000 mon.smithi152 (mon.0) 310 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:55.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:53.505560+0000 mgr.smithi152.lynahm (mgr.14196) 79 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:16:55.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:53.594087+0000 mon.smithi152 (mon.0) 311 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-04-06T12:16:55.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:53.505560+0000 mgr.smithi152.lynahm (mgr.14196) 79 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:16:55.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:53.594087+0000 mon.smithi152 (mon.0) 311 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-04-06T12:16:55.314 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-06T12:16:55.314 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-06T12:16:55.314 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2024-04-06T12:16:55.315 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2024-04-06T12:16:55.315 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126077 s, 832 MB/s 2024-04-06T12:16:55.315 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2024-04-06T12:16:56.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2024-04-06T12:16:56.681 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:55.505865+0000 mgr.smithi152.lynahm (mgr.14196) 80 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:16:57.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:55.505865+0000 mgr.smithi152.lynahm (mgr.14196) 80 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:16:58.762 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:57.506174+0000 mgr.smithi152.lynahm (mgr.14196) 81 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:16:58.762 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:58.569325+0000 mon.smithi152 (mon.0) 312 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:58.762 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:58.570109+0000 mon.smithi152 (mon.0) 313 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:16:58.762 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:58.570646+0000 mon.smithi152 (mon.0) 314 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:16:58.763 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:58.573945+0000 mon.smithi152 (mon.0) 315 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:58.763 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:58.574669+0000 mon.smithi152 (mon.0) 316 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:58.763 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:58.575200+0000 mon.smithi152 (mon.0) 317 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:16:58.763 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:58.578803+0000 mon.smithi152 (mon.0) 318 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:58.763 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:58.581985+0000 mon.smithi152 (mon.0) 319 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:16:59.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:57.506174+0000 mgr.smithi152.lynahm (mgr.14196) 81 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:16:59.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:58.569325+0000 mon.smithi152 (mon.0) 312 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:59.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:58.570109+0000 mon.smithi152 (mon.0) 313 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:16:59.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:58.570646+0000 mon.smithi152 (mon.0) 314 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:16:59.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:58.573945+0000 mon.smithi152 (mon.0) 315 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:59.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:58.574669+0000 mon.smithi152 (mon.0) 316 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:59.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:58.575200+0000 mon.smithi152 (mon.0) 317 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:16:59.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:58.578803+0000 mon.smithi152 (mon.0) 318 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:16:59.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:58.581985+0000 mon.smithi152 (mon.0) 319 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:16:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.005+0000 7fc76e767700 1 -- 172.21.15.152:0/3109253224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 msgr2=0x7fc7680f8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:16:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.005+0000 7fc76e767700 1 --2- 172.21.15.152:0/3109253224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 0x7fc7680f8b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc75c0047f0 tx=0x7fc75c009cb0).stop 2024-04-06T12:16:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.005+0000 7fc76e767700 1 -- 172.21.15.152:0/3109253224 shutdown_connections 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.005+0000 7fc76e767700 1 --2- 172.21.15.152:0/3109253224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 0x7fc7680f8b20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.005+0000 7fc76e767700 1 --2- 172.21.15.152:0/3109253224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7680f77e0 0x7fc7680f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.005+0000 7fc76e767700 1 -- 172.21.15.152:0/3109253224 >> 172.21.15.152:0/3109253224 conn(0x7fc7680f2fc0 msgr2=0x7fc7680f5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.006+0000 7fc76e767700 1 -- 172.21.15.152:0/3109253224 shutdown_connections 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.006+0000 7fc76e767700 1 -- 172.21.15.152:0/3109253224 wait complete. 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.006+0000 7fc76e767700 1 Processor -- start 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.006+0000 7fc76e767700 1 -- start start 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.006+0000 7fc76e767700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7680f77e0 0x7fc76806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.006+0000 7fc76e767700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 0x7fc76806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc76e767700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76806cf80 con 0x7fc7680f80f0 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc76e767700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76806b520 con 0x7fc7680f77e0 2024-04-06T12:16:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7677fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 0x7fc76806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7677fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 0x7fc76806b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44782/0 (socket says 172.21.15.152:44782) 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7677fe700 1 -- 172.21.15.152:0/3854319287 learned_addr learned my addr 172.21.15.152:0/3854319287 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc767fff700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7680f77e0 0x7fc76806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7677fe700 1 -- 172.21.15.152:0/3854319287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7680f77e0 msgr2=0x7fc76806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7677fe700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7680f77e0 0x7fc76806c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7677fe700 1 -- 172.21.15.152:0/3854319287 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c005040 con 0x7fc7680f80f0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7677fe700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 0x7fc76806b030 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc75c013470 tx=0x7fc75c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7657fa700 1 -- 172.21.15.152:0/3854319287 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc75c00e030 con 0x7fc7680f80f0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7657fa700 1 -- 172.21.15.152:0/3854319287 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc75c007e90 con 0x7fc7680f80f0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76806b740 con 0x7fc7680f80f0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc7657fa700 1 -- 172.21.15.152:0/3854319287 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc75c018070 con 0x7fc7680f80f0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.007+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76806bc20 con 0x7fc7680f80f0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.008+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76806be90 con 0x7fc7680f80f0 2024-04-06T12:16:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.009+0000 7fc7657fa700 1 -- 172.21.15.152:0/3854319287 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fc75c01d420 con 0x7fc7680f80f0 2024-04-06T12:16:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.009+0000 7fc7657fa700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc750061110 0x7fc7500635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:16:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.009+0000 7fc767fff700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc750061110 0x7fc7500635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:16:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.009+0000 7fc7657fa700 1 -- 172.21.15.152:0/3854319287 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2281+0+0 (secure 0 0 0) 0x7fc75c07d060 con 0x7fc7680f80f0 2024-04-06T12:16:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.009+0000 7fc767fff700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc750061110 0x7fc7500635d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc758004de0 tx=0x7fc75800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:16:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.014+0000 7fc7657fa700 1 -- 172.21.15.152:0/3854319287 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc75c051c00 con 0x7fc7680f80f0 2024-04-06T12:16:59.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:16:59.197+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7681001c0 con 0x7fc750061110 2024-04-06T12:16:59.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:16:58.571012+0000 mgr.smithi152.lynahm (mgr.14196) 82 : cephadm [INF] Adjusting osd_memory_target on smithi152 to 6961M 2024-04-06T12:16:59.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:59.198912+0000 mgr.smithi152.lynahm (mgr.14196) 83 : audit [DBG] from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:16:59.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:59.201142+0000 mon.smithi152 (mon.0) 320 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:16:59.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:59.203287+0000 mon.smithi152 (mon.0) 321 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:16:59.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:16:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:16:59.203857+0000 mon.smithi152 (mon.0) 322 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:16:59.931 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:59 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:16:58.571012+0000 mgr.smithi152.lynahm (mgr.14196) 82 : cephadm [INF] Adjusting osd_memory_target on smithi152 to 6961M 2024-04-06T12:16:59.931 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:59 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:59.198912+0000 mgr.smithi152.lynahm (mgr.14196) 83 : audit [DBG] from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:16:59.931 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:59 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:59.201142+0000 mon.smithi152 (mon.0) 320 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:16:59.931 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:59 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:59.203287+0000 mon.smithi152 (mon.0) 321 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:16:59.932 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:16:59 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:16:59.203857+0000 mon.smithi152 (mon.0) 322 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:00.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:16:59.506447+0000 mgr.smithi152.lynahm (mgr.14196) 84 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:01.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:16:59.506447+0000 mgr.smithi152.lynahm (mgr.14196) 84 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:01.025700+0000 mon.smithi152 (mon.0) 323 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:02.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:01.025700+0000 mon.smithi152 (mon.0) 323 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:03.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:01.506702+0000 mgr.smithi152.lynahm (mgr.14196) 85 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:03.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:02.854966+0000 mon.smithi152 (mon.0) 324 : audit [INF] from='client.? 172.21.15.152:0/1244932370' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a279284-26fa-436f-a830-abda13b40713"}]: dispatch 2024-04-06T12:17:03.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:02.858443+0000 mon.smithi152 (mon.0) 325 : audit [INF] from='client.? 172.21.15.152:0/1244932370' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a279284-26fa-436f-a830-abda13b40713"}]': finished 2024-04-06T12:17:03.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:02.858489+0000 mon.smithi152 (mon.0) 326 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-04-06T12:17:03.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:02.858589+0000 mon.smithi152 (mon.0) 327 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:03.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:01.506702+0000 mgr.smithi152.lynahm (mgr.14196) 85 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:03.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:02.854966+0000 mon.smithi152 (mon.0) 324 : audit [INF] from='client.? 172.21.15.152:0/1244932370' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a279284-26fa-436f-a830-abda13b40713"}]: dispatch 2024-04-06T12:17:03.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:02.858443+0000 mon.smithi152 (mon.0) 325 : audit [INF] from='client.? 172.21.15.152:0/1244932370' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a279284-26fa-436f-a830-abda13b40713"}]': finished 2024-04-06T12:17:03.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:02.858489+0000 mon.smithi152 (mon.0) 326 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-04-06T12:17:03.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:02.858589+0000 mon.smithi152 (mon.0) 327 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:04.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:03.614053+0000 mon.smithi152 (mon.0) 328 : audit [DBG] from='client.? 172.21.15.152:0/1191835585' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:17:04.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:03.614053+0000 mon.smithi152 (mon.0) 328 : audit [DBG] from='client.? 172.21.15.152:0/1191835585' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:17:05.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:03.506979+0000 mgr.smithi152.lynahm (mgr.14196) 86 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:05.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:04.151199+0000 mon.smithi152 (mon.0) 329 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:05.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:04.151851+0000 mon.smithi152 (mon.0) 330 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:05.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:04.152457+0000 mon.smithi152 (mon.0) 331 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:05.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:04.157325+0000 mon.smithi152 (mon.0) 332 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:03.506979+0000 mgr.smithi152.lynahm (mgr.14196) 86 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:04.151199+0000 mon.smithi152 (mon.0) 329 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:04.151851+0000 mon.smithi152 (mon.0) 330 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:04.152457+0000 mon.smithi152 (mon.0) 331 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:05.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:04.157325+0000 mon.smithi152 (mon.0) 332 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:07.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:05.507373+0000 mgr.smithi152.lynahm (mgr.14196) 87 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:05.507373+0000 mgr.smithi152.lynahm (mgr.14196) 87 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:09.295 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:07.507660+0000 mgr.smithi152.lynahm (mgr.14196) 88 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:09.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:07.507660+0000 mgr.smithi152.lynahm (mgr.14196) 88 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:11.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:09.507945+0000 mgr.smithi152.lynahm (mgr.14196) 89 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:11.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:10.351164+0000 mon.smithi152 (mon.0) 333 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-06T12:17:11.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:10.351735+0000 mon.smithi152 (mon.0) 334 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:09.507945+0000 mgr.smithi152.lynahm (mgr.14196) 89 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:10.351164+0000 mon.smithi152 (mon.0) 333 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-06T12:17:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:10.351735+0000 mon.smithi152 (mon.0) 334 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:12.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:17:10.352234+0000 mgr.smithi152.lynahm (mgr.14196) 90 : cephadm [INF] Deploying daemon osd.2 on smithi152 2024-04-06T12:17:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:17:10.352234+0000 mgr.smithi152.lynahm (mgr.14196) 90 : cephadm [INF] Deploying daemon osd.2 on smithi152 2024-04-06T12:17:13.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:13 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:11.508208+0000 mgr.smithi152.lynahm (mgr.14196) 91 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:13 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:11.508208+0000 mgr.smithi152.lynahm (mgr.14196) 91 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:15.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:13.508436+0000 mgr.smithi152.lynahm (mgr.14196) 92 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:13.508436+0000 mgr.smithi152.lynahm (mgr.14196) 92 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:15.386860+0000 mon.smithi152 (mon.0) 335 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:15.398085+0000 mon.smithi152 (mon.0) 336 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:17:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:15.508688+0000 mgr.smithi152.lynahm (mgr.14196) 93 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:16.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:15.386860+0000 mon.smithi152 (mon.0) 335 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:16.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:15.398085+0000 mon.smithi152 (mon.0) 336 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:17:16.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:15.508688+0000 mgr.smithi152.lynahm (mgr.14196) 93 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:17.509083+0000 mgr.smithi152.lynahm (mgr.14196) 94 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:17.509083+0000 mgr.smithi152.lynahm (mgr.14196) 94 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:19.537 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 2 on host 'smithi152' 2024-04-06T12:17:19.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.538+0000 7fc7657fa700 1 -- 172.21.15.152:0/3854319287 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc7681001c0 con 0x7fc750061110 2024-04-06T12:17:19.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc750061110 msgr2=0x7fc7500635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:17:19.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc750061110 0x7fc7500635d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc758004de0 tx=0x7fc75800b040).stop 2024-04-06T12:17:19.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 msgr2=0x7fc76806b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:17:19.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 0x7fc76806b030 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc75c013470 tx=0x7fc75c009cb0).stop 2024-04-06T12:17:19.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 shutdown_connections 2024-04-06T12:17:19.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc750061110 0x7fc7500635d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:19.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7680f77e0 0x7fc76806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:19.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 --2- 172.21.15.152:0/3854319287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680f80f0 0x7fc76806b030 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:19.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 >> 172.21.15.152:0/3854319287 conn(0x7fc7680f2fc0 msgr2=0x7fc7680fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:17:19.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 shutdown_connections 2024-04-06T12:17:19.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:17:19.540+0000 7fc76e767700 1 -- 172.21.15.152:0/3854319287 wait complete. 2024-04-06T12:17:19.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:19.274802+0000 mon.smithi152 (mon.0) 337 : audit [INF] from='osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T12:17:19.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:19.538507+0000 mon.smithi152 (mon.0) 338 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:19.274802+0000 mon.smithi152 (mon.0) 337 : audit [INF] from='osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T12:17:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:19.538507+0000 mon.smithi152 (mon.0) 338 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:20.193 DEBUG:teuthology.orchestra.run.smithi152:osd.2> sudo journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.2.service 2024-04-06T12:17:20.196 INFO:tasks.cephadm:Deploying osd.3 on smithi195 with /dev/vg_nvme/lv_4... 2024-04-06T12:17:20.196 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-06T12:17:20.226 INFO:journalctl@ceph.osd.2.smithi152.stdout:-- Logs begin at Sat 2024-04-06 12:02:33 UTC. -- 2024-04-06T12:17:20.776 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:17:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[65311]: debug 2024-04-06T12:17:20.572+0000 7f03fe905700 -1 osd.2 0 waiting for initial osdmap 2024-04-06T12:17:20.776 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:17:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[65311]: debug 2024-04-06T12:17:20.577+0000 7f03f787a700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T12:17:20.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:19.509421+0000 mgr.smithi152.lynahm (mgr.14196) 95 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:20.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:19.568557+0000 mon.smithi152 (mon.0) 339 : audit [INF] from='osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-06T12:17:20.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:19.568601+0000 mon.smithi152 (mon.0) 340 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-04-06T12:17:20.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:19.568708+0000 mon.smithi152 (mon.0) 341 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:20.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:19.569150+0000 mon.smithi152 (mon.0) 342 : audit [INF] from='osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:17:20.937 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:19.509421+0000 mgr.smithi152.lynahm (mgr.14196) 95 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:20.937 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:19.568557+0000 mon.smithi152 (mon.0) 339 : audit [INF] from='osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-06T12:17:20.937 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:19.568601+0000 mon.smithi152 (mon.0) 340 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-04-06T12:17:20.937 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:19.568708+0000 mon.smithi152 (mon.0) 341 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:20.937 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:19.569150+0000 mon.smithi152 (mon.0) 342 : audit [INF] from='osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:17:22.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:20.569813+0000 mon.smithi152 (mon.0) 343 : audit [INF] from='osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-04-06T12:17:22.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:20.569861+0000 mon.smithi152 (mon.0) 344 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-04-06T12:17:22.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:20.570208+0000 mon.smithi152 (mon.0) 345 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:22.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:20.574127+0000 mon.smithi152 (mon.0) 346 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:22.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:20.569813+0000 mon.smithi152 (mon.0) 343 : audit [INF] from='osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-04-06T12:17:22.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:20.569861+0000 mon.smithi152 (mon.0) 344 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-04-06T12:17:22.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:20.570208+0000 mon.smithi152 (mon.0) 345 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:22.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:20.574127+0000 mon.smithi152 (mon.0) 346 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:22.305 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-06T12:17:22.305 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-06T12:17:22.305 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-04-06T12:17:22.305 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-04-06T12:17:22.305 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0124485 s, 842 MB/s 2024-04-06T12:17:22.305 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-04-06T12:17:22.986 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:20.272416+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:17:22.986 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:20.272545+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:17:22.986 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:21.509851+0000 mgr.smithi152.lynahm (mgr.14196) 96 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:22.986 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:21.575034+0000 mon.smithi152 (mon.0) 347 : cluster [INF] osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] boot 2024-04-06T12:17:22.986 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:21.575060+0000 mon.smithi152 (mon.0) 348 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-04-06T12:17:22.986 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:21.575358+0000 mon.smithi152 (mon.0) 349 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:22.986 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:21.575802+0000 mon.smithi152 (mon.0) 350 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-06T12:17:22.986 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:21.913913+0000 mon.smithi152 (mon.0) 351 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:22.986 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:22.576828+0000 mon.smithi152 (mon.0) 352 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-06T12:17:22.987 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:22.576873+0000 mon.smithi152 (mon.0) 353 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-04-06T12:17:22.987 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:22.577528+0000 mon.smithi152 (mon.0) 354 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-04-06T12:17:23.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2024-04-06T12:17:23.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:20.272416+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:17:23.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:20.272545+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:17:23.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:21.509851+0000 mgr.smithi152.lynahm (mgr.14196) 96 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-06T12:17:23.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:21.575034+0000 mon.smithi152 (mon.0) 347 : cluster [INF] osd.2 [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] boot 2024-04-06T12:17:23.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:21.575060+0000 mon.smithi152 (mon.0) 348 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-04-06T12:17:23.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:21.575358+0000 mon.smithi152 (mon.0) 349 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:17:23.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:21.575802+0000 mon.smithi152 (mon.0) 350 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-06T12:17:23.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:21.913913+0000 mon.smithi152 (mon.0) 351 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:23.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:22.576828+0000 mon.smithi152 (mon.0) 352 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-06T12:17:23.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:22.576873+0000 mon.smithi152 (mon.0) 353 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-04-06T12:17:23.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:22.577528+0000 mon.smithi152 (mon.0) 354 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-04-06T12:17:24.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:23.510181+0000 mgr.smithi152.lynahm (mgr.14196) 97 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:24.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:23.577578+0000 mon.smithi152 (mon.0) 355 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-04-06T12:17:24.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:23.577634+0000 mon.smithi152 (mon.0) 356 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-04-06T12:17:24.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:23.510181+0000 mgr.smithi152.lynahm (mgr.14196) 97 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:24.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:23.577578+0000 mon.smithi152 (mon.0) 355 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-04-06T12:17:24.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:23.577634+0000 mon.smithi152 (mon.0) 356 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-04-06T12:17:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.048+0000 7f213d8f7700 1 -- 172.21.15.195:0/4235501912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f6470 msgr2=0x7f21380f8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:17:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.048+0000 7f213d8f7700 1 --2- 172.21.15.195:0/4235501912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f6470 0x7f21380f8bf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f21280047f0 tx=0x7f2128009cb0).stop 2024-04-06T12:17:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.048+0000 7f213d8f7700 1 -- 172.21.15.195:0/4235501912 shutdown_connections 2024-04-06T12:17:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.048+0000 7f213d8f7700 1 --2- 172.21.15.195:0/4235501912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f6470 0x7f21380f8bf0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.048+0000 7f213d8f7700 1 --2- 172.21.15.195:0/4235501912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21380f5ad0 0x7f21380f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.048+0000 7f213d8f7700 1 -- 172.21.15.195:0/4235501912 >> 172.21.15.195:0/4235501912 conn(0x7f21380f1610 msgr2=0x7f21380f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:17:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.048+0000 7f213d8f7700 1 -- 172.21.15.195:0/4235501912 shutdown_connections 2024-04-06T12:17:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.048+0000 7f213d8f7700 1 -- 172.21.15.195:0/4235501912 wait complete. 2024-04-06T12:17:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f213d8f7700 1 Processor -- start 2024-04-06T12:17:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f213d8f7700 1 -- start start 2024-04-06T12:17:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f213d8f7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f5ad0 0x7f21380f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:17:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f213d8f7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21380f6470 0x7f21380f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f213d8f7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21380f8a50 con 0x7f21380f6470 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f213d8f7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21380f6ff0 con 0x7f21380f5ad0 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f2136ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f5ad0 0x7f21380f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f2136ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f5ad0 0x7f21380f84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:37234/0 (socket says 172.21.15.195:37234) 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f2136ffd700 1 -- 172.21.15.195:0/876756186 learned_addr learned my addr 172.21.15.195:0/876756186 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.049+0000 7f21367fc700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21380f6470 0x7f21380f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.050+0000 7f2136ffd700 1 -- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21380f6470 msgr2=0x7f21380f6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.050+0000 7f2136ffd700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21380f6470 0x7f21380f6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.050+0000 7f2136ffd700 1 -- 172.21.15.195:0/876756186 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2128005040 con 0x7f21380f5ad0 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.050+0000 7f2136ffd700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f5ad0 0x7f21380f84a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f2120002780 tx=0x7f2120009ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:17:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.050+0000 7f212ffff700 1 -- 172.21.15.195:0/876756186 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2120007b40 con 0x7f21380f5ad0 2024-04-06T12:17:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.050+0000 7f212ffff700 1 -- 172.21.15.195:0/876756186 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f212000f040 con 0x7f21380f5ad0 2024-04-06T12:17:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.050+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21380f7270 con 0x7f21380f5ad0 2024-04-06T12:17:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.050+0000 7f212ffff700 1 -- 172.21.15.195:0/876756186 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2120014780 con 0x7f21380f5ad0 2024-04-06T12:17:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.050+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21380f77b0 con 0x7f21380f5ad0 2024-04-06T12:17:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.051+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2138100010 con 0x7f21380f5ad0 2024-04-06T12:17:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.051+0000 7f212ffff700 1 -- 172.21.15.195:0/876756186 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f2120007ca0 con 0x7f21380f5ad0 2024-04-06T12:17:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.052+0000 7f212ffff700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2124061180 0x7f2124063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:17:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.052+0000 7f212ffff700 1 -- 172.21.15.195:0/876756186 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f212007bdf0 con 0x7f21380f5ad0 2024-04-06T12:17:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.052+0000 7f21367fc700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2124061180 0x7f2124063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:17:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.052+0000 7f21367fc700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2124061180 0x7f2124063640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2128013470 tx=0x7f2128009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:17:25.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.056+0000 7f212ffff700 1 -- 172.21.15.195:0/876756186 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f21200506c0 con 0x7f21380f5ad0 2024-04-06T12:17:25.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:25.224+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2138059120 con 0x7f2124061180 2024-04-06T12:17:26.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:24.831105+0000 mon.smithi152 (mon.0) 357 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-04-06T12:17:26.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.226652+0000 mgr.smithi152.lynahm (mgr.14196) 98 : audit [DBG] from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:17:26.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.228904+0000 mon.smithi152 (mon.0) 358 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:17:26.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.230872+0000 mon.smithi152 (mon.0) 359 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.231502+0000 mon.smithi152 (mon.0) 360 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.336971+0000 mon.smithi152 (mon.0) 361 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.337739+0000 mon.smithi152 (mon.0) 362 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.338338+0000 mon.smithi152 (mon.0) 363 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.338903+0000 mon.smithi152 (mon.0) 364 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.344829+0000 mon.smithi152 (mon.0) 365 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.345689+0000 mon.smithi152 (mon.0) 366 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.346215+0000 mon.smithi152 (mon.0) 367 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.352358+0000 mon.smithi152 (mon.0) 368 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.356290+0000 mon.smithi152 (mon.0) 369 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.357521+0000 mon.smithi152 (mon.0) 370 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.358056+0000 mon.smithi152 (mon.0) 371 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:26.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:25.363658+0000 mon.smithi152 (mon.0) 372 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:24.831105+0000 mon.smithi152 (mon.0) 357 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-04-06T12:17:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.226652+0000 mgr.smithi152.lynahm (mgr.14196) 98 : audit [DBG] from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:17:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.228904+0000 mon.smithi152 (mon.0) 358 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.230872+0000 mon.smithi152 (mon.0) 359 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.231502+0000 mon.smithi152 (mon.0) 360 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.336971+0000 mon.smithi152 (mon.0) 361 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.337739+0000 mon.smithi152 (mon.0) 362 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.338338+0000 mon.smithi152 (mon.0) 363 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.338903+0000 mon.smithi152 (mon.0) 364 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.344829+0000 mon.smithi152 (mon.0) 365 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.345689+0000 mon.smithi152 (mon.0) 366 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.346215+0000 mon.smithi152 (mon.0) 367 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.352358+0000 mon.smithi152 (mon.0) 368 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.356290+0000 mon.smithi152 (mon.0) 369 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.357521+0000 mon.smithi152 (mon.0) 370 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:26.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.358056+0000 mon.smithi152 (mon.0) 371 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:26.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:25.363658+0000 mon.smithi152 (mon.0) 372 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:27.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:17:25.332248+0000 mgr.smithi152.lynahm (mgr.14196) 99 : cephadm [INF] Detected new or changed devices on smithi152 2024-04-06T12:17:27.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:17:25.339313+0000 mgr.smithi152.lynahm (mgr.14196) 100 : cephadm [INF] Adjusting osd_memory_target on smithi152 to 4640M 2024-04-06T12:17:27.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:25.510436+0000 mgr.smithi152.lynahm (mgr.14196) 101 : cluster [DBG] pgmap v75: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:27.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:17:25.332248+0000 mgr.smithi152.lynahm (mgr.14196) 99 : cephadm [INF] Detected new or changed devices on smithi152 2024-04-06T12:17:27.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:17:25.339313+0000 mgr.smithi152.lynahm (mgr.14196) 100 : cephadm [INF] Adjusting osd_memory_target on smithi152 to 4640M 2024-04-06T12:17:27.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:25.510436+0000 mgr.smithi152.lynahm (mgr.14196) 101 : cluster [DBG] pgmap v75: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:27.789291+0000 mon.smithi195 (mon.1) 2 : audit [INF] from='client.? 172.21.15.195:0/2400792297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64e8942a-1121-44fd-9ed2-cbb5176df587"}]: dispatch 2024-04-06T12:17:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:27.789748+0000 mon.smithi152 (mon.0) 373 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64e8942a-1121-44fd-9ed2-cbb5176df587"}]: dispatch 2024-04-06T12:17:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:27.794193+0000 mon.smithi152 (mon.0) 374 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64e8942a-1121-44fd-9ed2-cbb5176df587"}]': finished 2024-04-06T12:17:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:27.794252+0000 mon.smithi152 (mon.0) 375 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-04-06T12:17:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:27.794423+0000 mon.smithi152 (mon.0) 376 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:27.789291+0000 mon.smithi195 (mon.1) 2 : audit [INF] from='client.? 172.21.15.195:0/2400792297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64e8942a-1121-44fd-9ed2-cbb5176df587"}]: dispatch 2024-04-06T12:17:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:27.789748+0000 mon.smithi152 (mon.0) 373 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64e8942a-1121-44fd-9ed2-cbb5176df587"}]: dispatch 2024-04-06T12:17:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:27.794193+0000 mon.smithi152 (mon.0) 374 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64e8942a-1121-44fd-9ed2-cbb5176df587"}]': finished 2024-04-06T12:17:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:27.794252+0000 mon.smithi152 (mon.0) 375 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-04-06T12:17:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:27.794423+0000 mon.smithi152 (mon.0) 376 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:29.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:27.510811+0000 mgr.smithi152.lynahm (mgr.14196) 102 : cluster [DBG] pgmap v76: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:29.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:28.375871+0000 mon.smithi195 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.195:0/3393625202' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:17:29.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:27.510811+0000 mgr.smithi152.lynahm (mgr.14196) 102 : cluster [DBG] pgmap v76: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:29.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:28.375871+0000 mon.smithi195 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.195:0/3393625202' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:17:31.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:29.511278+0000 mgr.smithi152.lynahm (mgr.14196) 103 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:31.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:29.511278+0000 mgr.smithi152.lynahm (mgr.14196) 103 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:33.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:31.511724+0000 mgr.smithi152.lynahm (mgr.14196) 104 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:31.511724+0000 mgr.smithi152.lynahm (mgr.14196) 104 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:33.512131+0000 mgr.smithi152.lynahm (mgr.14196) 105 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:34.698104+0000 mon.smithi152 (mon.0) 377 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-06T12:17:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:34.698864+0000 mon.smithi152 (mon.0) 378 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:35.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:33.512131+0000 mgr.smithi152.lynahm (mgr.14196) 105 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:35.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:34.698104+0000 mon.smithi152 (mon.0) 377 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-06T12:17:35.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:34.698864+0000 mon.smithi152 (mon.0) 378 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:36.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:17:34.699525+0000 mgr.smithi152.lynahm (mgr.14196) 106 : cephadm [INF] Deploying daemon osd.3 on smithi195 2024-04-06T12:17:36.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:17:34.699525+0000 mgr.smithi152.lynahm (mgr.14196) 106 : cephadm [INF] Deploying daemon osd.3 on smithi195 2024-04-06T12:17:37.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:35.512650+0000 mgr.smithi152.lynahm (mgr.14196) 107 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:37.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:35.512650+0000 mgr.smithi152.lynahm (mgr.14196) 107 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:39.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:37.513080+0000 mgr.smithi152.lynahm (mgr.14196) 108 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:37.513080+0000 mgr.smithi152.lynahm (mgr.14196) 108 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:39.513581+0000 mgr.smithi152.lynahm (mgr.14196) 109 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:39.738601+0000 mon.smithi152 (mon.0) 379 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:39.768385+0000 mon.smithi152 (mon.0) 380 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:17:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:39.513581+0000 mgr.smithi152.lynahm (mgr.14196) 109 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:39.738601+0000 mon.smithi152 (mon.0) 379 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:39.768385+0000 mon.smithi152 (mon.0) 380 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:17:43.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:41.514005+0000 mgr.smithi152.lynahm (mgr.14196) 110 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:43.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:41.514005+0000 mgr.smithi152.lynahm (mgr.14196) 110 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:43.856 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.857+0000 7f212ffff700 1 -- 172.21.15.195:0/876756186 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2138059120 con 0x7f2124061180 2024-04-06T12:17:43.857 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 3 on host 'smithi195' 2024-04-06T12:17:43.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.859+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2124061180 msgr2=0x7f2124063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:17:43.858 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.859+0000 7f213d8f7700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2124061180 0x7f2124063640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2128013470 tx=0x7f2128009cb0).stop 2024-04-06T12:17:43.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.860+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f5ad0 msgr2=0x7f21380f84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:17:43.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.860+0000 7f213d8f7700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f5ad0 0x7f21380f84a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f2120002780 tx=0x7f2120009ee0).stop 2024-04-06T12:17:43.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.860+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 shutdown_connections 2024-04-06T12:17:43.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.860+0000 7f213d8f7700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2124061180 0x7f2124063640 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:43.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.860+0000 7f213d8f7700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21380f5ad0 0x7f21380f84a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:43.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.860+0000 7f213d8f7700 1 --2- 172.21.15.195:0/876756186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21380f6470 0x7f21380f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:43.859 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.860+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 >> 172.21.15.195:0/876756186 conn(0x7f21380f1610 msgr2=0x7f21380fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:17:43.860 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.860+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 shutdown_connections 2024-04-06T12:17:43.860 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:43.860+0000 7f213d8f7700 1 -- 172.21.15.195:0/876756186 wait complete. 2024-04-06T12:17:44.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:43.654823+0000 mon.smithi195 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T12:17:44.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:43.655289+0000 mon.smithi152 (mon.0) 381 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T12:17:44.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:43.654823+0000 mon.smithi195 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T12:17:44.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:43.655289+0000 mon.smithi152 (mon.0) 381 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T12:17:44.499 DEBUG:teuthology.orchestra.run.smithi195:osd.3> sudo journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.3.service 2024-04-06T12:17:44.502 INFO:tasks.cephadm:Deploying osd.4 on smithi195 with /dev/vg_nvme/lv_3... 2024-04-06T12:17:44.502 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-06T12:17:44.532 INFO:journalctl@ceph.osd.3.smithi195.stdout:-- Logs begin at Sat 2024-04-06 12:02:27 UTC. -- 2024-04-06T12:17:44.751 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:43.514296+0000 mgr.smithi152.lynahm (mgr.14196) 111 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:44.751 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:43.747987+0000 mon.smithi152 (mon.0) 382 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-06T12:17:44.751 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:43.748094+0000 mon.smithi152 (mon.0) 383 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-04-06T12:17:44.751 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:43.748248+0000 mon.smithi152 (mon.0) 384 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:44.751 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:43.748614+0000 mon.smithi195 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:17:44.751 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:43.748883+0000 mon.smithi152 (mon.0) 385 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:17:44.752 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:43.858152+0000 mon.smithi152 (mon.0) 386 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:45.003 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:17:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[48933]: debug 2024-04-06T12:17:44.753+0000 7fc726ac5700 -1 osd.3 0 waiting for initial osdmap 2024-04-06T12:17:45.003 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:17:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[48933]: debug 2024-04-06T12:17:44.760+0000 7fc72023b700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T12:17:45.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:43.514296+0000 mgr.smithi152.lynahm (mgr.14196) 111 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:45.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:43.747987+0000 mon.smithi152 (mon.0) 382 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-06T12:17:45.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:43.748094+0000 mon.smithi152 (mon.0) 383 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-04-06T12:17:45.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:43.748248+0000 mon.smithi152 (mon.0) 384 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:45.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:43.748614+0000 mon.smithi195 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:17:45.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:43.748883+0000 mon.smithi152 (mon.0) 385 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:17:45.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:43.858152+0000 mon.smithi152 (mon.0) 386 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:45.752 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:44.750238+0000 mon.smithi152 (mon.0) 387 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-06T12:17:45.752 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:44.750347+0000 mon.smithi152 (mon.0) 388 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-04-06T12:17:45.752 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:44.750800+0000 mon.smithi152 (mon.0) 389 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:45.752 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:44.755567+0000 mon.smithi152 (mon.0) 390 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:45.753 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:44.779368+0000 mon.smithi152 (mon.0) 391 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:45.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:44.750238+0000 mon.smithi152 (mon.0) 387 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-06T12:17:45.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:44.750347+0000 mon.smithi152 (mon.0) 388 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-04-06T12:17:45.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:44.750800+0000 mon.smithi152 (mon.0) 389 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:45.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:44.755567+0000 mon.smithi152 (mon.0) 390 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:45.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:44.779368+0000 mon.smithi152 (mon.0) 391 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-06T12:17:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-06T12:17:46.949 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-04-06T12:17:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-04-06T12:17:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0084471 s, 1.2 GB/s 2024-04-06T12:17:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-04-06T12:17:47.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:44.651075+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:17:47.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:44.651161+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:17:47.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:45.514665+0000 mgr.smithi152.lynahm (mgr.14196) 112 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:47.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:45.752304+0000 mon.smithi152 (mon.0) 392 : cluster [INF] osd.3 [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] boot 2024-04-06T12:17:47.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:45.752343+0000 mon.smithi152 (mon.0) 393 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-04-06T12:17:47.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:45.752487+0000 mon.smithi152 (mon.0) 394 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:44.651075+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:17:47.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:44.651161+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:17:47.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:45.514665+0000 mgr.smithi152.lynahm (mgr.14196) 112 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-04-06T12:17:47.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:45.752304+0000 mon.smithi152 (mon.0) 392 : cluster [INF] osd.3 [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] boot 2024-04-06T12:17:47.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:45.752343+0000 mon.smithi152 (mon.0) 393 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-04-06T12:17:47.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:45.752487+0000 mon.smithi152 (mon.0) 394 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:17:48.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:46.758795+0000 mon.smithi152 (mon.0) 395 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-04-06T12:17:48.041 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:46.758795+0000 mon.smithi152 (mon.0) 395 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-04-06T12:17:48.449 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2024-04-06T12:17:49.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:47.515172+0000 mgr.smithi152.lynahm (mgr.14196) 113 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:49.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:47.760347+0000 mon.smithi152 (mon.0) 396 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-04-06T12:17:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:47.515172+0000 mgr.smithi152.lynahm (mgr.14196) 113 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:47.760347+0000 mon.smithi152 (mon.0) 396 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-04-06T12:17:50.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:17:49.191915+0000 mgr.smithi152.lynahm (mgr.14196) 114 : cephadm [INF] Detected new or changed devices on smithi195 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.197330+0000 mon.smithi152 (mon.0) 397 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.507429+0000 mon.smithi152 (mon.0) 398 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.514669+0000 mon.smithi152 (mon.0) 399 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.515942+0000 mon.smithi152 (mon.0) 400 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.516702+0000 mon.smithi152 (mon.0) 401 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.523381+0000 mon.smithi152 (mon.0) 402 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.527617+0000 mon.smithi152 (mon.0) 403 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.529142+0000 mon.smithi152 (mon.0) 404 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.529843+0000 mon.smithi152 (mon.0) 405 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:50.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:49.536220+0000 mon.smithi152 (mon.0) 406 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:50.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:17:49.191915+0000 mgr.smithi152.lynahm (mgr.14196) 114 : cephadm [INF] Detected new or changed devices on smithi195 2024-04-06T12:17:50.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.197330+0000 mon.smithi152 (mon.0) 397 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:50.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.507429+0000 mon.smithi152 (mon.0) 398 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:17:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.514669+0000 mon.smithi152 (mon.0) 399 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.515942+0000 mon.smithi152 (mon.0) 400 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.516702+0000 mon.smithi152 (mon.0) 401 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.523381+0000 mon.smithi152 (mon.0) 402 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.527617+0000 mon.smithi152 (mon.0) 403 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:17:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.529142+0000 mon.smithi152 (mon.0) 404 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.529843+0000 mon.smithi152 (mon.0) 405 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:17:50.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:49.536220+0000 mon.smithi152 (mon.0) 406 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:17:50.554 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.552+0000 7f36410d9700 1 -- 172.21.15.195:0/2098924848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 msgr2=0x7f363c0f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:17:50.554 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.552+0000 7f36410d9700 1 --2- 172.21.15.195:0/2098924848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 0x7f363c0f7e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f362c0047f0 tx=0x7f362c009cb0).stop 2024-04-06T12:17:50.554 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.552+0000 7f36410d9700 1 -- 172.21.15.195:0/2098924848 shutdown_connections 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.552+0000 7f36410d9700 1 --2- 172.21.15.195:0/2098924848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 0x7f363c0f7e10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.552+0000 7f36410d9700 1 --2- 172.21.15.195:0/2098924848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f363c0f6710 0x7f363c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.552+0000 7f36410d9700 1 -- 172.21.15.195:0/2098924848 >> 172.21.15.195:0/2098924848 conn(0x7f363c0f1e70 msgr2=0x7f363c0f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.552+0000 7f36410d9700 1 -- 172.21.15.195:0/2098924848 shutdown_connections 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.552+0000 7f36410d9700 1 -- 172.21.15.195:0/2098924848 wait complete. 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.553+0000 7f36410d9700 1 Processor -- start 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.553+0000 7f36410d9700 1 -- start start 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.553+0000 7f36410d9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f363c0f6710 0x7f363c0610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.553+0000 7f36410d9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 0x7f363c10ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.553+0000 7f36410d9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c10d330 con 0x7f363c0f6710 2024-04-06T12:17:50.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.553+0000 7f36410d9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c10d470 con 0x7f363c0f79b0 2024-04-06T12:17:50.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.553+0000 7f363a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 0x7f363c10ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:17:50.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.553+0000 7f363a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 0x7f363c10ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:38254/0 (socket says 172.21.15.195:38254) 2024-04-06T12:17:50.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f363a59c700 1 -- 172.21.15.195:0/1031109813 learned_addr learned my addr 172.21.15.195:0/1031109813 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:17:50.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f363ad9d700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f363c0f6710 0x7f363c0610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:17:50.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f363a59c700 1 -- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f363c0f6710 msgr2=0x7f363c0610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:17:50.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f363a59c700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f363c0f6710 0x7f363c0610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:17:50.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f363a59c700 1 -- 172.21.15.195:0/1031109813 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c005040 con 0x7f363c0f79b0 2024-04-06T12:17:50.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f363a59c700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 0x7f363c10ce40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f362c013580 tx=0x7f362c009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:17:50.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f3623fff700 1 -- 172.21.15.195:0/1031109813 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362c018070 con 0x7f363c0f79b0 2024-04-06T12:17:50.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c10d670 con 0x7f363c0f79b0 2024-04-06T12:17:50.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f3623fff700 1 -- 172.21.15.195:0/1031109813 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f362c007e90 con 0x7f363c0f79b0 2024-04-06T12:17:50.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f3623fff700 1 -- 172.21.15.195:0/1031109813 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362c0123c0 con 0x7f363c0f79b0 2024-04-06T12:17:50.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.554+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c10dbd0 con 0x7f363c0f79b0 2024-04-06T12:17:50.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.555+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c0feed0 con 0x7f363c0f79b0 2024-04-06T12:17:50.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.555+0000 7f3623fff700 1 -- 172.21.15.195:0/1031109813 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f362c01d420 con 0x7f363c0f79b0 2024-04-06T12:17:50.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.556+0000 7f3623fff700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3624061160 0x7f3624063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:17:50.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.556+0000 7f3623fff700 1 -- 172.21.15.195:0/1031109813 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3671+0+0 (secure 0 0 0) 0x7f362c07cec0 con 0x7f363c0f79b0 2024-04-06T12:17:50.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.556+0000 7f363ad9d700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3624061160 0x7f3624063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:17:50.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.556+0000 7f363ad9d700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3624061160 0x7f3624063620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f363c0f7810 tx=0x7f363000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:17:50.562 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.560+0000 7f3623fff700 1 -- 172.21.15.195:0/1031109813 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f362c0514f0 con 0x7f363c0f79b0 2024-04-06T12:17:50.729 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:17:50.731+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f363c059120 con 0x7f3624061160 2024-04-06T12:17:51.499 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:17:49.508085+0000 mgr.smithi152.lynahm (mgr.14196) 115 : cephadm [INF] Adjusting osd_memory_target on smithi195 to 14946M 2024-04-06T12:17:51.499 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:49.515500+0000 mgr.smithi152.lynahm (mgr.14196) 116 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:51.499 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:50.735248+0000 mon.smithi152 (mon.0) 407 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:17:51.499 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:50.737655+0000 mon.smithi152 (mon.0) 408 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:17:51.499 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:50.738419+0000 mon.smithi152 (mon.0) 409 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:51.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:17:49.508085+0000 mgr.smithi152.lynahm (mgr.14196) 115 : cephadm [INF] Adjusting osd_memory_target on smithi195 to 14946M 2024-04-06T12:17:51.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:49.515500+0000 mgr.smithi152.lynahm (mgr.14196) 116 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:51.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:50.735248+0000 mon.smithi152 (mon.0) 407 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:17:51.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:50.737655+0000 mon.smithi152 (mon.0) 408 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:17:51.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:50.738419+0000 mon.smithi152 (mon.0) 409 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:17:52.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:50.732925+0000 mgr.smithi152.lynahm (mgr.14196) 117 : audit [DBG] from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:17:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:50.732925+0000 mgr.smithi152.lynahm (mgr.14196) 117 : audit [DBG] from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:17:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:51.515825+0000 mgr.smithi152.lynahm (mgr.14196) 118 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:53.135628+0000 mon.smithi195 (mon.1) 6 : audit [INF] from='client.? 172.21.15.195:0/307518227' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378a7c45-9887-4e48-b004-0f3b470af912"}]: dispatch 2024-04-06T12:17:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:53.136091+0000 mon.smithi152 (mon.0) 410 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378a7c45-9887-4e48-b004-0f3b470af912"}]: dispatch 2024-04-06T12:17:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:53.140546+0000 mon.smithi152 (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "378a7c45-9887-4e48-b004-0f3b470af912"}]': finished 2024-04-06T12:17:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:53.140602+0000 mon.smithi152 (mon.0) 412 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-04-06T12:17:53.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:53.140731+0000 mon.smithi152 (mon.0) 413 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:17:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:51.515825+0000 mgr.smithi152.lynahm (mgr.14196) 118 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:53.135628+0000 mon.smithi195 (mon.1) 6 : audit [INF] from='client.? 172.21.15.195:0/307518227' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378a7c45-9887-4e48-b004-0f3b470af912"}]: dispatch 2024-04-06T12:17:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:53.136091+0000 mon.smithi152 (mon.0) 410 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378a7c45-9887-4e48-b004-0f3b470af912"}]: dispatch 2024-04-06T12:17:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:53.140546+0000 mon.smithi152 (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "378a7c45-9887-4e48-b004-0f3b470af912"}]': finished 2024-04-06T12:17:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:53.140602+0000 mon.smithi152 (mon.0) 412 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-04-06T12:17:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:53.140731+0000 mon.smithi152 (mon.0) 413 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:17:54.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:17:53.726314+0000 mon.smithi195 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.195:0/1763770998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:17:54.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:17:53.726314+0000 mon.smithi195 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.195:0/1763770998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:17:55.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:53.516222+0000 mgr.smithi152.lynahm (mgr.14196) 119 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:55.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:55 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:53.516222+0000 mgr.smithi152.lynahm (mgr.14196) 119 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:57 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:55.516670+0000 mgr.smithi152.lynahm (mgr.14196) 120 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:57 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:55.516670+0000 mgr.smithi152.lynahm (mgr.14196) 120 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:59.470 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:17:59 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:57.517070+0000 mgr.smithi152.lynahm (mgr.14196) 121 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:17:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:17:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:57.517070+0000 mgr.smithi152.lynahm (mgr.14196) 121 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:00.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:00.033738+0000 mon.smithi152 (mon.0) 414 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-06T12:18:00.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:00.034564+0000 mon.smithi152 (mon.0) 415 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:00.033738+0000 mon.smithi152 (mon.0) 414 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-06T12:18:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:00.034564+0000 mon.smithi152 (mon.0) 415 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:01.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:17:59.517503+0000 mgr.smithi152.lynahm (mgr.14196) 122 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:01.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:18:00.035240+0000 mgr.smithi152.lynahm (mgr.14196) 123 : cephadm [INF] Deploying daemon osd.4 on smithi195 2024-04-06T12:18:01.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:17:59.517503+0000 mgr.smithi152.lynahm (mgr.14196) 122 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:01.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:18:00.035240+0000 mgr.smithi152.lynahm (mgr.14196) 123 : cephadm [INF] Deploying daemon osd.4 on smithi195 2024-04-06T12:18:03.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:01.517829+0000 mgr.smithi152.lynahm (mgr.14196) 124 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:01.517829+0000 mgr.smithi152.lynahm (mgr.14196) 124 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:05.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:03.518323+0000 mgr.smithi152.lynahm (mgr.14196) 125 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:05.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:04.928223+0000 mon.smithi152 (mon.0) 416 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:05.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:04.941115+0000 mon.smithi152 (mon.0) 417 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:18:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:03.518323+0000 mgr.smithi152.lynahm (mgr.14196) 125 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:04.928223+0000 mon.smithi152 (mon.0) 416 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:04.941115+0000 mon.smithi152 (mon.0) 417 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:18:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:05.518729+0000 mgr.smithi152.lynahm (mgr.14196) 126 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:05.518729+0000 mgr.smithi152.lynahm (mgr.14196) 126 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:08.570 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.571+0000 7f3623fff700 1 -- 172.21.15.195:0/1031109813 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f363c059120 con 0x7f3624061160 2024-04-06T12:18:08.570 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 4 on host 'smithi195' 2024-04-06T12:18:08.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3624061160 msgr2=0x7f3624063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:08.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3624061160 0x7f3624063620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f363c0f7810 tx=0x7f363000b040).stop 2024-04-06T12:18:08.571 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 msgr2=0x7f363c10ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:08.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 0x7f363c10ce40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f362c013580 tx=0x7f362c009cb0).stop 2024-04-06T12:18:08.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 shutdown_connections 2024-04-06T12:18:08.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3624061160 0x7f3624063620 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:08.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f363c0f6710 0x7f363c0610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:08.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 --2- 172.21.15.195:0/1031109813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f363c0f79b0 0x7f363c10ce40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:08.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 >> 172.21.15.195:0/1031109813 conn(0x7f363c0f1e70 msgr2=0x7f363c0fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:08.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 shutdown_connections 2024-04-06T12:18:08.572 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:08.574+0000 7f36410d9700 1 -- 172.21.15.195:0/1031109813 wait complete. 2024-04-06T12:18:09.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:07.519291+0000 mgr.smithi152.lynahm (mgr.14196) 127 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:09.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:08.571397+0000 mon.smithi152 (mon.0) 418 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:09.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:08.794248+0000 mon.smithi195 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T12:18:09.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:08.794658+0000 mon.smithi152 (mon.0) 419 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T12:18:09.479 DEBUG:teuthology.orchestra.run.smithi195:osd.4> sudo journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.4.service 2024-04-06T12:18:09.482 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_2... 2024-04-06T12:18:09.482 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-06T12:18:09.512 INFO:journalctl@ceph.osd.4.smithi195.stdout:-- Logs begin at Sat 2024-04-06 12:02:27 UTC. -- 2024-04-06T12:18:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:07.519291+0000 mgr.smithi152.lynahm (mgr.14196) 127 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:08.571397+0000 mon.smithi152 (mon.0) 418 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:08.794248+0000 mon.smithi195 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T12:18:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:08.794658+0000 mon.smithi152 (mon.0) 419 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T12:18:10.799 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:18:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[54543]: debug 2024-04-06T12:18:10.579+0000 7f9a8a5a1700 -1 osd.4 0 waiting for initial osdmap 2024-04-06T12:18:10.800 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:18:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[54543]: debug 2024-04-06T12:18:10.586+0000 7f9a83516700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T12:18:10.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:09.519631+0000 mgr.smithi152.lynahm (mgr.14196) 128 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:10.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:09.573669+0000 mon.smithi152 (mon.0) 420 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-06T12:18:10.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:09.573733+0000 mon.smithi152 (mon.0) 421 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-04-06T12:18:10.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:09.573888+0000 mon.smithi152 (mon.0) 422 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:18:10.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:09.574320+0000 mon.smithi195 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:18:10.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:09.574617+0000 mon.smithi152 (mon.0) 423 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:18:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:09.519631+0000 mgr.smithi152.lynahm (mgr.14196) 128 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:09.573669+0000 mon.smithi152 (mon.0) 420 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-06T12:18:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:09.573733+0000 mon.smithi152 (mon.0) 421 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-04-06T12:18:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:09.573888+0000 mon.smithi152 (mon.0) 422 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:18:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:09.574320+0000 mon.smithi195 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:18:11.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:09.574617+0000 mon.smithi152 (mon.0) 423 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:18:11.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:10.575570+0000 mon.smithi152 (mon.0) 424 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-06T12:18:11.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:10.575681+0000 mon.smithi152 (mon.0) 425 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-04-06T12:18:11.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:10.576110+0000 mon.smithi152 (mon.0) 426 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:18:11.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:10.579733+0000 mon.smithi152 (mon.0) 427 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:18:11.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:11.514313+0000 mon.smithi152 (mon.0) 428 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:11.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:11.576416+0000 mon.smithi152 (mon.0) 429 : cluster [INF] osd.4 [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] boot 2024-04-06T12:18:11.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:11.576481+0000 mon.smithi152 (mon.0) 430 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-04-06T12:18:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:10.575570+0000 mon.smithi152 (mon.0) 424 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-06T12:18:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:10.575681+0000 mon.smithi152 (mon.0) 425 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-04-06T12:18:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:10.576110+0000 mon.smithi152 (mon.0) 426 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:18:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:10.579733+0000 mon.smithi152 (mon.0) 427 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:18:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:11.514313+0000 mon.smithi152 (mon.0) 428 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:11.576416+0000 mon.smithi152 (mon.0) 429 : cluster [INF] osd.4 [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] boot 2024-04-06T12:18:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:11.576481+0000 mon.smithi152 (mon.0) 430 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-04-06T12:18:12.056 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-06T12:18:12.056 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-06T12:18:12.056 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-04-06T12:18:12.056 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-04-06T12:18:12.056 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00868182 s, 1.2 GB/s 2024-04-06T12:18:12.056 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-04-06T12:18:12.783 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:09.828059+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:18:12.783 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:09.828131+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:18:12.783 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:11.520064+0000 mgr.smithi152.lynahm (mgr.14196) 129 : cluster [DBG] pgmap v107: 1 pgs: 1 peering; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:12.784 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:11.576635+0000 mon.smithi152 (mon.0) 431 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:18:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:09.828059+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:18:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:09.828131+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:18:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:11.520064+0000 mgr.smithi152.lynahm (mgr.14196) 129 : cluster [DBG] pgmap v107: 1 pgs: 1 peering; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-06T12:18:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:11.576635+0000 mon.smithi152 (mon.0) 431 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:18:13.579 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2024-04-06T12:18:13.857 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:13 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:12.581831+0000 mon.smithi152 (mon.0) 432 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-04-06T12:18:14.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:13 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:12.581831+0000 mon.smithi152 (mon.0) 432 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-04-06T12:18:14.772 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:13.520514+0000 mgr.smithi152.lynahm (mgr.14196) 130 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:15.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:13.520514+0000 mgr.smithi152.lynahm (mgr.14196) 130 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:15.602 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.601+0000 7f3151b2d700 1 -- 172.21.15.195:0/1536848636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f66f0 msgr2=0x7f314c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:15.602 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.601+0000 7f3151b2d700 1 --2- 172.21.15.195:0/1536848636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f66f0 0x7f314c0f6b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f313c0047f0 tx=0x7f313c009cb0).stop 2024-04-06T12:18:15.602 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.601+0000 7f3151b2d700 1 -- 172.21.15.195:0/1536848636 shutdown_connections 2024-04-06T12:18:15.602 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.601+0000 7f3151b2d700 1 --2- 172.21.15.195:0/1536848636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c0f7990 0x7f314c0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:18:15.602 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.601+0000 7f3151b2d700 1 --2- 172.21.15.195:0/1536848636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f66f0 0x7f314c0f6b10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:15.602 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.601+0000 7f3151b2d700 1 -- 172.21.15.195:0/1536848636 >> 172.21.15.195:0/1536848636 conn(0x7f314c0f1e50 msgr2=0x7f314c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:15.602 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.601+0000 7f3151b2d700 1 -- 172.21.15.195:0/1536848636 shutdown_connections 2024-04-06T12:18:15.602 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.601+0000 7f3151b2d700 1 -- 172.21.15.195:0/1536848636 wait complete. 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.601+0000 7f3151b2d700 1 Processor -- start 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f3151b2d700 1 -- start start 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f3151b2d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c0f66f0 0x7f314c061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f3151b2d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f7990 0x7f314c10ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f3151b2d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c10d310 con 0x7f314c0f66f0 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f3151b2d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c10d450 con 0x7f314c0f7990 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f314affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f7990 0x7f314c10ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f314affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f7990 0x7f314c10ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:52772/0 (socket says 172.21.15.195:52772) 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f314affd700 1 -- 172.21.15.195:0/2558303362 learned_addr learned my addr 172.21.15.195:0/2558303362 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f314b7fe700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c0f66f0 0x7f314c061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f314affd700 1 -- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c0f66f0 msgr2=0x7f314c061040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f314affd700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c0f66f0 0x7f314c061040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:15.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f314affd700 1 -- 172.21.15.195:0/2558303362 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c005040 con 0x7f314c0f7990 2024-04-06T12:18:15.604 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f314affd700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f7990 0x7f314c10ce20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f314000b4b0 tx=0x7f31400090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:15.604 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.602+0000 7f3148ff9700 1 -- 172.21.15.195:0/2558303362 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3140002500 con 0x7f314c0f7990 2024-04-06T12:18:15.604 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.603+0000 7f3148ff9700 1 -- 172.21.15.195:0/2558303362 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3140002af0 con 0x7f314c0f7990 2024-04-06T12:18:15.604 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.603+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c10d730 con 0x7f314c0f7990 2024-04-06T12:18:15.604 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.603+0000 7f3148ff9700 1 -- 172.21.15.195:0/2558303362 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3140012bf0 con 0x7f314c0f7990 2024-04-06T12:18:15.604 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.603+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c10dc70 con 0x7f314c0f7990 2024-04-06T12:18:15.604 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.603+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c0fef30 con 0x7f314c0f7990 2024-04-06T12:18:15.605 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.604+0000 7f3148ff9700 1 -- 172.21.15.195:0/2558303362 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f3140002660 con 0x7f314c0f7990 2024-04-06T12:18:15.605 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.604+0000 7f3148ff9700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3134061180 0x7f3134063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:15.605 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.604+0000 7f3148ff9700 1 -- 172.21.15.195:0/2558303362 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4103+0+0 (secure 0 0 0) 0x7f314007c450 con 0x7f314c0f7990 2024-04-06T12:18:15.605 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.604+0000 7f314b7fe700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3134061180 0x7f3134063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:15.605 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.605+0000 7f314b7fe700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3134061180 0x7f3134063640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f313c004f10 tx=0x7f313c00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:15.607 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.608+0000 7f3148ff9700 1 -- 172.21.15.195:0/2558303362 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3140050870 con 0x7f314c0f7990 2024-04-06T12:18:15.777 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:15.778+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f314c059120 con 0x7f3134061180 2024-04-06T12:18:16.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:15.520983+0000 mgr.smithi152.lynahm (mgr.14196) 131 : cluster [DBG] pgmap v111: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:15.781074+0000 mgr.smithi152.lynahm (mgr.14196) 132 : audit [DBG] from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:15.783351+0000 mon.smithi152 (mon.0) 433 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:15.785670+0000 mon.smithi152 (mon.0) 434 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:15.786373+0000 mon.smithi152 (mon.0) 435 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.578664+0000 mon.smithi152 (mon.0) 436 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.579693+0000 mon.smithi152 (mon.0) 437 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.580665+0000 mon.smithi152 (mon.0) 438 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.585006+0000 mon.smithi152 (mon.0) 439 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.586081+0000 mon.smithi152 (mon.0) 440 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.586849+0000 mon.smithi152 (mon.0) 441 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:18:16.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.591497+0000 mon.smithi152 (mon.0) 442 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:17.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:15.520983+0000 mgr.smithi152.lynahm (mgr.14196) 131 : cluster [DBG] pgmap v111: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:15.781074+0000 mgr.smithi152.lynahm (mgr.14196) 132 : audit [DBG] from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:15.783351+0000 mon.smithi152 (mon.0) 433 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:15.785670+0000 mon.smithi152 (mon.0) 434 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:15.786373+0000 mon.smithi152 (mon.0) 435 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.578664+0000 mon.smithi152 (mon.0) 436 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.579693+0000 mon.smithi152 (mon.0) 437 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.580665+0000 mon.smithi152 (mon.0) 438 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.585006+0000 mon.smithi152 (mon.0) 439 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.586081+0000 mon.smithi152 (mon.0) 440 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.586849+0000 mon.smithi152 (mon.0) 441 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:18:17.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.591497+0000 mon.smithi152 (mon.0) 442 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:17.803 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:18:16.573536+0000 mgr.smithi152.lynahm (mgr.14196) 133 : cephadm [INF] Detected new or changed devices on smithi195 2024-04-06T12:18:17.803 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:18:16.581251+0000 mgr.smithi152.lynahm (mgr.14196) 134 : cephadm [INF] Adjusting osd_memory_target on smithi195 to 7473M 2024-04-06T12:18:17.803 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.596750+0000 mon.smithi152 (mon.0) 443 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:18:17.803 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.598208+0000 mon.smithi152 (mon.0) 444 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:17.803 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.598868+0000 mon.smithi152 (mon.0) 445 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:18:17.803 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:16.602912+0000 mon.smithi152 (mon.0) 446 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:18:16.573536+0000 mgr.smithi152.lynahm (mgr.14196) 133 : cephadm [INF] Detected new or changed devices on smithi195 2024-04-06T12:18:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:18:16.581251+0000 mgr.smithi152.lynahm (mgr.14196) 134 : cephadm [INF] Adjusting osd_memory_target on smithi195 to 7473M 2024-04-06T12:18:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.596750+0000 mon.smithi152 (mon.0) 443 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:18:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.598208+0000 mon.smithi152 (mon.0) 444 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.598868+0000 mon.smithi152 (mon.0) 445 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:18:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:16.602912+0000 mon.smithi152 (mon.0) 446 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:17.521478+0000 mgr.smithi152.lynahm (mgr.14196) 135 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:18.561735+0000 mon.smithi195 (mon.1) 10 : audit [INF] from='client.? 172.21.15.195:0/2327538681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2608627e-47c5-446a-b13e-699aaaea81bd"}]: dispatch 2024-04-06T12:18:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:18.562143+0000 mon.smithi152 (mon.0) 447 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2608627e-47c5-446a-b13e-699aaaea81bd"}]: dispatch 2024-04-06T12:18:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:18.566716+0000 mon.smithi152 (mon.0) 448 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2608627e-47c5-446a-b13e-699aaaea81bd"}]': finished 2024-04-06T12:18:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:18.566771+0000 mon.smithi152 (mon.0) 449 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-04-06T12:18:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:18.566938+0000 mon.smithi152 (mon.0) 450 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:17.521478+0000 mgr.smithi152.lynahm (mgr.14196) 135 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:18.561735+0000 mon.smithi195 (mon.1) 10 : audit [INF] from='client.? 172.21.15.195:0/2327538681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2608627e-47c5-446a-b13e-699aaaea81bd"}]: dispatch 2024-04-06T12:18:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:18.562143+0000 mon.smithi152 (mon.0) 447 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2608627e-47c5-446a-b13e-699aaaea81bd"}]: dispatch 2024-04-06T12:18:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:18.566716+0000 mon.smithi152 (mon.0) 448 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2608627e-47c5-446a-b13e-699aaaea81bd"}]': finished 2024-04-06T12:18:19.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:18.566771+0000 mon.smithi152 (mon.0) 449 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-04-06T12:18:19.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:18.566938+0000 mon.smithi152 (mon.0) 450 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:19.141483+0000 mon.smithi195 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.195:0/126945850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:18:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:19.141483+0000 mon.smithi195 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.195:0/126945850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-06T12:18:21.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:19.521849+0000 mgr.smithi152.lynahm (mgr.14196) 136 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:19.521849+0000 mgr.smithi152.lynahm (mgr.14196) 136 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:21.522332+0000 mgr.smithi152.lynahm (mgr.14196) 137 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:21.522332+0000 mgr.smithi152.lynahm (mgr.14196) 137 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:24.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:23.522768+0000 mgr.smithi152.lynahm (mgr.14196) 138 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:23.522768+0000 mgr.smithi152.lynahm (mgr.14196) 138 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:25.560345+0000 mon.smithi152 (mon.0) 451 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-06T12:18:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:25.561175+0000 mon.smithi152 (mon.0) 452 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:25.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:25.560345+0000 mon.smithi152 (mon.0) 451 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-06T12:18:25.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:25.561175+0000 mon.smithi152 (mon.0) 452 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:27.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:25.523075+0000 mgr.smithi152.lynahm (mgr.14196) 139 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:27.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:18:25.561880+0000 mgr.smithi152.lynahm (mgr.14196) 140 : cephadm [INF] Deploying daemon osd.5 on smithi195 2024-04-06T12:18:27.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:25.523075+0000 mgr.smithi152.lynahm (mgr.14196) 139 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:27.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:18:25.561880+0000 mgr.smithi152.lynahm (mgr.14196) 140 : cephadm [INF] Deploying daemon osd.5 on smithi195 2024-04-06T12:18:28.950 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:27.523626+0000 mgr.smithi152.lynahm (mgr.14196) 141 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:29.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:27.523626+0000 mgr.smithi152.lynahm (mgr.14196) 141 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:30.943 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:29.524226+0000 mgr.smithi152.lynahm (mgr.14196) 142 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:31.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:29.524226+0000 mgr.smithi152.lynahm (mgr.14196) 142 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:31.055796+0000 mon.smithi152 (mon.0) 453 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:31.056117+0000 mon.smithi152 (mon.0) 454 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:18:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:31.055796+0000 mon.smithi152 (mon.0) 453 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:31.056117+0000 mon.smithi152 (mon.0) 454 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:18:33.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:31.524550+0000 mgr.smithi152.lynahm (mgr.14196) 143 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:33.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:31.524550+0000 mgr.smithi152.lynahm (mgr.14196) 143 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:35.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.223+0000 7f3148ff9700 1 -- 172.21.15.195:0/2558303362 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f314c059120 con 0x7f3134061180 2024-04-06T12:18:35.222 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2024-04-06T12:18:35.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3134061180 msgr2=0x7f3134063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:35.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3134061180 0x7f3134063640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f313c004f10 tx=0x7f313c00b040).stop 2024-04-06T12:18:35.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f7990 msgr2=0x7f314c10ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:35.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f7990 0x7f314c10ce20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f314000b4b0 tx=0x7f31400090f0).stop 2024-04-06T12:18:35.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 shutdown_connections 2024-04-06T12:18:35.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3134061180 0x7f3134063640 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:35.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c0f66f0 0x7f314c061040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:35.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 --2- 172.21.15.195:0/2558303362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f314c0f7990 0x7f314c10ce20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:35.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 >> 172.21.15.195:0/2558303362 conn(0x7f314c0f1e50 msgr2=0x7f314c0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:35.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 shutdown_connections 2024-04-06T12:18:35.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:35.225+0000 7f3151b2d700 1 -- 172.21.15.195:0/2558303362 wait complete. 2024-04-06T12:18:35.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:33.524899+0000 mgr.smithi152.lynahm (mgr.14196) 144 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:35.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:34.959565+0000 mon.smithi195 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T12:18:35.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:34.960156+0000 mon.smithi152 (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T12:18:35.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:33.524899+0000 mgr.smithi152.lynahm (mgr.14196) 144 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:35.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:34.959565+0000 mon.smithi195 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T12:18:35.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:34.960156+0000 mon.smithi152 (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T12:18:36.243 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:35.067476+0000 mon.smithi152 (mon.0) 456 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-06T12:18:36.243 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:35.067544+0000 mon.smithi152 (mon.0) 457 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-04-06T12:18:36.243 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:35.067962+0000 mon.smithi152 (mon.0) 458 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:36.243 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:35.068182+0000 mon.smithi195 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:18:36.244 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:35.068431+0000 mon.smithi152 (mon.0) 459 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:18:36.244 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:35.223965+0000 mon.smithi152 (mon.0) 460 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:36.244 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:35.977122+0000 mon.smithi152 (mon.0) 461 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:36.244 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:36.066721+0000 mon.smithi152 (mon.0) 462 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-06T12:18:36.244 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:36.066798+0000 mon.smithi152 (mon.0) 463 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-04-06T12:18:36.244 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:36.066973+0000 mon.smithi152 (mon.0) 464 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:36.265 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.5.service 2024-04-06T12:18:36.267 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-06T12:18:36.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd stat -f json 2024-04-06T12:18:36.298 INFO:journalctl@ceph.osd.5.smithi195.stdout:-- Logs begin at Sat 2024-04-06 12:02:27 UTC. -- 2024-04-06T12:18:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:35.067476+0000 mon.smithi152 (mon.0) 456 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-06T12:18:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:35.067544+0000 mon.smithi152 (mon.0) 457 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-04-06T12:18:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:35.067962+0000 mon.smithi152 (mon.0) 458 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:35.068182+0000 mon.smithi195 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:18:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:35.068431+0000 mon.smithi152 (mon.0) 459 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:18:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:35.223965+0000 mon.smithi152 (mon.0) 460 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:35.977122+0000 mon.smithi152 (mon.0) 461 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:36.066721+0000 mon.smithi152 (mon.0) 462 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-06T12:18:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:36.066798+0000 mon.smithi152 (mon.0) 463 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-04-06T12:18:36.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:36.066973+0000 mon.smithi152 (mon.0) 464 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:37.339 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:35.525322+0000 mgr.smithi152.lynahm (mgr.14196) 145 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:37.339 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:36.071203+0000 mon.smithi152 (mon.0) 465 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:37.339 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:37.070582+0000 mon.smithi152 (mon.0) 466 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:37.528 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:35.525322+0000 mgr.smithi152.lynahm (mgr.14196) 145 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:37.529 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:36.071203+0000 mon.smithi152 (mon.0) 465 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:37.529 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:37.070582+0000 mon.smithi152 (mon.0) 466 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:38.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.287+0000 7fe936d1a700 1 -- 172.21.15.152:0/2242804800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f77d0 msgr2=0x7fe9300f7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.287+0000 7fe936d1a700 1 --2- 172.21.15.152:0/2242804800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f77d0 0x7fe9300f7bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe9240047f0 tx=0x7fe924009cb0).stop 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.287+0000 7fe936d1a700 1 -- 172.21.15.152:0/2242804800 shutdown_connections 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.287+0000 7fe936d1a700 1 --2- 172.21.15.152:0/2242804800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9300f80e0 0x7fe9300f8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.287+0000 7fe936d1a700 1 --2- 172.21.15.152:0/2242804800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f77d0 0x7fe9300f7bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.287+0000 7fe936d1a700 1 -- 172.21.15.152:0/2242804800 >> 172.21.15.152:0/2242804800 conn(0x7fe9300f2fb0 msgr2=0x7fe9300f53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.287+0000 7fe936d1a700 1 -- 172.21.15.152:0/2242804800 shutdown_connections 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.287+0000 7fe936d1a700 1 -- 172.21.15.152:0/2242804800 wait complete. 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe936d1a700 1 Processor -- start 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe936d1a700 1 -- start start 2024-04-06T12:18:38.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe936d1a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9300f77d0 0x7fe9301080b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe936d1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f80e0 0x7fe9301085a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe936d1a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930108b50 con 0x7fe9300f80e0 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe936d1a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930108c90 con 0x7fe9300f77d0 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f80e0 0x7fe9301085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f80e0 0x7fe9301085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59820/0 (socket says 172.21.15.152:59820) 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe92ffff700 1 -- 172.21.15.152:0/28682686 learned_addr learned my addr 172.21.15.152:0/28682686 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe934ab6700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9300f77d0 0x7fe9301080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe92ffff700 1 -- 172.21.15.152:0/28682686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9300f77d0 msgr2=0x7fe9301080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe92ffff700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9300f77d0 0x7fe9301080b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.288+0000 7fe92ffff700 1 -- 172.21.15.152:0/28682686 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924005040 con 0x7fe9300f80e0 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.289+0000 7fe92ffff700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f80e0 0x7fe9301085a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe91c00e910 tx=0x7fe91c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.289+0000 7fe92dffb700 1 -- 172.21.15.152:0/28682686 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91c007b40 con 0x7fe9300f80e0 2024-04-06T12:18:38.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.289+0000 7fe92dffb700 1 -- 172.21.15.152:0/28682686 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe91c00f040 con 0x7fe9300f80e0 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.289+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93010d730 con 0x7fe9300f80e0 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.289+0000 7fe92dffb700 1 -- 172.21.15.152:0/28682686 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91c014850 con 0x7fe9300f80e0 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.289+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93010dcf0 con 0x7fe9300f80e0 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.290+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe930100000 con 0x7fe9300f80e0 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.290+0000 7fe92dffb700 1 -- 172.21.15.152:0/28682686 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fe91c014b10 con 0x7fe9300f80e0 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.290+0000 7fe92dffb700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe920061180 0x7fe920063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.291+0000 7fe92dffb700 1 -- 172.21.15.152:0/28682686 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fe91c07bf30 con 0x7fe9300f80e0 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.291+0000 7fe934ab6700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe920061180 0x7fe920063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.291+0000 7fe934ab6700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe920061180 0x7fe920063640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe9240047c0 tx=0x7fe924009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:38.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.295+0000 7fe92dffb700 1 -- 172.21.15.152:0/28682686 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe91c049f60 con 0x7fe9300f80e0 2024-04-06T12:18:38.539 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:35.929654+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:18:38.539 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:35.929732+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:18:38.539 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:37.074945+0000 mon.smithi152 (mon.0) 467 : cluster [INF] osd.5 [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] boot 2024-04-06T12:18:38.539 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:37.074974+0000 mon.smithi152 (mon.0) 468 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-04-06T12:18:38.539 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:37.075277+0000 mon.smithi152 (mon.0) 469 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:38.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.456+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe9300598f0 con 0x7fe9300f80e0 2024-04-06T12:18:38.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.457+0000 7fe92dffb700 1 -- 172.21.15.152:0/28682686 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7fe91c050200 con 0x7fe9300f80e0 2024-04-06T12:18:38.540 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:18:38.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe920061180 msgr2=0x7fe920063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe920061180 0x7fe920063640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe9240047c0 tx=0x7fe924009cb0).stop 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f80e0 msgr2=0x7fe9301085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f80e0 0x7fe9301085a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe91c00e910 tx=0x7fe91c00b040).stop 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 shutdown_connections 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe920061180 0x7fe920063640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9300f77d0 0x7fe9301080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 --2- 172.21.15.152:0/28682686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9300f80e0 0x7fe9301085a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 >> 172.21.15.152:0/28682686 conn(0x7fe9300f2fb0 msgr2=0x7fe9300fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 shutdown_connections 2024-04-06T12:18:38.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:38.459+0000 7fe936d1a700 1 -- 172.21.15.152:0/28682686 wait complete. 2024-04-06T12:18:38.541 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:35.929654+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-04-06T12:18:38.542 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:35.929732+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-04-06T12:18:38.542 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:37.074945+0000 mon.smithi152 (mon.0) 467 : cluster [INF] osd.5 [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] boot 2024-04-06T12:18:38.542 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:37.074974+0000 mon.smithi152 (mon.0) 468 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-04-06T12:18:38.542 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:37.075277+0000 mon.smithi152 (mon.0) 469 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:18:39.070 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1712405917,"num_in_osds":6,"osd_in_since":1712405898,"num_remapped_pgs":0} 2024-04-06T12:18:39.071 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-06T12:18:39.126 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:37.525688+0000 mgr.smithi152.lynahm (mgr.14196) 146 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:39.126 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:38.083352+0000 mon.smithi152 (mon.0) 470 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-04-06T12:18:39.126 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:38.458227+0000 mon.smithi152 (mon.0) 471 : audit [DBG] from='client.? 172.21.15.152:0/28682686' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-06T12:18:39.342 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:18:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:37.525688+0000 mgr.smithi152.lynahm (mgr.14196) 146 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-06T12:18:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:38.083352+0000 mon.smithi152 (mon.0) 470 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-04-06T12:18:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:38.458227+0000 mon.smithi152 (mon.0) 471 : audit [DBG] from='client.? 172.21.15.152:0/28682686' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-06T12:18:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:18:39.363472+0000 mgr.smithi152.lynahm (mgr.14196) 147 : cephadm [INF] Detected new or changed devices on smithi195 2024-04-06T12:18:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.368888+0000 mon.smithi152 (mon.0) 472 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.369816+0000 mon.smithi152 (mon.0) 473 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.370451+0000 mon.smithi152 (mon.0) 474 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.371048+0000 mon.smithi152 (mon.0) 475 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:18:39.371497+0000 mgr.smithi152.lynahm (mgr.14196) 148 : cephadm [INF] Adjusting osd_memory_target on smithi195 to 4982M 2024-04-06T12:18:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.375047+0000 mon.smithi152 (mon.0) 476 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.376296+0000 mon.smithi152 (mon.0) 477 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.376925+0000 mon.smithi152 (mon.0) 478 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:18:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.380788+0000 mon.smithi152 (mon.0) 479 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.384279+0000 mon.smithi152 (mon.0) 480 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:18:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.385429+0000 mon.smithi152 (mon.0) 481 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.385943+0000 mon.smithi152 (mon.0) 482 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:18:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:39.389259+0000 mon.smithi152 (mon.0) 483 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:39.525993+0000 mgr.smithi152.lynahm (mgr.14196) 149 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:40.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:18:39.363472+0000 mgr.smithi152.lynahm (mgr.14196) 147 : cephadm [INF] Detected new or changed devices on smithi195 2024-04-06T12:18:40.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.368888+0000 mon.smithi152 (mon.0) 472 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:40.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.369816+0000 mon.smithi152 (mon.0) 473 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:40.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.370451+0000 mon.smithi152 (mon.0) 474 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:40.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.371048+0000 mon.smithi152 (mon.0) 475 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:18:40.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:18:39.371497+0000 mgr.smithi152.lynahm (mgr.14196) 148 : cephadm [INF] Adjusting osd_memory_target on smithi195 to 4982M 2024-04-06T12:18:40.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.375047+0000 mon.smithi152 (mon.0) 476 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:40.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.376296+0000 mon.smithi152 (mon.0) 477 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:40.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.376925+0000 mon.smithi152 (mon.0) 478 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:18:40.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.380788+0000 mon.smithi152 (mon.0) 479 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:40.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.384279+0000 mon.smithi152 (mon.0) 480 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:18:40.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.385429+0000 mon.smithi152 (mon.0) 481 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:18:40.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.385943+0000 mon.smithi152 (mon.0) 482 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:18:40.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:39.389259+0000 mon.smithi152 (mon.0) 483 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:18:40.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:39.525993+0000 mgr.smithi152.lynahm (mgr.14196) 149 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:41.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.147+0000 7f5b2b283700 1 -- 172.21.15.152:0/1183167458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 msgr2=0x7f5b240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:41.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.147+0000 7f5b2b283700 1 --2- 172.21.15.152:0/1183167458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 0x7f5b240f6cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f5b200047f0 tx=0x7f5b20009cb0).stop 2024-04-06T12:18:41.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.147+0000 7f5b2b283700 1 -- 172.21.15.152:0/1183167458 shutdown_connections 2024-04-06T12:18:41.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.147+0000 7f5b2b283700 1 --2- 172.21.15.152:0/1183167458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b240f7b40 0x7f5b240f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:41.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.147+0000 7f5b2b283700 1 --2- 172.21.15.152:0/1183167458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 0x7f5b240f6cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:41.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.147+0000 7f5b2b283700 1 -- 172.21.15.152:0/1183167458 >> 172.21.15.152:0/1183167458 conn(0x7f5b240f2020 msgr2=0x7f5b240f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:41.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.147+0000 7f5b2b283700 1 -- 172.21.15.152:0/1183167458 shutdown_connections 2024-04-06T12:18:41.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.147+0000 7f5b2b283700 1 -- 172.21.15.152:0/1183167458 wait complete. 2024-04-06T12:18:41.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.148+0000 7f5b2b283700 1 Processor -- start 2024-04-06T12:18:41.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2b283700 1 -- start start 2024-04-06T12:18:41.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2b283700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 0x7f5b240615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:41.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2b283700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b240f7b40 0x7f5b2410ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:41.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2b283700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2410d3a0 con 0x7f5b240f68a0 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2b283700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2410d4e0 con 0x7f5b240f7b40 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2901f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 0x7f5b240615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2901f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 0x7f5b240615a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59832/0 (socket says 172.21.15.152:59832) 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2901f700 1 -- 172.21.15.152:0/1576884224 learned_addr learned my addr 172.21.15.152:0/1576884224 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2881e700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b240f7b40 0x7f5b2410ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2901f700 1 -- 172.21.15.152:0/1576884224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b240f7b40 msgr2=0x7f5b2410ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2901f700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b240f7b40 0x7f5b2410ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2901f700 1 -- 172.21.15.152:0/1576884224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20005040 con 0x7f5b240f68a0 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.149+0000 7f5b2881e700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b240f7b40 0x7f5b2410ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.150+0000 7f5b2901f700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 0x7f5b240615a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f5b20013470 tx=0x7f5b20009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.150+0000 7f5b16777700 1 -- 172.21.15.152:0/1576884224 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2000e030 con 0x7f5b240f68a0 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.150+0000 7f5b16777700 1 -- 172.21.15.152:0/1576884224 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5b20007e90 con 0x7f5b240f68a0 2024-04-06T12:18:41.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.150+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2410d6e0 con 0x7f5b240f68a0 2024-04-06T12:18:41.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.150+0000 7f5b16777700 1 -- 172.21.15.152:0/1576884224 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b20018070 con 0x7f5b240f68a0 2024-04-06T12:18:41.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.150+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2410db90 con 0x7f5b240f68a0 2024-04-06T12:18:41.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.151+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b24047540 con 0x7f5b240f68a0 2024-04-06T12:18:41.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.151+0000 7f5b16777700 1 -- 172.21.15.152:0/1576884224 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f5b2001d420 con 0x7f5b240f68a0 2024-04-06T12:18:41.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.152+0000 7f5b16777700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f5b10061180 0x7f5b10063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:41.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.152+0000 7f5b16777700 1 -- 172.21.15.152:0/1576884224 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f5b2007db70 con 0x7f5b240f68a0 2024-04-06T12:18:41.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.152+0000 7f5b2881e700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f5b10061180 0x7f5b10063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:41.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.152+0000 7f5b2881e700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f5b10061180 0x7f5b10063640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5b18004ba0 tx=0x7f5b18009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:41.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.156+0000 7f5b16777700 1 -- 172.21.15.152:0/1576884224 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5b20051e40 con 0x7f5b240f68a0 2024-04-06T12:18:41.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.318+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b240598f0 con 0x7f5b240f68a0 2024-04-06T12:18:41.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.319+0000 7f5b16777700 1 -- 172.21.15.152:0/1576884224 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10952 (secure 0 0 0) 0x7f5b2001d6d0 con 0x7f5b240f68a0 2024-04-06T12:18:41.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:18:41.317 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","created":"2024-04-06T12:13:16.768469+0000","modified":"2024-04-06T12:18:38.076766+0000","last_up_change":"2024-04-06T12:18:37.071819+0000","last_in_change":"2024-04-06T12:18:18.562700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-06T12:17:21.824734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"cb0a62c1-5f47-450c-8e9e-4e02c899eda3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6803","nonce":1835635164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6805","nonce":1835635164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6809","nonce":1835635164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6807","nonce":1835635164}]},"public_addr":"172.21.15.152:6803/1835635164","cluster_addr":"172.21.15.152:6805/1835635164","heartbeat_back_addr":"172.21.15.152:6809/1835635164","heartbeat_front_addr":"172.21.15.152:6807/1835635164","state":["exists","up"]},{"osd":1,"uuid":"f9490187-6df1-4d4f-bfd3-a2da32d3a669","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6811","nonce":4181928109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6813","nonce":4181928109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6817","nonce":4181928109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6815","nonce":4181928109}]},"public_addr":"172.21.15.152:6811/4181928109","cluster_addr":"172.21.15.152:6813/4181928109","heartbeat_back_addr":"172.21.15.152:6817/4181928109","heartbeat_front_addr":"172.21.15.152:6815/4181928109","state":["exists","up"]},{"osd":2,"uuid":"4a279284-26fa-436f-a830-abda13b40713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6819","nonce":366825869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6821","nonce":366825869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6825","nonce":366825869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6823","nonce":366825869}]},"public_addr":"172.21.15.152:6819/366825869","cluster_addr":"172.21.15.152:6821/366825869","heartbeat_back_addr":"172.21.15.152:6825/366825869","heartbeat_front_addr":"172.21.15.152:6823/366825869","state":["exists","up"]},{"osd":3,"uuid":"64e8942a-1121-44fd-9ed2-cbb5176df587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6801","nonce":2559967436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6803","nonce":2559967436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6807","nonce":2559967436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6805","nonce":2559967436}]},"public_addr":"172.21.15.195:6801/2559967436","cluster_addr":"172.21.15.195:6803/2559967436","heartbeat_back_addr":"172.21.15.195:6807/2559967436","heartbeat_front_addr":"172.21.15.195:6805/2559967436","state":["exists","up"]},{"osd":4,"uuid":"378a7c45-9887-4e48-b004-0f3b470af912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6809","nonce":62445982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6811","nonce":62445982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6815","nonce":62445982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6813","nonce":62445982}]},"public_addr":"172.21.15.195:6809/62445982","cluster_addr":"172.21.15.195:6811/62445982","heartbeat_back_addr":"172.21.15.195:6815/62445982","heartbeat_front_addr":"172.21.15.195:6813/62445982","state":["exists","up"]},{"osd":5,"uuid":"2608627e-47c5-446a-b13e-699aaaea81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6817","nonce":2188685791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6819","nonce":2188685791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6823","nonce":2188685791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6821","nonce":2188685791}]},"public_addr":"172.21.15.195:6817/2188685791","cluster_addr":"172.21.15.195:6819/2188685791","heartbeat_back_addr":"172.21.15.195:6823/2188685791","heartbeat_front_addr":"172.21.15.195:6821/2188685791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:18.549757+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:51.020120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:20.272551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:44.651165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:09.828133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:35.929735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:6801/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6800/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/2556143500":"2024-04-07T12:14:19.995122+0000","172.21.15.152:6801/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/1200342064":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/378420270":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/944313623":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6800/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.152:0/2930097039":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6800/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/2583442237":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6801/3532590768":"2024-04-07T12:13:49.213100+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T12:18:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f5b10061180 msgr2=0x7f5b10063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f5b10061180 0x7f5b10063640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5b18004ba0 tx=0x7f5b18009040).stop 2024-04-06T12:18:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 msgr2=0x7f5b240615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 0x7f5b240615a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f5b20013470 tx=0x7f5b20009cb0).stop 2024-04-06T12:18:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 shutdown_connections 2024-04-06T12:18:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f5b10061180 0x7f5b10063640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240f68a0 0x7f5b240615a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 --2- 172.21.15.152:0/1576884224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b240f7b40 0x7f5b2410ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 >> 172.21.15.152:0/1576884224 conn(0x7f5b240f2020 msgr2=0x7f5b240fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:41.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 shutdown_connections 2024-04-06T12:18:41.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:41.321+0000 7f5b2b283700 1 -- 172.21.15.152:0/1576884224 wait complete. 2024-04-06T12:18:41.674 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:41.319799+0000 mon.smithi152 (mon.0) 484 : audit [DBG] from='client.? 172.21.15.152:0/1576884224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:18:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:41.319799+0000 mon.smithi152 (mon.0) 484 : audit [DBG] from='client.? 172.21.15.152:0/1576884224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:18:42.086 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-06T12:17:21.824734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-04-06T12:18:42.087 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd pool get device_health_metrics pg_num 2024-04-06T12:18:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:18:42.657 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:41.526285+0000 mgr.smithi152.lynahm (mgr.14196) 150 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:42.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:41.526285+0000 mgr.smithi152.lynahm (mgr.14196) 150 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:44.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.110+0000 7f91e64eb700 1 -- 172.21.15.152:0/2086040937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f8c40 msgr2=0x7f91e00f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:44.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.110+0000 7f91e64eb700 1 --2- 172.21.15.152:0/2086040937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f8c40 0x7f91e00f90a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f91c80047f0 tx=0x7f91c8009cb0).stop 2024-04-06T12:18:44.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.110+0000 7f91e64eb700 1 -- 172.21.15.152:0/2086040937 shutdown_connections 2024-04-06T12:18:44.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.110+0000 7f91e64eb700 1 --2- 172.21.15.152:0/2086040937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f8c40 0x7f91e00f90a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:44.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.110+0000 7f91e64eb700 1 --2- 172.21.15.152:0/2086040937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e00f79a0 0x7f91e00f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:18:44.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.110+0000 7f91e64eb700 1 -- 172.21.15.152:0/2086040937 >> 172.21.15.152:0/2086040937 conn(0x7f91e00f3100 msgr2=0x7f91e00f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:44.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.110+0000 7f91e64eb700 1 -- 172.21.15.152:0/2086040937 shutdown_connections 2024-04-06T12:18:44.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.110+0000 7f91e64eb700 1 -- 172.21.15.152:0/2086040937 wait complete. 2024-04-06T12:18:44.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91e64eb700 1 Processor -- start 2024-04-06T12:18:44.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91e64eb700 1 -- start start 2024-04-06T12:18:44.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91e64eb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f79a0 0x7f91e006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:44.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91e64eb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e00f8c40 0x7f91e006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:44.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91e64eb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e006b520 con 0x7f91e00f79a0 2024-04-06T12:18:44.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91e64eb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e006b660 con 0x7f91e00f8c40 2024-04-06T12:18:44.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91dffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f79a0 0x7f91e006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:44.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91dffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f79a0 0x7f91e006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36156/0 (socket says 172.21.15.152:36156) 2024-04-06T12:18:44.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91dffff700 1 -- 172.21.15.152:0/3774977307 learned_addr learned my addr 172.21.15.152:0/3774977307 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:18:44.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91df7fe700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e00f8c40 0x7f91e006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:44.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91dffff700 1 -- 172.21.15.152:0/3774977307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e00f8c40 msgr2=0x7f91e006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:44.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91dffff700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e00f8c40 0x7f91e006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:44.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.111+0000 7f91dffff700 1 -- 172.21.15.152:0/3774977307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8005040 con 0x7f91e00f79a0 2024-04-06T12:18:44.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.112+0000 7f91dffff700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f79a0 0x7f91e006c9d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f91d000b480 tx=0x7f91d00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:44.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.112+0000 7f91dd7fa700 1 -- 172.21.15.152:0/3774977307 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d0002500 con 0x7f91e00f79a0 2024-04-06T12:18:44.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.112+0000 7f91dd7fa700 1 -- 172.21.15.152:0/3774977307 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f91d0002af0 con 0x7f91e00f79a0 2024-04-06T12:18:44.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.112+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e006b940 con 0x7f91e00f79a0 2024-04-06T12:18:44.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.112+0000 7f91dd7fa700 1 -- 172.21.15.152:0/3774977307 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d0012bb0 con 0x7f91e00f79a0 2024-04-06T12:18:44.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.112+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e006be80 con 0x7f91e00f79a0 2024-04-06T12:18:44.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.113+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e0100190 con 0x7f91e00f79a0 2024-04-06T12:18:44.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.113+0000 7f91dd7fa700 1 -- 172.21.15.152:0/3774977307 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f91d0002660 con 0x7f91e00f79a0 2024-04-06T12:18:44.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.113+0000 7f91dd7fa700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f91cc061180 0x7f91cc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:44.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.113+0000 7f91dd7fa700 1 -- 172.21.15.152:0/3774977307 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f91d007c510 con 0x7f91e00f79a0 2024-04-06T12:18:44.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.113+0000 7f91df7fe700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f91cc061180 0x7f91cc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:44.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.114+0000 7f91df7fe700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f91cc061180 0x7f91cc063640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f91c8007cf0 tx=0x7f91c8009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:44.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.118+0000 7f91dd7fa700 1 -- 172.21.15.152:0/3774977307 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f91d0050780 con 0x7f91e00f79a0 2024-04-06T12:18:44.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.279+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f91e01020b0 con 0x7f91e00f79a0 2024-04-06T12:18:44.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.280+0000 7f91dd7fa700 1 -- 172.21.15.152:0/3774977307 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v38) v1 ==== 110+0+10 (secure 0 0 0) 0x7f91d0050370 con 0x7f91e00f79a0 2024-04-06T12:18:44.279 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-06T12:18:44.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f91cc061180 msgr2=0x7f91cc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:44.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f91cc061180 0x7f91cc063640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f91c8007cf0 tx=0x7f91c8009cb0).stop 2024-04-06T12:18:44.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f79a0 msgr2=0x7f91e006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:44.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f79a0 0x7f91e006c9d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f91d000b480 tx=0x7f91d00090f0).stop 2024-04-06T12:18:44.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 shutdown_connections 2024-04-06T12:18:44.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f91cc061180 0x7f91cc063640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:44.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00f79a0 0x7f91e006c9d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:44.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 --2- 172.21.15.152:0/3774977307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91e00f8c40 0x7f91e006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:44.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 >> 172.21.15.152:0/3774977307 conn(0x7f91e00f3100 msgr2=0x7f91e00fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:44.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 shutdown_connections 2024-04-06T12:18:44.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:44.281+0000 7f91e64eb700 1 -- 172.21.15.152:0/3774977307 wait complete. 2024-04-06T12:18:45.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:43.526679+0000 mgr.smithi152.lynahm (mgr.14196) 151 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:45.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:44.280853+0000 mon.smithi152 (mon.0) 485 : audit [DBG] from='client.? 172.21.15.152:0/3774977307' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-04-06T12:18:45.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:43.526679+0000 mgr.smithi152.lynahm (mgr.14196) 151 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:45.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:44.280853+0000 mon.smithi152 (mon.0) 485 : audit [DBG] from='client.? 172.21.15.152:0/3774977307' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-04-06T12:18:45.055 INFO:tasks.cephadm:Setting up client nodes... 2024-04-06T12:18:45.056 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-06T12:18:46.833 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:45.526965+0000 mgr.smithi152.lynahm (mgr.14196) 152 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:45.526965+0000 mgr.smithi152.lynahm (mgr.14196) 152 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:47.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.090+0000 7fc6247f6700 1 -- 172.21.15.152:0/3301888178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06cb70 msgr2=0x7fc61c06b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.090+0000 7fc6247f6700 1 --2- 172.21.15.152:0/3301888178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06cb70 0x7fc61c06b070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fc60c0047f0 tx=0x7fc60c009cb0).stop 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.090+0000 7fc6247f6700 1 -- 172.21.15.152:0/3301888178 shutdown_connections 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.090+0000 7fc6247f6700 1 --2- 172.21.15.152:0/3301888178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc61c06b560 0x7fc61c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.090+0000 7fc6247f6700 1 --2- 172.21.15.152:0/3301888178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06cb70 0x7fc61c06b070 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.090+0000 7fc6247f6700 1 -- 172.21.15.152:0/3301888178 >> 172.21.15.152:0/3301888178 conn(0x7fc61c0f3150 msgr2=0x7fc61c0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.090+0000 7fc6247f6700 1 -- 172.21.15.152:0/3301888178 shutdown_connections 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.090+0000 7fc6247f6700 1 -- 172.21.15.152:0/3301888178 wait complete. 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc6247f6700 1 Processor -- start 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc6247f6700 1 -- start start 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc6247f6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06b560 0x7fc61c10a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc6247f6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc61c06cb70 0x7fc61c10a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc6247f6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c10ae20 con 0x7fc61c06b560 2024-04-06T12:18:47.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc6247f6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c10af60 con 0x7fc61c06cb70 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc622592700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06b560 0x7fc61c10a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc622592700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06b560 0x7fc61c10a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36172/0 (socket says 172.21.15.152:36172) 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc622592700 1 -- 172.21.15.152:0/548856858 learned_addr learned my addr 172.21.15.152:0/548856858 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc621d91700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc61c06cb70 0x7fc61c10a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc622592700 1 -- 172.21.15.152:0/548856858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc61c06cb70 msgr2=0x7fc61c10a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc622592700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc61c06cb70 0x7fc61c10a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc622592700 1 -- 172.21.15.152:0/548856858 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c005040 con 0x7fc61c06b560 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.091+0000 7fc621d91700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc61c06cb70 0x7fc61c10a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.092+0000 7fc622592700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06b560 0x7fc61c10a380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc60c013510 tx=0x7fc60c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.092+0000 7fc6137fe700 1 -- 172.21.15.152:0/548856858 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60c00e030 con 0x7fc61c06b560 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.092+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c10f9a0 con 0x7fc61c06b560 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.092+0000 7fc6137fe700 1 -- 172.21.15.152:0/548856858 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc60c007e90 con 0x7fc61c06b560 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.092+0000 7fc6137fe700 1 -- 172.21.15.152:0/548856858 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60c018070 con 0x7fc61c06b560 2024-04-06T12:18:47.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.092+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c10fee0 con 0x7fc61c06b560 2024-04-06T12:18:47.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.093+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c05fb50 con 0x7fc61c06b560 2024-04-06T12:18:47.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.093+0000 7fc6137fe700 1 -- 172.21.15.152:0/548856858 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fc60c01da20 con 0x7fc61c06b560 2024-04-06T12:18:47.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.093+0000 7fc6137fe700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc608061180 0x7fc608063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:47.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.093+0000 7fc6137fe700 1 -- 172.21.15.152:0/548856858 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fc60c07db70 con 0x7fc61c06b560 2024-04-06T12:18:47.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.093+0000 7fc621d91700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc608061180 0x7fc608063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:47.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.094+0000 7fc621d91700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc608061180 0x7fc608063640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc618004b80 tx=0x7fc618009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:47.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.098+0000 7fc6137fe700 1 -- 172.21.15.152:0/548856858 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc60c051e40 con 0x7fc61c06b560 2024-04-06T12:18:47.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.321+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fc61c1023c0 con 0x7fc61c06b560 2024-04-06T12:18:47.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.324+0000 7fc6137fe700 1 -- 172.21.15.152:0/548856858 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fc60c051a30 con 0x7fc61c06b560 2024-04-06T12:18:47.323 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-04-06T12:18:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCnPRFmEJY8ExAATy/+PkUpIT04pKZCcjYEuQ== 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.326+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc608061180 msgr2=0x7fc608063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.326+0000 7fc6247f6700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc608061180 0x7fc608063640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc618004b80 tx=0x7fc618009040).stop 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.326+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06b560 msgr2=0x7fc61c10a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.326+0000 7fc6247f6700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06b560 0x7fc61c10a380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc60c013510 tx=0x7fc60c009cb0).stop 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.326+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 shutdown_connections 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.326+0000 7fc6247f6700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fc608061180 0x7fc608063640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.326+0000 7fc6247f6700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc61c06b560 0x7fc61c10a380 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.326+0000 7fc6247f6700 1 --2- 172.21.15.152:0/548856858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc61c06cb70 0x7fc61c10a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.326+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 >> 172.21.15.152:0/548856858 conn(0x7fc61c0f3150 msgr2=0x7fc61c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.327+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 shutdown_connections 2024-04-06T12:18:47.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:47.327+0000 7fc6247f6700 1 -- 172.21.15.152:0/548856858 wait complete. 2024-04-06T12:18:47.667 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:47.322589+0000 mon.smithi152 (mon.0) 486 : audit [INF] from='client.? 172.21.15.152:0/548856858' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T12:18:47.667 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:47.325881+0000 mon.smithi152 (mon.0) 487 : audit [INF] from='client.? 172.21.15.152:0/548856858' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T12:18:47.952 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:18:47.953 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-06T12:18:47.953 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-06T12:18:47.993 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-06T12:18:48.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:47.322589+0000 mon.smithi152 (mon.0) 486 : audit [INF] from='client.? 172.21.15.152:0/548856858' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T12:18:48.028 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:47.325881+0000 mon.smithi152 (mon.0) 487 : audit [INF] from='client.? 172.21.15.152:0/548856858' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T12:18:48.737 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:47.527267+0000 mgr.smithi152.lynahm (mgr.14196) 153 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:49.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:47.527267+0000 mgr.smithi152.lynahm (mgr.14196) 153 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:49.885 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.887+0000 7f5015334700 1 -- 172.21.15.195:0/1875158171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 msgr2=0x7f50100f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:49.885 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.887+0000 7f5015334700 1 --2- 172.21.15.195:0/1875158171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 0x7f50100f62b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f50040048f0 tx=0x7f500400adc0).stop 2024-04-06T12:18:49.885 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.887+0000 7f5015334700 1 -- 172.21.15.195:0/1875158171 shutdown_connections 2024-04-06T12:18:49.885 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.887+0000 7f5015334700 1 --2- 172.21.15.195:0/1875158171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50100f7090 0x7f50100f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:18:49.885 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.887+0000 7f5015334700 1 --2- 172.21.15.195:0/1875158171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 0x7f50100f62b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:49.885 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.887+0000 7f5015334700 1 -- 172.21.15.195:0/1875158171 >> 172.21.15.195:0/1875158171 conn(0x7f50100f1610 msgr2=0x7f50100f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:49.885 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.887+0000 7f5015334700 1 -- 172.21.15.195:0/1875158171 shutdown_connections 2024-04-06T12:18:49.885 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.887+0000 7f5015334700 1 -- 172.21.15.195:0/1875158171 wait complete. 2024-04-06T12:18:49.887 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.888+0000 7f5015334700 1 Processor -- start 2024-04-06T12:18:49.887 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.888+0000 7f5015334700 1 -- start start 2024-04-06T12:18:49.887 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.888+0000 7f5015334700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 0x7f5010105df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:49.887 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.888+0000 7f5015334700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50100f7090 0x7f50101062e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:49.887 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.888+0000 7f5015334700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5010106920 con 0x7f50100f7090 2024-04-06T12:18:49.887 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.888+0000 7f5015334700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5010106a60 con 0x7f50100f5e90 2024-04-06T12:18:49.887 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.888+0000 7f500effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 0x7f5010105df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:49.887 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.888+0000 7f500effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 0x7f5010105df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:53752/0 (socket says 172.21.15.195:53752) 2024-04-06T12:18:49.887 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.888+0000 7f500effd700 1 -- 172.21.15.195:0/878430314 learned_addr learned my addr 172.21.15.195:0/878430314 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f500e7fc700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50100f7090 0x7f50101062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f500effd700 1 -- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50100f7090 msgr2=0x7f50101062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f500effd700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50100f7090 0x7f50101062e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f500effd700 1 -- 172.21.15.195:0/878430314 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5004005040 con 0x7f50100f5e90 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f500effd700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 0x7f5010105df0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f500400c3b0 tx=0x7f500400adc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f4ff7fff700 1 -- 172.21.15.195:0/878430314 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f500400f030 con 0x7f50100f5e90 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f4ff7fff700 1 -- 172.21.15.195:0/878430314 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f500400aa60 con 0x7f50100f5e90 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501010b450 con 0x7f50100f5e90 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f4ff7fff700 1 -- 172.21.15.195:0/878430314 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5004019070 con 0x7f50100f5e90 2024-04-06T12:18:49.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.889+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501010b950 con 0x7f50100f5e90 2024-04-06T12:18:49.889 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.890+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50100fde50 con 0x7f50100f5e90 2024-04-06T12:18:49.889 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.890+0000 7f4ff7fff700 1 -- 172.21.15.195:0/878430314 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f500401e420 con 0x7f50100f5e90 2024-04-06T12:18:49.889 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.891+0000 7f4ff7fff700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4ff8061180 0x7f4ff8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:49.889 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.891+0000 7f4ff7fff700 1 -- 172.21.15.195:0/878430314 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f500407d6c0 con 0x7f50100f5e90 2024-04-06T12:18:49.889 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.891+0000 7f500e7fc700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4ff8061180 0x7f4ff8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:49.889 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.891+0000 7f500e7fc700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4ff8061180 0x7f4ff8063640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f500000a880 tx=0x7f5000008040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:49.892 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:49.895+0000 7f4ff7fff700 1 -- 172.21.15.195:0/878430314 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5004051990 con 0x7f50100f5e90 2024-04-06T12:18:50.117 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.119+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f50100ffcc0 con 0x7f50100f5e90 2024-04-06T12:18:50.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.124+0000 7f4ff7fff700 1 -- 172.21.15.195:0/878430314 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f5004051580 con 0x7f50100f5e90 2024-04-06T12:18:50.122 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-04-06T12:18:50.123 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCqPRFm++4yBxAArnjkfS/NbpFnBucMuEyMFA== 2024-04-06T12:18:50.125 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4ff8061180 msgr2=0x7f4ff8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:50.125 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4ff8061180 0x7f4ff8063640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f500000a880 tx=0x7f5000008040).stop 2024-04-06T12:18:50.125 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 msgr2=0x7f5010105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:50.125 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 0x7f5010105df0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f500400c3b0 tx=0x7f500400adc0).stop 2024-04-06T12:18:50.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 shutdown_connections 2024-04-06T12:18:50.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4ff8061180 0x7f4ff8063640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:50.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50100f5e90 0x7f5010105df0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:50.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 --2- 172.21.15.195:0/878430314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50100f7090 0x7f50101062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:50.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 >> 172.21.15.195:0/878430314 conn(0x7f50100f1610 msgr2=0x7f50100fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:50.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 shutdown_connections 2024-04-06T12:18:50.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-06T12:18:50.128+0000 7f5015334700 1 -- 172.21.15.195:0/878430314 wait complete. 2024-04-06T12:18:50.796 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:49.527729+0000 mgr.smithi152.lynahm (mgr.14196) 154 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:50.796 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:50.120174+0000 mon.smithi195 (mon.1) 14 : audit [INF] from='client.? 172.21.15.195:0/878430314' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T12:18:50.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:50.120610+0000 mon.smithi152 (mon.0) 488 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T12:18:50.797 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:50.123917+0000 mon.smithi152 (mon.0) 489 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T12:18:50.815 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:18:50.815 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-06T12:18:50.816 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-06T12:18:50.896 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-06T12:18:50.896 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-06T12:18:50.897 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph mgr dump --format=json 2024-04-06T12:18:50.928 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:49.527729+0000 mgr.smithi152.lynahm (mgr.14196) 154 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:50.928 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:50.120174+0000 mon.smithi195 (mon.1) 14 : audit [INF] from='client.? 172.21.15.195:0/878430314' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T12:18:50.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:50.120610+0000 mon.smithi152 (mon.0) 488 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-06T12:18:50.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:50.123917+0000 mon.smithi152 (mon.0) 489 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-06T12:18:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:18:52.670 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:51.528102+0000 mgr.smithi152.lynahm (mgr.14196) 155 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:52.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 -- 172.21.15.152:0/391809843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f79a0 msgr2=0x7f98f80f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:52.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 --2- 172.21.15.152:0/391809843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f79a0 0x7f98f80f7dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f98e00047f0 tx=0x7f98e0009cb0).stop 2024-04-06T12:18:52.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 -- 172.21.15.152:0/391809843 shutdown_connections 2024-04-06T12:18:52.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 --2- 172.21.15.152:0/391809843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f80f8c40 0x7f98f80f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:52.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 --2- 172.21.15.152:0/391809843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f79a0 0x7f98f80f7dc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:52.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 -- 172.21.15.152:0/391809843 >> 172.21.15.152:0/391809843 conn(0x7f98f80f3100 msgr2=0x7f98f80f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:52.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 -- 172.21.15.152:0/391809843 shutdown_connections 2024-04-06T12:18:52.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 -- 172.21.15.152:0/391809843 wait complete. 2024-04-06T12:18:52.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 Processor -- start 2024-04-06T12:18:52.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.912+0000 7f98fe720700 1 -- start start 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98fe720700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f80f79a0 0x7f98f81080d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98fe720700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f8c40 0x7f98f81085c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98fe720700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8108b70 con 0x7f98f80f8c40 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98fe720700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8108cb0 con 0x7f98f80f79a0 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98f77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f8c40 0x7f98f81085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98f77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f8c40 0x7f98f81085c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36688/0 (socket says 172.21.15.152:36688) 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98f77fe700 1 -- 172.21.15.152:0/1546256222 learned_addr learned my addr 172.21.15.152:0/1546256222 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98f7fff700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f80f79a0 0x7f98f81080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98f77fe700 1 -- 172.21.15.152:0/1546256222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f80f79a0 msgr2=0x7f98f81080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98f77fe700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f80f79a0 0x7f98f81080d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98f77fe700 1 -- 172.21.15.152:0/1546256222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0005040 con 0x7f98f80f8c40 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.913+0000 7f98f77fe700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f8c40 0x7f98f81085c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f98e800c790 tx=0x7f98e800caa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.914+0000 7f98f57fa700 1 -- 172.21.15.152:0/1546256222 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e800e680 con 0x7f98f80f8c40 2024-04-06T12:18:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.914+0000 7f98f57fa700 1 -- 172.21.15.152:0/1546256222 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f98e800ec70 con 0x7f98f80f8c40 2024-04-06T12:18:52.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.914+0000 7f98f57fa700 1 -- 172.21.15.152:0/1546256222 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e8012d70 con 0x7f98f80f8c40 2024-04-06T12:18:52.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.914+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f810d750 con 0x7f98f80f8c40 2024-04-06T12:18:52.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.914+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f810dc40 con 0x7f98f80f8c40 2024-04-06T12:18:52.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.915+0000 7f98f57fa700 1 -- 172.21.15.152:0/1546256222 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f98e800e7e0 con 0x7f98f80f8c40 2024-04-06T12:18:52.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.915+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8100110 con 0x7f98f80f8c40 2024-04-06T12:18:52.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.915+0000 7f98f57fa700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98e4061180 0x7f98e4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:52.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.915+0000 7f98f57fa700 1 -- 172.21.15.152:0/1546256222 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f98e807be40 con 0x7f98f80f8c40 2024-04-06T12:18:52.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.915+0000 7f98f7fff700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98e4061180 0x7f98e4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:52.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.916+0000 7f98f7fff700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98e4061180 0x7f98e4063640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f98e0004f10 tx=0x7f98e000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:52.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:52.920+0000 7f98f57fa700 1 -- 172.21.15.152:0/1546256222 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f98e8047f60 con 0x7f98f80f8c40 2024-04-06T12:18:53.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:51.528102+0000 mgr.smithi152.lynahm (mgr.14196) 155 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.126+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f98f80598f0 con 0x7f98f80f8c40 2024-04-06T12:18:53.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.129+0000 7f98f57fa700 1 -- 172.21.15.152:0/1546256222 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+152033 (secure 0 0 0) 0x7f98e8045200 con 0x7f98f80f8c40 2024-04-06T12:18:53.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:18:53.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98e4061180 msgr2=0x7f98e4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:53.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98e4061180 0x7f98e4063640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f98e0004f10 tx=0x7f98e000b040).stop 2024-04-06T12:18:53.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f8c40 msgr2=0x7f98f81085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:53.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f8c40 0x7f98f81085c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f98e800c790 tx=0x7f98e800caa0).stop 2024-04-06T12:18:53.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 shutdown_connections 2024-04-06T12:18:53.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98e4061180 0x7f98e4063640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:53.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f80f79a0 0x7f98f81080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:53.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 --2- 172.21.15.152:0/1546256222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98f80f8c40 0x7f98f81085c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:53.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 >> 172.21.15.152:0/1546256222 conn(0x7f98f80f3100 msgr2=0x7f98f80fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:53.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 shutdown_connections 2024-04-06T12:18:53.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:53.131+0000 7f98fe720700 1 -- 172.21.15.152:0/1546256222 wait complete. 2024-04-06T12:18:53.944 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:53.127619+0000 mon.smithi152 (mon.0) 490 : audit [DBG] from='client.? 172.21.15.152:0/1546256222' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-06T12:18:53.963 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"active_gid":14196,"active_name":"smithi152.lynahm","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3059779308},{"type":"v1","addr":"172.21.15.152:6801","nonce":3059779308}]},"active_addr":"172.21.15.152:6801/3059779308","active_change":"2024-04-06T12:15:15.483948+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":14210,"name":"smithi195.ausetj","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.152:8443/","prometheus":"http://172.21.15.152:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2875093102}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":1500470379}]}]} 2024-04-06T12:18:53.967 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-06T12:18:53.967 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-06T12:18:53.968 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-06T12:18:54.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:53.127619+0000 mon.smithi152 (mon.0) 490 : audit [DBG] from='client.? 172.21.15.152:0/1546256222' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-06T12:18:54.272 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:18:54.763 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:53.528430+0000 mgr.smithi152.lynahm (mgr.14196) 156 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:55.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:53.528430+0000 mgr.smithi152.lynahm (mgr.14196) 156 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.204+0000 7f7b6f366700 1 -- 172.21.15.152:0/2973199227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 msgr2=0x7f7b680f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.204+0000 7f7b6f366700 1 --2- 172.21.15.152:0/2973199227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 0x7f7b680f7dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f7b640047f0 tx=0x7f7b64009cb0).stop 2024-04-06T12:18:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.204+0000 7f7b6f366700 1 -- 172.21.15.152:0/2973199227 shutdown_connections 2024-04-06T12:18:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.204+0000 7f7b6f366700 1 --2- 172.21.15.152:0/2973199227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680f8c40 0x7f7b680f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.204+0000 7f7b6f366700 1 --2- 172.21.15.152:0/2973199227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 0x7f7b680f7dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.204+0000 7f7b6f366700 1 -- 172.21.15.152:0/2973199227 >> 172.21.15.152:0/2973199227 conn(0x7f7b680f3100 msgr2=0x7f7b680f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.204+0000 7f7b6f366700 1 -- 172.21.15.152:0/2973199227 shutdown_connections 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.204+0000 7f7b6f366700 1 -- 172.21.15.152:0/2973199227 wait complete. 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6f366700 1 Processor -- start 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6f366700 1 -- start start 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6f366700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 0x7f7b681081e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6f366700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680f8c40 0x7f7b681086d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6f366700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b68108c80 con 0x7f7b680f79a0 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6f366700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b68108dc0 con 0x7f7b680f8c40 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6d102700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 0x7f7b681081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6d102700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 0x7f7b681081e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36704/0 (socket says 172.21.15.152:36704) 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6d102700 1 -- 172.21.15.152:0/1536344917 learned_addr learned my addr 172.21.15.152:0/1536344917 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6c901700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680f8c40 0x7f7b681086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6d102700 1 -- 172.21.15.152:0/1536344917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680f8c40 msgr2=0x7f7b681086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6d102700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680f8c40 0x7f7b681086d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.205+0000 7f7b6d102700 1 -- 172.21.15.152:0/1536344917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64005040 con 0x7f7b680f79a0 2024-04-06T12:18:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.206+0000 7f7b6d102700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 0x7f7b681081e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f7b64013580 tx=0x7f7b64009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.206+0000 7f7b5e7fc700 1 -- 172.21.15.152:0/1536344917 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b64018070 con 0x7f7b680f79a0 2024-04-06T12:18:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.206+0000 7f7b5e7fc700 1 -- 172.21.15.152:0/1536344917 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7b64007e90 con 0x7f7b680f79a0 2024-04-06T12:18:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.206+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6810d800 con 0x7f7b680f79a0 2024-04-06T12:18:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.206+0000 7f7b5e7fc700 1 -- 172.21.15.152:0/1536344917 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b640123c0 con 0x7f7b680f79a0 2024-04-06T12:18:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.206+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6810ddc0 con 0x7f7b680f79a0 2024-04-06T12:18:56.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.207+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b68100110 con 0x7f7b680f79a0 2024-04-06T12:18:56.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.207+0000 7f7b5e7fc700 1 -- 172.21.15.152:0/1536344917 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f7b6401d420 con 0x7f7b680f79a0 2024-04-06T12:18:56.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.208+0000 7f7b5e7fc700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7b54061180 0x7f7b54063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:56.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.208+0000 7f7b5e7fc700 1 -- 172.21.15.152:0/1536344917 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f7b6407d1c0 con 0x7f7b680f79a0 2024-04-06T12:18:56.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.208+0000 7f7b6c901700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7b54061180 0x7f7b54063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:56.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.208+0000 7f7b6c901700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7b54061180 0x7f7b54063640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7b58009f20 tx=0x7f7b5800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.212+0000 7f7b5e7fc700 1 -- 172.21.15.152:0/1536344917 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7b64051490 con 0x7f7b680f79a0 2024-04-06T12:18:56.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.376+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b680598f0 con 0x7f7b680f79a0 2024-04-06T12:18:56.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.376+0000 7f7b5e7fc700 1 -- 172.21.15.152:0/1536344917 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10952 (secure 0 0 0) 0x7f7b64051080 con 0x7f7b680f79a0 2024-04-06T12:18:56.375 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:18:56.375 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","created":"2024-04-06T12:13:16.768469+0000","modified":"2024-04-06T12:18:38.076766+0000","last_up_change":"2024-04-06T12:18:37.071819+0000","last_in_change":"2024-04-06T12:18:18.562700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-06T12:17:21.824734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"cb0a62c1-5f47-450c-8e9e-4e02c899eda3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6803","nonce":1835635164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6805","nonce":1835635164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6809","nonce":1835635164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6807","nonce":1835635164}]},"public_addr":"172.21.15.152:6803/1835635164","cluster_addr":"172.21.15.152:6805/1835635164","heartbeat_back_addr":"172.21.15.152:6809/1835635164","heartbeat_front_addr":"172.21.15.152:6807/1835635164","state":["exists","up"]},{"osd":1,"uuid":"f9490187-6df1-4d4f-bfd3-a2da32d3a669","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6811","nonce":4181928109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6813","nonce":4181928109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6817","nonce":4181928109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6815","nonce":4181928109}]},"public_addr":"172.21.15.152:6811/4181928109","cluster_addr":"172.21.15.152:6813/4181928109","heartbeat_back_addr":"172.21.15.152:6817/4181928109","heartbeat_front_addr":"172.21.15.152:6815/4181928109","state":["exists","up"]},{"osd":2,"uuid":"4a279284-26fa-436f-a830-abda13b40713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6819","nonce":366825869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6821","nonce":366825869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6825","nonce":366825869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6823","nonce":366825869}]},"public_addr":"172.21.15.152:6819/366825869","cluster_addr":"172.21.15.152:6821/366825869","heartbeat_back_addr":"172.21.15.152:6825/366825869","heartbeat_front_addr":"172.21.15.152:6823/366825869","state":["exists","up"]},{"osd":3,"uuid":"64e8942a-1121-44fd-9ed2-cbb5176df587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6801","nonce":2559967436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6803","nonce":2559967436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6807","nonce":2559967436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6805","nonce":2559967436}]},"public_addr":"172.21.15.195:6801/2559967436","cluster_addr":"172.21.15.195:6803/2559967436","heartbeat_back_addr":"172.21.15.195:6807/2559967436","heartbeat_front_addr":"172.21.15.195:6805/2559967436","state":["exists","up"]},{"osd":4,"uuid":"378a7c45-9887-4e48-b004-0f3b470af912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6809","nonce":62445982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6811","nonce":62445982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6815","nonce":62445982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6813","nonce":62445982}]},"public_addr":"172.21.15.195:6809/62445982","cluster_addr":"172.21.15.195:6811/62445982","heartbeat_back_addr":"172.21.15.195:6815/62445982","heartbeat_front_addr":"172.21.15.195:6813/62445982","state":["exists","up"]},{"osd":5,"uuid":"2608627e-47c5-446a-b13e-699aaaea81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6817","nonce":2188685791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6819","nonce":2188685791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6823","nonce":2188685791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6821","nonce":2188685791}]},"public_addr":"172.21.15.195:6817/2188685791","cluster_addr":"172.21.15.195:6819/2188685791","heartbeat_back_addr":"172.21.15.195:6823/2188685791","heartbeat_front_addr":"172.21.15.195:6821/2188685791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:18.549757+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:51.020120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:20.272551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:44.651165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:09.828133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:35.929735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:6801/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6800/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/2556143500":"2024-04-07T12:14:19.995122+0000","172.21.15.152:6801/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/1200342064":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/378420270":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/944313623":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6800/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.152:0/2930097039":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6800/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/2583442237":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6801/3532590768":"2024-04-07T12:13:49.213100+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T12:18:56.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7b54061180 msgr2=0x7f7b54063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:56.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7b54061180 0x7f7b54063640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7b58009f20 tx=0x7f7b5800b040).stop 2024-04-06T12:18:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 msgr2=0x7f7b681081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 0x7f7b681081e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f7b64013580 tx=0x7f7b64009cb0).stop 2024-04-06T12:18:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 shutdown_connections 2024-04-06T12:18:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f7b54061180 0x7f7b54063640 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b680f79a0 0x7f7b681081e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 --2- 172.21.15.152:0/1536344917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680f8c40 0x7f7b681086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 >> 172.21.15.152:0/1536344917 conn(0x7f7b680f3100 msgr2=0x7f7b680fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 shutdown_connections 2024-04-06T12:18:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:56.378+0000 7f7b6f366700 1 -- 172.21.15.152:0/1536344917 wait complete. 2024-04-06T12:18:56.695 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:55.528887+0000 mgr.smithi152.lynahm (mgr.14196) 157 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:56.695 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:56.377285+0000 mon.smithi152 (mon.0) 491 : audit [DBG] from='client.? 172.21.15.152:0/1536344917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:18:57.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:55.528887+0000 mgr.smithi152.lynahm (mgr.14196) 157 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:57.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:56.377285+0000 mon.smithi152 (mon.0) 491 : audit [DBG] from='client.? 172.21.15.152:0/1536344917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:18:57.105 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-06T12:18:57.105 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-06T12:18:57.369 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:18:58.902 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:57.529302+0000 mgr.smithi152.lynahm (mgr.14196) 158 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:59.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:57.529302+0000 mgr.smithi152.lynahm (mgr.14196) 158 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:18:59.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.174+0000 7fb66178c700 1 -- 172.21.15.152:0/1561521979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c0fab10 msgr2=0x7fb65c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:59.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.174+0000 7fb66178c700 1 --2- 172.21.15.152:0/1561521979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c0fab10 0x7fb65c0fcf60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb6500047f0 tx=0x7fb650009cb0).stop 2024-04-06T12:18:59.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.174+0000 7fb66178c700 1 -- 172.21.15.152:0/1561521979 shutdown_connections 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.174+0000 7fb66178c700 1 --2- 172.21.15.152:0/1561521979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c0fab10 0x7fb65c0fcf60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.174+0000 7fb66178c700 1 --2- 172.21.15.152:0/1561521979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb65c061740 0x7fb65c0fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.174+0000 7fb66178c700 1 -- 172.21.15.152:0/1561521979 >> 172.21.15.152:0/1561521979 conn(0x7fb65c0f2020 msgr2=0x7fb65c0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.174+0000 7fb66178c700 1 -- 172.21.15.152:0/1561521979 shutdown_connections 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.174+0000 7fb66178c700 1 -- 172.21.15.152:0/1561521979 wait complete. 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.175+0000 7fb66178c700 1 Processor -- start 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.175+0000 7fb66178c700 1 -- start start 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.175+0000 7fb66178c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c061740 0x7fb65c1080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.175+0000 7fb66178c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb65c0fab10 0x7fb65c1085b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.175+0000 7fb66178c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c108b60 con 0x7fb65c061740 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.175+0000 7fb66178c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c108ca0 con 0x7fb65c0fab10 2024-04-06T12:18:59.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.175+0000 7fb65affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c061740 0x7fb65c1080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.175+0000 7fb65affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c061740 0x7fb65c1080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36730/0 (socket says 172.21.15.152:36730) 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.175+0000 7fb65affd700 1 -- 172.21.15.152:0/3844221094 learned_addr learned my addr 172.21.15.152:0/3844221094 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb65a7fc700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb65c0fab10 0x7fb65c1085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb65affd700 1 -- 172.21.15.152:0/3844221094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb65c0fab10 msgr2=0x7fb65c1085b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb65affd700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb65c0fab10 0x7fb65c1085b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb65affd700 1 -- 172.21.15.152:0/3844221094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650005040 con 0x7fb65c061740 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb65affd700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c061740 0x7fb65c1080c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb64c0041d0 tx=0x7fb64c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb643fff700 1 -- 172.21.15.152:0/3844221094 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb64c007b40 con 0x7fb65c061740 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c10d740 con 0x7fb65c061740 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb643fff700 1 -- 172.21.15.152:0/3844221094 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb64c00f040 con 0x7fb65c061740 2024-04-06T12:18:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb643fff700 1 -- 172.21.15.152:0/3844221094 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb64c013730 con 0x7fb65c061740 2024-04-06T12:18:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.176+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65c10dc80 con 0x7fb65c061740 2024-04-06T12:18:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.177+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65c100120 con 0x7fb65c061740 2024-04-06T12:18:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.177+0000 7fb643fff700 1 -- 172.21.15.152:0/3844221094 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fb64c009110 con 0x7fb65c061740 2024-04-06T12:18:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.178+0000 7fb643fff700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb644061180 0x7fb644063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:18:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.178+0000 7fb643fff700 1 -- 172.21.15.152:0/3844221094 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fb64c07bfe0 con 0x7fb65c061740 2024-04-06T12:18:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.178+0000 7fb65a7fc700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb644061180 0x7fb644063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:18:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.178+0000 7fb65a7fc700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb644061180 0x7fb644063640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb650004f10 tx=0x7fb65000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:18:59.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.182+0000 7fb643fff700 1 -- 172.21.15.152:0/3844221094 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb64c0502b0 con 0x7fb65c061740 2024-04-06T12:18:59.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.345+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb65c101f90 con 0x7fb65c061740 2024-04-06T12:18:59.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.346+0000 7fb643fff700 1 -- 172.21.15.152:0/3844221094 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10952 (secure 0 0 0) 0x7fb64c04fea0 con 0x7fb65c061740 2024-04-06T12:18:59.344 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:18:59.344 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","created":"2024-04-06T12:13:16.768469+0000","modified":"2024-04-06T12:18:38.076766+0000","last_up_change":"2024-04-06T12:18:37.071819+0000","last_in_change":"2024-04-06T12:18:18.562700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-06T12:17:21.824734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"cb0a62c1-5f47-450c-8e9e-4e02c899eda3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6803","nonce":1835635164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6805","nonce":1835635164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6809","nonce":1835635164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6807","nonce":1835635164}]},"public_addr":"172.21.15.152:6803/1835635164","cluster_addr":"172.21.15.152:6805/1835635164","heartbeat_back_addr":"172.21.15.152:6809/1835635164","heartbeat_front_addr":"172.21.15.152:6807/1835635164","state":["exists","up"]},{"osd":1,"uuid":"f9490187-6df1-4d4f-bfd3-a2da32d3a669","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6811","nonce":4181928109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6813","nonce":4181928109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6817","nonce":4181928109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6815","nonce":4181928109}]},"public_addr":"172.21.15.152:6811/4181928109","cluster_addr":"172.21.15.152:6813/4181928109","heartbeat_back_addr":"172.21.15.152:6817/4181928109","heartbeat_front_addr":"172.21.15.152:6815/4181928109","state":["exists","up"]},{"osd":2,"uuid":"4a279284-26fa-436f-a830-abda13b40713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6819","nonce":366825869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6821","nonce":366825869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6825","nonce":366825869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6823","nonce":366825869}]},"public_addr":"172.21.15.152:6819/366825869","cluster_addr":"172.21.15.152:6821/366825869","heartbeat_back_addr":"172.21.15.152:6825/366825869","heartbeat_front_addr":"172.21.15.152:6823/366825869","state":["exists","up"]},{"osd":3,"uuid":"64e8942a-1121-44fd-9ed2-cbb5176df587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6801","nonce":2559967436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6803","nonce":2559967436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6807","nonce":2559967436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6805","nonce":2559967436}]},"public_addr":"172.21.15.195:6801/2559967436","cluster_addr":"172.21.15.195:6803/2559967436","heartbeat_back_addr":"172.21.15.195:6807/2559967436","heartbeat_front_addr":"172.21.15.195:6805/2559967436","state":["exists","up"]},{"osd":4,"uuid":"378a7c45-9887-4e48-b004-0f3b470af912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6809","nonce":62445982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6811","nonce":62445982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6815","nonce":62445982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6813","nonce":62445982}]},"public_addr":"172.21.15.195:6809/62445982","cluster_addr":"172.21.15.195:6811/62445982","heartbeat_back_addr":"172.21.15.195:6815/62445982","heartbeat_front_addr":"172.21.15.195:6813/62445982","state":["exists","up"]},{"osd":5,"uuid":"2608627e-47c5-446a-b13e-699aaaea81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6817","nonce":2188685791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6819","nonce":2188685791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6823","nonce":2188685791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6821","nonce":2188685791}]},"public_addr":"172.21.15.195:6817/2188685791","cluster_addr":"172.21.15.195:6819/2188685791","heartbeat_back_addr":"172.21.15.195:6823/2188685791","heartbeat_front_addr":"172.21.15.195:6821/2188685791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:18.549757+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:51.020120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:20.272551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:44.651165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:09.828133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:35.929735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:6801/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6800/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/2556143500":"2024-04-07T12:14:19.995122+0000","172.21.15.152:6801/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/1200342064":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/378420270":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/944313623":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6800/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.152:0/2930097039":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6800/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/2583442237":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6801/3532590768":"2024-04-07T12:13:49.213100+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T12:18:59.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb644061180 msgr2=0x7fb644063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:59.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb644061180 0x7fb644063640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb650004f10 tx=0x7fb65000b040).stop 2024-04-06T12:18:59.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c061740 msgr2=0x7fb65c1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:18:59.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c061740 0x7fb65c1080c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb64c0041d0 tx=0x7fb64c009f60).stop 2024-04-06T12:18:59.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 shutdown_connections 2024-04-06T12:18:59.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb644061180 0x7fb644063640 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:59.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb65c061740 0x7fb65c1080c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:59.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 --2- 172.21.15.152:0/3844221094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb65c0fab10 0x7fb65c1085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:18:59.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 >> 172.21.15.152:0/3844221094 conn(0x7fb65c0f2020 msgr2=0x7fb65c0f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:18:59.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 shutdown_connections 2024-04-06T12:18:59.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:18:59.348+0000 7fb66178c700 1 -- 172.21.15.152:0/3844221094 wait complete. 2024-04-06T12:18:59.717 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:18:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:18:59.346926+0000 mon.smithi152 (mon.0) 492 : audit [DBG] from='client.? 172.21.15.152:0/3844221094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:19:00.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:18:59 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:18:59.346926+0000 mon.smithi152 (mon.0) 492 : audit [DBG] from='client.? 172.21.15.152:0/3844221094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:19:00.161 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-04-06T12:19:00.161 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-04-06T12:19:00.162 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-04-06T12:19:00.162 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-04-06T12:19:00.163 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-04-06T12:19:00.163 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-04-06T12:19:00.489 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:00.507 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:00.980 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:18:59.529583+0000 mgr.smithi152.lynahm (mgr.14196) 159 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:01.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:18:59.529583+0000 mgr.smithi152.lynahm (mgr.14196) 159 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:01.827 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:02.388 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:02.391 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:02.395 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:03.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:01.530155+0000 mgr.smithi152.lynahm (mgr.14196) 160 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:03.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:01.530155+0000 mgr.smithi152.lynahm (mgr.14196) 160 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:04.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 -- 172.21.15.152:0/1027840035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f79a0 msgr2=0x7faf0c0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 --2- 172.21.15.152:0/1027840035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f79a0 0x7faf0c0f7dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7faf080047f0 tx=0x7faf08009cb0).stop 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 -- 172.21.15.152:0/1027840035 shutdown_connections 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 --2- 172.21.15.152:0/1027840035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0c0f8c40 0x7faf0c0f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 --2- 172.21.15.152:0/1027840035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f79a0 0x7faf0c0f7dc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 -- 172.21.15.152:0/1027840035 >> 172.21.15.152:0/1027840035 conn(0x7faf0c0f3100 msgr2=0x7faf0c0f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 -- 172.21.15.152:0/1027840035 shutdown_connections 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 -- 172.21.15.152:0/1027840035 wait complete. 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 Processor -- start 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.101+0000 7faf1373b700 1 -- start start 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf1373b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0c0f79a0 0x7faf0c1080d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf1373b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f8c40 0x7faf0c1085c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf1373b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c108b70 con 0x7faf0c0f8c40 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf1373b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c108cb0 con 0x7faf0c0f79a0 2024-04-06T12:19:04.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf10cd6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f8c40 0x7faf0c1085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf10cd6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f8c40 0x7faf0c1085c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41332/0 (socket says 172.21.15.152:41332) 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf10cd6700 1 -- 172.21.15.152:0/2647105862 learned_addr learned my addr 172.21.15.152:0/2647105862 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf114d7700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0c0f79a0 0x7faf0c1080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf10cd6700 1 -- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0c0f79a0 msgr2=0x7faf0c1080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf10cd6700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0c0f79a0 0x7faf0c1080d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf10cd6700 1 -- 172.21.15.152:0/2647105862 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08005040 con 0x7faf0c0f8c40 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf10cd6700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f8c40 0x7faf0c1085c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7faefc0041d0 tx=0x7faefc009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf027fc700 1 -- 172.21.15.152:0/2647105862 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faefc007b40 con 0x7faf0c0f8c40 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf027fc700 1 -- 172.21.15.152:0/2647105862 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7faefc00f040 con 0x7faf0c0f8c40 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c10d750 con 0x7faf0c0f8c40 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf027fc700 1 -- 172.21.15.152:0/2647105862 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faefc013730 con 0x7faf0c0f8c40 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.102+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c10dc90 con 0x7faf0c0f8c40 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.103+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf0c05f5f0 con 0x7faf0c0f8c40 2024-04-06T12:19:04.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.103+0000 7faf027fc700 1 -- 172.21.15.152:0/2647105862 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7faefc009110 con 0x7faf0c0f8c40 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.104+0000 7faf027fc700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7faef8061180 0x7faef8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.104+0000 7faf027fc700 1 -- 172.21.15.152:0/2647105862 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7faefc07bef0 con 0x7faf0c0f8c40 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.104+0000 7faf114d7700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7faef8061180 0x7faef8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.104+0000 7faf027fc700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] conn(0x7faef8066d50 0x7faef8069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.104+0000 7faf027fc700 1 -- 172.21.15.152:0/2647105862 --> [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faef8069810 con 0x7faef8066d50 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.104+0000 7faf027fc700 1 -- 172.21.15.152:0/2647105862 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7faefc07e560 con 0x7faf0c0f8c40 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.104+0000 7faf114d7700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7faef8061180 0x7faef8063640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7faf08004f10 tx=0x7faf0800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.104+0000 7faf11cd8700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] conn(0x7faef8066d50 0x7faef8069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.105+0000 7faf11cd8700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] conn(0x7faef8066d50 0x7faef8069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:04.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.105+0000 7faf027fc700 1 -- 172.21.15.152:0/2647105862 <== osd.5 v2:172.21.15.195:6816/2188685791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7faef8069810 con 0x7faef8066d50 2024-04-06T12:19:04.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.119+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 --> [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf0c059360 con 0x7faef8066d50 2024-04-06T12:19:04.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf027fc700 1 -- 172.21.15.152:0/2647105862 <== osd.5 v2:172.21.15.195:6816/2188685791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7faf0c059360 con 0x7faef8066d50 2024-04-06T12:19:04.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] conn(0x7faef8066d50 msgr2=0x7faef8069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] conn(0x7faef8066d50 0x7faef8069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7faef8061180 msgr2=0x7faef8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7faef8061180 0x7faef8063640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7faf08004f10 tx=0x7faf0800b040).stop 2024-04-06T12:19:04.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f8c40 msgr2=0x7faf0c1085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f8c40 0x7faf0c1085c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7faefc0041d0 tx=0x7faefc009f60).stop 2024-04-06T12:19:04.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 shutdown_connections 2024-04-06T12:19:04.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:6816/2188685791,v1:172.21.15.195:6817/2188685791] conn(0x7faef8066d50 0x7faef8069190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7faef8061180 0x7faef8063640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0c0f79a0 0x7faf0c1080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 --2- 172.21.15.152:0/2647105862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf0c0f8c40 0x7faf0c1085c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.120+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 >> 172.21.15.152:0/2647105862 conn(0x7faf0c0f3100 msgr2=0x7faf0c0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:04.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.121+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 shutdown_connections 2024-04-06T12:19:04.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.121+0000 7faf1373b700 1 -- 172.21.15.152:0/2647105862 wait complete. 2024-04-06T12:19:04.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.827+0000 7f0a0e44c700 1 -- 172.21.15.152:0/3150674815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f68a0 msgr2=0x7f0a080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.827+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/3150674815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f68a0 0x7f0a080f6cc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f09f80047f0 tx=0x7f09f8009cb0).stop 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.827+0000 7f0a0e44c700 1 -- 172.21.15.152:0/3150674815 shutdown_connections 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.827+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/3150674815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a080f7b40 0x7f0a080f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.827+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/3150674815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f68a0 0x7f0a080f6cc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.827+0000 7f0a0e44c700 1 -- 172.21.15.152:0/3150674815 >> 172.21.15.152:0/3150674815 conn(0x7f0a080f2020 msgr2=0x7f0a080f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.827+0000 7f0a0e44c700 1 -- 172.21.15.152:0/3150674815 shutdown_connections 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.827+0000 7f0a0e44c700 1 -- 172.21.15.152:0/3150674815 wait complete. 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a0e44c700 1 Processor -- start 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a0e44c700 1 -- start start 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a0e44c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a080f68a0 0x7f0a08106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a0e44c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f7b40 0x7f0a08107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a0e44c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08107a40 con 0x7f0a080f7b40 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a0e44c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08107b80 con 0x7f0a080f68a0 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a077fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f7b40 0x7f0a08107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:04.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a077fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f7b40 0x7f0a08107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41360/0 (socket says 172.21.15.152:41360) 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a077fe700 1 -- 172.21.15.152:0/2595536927 learned_addr learned my addr 172.21.15.152:0/2595536927 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a07fff700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a080f68a0 0x7f0a08106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a077fe700 1 -- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a080f68a0 msgr2=0x7f0a08106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.828+0000 7f0a077fe700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a080f68a0 0x7f0a08106fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.829+0000 7f0a077fe700 1 -- 172.21.15.152:0/2595536927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8005040 con 0x7f0a080f7b40 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.829+0000 7f0a077fe700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f7b40 0x7f0a08107490 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f09fc00c790 tx=0x7f09fc004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.829+0000 7f0a057fa700 1 -- 172.21.15.152:0/2595536927 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09fc00e680 con 0x7f0a080f7b40 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.829+0000 7f0a057fa700 1 -- 172.21.15.152:0/2595536927 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f09fc00ec70 con 0x7f0a080f7b40 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.829+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0810c620 con 0x7f0a080f7b40 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.829+0000 7f0a057fa700 1 -- 172.21.15.152:0/2595536927 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09fc012d30 con 0x7f0a080f7b40 2024-04-06T12:19:04.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.829+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0810cb60 con 0x7f0a080f7b40 2024-04-06T12:19:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.830+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a08061c00 con 0x7f0a080f7b40 2024-04-06T12:19:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.830+0000 7f0a057fa700 1 -- 172.21.15.152:0/2595536927 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f09fc012400 con 0x7f0a080f7b40 2024-04-06T12:19:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.831+0000 7f0a057fa700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f09f0061180 0x7f09f0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.831+0000 7f0a057fa700 1 -- 172.21.15.152:0/2595536927 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f09fc07c990 con 0x7f0a080f7b40 2024-04-06T12:19:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.831+0000 7f0a07fff700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f09f0061180 0x7f09f0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.831+0000 7f0a057fa700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] conn(0x7f09f0066d50 0x7f09f0069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.831+0000 7f0a057fa700 1 -- 172.21.15.152:0/2595536927 --> [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09f0069810 con 0x7f09f0066d50 2024-04-06T12:19:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.831+0000 7f0a057fa700 1 -- 172.21.15.152:0/2595536927 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09fc07cd90 con 0x7f0a080f7b40 2024-04-06T12:19:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.831+0000 7f0a07fff700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f09f0061180 0x7f09f0063640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f09f8004f10 tx=0x7f09f800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.831+0000 7f0a0c9e9700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] conn(0x7f09f0066d50 0x7f09f0069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.832+0000 7f0a0c9e9700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] conn(0x7f09f0066d50 0x7f09f0069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.832+0000 7f0a057fa700 1 -- 172.21.15.152:0/2595536927 <== osd.4 v2:172.21.15.195:6808/62445982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f09f0069810 con 0x7f09f0066d50 2024-04-06T12:19:04.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.846+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 --> [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a08059360 con 0x7f09f0066d50 2024-04-06T12:19:04.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a057fa700 1 -- 172.21.15.152:0/2595536927 <== osd.4 v2:172.21.15.195:6808/62445982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0a08059360 con 0x7f09f0066d50 2024-04-06T12:19:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] conn(0x7f09f0066d50 msgr2=0x7f09f0069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] conn(0x7f09f0066d50 0x7f09f0069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f09f0061180 msgr2=0x7f09f0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f09f0061180 0x7f09f0063640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f09f8004f10 tx=0x7f09f800b040).stop 2024-04-06T12:19:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f7b40 msgr2=0x7f0a08107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f7b40 0x7f0a08107490 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f09fc00c790 tx=0x7f09fc004330).stop 2024-04-06T12:19:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 shutdown_connections 2024-04-06T12:19:04.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:6808/62445982,v1:172.21.15.195:6809/62445982] conn(0x7f09f0066d50 0x7f09f0069190 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f09f0061180 0x7f09f0063640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a080f68a0 0x7f0a08106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.847+0000 7f0a0e44c700 1 --2- 172.21.15.152:0/2595536927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a080f7b40 0x7f0a08107490 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.848+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 >> 172.21.15.152:0/2595536927 conn(0x7f0a080f2020 msgr2=0x7f0a080fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.848+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 shutdown_connections 2024-04-06T12:19:04.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:04.848+0000 7f0a0e44c700 1 -- 172.21.15.152:0/2595536927 wait complete. 2024-04-06T12:19:05.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:03.530449+0000 mgr.smithi152.lynahm (mgr.14196) 161 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:05.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:03.530449+0000 mgr.smithi152.lynahm (mgr.14196) 161 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:06.649 INFO:teuthology.orchestra.run.smithi152.stdout:158913789961 2024-04-06T12:19:06.650 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-04-06T12:19:06.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:05.530750+0000 mgr.smithi152.lynahm (mgr.14196) 162 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:07.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:05.530750+0000 mgr.smithi152.lynahm (mgr.14196) 162 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:08.079 INFO:teuthology.orchestra.run.smithi152.stdout:137438953485 2024-04-06T12:19:08.080 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-04-06T12:19:08.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.080+0000 7f3c97512700 1 -- 172.21.15.152:0/3068035363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 msgr2=0x7f3c900f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.080+0000 7f3c97512700 1 --2- 172.21.15.152:0/3068035363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 0x7f3c900f6cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3c8c0047f0 tx=0x7f3c8c009cb0).stop 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.080+0000 7f3c97512700 1 -- 172.21.15.152:0/3068035363 shutdown_connections 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.080+0000 7f3c97512700 1 --2- 172.21.15.152:0/3068035363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c900f7b40 0x7f3c900f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.080+0000 7f3c97512700 1 --2- 172.21.15.152:0/3068035363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 0x7f3c900f6cc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.080+0000 7f3c97512700 1 -- 172.21.15.152:0/3068035363 >> 172.21.15.152:0/3068035363 conn(0x7f3c900f2020 msgr2=0x7f3c900f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.080+0000 7f3c97512700 1 -- 172.21.15.152:0/3068035363 shutdown_connections 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.080+0000 7f3c97512700 1 -- 172.21.15.152:0/3068035363 wait complete. 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c97512700 1 Processor -- start 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c97512700 1 -- start start 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c97512700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 0x7f3c9010a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c97512700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c900f7b40 0x7f3c9010a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:08.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c97512700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9010ad00 con 0x7f3c900f68a0 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c97512700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9010ae40 con 0x7f3c900f7b40 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c952ae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 0x7f3c9010a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c952ae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 0x7f3c9010a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41374/0 (socket says 172.21.15.152:41374) 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c952ae700 1 -- 172.21.15.152:0/2793187754 learned_addr learned my addr 172.21.15.152:0/2793187754 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c94aad700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c900f7b40 0x7f3c9010a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c952ae700 1 -- 172.21.15.152:0/2793187754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c900f7b40 msgr2=0x7f3c9010a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c952ae700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c900f7b40 0x7f3c9010a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c952ae700 1 -- 172.21.15.152:0/2793187754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c005040 con 0x7f3c900f68a0 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c952ae700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 0x7f3c9010a260 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3c8c004f10 tx=0x7f3c8c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.081+0000 7f3c867fc700 1 -- 172.21.15.152:0/2793187754 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c8c00e070 con 0x7f3c900f68a0 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.082+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9010f880 con 0x7f3c900f68a0 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.082+0000 7f3c867fc700 1 -- 172.21.15.152:0/2793187754 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3c8c007e90 con 0x7f3c900f68a0 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.082+0000 7f3c867fc700 1 -- 172.21.15.152:0/2793187754 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c8c018070 con 0x7f3c900f68a0 2024-04-06T12:19:08.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.082+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9010fdc0 con 0x7f3c900f68a0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.082+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c9005f5f0 con 0x7f3c900f68a0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.083+0000 7f3c867fc700 1 -- 172.21.15.152:0/2793187754 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f3c8c0123c0 con 0x7f3c900f68a0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.083+0000 7f3c867fc700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3c7c061110 0x7f3c7c0635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.083+0000 7f3c867fc700 1 -- 172.21.15.152:0/2793187754 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f3c8c07d340 con 0x7f3c900f68a0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.083+0000 7f3c94aad700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3c7c061110 0x7f3c7c0635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.083+0000 7f3c867fc700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] conn(0x7f3c7c066ce0 0x7f3c7c069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.083+0000 7f3c867fc700 1 -- 172.21.15.152:0/2793187754 --> [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c7c0697a0 con 0x7f3c7c066ce0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.083+0000 7f3c867fc700 1 -- 172.21.15.152:0/2793187754 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c8c07f9b0 con 0x7f3c900f68a0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.084+0000 7f3c95aaf700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] conn(0x7f3c7c066ce0 0x7f3c7c069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.084+0000 7f3c94aad700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3c7c061110 0x7f3c7c0635d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3c80004dc0 tx=0x7f3c8000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.084+0000 7f3c95aaf700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] conn(0x7f3c7c066ce0 0x7f3c7c069120 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.084+0000 7f3c867fc700 1 -- 172.21.15.152:0/2793187754 <== osd.1 v2:172.21.15.152:6810/4181928109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f3c7c0697a0 con 0x7f3c7c066ce0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.102+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 --> [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c900fc040 con 0x7f3c7c066ce0 2024-04-06T12:19:08.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c867fc700 1 -- 172.21.15.152:0/2793187754 <== osd.1 v2:172.21.15.152:6810/4181928109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c900fc040 con 0x7f3c7c066ce0 2024-04-06T12:19:08.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] conn(0x7f3c7c066ce0 msgr2=0x7f3c7c069120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:08.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] conn(0x7f3c7c066ce0 0x7f3c7c069120 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:08.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3c7c061110 msgr2=0x7f3c7c0635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:08.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3c7c061110 0x7f3c7c0635d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3c80004dc0 tx=0x7f3c8000b040).stop 2024-04-06T12:19:08.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 msgr2=0x7f3c9010a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:08.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 0x7f3c9010a260 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3c8c004f10 tx=0x7f3c8c009cb0).stop 2024-04-06T12:19:08.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 shutdown_connections 2024-04-06T12:19:08.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6810/4181928109,v1:172.21.15.152:6811/4181928109] conn(0x7f3c7c066ce0 0x7f3c7c069120 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:08.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3c7c061110 0x7f3c7c0635d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:08.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c900f68a0 0x7f3c9010a260 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:08.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 --2- 172.21.15.152:0/2793187754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c900f7b40 0x7f3c9010a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:08.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 >> 172.21.15.152:0/2793187754 conn(0x7f3c900f2020 msgr2=0x7f3c90061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:08.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 shutdown_connections 2024-04-06T12:19:08.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:08.103+0000 7f3c97512700 1 -- 172.21.15.152:0/2793187754 wait complete. 2024-04-06T12:19:08.962 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:07.531048+0000 mgr.smithi152.lynahm (mgr.14196) 163 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:09.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:07.531048+0000 mgr.smithi152.lynahm (mgr.14196) 163 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:09.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.654+0000 7fd9c2b63700 1 -- 172.21.15.152:0/1949788225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f7b40 msgr2=0x7fd9bc0f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:09.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.654+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/1949788225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f7b40 0x7fd9bc0f7fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd9a80047f0 tx=0x7fd9a8009cb0).stop 2024-04-06T12:19:09.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.654+0000 7fd9c2b63700 1 -- 172.21.15.152:0/1949788225 shutdown_connections 2024-04-06T12:19:09.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.654+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/1949788225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f7b40 0x7fd9bc0f7fa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:09.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.654+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/1949788225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9bc0f68a0 0x7fd9bc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:09.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.654+0000 7fd9c2b63700 1 -- 172.21.15.152:0/1949788225 >> 172.21.15.152:0/1949788225 conn(0x7fd9bc0f2020 msgr2=0x7fd9bc0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.654+0000 7fd9c2b63700 1 -- 172.21.15.152:0/1949788225 shutdown_connections 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.654+0000 7fd9c2b63700 1 -- 172.21.15.152:0/1949788225 wait complete. 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c2b63700 1 Processor -- start 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c2b63700 1 -- start start 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c2b63700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f68a0 0x7fd9bc0615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c2b63700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9bc0f7b40 0x7fd9bc10ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c2b63700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc10d380 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c2b63700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc10d4c0 con 0x7fd9bc0f7b40 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c08ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f68a0 0x7fd9bc0615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c08ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f68a0 0x7fd9bc0615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41380/0 (socket says 172.21.15.152:41380) 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c08ff700 1 -- 172.21.15.152:0/3098080949 learned_addr learned my addr 172.21.15.152:0/3098080949 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9bbfff700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9bc0f7b40 0x7fd9bc10ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c08ff700 1 -- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9bc0f7b40 msgr2=0x7fd9bc10ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c08ff700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9bc0f7b40 0x7fd9bc10ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c08ff700 1 -- 172.21.15.152:0/3098080949 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8005040 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9bbfff700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9bc0f7b40 0x7fd9bc10ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c08ff700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f68a0 0x7fd9bc0615c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fd9b000c7c0 tx=0x7fd9b0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9b9ffb700 1 -- 172.21.15.152:0/3098080949 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b00106f0 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9b9ffb700 1 -- 172.21.15.152:0/3098080949 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fd9b0010ce0 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc10d720 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.655+0000 7fd9b9ffb700 1 -- 172.21.15.152:0/3098080949 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b0012c70 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.656+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc10dc60 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.656+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9bc05f5f0 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.657+0000 7fd9b9ffb700 1 -- 172.21.15.152:0/3098080949 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fd9b0012400 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.657+0000 7fd9b9ffb700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd9ac061180 0x7fd9ac063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.657+0000 7fd9b9ffb700 1 -- 172.21.15.152:0/3098080949 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fd9b007be40 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.657+0000 7fd9bbfff700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd9ac061180 0x7fd9ac063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:09.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.657+0000 7fd9b9ffb700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] conn(0x7fd9ac066d50 0x7fd9ac069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:09.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.657+0000 7fd9b9ffb700 1 -- 172.21.15.152:0/3098080949 --> [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9ac069810 con 0x7fd9ac066d50 2024-04-06T12:19:09.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.657+0000 7fd9b9ffb700 1 -- 172.21.15.152:0/3098080949 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9b007e4b0 con 0x7fd9bc0f68a0 2024-04-06T12:19:09.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.658+0000 7fd9bbfff700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd9ac061180 0x7fd9ac063640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd9a8013470 tx=0x7fd9a800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:09.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.658+0000 7fd9c1100700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] conn(0x7fd9ac066d50 0x7fd9ac069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:09.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.658+0000 7fd9c1100700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] conn(0x7fd9ac066d50 0x7fd9ac069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:09.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.659+0000 7fd9b9ffb700 1 -- 172.21.15.152:0/3098080949 <== osd.3 v2:172.21.15.195:6800/2559967436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fd9ac069810 con 0x7fd9ac066d50 2024-04-06T12:19:09.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.673+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 --> [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9bc0593e0 con 0x7fd9ac066d50 2024-04-06T12:19:09.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9b9ffb700 1 -- 172.21.15.152:0/3098080949 <== osd.3 v2:172.21.15.195:6800/2559967436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd9bc0593e0 con 0x7fd9ac066d50 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] conn(0x7fd9ac066d50 msgr2=0x7fd9ac069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] conn(0x7fd9ac066d50 0x7fd9ac069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd9ac061180 msgr2=0x7fd9ac063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd9ac061180 0x7fd9ac063640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd9a8013470 tx=0x7fd9a800b040).stop 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f68a0 msgr2=0x7fd9bc0615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f68a0 0x7fd9bc0615c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fd9b000c7c0 tx=0x7fd9b0007f70).stop 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 shutdown_connections 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:6800/2559967436,v1:172.21.15.195:6801/2559967436] conn(0x7fd9ac066d50 0x7fd9ac069190 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd9ac061180 0x7fd9ac063640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0f68a0 0x7fd9bc0615c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 --2- 172.21.15.152:0/3098080949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9bc0f7b40 0x7fd9bc10ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:09.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.674+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 >> 172.21.15.152:0/3098080949 conn(0x7fd9bc0f2020 msgr2=0x7fd9bc0fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:09.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.675+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 shutdown_connections 2024-04-06T12:19:09.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:09.675+0000 7fd9c2b63700 1 -- 172.21.15.152:0/3098080949 wait complete. 2024-04-06T12:19:10.590 INFO:teuthology.orchestra.run.smithi152.stdout:111669149715 2024-04-06T12:19:10.590 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-04-06T12:19:10.931 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:09.531324+0000 mgr.smithi152.lynahm (mgr.14196) 164 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:11.051 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:09.531324+0000 mgr.smithi152.lynahm (mgr.14196) 164 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:11.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.582+0000 7f28cdee8700 1 -- 172.21.15.152:0/1488314926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 msgr2=0x7f28c80f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:11.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.582+0000 7f28cdee8700 1 --2- 172.21.15.152:0/1488314926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 0x7f28c80f7fa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f28b00047f0 tx=0x7f28b0009cb0).stop 2024-04-06T12:19:11.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.582+0000 7f28cdee8700 1 -- 172.21.15.152:0/1488314926 shutdown_connections 2024-04-06T12:19:11.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.582+0000 7f28cdee8700 1 --2- 172.21.15.152:0/1488314926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 0x7f28c80f7fa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:11.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.582+0000 7f28cdee8700 1 --2- 172.21.15.152:0/1488314926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28c80f68a0 0x7f28c80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:11.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.582+0000 7f28cdee8700 1 -- 172.21.15.152:0/1488314926 >> 172.21.15.152:0/1488314926 conn(0x7f28c80f2020 msgr2=0x7f28c80f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:11.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.582+0000 7f28cdee8700 1 -- 172.21.15.152:0/1488314926 shutdown_connections 2024-04-06T12:19:11.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.582+0000 7f28cdee8700 1 -- 172.21.15.152:0/1488314926 wait complete. 2024-04-06T12:19:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28cdee8700 1 Processor -- start 2024-04-06T12:19:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28cdee8700 1 -- start start 2024-04-06T12:19:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28cdee8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28c80f68a0 0x7f28c8108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28cdee8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 0x7f28c8108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28cdee8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8108ae0 con 0x7f28c80f7b40 2024-04-06T12:19:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28cdee8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8108c20 con 0x7f28c80f68a0 2024-04-06T12:19:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28c6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 0x7f28c8108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:11.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28c6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 0x7f28c8108530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41388/0 (socket says 172.21.15.152:41388) 2024-04-06T12:19:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28c6ffd700 1 -- 172.21.15.152:0/3456230039 learned_addr learned my addr 172.21.15.152:0/3456230039 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.583+0000 7f28c77fe700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28c80f68a0 0x7f28c8108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.584+0000 7f28c6ffd700 1 -- 172.21.15.152:0/3456230039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28c80f68a0 msgr2=0x7f28c8108040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.584+0000 7f28c6ffd700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28c80f68a0 0x7f28c8108040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.584+0000 7f28c6ffd700 1 -- 172.21.15.152:0/3456230039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0005040 con 0x7f28c80f7b40 2024-04-06T12:19:11.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.584+0000 7f28c6ffd700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 0x7f28c8108530 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f28b0013510 tx=0x7f28b0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.584+0000 7f28c4ff9700 1 -- 172.21.15.152:0/3456230039 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b000e030 con 0x7f28c80f7b40 2024-04-06T12:19:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.584+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c810d660 con 0x7f28c80f7b40 2024-04-06T12:19:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.584+0000 7f28c4ff9700 1 -- 172.21.15.152:0/3456230039 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f28b0007e90 con 0x7f28c80f7b40 2024-04-06T12:19:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.584+0000 7f28c4ff9700 1 -- 172.21.15.152:0/3456230039 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b0018070 con 0x7f28c80f7b40 2024-04-06T12:19:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.584+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c810dba0 con 0x7f28c80f7b40 2024-04-06T12:19:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.585+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28c8061c00 con 0x7f28c80f7b40 2024-04-06T12:19:11.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.585+0000 7f28c4ff9700 1 -- 172.21.15.152:0/3456230039 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f28b001da20 con 0x7f28c80f7b40 2024-04-06T12:19:11.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.586+0000 7f28c4ff9700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f28b40611d0 0x7f28b4063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:11.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.586+0000 7f28c4ff9700 1 -- 172.21.15.152:0/3456230039 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f28b007dc50 con 0x7f28c80f7b40 2024-04-06T12:19:11.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.586+0000 7f28c77fe700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f28b40611d0 0x7f28b4063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:11.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.586+0000 7f28c4ff9700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] conn(0x7f28b4066da0 0x7f28b40691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:11.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.586+0000 7f28c4ff9700 1 -- 172.21.15.152:0/3456230039 --> [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28b4069860 con 0x7f28b4066da0 2024-04-06T12:19:11.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.586+0000 7f28c4ff9700 1 -- 172.21.15.152:0/3456230039 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28b00831a0 con 0x7f28c80f7b40 2024-04-06T12:19:11.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.586+0000 7f28c7fff700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] conn(0x7f28b4066da0 0x7f28b40691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:11.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.586+0000 7f28c77fe700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f28b40611d0 0x7f28b4063690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f28c80f79a0 tx=0x7f28b8009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:11.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.586+0000 7f28c7fff700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] conn(0x7f28b4066da0 0x7f28b40691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:11.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.587+0000 7f28c4ff9700 1 -- 172.21.15.152:0/3456230039 <== osd.2 v2:172.21.15.152:6818/366825869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f28b4069860 con 0x7f28b4066da0 2024-04-06T12:19:11.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.601+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 --> [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28c80fc1c0 con 0x7f28b4066da0 2024-04-06T12:19:11.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.601+0000 7f28c4ff9700 1 -- 172.21.15.152:0/3456230039 <== osd.2 v2:172.21.15.152:6818/366825869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f28c80fc1c0 con 0x7f28b4066da0 2024-04-06T12:19:11.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.601+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] conn(0x7f28b4066da0 msgr2=0x7f28b40691e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:11.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.601+0000 7f28cdee8700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] conn(0x7f28b4066da0 0x7f28b40691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f28b40611d0 msgr2=0x7f28b4063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f28b40611d0 0x7f28b4063690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f28c80f79a0 tx=0x7f28b8009040).stop 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 msgr2=0x7f28c8108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 0x7f28c8108530 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f28b0013510 tx=0x7f28b0009cb0).stop 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 shutdown_connections 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6818/366825869,v1:172.21.15.152:6819/366825869] conn(0x7f28b4066da0 0x7f28b40691e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f28b40611d0 0x7f28b4063690 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28c80f68a0 0x7f28c8108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 --2- 172.21.15.152:0/3456230039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28c80f7b40 0x7f28c8108530 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 >> 172.21.15.152:0/3456230039 conn(0x7f28c80f2020 msgr2=0x7f28c8061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 shutdown_connections 2024-04-06T12:19:11.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:11.602+0000 7f28cdee8700 1 -- 172.21.15.152:0/3456230039 wait complete. 2024-04-06T12:19:12.403 INFO:teuthology.orchestra.run.smithi152.stdout:81604378649 2024-04-06T12:19:12.403 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-04-06T12:19:12.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:11.531612+0000 mgr.smithi152.lynahm (mgr.14196) 165 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:12.763 INFO:teuthology.orchestra.run.smithi152.stdout:60129542174 2024-04-06T12:19:12.764 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-04-06T12:19:13.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:11.531612+0000 mgr.smithi152.lynahm (mgr.14196) 165 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:13.056 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:13.553 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:13.553 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:13.558 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:14.511 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:15.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:13.532173+0000 mgr.smithi152.lynahm (mgr.14196) 166 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:15.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:13.532173+0000 mgr.smithi152.lynahm (mgr.14196) 166 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.402+0000 7f3523a3e700 1 -- 172.21.15.152:0/368205758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f79a0 msgr2=0x7f351c0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.402+0000 7f3523a3e700 1 --2- 172.21.15.152:0/368205758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f79a0 0x7f351c0f7dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f35180047f0 tx=0x7f3518009cb0).stop 2024-04-06T12:19:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 -- 172.21.15.152:0/368205758 shutdown_connections 2024-04-06T12:19:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 --2- 172.21.15.152:0/368205758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c0f8c40 0x7f351c0f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 --2- 172.21.15.152:0/368205758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f79a0 0x7f351c0f7dc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 -- 172.21.15.152:0/368205758 >> 172.21.15.152:0/368205758 conn(0x7f351c0f3100 msgr2=0x7f351c0f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 -- 172.21.15.152:0/368205758 shutdown_connections 2024-04-06T12:19:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 -- 172.21.15.152:0/368205758 wait complete. 2024-04-06T12:19:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 Processor -- start 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 -- start start 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c0f79a0 0x7f351c1080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f8c40 0x7f351c108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c108b40 con 0x7f351c0f8c40 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.403+0000 7f3523a3e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c108c80 con 0x7f351c0f79a0 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f3520fd9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f8c40 0x7f351c108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f3520fd9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f8c40 0x7f351c108590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44326/0 (socket says 172.21.15.152:44326) 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f3520fd9700 1 -- 172.21.15.152:0/4010221095 learned_addr learned my addr 172.21.15.152:0/4010221095 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f35217da700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c0f79a0 0x7f351c1080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f3520fd9700 1 -- 172.21.15.152:0/4010221095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c0f79a0 msgr2=0x7f351c1080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f3520fd9700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c0f79a0 0x7f351c1080a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f3520fd9700 1 -- 172.21.15.152:0/4010221095 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518005040 con 0x7f351c0f8c40 2024-04-06T12:19:16.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f35217da700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c0f79a0 0x7f351c1080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:19:16.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f3520fd9700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f8c40 0x7f351c108590 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f350c00c740 tx=0x7f350c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:16.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f35127fc700 1 -- 172.21.15.152:0/4010221095 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f350c00e680 con 0x7f351c0f8c40 2024-04-06T12:19:16.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c10d720 con 0x7f351c0f8c40 2024-04-06T12:19:16.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f35127fc700 1 -- 172.21.15.152:0/4010221095 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f350c00ec70 con 0x7f351c0f8c40 2024-04-06T12:19:16.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f35127fc700 1 -- 172.21.15.152:0/4010221095 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f350c013d30 con 0x7f351c0f8c40 2024-04-06T12:19:16.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.404+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c10dc60 con 0x7f351c0f8c40 2024-04-06T12:19:16.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.405+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f351c05f5f0 con 0x7f351c0f8c40 2024-04-06T12:19:16.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.405+0000 7f35127fc700 1 -- 172.21.15.152:0/4010221095 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f350c00e7e0 con 0x7f351c0f8c40 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.406+0000 7f35127fc700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3508061180 0x7f3508063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.406+0000 7f35127fc700 1 -- 172.21.15.152:0/4010221095 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f350c07c840 con 0x7f351c0f8c40 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.406+0000 7f35217da700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3508061180 0x7f3508063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.406+0000 7f35127fc700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] conn(0x7f3508066d50 0x7f3508069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.406+0000 7f35127fc700 1 -- 172.21.15.152:0/4010221095 --> [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3508069810 con 0x7f3508066d50 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.406+0000 7f35127fc700 1 -- 172.21.15.152:0/4010221095 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f350c081220 con 0x7f351c0f8c40 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.406+0000 7f3521fdb700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] conn(0x7f3508066d50 0x7f3508069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.406+0000 7f35217da700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3508061180 0x7f3508063640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3518013470 tx=0x7f351800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.406+0000 7f3521fdb700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] conn(0x7f3508066d50 0x7f3508069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.407+0000 7f35127fc700 1 -- 172.21.15.152:0/4010221095 <== osd.0 v2:172.21.15.152:6802/1835635164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f3508069810 con 0x7f3508066d50 2024-04-06T12:19:16.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.421+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 --> [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f351c0593e0 con 0x7f3508066d50 2024-04-06T12:19:16.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.421+0000 7f35127fc700 1 -- 172.21.15.152:0/4010221095 <== osd.0 v2:172.21.15.152:6802/1835635164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f351c0593e0 con 0x7f3508066d50 2024-04-06T12:19:16.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.421+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] conn(0x7f3508066d50 msgr2=0x7f3508069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:16.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.421+0000 7f3523a3e700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] conn(0x7f3508066d50 0x7f3508069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:16.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.421+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3508061180 msgr2=0x7f3508063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:16.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.421+0000 7f3523a3e700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3508061180 0x7f3508063640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3518013470 tx=0x7f351800b040).stop 2024-04-06T12:19:16.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.421+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f8c40 msgr2=0x7f351c108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:16.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.421+0000 7f3523a3e700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f8c40 0x7f351c108590 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f350c00c740 tx=0x7f350c007ef0).stop 2024-04-06T12:19:16.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.422+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 shutdown_connections 2024-04-06T12:19:16.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.422+0000 7f3523a3e700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3508061180 0x7f3508063640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:16.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.422+0000 7f3523a3e700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c0f79a0 0x7f351c1080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:16.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.422+0000 7f3523a3e700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:6802/1835635164,v1:172.21.15.152:6803/1835635164] conn(0x7f3508066d50 0x7f3508069190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:16.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.422+0000 7f3523a3e700 1 --2- 172.21.15.152:0/4010221095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f351c0f8c40 0x7f351c108590 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:16.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.422+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 >> 172.21.15.152:0/4010221095 conn(0x7f351c0f3100 msgr2=0x7f351c0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:16.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.422+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 shutdown_connections 2024-04-06T12:19:16.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:16.422+0000 7f3523a3e700 1 -- 172.21.15.152:0/4010221095 wait complete. 2024-04-06T12:19:16.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:15.532684+0000 mgr.smithi152.lynahm (mgr.14196) 167 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:17.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:15.532684+0000 mgr.smithi152.lynahm (mgr.14196) 167 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:18.564 INFO:teuthology.orchestra.run.smithi152.stdout:38654705703 2024-04-06T12:19:18.564 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-04-06T12:19:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:17.533002+0000 mgr.smithi152.lynahm (mgr.14196) 168 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:17.533002+0000 mgr.smithi152.lynahm (mgr.14196) 168 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.155+0000 7fbc8d20d700 1 -- 172.21.15.152:0/319094685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 msgr2=0x7fbc880f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.155+0000 7fbc8d20d700 1 --2- 172.21.15.152:0/319094685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 0x7fbc880f7fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fbc7c0047f0 tx=0x7fbc7c009cb0).stop 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.155+0000 7fbc8d20d700 1 -- 172.21.15.152:0/319094685 shutdown_connections 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.155+0000 7fbc8d20d700 1 --2- 172.21.15.152:0/319094685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 0x7fbc880f7fa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.155+0000 7fbc8d20d700 1 --2- 172.21.15.152:0/319094685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc880f68a0 0x7fbc880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.155+0000 7fbc8d20d700 1 -- 172.21.15.152:0/319094685 >> 172.21.15.152:0/319094685 conn(0x7fbc880f2020 msgr2=0x7fbc880f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.155+0000 7fbc8d20d700 1 -- 172.21.15.152:0/319094685 shutdown_connections 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.155+0000 7fbc8d20d700 1 -- 172.21.15.152:0/319094685 wait complete. 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.155+0000 7fbc8d20d700 1 Processor -- start 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8d20d700 1 -- start start 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8d20d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc880f68a0 0x7fbc88106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:20.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8d20d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 0x7fbc88107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8d20d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc881079e0 con 0x7fbc880f7b40 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8d20d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc88107b20 con 0x7fbc880f68a0 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 0x7fbc88107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 0x7fbc88107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44338/0 (socket says 172.21.15.152:44338) 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8659c700 1 -- 172.21.15.152:0/960523162 learned_addr learned my addr 172.21.15.152:0/960523162 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc86d9d700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc880f68a0 0x7fbc88106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8659c700 1 -- 172.21.15.152:0/960523162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc880f68a0 msgr2=0x7fbc88106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8659c700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc880f68a0 0x7fbc88106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8659c700 1 -- 172.21.15.152:0/960523162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c005040 con 0x7fbc880f7b40 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc8659c700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 0x7fbc88107430 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fbc7c013510 tx=0x7fbc7c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.156+0000 7fbc6ffff700 1 -- 172.21.15.152:0/960523162 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7c00e030 con 0x7fbc880f7b40 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.157+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8810c560 con 0x7fbc880f7b40 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.157+0000 7fbc6ffff700 1 -- 172.21.15.152:0/960523162 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbc7c007e90 con 0x7fbc880f7b40 2024-04-06T12:19:20.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.157+0000 7fbc6ffff700 1 -- 172.21.15.152:0/960523162 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7c018070 con 0x7fbc880f7b40 2024-04-06T12:19:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.157+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8810caa0 con 0x7fbc880f7b40 2024-04-06T12:19:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.157+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc880feff0 con 0x7fbc880f7b40 2024-04-06T12:19:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.158+0000 7fbc6ffff700 1 -- 172.21.15.152:0/960523162 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fbc7c01d940 con 0x7fbc880f7b40 2024-04-06T12:19:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.158+0000 7fbc6ffff700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbc70061180 0x7fbc70063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.159+0000 7fbc6ffff700 1 -- 172.21.15.152:0/960523162 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fbc7c07ddd0 con 0x7fbc880f7b40 2024-04-06T12:19:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.159+0000 7fbc86d9d700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbc70061180 0x7fbc70063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.159+0000 7fbc86d9d700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbc70061180 0x7fbc70063640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fbc880f79a0 tx=0x7fbc78009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.162+0000 7fbc6ffff700 1 -- 172.21.15.152:0/960523162 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbc7c052060 con 0x7fbc880f7b40 2024-04-06T12:19:20.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.328+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbc88100e60 con 0x7fbc880f7b40 2024-04-06T12:19:20.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.329+0000 7fbc6ffff700 1 -- 172.21.15.152:0/960523162 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc7c051c50 con 0x7fbc880f7b40 2024-04-06T12:19:20.327 INFO:teuthology.orchestra.run.smithi152.stdout:111669149717 2024-04-06T12:19:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbc70061180 msgr2=0x7fbc70063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbc70061180 0x7fbc70063640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fbc880f79a0 tx=0x7fbc78009040).stop 2024-04-06T12:19:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 msgr2=0x7fbc88107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 0x7fbc88107430 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fbc7c013510 tx=0x7fbc7c009cb0).stop 2024-04-06T12:19:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 shutdown_connections 2024-04-06T12:19:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbc70061180 0x7fbc70063640 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc880f68a0 0x7fbc88106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 --2- 172.21.15.152:0/960523162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc880f7b40 0x7fbc88107430 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 >> 172.21.15.152:0/960523162 conn(0x7fbc880f2020 msgr2=0x7fbc880fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:20.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 shutdown_connections 2024-04-06T12:19:20.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.331+0000 7fbc8d20d700 1 -- 172.21.15.152:0/960523162 wait complete. 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.424+0000 7f72b9b2c700 1 -- 172.21.15.152:0/519260072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f8c40 msgr2=0x7f72b40f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.424+0000 7f72b9b2c700 1 --2- 172.21.15.152:0/519260072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f8c40 0x7f72b40f90a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f72a40047f0 tx=0x7f72a4009cb0).stop 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.424+0000 7f72b9b2c700 1 -- 172.21.15.152:0/519260072 shutdown_connections 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.424+0000 7f72b9b2c700 1 --2- 172.21.15.152:0/519260072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f8c40 0x7f72b40f90a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.424+0000 7f72b9b2c700 1 --2- 172.21.15.152:0/519260072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b40f79a0 0x7f72b40f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.424+0000 7f72b9b2c700 1 -- 172.21.15.152:0/519260072 >> 172.21.15.152:0/519260072 conn(0x7f72b40f3100 msgr2=0x7f72b40f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.425+0000 7f72b9b2c700 1 -- 172.21.15.152:0/519260072 shutdown_connections 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.425+0000 7f72b9b2c700 1 -- 172.21.15.152:0/519260072 wait complete. 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.425+0000 7f72b9b2c700 1 Processor -- start 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.425+0000 7f72b9b2c700 1 -- start start 2024-04-06T12:19:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.425+0000 7f72b9b2c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f79a0 0x7f72b406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.425+0000 7f72b9b2c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b40f8c40 0x7f72b406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.425+0000 7f72b9b2c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b406cf80 con 0x7f72b40f79a0 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.425+0000 7f72b9b2c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b406b520 con 0x7f72b40f8c40 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.425+0000 7f72b37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f79a0 0x7f72b406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f79a0 0x7f72b406c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44358/0 (socket says 172.21.15.152:44358) 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b37fe700 1 -- 172.21.15.152:0/1444174852 learned_addr learned my addr 172.21.15.152:0/1444174852 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b2ffd700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b40f8c40 0x7f72b406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b37fe700 1 -- 172.21.15.152:0/1444174852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b40f8c40 msgr2=0x7f72b406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b37fe700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b40f8c40 0x7f72b406b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b37fe700 1 -- 172.21.15.152:0/1444174852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4005040 con 0x7f72b40f79a0 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b2ffd700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b40f8c40 0x7f72b406b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b37fe700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f79a0 0x7f72b406c9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f72a800e910 tx=0x7f72a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b0ff9700 1 -- 172.21.15.152:0/1444174852 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a800ee50 con 0x7f72b40f79a0 2024-04-06T12:19:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b0ff9700 1 -- 172.21.15.152:0/1444174852 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f72a800f040 con 0x7f72b40f79a0 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b406b7a0 con 0x7f72b40f79a0 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b0ff9700 1 -- 172.21.15.152:0/1444174852 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a800c810 con 0x7f72b40f79a0 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.426+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b406bd60 con 0x7f72b40f79a0 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.427+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b4100110 con 0x7f72b40f79a0 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.427+0000 7f72b0ff9700 1 -- 172.21.15.152:0/1444174852 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f72a80092b0 con 0x7f72b40f79a0 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.428+0000 7f72b0ff9700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f729c061180 0x7f729c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.428+0000 7f72b0ff9700 1 -- 172.21.15.152:0/1444174852 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f72a807bec0 con 0x7f72b40f79a0 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.428+0000 7f72b2ffd700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f729c061180 0x7f729c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.428+0000 7f72b2ffd700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f729c061180 0x7f729c063640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f72a4004540 tx=0x7f72a400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.432+0000 7f72b0ff9700 1 -- 172.21.15.152:0/1444174852 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f72a8050210 con 0x7f72b40f79a0 2024-04-06T12:19:20.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.599+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f72b4101f80 con 0x7f72b40f79a0 2024-04-06T12:19:20.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.599+0000 7f72b0ff9700 1 -- 172.21.15.152:0/1444174852 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72a804fe00 con 0x7f72b40f79a0 2024-04-06T12:19:20.598 INFO:teuthology.orchestra.run.smithi152.stdout:81604378651 2024-04-06T12:19:20.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f729c061180 msgr2=0x7f729c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:20.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f729c061180 0x7f729c063640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f72a4004540 tx=0x7f72a400b040).stop 2024-04-06T12:19:20.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f79a0 msgr2=0x7f72b406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:20.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f79a0 0x7f72b406c9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f72a800e910 tx=0x7f72a800b040).stop 2024-04-06T12:19:20.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 shutdown_connections 2024-04-06T12:19:20.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f729c061180 0x7f729c063640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b40f79a0 0x7f72b406c9d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 --2- 172.21.15.152:0/1444174852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b40f8c40 0x7f72b406b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:20.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 >> 172.21.15.152:0/1444174852 conn(0x7f72b40f3100 msgr2=0x7f72b40fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:20.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 shutdown_connections 2024-04-06T12:19:20.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.601+0000 7f72b9b2c700 1 -- 172.21.15.152:0/1444174852 wait complete. 2024-04-06T12:19:21.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:19.533293+0000 mgr.smithi152.lynahm (mgr.14196) 169 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:21.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:20.329992+0000 mon.smithi152 (mon.0) 493 : audit [DBG] from='client.? 172.21.15.152:0/960523162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-06T12:19:21.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:20.600360+0000 mon.smithi152 (mon.0) 494 : audit [DBG] from='client.? 172.21.15.152:0/1444174852' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-06T12:19:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:19.533293+0000 mgr.smithi152.lynahm (mgr.14196) 169 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:20.329992+0000 mon.smithi152 (mon.0) 493 : audit [DBG] from='client.? 172.21.15.152:0/960523162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-06T12:19:21.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:20.600360+0000 mon.smithi152 (mon.0) 494 : audit [DBG] from='client.? 172.21.15.152:0/1444174852' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-06T12:19:21.468 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149717 for osd.3 2024-04-06T12:19:21.468 DEBUG:teuthology.parallel:result is None 2024-04-06T12:19:21.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.893+0000 7f52cd36f700 1 -- 172.21.15.152:0/3844267529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 msgr2=0x7f52c80fa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:21.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.893+0000 7f52cd36f700 1 --2- 172.21.15.152:0/3844267529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 0x7f52c80fa580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f52b80047f0 tx=0x7f52b8009cb0).stop 2024-04-06T12:19:21.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.893+0000 7f52cd36f700 1 -- 172.21.15.152:0/3844267529 shutdown_connections 2024-04-06T12:19:21.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.893+0000 7f52cd36f700 1 --2- 172.21.15.152:0/3844267529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52c80fab00 0x7f52c80fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:21.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.893+0000 7f52cd36f700 1 --2- 172.21.15.152:0/3844267529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 0x7f52c80fa580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:21.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.893+0000 7f52cd36f700 1 -- 172.21.15.152:0/3844267529 >> 172.21.15.152:0/3844267529 conn(0x7f52c80f2020 msgr2=0x7f52c80f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:21.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.893+0000 7f52cd36f700 1 -- 172.21.15.152:0/3844267529 shutdown_connections 2024-04-06T12:19:21.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.893+0000 7f52cd36f700 1 -- 172.21.15.152:0/3844267529 wait complete. 2024-04-06T12:19:21.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.894+0000 7f52cd36f700 1 Processor -- start 2024-04-06T12:19:21.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.894+0000 7f52cd36f700 1 -- start start 2024-04-06T12:19:21.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.894+0000 7f52cd36f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 0x7f52c8108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:21.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.894+0000 7f52cd36f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52c80fab00 0x7f52c8108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:21.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.894+0000 7f52cd36f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8108b20 con 0x7f52c80617e0 2024-04-06T12:19:21.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.894+0000 7f52cd36f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8108c60 con 0x7f52c80fab00 2024-04-06T12:19:21.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.894+0000 7f52c6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 0x7f52c8108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:21.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.894+0000 7f52c6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 0x7f52c8108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44378/0 (socket says 172.21.15.152:44378) 2024-04-06T12:19:21.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.894+0000 7f52c6ffd700 1 -- 172.21.15.152:0/1689393986 learned_addr learned my addr 172.21.15.152:0/1689393986 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:21.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52c67fc700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52c80fab00 0x7f52c8108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52c6ffd700 1 -- 172.21.15.152:0/1689393986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52c80fab00 msgr2=0x7f52c8108570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52c6ffd700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52c80fab00 0x7f52c8108570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52c6ffd700 1 -- 172.21.15.152:0/1689393986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8005040 con 0x7f52c80617e0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52c67fc700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52c80fab00 0x7f52c8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52c6ffd700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 0x7f52c8108080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f52b8013470 tx=0x7f52b8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52affff700 1 -- 172.21.15.152:0/1689393986 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b800e030 con 0x7f52c80617e0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c810d6a0 con 0x7f52c80617e0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52affff700 1 -- 172.21.15.152:0/1689393986 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f52b8007e90 con 0x7f52c80617e0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52affff700 1 -- 172.21.15.152:0/1689393986 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b8018070 con 0x7f52c80617e0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.895+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c810dbe0 con 0x7f52c80617e0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.896+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c8100140 con 0x7f52c80617e0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.897+0000 7f52affff700 1 -- 172.21.15.152:0/1689393986 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f52b801d420 con 0x7f52c80617e0 2024-04-06T12:19:21.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.897+0000 7f52affff700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b0061180 0x7f52b0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:21.648 INFO:teuthology.orchestra.run.smithi152.stdout:137438953488 2024-04-06T12:19:21.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.897+0000 7f52affff700 1 -- 172.21.15.152:0/1689393986 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f52b807de90 con 0x7f52c80617e0 2024-04-06T12:19:21.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.897+0000 7f52c67fc700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b0061180 0x7f52b0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:21.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.897+0000 7f52c67fc700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b0061180 0x7f52b0063640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f52c80615b0 tx=0x7f52bc009da0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:21.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:20.901+0000 7f52affff700 1 -- 172.21.15.152:0/1689393986 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f52b80521e0 con 0x7f52c80617e0 2024-04-06T12:19:21.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.065+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f52c8101fb0 con 0x7f52c80617e0 2024-04-06T12:19:21.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.066+0000 7f52affff700 1 -- 172.21.15.152:0/1689393986 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52b804e020 con 0x7f52c80617e0 2024-04-06T12:19:21.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.067+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b0061180 msgr2=0x7f52b0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.067+0000 7f52cd36f700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b0061180 0x7f52b0063640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f52c80615b0 tx=0x7f52bc009da0).stop 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.067+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 msgr2=0x7f52c8108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.067+0000 7f52cd36f700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 0x7f52c8108080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f52b8013470 tx=0x7f52b8009cb0).stop 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.067+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 shutdown_connections 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.067+0000 7f52cd36f700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b0061180 0x7f52b0063640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.067+0000 7f52cd36f700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52c80617e0 0x7f52c8108080 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.067+0000 7f52cd36f700 1 --2- 172.21.15.152:0/1689393986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52c80fab00 0x7f52c8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.067+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 >> 172.21.15.152:0/1689393986 conn(0x7f52c80f2020 msgr2=0x7f52c80f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.068+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 shutdown_connections 2024-04-06T12:19:21.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:21.068+0000 7f52cd36f700 1 -- 172.21.15.152:0/1689393986 wait complete. 2024-04-06T12:19:21.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:21.067109+0000 mon.smithi152 (mon.0) 495 : audit [DBG] from='client.? 172.21.15.152:0/1689393986' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-06T12:19:22.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:21.067109+0000 mon.smithi152 (mon.0) 495 : audit [DBG] from='client.? 172.21.15.152:0/1689393986' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-06T12:19:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:21.533556+0000 mgr.smithi152.lynahm (mgr.14196) 170 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:21.533556+0000 mgr.smithi152.lynahm (mgr.14196) 170 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:23.797 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953485 got 137438953488 for osd.4 2024-04-06T12:19:23.797 DEBUG:teuthology.parallel:result is None 2024-04-06T12:19:23.932 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:23.960 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378651 for osd.2 2024-04-06T12:19:23.961 DEBUG:teuthology.parallel:result is None 2024-04-06T12:19:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:23.533969+0000 mgr.smithi152.lynahm (mgr.14196) 171 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:25.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:23.533969+0000 mgr.smithi152.lynahm (mgr.14196) 171 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:25.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.740+0000 7f3125a4a700 1 -- 172.21.15.152:0/1019529187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 msgr2=0x7f31200f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:25.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.740+0000 7f3125a4a700 1 --2- 172.21.15.152:0/1019529187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 0x7f31200f7fa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f31100047f0 tx=0x7f3110009cb0).stop 2024-04-06T12:19:25.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.740+0000 7f3125a4a700 1 -- 172.21.15.152:0/1019529187 shutdown_connections 2024-04-06T12:19:25.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.740+0000 7f3125a4a700 1 --2- 172.21.15.152:0/1019529187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 0x7f31200f7fa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:25.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.740+0000 7f3125a4a700 1 --2- 172.21.15.152:0/1019529187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31200f68a0 0x7f31200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:25.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.740+0000 7f3125a4a700 1 -- 172.21.15.152:0/1019529187 >> 172.21.15.152:0/1019529187 conn(0x7f31200f2020 msgr2=0x7f31200f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.741+0000 7f3125a4a700 1 -- 172.21.15.152:0/1019529187 shutdown_connections 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.741+0000 7f3125a4a700 1 -- 172.21.15.152:0/1019529187 wait complete. 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.741+0000 7f3125a4a700 1 Processor -- start 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.741+0000 7f3125a4a700 1 -- start start 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.741+0000 7f3125a4a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31200f68a0 0x7f31200fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.741+0000 7f3125a4a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 0x7f31200f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.741+0000 7f3125a4a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31200fadd0 con 0x7f31200f7b40 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.741+0000 7f3125a4a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31200f9370 con 0x7f31200f68a0 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.741+0000 7f311e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 0x7f31200f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f311e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 0x7f31200f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53110/0 (socket says 172.21.15.152:53110) 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f311e7fc700 1 -- 172.21.15.152:0/160567274 learned_addr learned my addr 172.21.15.152:0/160567274 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f311effd700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31200f68a0 0x7f31200fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f311e7fc700 1 -- 172.21.15.152:0/160567274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31200f68a0 msgr2=0x7f31200fa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:25.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f311e7fc700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31200f68a0 0x7f31200fa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f311e7fc700 1 -- 172.21.15.152:0/160567274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3110005040 con 0x7f31200f7b40 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f311effd700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31200f68a0 0x7f31200fa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f311e7fc700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 0x7f31200f8e80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f3110013510 tx=0x7f3110009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f3117fff700 1 -- 172.21.15.152:0/160567274 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f311000e030 con 0x7f31200f7b40 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f3117fff700 1 -- 172.21.15.152:0/160567274 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3110007e90 con 0x7f31200f7b40 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f3117fff700 1 -- 172.21.15.152:0/160567274 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3110018070 con 0x7f31200f7b40 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31200f9590 con 0x7f31200f7b40 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.742+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31200f9a70 con 0x7f31200f7b40 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.743+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31200f9ce0 con 0x7f31200f7b40 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.743+0000 7f3117fff700 1 -- 172.21.15.152:0/160567274 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f311001da20 con 0x7f31200f7b40 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.744+0000 7f3117fff700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f310c061180 0x7f310c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.744+0000 7f3117fff700 1 -- 172.21.15.152:0/160567274 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f311007da80 con 0x7f31200f7b40 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.744+0000 7f311effd700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f310c061180 0x7f310c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:25.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.744+0000 7f311effd700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f310c061180 0x7f310c063640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f31200f79a0 tx=0x7f3108009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:25.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.748+0000 7f3117fff700 1 -- 172.21.15.152:0/160567274 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3110051dd0 con 0x7f31200f7b40 2024-04-06T12:19:25.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.916+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f31201106d0 con 0x7f31200f7b40 2024-04-06T12:19:25.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.917+0000 7f3117fff700 1 -- 172.21.15.152:0/160567274 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31100519c0 con 0x7f31200f7b40 2024-04-06T12:19:25.915 INFO:teuthology.orchestra.run.smithi152.stdout:158913789965 2024-04-06T12:19:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f310c061180 msgr2=0x7f310c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f310c061180 0x7f310c063640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f31200f79a0 tx=0x7f3108009040).stop 2024-04-06T12:19:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 msgr2=0x7f31200f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 0x7f31200f8e80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f3110013510 tx=0x7f3110009cb0).stop 2024-04-06T12:19:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 shutdown_connections 2024-04-06T12:19:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f310c061180 0x7f310c063640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31200f68a0 0x7f31200fa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 --2- 172.21.15.152:0/160567274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31200f7b40 0x7f31200f8e80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:25.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 >> 172.21.15.152:0/160567274 conn(0x7f31200f2020 msgr2=0x7f3120061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:25.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 shutdown_connections 2024-04-06T12:19:25.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.919+0000 7f3125a4a700 1 -- 172.21.15.152:0/160567274 wait complete. 2024-04-06T12:19:26.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.965+0000 7ff4800cf700 1 -- 172.21.15.152:0/2688244663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f68a0 msgr2=0x7ff4780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:26.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.965+0000 7ff4800cf700 1 --2- 172.21.15.152:0/2688244663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f68a0 0x7ff4780f6cc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7ff468004730 tx=0x7ff468009cb0).stop 2024-04-06T12:19:26.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.965+0000 7ff4800cf700 1 -- 172.21.15.152:0/2688244663 shutdown_connections 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.965+0000 7ff4800cf700 1 --2- 172.21.15.152:0/2688244663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4780f7b40 0x7ff4780f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.965+0000 7ff4800cf700 1 --2- 172.21.15.152:0/2688244663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f68a0 0x7ff4780f6cc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.965+0000 7ff4800cf700 1 -- 172.21.15.152:0/2688244663 >> 172.21.15.152:0/2688244663 conn(0x7ff4780f2020 msgr2=0x7ff4780f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.965+0000 7ff4800cf700 1 -- 172.21.15.152:0/2688244663 shutdown_connections 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.965+0000 7ff4800cf700 1 -- 172.21.15.152:0/2688244663 wait complete. 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff4800cf700 1 Processor -- start 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff4800cf700 1 -- start start 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff4800cf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4780f68a0 0x7ff478108140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff4800cf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f7b40 0x7ff478108630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff4800cf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478108be0 con 0x7ff4780f7b40 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff4800cf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478108d20 con 0x7ff4780f68a0 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff47d66a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f7b40 0x7ff478108630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff47d66a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f7b40 0x7ff478108630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53140/0 (socket says 172.21.15.152:53140) 2024-04-06T12:19:26.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff47d66a700 1 -- 172.21.15.152:0/363226022 learned_addr learned my addr 172.21.15.152:0/363226022 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.966+0000 7ff47de6b700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4780f68a0 0x7ff478108140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.967+0000 7ff47d66a700 1 -- 172.21.15.152:0/363226022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4780f68a0 msgr2=0x7ff478108140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.967+0000 7ff47d66a700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4780f68a0 0x7ff478108140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.967+0000 7ff47d66a700 1 -- 172.21.15.152:0/363226022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474005040 con 0x7ff4780f7b40 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.967+0000 7ff47d66a700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f7b40 0x7ff478108630 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7ff474009380 tx=0x7ff474009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.967+0000 7ff46effd700 1 -- 172.21.15.152:0/363226022 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47400e560 con 0x7ff4780f7b40 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.967+0000 7ff46effd700 1 -- 172.21.15.152:0/363226022 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff47400f040 con 0x7ff4780f7b40 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.967+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff468005040 con 0x7ff4780f7b40 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.967+0000 7ff46effd700 1 -- 172.21.15.152:0/363226022 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff474014a70 con 0x7ff4780f7b40 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.967+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47810dbf0 con 0x7ff4780f7b40 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.968+0000 7ff46effd700 1 -- 172.21.15.152:0/363226022 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7ff474014ca0 con 0x7ff4780f7b40 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.968+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4780feff0 con 0x7ff4780f7b40 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.968+0000 7ff46effd700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff464061180 0x7ff464063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:26.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.969+0000 7ff46effd700 1 -- 172.21.15.152:0/363226022 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7ff47407bf40 con 0x7ff4780f7b40 2024-04-06T12:19:26.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.969+0000 7ff47de6b700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff464061180 0x7ff464063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:26.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.969+0000 7ff47de6b700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff464061180 0x7ff464063640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff4680133e0 tx=0x7ff468016040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:26.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:25.973+0000 7ff46effd700 1 -- 172.21.15.152:0/363226022 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff474049f60 con 0x7ff4780f7b40 2024-04-06T12:19:26.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.140+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4780ff180 con 0x7ff4780f7b40 2024-04-06T12:19:26.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.141+0000 7ff46effd700 1 -- 172.21.15.152:0/363226022 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4780ff180 con 0x7ff4780f7b40 2024-04-06T12:19:26.139 INFO:teuthology.orchestra.run.smithi152.stdout:60129542178 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff464061180 msgr2=0x7ff464063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff464061180 0x7ff464063640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff4680133e0 tx=0x7ff468016040).stop 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f7b40 msgr2=0x7ff478108630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f7b40 0x7ff478108630 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7ff474009380 tx=0x7ff474009cb0).stop 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 shutdown_connections 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff464061180 0x7ff464063640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4780f68a0 0x7ff478108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 --2- 172.21.15.152:0/363226022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4780f7b40 0x7ff478108630 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 >> 172.21.15.152:0/363226022 conn(0x7ff4780f2020 msgr2=0x7ff478061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 shutdown_connections 2024-04-06T12:19:26.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:26.143+0000 7ff4800cf700 1 -- 172.21.15.152:0/363226022 wait complete. 2024-04-06T12:19:26.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:25.534280+0000 mgr.smithi152.lynahm (mgr.14196) 172 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:26.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:25.918192+0000 mon.smithi152 (mon.0) 496 : audit [DBG] from='client.? 172.21.15.152:0/160567274' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-06T12:19:26.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:26.142190+0000 mon.smithi152 (mon.0) 497 : audit [DBG] from='client.? 172.21.15.152:0/363226022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-06T12:19:26.967 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542178 for osd.1 2024-04-06T12:19:26.968 DEBUG:teuthology.parallel:result is None 2024-04-06T12:19:27.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:25.534280+0000 mgr.smithi152.lynahm (mgr.14196) 172 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:27.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:25.918192+0000 mon.smithi152 (mon.0) 496 : audit [DBG] from='client.? 172.21.15.152:0/160567274' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-06T12:19:27.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:26.142190+0000 mon.smithi152 (mon.0) 497 : audit [DBG] from='client.? 172.21.15.152:0/363226022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-06T12:19:27.579 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789961 got 158913789965 for osd.5 2024-04-06T12:19:27.579 DEBUG:teuthology.parallel:result is None 2024-04-06T12:19:28.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.406+0000 7f9eac8da700 1 -- 172.21.15.152:0/1849258679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f8c40 msgr2=0x7f9ea80f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:28.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.406+0000 7f9eac8da700 1 --2- 172.21.15.152:0/1849258679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f8c40 0x7f9ea80f90a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f9e980047f0 tx=0x7f9e98009cb0).stop 2024-04-06T12:19:28.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.406+0000 7f9eac8da700 1 -- 172.21.15.152:0/1849258679 shutdown_connections 2024-04-06T12:19:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.406+0000 7f9eac8da700 1 --2- 172.21.15.152:0/1849258679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f8c40 0x7f9ea80f90a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.406+0000 7f9eac8da700 1 --2- 172.21.15.152:0/1849258679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea80f79a0 0x7f9ea80f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.406+0000 7f9eac8da700 1 -- 172.21.15.152:0/1849258679 >> 172.21.15.152:0/1849258679 conn(0x7f9ea80f3100 msgr2=0x7f9ea80f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.406+0000 7f9eac8da700 1 -- 172.21.15.152:0/1849258679 shutdown_connections 2024-04-06T12:19:28.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.406+0000 7f9eac8da700 1 -- 172.21.15.152:0/1849258679 wait complete. 2024-04-06T12:19:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9eac8da700 1 Processor -- start 2024-04-06T12:19:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9eac8da700 1 -- start start 2024-04-06T12:19:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9eac8da700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f79a0 0x7f9ea8108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9eac8da700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea80f8c40 0x7f9ea8108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9eac8da700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8108b20 con 0x7f9ea80f79a0 2024-04-06T12:19:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9eac8da700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8108c60 con 0x7f9ea80f8c40 2024-04-06T12:19:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9ea659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f79a0 0x7f9ea8108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9ea659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f79a0 0x7f9ea8108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53160/0 (socket says 172.21.15.152:53160) 2024-04-06T12:19:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9ea659c700 1 -- 172.21.15.152:0/1505258398 learned_addr learned my addr 172.21.15.152:0/1505258398 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9ea5d9b700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea80f8c40 0x7f9ea8108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9ea659c700 1 -- 172.21.15.152:0/1505258398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea80f8c40 msgr2=0x7f9ea8108570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9ea659c700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea80f8c40 0x7f9ea8108570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9ea659c700 1 -- 172.21.15.152:0/1505258398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98005040 con 0x7f9ea80f79a0 2024-04-06T12:19:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9ea5d9b700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea80f8c40 0x7f9ea8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:19:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9ea659c700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f79a0 0x7f9ea8108080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f9e9c002780 tx=0x7f9e9c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9e977fe700 1 -- 172.21.15.152:0/1505258398 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e9c007b40 con 0x7f9ea80f79a0 2024-04-06T12:19:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9e977fe700 1 -- 172.21.15.152:0/1505258398 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9e9c00f040 con 0x7f9ea80f79a0 2024-04-06T12:19:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea810d700 con 0x7f9ea80f79a0 2024-04-06T12:19:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9e977fe700 1 -- 172.21.15.152:0/1505258398 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e9c0146f0 con 0x7f9ea80f79a0 2024-04-06T12:19:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.407+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea810dc40 con 0x7f9ea80f79a0 2024-04-06T12:19:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.408+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea8100110 con 0x7f9ea80f79a0 2024-04-06T12:19:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.409+0000 7f9e977fe700 1 -- 172.21.15.152:0/1505258398 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f9e9c007ca0 con 0x7f9ea80f79a0 2024-04-06T12:19:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.409+0000 7f9e977fe700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9e90061180 0x7f9e90063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.410+0000 7f9e977fe700 1 -- 172.21.15.152:0/1505258398 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f9e9c07c880 con 0x7f9ea80f79a0 2024-04-06T12:19:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.410+0000 7f9ea5d9b700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9e90061180 0x7f9e90063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.410+0000 7f9ea5d9b700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9e90061180 0x7f9e90063640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9e98013470 tx=0x7f9e9800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:28.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.413+0000 7f9e977fe700 1 -- 172.21.15.152:0/1505258398 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9e9c050bd0 con 0x7f9ea80f79a0 2024-04-06T12:19:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.577+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ea8101f80 con 0x7f9ea80f79a0 2024-04-06T12:19:28.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.577+0000 7f9e977fe700 1 -- 172.21.15.152:0/1505258398 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e9c0507c0 con 0x7f9ea80f79a0 2024-04-06T12:19:28.575 INFO:teuthology.orchestra.run.smithi152.stdout:38654705705 2024-04-06T12:19:28.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9e90061180 msgr2=0x7f9e90063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:28.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9e90061180 0x7f9e90063640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9e98013470 tx=0x7f9e9800b040).stop 2024-04-06T12:19:28.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f79a0 msgr2=0x7f9ea8108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:28.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f79a0 0x7f9ea8108080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f9e9c002780 tx=0x7f9e9c009ee0).stop 2024-04-06T12:19:28.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 shutdown_connections 2024-04-06T12:19:28.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9e90061180 0x7f9e90063640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:28.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ea80f79a0 0x7f9ea8108080 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:28.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 --2- 172.21.15.152:0/1505258398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea80f8c40 0x7f9ea8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:28.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 >> 172.21.15.152:0/1505258398 conn(0x7f9ea80f3100 msgr2=0x7f9ea80fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:28.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 shutdown_connections 2024-04-06T12:19:28.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:28.579+0000 7f9eac8da700 1 -- 172.21.15.152:0/1505258398 wait complete. 2024-04-06T12:19:28.936 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:27.534693+0000 mgr.smithi152.lynahm (mgr.14196) 173 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:28.936 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:28.578344+0000 mon.smithi152 (mon.0) 498 : audit [DBG] from='client.? 172.21.15.152:0/1505258398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-06T12:19:29.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:27.534693+0000 mgr.smithi152.lynahm (mgr.14196) 173 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:29.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:28.578344+0000 mon.smithi152 (mon.0) 498 : audit [DBG] from='client.? 172.21.15.152:0/1505258398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-06T12:19:29.370 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705703 got 38654705705 for osd.0 2024-04-06T12:19:29.370 DEBUG:teuthology.parallel:result is None 2024-04-06T12:19:29.370 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-06T12:19:29.370 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-06T12:19:29.638 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:30.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:29.534997+0000 mgr.smithi152.lynahm (mgr.14196) 174 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:31.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:29.534997+0000 mgr.smithi152.lynahm (mgr.14196) 174 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.452+0000 7f4e35e2e700 1 -- 172.21.15.152:0/2586320610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e300f8c40 msgr2=0x7f4e300f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.452+0000 7f4e35e2e700 1 --2- 172.21.15.152:0/2586320610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e300f8c40 0x7f4e300f90a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4e180047f0 tx=0x7f4e18009cb0).stop 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.452+0000 7f4e35e2e700 1 -- 172.21.15.152:0/2586320610 shutdown_connections 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.452+0000 7f4e35e2e700 1 --2- 172.21.15.152:0/2586320610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e300f8c40 0x7f4e300f90a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.452+0000 7f4e35e2e700 1 --2- 172.21.15.152:0/2586320610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e300f79a0 0x7f4e300f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.452+0000 7f4e35e2e700 1 -- 172.21.15.152:0/2586320610 >> 172.21.15.152:0/2586320610 conn(0x7f4e300f3100 msgr2=0x7f4e300f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.452+0000 7f4e35e2e700 1 -- 172.21.15.152:0/2586320610 shutdown_connections 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.452+0000 7f4e35e2e700 1 -- 172.21.15.152:0/2586320610 wait complete. 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.453+0000 7f4e35e2e700 1 Processor -- start 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.453+0000 7f4e35e2e700 1 -- start start 2024-04-06T12:19:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.453+0000 7f4e35e2e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e300f79a0 0x7f4e30108180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.453+0000 7f4e35e2e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e300f8c40 0x7f4e30108670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.453+0000 7f4e35e2e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30108c20 con 0x7f4e300f8c40 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.453+0000 7f4e35e2e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30108d60 con 0x7f4e300f79a0 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.453+0000 7f4e2effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e300f8c40 0x7f4e30108670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.453+0000 7f4e2effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e300f8c40 0x7f4e30108670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53184/0 (socket says 172.21.15.152:53184) 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.453+0000 7f4e2effd700 1 -- 172.21.15.152:0/478454957 learned_addr learned my addr 172.21.15.152:0/478454957 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e2f7fe700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e300f79a0 0x7f4e30108180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e2effd700 1 -- 172.21.15.152:0/478454957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e300f79a0 msgr2=0x7f4e30108180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e2effd700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e300f79a0 0x7f4e30108180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e2effd700 1 -- 172.21.15.152:0/478454957 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18005040 con 0x7f4e300f8c40 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e2f7fe700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e300f79a0 0x7f4e30108180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e2effd700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e300f8c40 0x7f4e30108670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4e18013580 tx=0x7f4e18009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e2cff9700 1 -- 172.21.15.152:0/478454957 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e18018070 con 0x7f4e300f8c40 2024-04-06T12:19:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e2cff9700 1 -- 172.21.15.152:0/478454957 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4e18007e90 con 0x7f4e300f8c40 2024-04-06T12:19:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3010d7a0 con 0x7f4e300f8c40 2024-04-06T12:19:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e2cff9700 1 -- 172.21.15.152:0/478454957 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e180123c0 con 0x7f4e300f8c40 2024-04-06T12:19:31.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.454+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3010dd60 con 0x7f4e300f8c40 2024-04-06T12:19:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.455+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e301000f0 con 0x7f4e300f8c40 2024-04-06T12:19:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.455+0000 7f4e2cff9700 1 -- 172.21.15.152:0/478454957 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f4e1801d420 con 0x7f4e300f8c40 2024-04-06T12:19:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.456+0000 7f4e2cff9700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4e1c061180 0x7f4e1c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.456+0000 7f4e2cff9700 1 -- 172.21.15.152:0/478454957 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f4e1807d1d0 con 0x7f4e300f8c40 2024-04-06T12:19:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.456+0000 7f4e2f7fe700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4e1c061180 0x7f4e1c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.456+0000 7f4e2f7fe700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4e1c061180 0x7f4e1c063640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4e20007fd0 tx=0x7f4e2000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.460+0000 7f4e2cff9700 1 -- 172.21.15.152:0/478454957 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4e180514a0 con 0x7f4e300f8c40 2024-04-06T12:19:31.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.620+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e30059120 con 0x7f4e1c061180 2024-04-06T12:19:31.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.621+0000 7f4e2cff9700 1 -- 172.21.15.152:0/478454957 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27818 (secure 0 0 0) 0x7f4e30059120 con 0x7f4e1c061180 2024-04-06T12:19:31.620 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:19:31.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4e1c061180 msgr2=0x7f4e1c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:31.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4e1c061180 0x7f4e1c063640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4e20007fd0 tx=0x7f4e2000b040).stop 2024-04-06T12:19:31.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e300f8c40 msgr2=0x7f4e30108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:31.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e300f8c40 0x7f4e30108670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4e18013580 tx=0x7f4e18009cb0).stop 2024-04-06T12:19:31.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 shutdown_connections 2024-04-06T12:19:31.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4e1c061180 0x7f4e1c063640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:31.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e300f79a0 0x7f4e30108180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:31.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 --2- 172.21.15.152:0/478454957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e300f8c40 0x7f4e30108670 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:31.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 >> 172.21.15.152:0/478454957 conn(0x7f4e300f3100 msgr2=0x7f4e300fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:31.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 shutdown_connections 2024-04-06T12:19:31.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:31.623+0000 7f4e35e2e700 1 -- 172.21.15.152:0/478454957 wait complete. 2024-04-06T12:19:31.622 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-06T12:19:32.426 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-04-06T12:19:31.535165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1784564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":1782528,"kb_avail":560686348,"statfs":{"total":575970213888,"available":574142820352,"internally_reserved":0,"allocated":2035712,"data_stored":761538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1825308672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-06T12:18:36.065993+0000","last_change":"2024-04-06T12:18:12.116320+0000","last_active":"2024-04-06T12:18:36.065993+0000","last_peered":"2024-04-06T12:18:36.065993+0000","last_clean":"2024-04-06T12:18:36.065993+0000","last_became_active":"2024-04-06T12:18:12.115882+0000","last_became_peered":"2024-04-06T12:18:12.115882+0000","last_unstale":"2024-04-06T12:18:36.065993+0000","last_undegraded":"2024-04-06T12:18:36.065993+0000","last_fullsized":"2024-04-06T12:18:36.065993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T12:17:22.572523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T12:17:22.572523+0000","last_clean_scrub_stamp":"2024-04-06T12:17:22.572523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.495},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 6 12:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53200000000000003}]},{"osd":1,"last update":"Sat Apr 6 12:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Apr 6 12:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Apr 6 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447728,"statfs":{"total":95995035648,"available":95690473472,"internally_reserved":0,"allocated":335872,"data_stored":126358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 6 12:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Apr 6 12:18:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Apr 6 12:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 6 12:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.31900000000000001,"15min":0.311},"min":{"1min":0.28000000000000003,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.496,"5min":0.502,"15min":0.502},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.33000000000000002},"min":{"1min":0.246,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.31}]},{"osd":2,"last update":"Sat Apr 6 12:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.371},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.39100000000000001,"15min":0.39500000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.48699999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.27800000000000002}]},{"osd":3,"last update":"Sat Apr 6 12:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Apr 6 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 6 12:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33300000000000002,"15min":0.33000000000000002},"min":{"1min":0.23799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.49099999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.55700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Apr 6 12:18:25 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.61199999999999999}]},{"osd":3,"last update":"Sat Apr 6 12:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.80800000000000005}]},{"osd":4,"last update":"Sat Apr 6 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-06T12:19:32.427 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-06T12:19:32.694 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:32.952 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:31.535332+0000 mgr.smithi152.lynahm (mgr.14196) 175 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:32.952 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:31.621352+0000 mgr.smithi152.lynahm (mgr.14196) 176 : audit [DBG] from='client.14390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T12:19:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:31.535332+0000 mgr.smithi152.lynahm (mgr.14196) 175 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:31.621352+0000 mgr.smithi152.lynahm (mgr.14196) 176 : audit [DBG] from='client.14390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T12:19:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.420+0000 7fbe78e88700 1 -- 172.21.15.152:0/1522687466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 msgr2=0x7fbe740f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.420+0000 7fbe78e88700 1 --2- 172.21.15.152:0/1522687466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 0x7fbe740f6cc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fbe640047f0 tx=0x7fbe64009cb0).stop 2024-04-06T12:19:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.420+0000 7fbe78e88700 1 -- 172.21.15.152:0/1522687466 shutdown_connections 2024-04-06T12:19:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.420+0000 7fbe78e88700 1 --2- 172.21.15.152:0/1522687466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe740f7b40 0x7fbe740f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.420+0000 7fbe78e88700 1 --2- 172.21.15.152:0/1522687466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 0x7fbe740f6cc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.420+0000 7fbe78e88700 1 -- 172.21.15.152:0/1522687466 >> 172.21.15.152:0/1522687466 conn(0x7fbe740f2020 msgr2=0x7fbe740f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.420+0000 7fbe78e88700 1 -- 172.21.15.152:0/1522687466 shutdown_connections 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.420+0000 7fbe78e88700 1 -- 172.21.15.152:0/1522687466 wait complete. 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.421+0000 7fbe78e88700 1 Processor -- start 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.421+0000 7fbe78e88700 1 -- start start 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.421+0000 7fbe78e88700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 0x7fbe740fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.421+0000 7fbe78e88700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe740f7b40 0x7fbe740f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.421+0000 7fbe78e88700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740fadd0 con 0x7fbe740f68a0 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.421+0000 7fbe78e88700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740f9370 con 0x7fbe740f7b40 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.421+0000 7fbe7259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 0x7fbe740fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.421+0000 7fbe7259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 0x7fbe740fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60082/0 (socket says 172.21.15.152:60082) 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.421+0000 7fbe7259c700 1 -- 172.21.15.152:0/2228250854 learned_addr learned my addr 172.21.15.152:0/2228250854 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe71d9b700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe740f7b40 0x7fbe740f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe7259c700 1 -- 172.21.15.152:0/2228250854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe740f7b40 msgr2=0x7fbe740f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe7259c700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe740f7b40 0x7fbe740f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe7259c700 1 -- 172.21.15.152:0/2228250854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64005040 con 0x7fbe740f68a0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe71d9b700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe740f7b40 0x7fbe740f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe7259c700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 0x7fbe740fa820 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fbe64004f10 tx=0x7fbe64009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe637fe700 1 -- 172.21.15.152:0/2228250854 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe6400e070 con 0x7fbe740f68a0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe637fe700 1 -- 172.21.15.152:0/2228250854 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbe64007e90 con 0x7fbe740f68a0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe637fe700 1 -- 172.21.15.152:0/2228250854 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe64018070 con 0x7fbe740f68a0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe740f9590 con 0x7fbe740f68a0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.422+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe740f9a20 con 0x7fbe740f68a0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.423+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe740f9c90 con 0x7fbe740f68a0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.423+0000 7fbe637fe700 1 -- 172.21.15.152:0/2228250854 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fbe640123c0 con 0x7fbe740f68a0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.424+0000 7fbe637fe700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbe5c061180 0x7fbe5c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.424+0000 7fbe71d9b700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbe5c061180 0x7fbe5c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.424+0000 7fbe637fe700 1 -- 172.21.15.152:0/2228250854 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fbe6407d430 con 0x7fbe740f68a0 2024-04-06T12:19:34.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.424+0000 7fbe71d9b700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbe5c061180 0x7fbe5c063640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbe68004ca0 tx=0x7fbe6800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:34.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.428+0000 7fbe637fe700 1 -- 172.21.15.152:0/2228250854 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbe64051700 con 0x7fbe740f68a0 2024-04-06T12:19:34.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.588+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe740fbf80 con 0x7fbe5c061180 2024-04-06T12:19:34.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.589+0000 7fbe637fe700 1 -- 172.21.15.152:0/2228250854 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27845 (secure 0 0 0) 0x7fbe740fbf80 con 0x7fbe5c061180 2024-04-06T12:19:34.587 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:19:34.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbe5c061180 msgr2=0x7fbe5c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:34.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbe5c061180 0x7fbe5c063640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbe68004ca0 tx=0x7fbe6800b040).stop 2024-04-06T12:19:34.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 msgr2=0x7fbe740fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:34.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 0x7fbe740fa820 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fbe64004f10 tx=0x7fbe64009cb0).stop 2024-04-06T12:19:34.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 shutdown_connections 2024-04-06T12:19:34.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbe5c061180 0x7fbe5c063640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:34.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe740f68a0 0x7fbe740fa820 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:34.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 --2- 172.21.15.152:0/2228250854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe740f7b40 0x7fbe740f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:34.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 >> 172.21.15.152:0/2228250854 conn(0x7fbe740f2020 msgr2=0x7fbe74061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:34.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 shutdown_connections 2024-04-06T12:19:34.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:34.591+0000 7fbe78e88700 1 -- 172.21.15.152:0/2228250854 wait complete. 2024-04-06T12:19:34.590 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-06T12:19:35.004 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:33.535844+0000 mgr.smithi152.lynahm (mgr.14196) 177 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:33.535844+0000 mgr.smithi152.lynahm (mgr.14196) 177 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:35.405 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-04-06T12:19:33.535602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1784564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":1782528,"kb_avail":560686348,"statfs":{"total":575970213888,"available":574142820352,"internally_reserved":0,"allocated":2035712,"data_stored":761538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1825308672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-06T12:18:36.065993+0000","last_change":"2024-04-06T12:18:12.116320+0000","last_active":"2024-04-06T12:18:36.065993+0000","last_peered":"2024-04-06T12:18:36.065993+0000","last_clean":"2024-04-06T12:18:36.065993+0000","last_became_active":"2024-04-06T12:18:12.115882+0000","last_became_peered":"2024-04-06T12:18:12.115882+0000","last_unstale":"2024-04-06T12:18:36.065993+0000","last_undegraded":"2024-04-06T12:18:36.065993+0000","last_fullsized":"2024-04-06T12:18:36.065993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-06T12:17:22.572523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-06T12:17:22.572523+0000","last_clean_scrub_stamp":"2024-04-06T12:17:22.572523+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":4,"up_from":32,"seq":137438953491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.495},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 6 12:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53200000000000003}]},{"osd":1,"last update":"Sat Apr 6 12:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Apr 6 12:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Apr 6 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447728,"statfs":{"total":95995035648,"available":95690473472,"internally_reserved":0,"allocated":335872,"data_stored":126358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 6 12:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36799999999999999,"15min":0.374},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.505,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48999999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.23100000000000001}]},{"osd":1,"last update":"Sat Apr 6 12:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.249},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38700000000000001,"15min":0.39200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.28199999999999997}]},{"osd":3,"last update":"Sat Apr 6 12:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46100000000000002}]},{"osd":4,"last update":"Sat Apr 6 12:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 6 12:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.31900000000000001,"15min":0.311},"min":{"1min":0.28000000000000003,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.496,"5min":0.502,"15min":0.502},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.33000000000000002},"min":{"1min":0.246,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.31}]},{"osd":2,"last update":"Sat Apr 6 12:19:26 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.371},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.39100000000000001,"15min":0.39500000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.48699999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.27800000000000002}]},{"osd":3,"last update":"Sat Apr 6 12:18:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Apr 6 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 6 12:18:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33300000000000002,"15min":0.33000000000000002},"min":{"1min":0.23799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.49099999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.23000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.55700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.25800000000000001}]},{"osd":2,"last update":"Sat Apr 6 12:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.374,"15min":0.379},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.31},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.25800000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.32300000000000001}]},{"osd":3,"last update":"Sat Apr 6 12:18:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.441},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Apr 6 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-06T12:19:35.406 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-06T12:19:35.406 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-06T12:19:35.406 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-06T12:19:35.406 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph health --format=json 2024-04-06T12:19:35.676 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:19:35.939 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:34.589393+0000 mgr.smithi152.lynahm (mgr.14196) 178 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T12:19:36.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:34.589393+0000 mgr.smithi152.lynahm (mgr.14196) 178 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-06T12:19:36.957 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:35.536197+0000 mgr.smithi152.lynahm (mgr.14196) 179 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:37.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:35.536197+0000 mgr.smithi152.lynahm (mgr.14196) 179 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:37.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.487+0000 7f3e9f41b700 1 -- 172.21.15.152:0/3744722236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f7b40 msgr2=0x7f3e980f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:37.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.487+0000 7f3e9f41b700 1 --2- 172.21.15.152:0/3744722236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f7b40 0x7f3e980f7fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f3e8c0047f0 tx=0x7f3e8c009cb0).stop 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.487+0000 7f3e9f41b700 1 -- 172.21.15.152:0/3744722236 shutdown_connections 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.487+0000 7f3e9f41b700 1 --2- 172.21.15.152:0/3744722236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f7b40 0x7f3e980f7fa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.487+0000 7f3e9f41b700 1 --2- 172.21.15.152:0/3744722236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e980f68a0 0x7f3e980f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.487+0000 7f3e9f41b700 1 -- 172.21.15.152:0/3744722236 >> 172.21.15.152:0/3744722236 conn(0x7f3e980f2020 msgr2=0x7f3e980f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.487+0000 7f3e9f41b700 1 -- 172.21.15.152:0/3744722236 shutdown_connections 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.487+0000 7f3e9f41b700 1 -- 172.21.15.152:0/3744722236 wait complete. 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.488+0000 7f3e9f41b700 1 Processor -- start 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.488+0000 7f3e9f41b700 1 -- start start 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.488+0000 7f3e9f41b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f68a0 0x7f3e980fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.488+0000 7f3e9f41b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e980f7b40 0x7f3e980f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:37.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.488+0000 7f3e9f41b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980fadd0 con 0x7f3e980f68a0 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.488+0000 7f3e9f41b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980f9370 con 0x7f3e980f7b40 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.488+0000 7f3e9d1b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f68a0 0x7f3e980fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.488+0000 7f3e9d1b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f68a0 0x7f3e980fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60104/0 (socket says 172.21.15.152:60104) 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.488+0000 7f3e9d1b7700 1 -- 172.21.15.152:0/54471742 learned_addr learned my addr 172.21.15.152:0/54471742 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e9c9b6700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e980f7b40 0x7f3e980f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e9d1b7700 1 -- 172.21.15.152:0/54471742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e980f7b40 msgr2=0x7f3e980f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e9d1b7700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e980f7b40 0x7f3e980f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e9d1b7700 1 -- 172.21.15.152:0/54471742 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c005040 con 0x7f3e980f68a0 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e9d1b7700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f68a0 0x7f3e980fa820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f3e9400c790 tx=0x7f3e94007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e8a7fc700 1 -- 172.21.15.152:0/54471742 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e9400e680 con 0x7f3e980f68a0 2024-04-06T12:19:37.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e8a7fc700 1 -- 172.21.15.152:0/54471742 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3e9400ec70 con 0x7f3e980f68a0 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e980f95f0 con 0x7f3e980f68a0 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e8a7fc700 1 -- 172.21.15.152:0/54471742 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e94013db0 con 0x7f3e980f68a0 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.489+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e980f9b30 con 0x7f3e980f68a0 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.490+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e98047540 con 0x7f3e980f68a0 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.490+0000 7f3e8a7fc700 1 -- 172.21.15.152:0/54471742 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f3e9400e7e0 con 0x7f3e980f68a0 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.490+0000 7f3e8a7fc700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3e84061180 0x7f3e84063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.490+0000 7f3e8a7fc700 1 -- 172.21.15.152:0/54471742 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f3e9407c7b0 con 0x7f3e980f68a0 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.490+0000 7f3e9c9b6700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3e84061180 0x7f3e84063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.491+0000 7f3e9c9b6700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3e84061180 0x7f3e84063640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3e8c004f10 tx=0x7f3e8c00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:37.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.495+0000 7f3e8a7fc700 1 -- 172.21.15.152:0/54471742 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3e94050a80 con 0x7f3e980f68a0 2024-04-06T12:19:37.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.698+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3e980feff0 con 0x7f3e980f68a0 2024-04-06T12:19:37.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.698+0000 7f3e8a7fc700 1 -- 172.21.15.152:0/54471742 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f3e94050670 con 0x7f3e980f68a0 2024-04-06T12:19:37.696 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:19:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3e84061180 msgr2=0x7f3e84063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3e84061180 0x7f3e84063640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3e8c004f10 tx=0x7f3e8c00b040).stop 2024-04-06T12:19:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f68a0 msgr2=0x7f3e980fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:37.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f68a0 0x7f3e980fa820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f3e9400c790 tx=0x7f3e94007f10).stop 2024-04-06T12:19:37.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 shutdown_connections 2024-04-06T12:19:37.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3e84061180 0x7f3e84063640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:37.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e980f68a0 0x7f3e980fa820 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:37.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 --2- 172.21.15.152:0/54471742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e980f7b40 0x7f3e980f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:37.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 >> 172.21.15.152:0/54471742 conn(0x7f3e980f2020 msgr2=0x7f3e98061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:37.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 shutdown_connections 2024-04-06T12:19:37.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:37.700+0000 7f3e9f41b700 1 -- 172.21.15.152:0/54471742 wait complete. 2024-04-06T12:19:38.644 INFO:teuthology.orchestra.run.smithi152.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-06T12:19:38.644 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-06T12:19:38.645 INFO:tasks.cephadm:Setup complete, yielding 2024-04-06T12:19:38.645 INFO:teuthology.run_tasks:Running task print... 2024-04-06T12:19:38.661 INFO:teuthology.task.print:**** done end installing pacific cephadm ... 2024-04-06T12:19:38.662 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-06T12:19:38.728 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:19:38.728 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-06T12:19:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:37.536496+0000 mgr.smithi152.lynahm (mgr.14196) 180 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:39.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:37.699279+0000 mon.smithi152 (mon.0) 499 : audit [DBG] from='client.? 172.21.15.152:0/54471742' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-06T12:19:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:37.536496+0000 mgr.smithi152.lynahm (mgr.14196) 180 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:39.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:37.699279+0000 mon.smithi152 (mon.0) 499 : audit [DBG] from='client.? 172.21.15.152:0/54471742' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-06T12:19:40.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:39.393155+0000 mon.smithi152 (mon.0) 500 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:19:40.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:39.393155+0000 mon.smithi152 (mon.0) 500 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:19:40.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.828+0000 7f98e9724700 1 -- 172.21.15.152:0/557562259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f66e0 msgr2=0x7f98e40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:40.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.828+0000 7f98e9724700 1 --2- 172.21.15.152:0/557562259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f66e0 0x7f98e40f6b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f98cc0047f0 tx=0x7f98cc009cb0).stop 2024-04-06T12:19:40.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.828+0000 7f98e9724700 1 -- 172.21.15.152:0/557562259 shutdown_connections 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.828+0000 7f98e9724700 1 --2- 172.21.15.152:0/557562259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e40f6ff0 0x7f98e40f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.828+0000 7f98e9724700 1 --2- 172.21.15.152:0/557562259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f66e0 0x7f98e40f6b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.828+0000 7f98e9724700 1 -- 172.21.15.152:0/557562259 >> 172.21.15.152:0/557562259 conn(0x7f98e40f1ec0 msgr2=0x7f98e40f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.828+0000 7f98e9724700 1 -- 172.21.15.152:0/557562259 shutdown_connections 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.828+0000 7f98e9724700 1 -- 172.21.15.152:0/557562259 wait complete. 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e9724700 1 Processor -- start 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e9724700 1 -- start start 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e9724700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e40f66e0 0x7f98e4106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e9724700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f6ff0 0x7f98e41073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e9724700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4107980 con 0x7f98e40f6ff0 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e9724700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4107ac0 con 0x7f98e40f66e0 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e27fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f6ff0 0x7f98e41073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e27fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f6ff0 0x7f98e41073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60126/0 (socket says 172.21.15.152:60126) 2024-04-06T12:19:40.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e27fc700 1 -- 172.21.15.152:0/3864251538 learned_addr learned my addr 172.21.15.152:0/3864251538 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e2ffd700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e40f66e0 0x7f98e4106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e27fc700 1 -- 172.21.15.152:0/3864251538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e40f66e0 msgr2=0x7f98e4106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e27fc700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e40f66e0 0x7f98e4106ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.829+0000 7f98e27fc700 1 -- 172.21.15.152:0/3864251538 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc005040 con 0x7f98e40f6ff0 2024-04-06T12:19:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.830+0000 7f98e27fc700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f6ff0 0x7f98e41073d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f98d400c790 tx=0x7f98d4004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.830+0000 7f98dbfff700 1 -- 172.21.15.152:0/3864251538 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d400e680 con 0x7f98e40f6ff0 2024-04-06T12:19:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.830+0000 7f98dbfff700 1 -- 172.21.15.152:0/3864251538 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f98d400ec70 con 0x7f98e40f6ff0 2024-04-06T12:19:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.830+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e410c560 con 0x7f98e40f6ff0 2024-04-06T12:19:40.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.830+0000 7f98dbfff700 1 -- 172.21.15.152:0/3864251538 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d4012d30 con 0x7f98e40f6ff0 2024-04-06T12:19:40.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.830+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e410caa0 con 0x7f98e40f6ff0 2024-04-06T12:19:40.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.831+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e40feee0 con 0x7f98e40f6ff0 2024-04-06T12:19:40.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.831+0000 7f98dbfff700 1 -- 172.21.15.152:0/3864251538 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f98d4012400 con 0x7f98e40f6ff0 2024-04-06T12:19:40.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.831+0000 7f98dbfff700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98d0061180 0x7f98d0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:40.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.832+0000 7f98dbfff700 1 -- 172.21.15.152:0/3864251538 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f98d407be50 con 0x7f98e40f6ff0 2024-04-06T12:19:40.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.832+0000 7f98e2ffd700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98d0061180 0x7f98d0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:40.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.832+0000 7f98e2ffd700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98d0061180 0x7f98d0063640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f98cc004f10 tx=0x7f98cc00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:40.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.836+0000 7f98dbfff700 1 -- 172.21.15.152:0/3864251538 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f98d4047f60 con 0x7f98e40f6ff0 2024-04-06T12:19:40.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:40.997+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f98e40598f0 con 0x7f98e40f6ff0 2024-04-06T12:19:40.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.001+0000 7f98dbfff700 1 -- 172.21.15.152:0/3864251538 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f98d4050120 con 0x7f98e40f6ff0 2024-04-06T12:19:41.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.003+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98d0061180 msgr2=0x7f98d0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.003+0000 7f98e9724700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98d0061180 0x7f98d0063640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f98cc004f10 tx=0x7f98cc00b040).stop 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.003+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f6ff0 msgr2=0x7f98e41073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.003+0000 7f98e9724700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f6ff0 0x7f98e41073d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f98d400c790 tx=0x7f98d4004330).stop 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.003+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 shutdown_connections 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.003+0000 7f98e9724700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f98d0061180 0x7f98d0063640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.003+0000 7f98e9724700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e40f66e0 0x7f98e4106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.003+0000 7f98e9724700 1 --2- 172.21.15.152:0/3864251538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40f6ff0 0x7f98e41073d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.003+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 >> 172.21.15.152:0/3864251538 conn(0x7f98e40f1ec0 msgr2=0x7f98e40fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.004+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 shutdown_connections 2024-04-06T12:19:41.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:41.004+0000 7f98e9724700 1 -- 172.21.15.152:0/3864251538 wait complete. 2024-04-06T12:19:41.004 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:39.536785+0000 mgr.smithi152.lynahm (mgr.14196) 181 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:41.004 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:39.773095+0000 mon.smithi152 (mon.0) 501 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:19:41.004 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:39.773742+0000 mon.smithi152 (mon.0) 502 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:19:41.004 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:39.780047+0000 mon.smithi152 (mon.0) 503 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:19:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:39.536785+0000 mgr.smithi152.lynahm (mgr.14196) 181 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:39.773095+0000 mon.smithi152 (mon.0) 501 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:19:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:39.773742+0000 mon.smithi152 (mon.0) 502 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:19:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:39.780047+0000 mon.smithi152 (mon.0) 503 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:19:41.759 INFO:teuthology.run_tasks:Running task print... 2024-04-06T12:19:41.768 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-06T12:19:41.768 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-06T12:19:41.798 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:19:41.798 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph orch status' 2024-04-06T12:19:41.999 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:41.002551+0000 mon.smithi152 (mon.0) 504 : audit [INF] from='client.? 172.21.15.152:0/3864251538' entity='client.admin' 2024-04-06T12:19:41.999 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:41.049685+0000 mon.smithi152 (mon.0) 505 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:19:41.999 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:41.051090+0000 mon.smithi152 (mon.0) 506 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:19:41.999 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:41.051677+0000 mon.smithi152 (mon.0) 507 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:19:42.000 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:41.055821+0000 mon.smithi152 (mon.0) 508 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:19:42.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:41.002551+0000 mon.smithi152 (mon.0) 504 : audit [INF] from='client.? 172.21.15.152:0/3864251538' entity='client.admin' 2024-04-06T12:19:42.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:41.049685+0000 mon.smithi152 (mon.0) 505 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:19:42.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:41.051090+0000 mon.smithi152 (mon.0) 506 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:19:42.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:41.051677+0000 mon.smithi152 (mon.0) 507 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:19:42.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:41.055821+0000 mon.smithi152 (mon.0) 508 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:19:43.405 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:41.537270+0000 mgr.smithi152.lynahm (mgr.14196) 182 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:43.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:41.537270+0000 mgr.smithi152.lynahm (mgr.14196) 182 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:43.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.954+0000 7fa407f59700 1 -- 172.21.15.152:0/3038019440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f66f0 msgr2=0x7fa4000f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:43.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.954+0000 7fa407f59700 1 --2- 172.21.15.152:0/3038019440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f66f0 0x7fa4000f6b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fa3f40047f0 tx=0x7fa3f4009cb0).stop 2024-04-06T12:19:43.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.954+0000 7fa407f59700 1 -- 172.21.15.152:0/3038019440 shutdown_connections 2024-04-06T12:19:43.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.954+0000 7fa407f59700 1 --2- 172.21.15.152:0/3038019440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4000f7990 0x7fa4000f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.954+0000 7fa407f59700 1 --2- 172.21.15.152:0/3038019440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f66f0 0x7fa4000f6b10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.954+0000 7fa407f59700 1 -- 172.21.15.152:0/3038019440 >> 172.21.15.152:0/3038019440 conn(0x7fa4000f1e50 msgr2=0x7fa4000f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.954+0000 7fa407f59700 1 -- 172.21.15.152:0/3038019440 shutdown_connections 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.954+0000 7fa407f59700 1 -- 172.21.15.152:0/3038019440 wait complete. 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa407f59700 1 Processor -- start 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa407f59700 1 -- start start 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa407f59700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4000f66f0 0x7fa400061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa407f59700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f7990 0x7fa40010cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa407f59700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40010d2b0 con 0x7fa4000f7990 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa407f59700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40010d3f0 con 0x7fa4000f66f0 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa4054f4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f7990 0x7fa40010cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa4054f4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f7990 0x7fa40010cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57772/0 (socket says 172.21.15.152:57772) 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa4054f4700 1 -- 172.21.15.152:0/2710859842 learned_addr learned my addr 172.21.15.152:0/2710859842 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:43.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.955+0000 7fa405cf5700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4000f66f0 0x7fa400061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:43.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.956+0000 7fa4054f4700 1 -- 172.21.15.152:0/2710859842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4000f66f0 msgr2=0x7fa400061040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:43.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.956+0000 7fa4054f4700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4000f66f0 0x7fa400061040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:43.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.956+0000 7fa4054f4700 1 -- 172.21.15.152:0/2710859842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4005040 con 0x7fa4000f7990 2024-04-06T12:19:43.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.956+0000 7fa4054f4700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f7990 0x7fa40010cdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fa3fc0041d0 tx=0x7fa3fc009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:43.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.956+0000 7fa3f2ffd700 1 -- 172.21.15.152:0/2710859842 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3fc007b40 con 0x7fa4000f7990 2024-04-06T12:19:43.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.956+0000 7fa3f2ffd700 1 -- 172.21.15.152:0/2710859842 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa3fc00f040 con 0x7fa4000f7990 2024-04-06T12:19:43.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.956+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40010d650 con 0x7fa4000f7990 2024-04-06T12:19:43.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.956+0000 7fa3f2ffd700 1 -- 172.21.15.152:0/2710859842 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3fc013730 con 0x7fa4000f7990 2024-04-06T12:19:43.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.956+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40010db60 con 0x7fa4000f7990 2024-04-06T12:19:43.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.957+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4000feed0 con 0x7fa4000f7990 2024-04-06T12:19:43.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.957+0000 7fa3f2ffd700 1 -- 172.21.15.152:0/2710859842 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fa3fc009110 con 0x7fa4000f7990 2024-04-06T12:19:43.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.958+0000 7fa3f2ffd700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa3ec061180 0x7fa3ec063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:43.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.958+0000 7fa3f2ffd700 1 -- 172.21.15.152:0/2710859842 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fa3fc07bf90 con 0x7fa4000f7990 2024-04-06T12:19:43.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.958+0000 7fa405cf5700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa3ec061180 0x7fa3ec063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:43.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.958+0000 7fa405cf5700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa3ec061180 0x7fa3ec063640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fa3f4004f10 tx=0x7fa3f400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:43.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:43.962+0000 7fa3f2ffd700 1 -- 172.21.15.152:0/2710859842 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa3fc050260 con 0x7fa4000f7990 2024-04-06T12:19:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.137+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa400059120 con 0x7fa3ec061180 2024-04-06T12:19:44.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.138+0000 7fa3f2ffd700 1 -- 172.21.15.152:0/2710859842 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa400059120 con 0x7fa3ec061180 2024-04-06T12:19:44.135 INFO:teuthology.orchestra.run.smithi152.stdout:Backend: cephadm 2024-04-06T12:19:44.135 INFO:teuthology.orchestra.run.smithi152.stdout:Available: Yes 2024-04-06T12:19:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:Paused: No 2024-04-06T12:19:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa3ec061180 msgr2=0x7fa3ec063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa3ec061180 0x7fa3ec063640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fa3f4004f10 tx=0x7fa3f400b040).stop 2024-04-06T12:19:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f7990 msgr2=0x7fa40010cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f7990 0x7fa40010cdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fa3fc0041d0 tx=0x7fa3fc009f60).stop 2024-04-06T12:19:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 shutdown_connections 2024-04-06T12:19:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa3ec061180 0x7fa3ec063640 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4000f66f0 0x7fa400061040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 --2- 172.21.15.152:0/2710859842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4000f7990 0x7fa40010cdc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 >> 172.21.15.152:0/2710859842 conn(0x7fa4000f1e50 msgr2=0x7fa4000fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 shutdown_connections 2024-04-06T12:19:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:44.140+0000 7fa407f59700 1 -- 172.21.15.152:0/2710859842 wait complete. 2024-04-06T12:19:44.864 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph orch ps' 2024-04-06T12:19:45.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:43.537782+0000 mgr.smithi152.lynahm (mgr.14196) 183 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:45.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:44.138322+0000 mgr.smithi152.lynahm (mgr.14196) 184 : audit [DBG] from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:45.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:43.537782+0000 mgr.smithi152.lynahm (mgr.14196) 183 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:45.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:44.138322+0000 mgr.smithi152.lynahm (mgr.14196) 184 : audit [DBG] from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:46.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.965+0000 7ffa93145700 1 -- 172.21.15.152:0/1714204758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f66f0 msgr2=0x7ffa8c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:46.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.965+0000 7ffa93145700 1 --2- 172.21.15.152:0/1714204758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f66f0 0x7ffa8c0f6b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7ffa800047f0 tx=0x7ffa80009cb0).stop 2024-04-06T12:19:46.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.965+0000 7ffa93145700 1 -- 172.21.15.152:0/1714204758 shutdown_connections 2024-04-06T12:19:46.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.965+0000 7ffa93145700 1 --2- 172.21.15.152:0/1714204758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c0f7990 0x7ffa8c0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:46.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.965+0000 7ffa93145700 1 --2- 172.21.15.152:0/1714204758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f66f0 0x7ffa8c0f6b10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:46.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.965+0000 7ffa93145700 1 -- 172.21.15.152:0/1714204758 >> 172.21.15.152:0/1714204758 conn(0x7ffa8c0f1e50 msgr2=0x7ffa8c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:46.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.965+0000 7ffa93145700 1 -- 172.21.15.152:0/1714204758 shutdown_connections 2024-04-06T12:19:46.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.965+0000 7ffa93145700 1 -- 172.21.15.152:0/1714204758 wait complete. 2024-04-06T12:19:46.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa93145700 1 Processor -- start 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa93145700 1 -- start start 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa93145700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c0f66f0 0x7ffa8c107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa93145700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f7990 0x7ffa8c108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa93145700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c108a10 con 0x7ffa8c0f7990 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa93145700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c108b50 con 0x7ffa8c0f66f0 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa8bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f7990 0x7ffa8c108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa8bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f7990 0x7ffa8c108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57790/0 (socket says 172.21.15.152:57790) 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa8bfff700 1 -- 172.21.15.152:0/402893074 learned_addr learned my addr 172.21.15.152:0/402893074 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa90ee1700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c0f66f0 0x7ffa8c107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa8bfff700 1 -- 172.21.15.152:0/402893074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c0f66f0 msgr2=0x7ffa8c107f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa8bfff700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c0f66f0 0x7ffa8c107f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa8bfff700 1 -- 172.21.15.152:0/402893074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa80005040 con 0x7ffa8c0f7990 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.966+0000 7ffa8bfff700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f7990 0x7ffa8c108460 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ffa780041d0 tx=0x7ffa78009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.967+0000 7ffa89ffb700 1 -- 172.21.15.152:0/402893074 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa78007b40 con 0x7ffa8c0f7990 2024-04-06T12:19:46.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.967+0000 7ffa89ffb700 1 -- 172.21.15.152:0/402893074 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ffa7800f040 con 0x7ffa8c0f7990 2024-04-06T12:19:46.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.967+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c10d5f0 con 0x7ffa8c0f7990 2024-04-06T12:19:46.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.967+0000 7ffa89ffb700 1 -- 172.21.15.152:0/402893074 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa780146f0 con 0x7ffa8c0f7990 2024-04-06T12:19:46.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.967+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c10db30 con 0x7ffa8c0f7990 2024-04-06T12:19:46.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.968+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c0feeb0 con 0x7ffa8c0f7990 2024-04-06T12:19:46.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.968+0000 7ffa89ffb700 1 -- 172.21.15.152:0/402893074 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7ffa78009110 con 0x7ffa8c0f7990 2024-04-06T12:19:46.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.968+0000 7ffa89ffb700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ffa7c061180 0x7ffa7c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:46.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.968+0000 7ffa89ffb700 1 -- 172.21.15.152:0/402893074 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7ffa7807c4a0 con 0x7ffa8c0f7990 2024-04-06T12:19:46.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.968+0000 7ffa90ee1700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ffa7c061180 0x7ffa7c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:46.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.969+0000 7ffa90ee1700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ffa7c061180 0x7ffa7c063640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ffa80004f10 tx=0x7ffa8000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:46.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:46.972+0000 7ffa89ffb700 1 -- 172.21.15.152:0/402893074 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ffa780507f0 con 0x7ffa8c0f7990 2024-04-06T12:19:47.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.149+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa8c0fbdd0 con 0x7ffa7c061180 2024-04-06T12:19:47.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.156+0000 7ffa89ffb700 1 -- 172.21.15.152:0/402893074 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2700 (secure 0 0 0) 0x7ffa8c0fbdd0 con 0x7ffa7c061180 2024-04-06T12:19:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:19:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (3m) 2m ago 4m 15.5M - 0.23.0 ba2b418f427c a23e247a2160 2024-04-06T12:19:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (4m) 2m ago 4m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:19:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (4m) 71s ago 4m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:19:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (3m) 2m ago 4m 46.2M - 8.3.5 dad864ee21e9 68f8b2b6d071 2024-04-06T12:19:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:9283 running (6m) 2m ago 6m 425M - 16.2.15-1-g8963e9de 727f386679cb 10652d2c4bd5 2024-04-06T12:19:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283 running (4m) 71s ago 4m 385M - 16.2.15-1-g8963e9de 727f386679cb 8a05c1240f1e 2024-04-06T12:19:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (6m) 2m ago 6m 47.0M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:19:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (4m) 71s ago 4m 50.6M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:19:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 2m ago 4m 23.1M - 1.3.1 1dbe0e931976 7122c2020056 2024-04-06T12:19:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (4m) 71s ago 4m 22.2M - 1.3.1 1dbe0e931976 9dbc0ed205d9 2024-04-06T12:19:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (3m) 2m ago 3m 33.6M 4640M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:19:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (3m) 2m ago 3m 35.5M 4640M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:19:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (2m) 2m ago 2m 10.8M 4640M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:19:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (2m) 71s ago 2m 33.9M 4982M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:19:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (102s) 71s ago 102s 33.6M 4982M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:19:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (76s) 71s ago 76s 10.6M 4982M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:19:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (3m) 71s ago 3m 55.9M - 2.33.4 514e6a882f6e d9a8fc6b6cf9 2024-04-06T12:19:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ffa7c061180 msgr2=0x7ffa7c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ffa7c061180 0x7ffa7c063640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ffa80004f10 tx=0x7ffa8000b040).stop 2024-04-06T12:19:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f7990 msgr2=0x7ffa8c108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f7990 0x7ffa8c108460 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ffa780041d0 tx=0x7ffa78009f60).stop 2024-04-06T12:19:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 shutdown_connections 2024-04-06T12:19:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ffa7c061180 0x7ffa7c063640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c0f66f0 0x7ffa8c107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 --2- 172.21.15.152:0/402893074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa8c0f7990 0x7ffa8c108460 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 >> 172.21.15.152:0/402893074 conn(0x7ffa8c0f1e50 msgr2=0x7ffa8c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 shutdown_connections 2024-04-06T12:19:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:47.158+0000 7ffa93145700 1 -- 172.21.15.152:0/402893074 wait complete. 2024-04-06T12:19:47.495 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:45.538041+0000 mgr.smithi152.lynahm (mgr.14196) 185 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:47.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:45.538041+0000 mgr.smithi152.lynahm (mgr.14196) 185 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:47.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph orch ls' 2024-04-06T12:19:48.334 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:47.150900+0000 mgr.smithi152.lynahm (mgr.14196) 186 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:48.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:47.150900+0000 mgr.smithi152.lynahm (mgr.14196) 186 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:49.467 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:47.538545+0000 mgr.smithi152.lynahm (mgr.14196) 187 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:49.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:49 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:47.538545+0000 mgr.smithi152.lynahm (mgr.14196) 187 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:49.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.984+0000 7fdaa7382700 1 -- 172.21.15.152:0/1061374465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f66f0 msgr2=0x7fdaa00f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.984+0000 7fdaa7382700 1 --2- 172.21.15.152:0/1061374465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f66f0 0x7fdaa00f6b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fda940047f0 tx=0x7fda94009cb0).stop 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.984+0000 7fdaa7382700 1 -- 172.21.15.152:0/1061374465 shutdown_connections 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.984+0000 7fdaa7382700 1 --2- 172.21.15.152:0/1061374465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaa00f7990 0x7fdaa00f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.984+0000 7fdaa7382700 1 --2- 172.21.15.152:0/1061374465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f66f0 0x7fdaa00f6b10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.984+0000 7fdaa7382700 1 -- 172.21.15.152:0/1061374465 >> 172.21.15.152:0/1061374465 conn(0x7fdaa00f1e50 msgr2=0x7fdaa00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.984+0000 7fdaa7382700 1 -- 172.21.15.152:0/1061374465 shutdown_connections 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.984+0000 7fdaa7382700 1 -- 172.21.15.152:0/1061374465 wait complete. 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa7382700 1 Processor -- start 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa7382700 1 -- start start 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa7382700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaa00f66f0 0x7fdaa0107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:49.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa7382700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f7990 0x7fdaa0108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa7382700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0108a10 con 0x7fdaa00f7990 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa7382700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0108b50 con 0x7fdaa00f66f0 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa491d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f7990 0x7fdaa0108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa491d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f7990 0x7fdaa0108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57808/0 (socket says 172.21.15.152:57808) 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa491d700 1 -- 172.21.15.152:0/1681402297 learned_addr learned my addr 172.21.15.152:0/1681402297 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.985+0000 7fdaa511e700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaa00f66f0 0x7fdaa0107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.986+0000 7fdaa491d700 1 -- 172.21.15.152:0/1681402297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaa00f66f0 msgr2=0x7fdaa0107f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.986+0000 7fdaa491d700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaa00f66f0 0x7fdaa0107f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.986+0000 7fdaa491d700 1 -- 172.21.15.152:0/1681402297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94005040 con 0x7fdaa00f7990 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.986+0000 7fdaa491d700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f7990 0x7fdaa0108460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fda9c00c740 tx=0x7fda9c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:49.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.986+0000 7fda927fc700 1 -- 172.21.15.152:0/1681402297 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9c00e680 con 0x7fdaa00f7990 2024-04-06T12:19:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.986+0000 7fda927fc700 1 -- 172.21.15.152:0/1681402297 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fda9c00ec70 con 0x7fdaa00f7990 2024-04-06T12:19:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.986+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa010d5f0 con 0x7fdaa00f7990 2024-04-06T12:19:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.986+0000 7fda927fc700 1 -- 172.21.15.152:0/1681402297 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9c013d30 con 0x7fdaa00f7990 2024-04-06T12:19:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.986+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa010db30 con 0x7fdaa00f7990 2024-04-06T12:19:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.987+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa00feeb0 con 0x7fdaa00f7990 2024-04-06T12:19:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.987+0000 7fda927fc700 1 -- 172.21.15.152:0/1681402297 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fda9c00e7e0 con 0x7fdaa00f7990 2024-04-06T12:19:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.988+0000 7fda927fc700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fda8c061180 0x7fda8c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.988+0000 7fda927fc700 1 -- 172.21.15.152:0/1681402297 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fda9c07c7a0 con 0x7fdaa00f7990 2024-04-06T12:19:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.988+0000 7fdaa511e700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fda8c061180 0x7fda8c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.988+0000 7fdaa511e700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fda8c061180 0x7fda8c063640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fda94013470 tx=0x7fda9400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:49.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:49.992+0000 7fda927fc700 1 -- 172.21.15.152:0/1681402297 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fda9c050af0 con 0x7fdaa00f7990 2024-04-06T12:19:50.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.162+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaa00fbdd0 con 0x7fda8c061180 2024-04-06T12:19:50.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.166+0000 7fda927fc700 1 -- 172.21.15.152:0/1681402297 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7fdaa00fbdd0 con 0x7fda8c061180 2024-04-06T12:19:50.164 INFO:teuthology.orchestra.run.smithi152.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-06T12:19:50.165 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-04-06T12:19:50.165 INFO:teuthology.orchestra.run.smithi152.stdout:crash 2/2 2m ago 5m * 2024-04-06T12:19:50.165 INFO:teuthology.orchestra.run.smithi152.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-04-06T12:19:50.165 INFO:teuthology.orchestra.run.smithi152.stdout:mgr 2/2 2m ago 5m count:2 2024-04-06T12:19:50.165 INFO:teuthology.orchestra.run.smithi152.stdout:mon 2/2 2m ago 4m smithi152:172.21.15.152=smithi152;smithi195:172.21.15.195=smithi195;count:2 2024-04-06T12:19:50.165 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-04-06T12:19:50.165 INFO:teuthology.orchestra.run.smithi152.stdout:osd 6 2m ago - 2024-04-06T12:19:50.165 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus ?:9095 1/1 74s ago 5m count:1 2024-04-06T12:19:50.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fda8c061180 msgr2=0x7fda8c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fda8c061180 0x7fda8c063640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fda94013470 tx=0x7fda9400b040).stop 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f7990 msgr2=0x7fdaa0108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f7990 0x7fdaa0108460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fda9c00c740 tx=0x7fda9c007ef0).stop 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 shutdown_connections 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fda8c061180 0x7fda8c063640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaa00f66f0 0x7fdaa0107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 --2- 172.21.15.152:0/1681402297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaa00f7990 0x7fdaa0108460 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 >> 172.21.15.152:0/1681402297 conn(0x7fdaa00f1e50 msgr2=0x7fdaa0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 shutdown_connections 2024-04-06T12:19:50.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:50.168+0000 7fdaa7382700 1 -- 172.21.15.152:0/1681402297 wait complete. 2024-04-06T12:19:51.017 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph orch host ls' 2024-04-06T12:19:51.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:49.539099+0000 mgr.smithi152.lynahm (mgr.14196) 188 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:51.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:50.164504+0000 mgr.smithi152.lynahm (mgr.14196) 189 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:51.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:49.539099+0000 mgr.smithi152.lynahm (mgr.14196) 188 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:51.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:50.164504+0000 mgr.smithi152.lynahm (mgr.14196) 189 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:53.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.110+0000 7f4309ab1700 1 -- 172.21.15.152:0/3203280345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 msgr2=0x7f43040f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.110+0000 7f4309ab1700 1 --2- 172.21.15.152:0/3203280345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 0x7f43040f6b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f42f40047f0 tx=0x7f42f4009cb0).stop 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.110+0000 7f4309ab1700 1 -- 172.21.15.152:0/3203280345 shutdown_connections 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.110+0000 7f4309ab1700 1 --2- 172.21.15.152:0/3203280345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43040f7020 0x7f43040f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.110+0000 7f4309ab1700 1 --2- 172.21.15.152:0/3203280345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 0x7f43040f6b30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.110+0000 7f4309ab1700 1 -- 172.21.15.152:0/3203280345 >> 172.21.15.152:0/3203280345 conn(0x7f43040f1f10 msgr2=0x7f43040f4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.110+0000 7f4309ab1700 1 -- 172.21.15.152:0/3203280345 shutdown_connections 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.110+0000 7f4309ab1700 1 -- 172.21.15.152:0/3203280345 wait complete. 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.111+0000 7f4309ab1700 1 Processor -- start 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.111+0000 7f4309ab1700 1 -- start start 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.111+0000 7f4309ab1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 0x7f4304108000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:53.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.111+0000 7f4309ab1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43040f7020 0x7f43041084f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.111+0000 7f4309ab1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4304108aa0 con 0x7f43040f6710 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.111+0000 7f4309ab1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4304108be0 con 0x7f43040f7020 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.111+0000 7f43037fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 0x7f4304108000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.111+0000 7f43037fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 0x7f4304108000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54720/0 (socket says 172.21.15.152:54720) 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.111+0000 7f43037fe700 1 -- 172.21.15.152:0/2356816774 learned_addr learned my addr 172.21.15.152:0/2356816774 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f4302ffd700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43040f7020 0x7f43041084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f43037fe700 1 -- 172.21.15.152:0/2356816774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43040f7020 msgr2=0x7f43041084f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f43037fe700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43040f7020 0x7f43041084f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f43037fe700 1 -- 172.21.15.152:0/2356816774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f4005040 con 0x7f43040f6710 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f4302ffd700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43040f7020 0x7f43041084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f43037fe700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 0x7f4304108000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f42f4009380 tx=0x7f42f4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f4300f74700 1 -- 172.21.15.152:0/2356816774 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f400e030 con 0x7f43040f6710 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f4300f74700 1 -- 172.21.15.152:0/2356816774 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f42f4007e90 con 0x7f43040f6710 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430410d620 con 0x7f43040f6710 2024-04-06T12:19:53.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f4300f74700 1 -- 172.21.15.152:0/2356816774 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f4018070 con 0x7f43040f6710 2024-04-06T12:19:53.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.112+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430410db60 con 0x7f43040f6710 2024-04-06T12:19:53.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.113+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43040fef10 con 0x7f43040f6710 2024-04-06T12:19:53.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.113+0000 7f4300f74700 1 -- 172.21.15.152:0/2356816774 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f42f401d420 con 0x7f43040f6710 2024-04-06T12:19:53.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.113+0000 7f4300f74700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f42ec061180 0x7f42ec063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:53.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.114+0000 7f4300f74700 1 -- 172.21.15.152:0/2356816774 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f42f407d9d0 con 0x7f43040f6710 2024-04-06T12:19:53.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.114+0000 7f4302ffd700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f42ec061180 0x7f42ec063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:53.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.114+0000 7f4302ffd700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f42ec061180 0x7f42ec063640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f42f8004c80 tx=0x7f42f800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:53.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.118+0000 7f4300f74700 1 -- 172.21.15.152:0/2356816774 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f42f4051c20 con 0x7f43040f6710 2024-04-06T12:19:53.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.287+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f430410e1a0 con 0x7f42ec061180 2024-04-06T12:19:53.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.288+0000 7f4300f74700 1 -- 172.21.15.152:0/2356816774 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f430410e1a0 con 0x7f42ec061180 2024-04-06T12:19:53.286 INFO:teuthology.orchestra.run.smithi152.stdout:HOST ADDR LABELS STATUS 2024-04-06T12:19:53.287 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152 172.21.15.152 2024-04-06T12:19:53.287 INFO:teuthology.orchestra.run.smithi152.stdout:smithi195 172.21.15.195 2024-04-06T12:19:53.287 INFO:teuthology.orchestra.run.smithi152.stdout:2 hosts in cluster 2024-04-06T12:19:53.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f42ec061180 msgr2=0x7f42ec063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:53.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f42ec061180 0x7f42ec063640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f42f8004c80 tx=0x7f42f800b040).stop 2024-04-06T12:19:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 msgr2=0x7f4304108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 0x7f4304108000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f42f4009380 tx=0x7f42f4009cb0).stop 2024-04-06T12:19:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 shutdown_connections 2024-04-06T12:19:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f42ec061180 0x7f42ec063640 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43040f6710 0x7f4304108000 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 --2- 172.21.15.152:0/2356816774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43040f7020 0x7f43041084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 >> 172.21.15.152:0/2356816774 conn(0x7f43040f1f10 msgr2=0x7f4304060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 shutdown_connections 2024-04-06T12:19:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:53.290+0000 7f4309ab1700 1 -- 172.21.15.152:0/2356816774 wait complete. 2024-04-06T12:19:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:51.539383+0000 mgr.smithi152.lynahm (mgr.14196) 190 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:51.539383+0000 mgr.smithi152.lynahm (mgr.14196) 190 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:53.969 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph orch device ls' 2024-04-06T12:19:54.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:53.288797+0000 mgr.smithi152.lynahm (mgr.14196) 191 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:54.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:53.288797+0000 mgr.smithi152.lynahm (mgr.14196) 191 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:55.338 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:53.539664+0000 mgr.smithi152.lynahm (mgr.14196) 192 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:55.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:55 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:53.539664+0000 mgr.smithi152.lynahm (mgr.14196) 192 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:55.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.887+0000 7f70c51f1700 1 -- 172.21.15.152:0/765645861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f8aa0 msgr2=0x7f70c00f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.887+0000 7f70c51f1700 1 --2- 172.21.15.152:0/765645861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f8aa0 0x7f70c00f8f00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f70b40047f0 tx=0x7f70b4009cb0).stop 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.887+0000 7f70c51f1700 1 -- 172.21.15.152:0/765645861 shutdown_connections 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.887+0000 7f70c51f1700 1 --2- 172.21.15.152:0/765645861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f8aa0 0x7f70c00f8f00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.887+0000 7f70c51f1700 1 --2- 172.21.15.152:0/765645861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c00f7800 0x7f70c00f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.887+0000 7f70c51f1700 1 -- 172.21.15.152:0/765645861 >> 172.21.15.152:0/765645861 conn(0x7f70c00f2f80 msgr2=0x7f70c00f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.887+0000 7f70c51f1700 1 -- 172.21.15.152:0/765645861 shutdown_connections 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.887+0000 7f70c51f1700 1 -- 172.21.15.152:0/765645861 wait complete. 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70c51f1700 1 Processor -- start 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70c51f1700 1 -- start start 2024-04-06T12:19:55.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70c51f1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f7800 0x7f70c0107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70c51f1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c00f8aa0 0x7f70c0108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70c51f1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c0108a00 con 0x7f70c00f7800 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70c51f1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c0108b40 con 0x7f70c00f8aa0 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70bed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f7800 0x7f70c0107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70bed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f7800 0x7f70c0107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54732/0 (socket says 172.21.15.152:54732) 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70bed9d700 1 -- 172.21.15.152:0/290978109 learned_addr learned my addr 172.21.15.152:0/290978109 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.888+0000 7f70be59c700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c00f8aa0 0x7f70c0108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70bed9d700 1 -- 172.21.15.152:0/290978109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c00f8aa0 msgr2=0x7f70c0108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70bed9d700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c00f8aa0 0x7f70c0108450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70bed9d700 1 -- 172.21.15.152:0/290978109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4005040 con 0x7f70c00f7800 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70be59c700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c00f8aa0 0x7f70c0108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70bed9d700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f7800 0x7f70c0107f60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f70b0002820 tx=0x7f70b0009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:55.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70a7fff700 1 -- 172.21.15.152:0/290978109 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b0002d60 con 0x7f70c00f7800 2024-04-06T12:19:55.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70a7fff700 1 -- 172.21.15.152:0/290978109 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f70b000f040 con 0x7f70c00f7800 2024-04-06T12:19:55.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c010d5e0 con 0x7f70c00f7800 2024-04-06T12:19:55.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70a7fff700 1 -- 172.21.15.152:0/290978109 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b000d820 con 0x7f70c00f7800 2024-04-06T12:19:55.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.889+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c010db20 con 0x7f70c00f7800 2024-04-06T12:19:55.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.890+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c00fffc0 con 0x7f70c00f7800 2024-04-06T12:19:55.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.890+0000 7f70a7fff700 1 -- 172.21.15.152:0/290978109 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f70b00092f0 con 0x7f70c00f7800 2024-04-06T12:19:55.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.891+0000 7f70a7fff700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f70a8061180 0x7f70a8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:55.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.891+0000 7f70a7fff700 1 -- 172.21.15.152:0/290978109 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f70b007c1d0 con 0x7f70c00f7800 2024-04-06T12:19:55.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.891+0000 7f70be59c700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f70a8061180 0x7f70a8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:55.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.891+0000 7f70be59c700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f70a8061180 0x7f70a8063640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f70b4013470 tx=0x7f70b400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:55.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:55.895+0000 7f70a7fff700 1 -- 172.21.15.152:0/290978109 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f70b0050550 con 0x7f70c00f7800 2024-04-06T12:19:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.065+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f70c0059120 con 0x7f70a8061180 2024-04-06T12:19:56.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.067+0000 7f70a7fff700 1 -- 172.21.15.152:0/290978109 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f70c0059120 con 0x7f70a8061180 2024-04-06T12:19:56.065 INFO:teuthology.orchestra.run.smithi152.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-06T12:19:56.065 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152 /dev/nvme0n1 ssd INTEL SSDPEDMD400G4_CVFT623300JT400BGN 372G 2m ago Has a FileSystem, LVM detected 2024-04-06T12:19:56.065 INFO:teuthology.orchestra.run.smithi152.stdout:smithi195 /dev/nvme0n1 ssd INTEL SSDPED1D480GA_PHMB751300FS480DGN 447G 76s ago Has a FileSystem, LVM detected 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.068+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f70a8061180 msgr2=0x7f70a8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.068+0000 7f70c51f1700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f70a8061180 0x7f70a8063640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f70b4013470 tx=0x7f70b400b040).stop 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.068+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f7800 msgr2=0x7f70c0107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.068+0000 7f70c51f1700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f7800 0x7f70c0107f60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f70b0002820 tx=0x7f70b0009f00).stop 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.068+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 shutdown_connections 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.068+0000 7f70c51f1700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f70a8061180 0x7f70a8063640 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.068+0000 7f70c51f1700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70c00f7800 0x7f70c0107f60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.068+0000 7f70c51f1700 1 --2- 172.21.15.152:0/290978109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70c00f8aa0 0x7f70c0108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.068+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 >> 172.21.15.152:0/290978109 conn(0x7f70c00f2f80 msgr2=0x7f70c00fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.069+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 shutdown_connections 2024-04-06T12:19:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:56.069+0000 7f70c51f1700 1 -- 172.21.15.152:0/290978109 wait complete. 2024-04-06T12:19:56.824 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-06T12:19:56.833 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:19:56.833 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-06T12:19:57.351 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:57 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:55.539920+0000 mgr.smithi152.lynahm (mgr.14196) 193 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:57.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:57 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:56.067364+0000 mgr.smithi152.lynahm (mgr.14196) 194 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:57 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:55.539920+0000 mgr.smithi152.lynahm (mgr.14196) 193 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:57 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:56.067364+0000 mgr.smithi152.lynahm (mgr.14196) 194 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:19:58.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.824+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/1950912740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 msgr2=0x7fa8c40f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:58.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.824+0000 7fa8c9c9d700 1 --2- 172.21.15.152:0/1950912740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 0x7fa8c40f8f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fa8b80047f0 tx=0x7fa8b8009cb0).stop 2024-04-06T12:19:58.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.824+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/1950912740 shutdown_connections 2024-04-06T12:19:58.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.824+0000 7fa8c9c9d700 1 --2- 172.21.15.152:0/1950912740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 0x7fa8c40f8f00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.824+0000 7fa8c9c9d700 1 --2- 172.21.15.152:0/1950912740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8c40f7800 0x7fa8c40f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.824+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/1950912740 >> 172.21.15.152:0/1950912740 conn(0x7fa8c40f2f80 msgr2=0x7fa8c40f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.824+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/1950912740 shutdown_connections 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.824+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/1950912740 wait complete. 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.825+0000 7fa8c9c9d700 1 Processor -- start 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.825+0000 7fa8c9c9d700 1 -- start start 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.825+0000 7fa8c9c9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8c40f7800 0x7fa8c4107f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.825+0000 7fa8c9c9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 0x7fa8c4108420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.825+0000 7fa8c9c9d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c41089d0 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.825+0000 7fa8c9c9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4108b10 con 0x7fa8c40f7800 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.825+0000 7fa8c2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 0x7fa8c4108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.825+0000 7fa8c2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 0x7fa8c4108420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54752/0 (socket says 172.21.15.152:54752) 2024-04-06T12:19:58.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.825+0000 7fa8c2ffd700 1 -- 172.21.15.152:0/4136143426 learned_addr learned my addr 172.21.15.152:0/4136143426 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c37fe700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8c40f7800 0x7fa8c4107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c2ffd700 1 -- 172.21.15.152:0/4136143426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8c40f7800 msgr2=0x7fa8c4107f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c2ffd700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8c40f7800 0x7fa8c4107f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c2ffd700 1 -- 172.21.15.152:0/4136143426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8005040 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c37fe700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8c40f7800 0x7fa8c4107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c2ffd700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 0x7fa8c4108420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fa8b8013510 tx=0x7fa8b8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c0ff9700 1 -- 172.21.15.152:0/4136143426 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b800e030 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c0ff9700 1 -- 172.21.15.152:0/4136143426 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa8b8007e90 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c410d550 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c0ff9700 1 -- 172.21.15.152:0/4136143426 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b8018070 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.826+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c410da90 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.827+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c40fffc0 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.827+0000 7fa8c0ff9700 1 -- 172.21.15.152:0/4136143426 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fa8b801d420 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.827+0000 7fa8c0ff9700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa8ac061180 0x7fa8ac063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:19:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.828+0000 7fa8c0ff9700 1 -- 172.21.15.152:0/4136143426 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fa8b807db70 con 0x7fa8c40f8aa0 2024-04-06T12:19:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.828+0000 7fa8c37fe700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa8ac061180 0x7fa8ac063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:19:58.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.828+0000 7fa8c37fe700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa8ac061180 0x7fa8ac063640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa8c40f8900 tx=0x7fa8b4009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:19:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:58.832+0000 7fa8c0ff9700 1 -- 172.21.15.152:0/4136143426 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa8b8051e40 con 0x7fa8c40f8aa0 2024-04-06T12:19:59.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:19:59.027+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8c4059120 con 0x7fa8ac061180 2024-04-06T12:19:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:19:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:57.540365+0000 mgr.smithi152.lynahm (mgr.14196) 195 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:19:59.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:19:59 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:57.540365+0000 mgr.smithi152.lynahm (mgr.14196) 195 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:00.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.363+0000 7fa8c0ff9700 1 -- 172.21.15.152:0/4136143426 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa8c4059120 con 0x7fa8ac061180 2024-04-06T12:20:00.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.366+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa8ac061180 msgr2=0x7fa8ac063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:00.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.366+0000 7fa8c9c9d700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa8ac061180 0x7fa8ac063640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa8c40f8900 tx=0x7fa8b4009040).stop 2024-04-06T12:20:00.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.366+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 msgr2=0x7fa8c4108420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:00.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.366+0000 7fa8c9c9d700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 0x7fa8c4108420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fa8b8013510 tx=0x7fa8b8009cb0).stop 2024-04-06T12:20:00.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.366+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 shutdown_connections 2024-04-06T12:20:00.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.366+0000 7fa8c9c9d700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa8ac061180 0x7fa8ac063640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:00.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.366+0000 7fa8c9c9d700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8c40f7800 0x7fa8c4107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:00.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.366+0000 7fa8c9c9d700 1 --2- 172.21.15.152:0/4136143426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c40f8aa0 0x7fa8c4108420 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:00.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.366+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 >> 172.21.15.152:0/4136143426 conn(0x7fa8c40f2f80 msgr2=0x7fa8c40fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:00.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.367+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 shutdown_connections 2024-04-06T12:20:00.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:00.367+0000 7fa8c9c9d700 1 -- 172.21.15.152:0/4136143426 wait complete. 2024-04-06T12:20:00.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:59.029734+0000 mgr.smithi152.lynahm (mgr.14196) 196 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:20:00.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:59.030236+0000 mon.smithi152 (mon.0) 509 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-06T12:20:00.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:59.325982+0000 mon.smithi152 (mon.0) 510 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-06T12:20:00.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:59.326029+0000 mon.smithi152 (mon.0) 511 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-04-06T12:20:00.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:19:59.326813+0000 mon.smithi152 (mon.0) 512 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-06T12:20:00.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:00.000165+0000 mon.smithi152 (mon.0) 513 : cluster [INF] overall HEALTH_OK 2024-04-06T12:20:00.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:20:00.339+0000 7fbba4211700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:20:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:59.029734+0000 mgr.smithi152.lynahm (mgr.14196) 196 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:20:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:59.030236+0000 mon.smithi152 (mon.0) 509 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-06T12:20:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:59.325982+0000 mon.smithi152 (mon.0) 510 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-06T12:20:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:59.326029+0000 mon.smithi152 (mon.0) 511 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-04-06T12:20:00.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:19:59.326813+0000 mon.smithi152 (mon.0) 512 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-06T12:20:00.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:00.000165+0000 mon.smithi152 (mon.0) 513 : cluster [INF] overall HEALTH_OK 2024-04-06T12:20:01.039 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph fs dump' 2024-04-06T12:20:01.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:19:59.540710+0000 mgr.smithi152.lynahm (mgr.14196) 197 : cluster [DBG] pgmap v169: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:01.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.329839+0000 mon.smithi152 (mon.0) 514 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-06T12:20:01.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:00.330056+0000 mon.smithi152 (mon.0) 515 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-04-06T12:20:01.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.340080+0000 mon.smithi152 (mon.0) 516 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:00.340985+0000 mon.smithi152 (mon.0) 517 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:00.341050+0000 mon.smithi152 (mon.0) 518 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:00.352722+0000 mon.smithi152 (mon.0) 519 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.352867+0000 mon.smithi152 (mon.0) 520 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:00.352964+0000 mon.smithi152 (mon.0) 521 : cluster [DBG] fsmap cephfs:0 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.364041+0000 mon.smithi152 (mon.0) 522 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.413283+0000 mon.smithi152 (mon.0) 523 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.414852+0000 mon.smithi152 (mon.0) 524 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.415471+0000 mon.smithi152 (mon.0) 525 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.419832+0000 mon.smithi152 (mon.0) 526 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.429454+0000 mon.smithi152 (mon.0) 527 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.430465+0000 mon.smithi152 (mon.0) 528 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.spbxnv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.436141+0000 mon.smithi152 (mon.0) 529 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.spbxnv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-06T12:20:01.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.436977+0000 mon.smithi152 (mon.0) 530 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:01.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:00.649936+0000 mon.smithi152 (mon.0) 531 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:01.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:19:59.540710+0000 mgr.smithi152.lynahm (mgr.14196) 197 : cluster [DBG] pgmap v169: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:01.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.329839+0000 mon.smithi152 (mon.0) 514 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:00.330056+0000 mon.smithi152 (mon.0) 515 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.340080+0000 mon.smithi152 (mon.0) 516 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:00.340985+0000 mon.smithi152 (mon.0) 517 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:00.341050+0000 mon.smithi152 (mon.0) 518 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:00.352722+0000 mon.smithi152 (mon.0) 519 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.352867+0000 mon.smithi152 (mon.0) 520 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:00.352964+0000 mon.smithi152 (mon.0) 521 : cluster [DBG] fsmap cephfs:0 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.364041+0000 mon.smithi152 (mon.0) 522 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.413283+0000 mon.smithi152 (mon.0) 523 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:20:01.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.414852+0000 mon.smithi152 (mon.0) 524 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:01.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.415471+0000 mon.smithi152 (mon.0) 525 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:20:01.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.419832+0000 mon.smithi152 (mon.0) 526 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:01.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.429454+0000 mon.smithi152 (mon.0) 527 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:01.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.430465+0000 mon.smithi152 (mon.0) 528 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.spbxnv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:20:01.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.436141+0000 mon.smithi152 (mon.0) 529 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.spbxnv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-06T12:20:01.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.436977+0000 mon.smithi152 (mon.0) 530 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:01.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:00.649936+0000 mon.smithi152 (mon.0) 531 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:02.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:20:00.357900+0000 mgr.smithi152.lynahm (mgr.14196) 198 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-04-06T12:20:02.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:20:00.437599+0000 mgr.smithi152.lynahm (mgr.14196) 199 : cephadm [INF] Deploying daemon mds.cephfs.smithi152.spbxnv on smithi152 2024-04-06T12:20:02.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:01.355830+0000 mon.smithi152 (mon.0) 532 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-04-06T12:20:02.603 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:20:00.357900+0000 mgr.smithi152.lynahm (mgr.14196) 198 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-04-06T12:20:02.603 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:20:00.437599+0000 mgr.smithi152.lynahm (mgr.14196) 199 : cephadm [INF] Deploying daemon mds.cephfs.smithi152.spbxnv on smithi152 2024-04-06T12:20:02.603 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:01.355830+0000 mon.smithi152 (mon.0) 532 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-04-06T12:20:03.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:01.541140+0000 mgr.smithi152.lynahm (mgr.14196) 200 : cluster [DBG] pgmap v173: 65 pgs: 3 creating+activating, 6 creating+peering, 40 unknown, 16 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:03.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:02.356662+0000 mon.smithi152 (mon.0) 533 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-04-06T12:20:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:01.541140+0000 mgr.smithi152.lynahm (mgr.14196) 200 : cluster [DBG] pgmap v173: 65 pgs: 3 creating+activating, 6 creating+peering, 40 unknown, 16 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:02.356662+0000 mon.smithi152 (mon.0) 533 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-04-06T12:20:04.528 INFO:teuthology.orchestra.run.smithi152.stdout:e2 2024-04-06T12:20:04.528 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:20:04.528 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:20:04.528 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:20:04.528 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:20:04.528 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:20:04.528 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 2 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:flags 12 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:00.340884+0000 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:in 2024-04-06T12:20:04.529 INFO:teuthology.orchestra.run.smithi152.stdout:up {} 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 0 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:20:04.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.304+0000 7fd9b7875700 1 -- 172.21.15.152:0/3496624728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 msgr2=0x7fd9b00f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.304+0000 7fd9b7875700 1 --2- 172.21.15.152:0/3496624728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 0x7fd9b00f62b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fd9ac0047f0 tx=0x7fd9ac009cb0).stop 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.304+0000 7fd9b7875700 1 -- 172.21.15.152:0/3496624728 shutdown_connections 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.304+0000 7fd9b7875700 1 --2- 172.21.15.152:0/3496624728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b00f7090 0x7fd9b00f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.304+0000 7fd9b7875700 1 --2- 172.21.15.152:0/3496624728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 0x7fd9b00f62b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.304+0000 7fd9b7875700 1 -- 172.21.15.152:0/3496624728 >> 172.21.15.152:0/3496624728 conn(0x7fd9b00f1610 msgr2=0x7fd9b00f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.304+0000 7fd9b7875700 1 -- 172.21.15.152:0/3496624728 shutdown_connections 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.304+0000 7fd9b7875700 1 -- 172.21.15.152:0/3496624728 wait complete. 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b7875700 1 Processor -- start 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b7875700 1 -- start start 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b7875700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 0x7fd9b00faf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b7875700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b00f7090 0x7fd9b00f9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b7875700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00fb4c0 con 0x7fd9b00f5e90 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b7875700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00f9a60 con 0x7fd9b00f7090 2024-04-06T12:20:04.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b5611700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 0x7fd9b00faf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b5611700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 0x7fd9b00faf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42196/0 (socket says 172.21.15.152:42196) 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b5611700 1 -- 172.21.15.152:0/227365407 learned_addr learned my addr 172.21.15.152:0/227365407 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b4e10700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b00f7090 0x7fd9b00f9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b5611700 1 -- 172.21.15.152:0/227365407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b00f7090 msgr2=0x7fd9b00f9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b5611700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b00f7090 0x7fd9b00f9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.305+0000 7fd9b5611700 1 -- 172.21.15.152:0/227365407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac005040 con 0x7fd9b00f5e90 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.306+0000 7fd9b4e10700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b00f7090 0x7fd9b00f9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.306+0000 7fd9b5611700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 0x7fd9b00faf10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd9ac013470 tx=0x7fd9ac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.306+0000 7fd9a67fc700 1 -- 172.21.15.152:0/227365407 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9ac00e030 con 0x7fd9b00f5e90 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.306+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b00f9c80 con 0x7fd9b00f5e90 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.306+0000 7fd9a67fc700 1 -- 172.21.15.152:0/227365407 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fd9ac007e90 con 0x7fd9b00f5e90 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.306+0000 7fd9a67fc700 1 -- 172.21.15.152:0/227365407 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9ac018070 con 0x7fd9b00f5e90 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.306+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b00fa160 con 0x7fd9b00f5e90 2024-04-06T12:20:04.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.307+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b00fa380 con 0x7fd9b00f5e90 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.307+0000 7fd9a67fc700 1 -- 172.21.15.152:0/227365407 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fd9ac01d420 con 0x7fd9b00f5e90 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.307+0000 7fd9a67fc700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd99c061180 0x7fd99c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.307+0000 7fd9a67fc700 1 -- 172.21.15.152:0/227365407 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fd9ac07dd60 con 0x7fd9b00f5e90 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.308+0000 7fd9b4e10700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd99c061180 0x7fd99c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.308+0000 7fd9b4e10700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd99c061180 0x7fd99c063640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd9a0009250 tx=0x7fd9a0009da0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.312+0000 7fd9a67fc700 1 -- 172.21.15.152:0/227365407 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd9ac051cf0 con 0x7fd9b00f5e90 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.524+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd9b00598f0 con 0x7fd9b00f5e90 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.525+0000 7fd9a67fc700 1 -- 172.21.15.152:0/227365407 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1034 (secure 0 0 0) 0x7fd9ac0518e0 con 0x7fd9b00f5e90 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd99c061180 msgr2=0x7fd99c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd99c061180 0x7fd99c063640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd9a0009250 tx=0x7fd9a0009da0).stop 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 msgr2=0x7fd9b00faf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 0x7fd9b00faf10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd9ac013470 tx=0x7fd9ac009cb0).stop 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 shutdown_connections 2024-04-06T12:20:04.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fd99c061180 0x7fd99c063640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:04.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9b00f5e90 0x7fd9b00faf10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:04.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 --2- 172.21.15.152:0/227365407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b00f7090 0x7fd9b00f9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:04.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 >> 172.21.15.152:0/227365407 conn(0x7fd9b00f1610 msgr2=0x7fd9b00fb660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:04.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 shutdown_connections 2024-04-06T12:20:04.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:04.526+0000 7fd9b7875700 1 -- 172.21.15.152:0/227365407 wait complete. 2024-04-06T12:20:04.534 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 2 2024-04-06T12:20:05.367 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-06T12:20:05.379 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:20:05.380 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-06T12:20:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:03.541797+0000 mgr.smithi152.lynahm (mgr.14196) 201 : cluster [DBG] pgmap v175: 65 pgs: 4 creating+activating, 6 creating+peering, 55 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:04.475627+0000 mon.smithi152 (mon.0) 534 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:04.476539+0000 mon.smithi152 (mon.0) 535 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.akamqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:20:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:04.481628+0000 mon.smithi152 (mon.0) 536 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.akamqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-06T12:20:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:04.482196+0000 mon.smithi152 (mon.0) 537 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:04.525917+0000 mon.smithi152 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.152:0/227365407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:20:05.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:03.541797+0000 mgr.smithi152.lynahm (mgr.14196) 201 : cluster [DBG] pgmap v175: 65 pgs: 4 creating+activating, 6 creating+peering, 55 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:05.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:04.475627+0000 mon.smithi152 (mon.0) 534 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:05.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:04.476539+0000 mon.smithi152 (mon.0) 535 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.akamqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:20:05.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:04.481628+0000 mon.smithi152 (mon.0) 536 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.akamqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-06T12:20:05.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:04.482196+0000 mon.smithi152 (mon.0) 537 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:05.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:04.525917+0000 mon.smithi152 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.152:0/227365407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:20:06.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:20:04.482678+0000 mgr.smithi152.lynahm (mgr.14196) 202 : cephadm [INF] Deploying daemon mds.cephfs.smithi195.akamqf on smithi195 2024-04-06T12:20:06.331 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:05.285434+0000 mon.smithi152 (mon.0) 539 : cluster [DBG] mds.? [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] up:boot 2024-04-06T12:20:06.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:05.285479+0000 mon.smithi152 (mon.0) 540 : cluster [INF] daemon mds.cephfs.smithi152.spbxnv assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-06T12:20:06.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:05.285529+0000 mon.smithi152 (mon.0) 541 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-06T12:20:06.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:05.285544+0000 mon.smithi152 (mon.0) 542 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-06T12:20:06.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:05.285554+0000 mon.smithi152 (mon.0) 543 : cluster [INF] Cluster is now healthy 2024-04-06T12:20:06.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:05.285973+0000 mon.smithi152 (mon.0) 544 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-04-06T12:20:06.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:05.286088+0000 mon.smithi152 (mon.0) 545 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:20:06.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:05.292323+0000 mon.smithi152 (mon.0) 546 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:creating} 2024-04-06T12:20:06.332 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:05.302109+0000 mon.smithi152 (mon.0) 547 : cluster [INF] daemon mds.cephfs.smithi152.spbxnv is now active in filesystem cephfs as rank 0 2024-04-06T12:20:06.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:20:04.482678+0000 mgr.smithi152.lynahm (mgr.14196) 202 : cephadm [INF] Deploying daemon mds.cephfs.smithi195.akamqf on smithi195 2024-04-06T12:20:06.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:05.285434+0000 mon.smithi152 (mon.0) 539 : cluster [DBG] mds.? [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] up:boot 2024-04-06T12:20:06.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:05.285479+0000 mon.smithi152 (mon.0) 540 : cluster [INF] daemon mds.cephfs.smithi152.spbxnv assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-06T12:20:06.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:05.285529+0000 mon.smithi152 (mon.0) 541 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-06T12:20:06.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:05.285544+0000 mon.smithi152 (mon.0) 542 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-06T12:20:06.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:05.285554+0000 mon.smithi152 (mon.0) 543 : cluster [INF] Cluster is now healthy 2024-04-06T12:20:06.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:05.285973+0000 mon.smithi152 (mon.0) 544 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-04-06T12:20:06.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:05.286088+0000 mon.smithi152 (mon.0) 545 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:20:06.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:05.292323+0000 mon.smithi152 (mon.0) 546 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:creating} 2024-04-06T12:20:06.779 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:05.302109+0000 mon.smithi152 (mon.0) 547 : cluster [INF] daemon mds.cephfs.smithi152.spbxnv is now active in filesystem cephfs as rank 0 2024-04-06T12:20:07.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.354+0000 7fb391626700 1 -- 172.21.15.152:0/3518463488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 msgr2=0x7fb38c0fcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:07.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.354+0000 7fb391626700 1 --2- 172.21.15.152:0/3518463488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 0x7fb38c0fcd70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb3800047f0 tx=0x7fb380009cb0).stop 2024-04-06T12:20:07.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.354+0000 7fb391626700 1 -- 172.21.15.152:0/3518463488 shutdown_connections 2024-04-06T12:20:07.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.354+0000 7fb391626700 1 --2- 172.21.15.152:0/3518463488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 0x7fb38c0fcd70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:07.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.354+0000 7fb391626700 1 --2- 172.21.15.152:0/3518463488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c0617b0 0x7fb38c0fa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:07.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.354+0000 7fb391626700 1 -- 172.21.15.152:0/3518463488 >> 172.21.15.152:0/3518463488 conn(0x7fb38c0f1f10 msgr2=0x7fb38c0f4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:07.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.354+0000 7fb391626700 1 -- 172.21.15.152:0/3518463488 shutdown_connections 2024-04-06T12:20:07.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.354+0000 7fb391626700 1 -- 172.21.15.152:0/3518463488 wait complete. 2024-04-06T12:20:07.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.354+0000 7fb391626700 1 Processor -- start 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb391626700 1 -- start start 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb391626700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c0617b0 0x7fb38c108090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb391626700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 0x7fb38c108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb391626700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c108b30 con 0x7fb38c0fa980 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb391626700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c108c70 con 0x7fb38c0617b0 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38a7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 0x7fb38c108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c0617b0 0x7fb38c108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38a7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 0x7fb38c108580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42246/0 (socket says 172.21.15.152:42246) 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c0617b0 0x7fb38c108090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:60952/0 (socket says 172.21.15.152:60952) 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38a7fc700 1 -- 172.21.15.152:0/1614849658 learned_addr learned my addr 172.21.15.152:0/1614849658 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:07.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38a7fc700 1 -- 172.21.15.152:0/1614849658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c0617b0 msgr2=0x7fb38c108090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38a7fc700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c0617b0 0x7fb38c108090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38a7fc700 1 -- 172.21.15.152:0/1614849658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380005040 con 0x7fb38c0fa980 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38affd700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c0617b0 0x7fb38c108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.355+0000 7fb38a7fc700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 0x7fb38c108580 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fb380009380 tx=0x7fb380009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.356+0000 7fb373fff700 1 -- 172.21.15.152:0/1614849658 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb380018070 con 0x7fb38c0fa980 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.356+0000 7fb373fff700 1 -- 172.21.15.152:0/1614849658 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb380007e90 con 0x7fb38c0fa980 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.356+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c10d6b0 con 0x7fb38c0fa980 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.356+0000 7fb373fff700 1 -- 172.21.15.152:0/1614849658 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3800123c0 con 0x7fb38c0fa980 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.356+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c10dc70 con 0x7fb38c0fa980 2024-04-06T12:20:07.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.357+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c0fffe0 con 0x7fb38c0fa980 2024-04-06T12:20:07.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.358+0000 7fb373fff700 1 -- 172.21.15.152:0/1614849658 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fb38001d420 con 0x7fb38c0fa980 2024-04-06T12:20:07.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.358+0000 7fb373fff700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb374061180 0x7fb374063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:07.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.358+0000 7fb373fff700 1 -- 172.21.15.152:0/1614849658 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fb38007d6c0 con 0x7fb38c0fa980 2024-04-06T12:20:07.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.358+0000 7fb38affd700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb374061180 0x7fb374063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:07.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.359+0000 7fb38affd700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb374061180 0x7fb374063640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb38c061580 tx=0x7fb37c00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:07.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.362+0000 7fb373fff700 1 -- 172.21.15.152:0/1614849658 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb3800516d0 con 0x7fb38c0fa980 2024-04-06T12:20:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:05.542164+0000 mgr.smithi152.lynahm (mgr.14196) 203 : cluster [DBG] pgmap v176: 65 pgs: 4 creating+activating, 6 creating+peering, 55 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:06.295313+0000 mon.smithi152 (mon.0) 548 : cluster [DBG] mds.? [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] up:active 2024-04-06T12:20:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:06.295357+0000 mon.smithi152 (mon.0) 549 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 2024-04-06T12:20:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:07.016923+0000 mon.smithi152 (mon.0) 550 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:07.017883+0000 mon.smithi152 (mon.0) 551 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mxtfph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:20:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:07.023238+0000 mon.smithi152 (mon.0) 552 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mxtfph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-06T12:20:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:07.023832+0000 mon.smithi152 (mon.0) 553 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:07.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:07.051234+0000 mon.smithi152 (mon.0) 554 : cluster [DBG] mds.? [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] up:boot 2024-04-06T12:20:07.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:07.051283+0000 mon.smithi152 (mon.0) 555 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby 2024-04-06T12:20:07.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:07.051374+0000 mon.smithi152 (mon.0) 556 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:20:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:05.542164+0000 mgr.smithi152.lynahm (mgr.14196) 203 : cluster [DBG] pgmap v176: 65 pgs: 4 creating+activating, 6 creating+peering, 55 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:06.295313+0000 mon.smithi152 (mon.0) 548 : cluster [DBG] mds.? [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] up:active 2024-04-06T12:20:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:06.295357+0000 mon.smithi152 (mon.0) 549 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 2024-04-06T12:20:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:07.016923+0000 mon.smithi152 (mon.0) 550 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:07.017883+0000 mon.smithi152 (mon.0) 551 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mxtfph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:20:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:07.023238+0000 mon.smithi152 (mon.0) 552 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mxtfph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-06T12:20:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:07.023832+0000 mon.smithi152 (mon.0) 553 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:07.051234+0000 mon.smithi152 (mon.0) 554 : cluster [DBG] mds.? [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] up:boot 2024-04-06T12:20:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:07.051283+0000 mon.smithi152 (mon.0) 555 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby 2024-04-06T12:20:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:07.051374+0000 mon.smithi152 (mon.0) 556 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:20:07.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:07.571+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fb38c101fe0 con 0x7fb38c0fa980 2024-04-06T12:20:08.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.303+0000 7fb373fff700 1 -- 172.21.15.152:0/1614849658 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb3800512c0 con 0x7fb38c0fa980 2024-04-06T12:20:08.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb374061180 msgr2=0x7fb374063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:08.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb374061180 0x7fb374063640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb38c061580 tx=0x7fb37c00b040).stop 2024-04-06T12:20:08.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 msgr2=0x7fb38c108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:08.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 0x7fb38c108580 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fb380009380 tx=0x7fb380009cb0).stop 2024-04-06T12:20:08.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 shutdown_connections 2024-04-06T12:20:08.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fb374061180 0x7fb374063640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:08.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c0617b0 0x7fb38c108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:08.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 --2- 172.21.15.152:0/1614849658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb38c0fa980 0x7fb38c108580 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:08.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 >> 172.21.15.152:0/1614849658 conn(0x7fb38c0f1f10 msgr2=0x7fb38c0f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:08.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 shutdown_connections 2024-04-06T12:20:08.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:08.305+0000 7fb391626700 1 -- 172.21.15.152:0/1614849658 wait complete. 2024-04-06T12:20:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:20:07.024313+0000 mgr.smithi152.lynahm (mgr.14196) 204 : cephadm [INF] Deploying daemon mds.cephfs.smithi152.mxtfph on smithi152 2024-04-06T12:20:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:07.573010+0000 mon.smithi152 (mon.0) 557 : audit [INF] from='client.? 172.21.15.152:0/1614849658' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-06T12:20:08.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:20:07.024313+0000 mgr.smithi152.lynahm (mgr.14196) 204 : cephadm [INF] Deploying daemon mds.cephfs.smithi152.mxtfph on smithi152 2024-04-06T12:20:08.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:07.573010+0000 mon.smithi152 (mon.0) 557 : audit [INF] from='client.? 172.21.15.152:0/1614849658' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-06T12:20:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:07.542532+0000 mgr.smithi152.lynahm (mgr.14196) 205 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 2.1 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:08.304342+0000 mon.smithi152 (mon.0) 558 : audit [INF] from='client.? 172.21.15.152:0/1614849658' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-06T12:20:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:08.304399+0000 mon.smithi152 (mon.0) 559 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby 2024-04-06T12:20:09.672 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-06T12:20:09.682 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:20:09.683 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-04-06T12:20:09.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:07.542532+0000 mgr.smithi152.lynahm (mgr.14196) 205 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 2.1 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-06T12:20:09.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:08.304342+0000 mon.smithi152 (mon.0) 558 : audit [INF] from='client.? 172.21.15.152:0/1614849658' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-06T12:20:09.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:08.304399+0000 mon.smithi152 (mon.0) 559 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby 2024-04-06T12:20:11.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:09.543072+0000 mgr.smithi152.lynahm (mgr.14196) 206 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 9 op/s 2024-04-06T12:20:11.555 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:10.467553+0000 mon.smithi152 (mon.0) 560 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:11.555 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:10.468495+0000 mon.smithi152 (mon.0) 561 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.ttgcpp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:20:11.555 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:10.473488+0000 mon.smithi152 (mon.0) 562 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.ttgcpp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-06T12:20:11.555 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:10.474060+0000 mon.smithi152 (mon.0) 563 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:11.555 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:10.698152+0000 mon.smithi152 (mon.0) 564 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:11.683 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:09.543072+0000 mgr.smithi152.lynahm (mgr.14196) 206 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 9 op/s 2024-04-06T12:20:11.683 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:10.467553+0000 mon.smithi152 (mon.0) 560 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:11.683 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:10.468495+0000 mon.smithi152 (mon.0) 561 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.ttgcpp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:20:11.684 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:10.473488+0000 mon.smithi152 (mon.0) 562 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.ttgcpp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-06T12:20:11.684 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:10.474060+0000 mon.smithi152 (mon.0) 563 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:11.684 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:10.698152+0000 mon.smithi152 (mon.0) 564 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.815+0000 7f52d5b44700 1 -- 172.21.15.152:0/1285563183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52d00f7a10 msgr2=0x7f52d00f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.815+0000 7f52d5b44700 1 --2- 172.21.15.152:0/1285563183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52d00f7a10 0x7f52d00f7e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f52c40047f0 tx=0x7f52c4009cb0).stop 2024-04-06T12:20:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.815+0000 7f52d5b44700 1 -- 172.21.15.152:0/1285563183 shutdown_connections 2024-04-06T12:20:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.815+0000 7f52d5b44700 1 --2- 172.21.15.152:0/1285563183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52d00f8cb0 0x7f52d00f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.815+0000 7f52d5b44700 1 --2- 172.21.15.152:0/1285563183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52d00f7a10 0x7f52d00f7e30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.815+0000 7f52d5b44700 1 -- 172.21.15.152:0/1285563183 >> 172.21.15.152:0/1285563183 conn(0x7f52d00f3150 msgr2=0x7f52d00f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.816+0000 7f52d5b44700 1 -- 172.21.15.152:0/1285563183 shutdown_connections 2024-04-06T12:20:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.816+0000 7f52d5b44700 1 -- 172.21.15.152:0/1285563183 wait complete. 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.816+0000 7f52d5b44700 1 Processor -- start 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.816+0000 7f52d5b44700 1 -- start start 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.816+0000 7f52d5b44700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52d00f7a10 0x7f52d006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.816+0000 7f52d5b44700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52d00f8cb0 0x7f52d006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.816+0000 7f52d5b44700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d006cf80 con 0x7f52d00f8cb0 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.816+0000 7f52d5b44700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d006b520 con 0x7f52d00f7a10 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ceffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52d00f8cb0 0x7f52d006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ceffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52d00f8cb0 0x7f52d006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42288/0 (socket says 172.21.15.152:42288) 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ceffd700 1 -- 172.21.15.152:0/3873094583 learned_addr learned my addr 172.21.15.152:0/3873094583 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52cf7fe700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52d00f7a10 0x7f52d006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ceffd700 1 -- 172.21.15.152:0/3873094583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52d00f7a10 msgr2=0x7f52d006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ceffd700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52d00f7a10 0x7f52d006c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ceffd700 1 -- 172.21.15.152:0/3873094583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0005040 con 0x7f52d00f8cb0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ceffd700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52d00f8cb0 0x7f52d006b030 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f52c0004870 tx=0x7f52c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ccff9700 1 -- 172.21.15.152:0/3873094583 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52c0010500 con 0x7f52d00f8cb0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c4005040 con 0x7f52d00f8cb0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ccff9700 1 -- 172.21.15.152:0/3873094583 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f52c000f040 con 0x7f52d00f8cb0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52ccff9700 1 -- 172.21.15.152:0/3873094583 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52c00149f0 con 0x7f52d00f8cb0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.817+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d006bbd0 con 0x7f52d00f8cb0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.818+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d005fb50 con 0x7f52d00f8cb0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.818+0000 7f52ccff9700 1 -- 172.21.15.152:0/3873094583 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f52c0014cb0 con 0x7f52d00f8cb0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.819+0000 7f52ccff9700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b8061180 0x7f52b8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.819+0000 7f52ccff9700 1 -- 172.21.15.152:0/3873094583 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f52c007c310 con 0x7f52d00f8cb0 2024-04-06T12:20:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.819+0000 7f52cf7fe700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b8061180 0x7f52b8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.819+0000 7f52cf7fe700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b8061180 0x7f52b8063640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f52c40047c0 tx=0x7f52c4009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:11.823+0000 7f52ccff9700 1 -- 172.21.15.152:0/3873094583 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f52c0049f60 con 0x7f52d00f8cb0 2024-04-06T12:20:12.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.026+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f52d006be50 con 0x7f52d00f8cb0 2024-04-06T12:20:12.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.049+0000 7f52ccff9700 1 -- 172.21.15.152:0/3873094583 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f52c00502a0 con 0x7f52d00f8cb0 2024-04-06T12:20:12.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b8061180 msgr2=0x7f52b8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:12.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b8061180 0x7f52b8063640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f52c40047c0 tx=0x7f52c4009cb0).stop 2024-04-06T12:20:12.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52d00f8cb0 msgr2=0x7f52d006b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:12.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52d00f8cb0 0x7f52d006b030 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f52c0004870 tx=0x7f52c0009cb0).stop 2024-04-06T12:20:12.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 shutdown_connections 2024-04-06T12:20:12.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f52b8061180 0x7f52b8063640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:12.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52d00f7a10 0x7f52d006c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:12.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 --2- 172.21.15.152:0/3873094583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52d00f8cb0 0x7f52d006b030 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:12.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 >> 172.21.15.152:0/3873094583 conn(0x7f52d00f3150 msgr2=0x7f52d00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:12.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 shutdown_connections 2024-04-06T12:20:12.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:12.052+0000 7f52d5b44700 1 -- 172.21.15.152:0/3873094583 wait complete. 2024-04-06T12:20:12.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:20:10.474522+0000 mgr.smithi152.lynahm (mgr.14196) 207 : cephadm [INF] Deploying daemon mds.cephfs.smithi195.ttgcpp on smithi195 2024-04-06T12:20:12.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:11.305734+0000 mon.smithi152 (mon.0) 565 : cluster [DBG] mds.? [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] up:boot 2024-04-06T12:20:12.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:11.305778+0000 mon.smithi152 (mon.0) 566 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 2 up:standby 2024-04-06T12:20:12.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:11.306229+0000 mon.smithi152 (mon.0) 567 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:20:12.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:11.543460+0000 mgr.smithi152.lynahm (mgr.14196) 208 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 4 op/s 2024-04-06T12:20:12.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:12.027640+0000 mon.smithi152 (mon.0) 568 : audit [INF] from='client.? 172.21.15.152:0/3873094583' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-06T12:20:12.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:12.050604+0000 mon.smithi152 (mon.0) 569 : audit [INF] from='client.? 172.21.15.152:0/3873094583' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-06T12:20:12.349 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:12.050657+0000 mon.smithi152 (mon.0) 570 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 1 up:standby 2024-04-06T12:20:12.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:20:10.474522+0000 mgr.smithi152.lynahm (mgr.14196) 207 : cephadm [INF] Deploying daemon mds.cephfs.smithi195.ttgcpp on smithi195 2024-04-06T12:20:12.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:11.305734+0000 mon.smithi152 (mon.0) 565 : cluster [DBG] mds.? [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] up:boot 2024-04-06T12:20:12.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:11.305778+0000 mon.smithi152 (mon.0) 566 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 2 up:standby 2024-04-06T12:20:12.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:11.306229+0000 mon.smithi152 (mon.0) 567 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:20:12.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:11.543460+0000 mgr.smithi152.lynahm (mgr.14196) 208 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 4 op/s 2024-04-06T12:20:12.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:12.027640+0000 mon.smithi152 (mon.0) 568 : audit [INF] from='client.? 172.21.15.152:0/3873094583' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-06T12:20:12.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:12.050604+0000 mon.smithi152 (mon.0) 569 : audit [INF] from='client.? 172.21.15.152:0/3873094583' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-06T12:20:12.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:12.050657+0000 mon.smithi152 (mon.0) 570 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 1 up:standby 2024-04-06T12:20:12.749 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-06T12:20:12.759 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:20:12.759 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-04-06T12:20:14.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:13.058725+0000 mon.smithi152 (mon.0) 571 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:14.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:13.059733+0000 mon.smithi152 (mon.0) 572 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:20:14.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:13.314716+0000 mon.smithi152 (mon.0) 573 : cluster [DBG] mds.? [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] up:boot 2024-04-06T12:20:14.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:13.314771+0000 mon.smithi152 (mon.0) 574 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:20:14.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:13.314870+0000 mon.smithi152 (mon.0) 575 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:20:14.509 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:13.058725+0000 mon.smithi152 (mon.0) 571 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:14.509 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:13.059733+0000 mon.smithi152 (mon.0) 572 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:20:14.509 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:13.314716+0000 mon.smithi152 (mon.0) 573 : cluster [DBG] mds.? [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] up:boot 2024-04-06T12:20:14.509 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:13.314771+0000 mon.smithi152 (mon.0) 574 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:20:14.509 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:13.314870+0000 mon.smithi152 (mon.0) 575 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:20:15.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/2406108390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f7990 msgr2=0x7f3b880f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 --2- 172.21.15.152:0/2406108390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f7990 0x7f3b880f7df0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f3b7c0047f0 tx=0x7f3b7c009cb0).stop 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/2406108390 shutdown_connections 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 --2- 172.21.15.152:0/2406108390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f7990 0x7f3b880f7df0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 --2- 172.21.15.152:0/2406108390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b880f66f0 0x7f3b880f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/2406108390 >> 172.21.15.152:0/2406108390 conn(0x7f3b880f1e50 msgr2=0x7f3b880f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/2406108390 shutdown_connections 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/2406108390 wait complete. 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 Processor -- start 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.001+0000 7f3b8cd6c700 1 -- start start 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8cd6c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f66f0 0x7f3b88106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8cd6c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b880f7990 0x7f3b881073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8cd6c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88107950 con 0x7f3b880f66f0 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8cd6c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88107a90 con 0x7f3b880f7990 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f66f0 0x7f3b88106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f66f0 0x7f3b88106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47538/0 (socket says 172.21.15.152:47538) 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8659c700 1 -- 172.21.15.152:0/1131444448 learned_addr learned my addr 172.21.15.152:0/1131444448 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b85d9b700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b880f7990 0x7f3b881073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8659c700 1 -- 172.21.15.152:0/1131444448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b880f7990 msgr2=0x7f3b881073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8659c700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b880f7990 0x7f3b881073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8659c700 1 -- 172.21.15.152:0/1131444448 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c005040 con 0x7f3b880f66f0 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8659c700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f66f0 0x7f3b88106eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f3b78002780 tx=0x7f3b78009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b777fe700 1 -- 172.21.15.152:0/1131444448 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b78007b40 con 0x7f3b880f66f0 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8810c4e0 con 0x7f3b880f66f0 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b777fe700 1 -- 172.21.15.152:0/1131444448 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3b7800f040 con 0x7f3b880f66f0 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b777fe700 1 -- 172.21.15.152:0/1131444448 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b78014780 con 0x7f3b880f66f0 2024-04-06T12:20:15.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.002+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8810ca20 con 0x7f3b880f66f0 2024-04-06T12:20:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.003+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b880feed0 con 0x7f3b880f66f0 2024-04-06T12:20:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.004+0000 7f3b777fe700 1 -- 172.21.15.152:0/1131444448 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f3b78007ca0 con 0x7f3b880f66f0 2024-04-06T12:20:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.004+0000 7f3b777fe700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3b700611d0 0x7f3b70063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.004+0000 7f3b777fe700 1 -- 172.21.15.152:0/1131444448 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f3b7807c8b0 con 0x7f3b880f66f0 2024-04-06T12:20:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.004+0000 7f3b85d9b700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3b700611d0 0x7f3b70063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.005+0000 7f3b85d9b700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3b700611d0 0x7f3b70063690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3b7c0047c0 tx=0x7f3b7c00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.008+0000 7f3b777fe700 1 -- 172.21.15.152:0/1131444448 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3b78050780 con 0x7f3b880f66f0 2024-04-06T12:20:15.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:15.218+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3b88100d40 con 0x7f3b880f66f0 2024-04-06T12:20:15.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:13.544000+0000 mgr.smithi152.lynahm (mgr.14196) 209 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 341 B/s wr, 3 op/s 2024-04-06T12:20:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:13.544000+0000 mgr.smithi152.lynahm (mgr.14196) 209 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 341 B/s wr, 3 op/s 2024-04-06T12:20:16.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.064+0000 7f3b777fe700 1 -- 172.21.15.152:0/1131444448 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v11) v1 ==== 168+0+0 (secure 0 0 0) 0x7f3b78050370 con 0x7f3b880f66f0 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.065+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3b700611d0 msgr2=0x7f3b70063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.065+0000 7f3b8cd6c700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3b700611d0 0x7f3b70063690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3b7c0047c0 tx=0x7f3b7c00b040).stop 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.065+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f66f0 msgr2=0x7f3b88106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.065+0000 7f3b8cd6c700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f66f0 0x7f3b88106eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f3b78002780 tx=0x7f3b78009ee0).stop 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.066+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 shutdown_connections 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.066+0000 7f3b8cd6c700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3b700611d0 0x7f3b70063690 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.066+0000 7f3b8cd6c700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b880f66f0 0x7f3b88106eb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.066+0000 7f3b8cd6c700 1 --2- 172.21.15.152:0/1131444448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b880f7990 0x7f3b881073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.066+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 >> 172.21.15.152:0/1131444448 conn(0x7f3b880f1e50 msgr2=0x7f3b880fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.066+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 shutdown_connections 2024-04-06T12:20:16.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:16.066+0000 7f3b8cd6c700 1 -- 172.21.15.152:0/1131444448 wait complete. 2024-04-06T12:20:16.065 INFO:teuthology.orchestra.run.smithi152.stderr:inline data enabled 2024-04-06T12:20:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:15.219912+0000 mon.smithi152 (mon.0) 576 : audit [INF] from='client.? 172.21.15.152:0/1131444448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T12:20:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:15.648161+0000 mon.smithi152 (mon.0) 577 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:15.876984+0000 mon.smithi152 (mon.0) 578 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:15.914425+0000 mon.smithi152 (mon.0) 579 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:15.219912+0000 mon.smithi152 (mon.0) 576 : audit [INF] from='client.? 172.21.15.152:0/1131444448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-06T12:20:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:15.648161+0000 mon.smithi152 (mon.0) 577 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:15.876984+0000 mon.smithi152 (mon.0) 578 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:15.914425+0000 mon.smithi152 (mon.0) 579 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:16.894 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-06T12:20:16.905 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:20:16.906 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph fs dump' 2024-04-06T12:20:17.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:15.544350+0000 mgr.smithi152.lynahm (mgr.14196) 210 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 255 B/s wr, 2 op/s 2024-04-06T12:20:17.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:16.059953+0000 mon.smithi152 (mon.0) 580 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-06T12:20:17.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:16.065010+0000 mon.smithi152 (mon.0) 581 : audit [INF] from='client.? 172.21.15.152:0/1131444448' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T12:20:17.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:16.065095+0000 mon.smithi152 (mon.0) 582 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:20:17.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:15.544350+0000 mgr.smithi152.lynahm (mgr.14196) 210 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 255 B/s wr, 2 op/s 2024-04-06T12:20:17.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:16.059953+0000 mon.smithi152 (mon.0) 580 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-06T12:20:17.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:16.065010+0000 mon.smithi152 (mon.0) 581 : audit [INF] from='client.? 172.21.15.152:0/1131444448' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-06T12:20:17.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:16.065095+0000 mon.smithi152 (mon.0) 582 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:20:19.143 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:17.544720+0000 mgr.smithi152.lynahm (mgr.14196) 211 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 204 B/s wr, 3 op/s 2024-04-06T12:20:19.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.369+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3155975003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 msgr2=0x7fa2c40f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.369+0000 7fa2c90eb700 1 --2- 172.21.15.152:0/3155975003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 0x7fa2c40f8b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fa2b80047f0 tx=0x7fa2b8009cb0).stop 2024-04-06T12:20:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.369+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3155975003 shutdown_connections 2024-04-06T12:20:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.369+0000 7fa2c90eb700 1 --2- 172.21.15.152:0/3155975003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 0x7fa2c40f8b10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.369+0000 7fa2c90eb700 1 --2- 172.21.15.152:0/3155975003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c40f77d0 0x7fa2c40f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.369+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3155975003 >> 172.21.15.152:0/3155975003 conn(0x7fa2c40f2fb0 msgr2=0x7fa2c40f53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.369+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3155975003 shutdown_connections 2024-04-06T12:20:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.369+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3155975003 wait complete. 2024-04-06T12:20:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.370+0000 7fa2c90eb700 1 Processor -- start 2024-04-06T12:20:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.370+0000 7fa2c90eb700 1 -- start start 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.370+0000 7fa2c90eb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c40f77d0 0x7fa2c406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.370+0000 7fa2c90eb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 0x7fa2c406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.370+0000 7fa2c90eb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c406cf80 con 0x7fa2c40f80e0 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.370+0000 7fa2c90eb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c406b520 con 0x7fa2c40f77d0 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 0x7fa2c406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 0x7fa2c406b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47558/0 (socket says 172.21.15.152:47558) 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c259c700 1 -- 172.21.15.152:0/3060664003 learned_addr learned my addr 172.21.15.152:0/3060664003 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c2d9d700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c40f77d0 0x7fa2c406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c259c700 1 -- 172.21.15.152:0/3060664003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c40f77d0 msgr2=0x7fa2c406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c259c700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c40f77d0 0x7fa2c406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c259c700 1 -- 172.21.15.152:0/3060664003 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8005040 con 0x7fa2c40f80e0 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c259c700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 0x7fa2c406b030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fa2b8013470 tx=0x7fa2b8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2abfff700 1 -- 172.21.15.152:0/3060664003 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2b800e030 con 0x7fa2c40f80e0 2024-04-06T12:20:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c406b740 con 0x7fa2c40f80e0 2024-04-06T12:20:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2abfff700 1 -- 172.21.15.152:0/3060664003 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa2b8007e90 con 0x7fa2c40f80e0 2024-04-06T12:20:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2abfff700 1 -- 172.21.15.152:0/3060664003 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2b8018070 con 0x7fa2c40f80e0 2024-04-06T12:20:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.371+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c406bc20 con 0x7fa2c40f80e0 2024-04-06T12:20:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.372+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c40fffd0 con 0x7fa2c40f80e0 2024-04-06T12:20:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.372+0000 7fa2abfff700 1 -- 172.21.15.152:0/3060664003 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fa2b801d420 con 0x7fa2c40f80e0 2024-04-06T12:20:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.373+0000 7fa2abfff700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa2ac061180 0x7fa2ac063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.373+0000 7fa2abfff700 1 -- 172.21.15.152:0/3060664003 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fa2b807dd40 con 0x7fa2c40f80e0 2024-04-06T12:20:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.373+0000 7fa2c2d9d700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa2ac061180 0x7fa2ac063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.373+0000 7fa2c2d9d700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa2ac061180 0x7fa2ac063640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa2b4009250 tx=0x7fa2b4009d60).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:19.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.377+0000 7fa2abfff700 1 -- 172.21.15.152:0/3060664003 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa2b8051cd0 con 0x7fa2c40f80e0 2024-04-06T12:20:19.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:17.544720+0000 mgr.smithi152.lynahm (mgr.14196) 211 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 204 B/s wr, 3 op/s 2024-04-06T12:20:19.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.584+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa2c40598f0 con 0x7fa2c40f80e0 2024-04-06T12:20:19.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.584+0000 7fa2abfff700 1 -- 172.21.15.152:0/3060664003 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1778 (secure 0 0 0) 0x7fa2b80518c0 con 0x7fa2c40f80e0 2024-04-06T12:20:19.583 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:20:19.583 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:20:19.583 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:20:19.583 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:20:19.583 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:20:19.583 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:20:19.583 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:20:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:20:19.585 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:20:19.586 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:20:19.586 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:20:19.586 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:20:19.586 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:20:19.586 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:20:19.586 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:20:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa2ac061180 msgr2=0x7fa2ac063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa2ac061180 0x7fa2ac063640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa2b4009250 tx=0x7fa2b4009d60).stop 2024-04-06T12:20:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 msgr2=0x7fa2c406b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 0x7fa2c406b030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fa2b8013470 tx=0x7fa2b8009cb0).stop 2024-04-06T12:20:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 shutdown_connections 2024-04-06T12:20:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa2ac061180 0x7fa2ac063640 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2c40f77d0 0x7fa2c406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 --2- 172.21.15.152:0/3060664003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2c40f80e0 0x7fa2c406b030 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 >> 172.21.15.152:0/3060664003 conn(0x7fa2c40f2fb0 msgr2=0x7fa2c40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 shutdown_connections 2024-04-06T12:20:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:19.586+0000 7fa2c90eb700 1 -- 172.21.15.152:0/3060664003 wait complete. 2024-04-06T12:20:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:20:20.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:19.585729+0000 mon.smithi152 (mon.0) 583 : audit [DBG] from='client.? 172.21.15.152:0/3060664003' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:20:20.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:19.585729+0000 mon.smithi152 (mon.0) 583 : audit [DBG] from='client.? 172.21.15.152:0/3060664003' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:20:20.716 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-06T12:20:21.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:19.545247+0000 mgr.smithi152.lynahm (mgr.14196) 212 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 170 B/s wr, 3 op/s 2024-04-06T12:20:21.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:20.924449+0000 mon.smithi152 (mon.0) 584 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:21.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:20.925378+0000 mon.smithi152 (mon.0) 585 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:21.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:20.926136+0000 mon.smithi152 (mon.0) 586 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:20:21.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:20.930720+0000 mon.smithi152 (mon.0) 587 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:21.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:20.935705+0000 mon.smithi152 (mon.0) 588 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:20:21.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:19.545247+0000 mgr.smithi152.lynahm (mgr.14196) 212 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 170 B/s wr, 3 op/s 2024-04-06T12:20:21.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:20.924449+0000 mon.smithi152 (mon.0) 584 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:21.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:20.925378+0000 mon.smithi152 (mon.0) 585 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:21.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:20.926136+0000 mon.smithi152 (mon.0) 586 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:20:21.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:20.930720+0000 mon.smithi152 (mon.0) 587 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:21.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:20.935705+0000 mon.smithi152 (mon.0) 588 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:20:23.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.992+0000 7f04f5d86700 1 -- 172.21.15.152:0/1948102171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 msgr2=0x7f04f00f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:23.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.992+0000 7f04f5d86700 1 --2- 172.21.15.152:0/1948102171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 0x7f04f00f7c00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f04e00047f0 tx=0x7f04e0009cb0).stop 2024-04-06T12:20:23.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.992+0000 7f04f5d86700 1 -- 172.21.15.152:0/1948102171 shutdown_connections 2024-04-06T12:20:23.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.992+0000 7f04f5d86700 1 --2- 172.21.15.152:0/1948102171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f00f80f0 0x7f04f00f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.992+0000 7f04f5d86700 1 --2- 172.21.15.152:0/1948102171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 0x7f04f00f7c00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.992+0000 7f04f5d86700 1 -- 172.21.15.152:0/1948102171 >> 172.21.15.152:0/1948102171 conn(0x7f04f00f2fc0 msgr2=0x7f04f00f5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.992+0000 7f04f5d86700 1 -- 172.21.15.152:0/1948102171 shutdown_connections 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.992+0000 7f04f5d86700 1 -- 172.21.15.152:0/1948102171 wait complete. 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04f5d86700 1 Processor -- start 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04f5d86700 1 -- start start 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04f5d86700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 0x7f04f0107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04f5d86700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f00f80f0 0x7f04f0108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04f5d86700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01089f0 con 0x7f04f00f77e0 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04f5d86700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0108b30 con 0x7f04f00f80f0 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04ef7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 0x7f04f0107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04ef7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 0x7f04f0107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56794/0 (socket says 172.21.15.152:56794) 2024-04-06T12:20:23.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04ef7fe700 1 -- 172.21.15.152:0/18949848 learned_addr learned my addr 172.21.15.152:0/18949848 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04eeffd700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f00f80f0 0x7f04f0108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04ef7fe700 1 -- 172.21.15.152:0/18949848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f00f80f0 msgr2=0x7f04f0108440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04ef7fe700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f00f80f0 0x7f04f0108440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.993+0000 7f04ef7fe700 1 -- 172.21.15.152:0/18949848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0005040 con 0x7f04f00f77e0 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.994+0000 7f04ef7fe700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 0x7f04f0107f50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f04e0013470 tx=0x7f04e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.994+0000 7f04ecff9700 1 -- 172.21.15.152:0/18949848 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e000e030 con 0x7f04f00f77e0 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.994+0000 7f04ecff9700 1 -- 172.21.15.152:0/18949848 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f04e0007e90 con 0x7f04f00f77e0 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.994+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f010d570 con 0x7f04f00f77e0 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.994+0000 7f04ecff9700 1 -- 172.21.15.152:0/18949848 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e0018070 con 0x7f04f00f77e0 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.994+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f010dab0 con 0x7f04f00f77e0 2024-04-06T12:20:23.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.995+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f00fffe0 con 0x7f04f00f77e0 2024-04-06T12:20:23.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.995+0000 7f04ecff9700 1 -- 172.21.15.152:0/18949848 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f04e001d420 con 0x7f04f00f77e0 2024-04-06T12:20:23.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.995+0000 7f04ecff9700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f04d8061110 0x7f04d80635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:23.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.995+0000 7f04ecff9700 1 -- 172.21.15.152:0/18949848 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f04e007dc70 con 0x7f04f00f77e0 2024-04-06T12:20:23.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.995+0000 7f04eeffd700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f04d8061110 0x7f04d80635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:23.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:22.996+0000 7f04eeffd700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f04d8061110 0x7f04d80635d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f04e4004dc0 tx=0x7f04e400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:23.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.000+0000 7f04ecff9700 1 -- 172.21.15.152:0/18949848 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f04e0051c00 con 0x7f04f00f77e0 2024-04-06T12:20:23.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.208+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04f00598f0 con 0x7f04f00f77e0 2024-04-06T12:20:23.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.208+0000 7f04ecff9700 1 -- 172.21.15.152:0/18949848 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f04e00517f0 con 0x7f04f00f77e0 2024-04-06T12:20:23.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f04d8061110 msgr2=0x7f04d80635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f04d8061110 0x7f04d80635d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f04e4004dc0 tx=0x7f04e400b040).stop 2024-04-06T12:20:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 msgr2=0x7f04f0107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 0x7f04f0107f50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f04e0013470 tx=0x7f04e0009cb0).stop 2024-04-06T12:20:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 shutdown_connections 2024-04-06T12:20:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f04d8061110 0x7f04d80635d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04f00f77e0 0x7f04f0107f50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 --2- 172.21.15.152:0/18949848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f00f80f0 0x7f04f0108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 >> 172.21.15.152:0/18949848 conn(0x7f04f00f2fc0 msgr2=0x7f04f00fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:23.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 shutdown_connections 2024-04-06T12:20:23.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:23.210+0000 7f04f5d86700 1 -- 172.21.15.152:0/18949848 wait complete. 2024-04-06T12:20:23.210 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:20:23.218 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:20:23.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:21.545611+0000 mgr.smithi152.lynahm (mgr.14196) 213 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T12:20:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:21.545611+0000 mgr.smithi152.lynahm (mgr.14196) 213 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T12:20:24.173 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:23.209747+0000 mon.smithi152 (mon.0) 589 : audit [DBG] from='client.? 172.21.15.152:0/18949848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-06T12:20:24.173 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:23.774640+0000 mon.smithi152 (mon.0) 590 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:24.192 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-06T12:20:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:23.209747+0000 mon.smithi152 (mon.0) 589 : audit [DBG] from='client.? 172.21.15.152:0/18949848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-06T12:20:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:23.774640+0000 mon.smithi152 (mon.0) 590 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:25.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:23.546021+0000 mgr.smithi152.lynahm (mgr.14196) 214 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T12:20:25.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:23.546021+0000 mgr.smithi152.lynahm (mgr.14196) 214 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-06T12:20:26.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.772+0000 7fa2537fd700 1 -- 172.21.15.152:0/2501049441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 msgr2=0x7fa24c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:26.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.772+0000 7fa2537fd700 1 --2- 172.21.15.152:0/2501049441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 0x7fa24c0f6b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fa2400047f0 tx=0x7fa240009cb0).stop 2024-04-06T12:20:26.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.772+0000 7fa2537fd700 1 -- 172.21.15.152:0/2501049441 shutdown_connections 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.772+0000 7fa2537fd700 1 --2- 172.21.15.152:0/2501049441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa24c0f7990 0x7fa24c0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.772+0000 7fa2537fd700 1 --2- 172.21.15.152:0/2501049441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 0x7fa24c0f6b10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.772+0000 7fa2537fd700 1 -- 172.21.15.152:0/2501049441 >> 172.21.15.152:0/2501049441 conn(0x7fa24c0f1e50 msgr2=0x7fa24c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.772+0000 7fa2537fd700 1 -- 172.21.15.152:0/2501049441 shutdown_connections 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.772+0000 7fa2537fd700 1 -- 172.21.15.152:0/2501049441 wait complete. 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.772+0000 7fa2537fd700 1 Processor -- start 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa2537fd700 1 -- start start 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa2537fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 0x7fa24c107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa2537fd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa24c0f7990 0x7fa24c108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa2537fd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c108a40 con 0x7fa24c0f66f0 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa2537fd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c108b80 con 0x7fa24c0f7990 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa251599700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 0x7fa24c107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:26.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa251599700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 0x7fa24c107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56798/0 (socket says 172.21.15.152:56798) 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa251599700 1 -- 172.21.15.152:0/866027526 learned_addr learned my addr 172.21.15.152:0/866027526 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa250d98700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa24c0f7990 0x7fa24c108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa251599700 1 -- 172.21.15.152:0/866027526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa24c0f7990 msgr2=0x7fa24c108490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa251599700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa24c0f7990 0x7fa24c108490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa251599700 1 -- 172.21.15.152:0/866027526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240005040 con 0x7fa24c0f66f0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa251599700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 0x7fa24c107fa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa240013470 tx=0x7fa240009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa23e7fc700 1 -- 172.21.15.152:0/866027526 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24000e030 con 0x7fa24c0f66f0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa23e7fc700 1 -- 172.21.15.152:0/866027526 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa240007e90 con 0x7fa24c0f66f0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa23e7fc700 1 -- 172.21.15.152:0/866027526 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa240018070 con 0x7fa24c0f66f0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c10d5c0 con 0x7fa24c0f66f0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.773+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c10db00 con 0x7fa24c0f66f0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.774+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c0feed0 con 0x7fa24c0f66f0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.775+0000 7fa23e7fc700 1 -- 172.21.15.152:0/866027526 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fa24001d940 con 0x7fa24c0f66f0 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.775+0000 7fa23e7fc700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa238061180 0x7fa238063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:26.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.775+0000 7fa23e7fc700 1 -- 172.21.15.152:0/866027526 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fa24007def0 con 0x7fa24c0f66f0 2024-04-06T12:20:26.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.775+0000 7fa250d98700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa238061180 0x7fa238063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:26.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.775+0000 7fa250d98700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa238061180 0x7fa238063640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa2480041d0 tx=0x7fa248009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:26.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:26.779+0000 7fa23e7fc700 1 -- 172.21.15.152:0/866027526 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa240051e80 con 0x7fa24c0f66f0 2024-04-06T12:20:27.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.009+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fa24c10e430 con 0x7fa24c0f66f0 2024-04-06T12:20:27.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.009+0000 7fa23e7fc700 1 -- 172.21.15.152:0/866027526 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v11) v1 ==== 78+0+99 (secure 0 0 0) 0x7fa240051a70 con 0x7fa24c0f66f0 2024-04-06T12:20:27.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa238061180 msgr2=0x7fa238063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa238061180 0x7fa238063640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa2480041d0 tx=0x7fa248009040).stop 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 msgr2=0x7fa24c107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 0x7fa24c107fa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa240013470 tx=0x7fa240009cb0).stop 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 shutdown_connections 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa238061180 0x7fa238063640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa24c0f66f0 0x7fa24c107fa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 --2- 172.21.15.152:0/866027526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa24c0f7990 0x7fa24c108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 >> 172.21.15.152:0/866027526 conn(0x7fa24c0f1e50 msgr2=0x7fa24c060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.011+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 shutdown_connections 2024-04-06T12:20:27.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:27.012+0000 7fa2537fd700 1 -- 172.21.15.152:0/866027526 wait complete. 2024-04-06T12:20:27.020 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:20:27.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:25.546439+0000 mgr.smithi152.lynahm (mgr.14196) 215 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-06T12:20:27.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:27.010844+0000 mon.smithi152 (mon.0) 591 : audit [DBG] from='client.? 172.21.15.152:0/866027526' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-06T12:20:27.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:25.546439+0000 mgr.smithi152.lynahm (mgr.14196) 215 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-06T12:20:27.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:27.010844+0000 mon.smithi152 (mon.0) 591 : audit [DBG] from='client.? 172.21.15.152:0/866027526' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-06T12:20:27.841 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-06T12:20:27.854 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-06T12:20:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.196+0000 7f68c15c0700 1 -- 172.21.15.152:0/3974135060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 msgr2=0x7f68bc0f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.196+0000 7f68c15c0700 1 --2- 172.21.15.152:0/3974135060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 0x7f68bc0f7e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f68ac0047f0 tx=0x7f68ac009cb0).stop 2024-04-06T12:20:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.196+0000 7f68c15c0700 1 -- 172.21.15.152:0/3974135060 shutdown_connections 2024-04-06T12:20:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.196+0000 7f68c15c0700 1 --2- 172.21.15.152:0/3974135060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 0x7f68bc0f7e10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.196+0000 7f68c15c0700 1 --2- 172.21.15.152:0/3974135060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68bc0f6710 0x7f68bc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.196+0000 7f68c15c0700 1 -- 172.21.15.152:0/3974135060 >> 172.21.15.152:0/3974135060 conn(0x7f68bc0f1e50 msgr2=0x7f68bc0f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.196+0000 7f68c15c0700 1 -- 172.21.15.152:0/3974135060 shutdown_connections 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.196+0000 7f68c15c0700 1 -- 172.21.15.152:0/3974135060 wait complete. 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.197+0000 7f68c15c0700 1 Processor -- start 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.197+0000 7f68c15c0700 1 -- start start 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.197+0000 7f68c15c0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68bc0f6710 0x7f68bc061140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.197+0000 7f68c15c0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 0x7f68bc10ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.197+0000 7f68c15c0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc10d1c0 con 0x7f68bc0f79b0 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.197+0000 7f68c15c0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc10d300 con 0x7f68bc0f6710 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68ba7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 0x7f68bc10ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68ba7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 0x7f68bc10ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56808/0 (socket says 172.21.15.152:56808) 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68ba7fc700 1 -- 172.21.15.152:0/410301967 learned_addr learned my addr 172.21.15.152:0/410301967 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68baffd700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68bc0f6710 0x7f68bc061140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68ba7fc700 1 -- 172.21.15.152:0/410301967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68bc0f6710 msgr2=0x7f68bc061140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68ba7fc700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68bc0f6710 0x7f68bc061140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68ba7fc700 1 -- 172.21.15.152:0/410301967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac005040 con 0x7f68bc0f79b0 2024-04-06T12:20:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68baffd700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68bc0f6710 0x7f68bc061140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:20:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68ba7fc700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 0x7f68bc10ccd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f68ac013470 tx=0x7f68ac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68a3fff700 1 -- 172.21.15.152:0/410301967 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68ac00e030 con 0x7f68bc0f79b0 2024-04-06T12:20:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68a3fff700 1 -- 172.21.15.152:0/410301967 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f68ac007e90 con 0x7f68bc0f79b0 2024-04-06T12:20:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc10d530 con 0x7f68bc0f79b0 2024-04-06T12:20:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68a3fff700 1 -- 172.21.15.152:0/410301967 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68ac018070 con 0x7f68bc0f79b0 2024-04-06T12:20:28.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.198+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc10da10 con 0x7f68bc0f79b0 2024-04-06T12:20:28.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.199+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc0feef0 con 0x7f68bc0f79b0 2024-04-06T12:20:28.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.200+0000 7f68a3fff700 1 -- 172.21.15.152:0/410301967 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f68ac01d420 con 0x7f68bc0f79b0 2024-04-06T12:20:28.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.200+0000 7f68a3fff700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f68a4061180 0x7f68a4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:28.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.200+0000 7f68a3fff700 1 -- 172.21.15.152:0/410301967 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f68ac07dd60 con 0x7f68bc0f79b0 2024-04-06T12:20:28.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.200+0000 7f68baffd700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f68a4061180 0x7f68a4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:28.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.201+0000 7f68baffd700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f68a4061180 0x7f68a4063640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f68bc0f7810 tx=0x7f68b0009d60).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:28.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.205+0000 7f68a3fff700 1 -- 172.21.15.152:0/410301967 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f68ac051cf0 con 0x7f68bc0f79b0 2024-04-06T12:20:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.385+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68bc059990 con 0x7f68bc0f79b0 2024-04-06T12:20:28.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.386+0000 7f68a3fff700 1 -- 172.21.15.152:0/410301967 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14137 (secure 0 0 0) 0x7f68ac0518e0 con 0x7f68bc0f79b0 2024-04-06T12:20:28.384 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:20:28.385 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":43,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","created":"2024-04-06T12:13:16.768469+0000","modified":"2024-04-06T12:20:02.351475+0000","last_up_change":"2024-04-06T12:18:37.071819+0000","last_in_change":"2024-04-06T12:18:18.562700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-06T12:17:21.824734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-06T12:19:59.272151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-06T12:19:59.568441+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cb0a62c1-5f47-450c-8e9e-4e02c899eda3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6803","nonce":1835635164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6805","nonce":1835635164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6809","nonce":1835635164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1835635164},{"type":"v1","addr":"172.21.15.152:6807","nonce":1835635164}]},"public_addr":"172.21.15.152:6803/1835635164","cluster_addr":"172.21.15.152:6805/1835635164","heartbeat_back_addr":"172.21.15.152:6809/1835635164","heartbeat_front_addr":"172.21.15.152:6807/1835635164","state":["exists","up"]},{"osd":1,"uuid":"f9490187-6df1-4d4f-bfd3-a2da32d3a669","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6811","nonce":4181928109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6813","nonce":4181928109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6817","nonce":4181928109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":4181928109},{"type":"v1","addr":"172.21.15.152:6815","nonce":4181928109}]},"public_addr":"172.21.15.152:6811/4181928109","cluster_addr":"172.21.15.152:6813/4181928109","heartbeat_back_addr":"172.21.15.152:6817/4181928109","heartbeat_front_addr":"172.21.15.152:6815/4181928109","state":["exists","up"]},{"osd":2,"uuid":"4a279284-26fa-436f-a830-abda13b40713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6819","nonce":366825869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6821","nonce":366825869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6825","nonce":366825869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":366825869},{"type":"v1","addr":"172.21.15.152:6823","nonce":366825869}]},"public_addr":"172.21.15.152:6819/366825869","cluster_addr":"172.21.15.152:6821/366825869","heartbeat_back_addr":"172.21.15.152:6825/366825869","heartbeat_front_addr":"172.21.15.152:6823/366825869","state":["exists","up"]},{"osd":3,"uuid":"64e8942a-1121-44fd-9ed2-cbb5176df587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6801","nonce":2559967436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6803","nonce":2559967436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6807","nonce":2559967436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2559967436},{"type":"v1","addr":"172.21.15.195:6805","nonce":2559967436}]},"public_addr":"172.21.15.195:6801/2559967436","cluster_addr":"172.21.15.195:6803/2559967436","heartbeat_back_addr":"172.21.15.195:6807/2559967436","heartbeat_front_addr":"172.21.15.195:6805/2559967436","state":["exists","up"]},{"osd":4,"uuid":"378a7c45-9887-4e48-b004-0f3b470af912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6809","nonce":62445982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6811","nonce":62445982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6815","nonce":62445982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":62445982},{"type":"v1","addr":"172.21.15.195:6813","nonce":62445982}]},"public_addr":"172.21.15.195:6809/62445982","cluster_addr":"172.21.15.195:6811/62445982","heartbeat_back_addr":"172.21.15.195:6815/62445982","heartbeat_front_addr":"172.21.15.195:6813/62445982","state":["exists","up"]},{"osd":5,"uuid":"2608627e-47c5-446a-b13e-699aaaea81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6817","nonce":2188685791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6819","nonce":2188685791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6823","nonce":2188685791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2188685791},{"type":"v1","addr":"172.21.15.195:6821","nonce":2188685791}]},"public_addr":"172.21.15.195:6817/2188685791","cluster_addr":"172.21.15.195:6819/2188685791","heartbeat_back_addr":"172.21.15.195:6823/2188685791","heartbeat_front_addr":"172.21.15.195:6821/2188685791","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:18.549757+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:51.020120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:20.272551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:44.651165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:09.828133+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:35.929735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:6801/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6800/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/2556143500":"2024-04-07T12:14:19.995122+0000","172.21.15.152:6801/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/1200342064":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/378420270":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/944313623":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6800/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.152:0/2930097039":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6800/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/2583442237":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6801/3532590768":"2024-04-07T12:13:49.213100+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T12:20:28.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f68a4061180 msgr2=0x7f68a4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f68a4061180 0x7f68a4063640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f68bc0f7810 tx=0x7f68b0009d60).stop 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 msgr2=0x7f68bc10ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 0x7f68bc10ccd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f68ac013470 tx=0x7f68ac009cb0).stop 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 shutdown_connections 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f68a4061180 0x7f68a4063640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68bc0f6710 0x7f68bc061140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 --2- 172.21.15.152:0/410301967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68bc0f79b0 0x7f68bc10ccd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 >> 172.21.15.152:0/410301967 conn(0x7f68bc0f1e50 msgr2=0x7f68bc0fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 shutdown_connections 2024-04-06T12:20:28.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.388+0000 7f68c15c0700 1 -- 172.21.15.152:0/410301967 wait complete. 2024-04-06T12:20:28.398 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-06T12:17:21.824734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-06T12:19:59.272151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-06T12:19:59.568441+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-06T12:20:28.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-06T12:20:28.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.519+0000 7efe030ec700 1 -- 172.21.15.152:0/3981163975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 msgr2=0x7efdfc0f7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.519+0000 7efe030ec700 1 --2- 172.21.15.152:0/3981163975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 0x7efdfc0f7c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7efdf00047f0 tx=0x7efdf0009cb0).stop 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 -- 172.21.15.152:0/3981163975 shutdown_connections 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 --2- 172.21.15.152:0/3981163975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdfc0f8a90 0x7efdfc0f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 --2- 172.21.15.152:0/3981163975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 0x7efdfc0f7c10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 -- 172.21.15.152:0/3981163975 >> 172.21.15.152:0/3981163975 conn(0x7efdfc0f2f50 msgr2=0x7efdfc0f5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 -- 172.21.15.152:0/3981163975 shutdown_connections 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 -- 172.21.15.152:0/3981163975 wait complete. 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 Processor -- start 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 -- start start 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 0x7efdfc06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdfc0f8a90 0x7efdfc06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:28.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc06cf80 con 0x7efdfc0f77f0 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe030ec700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc06b520 con 0x7efdfc0f8a90 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe00e88700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 0x7efdfc06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.520+0000 7efe00e88700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 0x7efdfc06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56818/0 (socket says 172.21.15.152:56818) 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efe00e88700 1 -- 172.21.15.152:0/2139519987 learned_addr learned my addr 172.21.15.152:0/2139519987 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efdfbfff700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdfc0f8a90 0x7efdfc06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efe00e88700 1 -- 172.21.15.152:0/2139519987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdfc0f8a90 msgr2=0x7efdfc06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efe00e88700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdfc0f8a90 0x7efdfc06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efe00e88700 1 -- 172.21.15.152:0/2139519987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0005040 con 0x7efdfc0f77f0 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efe00e88700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 0x7efdfc06c9d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7efdf0004f10 tx=0x7efdf0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efdf9ffb700 1 -- 172.21.15.152:0/2139519987 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf000e070 con 0x7efdfc0f77f0 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efdf9ffb700 1 -- 172.21.15.152:0/2139519987 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7efdf0007e90 con 0x7efdfc0f77f0 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc06b740 con 0x7efdfc0f77f0 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efdf9ffb700 1 -- 172.21.15.152:0/2139519987 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf0018070 con 0x7efdfc0f77f0 2024-04-06T12:20:28.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.521+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc06bc20 con 0x7efdfc0f77f0 2024-04-06T12:20:28.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.522+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc06be90 con 0x7efdfc0f77f0 2024-04-06T12:20:28.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.522+0000 7efdf9ffb700 1 -- 172.21.15.152:0/2139519987 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7efdf00123c0 con 0x7efdfc0f77f0 2024-04-06T12:20:28.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.523+0000 7efdf9ffb700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efdec061110 0x7efdec0635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:28.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.523+0000 7efdf9ffb700 1 -- 172.21.15.152:0/2139519987 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7efdf007d680 con 0x7efdfc0f77f0 2024-04-06T12:20:28.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.523+0000 7efdfbfff700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efdec061110 0x7efdec0635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:28.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.523+0000 7efdfbfff700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efdec061110 0x7efdec0635d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efde8004de0 tx=0x7efde800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:28.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.527+0000 7efdf9ffb700 1 -- 172.21.15.152:0/2139519987 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7efdf0051610 con 0x7efdfc0f77f0 2024-04-06T12:20:28.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.689+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efdfc0fffd0 con 0x7efdfc0f77f0 2024-04-06T12:20:28.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.690+0000 7efdf9ffb700 1 -- 172.21.15.152:0/2139519987 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v43) v1 ==== 110+0+10 (secure 0 0 0) 0x7efdf0051200 con 0x7efdfc0f77f0 2024-04-06T12:20:28.688 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-06T12:20:28.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efdec061110 msgr2=0x7efdec0635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efdec061110 0x7efdec0635d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efde8004de0 tx=0x7efde800b040).stop 2024-04-06T12:20:28.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 msgr2=0x7efdfc06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 0x7efdfc06c9d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7efdf0004f10 tx=0x7efdf0009cb0).stop 2024-04-06T12:20:28.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 shutdown_connections 2024-04-06T12:20:28.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efdec061110 0x7efdec0635d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdfc0f77f0 0x7efdfc06c9d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 --2- 172.21.15.152:0/2139519987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdfc0f8a90 0x7efdfc06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 >> 172.21.15.152:0/2139519987 conn(0x7efdfc0f2f50 msgr2=0x7efdfc0fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:28.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 shutdown_connections 2024-04-06T12:20:28.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.692+0000 7efe030ec700 1 -- 172.21.15.152:0/2139519987 wait complete. 2024-04-06T12:20:28.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-06T12:20:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/1925158462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 msgr2=0x7fbd180f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 --2- 172.21.15.152:0/1925158462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 0x7fbd180f6b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fbd140047f0 tx=0x7fbd14009cb0).stop 2024-04-06T12:20:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/1925158462 shutdown_connections 2024-04-06T12:20:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 --2- 172.21.15.152:0/1925158462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd180f7990 0x7fbd180f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 --2- 172.21.15.152:0/1925158462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 0x7fbd180f6b10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/1925158462 >> 172.21.15.152:0/1925158462 conn(0x7fbd180f1e50 msgr2=0x7fbd180f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/1925158462 shutdown_connections 2024-04-06T12:20:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/1925158462 wait complete. 2024-04-06T12:20:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 Processor -- start 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.839+0000 7fbd1fcd2700 1 -- start start 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1fcd2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 0x7fbd18108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1fcd2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd180f7990 0x7fbd18108510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1fcd2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18108ac0 con 0x7fbd180f66f0 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1fcd2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18108c00 con 0x7fbd180f7990 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1da6e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 0x7fbd18108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1da6e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 0x7fbd18108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56850/0 (socket says 172.21.15.152:56850) 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1da6e700 1 -- 172.21.15.152:0/3102671464 learned_addr learned my addr 172.21.15.152:0/3102671464 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1d26d700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd180f7990 0x7fbd18108510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1da6e700 1 -- 172.21.15.152:0/3102671464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd180f7990 msgr2=0x7fbd18108510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1da6e700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd180f7990 0x7fbd18108510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1da6e700 1 -- 172.21.15.152:0/3102671464 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14005040 con 0x7fbd180f66f0 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1d26d700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd180f7990 0x7fbd18108510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:20:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1da6e700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 0x7fbd18108020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fbd14013580 tx=0x7fbd14009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:28.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd0effd700 1 -- 172.21.15.152:0/3102671464 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd14018070 con 0x7fbd180f66f0 2024-04-06T12:20:28.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd0effd700 1 -- 172.21.15.152:0/3102671464 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbd14007e90 con 0x7fbd180f66f0 2024-04-06T12:20:28.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1810d640 con 0x7fbd180f66f0 2024-04-06T12:20:28.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd0effd700 1 -- 172.21.15.152:0/3102671464 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd140123c0 con 0x7fbd180f66f0 2024-04-06T12:20:28.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.840+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1810dc00 con 0x7fbd180f66f0 2024-04-06T12:20:28.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.842+0000 7fbd0effd700 1 -- 172.21.15.152:0/3102671464 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fbd1401d420 con 0x7fbd180f66f0 2024-04-06T12:20:28.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.842+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd180feeb0 con 0x7fbd180f66f0 2024-04-06T12:20:28.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.842+0000 7fbd0effd700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbd04061180 0x7fbd04063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:28.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.842+0000 7fbd0effd700 1 -- 172.21.15.152:0/3102671464 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fbd1407d500 con 0x7fbd180f66f0 2024-04-06T12:20:28.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.842+0000 7fbd1d26d700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbd04061180 0x7fbd04063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:28.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.842+0000 7fbd1d26d700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbd04061180 0x7fbd04063640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fbd08007fd0 tx=0x7fbd0800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:28.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:28.846+0000 7fbd0effd700 1 -- 172.21.15.152:0/3102671464 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbd14051490 con 0x7fbd180f66f0 2024-04-06T12:20:29.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.033+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fbd1810e240 con 0x7fbd180f66f0 2024-04-06T12:20:29.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.034+0000 7fbd0effd700 1 -- 172.21.15.152:0/3102671464 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7fbd14051080 con 0x7fbd180f66f0 2024-04-06T12:20:29.032 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-06T12:20:29.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbd04061180 msgr2=0x7fbd04063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbd04061180 0x7fbd04063640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fbd08007fd0 tx=0x7fbd0800b040).stop 2024-04-06T12:20:29.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 msgr2=0x7fbd18108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 0x7fbd18108020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fbd14013580 tx=0x7fbd14009cb0).stop 2024-04-06T12:20:29.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 shutdown_connections 2024-04-06T12:20:29.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fbd04061180 0x7fbd04063640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd180f66f0 0x7fbd18108020 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 --2- 172.21.15.152:0/3102671464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd180f7990 0x7fbd18108510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 >> 172.21.15.152:0/3102671464 conn(0x7fbd180f1e50 msgr2=0x7fbd18060e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:29.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 shutdown_connections 2024-04-06T12:20:29.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.036+0000 7fbd1fcd2700 1 -- 172.21.15.152:0/3102671464 wait complete. 2024-04-06T12:20:29.046 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-06T12:20:29.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.169+0000 7f3269df8700 1 -- 172.21.15.152:0/1613909473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f66f0 msgr2=0x7f32640f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.169+0000 7f3269df8700 1 --2- 172.21.15.152:0/1613909473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f66f0 0x7f32640f6b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f32580047f0 tx=0x7f3258009cb0).stop 2024-04-06T12:20:29.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.169+0000 7f3269df8700 1 -- 172.21.15.152:0/1613909473 shutdown_connections 2024-04-06T12:20:29.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.169+0000 7f3269df8700 1 --2- 172.21.15.152:0/1613909473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32640f7990 0x7f32640f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.169+0000 7f3269df8700 1 --2- 172.21.15.152:0/1613909473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f66f0 0x7f32640f6b10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.169+0000 7f3269df8700 1 -- 172.21.15.152:0/1613909473 >> 172.21.15.152:0/1613909473 conn(0x7f32640f1e50 msgr2=0x7f32640f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.169+0000 7f3269df8700 1 -- 172.21.15.152:0/1613909473 shutdown_connections 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.169+0000 7f3269df8700 1 -- 172.21.15.152:0/1613909473 wait complete. 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3269df8700 1 Processor -- start 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3269df8700 1 -- start start 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3269df8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32640f66f0 0x7f32640610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3269df8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f7990 0x7f326410cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3269df8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326410d250 con 0x7f32640f7990 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3269df8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326410d390 con 0x7f32640f66f0 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3262ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f7990 0x7f326410cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3262ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f7990 0x7f326410cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56862/0 (socket says 172.21.15.152:56862) 2024-04-06T12:20:29.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3262ffd700 1 -- 172.21.15.152:0/358493380 learned_addr learned my addr 172.21.15.152:0/358493380 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f32637fe700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32640f66f0 0x7f32640610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3262ffd700 1 -- 172.21.15.152:0/358493380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32640f66f0 msgr2=0x7f32640610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3262ffd700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32640f66f0 0x7f32640610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3262ffd700 1 -- 172.21.15.152:0/358493380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258005040 con 0x7f32640f7990 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.170+0000 7f3262ffd700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f7990 0x7f326410cd60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f32540041d0 tx=0x7f3254009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.171+0000 7f3260ff9700 1 -- 172.21.15.152:0/358493380 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3254007b40 con 0x7f32640f7990 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.171+0000 7f3260ff9700 1 -- 172.21.15.152:0/358493380 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f325400f040 con 0x7f32640f7990 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.171+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326410d5f0 con 0x7f32640f7990 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.171+0000 7f3260ff9700 1 -- 172.21.15.152:0/358493380 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32540146f0 con 0x7f32640f7990 2024-04-06T12:20:29.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.171+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326410db00 con 0x7f32640f7990 2024-04-06T12:20:29.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.172+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32640feeb0 con 0x7f32640f7990 2024-04-06T12:20:29.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.172+0000 7f3260ff9700 1 -- 172.21.15.152:0/358493380 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f3254009110 con 0x7f32640f7990 2024-04-06T12:20:29.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.172+0000 7f3260ff9700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f324c061180 0x7f324c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:29.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.173+0000 7f32637fe700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f324c061180 0x7f324c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:29.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.173+0000 7f3260ff9700 1 -- 172.21.15.152:0/358493380 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f325407c790 con 0x7f32640f7990 2024-04-06T12:20:29.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.173+0000 7f32637fe700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f324c061180 0x7f324c063640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f3258004f10 tx=0x7f325800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:29.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.177+0000 7f3260ff9700 1 -- 172.21.15.152:0/358493380 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f32540507a0 con 0x7f32640f7990 2024-04-06T12:20:29.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.342+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f3264100d20 con 0x7f32640f7990 2024-04-06T12:20:29.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.342+0000 7f3260ff9700 1 -- 172.21.15.152:0/358493380 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3254050390 con 0x7f32640f7990 2024-04-06T12:20:29.340 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-06T12:20:29.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f324c061180 msgr2=0x7f324c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f324c061180 0x7f324c063640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f3258004f10 tx=0x7f325800b040).stop 2024-04-06T12:20:29.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f7990 msgr2=0x7f326410cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f7990 0x7f326410cd60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f32540041d0 tx=0x7f3254009f60).stop 2024-04-06T12:20:29.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 shutdown_connections 2024-04-06T12:20:29.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f324c061180 0x7f324c063640 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32640f66f0 0x7f32640610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 --2- 172.21.15.152:0/358493380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32640f7990 0x7f326410cd60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 >> 172.21.15.152:0/358493380 conn(0x7f32640f1e50 msgr2=0x7f32640fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:29.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 shutdown_connections 2024-04-06T12:20:29.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.344+0000 7f3269df8700 1 -- 172.21.15.152:0/358493380 wait complete. 2024-04-06T12:20:29.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:27.547046+0000 mgr.smithi152.lynahm (mgr.14196) 216 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-04-06T12:20:29.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:28.387138+0000 mon.smithi152 (mon.0) 592 : audit [DBG] from='client.? 172.21.15.152:0/410301967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:20:29.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:28.691014+0000 mon.smithi152 (mon.0) 593 : audit [DBG] from='client.? 172.21.15.152:0/2139519987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-04-06T12:20:29.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:28.968538+0000 mon.smithi152 (mon.0) 594 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:29.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:28.969320+0000 mon.smithi152 (mon.0) 595 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:29.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:28.969887+0000 mon.smithi152 (mon.0) 596 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:20:29.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:28.973408+0000 mon.smithi152 (mon.0) 597 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:29.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:29.035196+0000 mon.smithi152 (mon.0) 598 : audit [DBG] from='client.? 172.21.15.152:0/3102671464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-06T12:20:29.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-06T12:20:29.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.475+0000 7ff983031700 1 -- 172.21.15.152:0/3520992178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 msgr2=0x7ff97c0f80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.475+0000 7ff983031700 1 --2- 172.21.15.152:0/3520992178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 0x7ff97c0f80d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff9700047f0 tx=0x7ff970009cb0).stop 2024-04-06T12:20:29.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.475+0000 7ff983031700 1 -- 172.21.15.152:0/3520992178 shutdown_connections 2024-04-06T12:20:29.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.475+0000 7ff983031700 1 --2- 172.21.15.152:0/3520992178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff97c0f8650 0x7ff97c0f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.475+0000 7ff983031700 1 --2- 172.21.15.152:0/3520992178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 0x7ff97c0f80d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.475+0000 7ff983031700 1 -- 172.21.15.152:0/3520992178 >> 172.21.15.152:0/3520992178 conn(0x7ff97c0f1570 msgr2=0x7ff97c0f39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:29.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.475+0000 7ff983031700 1 -- 172.21.15.152:0/3520992178 shutdown_connections 2024-04-06T12:20:29.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff983031700 1 -- 172.21.15.152:0/3520992178 wait complete. 2024-04-06T12:20:29.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff983031700 1 Processor -- start 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff983031700 1 -- start start 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff983031700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 0x7ff97c106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff983031700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff97c0f8650 0x7ff97c1073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff983031700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c107950 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff983031700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c107a90 con 0x7ff97c0f8650 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff980dcd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 0x7ff97c106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff980dcd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 0x7ff97c106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56878/0 (socket says 172.21.15.152:56878) 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff980dcd700 1 -- 172.21.15.152:0/30487041 learned_addr learned my addr 172.21.15.152:0/30487041 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.476+0000 7ff97bfff700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff97c0f8650 0x7ff97c1073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff980dcd700 1 -- 172.21.15.152:0/30487041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff97c0f8650 msgr2=0x7ff97c1073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff980dcd700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff97c0f8650 0x7ff97c1073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff980dcd700 1 -- 172.21.15.152:0/30487041 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff970005040 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff97bfff700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff97c0f8650 0x7ff97c1073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff980dcd700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 0x7ff97c106eb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7ff970004f10 tx=0x7ff970009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:29.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff979ffb700 1 -- 172.21.15.152:0/30487041 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff97000e070 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c10c4d0 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff979ffb700 1 -- 172.21.15.152:0/30487041 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff970007e90 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff979ffb700 1 -- 172.21.15.152:0/30487041 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff970018070 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.477+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c10ca10 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.478+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c0feee0 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.478+0000 7ff979ffb700 1 -- 172.21.15.152:0/30487041 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7ff9700123c0 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.479+0000 7ff979ffb700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff96c0611d0 0x7ff96c063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:29.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.479+0000 7ff979ffb700 1 -- 172.21.15.152:0/30487041 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7ff97007d790 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.479+0000 7ff97bfff700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff96c0611d0 0x7ff96c063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:29.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.479+0000 7ff97bfff700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff96c0611d0 0x7ff96c063690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff97c0f8a90 tx=0x7ff968009de0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:29.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.483+0000 7ff979ffb700 1 -- 172.21.15.152:0/30487041 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff970051660 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:27.547046+0000 mgr.smithi152.lynahm (mgr.14196) 216 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-04-06T12:20:29.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:28.387138+0000 mon.smithi152 (mon.0) 592 : audit [DBG] from='client.? 172.21.15.152:0/410301967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:20:29.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:28.691014+0000 mon.smithi152 (mon.0) 593 : audit [DBG] from='client.? 172.21.15.152:0/2139519987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-04-06T12:20:29.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:28.968538+0000 mon.smithi152 (mon.0) 594 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:29.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:28.969320+0000 mon.smithi152 (mon.0) 595 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:29.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:28.969887+0000 mon.smithi152 (mon.0) 596 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:20:29.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:28.973408+0000 mon.smithi152 (mon.0) 597 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:29.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:29.035196+0000 mon.smithi152 (mon.0) 598 : audit [DBG] from='client.? 172.21.15.152:0/3102671464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-06T12:20:29.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.688+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff97c0598f0 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.689+0000 7ff979ffb700 1 -- 172.21.15.152:0/30487041 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+4598 (secure 0 0 0) 0x7ff970051250 con 0x7ff97c0f7cb0 2024-04-06T12:20:29.687 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:20:29.687 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":11,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:20:16.059877+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14434":{"gid":14434,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.152:6827/3429506423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3429506423},{"type":"v1","addr":"172.21.15.152:6827","nonce":3429506423}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14444":{"gid":14444,"name":"cephfs.smithi152.mxtfph","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6829/1106454067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1106454067},{"type":"v1","addr":"172.21.15.152:6829","nonce":1106454067}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-06T12:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff96c0611d0 msgr2=0x7ff96c063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff96c0611d0 0x7ff96c063690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff97c0f8a90 tx=0x7ff968009de0).stop 2024-04-06T12:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 msgr2=0x7ff97c106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 0x7ff97c106eb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7ff970004f10 tx=0x7ff970009cb0).stop 2024-04-06T12:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 shutdown_connections 2024-04-06T12:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff96c0611d0 0x7ff96c063690 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97c0f7cb0 0x7ff97c106eb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 --2- 172.21.15.152:0/30487041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff97c0f8650 0x7ff97c1073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 >> 172.21.15.152:0/30487041 conn(0x7ff97c0f1570 msgr2=0x7ff97c0fb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 shutdown_connections 2024-04-06T12:20:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:29.691+0000 7ff983031700 1 -- 172.21.15.152:0/30487041 wait complete. 2024-04-06T12:20:29.690 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:20:29.701 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 1, 'flags': 50} 2024-04-06T12:20:29.701 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-06T12:20:29.725 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-06T12:20:29.725 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-06T12:20:29.726 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-06T12:20:29.726 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-06T12:20:29.726 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:29.726 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-06T12:20:29.726 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-06T12:20:29.726 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:29.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:29.726 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-06T12:20:29.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:29.751 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-06T12:20:29.828 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-06T12:20:29.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T12:20:29.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:29.830 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-04-06T12:20:29.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:29.849 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-04-06T12:20:29.918 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-04-06T12:20:29.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T12:20:29.920 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-06T12:20:29.920 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph fs ls 2024-04-06T12:20:30.226 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:20:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:29.343300+0000 mon.smithi152 (mon.0) 599 : audit [DBG] from='client.? 172.21.15.152:0/358493380' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-06T12:20:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:29.689925+0000 mon.smithi152 (mon.0) 600 : audit [DBG] from='client.? 172.21.15.152:0/30487041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-06T12:20:30.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:29.343300+0000 mon.smithi152 (mon.0) 599 : audit [DBG] from='client.? 172.21.15.152:0/358493380' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-06T12:20:30.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:29.689925+0000 mon.smithi152 (mon.0) 600 : audit [DBG] from='client.? 172.21.15.152:0/30487041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-06T12:20:31.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:31 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:29.547465+0000 mgr.smithi152.lynahm (mgr.14196) 217 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:20:31.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:31 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:30.648630+0000 mon.smithi152 (mon.0) 601 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:31.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:31 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:29.547465+0000 mgr.smithi152.lynahm (mgr.14196) 217 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:20:31.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:31 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:30.648630+0000 mon.smithi152 (mon.0) 601 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:32.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.126+0000 7f2f0477c700 1 -- 172.21.15.152:0/3021761580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f79a0 msgr2=0x7f2efc0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:32.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.126+0000 7f2f0477c700 1 --2- 172.21.15.152:0/3021761580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f79a0 0x7f2efc0f7dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f2ef80047f0 tx=0x7f2ef8009cb0).stop 2024-04-06T12:20:32.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.126+0000 7f2f0477c700 1 -- 172.21.15.152:0/3021761580 shutdown_connections 2024-04-06T12:20:32.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.126+0000 7f2f0477c700 1 --2- 172.21.15.152:0/3021761580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc0f8c40 0x7f2efc0f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:32.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.126+0000 7f2f0477c700 1 --2- 172.21.15.152:0/3021761580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f79a0 0x7f2efc0f7dc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:32.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.126+0000 7f2f0477c700 1 -- 172.21.15.152:0/3021761580 >> 172.21.15.152:0/3021761580 conn(0x7f2efc0f3100 msgr2=0x7f2efc0f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:32.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.126+0000 7f2f0477c700 1 -- 172.21.15.152:0/3021761580 shutdown_connections 2024-04-06T12:20:32.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.126+0000 7f2f0477c700 1 -- 172.21.15.152:0/3021761580 wait complete. 2024-04-06T12:20:32.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f0477c700 1 Processor -- start 2024-04-06T12:20:32.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f0477c700 1 -- start start 2024-04-06T12:20:32.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f0477c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc0f79a0 0x7f2efc1080d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:32.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f0477c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f8c40 0x7f2efc1085c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:32.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f0477c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc108b70 con 0x7f2efc0f8c40 2024-04-06T12:20:32.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f0477c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc108cb0 con 0x7f2efc0f79a0 2024-04-06T12:20:32.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f01d17700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f8c40 0x7f2efc1085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:32.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f01d17700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f8c40 0x7f2efc1085c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56884/0 (socket says 172.21.15.152:56884) 2024-04-06T12:20:32.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f01d17700 1 -- 172.21.15.152:0/3739331739 learned_addr learned my addr 172.21.15.152:0/3739331739 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:32.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.127+0000 7f2f02518700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc0f79a0 0x7f2efc1080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:32.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.128+0000 7f2f01d17700 1 -- 172.21.15.152:0/3739331739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc0f79a0 msgr2=0x7f2efc1080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:32.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.128+0000 7f2f01d17700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc0f79a0 0x7f2efc1080d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:32.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.128+0000 7f2f01d17700 1 -- 172.21.15.152:0/3739331739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8005040 con 0x7f2efc0f8c40 2024-04-06T12:20:32.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.128+0000 7f2f01d17700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f8c40 0x7f2efc1085c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f2eec00c790 tx=0x7f2eec00caa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:32.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.128+0000 7f2ef37fe700 1 -- 172.21.15.152:0/3739331739 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eec00e680 con 0x7f2efc0f8c40 2024-04-06T12:20:32.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.128+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc10d750 con 0x7f2efc0f8c40 2024-04-06T12:20:32.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.128+0000 7f2ef37fe700 1 -- 172.21.15.152:0/3739331739 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2eec00ec70 con 0x7f2efc0f8c40 2024-04-06T12:20:32.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.128+0000 7f2ef37fe700 1 -- 172.21.15.152:0/3739331739 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eec012d70 con 0x7f2efc0f8c40 2024-04-06T12:20:32.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.128+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc10dc90 con 0x7f2efc0f8c40 2024-04-06T12:20:32.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.129+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc100110 con 0x7f2efc0f8c40 2024-04-06T12:20:32.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.129+0000 7f2ef37fe700 1 -- 172.21.15.152:0/3739331739 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f2eec00e7e0 con 0x7f2efc0f8c40 2024-04-06T12:20:32.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.130+0000 7f2ef37fe700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2ee8061180 0x7f2ee8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:32.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.130+0000 7f2ef37fe700 1 -- 172.21.15.152:0/3739331739 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f2eec07c180 con 0x7f2efc0f8c40 2024-04-06T12:20:32.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.130+0000 7f2f02518700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2ee8061180 0x7f2ee8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:32.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.130+0000 7f2f02518700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2ee8061180 0x7f2ee8063640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2ef8004f10 tx=0x7f2ef800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:32.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.134+0000 7f2ef37fe700 1 -- 172.21.15.152:0/3739331739 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2eec047f60 con 0x7f2efc0f8c40 2024-04-06T12:20:32.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.335+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2efc101f80 con 0x7f2efc0f8c40 2024-04-06T12:20:32.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.336+0000 7f2ef37fe700 1 -- 172.21.15.152:0/3739331739 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) v1 ==== 53+0+83 (secure 0 0 0) 0x7f2eec050110 con 0x7f2efc0f8c40 2024-04-06T12:20:32.334 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.337+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2ee8061180 msgr2=0x7f2ee8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.337+0000 7f2f0477c700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2ee8061180 0x7f2ee8063640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2ef8004f10 tx=0x7f2ef800b040).stop 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.337+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f8c40 msgr2=0x7f2efc1085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.337+0000 7f2f0477c700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f8c40 0x7f2efc1085c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f2eec00c790 tx=0x7f2eec00caa0).stop 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.338+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 shutdown_connections 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.338+0000 7f2f0477c700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f2ee8061180 0x7f2ee8063640 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.338+0000 7f2f0477c700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc0f79a0 0x7f2efc1080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.338+0000 7f2f0477c700 1 --2- 172.21.15.152:0/3739331739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2efc0f8c40 0x7f2efc1085c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.338+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 >> 172.21.15.152:0/3739331739 conn(0x7f2efc0f3100 msgr2=0x7f2efc0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:32.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.338+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 shutdown_connections 2024-04-06T12:20:32.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:32.338+0000 7f2f0477c700 1 -- 172.21.15.152:0/3739331739 wait complete. 2024-04-06T12:20:33.001 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-06T12:20:33.002 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-06T12:20:33.002 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-04-06T12:20:33.002 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-06T12:20:33.002 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:33.002 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-06T12:20:33.002 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-06T12:20:33.002 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-06T12:20:33.002 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-06T12:20:33.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:33.003 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-04-06T12:20:33.022 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-06T12:20:33.022 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-06T12:20:33.022 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-04-06T12:20:33.022 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-06T12:20:33.022 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42134sec preferred_lft 42134sec 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-04-06T12:20:33.023 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-06T12:20:33.024 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-06T12:20:33.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:33.024 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-04-06T12:20:33.024 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-06T12:20:33.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2024-04-06T12:20:33.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2024-04-06T12:20:33.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2024-04-06T12:20:33.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-06T12:20:33.025 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-06T12:20:33.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:33.190 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-06T12:20:33.219 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-04-06T12:20:33.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:33.220 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-04-06T12:20:33.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:31.548065+0000 mgr.smithi152.lynahm (mgr.14196) 218 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:20:33.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:32.337153+0000 mon.smithi152 (mon.0) 602 : audit [DBG] from='client.? 172.21.15.152:0/3739331739' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-06T12:20:33.302 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-04-06T12:20:33.302 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-06T12:20:33.302 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-06T12:20:33.302 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-06T12:20:33.302 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-06T12:20:33.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:33.303 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-04-06T12:20:33.303 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-06T12:20:33.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-06T12:20:33.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-06T12:20:33.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-06T12:20:33.303 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-06T12:20:33.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:31.548065+0000 mgr.smithi152.lynahm (mgr.14196) 218 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:20:33.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:32.337153+0000 mon.smithi152 (mon.0) 602 : audit [DBG] from='client.? 172.21.15.152:0/3739331739' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-06T12:20:33.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:33.641 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-04-06T12:20:33.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:33.661 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-04-06T12:20:33.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:33.719 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-04-06T12:20:33.719 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-06T12:20:33.719 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-06T12:20:33.719 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-06T12:20:33.719 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-06T12:20:33.813 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-06T12:20:33.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:33.813 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-04-06T12:20:33.813 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-06T12:20:33.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-06T12:20:33.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-06T12:20:33.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-06T12:20:33.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-06T12:20:33.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-06T12:20:33.814 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-06T12:20:34.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:34.033 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-04-06T12:20:34.034 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-06T12:20:34.034 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-04-06T12:20:34.034 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2024-04-06T12:20:34.034 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-06T12:20:34.131 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-06T12:20:34.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-06T12:20:34.132 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:34.150 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-06T12:20:34.150 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-06T12:20:34.150 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:34.207 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-06T12:20:34.274 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-06T12:20:34.275 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-06T12:20:34.342 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-06T12:20:34.343 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-06T12:20:34.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:34.343 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-06T12:20:34.400 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-06T12:20:34.401 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-06T12:20:34.443 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-06T12:20:34.469 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-06T12:20:34.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-06T12:20:34.538 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-06T12:20:34.539 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-06T12:20:34.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:34.540 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-06T12:20:34.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2024-04-06T12:20:34.548+0000 7f10c218f3c0 -1 init, newargv = 0x556690bb5680 newargc=15 2024-04-06T12:20:34.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[78255]: starting ceph client 2024-04-06T12:20:34.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[78255]: starting fuse 2024-04-06T12:20:34.565 INFO:teuthology.orchestra.run.smithi152.stdout:149 2024-04-06T12:20:34.565 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [149] 2024-04-06T12:20:34.565 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-06T12:20:34.565 DEBUG:teuthology.orchestra.run.smithi152:> import glob 2024-04-06T12:20:34.565 DEBUG:teuthology.orchestra.run.smithi152:> import re 2024-04-06T12:20:34.565 DEBUG:teuthology.orchestra.run.smithi152:> import os 2024-04-06T12:20:34.565 DEBUG:teuthology.orchestra.run.smithi152:> import subprocess 2024-04-06T12:20:34.565 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-06T12:20:34.565 DEBUG:teuthology.orchestra.run.smithi152:> def _find_admin_socket(client_name): 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> return files[0] 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> for f in files: 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> contents = proc_f.read() 2024-04-06T12:20:34.566 DEBUG:teuthology.orchestra.run.smithi152:> if mountpoint in contents: 2024-04-06T12:20:34.567 DEBUG:teuthology.orchestra.run.smithi152:> return f 2024-04-06T12:20:34.567 DEBUG:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-06T12:20:34.567 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-06T12:20:34.567 DEBUG:teuthology.orchestra.run.smithi152:> print(_find_admin_socket("client.0")) 2024-04-06T12:20:34.567 DEBUG:teuthology.orchestra.run.smithi152:> ' 2024-04-06T12:20:34.688 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.78255.asok 2024-04-06T12:20:34.871 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.78255.asok 2024-04-06T12:20:34.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:34.871 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.78255.asok status 2024-04-06T12:20:35.023 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:20:35.023 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2024-04-06T12:20:35.023 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "618f440892089921c3e944a991122ddc44e60516", 2024-04-06T12:20:35.023 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 16.2.15 (618f440892089921c3e944a991122ddc44e60516) pacific (stable)", 2024-04-06T12:20:35.023 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "78255", 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 14496, 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 14496 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-06T12:20:35.024 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 1847732670 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 1847732670 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.14496 192.168.0.1:0/1847732670", 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "192.168.0.1:0/1847732670", 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 11, 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 43, 2024-04-06T12:20:35.025 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2024-04-06T12:20:35.026 INFO:teuthology.orchestra.run.smithi152.stdout: "blocklisted": false, 2024-04-06T12:20:35.026 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs" 2024-04-06T12:20:35.026 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:20:35.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- ceph fs ls 2024-04-06T12:20:35.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:33.548461+0000 mgr.smithi152.lynahm (mgr.14196) 219 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:20:35.304 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/mon.smithi152/config 2024-04-06T12:20:35.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:33.548461+0000 mgr.smithi152.lynahm (mgr.14196) 219 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:20:37.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.191+0000 7f03e3120700 1 -- 172.21.15.152:0/3003107342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f7b40 msgr2=0x7f03dc0f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.191+0000 7f03e3120700 1 --2- 172.21.15.152:0/3003107342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f7b40 0x7f03dc0f7fa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f03c80047f0 tx=0x7f03c8009cb0).stop 2024-04-06T12:20:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.191+0000 7f03e3120700 1 -- 172.21.15.152:0/3003107342 shutdown_connections 2024-04-06T12:20:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.191+0000 7f03e3120700 1 --2- 172.21.15.152:0/3003107342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f7b40 0x7f03dc0f7fa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.191+0000 7f03e3120700 1 --2- 172.21.15.152:0/3003107342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc0f68a0 0x7f03dc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.191+0000 7f03e3120700 1 -- 172.21.15.152:0/3003107342 >> 172.21.15.152:0/3003107342 conn(0x7f03dc0f2020 msgr2=0x7f03dc0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.191+0000 7f03e3120700 1 -- 172.21.15.152:0/3003107342 shutdown_connections 2024-04-06T12:20:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.191+0000 7f03e3120700 1 -- 172.21.15.152:0/3003107342 wait complete. 2024-04-06T12:20:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e3120700 1 Processor -- start 2024-04-06T12:20:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e3120700 1 -- start start 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e3120700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f68a0 0x7f03dc108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e3120700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc0f7b40 0x7f03dc108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e3120700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc108ae0 con 0x7f03dc0f68a0 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e3120700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc108c20 con 0x7f03dc0f7b40 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e0ebc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f68a0 0x7f03dc108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e0ebc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f68a0 0x7f03dc108040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57756/0 (socket says 172.21.15.152:57756) 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e0ebc700 1 -- 172.21.15.152:0/964096867 learned_addr learned my addr 172.21.15.152:0/964096867 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03dbfff700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc0f7b40 0x7f03dc108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e0ebc700 1 -- 172.21.15.152:0/964096867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc0f7b40 msgr2=0x7f03dc108530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e0ebc700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc0f7b40 0x7f03dc108530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e0ebc700 1 -- 172.21.15.152:0/964096867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8005040 con 0x7f03dc0f68a0 2024-04-06T12:20:37.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e0ebc700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f68a0 0x7f03dc108040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f03d0002820 tx=0x7f03d0009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:37.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03d9ffb700 1 -- 172.21.15.152:0/964096867 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d0007b40 con 0x7f03dc0f68a0 2024-04-06T12:20:37.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03d9ffb700 1 -- 172.21.15.152:0/964096867 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f03d000f040 con 0x7f03dc0f68a0 2024-04-06T12:20:37.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc10d6c0 con 0x7f03dc0f68a0 2024-04-06T12:20:37.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.192+0000 7f03d9ffb700 1 -- 172.21.15.152:0/964096867 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d00147c0 con 0x7f03dc0f68a0 2024-04-06T12:20:37.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.193+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc10dc00 con 0x7f03dc0f68a0 2024-04-06T12:20:37.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.194+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc0feff0 con 0x7f03dc0f68a0 2024-04-06T12:20:37.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.194+0000 7f03d9ffb700 1 -- 172.21.15.152:0/964096867 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f03d0009110 con 0x7f03dc0f68a0 2024-04-06T12:20:37.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.194+0000 7f03d9ffb700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f03cc061180 0x7f03cc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:37.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.194+0000 7f03d9ffb700 1 -- 172.21.15.152:0/964096867 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f03d007c4a0 con 0x7f03dc0f68a0 2024-04-06T12:20:37.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.194+0000 7f03dbfff700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f03cc061180 0x7f03cc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:37.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.195+0000 7f03dbfff700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f03cc061180 0x7f03cc063640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f03c80047c0 tx=0x7f03c800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:37.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.199+0000 7f03d9ffb700 1 -- 172.21.15.152:0/964096867 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f03d0050430 con 0x7f03dc0f68a0 2024-04-06T12:20:37.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:35.548815+0000 mgr.smithi152.lynahm (mgr.14196) 220 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:20:37.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.405+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f03dc10e300 con 0x7f03dc0f68a0 2024-04-06T12:20:37.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.406+0000 7f03d9ffb700 1 -- 172.21.15.152:0/964096867 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) v1 ==== 53+0+83 (secure 0 0 0) 0x7f03d0050020 con 0x7f03dc0f68a0 2024-04-06T12:20:37.410 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-06T12:20:37.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f03cc061180 msgr2=0x7f03cc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:37.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f03cc061180 0x7f03cc063640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f03c80047c0 tx=0x7f03c800b040).stop 2024-04-06T12:20:37.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f68a0 msgr2=0x7f03dc108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:37.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f68a0 0x7f03dc108040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f03d0002820 tx=0x7f03d0009f00).stop 2024-04-06T12:20:37.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 shutdown_connections 2024-04-06T12:20:37.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f03cc061180 0x7f03cc063640 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:37.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03dc0f68a0 0x7f03dc108040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:37.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 --2- 172.21.15.152:0/964096867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03dc0f7b40 0x7f03dc108530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:37.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 >> 172.21.15.152:0/964096867 conn(0x7f03dc0f2020 msgr2=0x7f03dc061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:37.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 shutdown_connections 2024-04-06T12:20:37.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:37.407+0000 7f03e3120700 1 -- 172.21.15.152:0/964096867 wait complete. 2024-04-06T12:20:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:35.548815+0000 mgr.smithi152.lynahm (mgr.14196) 220 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:20:38.186 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-06T12:20:38.186 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-06T12:20:38.186 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-06T12:20:38.186 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-06T12:20:38.186 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:38.186 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-06T12:20:38.186 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-06T12:20:38.186 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-06T12:20:38.186 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-06T12:20:38.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:38.187 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-06T12:20:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-06T12:20:38.211 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-06T12:20:38.211 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-06T12:20:38.211 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-06T12:20:38.211 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-06T12:20:38.211 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-06T12:20:38.211 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42123sec preferred_lft 42123sec 2024-04-06T12:20:38.211 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-04-06T12:20:38.211 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-06T12:20:38.211 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-06T12:20:38.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:38.212 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-04-06T12:20:38.212 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-06T12:20:38.212 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-04-06T12:20:38.212 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-04-06T12:20:38.212 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-04-06T12:20:38.212 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-06T12:20:38.212 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-06T12:20:38.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:37.406904+0000 mon.smithi152 (mon.0) 603 : audit [DBG] from='client.? 172.21.15.152:0/964096867' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-06T12:20:38.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:38.398 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-06T12:20:38.430 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-06T12:20:38.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:38.431 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-06T12:20:38.514 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-06T12:20:38.514 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-06T12:20:38.514 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-06T12:20:38.514 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-06T12:20:38.514 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-06T12:20:38.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:38.514 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-04-06T12:20:38.515 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-06T12:20:38.515 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-06T12:20:38.515 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-06T12:20:38.515 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-06T12:20:38.515 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-06T12:20:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:37.406904+0000 mon.smithi152 (mon.0) 603 : audit [DBG] from='client.? 172.21.15.152:0/964096867' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-06T12:20:38.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:38.823 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-06T12:20:38.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:38.840 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-04-06T12:20:38.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:38.898 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-04-06T12:20:38.898 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-06T12:20:38.898 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-06T12:20:38.898 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-06T12:20:38.898 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-06T12:20:38.992 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-06T12:20:38.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:38.992 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-04-06T12:20:38.993 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-06T12:20:38.993 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-06T12:20:38.993 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-06T12:20:38.993 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-06T12:20:38.993 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-06T12:20:38.993 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-06T12:20:38.993 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-06T12:20:39.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:39.182 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-04-06T12:20:39.182 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-06T12:20:39.182 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-06T12:20:39.182 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-04-06T12:20:39.182 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-06T12:20:39.279 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-06T12:20:39.279 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-06T12:20:39.280 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:39.297 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-06T12:20:39.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-06T12:20:39.297 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:37.549425+0000 mgr.smithi152.lynahm (mgr.14196) 221 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 2.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-06T12:20:39.315 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-04-06T12:20:39.382 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-06T12:20:39.383 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-06T12:20:39.450 INFO:teuthology.orchestra.run.smithi195.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-06T12:20:39.450 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-06T12:20:39.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:39.451 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-04-06T12:20:39.509 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-06T12:20:39.509 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-06T12:20:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:37.549425+0000 mgr.smithi152.lynahm (mgr.14196) 221 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 2.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-06T12:20:39.551 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-04-06T12:20:39.578 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-06T12:20:39.578 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-06T12:20:39.644 INFO:teuthology.orchestra.run.smithi195.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-06T12:20:39.645 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-06T12:20:39.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:39.645 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-04-06T12:20:39.681 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:2024-04-06T12:20:39.684+0000 7f9740fbf3c0 -1 init, newargv = 0x5647d931f920 newargc=15 2024-04-06T12:20:39.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[65037]: starting ceph client 2024-04-06T12:20:39.686 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[65037]: starting fuse 2024-04-06T12:20:39.700 INFO:teuthology.orchestra.run.smithi195.stdout:137 2024-04-06T12:20:39.701 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [137] 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> import re 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> import os 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2024-04-06T12:20:39.701 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> return f 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-06T12:20:39.702 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-06T12:20:39.703 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.1")) 2024-04-06T12:20:39.703 DEBUG:teuthology.orchestra.run.smithi195:> ' 2024-04-06T12:20:39.823 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.1.65037.asok 2024-04-06T12:20:40.007 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.65037.asok 2024-04-06T12:20:40.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:40.007 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.65037.asok status 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "618f440892089921c3e944a991122ddc44e60516", 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 16.2.15 (618f440892089921c3e944a991122ddc44e60516) pacific (stable)", 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "1", 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "65037", 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-06T12:20:40.167 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 24333, 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 24333 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.1:0", 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 2299992592 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-06T12:20:40.168 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.1:0", 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 2299992592 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.24333 192.168.0.1:0/2299992592", 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "192.168.0.1:0/2299992592", 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 11, 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 43, 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2024-04-06T12:20:40.169 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-06T12:20:40.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:40.177 DEBUG:teuthology.orchestra.run.smithi152:> stat --file-system '--printf=%T 2024-04-06T12:20:40.177 DEBUG:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:40.200 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2024-04-06T12:20:40.200 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:40.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:40.201 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:40.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:40.279 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2024-04-06T12:20:40.279 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:40.297 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2024-04-06T12:20:40.297 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:40.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:20:40.298 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:40.368 INFO:teuthology.run_tasks:Running task print... 2024-04-06T12:20:40.381 INFO:teuthology.task.print:**** done client 2024-04-06T12:20:40.381 INFO:teuthology.run_tasks:Running task parallel... 2024-04-06T12:20:40.436 INFO:teuthology.task.parallel:starting parallel... 2024-04-06T12:20:40.437 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-06T12:20:40.438 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-06T12:20:40.438 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:20:40.439 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-06T12:20:40.439 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-06T12:20:40.439 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-06T12:20:40.442 INFO:tasks.workunit:Pulling workunits from ref 800ec6d64a7fa0648ad53edfc6e50b41fc4cd674 2024-04-06T12:20:40.442 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-06T12:20:40.443 INFO:tasks.workunit:timeout=3h 2024-04-06T12:20:40.443 INFO:tasks.workunit:cleanup=True 2024-04-06T12:20:40.443 DEBUG:teuthology.orchestra.run.smithi152:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-06T12:20:40.467 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 95h/149d Inode: 1 Links: 2 2024-04-06T12:20:40.467 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:20:40.467 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-06T12:20:40.467 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-06T12:20:40.467 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-04-06 12:20:05.290062553 +0000 2024-04-06T12:20:40.467 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-04-06 12:20:40.278408077 +0000 2024-04-06T12:20:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2024-04-06T12:20:40.467 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-06T12:20:40.467 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-06T12:20:40.541 DEBUG:teuthology.orchestra.run.smithi195:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:40.561 INFO:teuthology.orchestra.run.smithi195.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:40.561 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-06T12:20:40.561 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 89h/137d Inode: 1 Links: 3 2024-04-06T12:20:40.561 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-06T12:20:40.561 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-06T12:20:40.561 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-06T12:20:40.561 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-06 12:20:40.539370131 +0000 2024-04-06T12:20:40.561 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-06 12:20:40.539370131 +0000 2024-04-06T12:20:40.561 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-04-06T12:20:40.562 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-06T12:20:40.562 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-06T12:20:40.633 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 800ec6d64a7fa0648ad53edfc6e50b41fc4cd674 2024-04-06T12:20:40.634 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 800ec6d64a7fa0648ad53edfc6e50b41fc4cd674 2024-04-06T12:20:40.652 INFO:tasks.workunit.client.0.smithi152.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-06T12:20:40.691 INFO:tasks.workunit.client.1.smithi195.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-06T12:20:41.192 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:39.550089+0000 mgr.smithi152.lynahm (mgr.14196) 222 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 2.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-06T12:20:41.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:39.550089+0000 mgr.smithi152.lynahm (mgr.14196) 222 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 2.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.587+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/3709426116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f7660 msgr2=0x7f9fb40f7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.587+0000 7f9fb8f9e700 1 --2- 172.21.15.152:0/3709426116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f7660 0x7f9fb40f7a80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f9fac009b60 tx=0x7f9fac004d10).stop 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.587+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/3709426116 shutdown_connections 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.587+0000 7f9fb8f9e700 1 --2- 172.21.15.152:0/3709426116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fb40f8900 0x7f9fb40f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.587+0000 7f9fb8f9e700 1 --2- 172.21.15.152:0/3709426116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f7660 0x7f9fb40f7a80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.587+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/3709426116 >> 172.21.15.152:0/3709426116 conn(0x7f9fb40f2de0 msgr2=0x7f9fb40f5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.587+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/3709426116 shutdown_connections 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.587+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/3709426116 wait complete. 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb8f9e700 1 Processor -- start 2024-04-06T12:20:42.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb8f9e700 1 -- start start 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb8f9e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fb40f7660 0x7f9fb406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb8f9e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f8900 0x7f9fb406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb8f9e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb406b590 con 0x7f9fb40f8900 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb8f9e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb406b6d0 con 0x7f9fb40f7660 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f8900 0x7f9fb406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f8900 0x7f9fb406b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56344/0 (socket says 172.21.15.152:56344) 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb2ffd700 1 -- 172.21.15.152:0/2635375091 learned_addr learned my addr 172.21.15.152:0/2635375091 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb37fe700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fb40f7660 0x7f9fb406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb2ffd700 1 -- 172.21.15.152:0/2635375091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fb40f7660 msgr2=0x7f9fb406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb2ffd700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fb40f7660 0x7f9fb406cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.588+0000 7f9fb2ffd700 1 -- 172.21.15.152:0/2635375091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0097c0 con 0x7f9fb40f8900 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.589+0000 7f9fb2ffd700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f8900 0x7f9fb406b030 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f9f9c00c790 tx=0x7f9f9c00caa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.589+0000 7f9fb0ff9700 1 -- 172.21.15.152:0/2635375091 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c00e680 con 0x7f9fb40f8900 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.589+0000 7f9fb0ff9700 1 -- 172.21.15.152:0/2635375091 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9f9c00ec70 con 0x7f9fb40f8900 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.589+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb406b9b0 con 0x7f9fb40f8900 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.589+0000 7f9fb0ff9700 1 -- 172.21.15.152:0/2635375091 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c012d70 con 0x7f9fb40f8900 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.589+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb410fec0 con 0x7f9fb40f8900 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.590+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb4046ce0 con 0x7f9fb40f8900 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.590+0000 7f9fb0ff9700 1 -- 172.21.15.152:0/2635375091 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f9f9c00e7e0 con 0x7f9fb40f8900 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.590+0000 7f9fb0ff9700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9fa0061180 0x7f9fa0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.591+0000 7f9fb0ff9700 1 -- 172.21.15.152:0/2635375091 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f9f9c07c120 con 0x7f9fb40f8900 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.591+0000 7f9fb37fe700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9fa0061180 0x7f9fa0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.591+0000 7f9fb37fe700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9fa0061180 0x7f9fa0063640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f9fac009b30 tx=0x7f9fac015040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:42.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.595+0000 7f9fb0ff9700 1 -- 172.21.15.152:0/2635375091 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9f9c047f60 con 0x7f9fb40f8900 2024-04-06T12:20:42.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.756+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f9fb40ffe40 con 0x7f9fb40f8900 2024-04-06T12:20:42.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.757+0000 7f9fb0ff9700 1 -- 172.21.15.152:0/2635375091 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f9f9c04c680 con 0x7f9fb40f8900 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.758+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9fa0061180 msgr2=0x7f9fa0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.758+0000 7f9fb8f9e700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9fa0061180 0x7f9fa0063640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f9fac009b30 tx=0x7f9fac015040).stop 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.758+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f8900 msgr2=0x7f9fb406b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.758+0000 7f9fb8f9e700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f8900 0x7f9fb406b030 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f9f9c00c790 tx=0x7f9f9c00caa0).stop 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.758+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 shutdown_connections 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.758+0000 7f9fb8f9e700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f9fa0061180 0x7f9fa0063640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.758+0000 7f9fb8f9e700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fb40f7660 0x7f9fb406cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.758+0000 7f9fb8f9e700 1 --2- 172.21.15.152:0/2635375091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fb40f8900 0x7f9fb406b030 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.758+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 >> 172.21.15.152:0/2635375091 conn(0x7f9fb40f2de0 msgr2=0x7f9fb40fc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.759+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 shutdown_connections 2024-04-06T12:20:42.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:42.759+0000 7f9fb8f9e700 1 -- 172.21.15.152:0/2635375091 wait complete. 2024-04-06T12:20:43.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:41.550525+0000 mgr.smithi152.lynahm (mgr.14196) 223 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-06T12:20:43.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:41.550525+0000 mgr.smithi152.lynahm (mgr.14196) 223 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-06T12:20:43.560 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-06T12:20:45.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:45 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:43.550958+0000 mgr.smithi152.lynahm (mgr.14196) 224 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 682 B/s wr, 2 op/s 2024-04-06T12:20:45.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:43.550958+0000 mgr.smithi152.lynahm (mgr.14196) 224 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 682 B/s wr, 2 op/s 2024-04-06T12:20:45.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/100062952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f7990 msgr2=0x7fe1cc0f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:45.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 --2- 172.21.15.152:0/100062952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f7990 0x7fe1cc0f7df0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe1b80047f0 tx=0x7fe1b8009cb0).stop 2024-04-06T12:20:45.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/100062952 shutdown_connections 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 --2- 172.21.15.152:0/100062952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f7990 0x7fe1cc0f7df0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 --2- 172.21.15.152:0/100062952 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0f66f0 0x7fe1cc0f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/100062952 >> 172.21.15.152:0/100062952 conn(0x7fe1cc0f1e50 msgr2=0x7fe1cc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/100062952 shutdown_connections 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/100062952 wait complete. 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 Processor -- start 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 -- start start 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f66f0 0x7fe1cc107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0f7990 0x7fe1cc108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc108a40 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.633+0000 7fe1d2ba5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc108b80 con 0x7fe1cc0f7990 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1d0941700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f66f0 0x7fe1cc107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1d0941700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f66f0 0x7fe1cc107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56354/0 (socket says 172.21.15.152:56354) 2024-04-06T12:20:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1d0941700 1 -- 172.21.15.152:0/3381289248 learned_addr learned my addr 172.21.15.152:0/3381289248 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1cbfff700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0f7990 0x7fe1cc108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1d0941700 1 -- 172.21.15.152:0/3381289248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0f7990 msgr2=0x7fe1cc108490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1d0941700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0f7990 0x7fe1cc108490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1d0941700 1 -- 172.21.15.152:0/3381289248 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8005040 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1cbfff700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0f7990 0x7fe1cc108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1d0941700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f66f0 0x7fe1cc107fa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fe1c0002780 tx=0x7fe1c0009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1c9ffb700 1 -- 172.21.15.152:0/3381289248 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c0007b40 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1c9ffb700 1 -- 172.21.15.152:0/3381289248 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe1c000f040 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc10d620 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1c9ffb700 1 -- 172.21.15.152:0/3381289248 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c00146f0 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.634+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc10db60 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.635+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc0feed0 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.635+0000 7fe1c9ffb700 1 -- 172.21.15.152:0/3381289248 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fe1c0007ca0 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.636+0000 7fe1c9ffb700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe1bc061180 0x7fe1bc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:45.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.636+0000 7fe1c9ffb700 1 -- 172.21.15.152:0/3381289248 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fe1c007c840 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.636+0000 7fe1cbfff700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe1bc061180 0x7fe1bc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:45.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.636+0000 7fe1cbfff700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe1bc061180 0x7fe1bc063640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe1b8013470 tx=0x7fe1b800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:45.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.640+0000 7fe1c9ffb700 1 -- 172.21.15.152:0/3381289248 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe1c00507d0 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.806+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fe1cc10e530 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.807+0000 7fe1c9ffb700 1 -- 172.21.15.152:0/3381289248 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fe1c00503c0 con 0x7fe1cc0f66f0 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.808+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe1bc061180 msgr2=0x7fe1bc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.808+0000 7fe1d2ba5700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe1bc061180 0x7fe1bc063640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe1b8013470 tx=0x7fe1b800b040).stop 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.808+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f66f0 msgr2=0x7fe1cc107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.808+0000 7fe1d2ba5700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f66f0 0x7fe1cc107fa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fe1c0002780 tx=0x7fe1c0009ee0).stop 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.808+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 shutdown_connections 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.808+0000 7fe1d2ba5700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fe1bc061180 0x7fe1bc063640 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.808+0000 7fe1d2ba5700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1cc0f66f0 0x7fe1cc107fa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.808+0000 7fe1d2ba5700 1 --2- 172.21.15.152:0/3381289248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1cc0f7990 0x7fe1cc108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.808+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 >> 172.21.15.152:0/3381289248 conn(0x7fe1cc0f1e50 msgr2=0x7fe1cc060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.809+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 shutdown_connections 2024-04-06T12:20:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:45.809+0000 7fe1d2ba5700 1 -- 172.21.15.152:0/3381289248 wait complete. 2024-04-06T12:20:46.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-06T12:20:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:45.551223+0000 mgr.smithi152.lynahm (mgr.14196) 225 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 682 B/s wr, 2 op/s 2024-04-06T12:20:47.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:45.551223+0000 mgr.smithi152.lynahm (mgr.14196) 225 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 682 B/s wr, 2 op/s 2024-04-06T12:20:48.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.730+0000 7f10ddc77700 1 -- 172.21.15.152:0/1675557623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 msgr2=0x7f10d80f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.730+0000 7f10ddc77700 1 --2- 172.21.15.152:0/1675557623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 0x7f10d80f7e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f10c80047f0 tx=0x7f10c8009cb0).stop 2024-04-06T12:20:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.730+0000 7f10ddc77700 1 -- 172.21.15.152:0/1675557623 shutdown_connections 2024-04-06T12:20:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.730+0000 7f10ddc77700 1 --2- 172.21.15.152:0/1675557623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d80f8cb0 0x7f10d80f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:20:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.730+0000 7f10ddc77700 1 --2- 172.21.15.152:0/1675557623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 0x7f10d80f7e30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.730+0000 7f10ddc77700 1 -- 172.21.15.152:0/1675557623 >> 172.21.15.152:0/1675557623 conn(0x7f10d80f3150 msgr2=0x7f10d80f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.730+0000 7f10ddc77700 1 -- 172.21.15.152:0/1675557623 shutdown_connections 2024-04-06T12:20:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.730+0000 7f10ddc77700 1 -- 172.21.15.152:0/1675557623 wait complete. 2024-04-06T12:20:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10ddc77700 1 Processor -- start 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10ddc77700 1 -- start start 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10ddc77700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 0x7f10d810a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10ddc77700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d80f8cb0 0x7f10d810a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10ddc77700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d810af60 con 0x7f10d80f7a10 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10ddc77700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d810b0a0 con 0x7f10d80f8cb0 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 0x7f10d810a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 0x7f10d810a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56368/0 (socket says 172.21.15.152:56368) 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10d77fe700 1 -- 172.21.15.152:0/2157758306 learned_addr learned my addr 172.21.15.152:0/2157758306 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10d77fe700 1 -- 172.21.15.152:0/2157758306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d80f8cb0 msgr2=0x7f10d810a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10d77fe700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d80f8cb0 0x7f10d810a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.731+0000 7f10d77fe700 1 -- 172.21.15.152:0/2157758306 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8005040 con 0x7f10d80f7a10 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.732+0000 7f10d77fe700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 0x7f10d810a430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f10c8013470 tx=0x7f10c8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.732+0000 7f10d4ff9700 1 -- 172.21.15.152:0/2157758306 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c800e030 con 0x7f10d80f7a10 2024-04-06T12:20:48.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.732+0000 7f10d4ff9700 1 -- 172.21.15.152:0/2157758306 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f10c8007e90 con 0x7f10d80f7a10 2024-04-06T12:20:48.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.732+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d810fae0 con 0x7f10d80f7a10 2024-04-06T12:20:48.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.732+0000 7f10d4ff9700 1 -- 172.21.15.152:0/2157758306 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c8018070 con 0x7f10d80f7a10 2024-04-06T12:20:48.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.732+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d810ffc0 con 0x7f10d80f7a10 2024-04-06T12:20:48.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.733+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d805fb50 con 0x7f10d80f7a10 2024-04-06T12:20:48.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.733+0000 7f10d4ff9700 1 -- 172.21.15.152:0/2157758306 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f10c801d940 con 0x7f10d80f7a10 2024-04-06T12:20:48.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.734+0000 7f10d4ff9700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f10c4061160 0x7f10c4063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:48.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.734+0000 7f10d4ff9700 1 -- 172.21.15.152:0/2157758306 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f10c807de30 con 0x7f10d80f7a10 2024-04-06T12:20:48.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.734+0000 7f10d6ffd700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f10c4061160 0x7f10c4063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:48.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.734+0000 7f10d6ffd700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f10c4061160 0x7f10c4063620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f10c0009700 tx=0x7f10c0006c30).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:48.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.738+0000 7f10d4ff9700 1 -- 172.21.15.152:0/2157758306 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f10c8051e40 con 0x7f10d80f7a10 2024-04-06T12:20:48.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.904+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f10d8100250 con 0x7f10d80f7a10 2024-04-06T12:20:48.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.909+0000 7f10d4ff9700 1 -- 172.21.15.152:0/2157758306 <== mon.0 v2:172.21.15.152:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10c8051e40 con 0x7f10d80f7a10 2024-04-06T12:20:48.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.909+0000 7f10d4ff9700 1 -- 172.21.15.152:0/2157758306 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v22)=0 v22) v1 ==== 135+0+0 (secure 0 0 0) 0x7f10c8051a30 con 0x7f10d80f7a10 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f10c4061160 msgr2=0x7f10c4063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f10c4061160 0x7f10c4063620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f10c0009700 tx=0x7f10c0006c30).stop 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 msgr2=0x7f10d810a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 0x7f10d810a430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f10c8013470 tx=0x7f10c8009cb0).stop 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 shutdown_connections 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f10c4061160 0x7f10c4063620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10d80f7a10 0x7f10d810a430 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 --2- 172.21.15.152:0/2157758306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d80f8cb0 0x7f10d810a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 >> 172.21.15.152:0/2157758306 conn(0x7f10d80f3150 msgr2=0x7f10d806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:48.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 shutdown_connections 2024-04-06T12:20:48.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:48.912+0000 7f10ddc77700 1 -- 172.21.15.152:0/2157758306 wait complete. 2024-04-06T12:20:49.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:47.551606+0000 mgr.smithi152.lynahm (mgr.14196) 226 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-06T12:20:49.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:48.909915+0000 mon.smithi152 (mon.0) 604 : audit [INF] from='client.? 172.21.15.152:0/2157758306' entity='client.admin' 2024-04-06T12:20:49.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:48.929189+0000 mon.smithi152 (mon.0) 605 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:20:49.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:49 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:47.551606+0000 mgr.smithi152.lynahm (mgr.14196) 226 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-06T12:20:49.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:49 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:48.909915+0000 mon.smithi152 (mon.0) 604 : audit [INF] from='client.? 172.21.15.152:0/2157758306' entity='client.admin' 2024-04-06T12:20:49.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:49 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:48.929189+0000 mon.smithi152 (mon.0) 605 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:20:49.776 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-04-06T12:20:50.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:49.325151+0000 mon.smithi152 (mon.0) 606 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:50.463 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:49.325806+0000 mon.smithi152 (mon.0) 607 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:20:50.463 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:49.330052+0000 mon.smithi152 (mon.0) 608 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:49.325151+0000 mon.smithi152 (mon.0) 606 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:20:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:49.325806+0000 mon.smithi152 (mon.0) 607 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:20:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:49.330052+0000 mon.smithi152 (mon.0) 608 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:20:51.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:49.551977+0000 mgr.smithi152.lynahm (mgr.14196) 227 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-06T12:20:51.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:49.551977+0000 mgr.smithi152.lynahm (mgr.14196) 227 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 7.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-06T12:20:51.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.715+0000 7f43db331700 1 -- 172.21.15.152:0/1326211632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 msgr2=0x7f43d40f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:51.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.715+0000 7f43db331700 1 --2- 172.21.15.152:0/1326211632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 0x7f43d40f5ed0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f43c40047f0 tx=0x7f43c4009cb0).stop 2024-04-06T12:20:51.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.715+0000 7f43db331700 1 -- 172.21.15.152:0/1326211632 shutdown_connections 2024-04-06T12:20:51.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.715+0000 7f43db331700 1 --2- 172.21.15.152:0/1326211632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43d40f6450 0x7f43d40f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:51.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.715+0000 7f43db331700 1 --2- 172.21.15.152:0/1326211632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 0x7f43d40f5ed0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:51.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.715+0000 7f43db331700 1 -- 172.21.15.152:0/1326211632 >> 172.21.15.152:0/1326211632 conn(0x7f43d40f15d0 msgr2=0x7f43d40f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:20:51.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.715+0000 7f43db331700 1 -- 172.21.15.152:0/1326211632 shutdown_connections 2024-04-06T12:20:51.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.715+0000 7f43db331700 1 -- 172.21.15.152:0/1326211632 wait complete. 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43db331700 1 Processor -- start 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43db331700 1 -- start start 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43db331700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 0x7f43d40f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43db331700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43d40f6450 0x7f43d40f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43db331700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40f7040 con 0x7f43d40f5ab0 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43db331700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40f7180 con 0x7f43d40f6450 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43d90cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 0x7f43d40f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43d90cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 0x7f43d40f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56394/0 (socket says 172.21.15.152:56394) 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43d90cd700 1 -- 172.21.15.152:0/348066319 learned_addr learned my addr 172.21.15.152:0/348066319 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43d88cc700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43d40f6450 0x7f43d40f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43d90cd700 1 -- 172.21.15.152:0/348066319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43d40f6450 msgr2=0x7f43d40f6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43d90cd700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43d40f6450 0x7f43d40f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:20:51.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43d90cd700 1 -- 172.21.15.152:0/348066319 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4005040 con 0x7f43d40f5ab0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43d90cd700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 0x7f43d40f8660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f43c400b120 tx=0x7f43c4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43ca7fc700 1 -- 172.21.15.152:0/348066319 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43c400e030 con 0x7f43d40f5ab0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43ca7fc700 1 -- 172.21.15.152:0/348066319 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43c4007e90 con 0x7f43d40f5ab0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d40f7400 con 0x7f43d40f5ab0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.716+0000 7f43ca7fc700 1 -- 172.21.15.152:0/348066319 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43c4018070 con 0x7f43d40f5ab0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.717+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d40f7960 con 0x7f43d40f5ab0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.717+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d4046ce0 con 0x7f43d40f5ab0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.718+0000 7f43ca7fc700 1 -- 172.21.15.152:0/348066319 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f43c401d960 con 0x7f43d40f5ab0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.718+0000 7f43ca7fc700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f43c00611d0 0x7f43c0063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.718+0000 7f43ca7fc700 1 -- 172.21.15.152:0/348066319 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f43c407dde0 con 0x7f43d40f5ab0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.718+0000 7f43d88cc700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f43c00611d0 0x7f43c0063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.719+0000 7f43d88cc700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f43c00611d0 0x7f43c0063690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f43d40f6890 tx=0x7f43d0009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:20:51.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.722+0000 7f43ca7fc700 1 -- 172.21.15.152:0/348066319 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f43c404e340 con 0x7f43d40f5ab0 2024-04-06T12:20:51.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:20:51.904+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f43d4059120 con 0x7f43c00611d0 2024-04-06T12:20:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:51.552445+0000 mgr.smithi152.lynahm (mgr.14196) 228 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2024-04-06T12:20:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:20:51.906231+0000 mgr.smithi152.lynahm (mgr.14196) 229 : audit [DBG] from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:20:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:51.552445+0000 mgr.smithi152.lynahm (mgr.14196) 228 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2024-04-06T12:20:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:20:51.906231+0000 mgr.smithi152.lynahm (mgr.14196) 229 : audit [DBG] from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:20:55.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:53.552826+0000 mgr.smithi152.lynahm (mgr.14196) 230 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T12:20:55.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:55 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:53.552826+0000 mgr.smithi152.lynahm (mgr.14196) 230 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T12:20:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:57 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:55.553125+0000 mgr.smithi152.lynahm (mgr.14196) 231 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T12:20:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:57 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:55.553125+0000 mgr.smithi152.lynahm (mgr.14196) 231 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T12:20:59.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:20:59 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:57.553484+0000 mgr.smithi152.lynahm (mgr.14196) 232 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-06T12:20:59.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:20:59 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:57.553484+0000 mgr.smithi152.lynahm (mgr.14196) 232 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-06T12:21:01.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:20:59.553920+0000 mgr.smithi152.lynahm (mgr.14196) 233 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T12:21:01.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:20:59.553920+0000 mgr.smithi152.lynahm (mgr.14196) 233 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-06T12:21:03.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:01.554267+0000 mgr.smithi152.lynahm (mgr.14196) 234 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-06T12:21:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:01.554267+0000 mgr.smithi152.lynahm (mgr.14196) 234 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-06T12:21:05.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:03.554637+0000 mgr.smithi152.lynahm (mgr.14196) 235 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-06T12:21:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:03.554637+0000 mgr.smithi152.lynahm (mgr.14196) 235 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-06T12:21:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:05.554916+0000 mgr.smithi152.lynahm (mgr.14196) 236 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:05.554916+0000 mgr.smithi152.lynahm (mgr.14196) 236 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:09.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:07.555300+0000 mgr.smithi152.lynahm (mgr.14196) 237 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:09.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:07.555300+0000 mgr.smithi152.lynahm (mgr.14196) 237 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:09.555705+0000 mgr.smithi152.lynahm (mgr.14196) 238 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:09.555705+0000 mgr.smithi152.lynahm (mgr.14196) 238 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:13.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:13 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:11.556066+0000 mgr.smithi152.lynahm (mgr.14196) 239 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:13 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:11.556066+0000 mgr.smithi152.lynahm (mgr.14196) 239 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:15.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:13.556469+0000 mgr.smithi152.lynahm (mgr.14196) 240 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:13.556469+0000 mgr.smithi152.lynahm (mgr.14196) 240 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:17.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:15.556805+0000 mgr.smithi152.lynahm (mgr.14196) 241 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:17.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:15.556805+0000 mgr.smithi152.lynahm (mgr.14196) 241 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:17.557218+0000 mgr.smithi152.lynahm (mgr.14196) 242 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:17.557218+0000 mgr.smithi152.lynahm (mgr.14196) 242 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:21.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:19.557693+0000 mgr.smithi152.lynahm (mgr.14196) 243 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:21.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:19.557693+0000 mgr.smithi152.lynahm (mgr.14196) 243 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:23.283 INFO:teuthology.orchestra.run.smithi152.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:21:23.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.285+0000 7f43ca7fc700 1 -- 172.21.15.152:0/348066319 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f43d0016070 con 0x7f43c00611d0 2024-04-06T12:21:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f43c00611d0 msgr2=0x7f43c0063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f43c00611d0 0x7f43c0063690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f43d40f6890 tx=0x7f43d0009040).stop 2024-04-06T12:21:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 msgr2=0x7f43d40f8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 0x7f43d40f8660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f43c400b120 tx=0x7f43c4009cb0).stop 2024-04-06T12:21:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 shutdown_connections 2024-04-06T12:21:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f43c00611d0 0x7f43c0063690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43d40f5ab0 0x7f43d40f8660 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 --2- 172.21.15.152:0/348066319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43d40f6450 0x7f43d40f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:23.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 >> 172.21.15.152:0/348066319 conn(0x7f43d40f15d0 msgr2=0x7f43d40fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:23.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 shutdown_connections 2024-04-06T12:21:23.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:23.287+0000 7f43db331700 1 -- 172.21.15.152:0/348066319 wait complete. 2024-04-06T12:21:23.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:21.558078+0000 mgr.smithi152.lynahm (mgr.14196) 244 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:23.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:21.558078+0000 mgr.smithi152.lynahm (mgr.14196) 244 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:24.246 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-04-06T12:21:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:21:23.281775+0000 mgr.smithi152.lynahm (mgr.14196) 245 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:21:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:23.285498+0000 mon.smithi152 (mon.0) 609 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:21:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:23.300267+0000 mon.smithi152 (mon.0) 610 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:21:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:23.301914+0000 mon.smithi152 (mon.0) 611 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:21:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:23.302528+0000 mon.smithi152 (mon.0) 612 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:21:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:23.308726+0000 mon.smithi152 (mon.0) 613 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:21:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:21:23.281775+0000 mgr.smithi152.lynahm (mgr.14196) 245 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:21:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:23.285498+0000 mon.smithi152 (mon.0) 609 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:21:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:23.300267+0000 mon.smithi152 (mon.0) 610 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:21:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:23.301914+0000 mon.smithi152 (mon.0) 611 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:21:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:23.302528+0000 mon.smithi152 (mon.0) 612 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:21:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:23.308726+0000 mon.smithi152 (mon.0) 613 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:21:25.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:21:23.313236+0000 mgr.smithi152.lynahm (mgr.14196) 246 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:21:25.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:23.558514+0000 mgr.smithi152.lynahm (mgr.14196) 247 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:25.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:21:23.313236+0000 mgr.smithi152.lynahm (mgr.14196) 246 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:21:25.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:23.558514+0000 mgr.smithi152.lynahm (mgr.14196) 247 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:26.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:25.558818+0000 mgr.smithi152.lynahm (mgr.14196) 248 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:26.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:25.558818+0000 mgr.smithi152.lynahm (mgr.14196) 248 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:27.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.451+0000 7efe32a1a700 1 -- 172.21.15.152:0/2429841314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f79a0 msgr2=0x7efe2c0f7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:27.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.451+0000 7efe32a1a700 1 --2- 172.21.15.152:0/2429841314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f79a0 0x7efe2c0f7e00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7efe200047f0 tx=0x7efe20009cb0).stop 2024-04-06T12:21:27.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.451+0000 7efe32a1a700 1 -- 172.21.15.152:0/2429841314 shutdown_connections 2024-04-06T12:21:27.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.451+0000 7efe32a1a700 1 --2- 172.21.15.152:0/2429841314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f79a0 0x7efe2c0f7e00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.451+0000 7efe32a1a700 1 --2- 172.21.15.152:0/2429841314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe2c0f6700 0x7efe2c0f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.451+0000 7efe32a1a700 1 -- 172.21.15.152:0/2429841314 >> 172.21.15.152:0/2429841314 conn(0x7efe2c0f1e60 msgr2=0x7efe2c0f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:27.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.451+0000 7efe32a1a700 1 -- 172.21.15.152:0/2429841314 shutdown_connections 2024-04-06T12:21:27.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.451+0000 7efe32a1a700 1 -- 172.21.15.152:0/2429841314 wait complete. 2024-04-06T12:21:27.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe32a1a700 1 Processor -- start 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe32a1a700 1 -- start start 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe32a1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f6700 0x7efe2c061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe32a1a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe2c0f79a0 0x7efe2c10cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe32a1a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c10d280 con 0x7efe2c0f6700 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe32a1a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c10d3c0 con 0x7efe2c0f79a0 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe2bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f6700 0x7efe2c061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe2bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f6700 0x7efe2c061040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42006/0 (socket says 172.21.15.152:42006) 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe2bfff700 1 -- 172.21.15.152:0/3465379482 learned_addr learned my addr 172.21.15.152:0/3465379482 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe2b7fe700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe2c0f79a0 0x7efe2c10cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe2bfff700 1 -- 172.21.15.152:0/3465379482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe2c0f79a0 msgr2=0x7efe2c10cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe2bfff700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe2c0f79a0 0x7efe2c10cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.452+0000 7efe2bfff700 1 -- 172.21.15.152:0/3465379482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20005040 con 0x7efe2c0f6700 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.453+0000 7efe2bfff700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f6700 0x7efe2c061040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7efe1c002780 tx=0x7efe1c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.453+0000 7efe297fa700 1 -- 172.21.15.152:0/3465379482 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1c007b40 con 0x7efe2c0f6700 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.453+0000 7efe297fa700 1 -- 172.21.15.152:0/3465379482 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe1c00f040 con 0x7efe2c0f6700 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.453+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c10d620 con 0x7efe2c0f6700 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.453+0000 7efe297fa700 1 -- 172.21.15.152:0/3465379482 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1c014820 con 0x7efe2c0f6700 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.453+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c10dbb0 con 0x7efe2c0f6700 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.454+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c0feee0 con 0x7efe2c0f6700 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.454+0000 7efe297fa700 1 -- 172.21.15.152:0/3465379482 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7efe1c007ca0 con 0x7efe2c0f6700 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.454+0000 7efe297fa700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efe14061180 0x7efe14063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.455+0000 7efe297fa700 1 -- 172.21.15.152:0/3465379482 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7efe1c07c750 con 0x7efe2c0f6700 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.455+0000 7efe2b7fe700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efe14061180 0x7efe14063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:27.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.455+0000 7efe2b7fe700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efe14061180 0x7efe14063640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7efe20004f10 tx=0x7efe2000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:27.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.459+0000 7efe297fa700 1 -- 172.21.15.152:0/3465379482 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7efe1c0506e0 con 0x7efe2c0f6700 2024-04-06T12:21:27.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.678+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe2c059120 con 0x7efe14061180 2024-04-06T12:21:27.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.679+0000 7efe297fa700 1 -- 172.21.15.152:0/3465379482 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7efe2c059120 con 0x7efe14061180 2024-04-06T12:21:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efe14061180 msgr2=0x7efe14063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efe14061180 0x7efe14063640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7efe20004f10 tx=0x7efe2000b040).stop 2024-04-06T12:21:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f6700 msgr2=0x7efe2c061040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f6700 0x7efe2c061040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7efe1c002780 tx=0x7efe1c009ee0).stop 2024-04-06T12:21:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 shutdown_connections 2024-04-06T12:21:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7efe14061180 0x7efe14063640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe2c0f6700 0x7efe2c061040 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 --2- 172.21.15.152:0/3465379482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe2c0f79a0 0x7efe2c10cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 >> 172.21.15.152:0/3465379482 conn(0x7efe2c0f1e60 msgr2=0x7efe2c0fb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:27.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 shutdown_connections 2024-04-06T12:21:27.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.681+0000 7efe32a1a700 1 -- 172.21.15.152:0/3465379482 wait complete. 2024-04-06T12:21:27.689 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.785+0000 7f1d002f3700 1 -- 172.21.15.152:0/2507113731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f6450 msgr2=0x7f1cf80f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.785+0000 7f1d002f3700 1 --2- 172.21.15.152:0/2507113731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f6450 0x7f1cf80f8bd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f1ce80047f0 tx=0x7f1ce8009cb0).stop 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.785+0000 7f1d002f3700 1 -- 172.21.15.152:0/2507113731 shutdown_connections 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.785+0000 7f1d002f3700 1 --2- 172.21.15.152:0/2507113731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f6450 0x7f1cf80f8bd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.785+0000 7f1d002f3700 1 --2- 172.21.15.152:0/2507113731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf80f5ab0 0x7f1cf80f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.785+0000 7f1d002f3700 1 -- 172.21.15.152:0/2507113731 >> 172.21.15.152:0/2507113731 conn(0x7f1cf80f15d0 msgr2=0x7f1cf80f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.785+0000 7f1d002f3700 1 -- 172.21.15.152:0/2507113731 shutdown_connections 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.785+0000 7f1d002f3700 1 -- 172.21.15.152:0/2507113731 wait complete. 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1d002f3700 1 Processor -- start 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1d002f3700 1 -- start start 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1d002f3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f5ab0 0x7f1cf8107fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1d002f3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf80f6450 0x7f1cf81084b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:27.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1d002f3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8108a60 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1d002f3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8108ba0 con 0x7f1cf80f6450 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1cfe08f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f5ab0 0x7f1cf8107fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1cfe08f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f5ab0 0x7f1cf8107fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42018/0 (socket says 172.21.15.152:42018) 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1cfe08f700 1 -- 172.21.15.152:0/386951477 learned_addr learned my addr 172.21.15.152:0/386951477 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1cfd88e700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf80f6450 0x7f1cf81084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1cfe08f700 1 -- 172.21.15.152:0/386951477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf80f6450 msgr2=0x7f1cf81084b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1cfe08f700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf80f6450 0x7f1cf81084b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1cfe08f700 1 -- 172.21.15.152:0/386951477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce8005040 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.786+0000 7f1cfe08f700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f5ab0 0x7f1cf8107fc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f1cf4002770 tx=0x7f1cf4002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.787+0000 7f1cef7fe700 1 -- 172.21.15.152:0/386951477 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf4007b40 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.787+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf80f6a20 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.787+0000 7f1cef7fe700 1 -- 172.21.15.152:0/386951477 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1cf400f040 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.787+0000 7f1cef7fe700 1 -- 172.21.15.152:0/386951477 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf4014820 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.787+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf80f6f60 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.788+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf80fffd0 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.788+0000 7f1cef7fe700 1 -- 172.21.15.152:0/386951477 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f1cf4007ca0 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.789+0000 7f1cef7fe700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f1ce4061180 0x7f1ce4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:27.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.789+0000 7f1cef7fe700 1 -- 172.21.15.152:0/386951477 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f1cf407c580 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.789+0000 7f1cfd88e700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f1ce4061180 0x7f1ce4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:27.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.789+0000 7f1cfd88e700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f1ce4061180 0x7f1ce4063640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1ce8004f10 tx=0x7f1ce800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:27.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.797+0000 7f1cef7fe700 1 -- 172.21.15.152:0/386951477 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1cf4050510 con 0x7f1cf80f5ab0 2024-04-06T12:21:27.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.990+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cf80f8430 con 0x7f1ce4061180 2024-04-06T12:21:27.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.991+0000 7f1cef7fe700 1 -- 172.21.15.152:0/386951477 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f1cf80f8430 con 0x7f1ce4061180 2024-04-06T12:21:27.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f1ce4061180 msgr2=0x7f1ce4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:27.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f1ce4061180 0x7f1ce4063640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1ce8004f10 tx=0x7f1ce800b040).stop 2024-04-06T12:21:27.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f5ab0 msgr2=0x7f1cf8107fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:27.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f5ab0 0x7f1cf8107fc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f1cf4002770 tx=0x7f1cf4002a80).stop 2024-04-06T12:21:27.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 shutdown_connections 2024-04-06T12:21:27.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f1ce4061180 0x7f1ce4063640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf80f5ab0 0x7f1cf8107fc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 --2- 172.21.15.152:0/386951477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf80f6450 0x7f1cf81084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:27.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 >> 172.21.15.152:0/386951477 conn(0x7f1cf80f15d0 msgr2=0x7f1cf80fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:27.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 shutdown_connections 2024-04-06T12:21:27.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:27.993+0000 7f1d002f3700 1 -- 172.21.15.152:0/386951477 wait complete. 2024-04-06T12:21:28.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.095+0000 7fa424292700 1 -- 172.21.15.152:0/966249234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f8e50 msgr2=0x7fa41c0f9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.095+0000 7fa424292700 1 --2- 172.21.15.152:0/966249234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f8e50 0x7fa41c0f9270 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fa4180047f0 tx=0x7fa418009cb0).stop 2024-04-06T12:21:28.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.095+0000 7fa424292700 1 -- 172.21.15.152:0/966249234 shutdown_connections 2024-04-06T12:21:28.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.095+0000 7fa424292700 1 --2- 172.21.15.152:0/966249234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa41c0f97f0 0x7fa41c0f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.095+0000 7fa424292700 1 --2- 172.21.15.152:0/966249234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f8e50 0x7fa41c0f9270 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.095+0000 7fa424292700 1 -- 172.21.15.152:0/966249234 >> 172.21.15.152:0/966249234 conn(0x7fa41c0f15d0 msgr2=0x7fa41c0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:28.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.095+0000 7fa424292700 1 -- 172.21.15.152:0/966249234 shutdown_connections 2024-04-06T12:21:28.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.095+0000 7fa424292700 1 -- 172.21.15.152:0/966249234 wait complete. 2024-04-06T12:21:28.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa424292700 1 Processor -- start 2024-04-06T12:21:28.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa424292700 1 -- start start 2024-04-06T12:21:28.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa424292700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa41c0f8e50 0x7fa41c107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:28.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa424292700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f97f0 0x7fa41c108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa424292700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c108a40 con 0x7fa41c0f97f0 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa424292700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c108b80 con 0x7fa41c0f8e50 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa42182d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f97f0 0x7fa41c108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa42182d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f97f0 0x7fa41c108490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42028/0 (socket says 172.21.15.152:42028) 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa42182d700 1 -- 172.21.15.152:0/2097718204 learned_addr learned my addr 172.21.15.152:0/2097718204 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa42202e700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa41c0f8e50 0x7fa41c107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa42182d700 1 -- 172.21.15.152:0/2097718204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa41c0f8e50 msgr2=0x7fa41c107fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa42182d700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa41c0f8e50 0x7fa41c107fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.096+0000 7fa42182d700 1 -- 172.21.15.152:0/2097718204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418005040 con 0x7fa41c0f97f0 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.097+0000 7fa42182d700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f97f0 0x7fa41c108490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa40c002770 tx=0x7fa40c002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.097+0000 7fa413779700 1 -- 172.21.15.152:0/2097718204 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa40c007b40 con 0x7fa41c0f97f0 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.097+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c10d620 con 0x7fa41c0f97f0 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.097+0000 7fa413779700 1 -- 172.21.15.152:0/2097718204 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa40c00f040 con 0x7fa41c0f97f0 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.097+0000 7fa413779700 1 -- 172.21.15.152:0/2097718204 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa40c014820 con 0x7fa41c0f97f0 2024-04-06T12:21:28.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.097+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c10db60 con 0x7fa41c0f97f0 2024-04-06T12:21:28.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.098+0000 7fa413779700 1 -- 172.21.15.152:0/2097718204 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fa40c007ca0 con 0x7fa41c0f97f0 2024-04-06T12:21:28.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.098+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c0fffc0 con 0x7fa41c0f97f0 2024-04-06T12:21:28.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.098+0000 7fa413779700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa408061180 0x7fa408063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:28.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.099+0000 7fa413779700 1 -- 172.21.15.152:0/2097718204 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fa40c07c600 con 0x7fa41c0f97f0 2024-04-06T12:21:28.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.099+0000 7fa42202e700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa408061180 0x7fa408063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:28.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.099+0000 7fa42202e700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa408061180 0x7fa408063640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa418004f10 tx=0x7fa41800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:28.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.103+0000 7fa413779700 1 -- 172.21.15.152:0/2097718204 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa40c050510 con 0x7fa41c0f97f0 2024-04-06T12:21:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:26.905468+0000 mon.smithi152 (mon.0) 614 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:21:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:21:26.905831+0000 mgr.smithi152.lynahm (mgr.14196) 249 : cephadm [INF] Upgrade: Target is version 18.2.2-1086-g052adcad (unknown) 2024-04-06T12:21:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:21:26.905899+0000 mgr.smithi152.lynahm (mgr.14196) 250 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e'] 2024-04-06T12:21:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:26.906640+0000 mon.smithi152 (mon.0) 615 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:21:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:26.911295+0000 mon.smithi152 (mon.0) 616 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:21:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:21:26.911922+0000 mgr.smithi152.lynahm (mgr.14196) 251 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi152.lynahm) 2024-04-06T12:21:28.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:21:27.197119+0000 mgr.smithi152.lynahm (mgr.14196) 252 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e on smithi195 2024-04-06T12:21:28.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.294+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa41c059120 con 0x7fa408061180 2024-04-06T12:21:28.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:26.905468+0000 mon.smithi152 (mon.0) 614 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:21:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:21:26.905831+0000 mgr.smithi152.lynahm (mgr.14196) 249 : cephadm [INF] Upgrade: Target is version 18.2.2-1086-g052adcad (unknown) 2024-04-06T12:21:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:21:26.905899+0000 mgr.smithi152.lynahm (mgr.14196) 250 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e'] 2024-04-06T12:21:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:26.906640+0000 mon.smithi152 (mon.0) 615 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:21:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:26.911295+0000 mon.smithi152 (mon.0) 616 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:21:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:21:26.911922+0000 mgr.smithi152.lynahm (mgr.14196) 251 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi152.lynahm) 2024-04-06T12:21:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:21:27.197119+0000 mgr.smithi152.lynahm (mgr.14196) 252 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e on smithi195 2024-04-06T12:21:28.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.304+0000 7fa413779700 1 -- 172.21.15.152:0/2097718204 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3344 (secure 0 0 0) 0x7fa41c059120 con 0x7fa408061180 2024-04-06T12:21:28.302 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (5m) 59s ago 6m 23.7M - 0.23.0 ba2b418f427c a23e247a2160 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (6m) 59s ago 6m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (6m) 64s ago 6m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (5m) 59s ago 6m 55.1M - 8.3.5 dad864ee21e9 68f8b2b6d071 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (78s) 59s ago 77s 13.3M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (84s) 59s ago 83s 17.4M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (81s) 64s ago 81s 11.2M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (75s) 64s ago 75s 12.0M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:9283 running (7m) 59s ago 7m 434M - 16.2.15-1-g8963e9de 727f386679cb 10652d2c4bd5 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283 running (6m) 64s ago 5m 386M - 16.2.15-1-g8963e9de 727f386679cb 8a05c1240f1e 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (8m) 59s ago 8m 60.7M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (5m) 64s ago 5m 60.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 59s ago 6m 25.2M - 1.3.1 1dbe0e931976 7122c2020056 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 64s ago 5m 20.9M - 1.3.1 1dbe0e931976 9dbc0ed205d9 2024-04-06T12:21:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (5m) 59s ago 5m 40.4M 4640M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:21:28.304 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (4m) 59s ago 4m 42.8M 4640M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:21:28.304 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (4m) 59s ago 4m 39.7M 4640M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:21:28.304 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (3m) 64s ago 3m 39.9M 4982M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:21:28.304 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (3m) 64s ago 3m 38.9M 4982M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:21:28.304 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (2m) 64s ago 2m 38.7M 4982M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:21:28.304 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (5m) 64s ago 5m 60.2M - 2.33.4 514e6a882f6e d9a8fc6b6cf9 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa408061180 msgr2=0x7fa408063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa408061180 0x7fa408063640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa418004f10 tx=0x7fa41800b040).stop 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f97f0 msgr2=0x7fa41c108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f97f0 0x7fa41c108490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa40c002770 tx=0x7fa40c002a80).stop 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 shutdown_connections 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa408061180 0x7fa408063640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa41c0f8e50 0x7fa41c107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 --2- 172.21.15.152:0/2097718204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa41c0f97f0 0x7fa41c108490 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 >> 172.21.15.152:0/2097718204 conn(0x7fa41c0f15d0 msgr2=0x7fa41c0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 shutdown_connections 2024-04-06T12:21:28.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.307+0000 7fa424292700 1 -- 172.21.15.152:0/2097718204 wait complete. 2024-04-06T12:21:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.409+0000 7f315ed70700 1 -- 172.21.15.152:0/1611944944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 msgr2=0x7f31580f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.409+0000 7f315ed70700 1 --2- 172.21.15.152:0/1611944944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 0x7f31580f7c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f314c0047f0 tx=0x7f314c009cb0).stop 2024-04-06T12:21:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.409+0000 7f315ed70700 1 -- 172.21.15.152:0/1611944944 shutdown_connections 2024-04-06T12:21:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.409+0000 7f315ed70700 1 --2- 172.21.15.152:0/1611944944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31580f8aa0 0x7f31580f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.409+0000 7f315ed70700 1 --2- 172.21.15.152:0/1611944944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 0x7f31580f7c20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.409+0000 7f315ed70700 1 -- 172.21.15.152:0/1611944944 >> 172.21.15.152:0/1611944944 conn(0x7f31580f2f80 msgr2=0x7f31580f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.409+0000 7f315ed70700 1 -- 172.21.15.152:0/1611944944 shutdown_connections 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.409+0000 7f315ed70700 1 -- 172.21.15.152:0/1611944944 wait complete. 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f315ed70700 1 Processor -- start 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f315ed70700 1 -- start start 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f315ed70700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 0x7f3158108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f315ed70700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31580f8aa0 0x7f3158108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f315ed70700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3158108b20 con 0x7f31580f7800 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f315ed70700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3158108c60 con 0x7f31580f8aa0 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f315cb0c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 0x7f3158108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f315cb0c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 0x7f3158108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42056/0 (socket says 172.21.15.152:42056) 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f315cb0c700 1 -- 172.21.15.152:0/559557253 learned_addr learned my addr 172.21.15.152:0/559557253 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:21:28.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.410+0000 7f3157fff700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31580f8aa0 0x7f3158108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:28.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.411+0000 7f315cb0c700 1 -- 172.21.15.152:0/559557253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31580f8aa0 msgr2=0x7f3158108570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.411+0000 7f315cb0c700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31580f8aa0 0x7f3158108570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.411+0000 7f315cb0c700 1 -- 172.21.15.152:0/559557253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c005040 con 0x7f31580f7800 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.411+0000 7f315cb0c700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 0x7f3158108080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f314c013560 tx=0x7f314c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.411+0000 7f3155ffb700 1 -- 172.21.15.152:0/559557253 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f314c018070 con 0x7f31580f7800 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.411+0000 7f3155ffb700 1 -- 172.21.15.152:0/559557253 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f314c007e90 con 0x7f31580f7800 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.411+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315810d6a0 con 0x7f31580f7800 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.411+0000 7f3155ffb700 1 -- 172.21.15.152:0/559557253 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f314c01c380 con 0x7f31580f7800 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.411+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315810dc60 con 0x7f31580f7800 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.412+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31580fffe0 con 0x7f31580f7800 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.412+0000 7f3155ffb700 1 -- 172.21.15.152:0/559557253 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f314c0123c0 con 0x7f31580f7800 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.413+0000 7f3155ffb700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3148061180 0x7f3148063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.413+0000 7f3155ffb700 1 -- 172.21.15.152:0/559557253 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f314c07d630 con 0x7f31580f7800 2024-04-06T12:21:28.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.413+0000 7f3157fff700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3148061180 0x7f3148063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:28.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.413+0000 7f3157fff700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3148061180 0x7f3148063640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3144004ee0 tx=0x7f314400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:28.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.417+0000 7f3155ffb700 1 -- 172.21.15.152:0/559557253 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f314c0515c0 con 0x7f31580f7800 2024-04-06T12:21:28.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.675+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f31580598f0 con 0x7f31580f7800 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.675+0000 7f3155ffb700 1 -- 172.21.15.152:0/559557253 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f314c0511b0 con 0x7f31580f7800 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:21:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:21:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:21:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:21:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:21:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:21:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 14 2024-04-06T12:21:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:21:28.675 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.677+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3148061180 msgr2=0x7f3148063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.677+0000 7f315ed70700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3148061180 0x7f3148063640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3144004ee0 tx=0x7f314400b040).stop 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.677+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 msgr2=0x7f3158108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.677+0000 7f315ed70700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 0x7f3158108080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f314c013560 tx=0x7f314c009cb0).stop 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.677+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 shutdown_connections 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.677+0000 7f315ed70700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f3148061180 0x7f3148063640 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.677+0000 7f315ed70700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31580f7800 0x7f3158108080 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.677+0000 7f315ed70700 1 --2- 172.21.15.152:0/559557253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31580f8aa0 0x7f3158108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.677+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 >> 172.21.15.152:0/559557253 conn(0x7f31580f2f80 msgr2=0x7f31580fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.678+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 shutdown_connections 2024-04-06T12:21:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.678+0000 7f315ed70700 1 -- 172.21.15.152:0/559557253 wait complete. 2024-04-06T12:21:28.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.786+0000 7ff0a4b56700 1 -- 172.21.15.152:0/2892138567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 msgr2=0x7ff0a00f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.786+0000 7ff0a4b56700 1 --2- 172.21.15.152:0/2892138567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 0x7ff0a00f5ed0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ff0900047f0 tx=0x7ff090009cb0).stop 2024-04-06T12:21:28.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.786+0000 7ff0a4b56700 1 -- 172.21.15.152:0/2892138567 shutdown_connections 2024-04-06T12:21:28.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.786+0000 7ff0a4b56700 1 --2- 172.21.15.152:0/2892138567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0a00f6450 0x7ff0a00f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.786+0000 7ff0a4b56700 1 --2- 172.21.15.152:0/2892138567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 0x7ff0a00f5ed0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.786+0000 7ff0a4b56700 1 -- 172.21.15.152:0/2892138567 >> 172.21.15.152:0/2892138567 conn(0x7ff0a00f15d0 msgr2=0x7ff0a00f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:28.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.786+0000 7ff0a4b56700 1 -- 172.21.15.152:0/2892138567 shutdown_connections 2024-04-06T12:21:28.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.786+0000 7ff0a4b56700 1 -- 172.21.15.152:0/2892138567 wait complete. 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.787+0000 7ff0a4b56700 1 Processor -- start 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.787+0000 7ff0a4b56700 1 -- start start 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.787+0000 7ff0a4b56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 0x7ff0a01080f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.787+0000 7ff0a4b56700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0a00f6450 0x7ff0a01085e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.787+0000 7ff0a4b56700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0108b90 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.787+0000 7ff0a4b56700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0108cd0 con 0x7ff0a00f6450 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.787+0000 7ff09e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 0x7ff0a01080f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff09e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 0x7ff0a01080f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42068/0 (socket says 172.21.15.152:42068) 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff09e59c700 1 -- 172.21.15.152:0/485562169 learned_addr learned my addr 172.21.15.152:0/485562169 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff09dd9b700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0a00f6450 0x7ff0a01085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff09e59c700 1 -- 172.21.15.152:0/485562169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0a00f6450 msgr2=0x7ff0a01085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff09e59c700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0a00f6450 0x7ff0a01085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:28.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff09e59c700 1 -- 172.21.15.152:0/485562169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090005040 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff09e59c700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 0x7ff0a01080f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff090013560 tx=0x7ff090009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:28.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff08f7fe700 1 -- 172.21.15.152:0/485562169 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff090018070 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a010d710 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.788+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a010dcd0 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.789+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a0100020 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.789+0000 7ff08f7fe700 1 -- 172.21.15.152:0/485562169 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff090007e90 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.789+0000 7ff08f7fe700 1 -- 172.21.15.152:0/485562169 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff090025e70 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.790+0000 7ff08f7fe700 1 -- 172.21.15.152:0/485562169 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7ff0900123c0 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.791+0000 7ff08f7fe700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff088061180 0x7ff088063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:28.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.791+0000 7ff08f7fe700 1 -- 172.21.15.152:0/485562169 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7ff09007d630 con 0x7ff0a00f5ab0 2024-04-06T12:21:28.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.791+0000 7ff09dd9b700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff088061180 0x7ff088063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:28.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.791+0000 7ff09dd9b700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff088061180 0x7ff088063640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff0a00f6890 tx=0x7ff09400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:28.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:28.798+0000 7ff08f7fe700 1 -- 172.21.15.152:0/485562169 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff090052530 con 0x7ff0a00f5ab0 2024-04-06T12:21:29.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.058+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0a0059120 con 0x7ff088061180 2024-04-06T12:21:29.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.059+0000 7ff08f7fe700 1 -- 172.21.15.152:0/485562169 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7ff0a0059120 con 0x7ff088061180 2024-04-06T12:21:29.057 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:21:29.057 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:21:29.057 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:21:29.058 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:21:29.058 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2024-04-06T12:21:29.058 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "0/2 daemons upgraded", 2024-04-06T12:21:29.058 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e image on host smithi195", 2024-04-06T12:21:29.058 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:21:29.058 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:21:29.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff088061180 msgr2=0x7ff088063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:29.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff088061180 0x7ff088063640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff0a00f6890 tx=0x7ff09400b040).stop 2024-04-06T12:21:29.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 msgr2=0x7ff0a01080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:29.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 0x7ff0a01080f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff090013560 tx=0x7ff090009cb0).stop 2024-04-06T12:21:29.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 shutdown_connections 2024-04-06T12:21:29.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7ff088061180 0x7ff088063640 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:29.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a00f5ab0 0x7ff0a01080f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:29.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 --2- 172.21.15.152:0/485562169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0a00f6450 0x7ff0a01085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:29.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 >> 172.21.15.152:0/485562169 conn(0x7ff0a00f15d0 msgr2=0x7ff0a00fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:29.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 shutdown_connections 2024-04-06T12:21:29.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:29.061+0000 7ff0a4b56700 1 -- 172.21.15.152:0/485562169 wait complete. 2024-04-06T12:21:29.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:27.559193+0000 mgr.smithi152.lynahm (mgr.14196) 253 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:29.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:27.679882+0000 mgr.smithi152.lynahm (mgr.14196) 254 : audit [DBG] from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:21:29.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:27.992031+0000 mgr.smithi152.lynahm (mgr.14196) 255 : audit [DBG] from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:21:29.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:28.296337+0000 mgr.smithi152.lynahm (mgr.14196) 256 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:21:29.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:28.676728+0000 mon.smithi152 (mon.0) 617 : audit [DBG] from='client.? 172.21.15.152:0/559557253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:21:29.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:27.559193+0000 mgr.smithi152.lynahm (mgr.14196) 253 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:29.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:27.679882+0000 mgr.smithi152.lynahm (mgr.14196) 254 : audit [DBG] from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:21:29.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:27.992031+0000 mgr.smithi152.lynahm (mgr.14196) 255 : audit [DBG] from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:21:29.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:28.296337+0000 mgr.smithi152.lynahm (mgr.14196) 256 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:21:29.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:28.676728+0000 mon.smithi152 (mon.0) 617 : audit [DBG] from='client.? 172.21.15.152:0/559557253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:21:30.193 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:29.060367+0000 mgr.smithi152.lynahm (mgr.14196) 257 : audit [DBG] from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:21:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:29.060367+0000 mgr.smithi152.lynahm (mgr.14196) 257 : audit [DBG] from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:21:31.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:29.559637+0000 mgr.smithi152.lynahm (mgr.14196) 258 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:31.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:29.559637+0000 mgr.smithi152.lynahm (mgr.14196) 258 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:33.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:31.560017+0000 mgr.smithi152.lynahm (mgr.14196) 259 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:31.560017+0000 mgr.smithi152.lynahm (mgr.14196) 259 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:35.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:33.560410+0000 mgr.smithi152.lynahm (mgr.14196) 260 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:35.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:33.560410+0000 mgr.smithi152.lynahm (mgr.14196) 260 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:37.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:35.560747+0000 mgr.smithi152.lynahm (mgr.14196) 261 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:37.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:35.560747+0000 mgr.smithi152.lynahm (mgr.14196) 261 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:39.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:37.561194+0000 mgr.smithi152.lynahm (mgr.14196) 262 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:37.561194+0000 mgr.smithi152.lynahm (mgr.14196) 262 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:41.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:39.561647+0000 mgr.smithi152.lynahm (mgr.14196) 263 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:41.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:39.561647+0000 mgr.smithi152.lynahm (mgr.14196) 263 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:43.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:41.562108+0000 mgr.smithi152.lynahm (mgr.14196) 264 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:43.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:41.562108+0000 mgr.smithi152.lynahm (mgr.14196) 264 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:45.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:43.562574+0000 mgr.smithi152.lynahm (mgr.14196) 265 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:45.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:43.562574+0000 mgr.smithi152.lynahm (mgr.14196) 265 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:45.562917+0000 mgr.smithi152.lynahm (mgr.14196) 266 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:47.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:45.562917+0000 mgr.smithi152.lynahm (mgr.14196) 266 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:49.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:47.563366+0000 mgr.smithi152.lynahm (mgr.14196) 267 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:49.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:47.563366+0000 mgr.smithi152.lynahm (mgr.14196) 267 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:51.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:49.563814+0000 mgr.smithi152.lynahm (mgr.14196) 268 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:51.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:49.563814+0000 mgr.smithi152.lynahm (mgr.14196) 268 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:53.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:51.564263+0000 mgr.smithi152.lynahm (mgr.14196) 269 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:53.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:51.564263+0000 mgr.smithi152.lynahm (mgr.14196) 269 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:55.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:53.564703+0000 mgr.smithi152.lynahm (mgr.14196) 270 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:53.564703+0000 mgr.smithi152.lynahm (mgr.14196) 270 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:57.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:55.565246+0000 mgr.smithi152.lynahm (mgr.14196) 271 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:57.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:55.565246+0000 mgr.smithi152.lynahm (mgr.14196) 271 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:21:58.220 INFO:tasks.workunit.client.1.smithi195.stderr:Updating files: 94% (11786/12461) Updating files: 95% (11838/12461) Updating files: 96% (11963/12461) Updating files: 97% (12088/12461) Updating files: 98% (12212/12461) Updating files: 99% (12337/12461) Updating files: 100% (12461/12461) Updating files: 100% (12461/12461), done. 2024-04-06T12:21:58.771 INFO:tasks.workunit.client.1.smithi195.stderr:Note: switching to '800ec6d64a7fa0648ad53edfc6e50b41fc4cd674'. 2024-04-06T12:21:58.771 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr:state without impacting any branches by switching back to a branch. 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr: git switch -c 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr:Or undo this operation with: 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr: git switch - 2024-04-06T12:21:58.772 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-04-06T12:21:58.773 INFO:tasks.workunit.client.1.smithi195.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-06T12:21:58.773 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-04-06T12:21:58.773 INFO:tasks.workunit.client.1.smithi195.stderr:HEAD is now at 800ec6d64a7 Merge pull request #56347 from cbodley/wip-65003-reef 2024-04-06T12:21:58.778 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-06T12:21:58.843 INFO:tasks.workunit.client.1.smithi195.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-06T12:21:58.845 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-06T12:21:58.845 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-06T12:21:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.176+0000 7f8bcb58a700 1 -- 172.21.15.152:0/2783332026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 msgr2=0x7f8bc40f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.176+0000 7f8bcb58a700 1 --2- 172.21.15.152:0/2783332026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 0x7f8bc40f7df0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f8bc00047f0 tx=0x7f8bc0009cb0).stop 2024-04-06T12:21:59.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.176+0000 7f8bcb58a700 1 -- 172.21.15.152:0/2783332026 shutdown_connections 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.176+0000 7f8bcb58a700 1 --2- 172.21.15.152:0/2783332026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 0x7f8bc40f7df0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.176+0000 7f8bcb58a700 1 --2- 172.21.15.152:0/2783332026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bc40f66f0 0x7f8bc40f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.176+0000 7f8bcb58a700 1 -- 172.21.15.152:0/2783332026 >> 172.21.15.152:0/2783332026 conn(0x7f8bc40f1e50 msgr2=0x7f8bc40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.176+0000 7f8bcb58a700 1 -- 172.21.15.152:0/2783332026 shutdown_connections 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.177+0000 7f8bcb58a700 1 -- 172.21.15.152:0/2783332026 wait complete. 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.177+0000 7f8bcb58a700 1 Processor -- start 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.177+0000 7f8bcb58a700 1 -- start start 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.177+0000 7f8bcb58a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bc40f66f0 0x7f8bc4107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.177+0000 7f8bcb58a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 0x7f8bc4108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.177+0000 7f8bcb58a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc41089f0 con 0x7f8bc40f7990 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.177+0000 7f8bcb58a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc4108b30 con 0x7f8bc40f66f0 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bc8b25700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 0x7f8bc4108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bc8b25700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 0x7f8bc4108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44238/0 (socket says 172.21.15.152:44238) 2024-04-06T12:21:59.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bc8b25700 1 -- 172.21.15.152:0/1654150737 learned_addr learned my addr 172.21.15.152:0/1654150737 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bc9326700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bc40f66f0 0x7f8bc4107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bc8b25700 1 -- 172.21.15.152:0/1654150737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bc40f66f0 msgr2=0x7f8bc4107f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bc8b25700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bc40f66f0 0x7f8bc4107f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bc8b25700 1 -- 172.21.15.152:0/1654150737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0005040 con 0x7f8bc40f7990 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bc8b25700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 0x7f8bc4108440 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f8bc0013620 tx=0x7f8bc0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bb67fc700 1 -- 172.21.15.152:0/1654150737 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc000e070 con 0x7f8bc40f7990 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bb67fc700 1 -- 172.21.15.152:0/1654150737 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8bc0007e90 con 0x7f8bc40f7990 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc410d570 con 0x7f8bc40f7990 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bb67fc700 1 -- 172.21.15.152:0/1654150737 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc0018070 con 0x7f8bc40f7990 2024-04-06T12:21:59.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.178+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc410db30 con 0x7f8bc40f7990 2024-04-06T12:21:59.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.179+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc40feeb0 con 0x7f8bc40f7990 2024-04-06T12:21:59.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.180+0000 7f8bb67fc700 1 -- 172.21.15.152:0/1654150737 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f8bc001d420 con 0x7f8bc40f7990 2024-04-06T12:21:59.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.180+0000 7f8bb67fc700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f8bb0061180 0x7f8bb0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:59.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.180+0000 7f8bb67fc700 1 -- 172.21.15.152:0/1654150737 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f8bc007d560 con 0x7f8bc40f7990 2024-04-06T12:21:59.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.180+0000 7f8bc9326700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f8bb0061180 0x7f8bb0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:59.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.180+0000 7f8bc9326700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f8bb0061180 0x7f8bb0063640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8bc40f77f0 tx=0x7f8bb800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:59.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.184+0000 7f8bb67fc700 1 -- 172.21.15.152:0/1654150737 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8bc0051570 con 0x7f8bc40f7990 2024-04-06T12:21:59.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:21:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:57.565667+0000 mgr.smithi152.lynahm (mgr.14196) 272 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:59.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:21:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:57.565667+0000 mgr.smithi152.lynahm (mgr.14196) 272 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:21:59.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.366+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bc410e1c0 con 0x7f8bb0061180 2024-04-06T12:21:59.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.367+0000 7f8bb67fc700 1 -- 172.21.15.152:0/1654150737 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f8bc410e1c0 con 0x7f8bb0061180 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.368+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f8bb0061180 msgr2=0x7f8bb0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.368+0000 7f8bcb58a700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f8bb0061180 0x7f8bb0063640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8bc40f77f0 tx=0x7f8bb800b040).stop 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.368+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 msgr2=0x7f8bc4108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.369+0000 7f8bcb58a700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 0x7f8bc4108440 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f8bc0013620 tx=0x7f8bc0009cb0).stop 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.369+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 shutdown_connections 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.369+0000 7f8bcb58a700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f8bb0061180 0x7f8bb0063640 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.369+0000 7f8bcb58a700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bc40f66f0 0x7f8bc4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.369+0000 7f8bcb58a700 1 --2- 172.21.15.152:0/1654150737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bc40f7990 0x7f8bc4108440 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.369+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 >> 172.21.15.152:0/1654150737 conn(0x7f8bc40f1e50 msgr2=0x7f8bc4060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:59.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.369+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 shutdown_connections 2024-04-06T12:21:59.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.369+0000 7f8bcb58a700 1 -- 172.21.15.152:0/1654150737 wait complete. 2024-04-06T12:21:59.377 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:21:59.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.467+0000 7fa3b73da700 1 -- 172.21.15.152:0/3815859912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 msgr2=0x7fa3b00f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.467+0000 7fa3b73da700 1 --2- 172.21.15.152:0/3815859912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 0x7fa3b00f6b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fa3a00047f0 tx=0x7fa3a0009cb0).stop 2024-04-06T12:21:59.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.467+0000 7fa3b73da700 1 -- 172.21.15.152:0/3815859912 shutdown_connections 2024-04-06T12:21:59.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.467+0000 7fa3b73da700 1 --2- 172.21.15.152:0/3815859912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3b00f7990 0x7fa3b00f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.467+0000 7fa3b73da700 1 --2- 172.21.15.152:0/3815859912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 0x7fa3b00f6b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.467+0000 7fa3b73da700 1 -- 172.21.15.152:0/3815859912 >> 172.21.15.152:0/3815859912 conn(0x7fa3b00f1e50 msgr2=0x7fa3b00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.467+0000 7fa3b73da700 1 -- 172.21.15.152:0/3815859912 shutdown_connections 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.467+0000 7fa3b73da700 1 -- 172.21.15.152:0/3815859912 wait complete. 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b73da700 1 Processor -- start 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b73da700 1 -- start start 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b73da700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 0x7fa3b00fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b73da700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3b00f7990 0x7fa3b00fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b73da700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00fec40 con 0x7fa3b00f66f0 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b73da700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00fd1e0 con 0x7fa3b00f7990 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b5176700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 0x7fa3b00fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:59.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b5176700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 0x7fa3b00fe690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44248/0 (socket says 172.21.15.152:44248) 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b5176700 1 -- 172.21.15.152:0/2080125435 learned_addr learned my addr 172.21.15.152:0/2080125435 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.468+0000 7fa3b4975700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3b00f7990 0x7fa3b00fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.469+0000 7fa3b5176700 1 -- 172.21.15.152:0/2080125435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3b00f7990 msgr2=0x7fa3b00fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.469+0000 7fa3b5176700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3b00f7990 0x7fa3b00fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.469+0000 7fa3b5176700 1 -- 172.21.15.152:0/2080125435 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a0005040 con 0x7fa3b00f66f0 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.469+0000 7fa3b5176700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 0x7fa3b00fe690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fa3a000b120 tx=0x7fa3a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.469+0000 7fa3a67fc700 1 -- 172.21.15.152:0/2080125435 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a000e030 con 0x7fa3b00f66f0 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.469+0000 7fa3a67fc700 1 -- 172.21.15.152:0/2080125435 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa3a0007e90 con 0x7fa3b00f66f0 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.469+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b00fd400 con 0x7fa3b00f66f0 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.469+0000 7fa3a67fc700 1 -- 172.21.15.152:0/2080125435 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a0018070 con 0x7fa3b00f66f0 2024-04-06T12:21:59.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.469+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b00fd960 con 0x7fa3b00f66f0 2024-04-06T12:21:59.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.470+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0047540 con 0x7fa3b00f66f0 2024-04-06T12:21:59.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.470+0000 7fa3a67fc700 1 -- 172.21.15.152:0/2080125435 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7fa3a001d420 con 0x7fa3b00f66f0 2024-04-06T12:21:59.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.471+0000 7fa3a67fc700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa39c061180 0x7fa39c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:59.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.471+0000 7fa3a67fc700 1 -- 172.21.15.152:0/2080125435 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fa3a007dd10 con 0x7fa3b00f66f0 2024-04-06T12:21:59.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.471+0000 7fa3b4975700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa39c061180 0x7fa39c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:59.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.471+0000 7fa3b4975700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa39c061180 0x7fa39c063640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa3ac004d20 tx=0x7fa3ac009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:59.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.475+0000 7fa3a67fc700 1 -- 172.21.15.152:0/2080125435 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa3a0051ca0 con 0x7fa3b00f66f0 2024-04-06T12:21:59.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.655+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3b0101fa0 con 0x7fa39c061180 2024-04-06T12:21:59.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.656+0000 7fa3a67fc700 1 -- 172.21.15.152:0/2080125435 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fa3b0101fa0 con 0x7fa39c061180 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa39c061180 msgr2=0x7fa39c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa39c061180 0x7fa39c063640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa3ac004d20 tx=0x7fa3ac009040).stop 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 msgr2=0x7fa3b00fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 0x7fa3b00fe690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fa3a000b120 tx=0x7fa3a0009cb0).stop 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 shutdown_connections 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7fa39c061180 0x7fa39c063640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3b00f66f0 0x7fa3b00fe690 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 --2- 172.21.15.152:0/2080125435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3b00f7990 0x7fa3b00fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 >> 172.21.15.152:0/2080125435 conn(0x7fa3b00f1e50 msgr2=0x7fa3b00fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 shutdown_connections 2024-04-06T12:21:59.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.658+0000 7fa3b73da700 1 -- 172.21.15.152:0/2080125435 wait complete. 2024-04-06T12:21:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.755+0000 7f51bd4b5700 1 -- 172.21.15.152:0/3228652357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 msgr2=0x7f51b80f7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.755+0000 7f51bd4b5700 1 --2- 172.21.15.152:0/3228652357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 0x7f51b80f7bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f51a00047f0 tx=0x7f51a0009cb0).stop 2024-04-06T12:21:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.755+0000 7f51bd4b5700 1 -- 172.21.15.152:0/3228652357 shutdown_connections 2024-04-06T12:21:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.755+0000 7f51bd4b5700 1 --2- 172.21.15.152:0/3228652357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51b80f80e0 0x7f51b80f8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:21:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.755+0000 7f51bd4b5700 1 --2- 172.21.15.152:0/3228652357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 0x7f51b80f7bf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.755+0000 7f51bd4b5700 1 -- 172.21.15.152:0/3228652357 >> 172.21.15.152:0/3228652357 conn(0x7f51b80f2fb0 msgr2=0x7f51b80f53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.755+0000 7f51bd4b5700 1 -- 172.21.15.152:0/3228652357 shutdown_connections 2024-04-06T12:21:59.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.755+0000 7f51bd4b5700 1 -- 172.21.15.152:0/3228652357 wait complete. 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51bd4b5700 1 Processor -- start 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51bd4b5700 1 -- start start 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51bd4b5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 0x7f51b8108000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51bd4b5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51b80f80e0 0x7f51b81084f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51bd4b5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8108b30 con 0x7f51b80f77d0 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51bd4b5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8108c70 con 0x7f51b80f80e0 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51b6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 0x7f51b8108000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51b6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 0x7f51b8108000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44264/0 (socket says 172.21.15.152:44264) 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51b6ffd700 1 -- 172.21.15.152:0/429330262 learned_addr learned my addr 172.21.15.152:0/429330262 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51b67fc700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51b80f80e0 0x7f51b81084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51b6ffd700 1 -- 172.21.15.152:0/429330262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51b80f80e0 msgr2=0x7f51b81084f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51b6ffd700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51b80f80e0 0x7f51b81084f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51b6ffd700 1 -- 172.21.15.152:0/429330262 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0005040 con 0x7f51b80f77d0 2024-04-06T12:21:59.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.756+0000 7f51b67fc700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51b80f80e0 0x7f51b81084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:21:59.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.757+0000 7f51b6ffd700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 0x7f51b8108000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f51a000b120 tx=0x7f51a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:59.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.757+0000 7f51affff700 1 -- 172.21.15.152:0/429330262 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a000e030 con 0x7f51b80f77d0 2024-04-06T12:21:59.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.757+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b810d6b0 con 0x7f51b80f77d0 2024-04-06T12:21:59.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.757+0000 7f51affff700 1 -- 172.21.15.152:0/429330262 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f51a0007e90 con 0x7f51b80f77d0 2024-04-06T12:21:59.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.757+0000 7f51affff700 1 -- 172.21.15.152:0/429330262 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a0018070 con 0x7f51b80f77d0 2024-04-06T12:21:59.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.757+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b810db90 con 0x7f51b80f77d0 2024-04-06T12:21:59.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.758+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b8100050 con 0x7f51b80f77d0 2024-04-06T12:21:59.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.758+0000 7f51affff700 1 -- 172.21.15.152:0/429330262 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f51a001d960 con 0x7f51b80f77d0 2024-04-06T12:21:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.758+0000 7f51affff700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f51a4061160 0x7f51a4063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:21:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.758+0000 7f51affff700 1 -- 172.21.15.152:0/429330262 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f51a007df10 con 0x7f51b80f77d0 2024-04-06T12:21:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.758+0000 7f51b67fc700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f51a4061160 0x7f51a4063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:21:59.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.759+0000 7f51b67fc700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f51a4061160 0x7f51a4063620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f51a800a900 tx=0x7f51a8008040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:21:59.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.763+0000 7f51affff700 1 -- 172.21.15.152:0/429330262 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f51a0051ea0 con 0x7f51b80f77d0 2024-04-06T12:21:59.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.932+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f51b8059120 con 0x7f51a4061160 2024-04-06T12:21:59.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.941+0000 7f51affff700 1 -- 172.21.15.152:0/429330262 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f51b8059120 con 0x7f51a4061160 2024-04-06T12:21:59.940 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:21:59.940 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (5m) 90s ago 7m 23.7M - 0.23.0 ba2b418f427c a23e247a2160 2024-04-06T12:21:59.940 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (7m) 90s ago 7m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:21:59.940 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (6m) 96s ago 6m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:21:59.940 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (5m) 90s ago 6m 55.1M - 8.3.5 dad864ee21e9 68f8b2b6d071 2024-04-06T12:21:59.940 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (110s) 90s ago 109s 13.3M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:21:59.940 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (116s) 90s ago 115s 17.4M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:21:59.940 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (113s) 96s ago 112s 11.2M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (107s) 96s ago 106s 12.0M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:9283 running (8m) 90s ago 8m 434M - 16.2.15-1-g8963e9de 727f386679cb 10652d2c4bd5 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283 running (6m) 96s ago 6m 386M - 16.2.15-1-g8963e9de 727f386679cb 8a05c1240f1e 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (8m) 90s ago 8m 60.7M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (6m) 96s ago 6m 60.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 90s ago 6m 25.2M - 1.3.1 1dbe0e931976 7122c2020056 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 96s ago 6m 20.9M - 1.3.1 1dbe0e931976 9dbc0ed205d9 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (5m) 90s ago 5m 40.4M 4640M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (5m) 90s ago 5m 42.8M 4640M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (4m) 90s ago 4m 39.7M 4640M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (4m) 96s ago 4m 39.9M 4982M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (3m) 96s ago 3m 38.9M 4982M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (3m) 96s ago 3m 38.7M 4982M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:21:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (6m) 96s ago 6m 60.2M - 2.33.4 514e6a882f6e d9a8fc6b6cf9 2024-04-06T12:21:59.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.943+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f51a4061160 msgr2=0x7f51a4063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.943+0000 7f51bd4b5700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f51a4061160 0x7f51a4063620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f51a800a900 tx=0x7f51a8008040).stop 2024-04-06T12:21:59.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.943+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 msgr2=0x7f51b8108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:21:59.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.943+0000 7f51bd4b5700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 0x7f51b8108000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f51a000b120 tx=0x7f51a0009cb0).stop 2024-04-06T12:21:59.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.943+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 shutdown_connections 2024-04-06T12:21:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.943+0000 7f51bd4b5700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f51a4061160 0x7f51a4063620 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.943+0000 7f51bd4b5700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80f77d0 0x7f51b8108000 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.943+0000 7f51bd4b5700 1 --2- 172.21.15.152:0/429330262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51b80f80e0 0x7f51b81084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:21:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.943+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 >> 172.21.15.152:0/429330262 conn(0x7f51b80f2fb0 msgr2=0x7f51b80fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:21:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.944+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 shutdown_connections 2024-04-06T12:21:59.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:21:59.944+0000 7f51bd4b5700 1 -- 172.21.15.152:0/429330262 wait complete. 2024-04-06T12:22:00.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 -- 172.21.15.152:0/936771812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f8cb0 msgr2=0x7f096c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:00.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 --2- 172.21.15.152:0/936771812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f8cb0 0x7f096c0f9110 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f095c0047f0 tx=0x7f095c009cb0).stop 2024-04-06T12:22:00.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 -- 172.21.15.152:0/936771812 shutdown_connections 2024-04-06T12:22:00.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 --2- 172.21.15.152:0/936771812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f8cb0 0x7f096c0f9110 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 --2- 172.21.15.152:0/936771812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096c0f7a10 0x7f096c0f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 -- 172.21.15.152:0/936771812 >> 172.21.15.152:0/936771812 conn(0x7f096c0f3150 msgr2=0x7f096c0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:00.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 -- 172.21.15.152:0/936771812 shutdown_connections 2024-04-06T12:22:00.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 -- 172.21.15.152:0/936771812 wait complete. 2024-04-06T12:22:00.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 Processor -- start 2024-04-06T12:22:00.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.041+0000 7f097178a700 1 -- start start 2024-04-06T12:22:00.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f097178a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f7a10 0x7f096c1081b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:00.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f097178a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096c0f8cb0 0x7f096c1086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:00.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f097178a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c108c50 con 0x7f096c0f7a10 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f097178a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c108d90 con 0x7f096c0f8cb0 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f096affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f7a10 0x7f096c1081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f096affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f7a10 0x7f096c1081b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44290/0 (socket says 172.21.15.152:44290) 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f096affd700 1 -- 172.21.15.152:0/683489185 learned_addr learned my addr 172.21.15.152:0/683489185 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f096a7fc700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096c0f8cb0 0x7f096c1086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f096affd700 1 -- 172.21.15.152:0/683489185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096c0f8cb0 msgr2=0x7f096c1086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f096affd700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096c0f8cb0 0x7f096c1086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f096affd700 1 -- 172.21.15.152:0/683489185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c005040 con 0x7f096c0f7a10 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f096affd700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f7a10 0x7f096c1081b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0960002780 tx=0x7f0960009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f0953fff700 1 -- 172.21.15.152:0/683489185 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0960007b40 con 0x7f096c0f7a10 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096c10d830 con 0x7f096c0f7a10 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f0953fff700 1 -- 172.21.15.152:0/683489185 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f096000f040 con 0x7f096c0f7a10 2024-04-06T12:22:00.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f0953fff700 1 -- 172.21.15.152:0/683489185 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0960014820 con 0x7f096c0f7a10 2024-04-06T12:22:00.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.042+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096c10ddf0 con 0x7f096c0f7a10 2024-04-06T12:22:00.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.043+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096c05fb50 con 0x7f096c0f7a10 2024-04-06T12:22:00.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.044+0000 7f0953fff700 1 -- 172.21.15.152:0/683489185 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f0960007ca0 con 0x7f096c0f7a10 2024-04-06T12:22:00.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.044+0000 7f0953fff700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f0954061180 0x7f0954063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:00.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.044+0000 7f0953fff700 1 -- 172.21.15.152:0/683489185 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f096007c7a0 con 0x7f096c0f7a10 2024-04-06T12:22:00.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.044+0000 7f096a7fc700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f0954061180 0x7f0954063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:00.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.044+0000 7f096a7fc700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f0954061180 0x7f0954063640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f095c004f10 tx=0x7f095c00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:00.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.048+0000 7f0953fff700 1 -- 172.21.15.152:0/683489185 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0960050730 con 0x7f096c0f7a10 2024-04-06T12:22:00.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.274+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f096c102170 con 0x7f096c0f7a10 2024-04-06T12:22:00.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.274+0000 7f0953fff700 1 -- 172.21.15.152:0/683489185 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f0960050320 con 0x7f096c0f7a10 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:22:00.273 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 14 2024-04-06T12:22:00.274 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:22:00.274 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:22:00.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f0954061180 msgr2=0x7f0954063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:00.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f0954061180 0x7f0954063640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f095c004f10 tx=0x7f095c00b040).stop 2024-04-06T12:22:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f7a10 msgr2=0x7f096c1081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f7a10 0x7f096c1081b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0960002780 tx=0x7f0960009ee0).stop 2024-04-06T12:22:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 shutdown_connections 2024-04-06T12:22:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f0954061180 0x7f0954063640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f096c0f7a10 0x7f096c1081b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 --2- 172.21.15.152:0/683489185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f096c0f8cb0 0x7f096c1086a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 >> 172.21.15.152:0/683489185 conn(0x7f096c0f3150 msgr2=0x7f096c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 shutdown_connections 2024-04-06T12:22:00.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.276+0000 7f097178a700 1 -- 172.21.15.152:0/683489185 wait complete. 2024-04-06T12:22:00.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.377+0000 7f4182482700 1 -- 172.21.15.152:0/3485509954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 msgr2=0x7f417c0f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:00.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.377+0000 7f4182482700 1 --2- 172.21.15.152:0/3485509954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 0x7f417c0f7b40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f416c0047f0 tx=0x7f416c009cb0).stop 2024-04-06T12:22:00.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.378+0000 7f4182482700 1 -- 172.21.15.152:0/3485509954 shutdown_connections 2024-04-06T12:22:00.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.378+0000 7f4182482700 1 --2- 172.21.15.152:0/3485509954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 0x7f417c0f7b40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.378+0000 7f4182482700 1 --2- 172.21.15.152:0/3485509954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0f6d40 0x7f417c0f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.378+0000 7f4182482700 1 -- 172.21.15.152:0/3485509954 >> 172.21.15.152:0/3485509954 conn(0x7f417c0f1670 msgr2=0x7f417c0f3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:00.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.378+0000 7f4182482700 1 -- 172.21.15.152:0/3485509954 shutdown_connections 2024-04-06T12:22:00.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.378+0000 7f4182482700 1 -- 172.21.15.152:0/3485509954 wait complete. 2024-04-06T12:22:00.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.378+0000 7f4182482700 1 Processor -- start 2024-04-06T12:22:00.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.378+0000 7f4182482700 1 -- start start 2024-04-06T12:22:00.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f4182482700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0f6d40 0x7f417c107fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:00.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f4182482700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 0x7f417c1084b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:00.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f4182482700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c108a60 con 0x7f417c0f76e0 2024-04-06T12:22:00.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f4182482700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c108ba0 con 0x7f417c0f6d40 2024-04-06T12:22:00.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f417b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 0x7f417c1084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:00.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f417b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 0x7f417c1084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44310/0 (socket says 172.21.15.152:44310) 2024-04-06T12:22:00.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f417b7fe700 1 -- 172.21.15.152:0/3523851494 learned_addr learned my addr 172.21.15.152:0/3523851494 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f417bfff700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0f6d40 0x7f417c107fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f417b7fe700 1 -- 172.21.15.152:0/3523851494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0f6d40 msgr2=0x7f417c107fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f417b7fe700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0f6d40 0x7f417c107fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f417b7fe700 1 -- 172.21.15.152:0/3523851494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c005040 con 0x7f417c0f76e0 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f417bfff700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0f6d40 0x7f417c107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f417b7fe700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 0x7f417c1084b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f416c00b120 tx=0x7f416c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f41797fa700 1 -- 172.21.15.152:0/3523851494 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f416c00e030 con 0x7f417c0f76e0 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c10d5e0 con 0x7f417c0f76e0 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f41797fa700 1 -- 172.21.15.152:0/3523851494 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f416c007e90 con 0x7f417c0f76e0 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f41797fa700 1 -- 172.21.15.152:0/3523851494 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f416c018070 con 0x7f417c0f76e0 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.379+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c10dba0 con 0x7f417c0f76e0 2024-04-06T12:22:00.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.380+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c0feef0 con 0x7f417c0f76e0 2024-04-06T12:22:00.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.381+0000 7f41797fa700 1 -- 172.21.15.152:0/3523851494 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 77153+0+0 (secure 0 0 0) 0x7f416c01d960 con 0x7f417c0f76e0 2024-04-06T12:22:00.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.381+0000 7f41797fa700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4164061180 0x7f4164063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:00.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.381+0000 7f41797fa700 1 -- 172.21.15.152:0/3523851494 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f416c07dec0 con 0x7f417c0f76e0 2024-04-06T12:22:00.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.381+0000 7f417bfff700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4164061180 0x7f4164063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:00.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.381+0000 7f417bfff700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4164061180 0x7f4164063640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4170007fd0 tx=0x7f4170009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:00.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.385+0000 7f41797fa700 1 -- 172.21.15.152:0/3523851494 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f416c051e50 con 0x7f417c0f76e0 2024-04-06T12:22:00.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.561+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 --> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f417c10e1e0 con 0x7f4164061180 2024-04-06T12:22:00.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.562+0000 7f41797fa700 1 -- 172.21.15.152:0/3523851494 <== mgr.14196 v2:172.21.15.152:6800/3059779308 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f417c10e1e0 con 0x7f4164061180 2024-04-06T12:22:00.560 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:22:00.560 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:22:00.560 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:22:00.560 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:22:00.560 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2024-04-06T12:22:00.560 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "0/2 daemons upgraded", 2024-04-06T12:22:00.560 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e image on host smithi195", 2024-04-06T12:22:00.560 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:22:00.561 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:22:00.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4164061180 msgr2=0x7f4164063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:00.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4164061180 0x7f4164063640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4170007fd0 tx=0x7f4170009040).stop 2024-04-06T12:22:00.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 msgr2=0x7f417c1084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:00.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 0x7f417c1084b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f416c00b120 tx=0x7f416c009cb0).stop 2024-04-06T12:22:00.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 shutdown_connections 2024-04-06T12:22:00.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:6800/3059779308,v1:172.21.15.152:6801/3059779308] conn(0x7f4164061180 0x7f4164063640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0f6d40 0x7f417c107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 --2- 172.21.15.152:0/3523851494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c0f76e0 0x7f417c1084b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:00.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 >> 172.21.15.152:0/3523851494 conn(0x7f417c0f1670 msgr2=0x7f417c0f6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:00.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 shutdown_connections 2024-04-06T12:22:00.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:00.564+0000 7f4182482700 1 -- 172.21.15.152:0/3523851494 wait complete. 2024-04-06T12:22:01.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:59.367744+0000 mgr.smithi152.lynahm (mgr.14196) 273 : audit [DBG] from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:01.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:21:59.566109+0000 mgr.smithi152.lynahm (mgr.14196) 274 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:22:01.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:59.657153+0000 mgr.smithi152.lynahm (mgr.14196) 275 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:01.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:21:59.934447+0000 mgr.smithi152.lynahm (mgr.14196) 276 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:01.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:00.275573+0000 mon.smithi152 (mon.0) 618 : audit [DBG] from='client.? 172.21.15.152:0/683489185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:22:01.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:59.367744+0000 mgr.smithi152.lynahm (mgr.14196) 273 : audit [DBG] from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:01.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:21:59.566109+0000 mgr.smithi152.lynahm (mgr.14196) 274 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:22:01.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:59.657153+0000 mgr.smithi152.lynahm (mgr.14196) 275 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:01.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:21:59.934447+0000 mgr.smithi152.lynahm (mgr.14196) 276 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:01.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:00.275573+0000 mon.smithi152 (mon.0) 618 : audit [DBG] from='client.? 172.21.15.152:0/683489185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:22:02.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:00.563006+0000 mgr.smithi152.lynahm (mgr.14196) 277 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:00.563006+0000 mgr.smithi152.lynahm (mgr.14196) 277 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:02.847 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-06T12:22:03.012 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-06T12:22:03.051 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-06T12:22:03.052 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-06T12:22:03.053 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-06T12:22:03.089 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-06T12:22:03.092 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-06T12:22:03.092 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-06T12:22:03.150 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-06T12:22:03.152 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-06T12:22:03.152 DEBUG:teuthology.orchestra.run.smithi195:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=800ec6d64a7fa0648ad53edfc6e50b41fc4cd674 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-06T12:22:03.220 INFO:tasks.workunit.client.1.smithi195.stderr:+ mkdir -p fsstress 2024-04-06T12:22:03.222 INFO:tasks.workunit.client.1.smithi195.stderr:+ pushd fsstress 2024-04-06T12:22:03.223 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-06T12:22:03.223 INFO:tasks.workunit.client.1.smithi195.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-06T12:22:03.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:01.566537+0000 mgr.smithi152.lynahm (mgr.14196) 278 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:22:03.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:01.566537+0000 mgr.smithi152.lynahm (mgr.14196) 278 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:22:03.418 INFO:tasks.workunit.client.0.smithi152.stderr:Note: switching to '800ec6d64a7fa0648ad53edfc6e50b41fc4cd674'. 2024-04-06T12:22:03.418 INFO:tasks.workunit.client.0.smithi152.stderr: 2024-04-06T12:22:03.419 INFO:tasks.workunit.client.0.smithi152.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-06T12:22:03.419 INFO:tasks.workunit.client.0.smithi152.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-06T12:22:03.419 INFO:tasks.workunit.client.0.smithi152.stderr:state without impacting any branches by switching back to a branch. 2024-04-06T12:22:03.419 INFO:tasks.workunit.client.0.smithi152.stderr: 2024-04-06T12:22:03.419 INFO:tasks.workunit.client.0.smithi152.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-06T12:22:03.419 INFO:tasks.workunit.client.0.smithi152.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-06T12:22:03.420 INFO:tasks.workunit.client.0.smithi152.stderr: 2024-04-06T12:22:03.420 INFO:tasks.workunit.client.0.smithi152.stderr: git switch -c 2024-04-06T12:22:03.420 INFO:tasks.workunit.client.0.smithi152.stderr: 2024-04-06T12:22:03.420 INFO:tasks.workunit.client.0.smithi152.stderr:Or undo this operation with: 2024-04-06T12:22:03.420 INFO:tasks.workunit.client.0.smithi152.stderr: 2024-04-06T12:22:03.420 INFO:tasks.workunit.client.0.smithi152.stderr: git switch - 2024-04-06T12:22:03.420 INFO:tasks.workunit.client.0.smithi152.stderr: 2024-04-06T12:22:03.420 INFO:tasks.workunit.client.0.smithi152.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-06T12:22:03.420 INFO:tasks.workunit.client.0.smithi152.stderr: 2024-04-06T12:22:03.421 INFO:tasks.workunit.client.0.smithi152.stderr:HEAD is now at 800ec6d64a7 Merge pull request #56347 from cbodley/wip-65003-reef 2024-04-06T12:22:03.425 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-06T12:22:03.455 INFO:tasks.workunit.client.0.smithi152.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-06T12:22:03.457 INFO:tasks.workunit.client.0.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-06T12:22:03.457 INFO:tasks.workunit.client.0.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-06T12:22:03.764 INFO:tasks.workunit.client.1.smithi195.stderr:+ tar xzf ltp-full.tgz 2024-04-06T12:22:04.018 INFO:tasks.workunit.client.0.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-06T12:22:04.076 INFO:tasks.workunit.client.0.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-06T12:22:04.116 INFO:tasks.workunit.client.0.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-06T12:22:04.118 INFO:tasks.workunit.client.0.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-06T12:22:04.118 INFO:tasks.workunit.client.0.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-06T12:22:04.155 INFO:tasks.workunit.client.0.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-06T12:22:04.158 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:22:04.159 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-06T12:22:04.219 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-06T12:22:04.220 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-06T12:22:04.220 DEBUG:teuthology.orchestra.run.smithi152:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=800ec6d64a7fa0648ad53edfc6e50b41fc4cd674 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-06T12:22:04.288 INFO:tasks.workunit.client.0.smithi152.stderr:+ mkdir -p fsstress 2024-04-06T12:22:04.291 INFO:tasks.workunit.client.0.smithi152.stderr:+ pushd fsstress 2024-04-06T12:22:04.292 INFO:tasks.workunit.client.0.smithi152.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-06T12:22:04.293 INFO:tasks.workunit.client.0.smithi152.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-06T12:22:05.156 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:03.567145+0000 mgr.smithi152.lynahm (mgr.14196) 279 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:22:05.156 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:04.398893+0000 mon.smithi152 (mon.0) 619 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:22:05.157 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:04.399689+0000 mon.smithi152 (mon.0) 620 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:22:05.157 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:04.400338+0000 mon.smithi152 (mon.0) 621 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:22:05.157 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:04.401063+0000 mon.smithi152 (mon.0) 622 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:22:05.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:03.567145+0000 mgr.smithi152.lynahm (mgr.14196) 279 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:22:05.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:04.398893+0000 mon.smithi152 (mon.0) 619 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:22:05.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:04.399689+0000 mon.smithi152 (mon.0) 620 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:22:05.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:04.400338+0000 mon.smithi152 (mon.0) 621 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:22:05.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:04.401063+0000 mon.smithi152 (mon.0) 622 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:22:05.996 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:04.394592+0000 mgr.smithi152.lynahm (mgr.14196) 280 : cephadm [INF] Upgrade: Updating mgr.smithi195.ausetj 2024-04-06T12:22:05.996 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:04.401625+0000 mgr.smithi152.lynahm (mgr.14196) 281 : cephadm [INF] Deploying daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:22:06.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:04.394592+0000 mgr.smithi152.lynahm (mgr.14196) 280 : cephadm [INF] Upgrade: Updating mgr.smithi195.ausetj 2024-04-06T12:22:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:04.401625+0000 mgr.smithi152.lynahm (mgr.14196) 281 : cephadm [INF] Deploying daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:22:06.441 INFO:tasks.workunit.client.0.smithi152.stderr:+ tar xzf ltp-full.tgz 2024-04-06T12:22:07.177 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:05.567424+0000 mgr.smithi152.lynahm (mgr.14196) 282 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:22:07.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:05.567424+0000 mgr.smithi152.lynahm (mgr.14196) 282 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:22:09.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:07.567802+0000 mgr.smithi152.lynahm (mgr.14196) 283 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 2.4 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 209 KiB/s wr, 14 op/s 2024-04-06T12:22:09.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:07.567802+0000 mgr.smithi152.lynahm (mgr.14196) 283 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 2.4 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 209 KiB/s wr, 14 op/s 2024-04-06T12:22:11.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:09.568221+0000 mgr.smithi152.lynahm (mgr.14196) 284 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.6 MiB/s wr, 47 op/s 2024-04-06T12:22:11.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:10.309010+0000 mon.smithi152 (mon.0) 623 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:22:11.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:10.309786+0000 mon.smithi152 (mon.0) 624 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:22:11.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:09.568221+0000 mgr.smithi152.lynahm (mgr.14196) 284 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.6 MiB/s wr, 47 op/s 2024-04-06T12:22:11.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:10.309010+0000 mon.smithi152 (mon.0) 623 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:22:11.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:10.309786+0000 mon.smithi152 (mon.0) 624 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:22:13.582 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:13 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:11.568572+0000 mgr.smithi152.lynahm (mgr.14196) 285 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 2.5 MiB/s wr, 86 op/s 2024-04-06T12:22:13.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:13 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:11.568572+0000 mgr.smithi152.lynahm (mgr.14196) 285 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 2.5 MiB/s wr, 86 op/s 2024-04-06T12:22:15.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:13.568995+0000 mgr.smithi152.lynahm (mgr.14196) 286 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 37 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 683 KiB/s rd, 3.1 MiB/s wr, 129 op/s 2024-04-06T12:22:15.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:14.215945+0000 mon.smithi152 (mon.0) 625 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:22:15.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:14.563753+0000 mon.smithi152 (mon.0) 626 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:22:15.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:14.564498+0000 mon.smithi152 (mon.0) 627 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:22:15.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:14.569050+0000 mon.smithi152 (mon.0) 628 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:22:15.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:14.575760+0000 mon.smithi152 (mon.0) 629 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:22:15.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:14.581288+0000 mon.smithi152 (mon.0) 630 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr fail", "who": "smithi152.lynahm"}]: dispatch 2024-04-06T12:22:15.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:14.587843+0000 mon.smithi152 (mon.0) 631 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-04-06T12:22:15.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:14.588053+0000 mon.smithi152 (mon.0) 632 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "mgr fail", "who": "smithi152.lynahm"}]': finished 2024-04-06T12:22:15.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:14.588107+0000 mon.smithi152 (mon.0) 633 : cluster [DBG] mgrmap e19: smithi195.ausetj(active, starting, since 0.0063316s) 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:13.568995+0000 mgr.smithi152.lynahm (mgr.14196) 286 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 37 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 683 KiB/s rd, 3.1 MiB/s wr, 129 op/s 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:14.215945+0000 mon.smithi152 (mon.0) 625 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:14.563753+0000 mon.smithi152 (mon.0) 626 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:14.564498+0000 mon.smithi152 (mon.0) 627 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:14.569050+0000 mon.smithi152 (mon.0) 628 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:14.575760+0000 mon.smithi152 (mon.0) 629 : audit [DBG] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:14.581288+0000 mon.smithi152 (mon.0) 630 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr fail", "who": "smithi152.lynahm"}]: dispatch 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:14.587843+0000 mon.smithi152 (mon.0) 631 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:14.588053+0000 mon.smithi152 (mon.0) 632 : audit [INF] from='mgr.14196 172.21.15.152:0/81947973' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "mgr fail", "who": "smithi152.lynahm"}]': finished 2024-04-06T12:22:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:14.588107+0000 mon.smithi152 (mon.0) 633 : cluster [DBG] mgrmap e19: smithi195.ausetj(active, starting, since 0.0063316s) 2024-04-06T12:22:17.654 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:17.550053+0000 mon.smithi152 (mon.0) 634 : cluster [INF] Active manager daemon smithi195.ausetj restarted 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:17.550579+0000 mon.smithi152 (mon.0) 635 : cluster [INF] Activating manager daemon smithi195.ausetj 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.556526+0000 mon.smithi195 (mon.1) 15 : audit [DBG] from='mgr.? 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:17.558958+0000 mon.smithi152 (mon.0) 636 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:17.559276+0000 mon.smithi152 (mon.0) 637 : cluster [DBG] mgrmap e20: smithi195.ausetj(active, starting, since 0.00898127s) 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.560020+0000 mon.smithi195 (mon.1) 16 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.560267+0000 mon.smithi195 (mon.1) 17 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.560487+0000 mon.smithi195 (mon.1) 18 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.560685+0000 mon.smithi195 (mon.1) 19 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.560979+0000 mon.smithi195 (mon.1) 20 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:22:17.655 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.561251+0000 mon.smithi195 (mon.1) 21 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.561504+0000 mon.smithi195 (mon.1) 22 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.561819+0000 mon.smithi195 (mon.1) 23 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr metadata", "who": "smithi195.ausetj", "id": "smithi195.ausetj"}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.562000+0000 mon.smithi195 (mon.1) 24 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.562334+0000 mon.smithi195 (mon.1) 25 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.562671+0000 mon.smithi195 (mon.1) 26 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.562990+0000 mon.smithi195 (mon.1) 27 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.563328+0000 mon.smithi195 (mon.1) 28 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.563650+0000 mon.smithi195 (mon.1) 29 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.564308+0000 mon.smithi195 (mon.1) 30 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.564654+0000 mon.smithi195 (mon.1) 31 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.565057+0000 mon.smithi195 (mon.1) 32 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.565198+0000 mon.smithi195 (mon.1) 33 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:22:17.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.566675+0000 mon.smithi195 (mon.1) 34 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:22:17.657 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.567113+0000 mon.smithi195 (mon.1) 35 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:22:17.911 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:17.550053+0000 mon.smithi152 (mon.0) 634 : cluster [INF] Active manager daemon smithi195.ausetj restarted 2024-04-06T12:22:17.911 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:17.550579+0000 mon.smithi152 (mon.0) 635 : cluster [INF] Activating manager daemon smithi195.ausetj 2024-04-06T12:22:17.911 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.556526+0000 mon.smithi195 (mon.1) 15 : audit [DBG] from='mgr.? 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:22:17.911 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:17.558958+0000 mon.smithi152 (mon.0) 636 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-04-06T12:22:17.911 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:17.559276+0000 mon.smithi152 (mon.0) 637 : cluster [DBG] mgrmap e20: smithi195.ausetj(active, starting, since 0.00898127s) 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.560020+0000 mon.smithi195 (mon.1) 16 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.560267+0000 mon.smithi195 (mon.1) 17 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.560487+0000 mon.smithi195 (mon.1) 18 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.560685+0000 mon.smithi195 (mon.1) 19 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.560979+0000 mon.smithi195 (mon.1) 20 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.561251+0000 mon.smithi195 (mon.1) 21 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.561504+0000 mon.smithi195 (mon.1) 22 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.561819+0000 mon.smithi195 (mon.1) 23 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr metadata", "who": "smithi195.ausetj", "id": "smithi195.ausetj"}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.562000+0000 mon.smithi195 (mon.1) 24 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.562334+0000 mon.smithi195 (mon.1) 25 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.562671+0000 mon.smithi195 (mon.1) 26 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.562990+0000 mon.smithi195 (mon.1) 27 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.563328+0000 mon.smithi195 (mon.1) 28 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.563650+0000 mon.smithi195 (mon.1) 29 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:22:17.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.564308+0000 mon.smithi195 (mon.1) 30 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:22:17.913 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.564654+0000 mon.smithi195 (mon.1) 31 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:22:17.913 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.565057+0000 mon.smithi195 (mon.1) 32 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:22:17.913 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.565198+0000 mon.smithi195 (mon.1) 33 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:22:17.913 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.566675+0000 mon.smithi195 (mon.1) 34 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:22:17.913 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.567113+0000 mon.smithi195 (mon.1) 35 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:17.738203+0000 mon.smithi152 (mon.0) 638 : cluster [INF] Manager daemon smithi195.ausetj is now available 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.759082+0000 mon.smithi152 (mon.0) 639 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.764251+0000 mon.smithi195 (mon.1) 36 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.784318+0000 mon.smithi195 (mon.1) 37 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.795240+0000 mon.smithi195 (mon.1) 38 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.ausetj/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.795604+0000 mon.smithi152 (mon.0) 640 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.ausetj/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.804405+0000 mon.smithi195 (mon.1) 39 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.ausetj/trash_purge_schedule"}]: dispatch 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.805244+0000 mon.smithi152 (mon.0) 641 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.ausetj/trash_purge_schedule"}]: dispatch 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:17.815535+0000 mon.smithi152 (mon.0) 642 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:18.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:18.123176+0000 mon.smithi152 (mon.0) 643 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:18.996 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:18.127869+0000 mon.smithi152 (mon.0) 644 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:17.738203+0000 mon.smithi152 (mon.0) 638 : cluster [INF] Manager daemon smithi195.ausetj is now available 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.759082+0000 mon.smithi152 (mon.0) 639 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.764251+0000 mon.smithi195 (mon.1) 36 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.784318+0000 mon.smithi195 (mon.1) 37 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.795240+0000 mon.smithi195 (mon.1) 38 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.ausetj/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.795604+0000 mon.smithi152 (mon.0) 640 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.ausetj/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.804405+0000 mon.smithi195 (mon.1) 39 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.ausetj/trash_purge_schedule"}]: dispatch 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.805244+0000 mon.smithi152 (mon.0) 641 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.ausetj/trash_purge_schedule"}]: dispatch 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:17.815535+0000 mon.smithi152 (mon.0) 642 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:18.123176+0000 mon.smithi152 (mon.0) 643 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:18.127869+0000 mon.smithi152 (mon.0) 644 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:18.198352+0000 mgr.smithi195.ausetj (mgr.24375) 1 : cephadm [INF] Deploying cephadm binary to smithi152 2024-04-06T12:22:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:18.199312+0000 mgr.smithi195.ausetj (mgr.24375) 2 : cephadm [INF] Deploying cephadm binary to smithi195 2024-04-06T12:22:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:18.614157+0000 mon.smithi152 (mon.0) 645 : cluster [DBG] mgrmap e21: smithi195.ausetj(active, since 1.06386s) 2024-04-06T12:22:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:18.623621+0000 mgr.smithi195.ausetj (mgr.24375) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:22:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:18.748088+0000 mgr.smithi195.ausetj (mgr.24375) 4 : cephadm [INF] [06/Apr/2024:12:22:18] ENGINE Bus STARTING 2024-04-06T12:22:20.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:18.198352+0000 mgr.smithi195.ausetj (mgr.24375) 1 : cephadm [INF] Deploying cephadm binary to smithi152 2024-04-06T12:22:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:18.199312+0000 mgr.smithi195.ausetj (mgr.24375) 2 : cephadm [INF] Deploying cephadm binary to smithi195 2024-04-06T12:22:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:18.614157+0000 mon.smithi152 (mon.0) 645 : cluster [DBG] mgrmap e21: smithi195.ausetj(active, since 1.06386s) 2024-04-06T12:22:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:18.623621+0000 mgr.smithi195.ausetj (mgr.24375) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:22:20.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:18.748088+0000 mgr.smithi195.ausetj (mgr.24375) 4 : cephadm [INF] [06/Apr/2024:12:22:18] ENGINE Bus STARTING 2024-04-06T12:22:20.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:18.919296+0000 mgr.smithi195.ausetj (mgr.24375) 5 : cephadm [INF] [06/Apr/2024:12:22:18] ENGINE Serving on https://172.21.15.195:7150 2024-04-06T12:22:20.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:19.021697+0000 mgr.smithi195.ausetj (mgr.24375) 6 : cephadm [INF] [06/Apr/2024:12:22:19] ENGINE Serving on http://172.21.15.195:8765 2024-04-06T12:22:20.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:19.021910+0000 mgr.smithi195.ausetj (mgr.24375) 7 : cephadm [INF] [06/Apr/2024:12:22:19] ENGINE Bus STARTED 2024-04-06T12:22:20.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:19.563853+0000 mgr.smithi195.ausetj (mgr.24375) 8 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:22:20.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:19.620419+0000 mon.smithi152 (mon.0) 646 : cluster [DBG] mgrmap e22: smithi195.ausetj(active, since 2s) 2024-04-06T12:22:20.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:19.776432+0000 mon.smithi195 (mon.1) 40 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T12:22:20.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:19.776854+0000 mon.smithi152 (mon.0) 647 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T12:22:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:18.919296+0000 mgr.smithi195.ausetj (mgr.24375) 5 : cephadm [INF] [06/Apr/2024:12:22:18] ENGINE Serving on https://172.21.15.195:7150 2024-04-06T12:22:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:19.021697+0000 mgr.smithi195.ausetj (mgr.24375) 6 : cephadm [INF] [06/Apr/2024:12:22:19] ENGINE Serving on http://172.21.15.195:8765 2024-04-06T12:22:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:19.021910+0000 mgr.smithi195.ausetj (mgr.24375) 7 : cephadm [INF] [06/Apr/2024:12:22:19] ENGINE Bus STARTED 2024-04-06T12:22:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:19.563853+0000 mgr.smithi195.ausetj (mgr.24375) 8 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:22:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:19.620419+0000 mon.smithi152 (mon.0) 646 : cluster [DBG] mgrmap e22: smithi195.ausetj(active, since 2s) 2024-04-06T12:22:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:19.776432+0000 mon.smithi195 (mon.1) 40 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T12:22:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:19.776854+0000 mon.smithi152 (mon.0) 647 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T12:22:21.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:20.623457+0000 mon.smithi152 (mon.0) 648 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]': finished 2024-04-06T12:22:21.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:20.623537+0000 mon.smithi152 (mon.0) 649 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-04-06T12:22:21.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:20.624575+0000 mon.smithi195 (mon.1) 41 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T12:22:21.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:20.625203+0000 mon.smithi152 (mon.0) 650 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T12:22:22.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:20.623457+0000 mon.smithi152 (mon.0) 648 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]': finished 2024-04-06T12:22:22.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:20.623537+0000 mon.smithi152 (mon.0) 649 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-04-06T12:22:22.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:20.624575+0000 mon.smithi195 (mon.1) 41 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T12:22:22.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:20.625203+0000 mon.smithi152 (mon.0) 650 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-06T12:22:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:21.564128+0000 mgr.smithi195.ausetj (mgr.24375) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:22:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:21.628239+0000 mon.smithi152 (mon.0) 651 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-06T12:22:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:21.628290+0000 mon.smithi152 (mon.0) 652 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-04-06T12:22:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:21.701020+0000 mon.smithi152 (mon.0) 653 : cluster [DBG] Standby manager daemon smithi152.lynahm started 2024-04-06T12:22:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:21.703636+0000 mon.smithi152 (mon.0) 654 : audit [DBG] from='mgr.? 172.21.15.152:0/2751530018' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.lynahm/crt"}]: dispatch 2024-04-06T12:22:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:21.705506+0000 mon.smithi152 (mon.0) 655 : audit [DBG] from='mgr.? 172.21.15.152:0/2751530018' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:22:23.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:21.708637+0000 mon.smithi152 (mon.0) 656 : audit [DBG] from='mgr.? 172.21.15.152:0/2751530018' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.lynahm/key"}]: dispatch 2024-04-06T12:22:23.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:21.709164+0000 mon.smithi152 (mon.0) 657 : audit [DBG] from='mgr.? 172.21.15.152:0/2751530018' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:22:23.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:22.322524+0000 mon.smithi152 (mon.0) 658 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:21.564128+0000 mgr.smithi195.ausetj (mgr.24375) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:22:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:21.628239+0000 mon.smithi152 (mon.0) 651 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-06T12:22:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:21.628290+0000 mon.smithi152 (mon.0) 652 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-04-06T12:22:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:21.701020+0000 mon.smithi152 (mon.0) 653 : cluster [DBG] Standby manager daemon smithi152.lynahm started 2024-04-06T12:22:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:21.703636+0000 mon.smithi152 (mon.0) 654 : audit [DBG] from='mgr.? 172.21.15.152:0/2751530018' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.lynahm/crt"}]: dispatch 2024-04-06T12:22:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:21.705506+0000 mon.smithi152 (mon.0) 655 : audit [DBG] from='mgr.? 172.21.15.152:0/2751530018' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:22:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:21.708637+0000 mon.smithi152 (mon.0) 656 : audit [DBG] from='mgr.? 172.21.15.152:0/2751530018' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.lynahm/key"}]: dispatch 2024-04-06T12:22:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:21.709164+0000 mon.smithi152 (mon.0) 657 : audit [DBG] from='mgr.? 172.21.15.152:0/2751530018' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:22:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:22.322524+0000 mon.smithi152 (mon.0) 658 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:23.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:22.636443+0000 mon.smithi152 (mon.0) 659 : cluster [DBG] mgrmap e23: smithi195.ausetj(active, since 5s), standbys: smithi152.lynahm 2024-04-06T12:22:23.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:22.637234+0000 mon.smithi195 (mon.1) 42 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:22:23.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:22.636443+0000 mon.smithi152 (mon.0) 659 : cluster [DBG] mgrmap e23: smithi195.ausetj(active, since 5s), standbys: smithi152.lynahm 2024-04-06T12:22:23.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:22.637234+0000 mon.smithi195 (mon.1) 42 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:22:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:23.564455+0000 mgr.smithi195.ausetj (mgr.24375) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:22:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:23.650583+0000 mon.smithi152 (mon.0) 660 : cluster [DBG] mgrmap e24: smithi195.ausetj(active, since 6s), standbys: smithi152.lynahm 2024-04-06T12:22:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:24.054853+0000 mon.smithi152 (mon.0) 661 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:24.260135+0000 mon.smithi152 (mon.0) 662 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:24.266341+0000 mon.smithi152 (mon.0) 663 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:25.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:23.564455+0000 mgr.smithi195.ausetj (mgr.24375) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:22:25.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:23.650583+0000 mon.smithi152 (mon.0) 660 : cluster [DBG] mgrmap e24: smithi195.ausetj(active, since 6s), standbys: smithi152.lynahm 2024-04-06T12:22:25.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:24.054853+0000 mon.smithi152 (mon.0) 661 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:25.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:24.260135+0000 mon.smithi152 (mon.0) 662 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:25.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:24.266341+0000 mon.smithi152 (mon.0) 663 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:25.051331+0000 mon.smithi152 (mon.0) 664 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:25.056821+0000 mon.smithi152 (mon.0) 665 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:25.129794+0000 mon.smithi152 (mon.0) 666 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T12:22:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:25.130140+0000 mon.smithi195 (mon.1) 43 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:22:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:25.130304+0000 mon.smithi195 (mon.1) 44 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:22:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:25.688341+0000 mon.smithi152 (mon.0) 667 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T12:22:26.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:25.051331+0000 mon.smithi152 (mon.0) 664 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:26.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:25.056821+0000 mon.smithi152 (mon.0) 665 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:26.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:25.129794+0000 mon.smithi152 (mon.0) 666 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T12:22:26.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:25.130140+0000 mon.smithi195 (mon.1) 43 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:22:26.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:25.130304+0000 mon.smithi195 (mon.1) 44 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:22:26.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:25.688341+0000 mon.smithi152 (mon.0) 667 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T12:22:27.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:25.565005+0000 mgr.smithi195.ausetj (mgr.24375) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-04-06T12:22:27.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:25.690055+0000 mon.smithi195 (mon.1) 45 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T12:22:27.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:26.208914+0000 mon.smithi195 (mon.1) 46 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T12:22:27.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:26.209057+0000 mon.smithi195 (mon.1) 47 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:22:27.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:26.209911+0000 mon.smithi195 (mon.1) 48 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:22:27.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:25.565005+0000 mgr.smithi195.ausetj (mgr.24375) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-04-06T12:22:27.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:25.690055+0000 mon.smithi195 (mon.1) 45 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-06T12:22:27.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:26.208914+0000 mon.smithi195 (mon.1) 46 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-06T12:22:27.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:26.209057+0000 mon.smithi195 (mon.1) 47 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:22:27.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:26.209911+0000 mon.smithi195 (mon.1) 48 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:22:28.432 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:27.565341+0000 mgr.smithi195.ausetj (mgr.24375) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 139 op/s 2024-04-06T12:22:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:27.565341+0000 mgr.smithi195.ausetj (mgr.24375) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 139 op/s 2024-04-06T12:22:30.190 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:28.832016+0000 mon.smithi152 (mon.0) 668 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:28.841084+0000 mon.smithi152 (mon.0) 669 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:28.842894+0000 mon.smithi195 (mon.1) 49 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:28.843221+0000 mon.smithi152 (mon.0) 670 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:28.844094+0000 mon.smithi195 (mon.1) 50 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:28.844299+0000 mon.smithi152 (mon.0) 671 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:28.845175+0000 mon.smithi195 (mon.1) 51 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:28.845309+0000 mon.smithi152 (mon.0) 672 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:28.845908+0000 mgr.smithi195.ausetj (mgr.24375) 13 : cephadm [INF] Adjusting osd_memory_target on smithi152 to 1910M 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:28.849874+0000 mon.smithi152 (mon.0) 673 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:30.191 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:29.565814+0000 mgr.smithi195.ausetj (mgr.24375) 14 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:28.832016+0000 mon.smithi152 (mon.0) 668 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:28.841084+0000 mon.smithi152 (mon.0) 669 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:28.842894+0000 mon.smithi195 (mon.1) 49 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:28.843221+0000 mon.smithi152 (mon.0) 670 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:28.844094+0000 mon.smithi195 (mon.1) 50 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:28.844299+0000 mon.smithi152 (mon.0) 671 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:28.845175+0000 mon.smithi195 (mon.1) 51 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:28.845309+0000 mon.smithi152 (mon.0) 672 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:28.845908+0000 mgr.smithi195.ausetj (mgr.24375) 13 : cephadm [INF] Adjusting osd_memory_target on smithi152 to 1910M 2024-04-06T12:22:30.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:28.849874+0000 mon.smithi152 (mon.0) 673 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:30.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:29.565814+0000 mgr.smithi195.ausetj (mgr.24375) 14 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2024-04-06T12:22:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.703+0000 7f2f175af700 1 -- 172.21.15.152:0/1284139986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f100f8cb0 msgr2=0x7f2f100f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.703+0000 7f2f175af700 1 --2- 172.21.15.152:0/1284139986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f100f8cb0 0x7f2f100f9110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f2f000047f0 tx=0x7f2f00009cb0).stop 2024-04-06T12:22:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.703+0000 7f2f175af700 1 -- 172.21.15.152:0/1284139986 shutdown_connections 2024-04-06T12:22:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.703+0000 7f2f175af700 1 --2- 172.21.15.152:0/1284139986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f100f8cb0 0x7f2f100f9110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.703+0000 7f2f175af700 1 --2- 172.21.15.152:0/1284139986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f100f7a10 0x7f2f100f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.703+0000 7f2f175af700 1 -- 172.21.15.152:0/1284139986 >> 172.21.15.152:0/1284139986 conn(0x7f2f100f3150 msgr2=0x7f2f100f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.703+0000 7f2f175af700 1 -- 172.21.15.152:0/1284139986 shutdown_connections 2024-04-06T12:22:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.703+0000 7f2f175af700 1 -- 172.21.15.152:0/1284139986 wait complete. 2024-04-06T12:22:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.704+0000 7f2f175af700 1 Processor -- start 2024-04-06T12:22:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.704+0000 7f2f175af700 1 -- start start 2024-04-06T12:22:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.704+0000 7f2f175af700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f100f7a10 0x7f2f10105f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.704+0000 7f2f175af700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f100f8cb0 0x7f2f10106480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.704+0000 7f2f175af700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10106a30 con 0x7f2f100f7a10 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.704+0000 7f2f175af700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10106b70 con 0x7f2f100f8cb0 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f14b4a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f100f8cb0 0x7f2f10106480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f14b4a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f100f8cb0 0x7f2f10106480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:43676/0 (socket says 172.21.15.152:43676) 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f14b4a700 1 -- 172.21.15.152:0/415366178 learned_addr learned my addr 172.21.15.152:0/415366178 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f1534b700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f100f7a10 0x7f2f10105f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f14b4a700 1 -- 172.21.15.152:0/415366178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f100f7a10 msgr2=0x7f2f10105f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f14b4a700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f100f7a10 0x7f2f10105f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f14b4a700 1 -- 172.21.15.152:0/415366178 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00005040 con 0x7f2f100f8cb0 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f14b4a700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f100f8cb0 0x7f2f10106480 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2f00013620 tx=0x7f2f00009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f067fc700 1 -- 172.21.15.152:0/415366178 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f0000e070 con 0x7f2f100f8cb0 2024-04-06T12:22:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f067fc700 1 -- 172.21.15.152:0/415366178 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f00007e90 con 0x7f2f100f8cb0 2024-04-06T12:22:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1010b5b0 con 0x7f2f100f8cb0 2024-04-06T12:22:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.705+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1010bb70 con 0x7f2f100f8cb0 2024-04-06T12:22:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.706+0000 7f2f067fc700 1 -- 172.21.15.152:0/415366178 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f00018070 con 0x7f2f100f8cb0 2024-04-06T12:22:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.707+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef4005150 con 0x7f2f100f8cb0 2024-04-06T12:22:30.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.707+0000 7f2f067fc700 1 -- 172.21.15.152:0/415366178 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f2f000263f0 con 0x7f2f100f8cb0 2024-04-06T12:22:30.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.708+0000 7f2f067fc700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2efc066dc0 0x7f2efc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:30.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.708+0000 7f2f067fc700 1 -- 172.21.15.152:0/415366178 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f2f00084f90 con 0x7f2f100f8cb0 2024-04-06T12:22:30.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.708+0000 7f2f1534b700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2efc066dc0 0x7f2efc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:22:30.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.708+0000 7f2f1534b700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2efc066dc0 0x7f2efc069280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2f100f8b10 tx=0x7f2f0c00b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:30.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:30.713+0000 7f2f067fc700 1 -- 172.21.15.152:0/415366178 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f2f00053280 con 0x7f2f100f8cb0 2024-04-06T12:22:31.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.006+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ef4000bf0 con 0x7f2efc066dc0 2024-04-06T12:22:31.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.008+0000 7f2f067fc700 1 -- 172.21.15.152:0/415366178 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2ef4000bf0 con 0x7f2efc066dc0 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.010+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2efc066dc0 msgr2=0x7f2efc069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2efc066dc0 0x7f2efc069280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2f100f8b10 tx=0x7f2f0c00b040).stop 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f100f8cb0 msgr2=0x7f2f10106480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f100f8cb0 0x7f2f10106480 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2f00013620 tx=0x7f2f00009cb0).stop 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 shutdown_connections 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2efc066dc0 0x7f2efc069280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f100f7a10 0x7f2f10105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 --2- 172.21.15.152:0/415366178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f100f8cb0 0x7f2f10106480 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 >> 172.21.15.152:0/415366178 conn(0x7f2f100f3150 msgr2=0x7f2f1006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 shutdown_connections 2024-04-06T12:22:31.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.011+0000 7f2f175af700 1 -- 172.21.15.152:0/415366178 wait complete. 2024-04-06T12:22:31.020 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:22:31.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.138+0000 7fe9b04fa700 1 -- 172.21.15.152:0/2306143999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f79b0 msgr2=0x7fe9a80f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.138+0000 7fe9b04fa700 1 --2- 172.21.15.152:0/2306143999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f79b0 0x7fe9a80f7e10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fe9980047f0 tx=0x7fe998009cb0).stop 2024-04-06T12:22:31.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.139+0000 7fe9b04fa700 1 -- 172.21.15.152:0/2306143999 shutdown_connections 2024-04-06T12:22:31.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.139+0000 7fe9b04fa700 1 --2- 172.21.15.152:0/2306143999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f79b0 0x7fe9a80f7e10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.139+0000 7fe9b04fa700 1 --2- 172.21.15.152:0/2306143999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80f6710 0x7fe9a80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.139+0000 7fe9b04fa700 1 -- 172.21.15.152:0/2306143999 >> 172.21.15.152:0/2306143999 conn(0x7fe9a80f1e70 msgr2=0x7fe9a80f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:31.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.139+0000 7fe9b04fa700 1 -- 172.21.15.152:0/2306143999 shutdown_connections 2024-04-06T12:22:31.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.139+0000 7fe9b04fa700 1 -- 172.21.15.152:0/2306143999 wait complete. 2024-04-06T12:22:31.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9b04fa700 1 Processor -- start 2024-04-06T12:22:31.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9b04fa700 1 -- start start 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9b04fa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f6710 0x7fe9a810a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9b04fa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80f79b0 0x7fe9a810a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9b04fa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810acf0 con 0x7fe9a80f6710 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9b04fa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810ae30 con 0x7fe9a80f79b0 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9ae296700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f6710 0x7fe9a810a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9ae296700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f6710 0x7fe9a810a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51590/0 (socket says 172.21.15.152:51590) 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9ae296700 1 -- 172.21.15.152:0/1844485422 learned_addr learned my addr 172.21.15.152:0/1844485422 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.140+0000 7fe9ada95700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80f79b0 0x7fe9a810a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.141+0000 7fe9ae296700 1 -- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80f79b0 msgr2=0x7fe9a810a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.141+0000 7fe9ae296700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80f79b0 0x7fe9a810a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.141+0000 7fe9ae296700 1 -- 172.21.15.152:0/1844485422 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998005040 con 0x7fe9a80f6710 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.141+0000 7fe9ae296700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f6710 0x7fe9a810a250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fe9a400e8c0 tx=0x7fe9a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.141+0000 7fe99f7fe700 1 -- 172.21.15.152:0/1844485422 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a400ee60 con 0x7fe9a80f6710 2024-04-06T12:22:31.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.141+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a810f8d0 con 0x7fe9a80f6710 2024-04-06T12:22:31.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.141+0000 7fe99f7fe700 1 -- 172.21.15.152:0/1844485422 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe9a400f040 con 0x7fe9a80f6710 2024-04-06T12:22:31.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.141+0000 7fe99f7fe700 1 -- 172.21.15.152:0/1844485422 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a400c7f0 con 0x7fe9a80f6710 2024-04-06T12:22:31.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.141+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a810fe90 con 0x7fe9a80f6710 2024-04-06T12:22:31.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.142+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a80feed0 con 0x7fe9a80f6710 2024-04-06T12:22:31.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.143+0000 7fe99f7fe700 1 -- 172.21.15.152:0/1844485422 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fe9a4007b40 con 0x7fe9a80f6710 2024-04-06T12:22:31.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.143+0000 7fe99f7fe700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe994066dc0 0x7fe994069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:31.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.143+0000 7fe99f7fe700 1 -- 172.21.15.152:0/1844485422 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fe9a4083f10 con 0x7fe9a80f6710 2024-04-06T12:22:31.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.144+0000 7fe9ada95700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe994066dc0 0x7fe994069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:22:31.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.144+0000 7fe9ada95700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe994066dc0 0x7fe994069280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe998004e60 tx=0x7fe99800b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:31.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.149+0000 7fe99f7fe700 1 -- 172.21.15.152:0/1844485422 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fe9a4052030 con 0x7fe9a80f6710 2024-04-06T12:22:31.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.473+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9a80fbbf0 con 0x7fe994066dc0 2024-04-06T12:22:31.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.475+0000 7fe99f7fe700 1 -- 172.21.15.152:0/1844485422 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe9a80fbbf0 con 0x7fe994066dc0 2024-04-06T12:22:31.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.477+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe994066dc0 msgr2=0x7fe994069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.477+0000 7fe9b04fa700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe994066dc0 0x7fe994069280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe998004e60 tx=0x7fe99800b040).stop 2024-04-06T12:22:31.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.477+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f6710 msgr2=0x7fe9a810a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.477+0000 7fe9b04fa700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f6710 0x7fe9a810a250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fe9a400e8c0 tx=0x7fe9a400b040).stop 2024-04-06T12:22:31.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.478+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 shutdown_connections 2024-04-06T12:22:31.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.478+0000 7fe9b04fa700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe994066dc0 0x7fe994069280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.478+0000 7fe9b04fa700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a80f6710 0x7fe9a810a250 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.478+0000 7fe9b04fa700 1 --2- 172.21.15.152:0/1844485422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80f79b0 0x7fe9a810a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.478+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 >> 172.21.15.152:0/1844485422 conn(0x7fe9a80f1e70 msgr2=0x7fe9a8060e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:31.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.478+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 shutdown_connections 2024-04-06T12:22:31.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.478+0000 7fe9b04fa700 1 -- 172.21.15.152:0/1844485422 wait complete. 2024-04-06T12:22:31.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.599+0000 7fbdce371700 1 -- 172.21.15.152:0/4027455017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 msgr2=0x7fbdc80fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.599+0000 7fbdce371700 1 --2- 172.21.15.152:0/4027455017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 0x7fbdc80fcda0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fbdbc0047f0 tx=0x7fbdbc009cb0).stop 2024-04-06T12:22:31.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.599+0000 7fbdce371700 1 -- 172.21.15.152:0/4027455017 shutdown_connections 2024-04-06T12:22:31.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.599+0000 7fbdce371700 1 --2- 172.21.15.152:0/4027455017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 0x7fbdc80fcda0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.599+0000 7fbdce371700 1 --2- 172.21.15.152:0/4027455017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdc8061220 0x7fbdc80fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.599+0000 7fbdce371700 1 -- 172.21.15.152:0/4027455017 >> 172.21.15.152:0/4027455017 conn(0x7fbdc80f1e50 msgr2=0x7fbdc80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:31.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.599+0000 7fbdce371700 1 -- 172.21.15.152:0/4027455017 shutdown_connections 2024-04-06T12:22:31.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.599+0000 7fbdce371700 1 -- 172.21.15.152:0/4027455017 wait complete. 2024-04-06T12:22:31.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.600+0000 7fbdce371700 1 Processor -- start 2024-04-06T12:22:31.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.600+0000 7fbdce371700 1 -- start start 2024-04-06T12:22:31.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.600+0000 7fbdce371700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdc8061220 0x7fbdc80f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:31.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.600+0000 7fbdce371700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 0x7fbdc80f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:31.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.600+0000 7fbdce371700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80f8280 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.600+0000 7fbdce371700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc810bda0 con 0x7fbdc8061220 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.600+0000 7fbdc77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 0x7fbdc80f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.600+0000 7fbdc77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 0x7fbdc80f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51608/0 (socket says 172.21.15.152:51608) 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.600+0000 7fbdc77fe700 1 -- 172.21.15.152:0/1506342639 learned_addr learned my addr 172.21.15.152:0/1506342639 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdc7fff700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdc8061220 0x7fbdc80f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdc77fe700 1 -- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdc8061220 msgr2=0x7fbdc80f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdc77fe700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdc8061220 0x7fbdc80f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdc77fe700 1 -- 172.21.15.152:0/1506342639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc005040 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdc77fe700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 0x7fbdc80f6330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fbdbc013560 tx=0x7fbdbc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdc57fa700 1 -- 172.21.15.152:0/1506342639 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdbc018070 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdc57fa700 1 -- 172.21.15.152:0/1506342639 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbdbc007e90 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc810bfc0 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdc57fa700 1 -- 172.21.15.152:0/1506342639 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdbc01c5e0 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.601+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc810c520 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.602+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc80fffb0 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.603+0000 7fbdc57fa700 1 -- 172.21.15.152:0/1506342639 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fbdbc0123c0 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.603+0000 7fbdc57fa700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fbdb0066dc0 0x7fbdb0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:31.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.603+0000 7fbdc57fa700 1 -- 172.21.15.152:0/1506342639 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fbdbc0851a0 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.604+0000 7fbdc7fff700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fbdb0066dc0 0x7fbdb0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:22:31.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.604+0000 7fbdc7fff700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fbdb0066dc0 0x7fbdb0069280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fbdb80092f0 tx=0x7fbdb800b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:31.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.608+0000 7fbdc57fa700 1 -- 172.21.15.152:0/1506342639 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fbdbc053240 con 0x7fbdc80fa9b0 2024-04-06T12:22:31.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.880+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdc8101ef0 con 0x7fbdb0066dc0 2024-04-06T12:22:31.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.891+0000 7fbdc57fa700 1 -- 172.21.15.152:0/1506342639 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbdc8101ef0 con 0x7fbdb0066dc0 2024-04-06T12:22:31.889 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:22:31.889 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (6m) 7s ago 7m 23.9M - 0.23.0 ba2b418f427c a23e247a2160 2024-04-06T12:22:31.889 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (7m) 7s ago 7m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:22:31.889 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (7m) 0s ago 7m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:22:31.889 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (6m) 7s ago 7m 57.2M - 8.3.5 dad864ee21e9 68f8b2b6d071 2024-04-06T12:22:31.889 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (2m) 7s ago 2m 79.0M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (2m) 7s ago 2m 111M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (2m) 0s ago 2m 12.0M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (2m) 0s ago 2m 12.8M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:9283 running (9m) 7s ago 8m 317M - 16.2.15-1-g8963e9de 727f386679cb 10652d2c4bd5 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283 running (24s) 0s ago 7m 476M - 18.2.2-1086-g052adcad 87261d5ece5a 5089ad242cab 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (9m) 7s ago 9m 47.7M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (6m) 0s ago 6m 39.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (7m) 7s ago 7m 25.9M - 1.3.1 1dbe0e931976 7122c2020056 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 0s ago 6m 23.6M - 1.3.1 1dbe0e931976 9dbc0ed205d9 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (6m) 7s ago 6m 63.4M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (5m) 7s ago 5m 62.1M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (5m) 7s ago 5m 53.4M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:22:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (4m) 0s ago 4m 64.5M 4982M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:22:31.891 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (4m) 0s ago 4m 57.7M 4982M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:22:31.891 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (4m) 0s ago 4m 58.3M 4982M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:22:31.891 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (6m) 0s ago 6m 60.4M - 2.33.4 514e6a882f6e d9a8fc6b6cf9 2024-04-06T12:22:31.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fbdb0066dc0 msgr2=0x7fbdb0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fbdb0066dc0 0x7fbdb0069280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fbdb80092f0 tx=0x7fbdb800b040).stop 2024-04-06T12:22:31.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 msgr2=0x7fbdc80f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:31.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 0x7fbdc80f6330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fbdbc013560 tx=0x7fbdbc009cb0).stop 2024-04-06T12:22:31.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 shutdown_connections 2024-04-06T12:22:31.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fbdb0066dc0 0x7fbdb0069280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdc8061220 0x7fbdc80f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 --2- 172.21.15.152:0/1506342639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdc80fa9b0 0x7fbdc80f6330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:31.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 >> 172.21.15.152:0/1506342639 conn(0x7fbdc80f1e50 msgr2=0x7fbdc80f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:31.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 shutdown_connections 2024-04-06T12:22:31.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:31.894+0000 7fbdce371700 1 -- 172.21.15.152:0/1506342639 wait complete. 2024-04-06T12:22:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.010+0000 7f5743180700 1 -- 172.21.15.152:0/1172260241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c0fa950 msgr2=0x7f573c0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.010+0000 7f5743180700 1 --2- 172.21.15.152:0/1172260241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c0fa950 0x7f573c0fcda0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f57280047f0 tx=0x7f5728009cb0).stop 2024-04-06T12:22:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 -- 172.21.15.152:0/1172260241 shutdown_connections 2024-04-06T12:22:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 --2- 172.21.15.152:0/1172260241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c0fa950 0x7f573c0fcda0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 --2- 172.21.15.152:0/1172260241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f573c061280 0x7f573c0fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 -- 172.21.15.152:0/1172260241 >> 172.21.15.152:0/1172260241 conn(0x7f573c0f1e50 msgr2=0x7f573c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:32.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 -- 172.21.15.152:0/1172260241 shutdown_connections 2024-04-06T12:22:32.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 -- 172.21.15.152:0/1172260241 wait complete. 2024-04-06T12:22:32.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 Processor -- start 2024-04-06T12:22:32.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 -- start start 2024-04-06T12:22:32.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f573c061280 0x7f573c108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:32.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c0fa950 0x7f573c108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:32.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c108b20 con 0x7f573c0fa950 2024-04-06T12:22:32.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.011+0000 7f5743180700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c108c60 con 0x7f573c061280 2024-04-06T12:22:32.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5740f1c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f573c061280 0x7f573c108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:32.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f573bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c0fa950 0x7f573c108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:32.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5740f1c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f573c061280 0x7f573c108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:43736/0 (socket says 172.21.15.152:43736) 2024-04-06T12:22:32.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5740f1c700 1 -- 172.21.15.152:0/589190302 learned_addr learned my addr 172.21.15.152:0/589190302 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:22:32.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5740f1c700 1 -- 172.21.15.152:0/589190302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c0fa950 msgr2=0x7f573c108570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:32.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5740f1c700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c0fa950 0x7f573c108570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5740f1c700 1 -- 172.21.15.152:0/589190302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728005040 con 0x7f573c061280 2024-04-06T12:22:32.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f573bfff700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c0fa950 0x7f573c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-06T12:22:32.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5740f1c700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f573c061280 0x7f573c108080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f573000e910 tx=0x7f573000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:32.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5739ffb700 1 -- 172.21.15.152:0/589190302 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5730007b40 con 0x7f573c061280 2024-04-06T12:22:32.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c10d700 con 0x7f573c061280 2024-04-06T12:22:32.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5739ffb700 1 -- 172.21.15.152:0/589190302 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f573000f040 con 0x7f573c061280 2024-04-06T12:22:32.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5739ffb700 1 -- 172.21.15.152:0/589190302 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5730014920 con 0x7f573c061280 2024-04-06T12:22:32.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.012+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c0f63f0 con 0x7f573c061280 2024-04-06T12:22:32.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.013+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c0fffd0 con 0x7f573c061280 2024-04-06T12:22:32.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.014+0000 7f5739ffb700 1 -- 172.21.15.152:0/589190302 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f5730007ca0 con 0x7f573c061280 2024-04-06T12:22:32.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.014+0000 7f5739ffb700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f572c06b1d0 0x7f572c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:32.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.015+0000 7f5739ffb700 1 -- 172.21.15.152:0/589190302 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f5730083d50 con 0x7f573c061280 2024-04-06T12:22:32.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.015+0000 7f573bfff700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f572c06b1d0 0x7f572c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:22:32.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.015+0000 7f573bfff700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f572c06b1d0 0x7f572c06d690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f57280047c0 tx=0x7f5728009cb0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:32.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.020+0000 7f5739ffb700 1 -- 172.21.15.152:0/589190302 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f5730051df0 con 0x7f573c061280 2024-04-06T12:22:32.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.364+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f573c101e40 con 0x7f573c061280 2024-04-06T12:22:32.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.364+0000 7f5739ffb700 1 -- 172.21.15.152:0/589190302 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f57300519e0 con 0x7f573c061280 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:22:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:22:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:22:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:22:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:22:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-04-06T12:22:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:22:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:22:32.364 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f572c06b1d0 msgr2=0x7f572c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f572c06b1d0 0x7f572c06d690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f57280047c0 tx=0x7f5728009cb0).stop 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f573c061280 msgr2=0x7f573c108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f573c061280 0x7f573c108080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f573000e910 tx=0x7f573000b040).stop 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 shutdown_connections 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f572c06b1d0 0x7f572c06d690 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f573c061280 0x7f573c108080 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 --2- 172.21.15.152:0/589190302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c0fa950 0x7f573c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 >> 172.21.15.152:0/589190302 conn(0x7f573c0f1e50 msgr2=0x7f573c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:32.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 shutdown_connections 2024-04-06T12:22:32.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.368+0000 7f5743180700 1 -- 172.21.15.152:0/589190302 wait complete. 2024-04-06T12:22:32.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.512+0000 7fe53f14d700 1 -- 172.21.15.152:0/2929679657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5380f9750 msgr2=0x7fe5380f5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:32.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.512+0000 7fe53f14d700 1 --2- 172.21.15.152:0/2929679657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5380f9750 0x7fe5380f5960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fe5240047f0 tx=0x7fe524009cb0).stop 2024-04-06T12:22:32.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.513+0000 7fe53f14d700 1 -- 172.21.15.152:0/2929679657 shutdown_connections 2024-04-06T12:22:32.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.513+0000 7fe53f14d700 1 --2- 172.21.15.152:0/2929679657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5380f9750 0x7fe5380f5960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.513+0000 7fe53f14d700 1 --2- 172.21.15.152:0/2929679657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5380f8e40 0x7fe5380f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:22:32.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.513+0000 7fe53f14d700 1 -- 172.21.15.152:0/2929679657 >> 172.21.15.152:0/2929679657 conn(0x7fe5380f1680 msgr2=0x7fe5380f3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:32.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.513+0000 7fe53f14d700 1 -- 172.21.15.152:0/2929679657 shutdown_connections 2024-04-06T12:22:32.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.513+0000 7fe53f14d700 1 -- 172.21.15.152:0/2929679657 wait complete. 2024-04-06T12:22:32.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe53f14d700 1 Processor -- start 2024-04-06T12:22:32.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe53f14d700 1 -- start start 2024-04-06T12:22:32.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe53f14d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5380f8e40 0x7fe53810e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:32.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe53f14d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5380f9750 0x7fe53810ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:32.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe53f14d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53810f240 con 0x7fe5380f9750 2024-04-06T12:22:32.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe53f14d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53810f380 con 0x7fe5380f8e40 2024-04-06T12:22:32.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe53cee9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5380f8e40 0x7fe53810e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:32.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe53cee9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5380f8e40 0x7fe53810e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:42872/0 (socket says 172.21.15.152:42872) 2024-04-06T12:22:32.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe537fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5380f9750 0x7fe53810ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:22:32.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.514+0000 7fe53cee9700 1 -- 172.21.15.152:0/3483406389 learned_addr learned my addr 172.21.15.152:0/3483406389 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:22:32.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.515+0000 7fe53cee9700 1 -- 172.21.15.152:0/3483406389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5380f9750 msgr2=0x7fe53810ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:32.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.515+0000 7fe53cee9700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5380f9750 0x7fe53810ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.515+0000 7fe53cee9700 1 -- 172.21.15.152:0/3483406389 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524005040 con 0x7fe5380f8e40 2024-04-06T12:22:32.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.515+0000 7fe53cee9700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5380f8e40 0x7fe53810e710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe52c00b4b0 tx=0x7fe52c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:32.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.515+0000 7fe535ffb700 1 -- 172.21.15.152:0/3483406389 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe52c002500 con 0x7fe5380f8e40 2024-04-06T12:22:32.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.515+0000 7fe535ffb700 1 -- 172.21.15.152:0/3483406389 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe52c002b10 con 0x7fe5380f8e40 2024-04-06T12:22:32.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.515+0000 7fe535ffb700 1 -- 172.21.15.152:0/3483406389 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe52c012d40 con 0x7fe5380f8e40 2024-04-06T12:22:32.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.515+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe538105ca0 con 0x7fe5380f8e40 2024-04-06T12:22:32.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.516+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5381061e0 con 0x7fe5380f8e40 2024-04-06T12:22:32.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.517+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5380fdec0 con 0x7fe5380f8e40 2024-04-06T12:22:32.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.517+0000 7fe535ffb700 1 -- 172.21.15.152:0/3483406389 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fe52c002660 con 0x7fe5380f8e40 2024-04-06T12:22:32.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.518+0000 7fe535ffb700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe528066dc0 0x7fe528069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:22:32.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.518+0000 7fe535ffb700 1 -- 172.21.15.152:0/3483406389 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fe52c084370 con 0x7fe5380f8e40 2024-04-06T12:22:32.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.518+0000 7fe537fff700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe528066dc0 0x7fe528069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:22:32.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.519+0000 7fe537fff700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe528066dc0 0x7fe528069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe524004f10 tx=0x7fe524009cb0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:22:32.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.527+0000 7fe535ffb700 1 -- 172.21.15.152:0/3483406389 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fe52c052520 con 0x7fe5380f8e40 2024-04-06T12:22:32.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.848+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe538059120 con 0x7fe528066dc0 2024-04-06T12:22:32.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.849+0000 7fe535ffb700 1 -- 172.21.15.152:0/3483406389 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe538059120 con 0x7fe528066dc0 2024-04-06T12:22:32.847 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:22:32.847 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:22:32.847 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:22:32.847 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:22:32.847 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2024-04-06T12:22:32.847 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "1/2 daemons upgraded", 2024-04-06T12:22:32.847 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2024-04-06T12:22:32.848 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:22:32.848 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:22:32.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe528066dc0 msgr2=0x7fe528069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:32.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe528066dc0 0x7fe528069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe524004f10 tx=0x7fe524009cb0).stop 2024-04-06T12:22:32.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5380f8e40 msgr2=0x7fe53810e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:22:32.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5380f8e40 0x7fe53810e710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe52c00b4b0 tx=0x7fe52c0090f0).stop 2024-04-06T12:22:32.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 shutdown_connections 2024-04-06T12:22:32.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe528066dc0 0x7fe528069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5380f8e40 0x7fe53810e710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 --2- 172.21.15.152:0/3483406389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5380f9750 0x7fe53810ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:22:32.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 >> 172.21.15.152:0/3483406389 conn(0x7fe5380f1680 msgr2=0x7fe5380fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:22:32.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 shutdown_connections 2024-04-06T12:22:32.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:22:32.852+0000 7fe53f14d700 1 -- 172.21.15.152:0/3483406389 wait complete. 2024-04-06T12:22:33.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:31.008949+0000 mgr.smithi195.ausetj (mgr.24375) 15 : audit [DBG] from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:33.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:31.475758+0000 mgr.smithi195.ausetj (mgr.24375) 16 : audit [DBG] from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:33.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:31.566164+0000 mgr.smithi195.ausetj (mgr.24375) 17 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 189 op/s 2024-04-06T12:22:33.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:31.731774+0000 mon.smithi152 (mon.0) 674 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:33.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:31.737381+0000 mon.smithi152 (mon.0) 675 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:33.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:32.365543+0000 mon.smithi195 (mon.1) 52 : audit [DBG] from='client.? 172.21.15.152:0/589190302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:22:33.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:32.424455+0000 mon.smithi152 (mon.0) 676 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:33.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:32.431216+0000 mon.smithi152 (mon.0) 677 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:33.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:31.008949+0000 mgr.smithi195.ausetj (mgr.24375) 15 : audit [DBG] from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:31.475758+0000 mgr.smithi195.ausetj (mgr.24375) 16 : audit [DBG] from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:31.566164+0000 mgr.smithi195.ausetj (mgr.24375) 17 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 189 op/s 2024-04-06T12:22:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:31.731774+0000 mon.smithi152 (mon.0) 674 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:31.737381+0000 mon.smithi152 (mon.0) 675 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:32.365543+0000 mon.smithi195 (mon.1) 52 : audit [DBG] from='client.? 172.21.15.152:0/589190302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:22:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:32.424455+0000 mon.smithi152 (mon.0) 676 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:32.431216+0000 mon.smithi152 (mon.0) 677 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:34.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:31.882539+0000 mgr.smithi195.ausetj (mgr.24375) 18 : audit [DBG] from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:34.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:32.784545+0000 mon.smithi195 (mon.1) 53 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:22:34.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:31.882539+0000 mgr.smithi195.ausetj (mgr.24375) 18 : audit [DBG] from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:34.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:32.784545+0000 mon.smithi195 (mon.1) 53 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:22:35.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:32.850248+0000 mgr.smithi195.ausetj (mgr.24375) 19 : audit [DBG] from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:35.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:33.566553+0000 mgr.smithi195.ausetj (mgr.24375) 20 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 158 op/s 2024-04-06T12:22:35.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:32.850248+0000 mgr.smithi195.ausetj (mgr.24375) 19 : audit [DBG] from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:22:35.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:33.566553+0000 mgr.smithi195.ausetj (mgr.24375) 20 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 158 op/s 2024-04-06T12:22:37.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:35.567013+0000 mgr.smithi195.ausetj (mgr.24375) 21 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-04-06T12:22:37.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:35.567013+0000 mgr.smithi195.ausetj (mgr.24375) 21 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-04-06T12:22:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:37.567311+0000 mgr.smithi195.ausetj (mgr.24375) 22 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 127 op/s 2024-04-06T12:22:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:37.567311+0000 mgr.smithi195.ausetj (mgr.24375) 22 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 127 op/s 2024-04-06T12:22:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.265893+0000 mon.smithi152 (mon.0) 678 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.273617+0000 mon.smithi152 (mon.0) 679 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.275536+0000 mon.smithi195 (mon.1) 54 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.275755+0000 mon.smithi152 (mon.0) 680 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.276678+0000 mon.smithi195 (mon.1) 55 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.276873+0000 mon.smithi152 (mon.0) 681 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.277662+0000 mon.smithi195 (mon.1) 56 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.277850+0000 mon.smithi152 (mon.0) 682 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:39.278465+0000 mgr.smithi195.ausetj (mgr.24375) 23 : cephadm [INF] Adjusting osd_memory_target on smithi195 to 2251M 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.282929+0000 mon.smithi152 (mon.0) 683 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.283934+0000 mon.smithi195 (mon.1) 57 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:39.284499+0000 mon.smithi195 (mon.1) 58 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:39.285489+0000 mgr.smithi195.ausetj (mgr.24375) 24 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:39.285757+0000 mgr.smithi195.ausetj (mgr.24375) 25 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:39.549881+0000 mgr.smithi195.ausetj (mgr.24375) 26 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:39.550005+0000 mgr.smithi195.ausetj (mgr.24375) 27 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:22:40.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:39.567717+0000 mgr.smithi195.ausetj (mgr.24375) 28 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.3 MiB/s wr, 244 op/s 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.265893+0000 mon.smithi152 (mon.0) 678 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.273617+0000 mon.smithi152 (mon.0) 679 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.275536+0000 mon.smithi195 (mon.1) 54 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.275755+0000 mon.smithi152 (mon.0) 680 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.276678+0000 mon.smithi195 (mon.1) 55 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.276873+0000 mon.smithi152 (mon.0) 681 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.277662+0000 mon.smithi195 (mon.1) 56 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.277850+0000 mon.smithi152 (mon.0) 682 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:39.278465+0000 mgr.smithi195.ausetj (mgr.24375) 23 : cephadm [INF] Adjusting osd_memory_target on smithi195 to 2251M 2024-04-06T12:22:40.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.282929+0000 mon.smithi152 (mon.0) 683 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.283934+0000 mon.smithi195 (mon.1) 57 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:22:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:39.284499+0000 mon.smithi195 (mon.1) 58 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:22:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:39.285489+0000 mgr.smithi195.ausetj (mgr.24375) 24 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:22:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:39.285757+0000 mgr.smithi195.ausetj (mgr.24375) 25 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:22:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:39.549881+0000 mgr.smithi195.ausetj (mgr.24375) 26 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:22:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:39.550005+0000 mgr.smithi195.ausetj (mgr.24375) 27 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:22:40.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:39.567717+0000 mgr.smithi195.ausetj (mgr.24375) 28 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.3 MiB/s wr, 244 op/s 2024-04-06T12:22:41.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:39.814076+0000 mgr.smithi195.ausetj (mgr.24375) 29 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:22:41.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:39.864155+0000 mgr.smithi195.ausetj (mgr.24375) 30 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:22:41.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:40.078112+0000 mgr.smithi195.ausetj (mgr.24375) 31 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:22:41.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:40.178260+0000 mgr.smithi195.ausetj (mgr.24375) 32 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:22:41.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:40.349869+0000 mon.smithi152 (mon.0) 684 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:40.358669+0000 mon.smithi152 (mon.0) 685 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:40.447418+0000 mon.smithi152 (mon.0) 686 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:40.455274+0000 mon.smithi152 (mon.0) 687 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:40.460041+0000 mon.smithi152 (mon.0) 688 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:40.595820+0000 mon.smithi152 (mon.0) 689 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:40.599347+0000 mon.smithi152 (mon.0) 690 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:40.603135+0000 mon.smithi152 (mon.0) 691 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:40.606845+0000 mon.smithi152 (mon.0) 692 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:40.608860+0000 mgr.smithi195.ausetj (mgr.24375) 33 : cephadm [INF] Reconfiguring alertmanager.smithi152 (dependencies changed)... 2024-04-06T12:22:41.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:40.620519+0000 mgr.smithi195.ausetj (mgr.24375) 34 : cephadm [INF] Reconfiguring daemon alertmanager.smithi152 on smithi152 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:39.814076+0000 mgr.smithi195.ausetj (mgr.24375) 29 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:39.864155+0000 mgr.smithi195.ausetj (mgr.24375) 30 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:40.078112+0000 mgr.smithi195.ausetj (mgr.24375) 31 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:40.178260+0000 mgr.smithi195.ausetj (mgr.24375) 32 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:40.349869+0000 mon.smithi152 (mon.0) 684 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:40.358669+0000 mon.smithi152 (mon.0) 685 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:40.447418+0000 mon.smithi152 (mon.0) 686 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:40.455274+0000 mon.smithi152 (mon.0) 687 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:40.460041+0000 mon.smithi152 (mon.0) 688 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:40.595820+0000 mon.smithi152 (mon.0) 689 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:40.599347+0000 mon.smithi152 (mon.0) 690 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:40.603135+0000 mon.smithi152 (mon.0) 691 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:40.606845+0000 mon.smithi152 (mon.0) 692 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:41.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:40.608860+0000 mgr.smithi195.ausetj (mgr.24375) 33 : cephadm [INF] Reconfiguring alertmanager.smithi152 (dependencies changed)... 2024-04-06T12:22:41.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:40.620519+0000 mgr.smithi195.ausetj (mgr.24375) 34 : cephadm [INF] Reconfiguring daemon alertmanager.smithi152 on smithi152 2024-04-06T12:22:42.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:41.568031+0000 mgr.smithi195.ausetj (mgr.24375) 35 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 179 op/s 2024-04-06T12:22:42.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:41.568031+0000 mgr.smithi195.ausetj (mgr.24375) 35 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 179 op/s 2024-04-06T12:22:45.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:43.568372+0000 mgr.smithi195.ausetj (mgr.24375) 36 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 179 op/s 2024-04-06T12:22:45.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:43.568372+0000 mgr.smithi195.ausetj (mgr.24375) 36 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 179 op/s 2024-04-06T12:22:47.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:45.568813+0000 mgr.smithi195.ausetj (mgr.24375) 37 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 160 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 300 op/s 2024-04-06T12:22:47.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:45.568813+0000 mgr.smithi195.ausetj (mgr.24375) 37 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 160 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 300 op/s 2024-04-06T12:22:49.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:47.569152+0000 mgr.smithi195.ausetj (mgr.24375) 38 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 160 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.6 MiB/s wr, 237 op/s 2024-04-06T12:22:49.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:47.784727+0000 mon.smithi195 (mon.1) 59 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:22:49.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:47.569152+0000 mgr.smithi195.ausetj (mgr.24375) 38 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 160 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.6 MiB/s wr, 237 op/s 2024-04-06T12:22:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:47.784727+0000 mon.smithi195 (mon.1) 59 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:22:50.627 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:49.569706+0000 mgr.smithi195.ausetj (mgr.24375) 39 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 175 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 399 op/s 2024-04-06T12:22:51.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:49.569706+0000 mgr.smithi195.ausetj (mgr.24375) 39 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 175 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 399 op/s 2024-04-06T12:22:52.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:51.570094+0000 mgr.smithi195.ausetj (mgr.24375) 40 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 175 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 283 op/s 2024-04-06T12:22:53.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:51.570094+0000 mgr.smithi195.ausetj (mgr.24375) 40 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 175 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 283 op/s 2024-04-06T12:22:54.509 INFO:tasks.workunit.client.1.smithi195.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-06T12:22:54.530 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-06T12:22:54.531 INFO:tasks.workunit.client.1.smithi195.stderr:+ make 2024-04-06T12:22:54.953 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:53.570434+0000 mgr.smithi195.ausetj (mgr.24375) 41 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 175 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 283 op/s 2024-04-06T12:22:55.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:53.570434+0000 mgr.smithi195.ausetj (mgr.24375) 41 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 175 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 283 op/s 2024-04-06T12:22:55.345 INFO:tasks.workunit.client.1.smithi195.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-06T12:22:56.219 INFO:tasks.workunit.client.1.smithi195.stderr:++ readlink -f fsstress 2024-04-06T12:22:56.220 INFO:tasks.workunit.client.1.smithi195.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-06T12:22:56.220 INFO:tasks.workunit.client.1.smithi195.stderr:+ popd 2024-04-06T12:22:56.221 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-06T12:22:56.221 INFO:tasks.workunit.client.1.smithi195.stderr:+ popd 2024-04-06T12:22:56.222 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-06T12:22:56.222 INFO:tasks.workunit.client.1.smithi195.stderr:++ mktemp -d -p . 2024-04-06T12:22:56.225 INFO:tasks.workunit.client.1.smithi195.stderr:+ T=./tmp.JohQYXlnc2 2024-04-06T12:22:56.225 INFO:tasks.workunit.client.1.smithi195.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.JohQYXlnc2 -l 1 -n 1000 -p 10 -v 2024-04-06T12:22:56.230 INFO:tasks.workunit.client.1.smithi195.stdout:seed = 1712500061 2024-04-06T12:22:56.236 INFO:tasks.workunit.client.1.smithi195.stdout:0/0: read - no filename 2024-04-06T12:22:56.236 INFO:tasks.workunit.client.1.smithi195.stdout:0/1: chown . 55498113 1 2024-04-06T12:22:56.236 INFO:tasks.workunit.client.1.smithi195.stdout:0/2: rmdir - no directory 2024-04-06T12:22:56.236 INFO:tasks.workunit.client.1.smithi195.stdout:0/3: chown . 17 1 2024-04-06T12:22:56.236 INFO:tasks.workunit.client.1.smithi195.stdout:0/4: rename - no filename 2024-04-06T12:22:56.237 INFO:tasks.workunit.client.1.smithi195.stdout:1/0: truncate - no filename 2024-04-06T12:22:56.237 INFO:tasks.workunit.client.1.smithi195.stdout:1/1: dread - no filename 2024-04-06T12:22:56.237 INFO:tasks.workunit.client.1.smithi195.stdout:1/2: chown . 27265609 1 2024-04-06T12:22:56.240 INFO:tasks.workunit.client.1.smithi195.stdout:2/0: dwrite - no filename 2024-04-06T12:22:56.240 INFO:tasks.workunit.client.1.smithi195.stdout:2/1: link - no file 2024-04-06T12:22:56.240 INFO:tasks.workunit.client.1.smithi195.stdout:2/2: rename - no filename 2024-04-06T12:22:56.240 INFO:tasks.workunit.client.1.smithi195.stdout:2/3: dread - no filename 2024-04-06T12:22:56.240 INFO:tasks.workunit.client.1.smithi195.stdout:2/4: fsync - no filename 2024-04-06T12:22:56.241 INFO:tasks.workunit.client.1.smithi195.stdout:0/5: creat f0 x:0 0 0 2024-04-06T12:22:56.242 INFO:tasks.workunit.client.1.smithi195.stdout:1/3: symlink l0 0 2024-04-06T12:22:56.242 INFO:tasks.workunit.client.1.smithi195.stdout:1/4: dwrite - no filename 2024-04-06T12:22:56.242 INFO:tasks.workunit.client.1.smithi195.stdout:1/5: truncate - no filename 2024-04-06T12:22:56.243 INFO:tasks.workunit.client.1.smithi195.stdout:1/6: dwrite - no filename 2024-04-06T12:22:56.243 INFO:tasks.workunit.client.1.smithi195.stdout:1/7: dread - no filename 2024-04-06T12:22:56.244 INFO:tasks.workunit.client.1.smithi195.stdout:3/0: dwrite - no filename 2024-04-06T12:22:56.246 INFO:tasks.workunit.client.1.smithi195.stdout:1/8: creat f1 x:0 0 0 2024-04-06T12:22:56.249 INFO:tasks.workunit.client.1.smithi195.stdout:4/0: dread - no filename 2024-04-06T12:22:56.249 INFO:tasks.workunit.client.1.smithi195.stdout:4/1: dwrite - no filename 2024-04-06T12:22:56.249 INFO:tasks.workunit.client.1.smithi195.stdout:4/2: write - no filename 2024-04-06T12:22:56.249 INFO:tasks.workunit.client.1.smithi195.stdout:4/3: readlink - no filename 2024-04-06T12:22:56.250 INFO:tasks.workunit.client.1.smithi195.stdout:4/4: dread - no filename 2024-04-06T12:22:56.250 INFO:tasks.workunit.client.1.smithi195.stdout:4/5: write - no filename 2024-04-06T12:22:56.250 INFO:tasks.workunit.client.1.smithi195.stdout:0/6: dwrite f0 [0,4194304] 0 2024-04-06T12:22:56.250 INFO:tasks.workunit.client.1.smithi195.stdout:2/5: symlink l0 0 2024-04-06T12:22:56.251 INFO:tasks.workunit.client.1.smithi195.stdout:2/6: rmdir - no directory 2024-04-06T12:22:56.251 INFO:tasks.workunit.client.1.smithi195.stdout:0/7: write f0 [3633144,25491] 0 2024-04-06T12:22:56.251 INFO:tasks.workunit.client.1.smithi195.stdout:1/9: symlink l2 0 2024-04-06T12:22:56.254 INFO:tasks.workunit.client.1.smithi195.stdout:3/1: creat f0 x:0 0 0 2024-04-06T12:22:56.255 INFO:tasks.workunit.client.1.smithi195.stdout:3/2: truncate f0 76844 0 2024-04-06T12:22:56.258 INFO:tasks.workunit.client.1.smithi195.stdout:2/7: rename l0 to l1 0 2024-04-06T12:22:56.261 INFO:tasks.workunit.client.1.smithi195.stdout:1/10: creat f3 x:0 0 0 2024-04-06T12:22:56.262 INFO:tasks.workunit.client.1.smithi195.stdout:4/6: mknod c0 0 2024-04-06T12:22:56.263 INFO:tasks.workunit.client.1.smithi195.stdout:4/7: dread - no filename 2024-04-06T12:22:56.263 INFO:tasks.workunit.client.1.smithi195.stdout:4/8: fsync - no filename 2024-04-06T12:22:56.268 INFO:tasks.workunit.client.1.smithi195.stdout:7/0: dread - no filename 2024-04-06T12:22:56.268 INFO:tasks.workunit.client.1.smithi195.stdout:7/1: write - no filename 2024-04-06T12:22:56.269 INFO:tasks.workunit.client.1.smithi195.stdout:7/2: chown . 32572536 1 2024-04-06T12:22:56.269 INFO:tasks.workunit.client.1.smithi195.stdout:7/3: readlink - no filename 2024-04-06T12:22:56.269 INFO:tasks.workunit.client.1.smithi195.stdout:7/4: truncate - no filename 2024-04-06T12:22:56.269 INFO:tasks.workunit.client.1.smithi195.stdout:7/5: write - no filename 2024-04-06T12:22:56.270 INFO:tasks.workunit.client.1.smithi195.stdout:4/9: rename c0 to c1 0 2024-04-06T12:22:56.272 INFO:tasks.workunit.client.1.smithi195.stdout:5/0: mkdir d0 0 2024-04-06T12:22:56.272 INFO:tasks.workunit.client.1.smithi195.stdout:5/1: unlink - no file 2024-04-06T12:22:56.272 INFO:tasks.workunit.client.1.smithi195.stdout:5/2: read - no filename 2024-04-06T12:22:56.273 INFO:tasks.workunit.client.1.smithi195.stdout:5/3: chown d0 0 1 2024-04-06T12:22:56.273 INFO:tasks.workunit.client.1.smithi195.stdout:5/4: rename d0 to d0/d1 22 2024-04-06T12:22:56.273 INFO:tasks.workunit.client.1.smithi195.stdout:3/3: link f0 f1 0 2024-04-06T12:22:56.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/0: readlink - no filename 2024-04-06T12:22:56.276 INFO:tasks.workunit.client.1.smithi195.stdout:6/0: mknod c0 0 2024-04-06T12:22:56.276 INFO:tasks.workunit.client.1.smithi195.stdout:6/1: dwrite - no filename 2024-04-06T12:22:56.278 INFO:tasks.workunit.client.1.smithi195.stdout:3/4: creat f2 x:0 0 0 2024-04-06T12:22:56.281 INFO:tasks.workunit.client.1.smithi195.stdout:9/0: write - no filename 2024-04-06T12:22:56.285 INFO:tasks.workunit.client.1.smithi195.stdout:6/2: creat f1 x:0 0 0 2024-04-06T12:22:56.285 INFO:tasks.workunit.client.1.smithi195.stdout:5/5: getdents d0 0 2024-04-06T12:22:56.285 INFO:tasks.workunit.client.1.smithi195.stdout:5/6: write - no filename 2024-04-06T12:22:56.285 INFO:tasks.workunit.client.1.smithi195.stdout:5/7: dread - no filename 2024-04-06T12:22:56.286 INFO:tasks.workunit.client.1.smithi195.stdout:3/5: unlink f1 0 2024-04-06T12:22:56.286 INFO:tasks.workunit.client.1.smithi195.stdout:3/6: readlink - no filename 2024-04-06T12:22:56.289 INFO:tasks.workunit.client.1.smithi195.stdout:8/1: creat f0 x:0 0 0 2024-04-06T12:22:56.290 INFO:tasks.workunit.client.1.smithi195.stdout:8/2: write f0 [35321,26485] 0 2024-04-06T12:22:56.292 INFO:tasks.workunit.client.1.smithi195.stdout:6/3: rename f1 to f2 0 2024-04-06T12:22:56.296 INFO:tasks.workunit.client.1.smithi195.stdout:9/1: creat f0 x:0 0 0 2024-04-06T12:22:56.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/3: symlink l1 0 2024-04-06T12:22:56.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/4: stat f0 0 2024-04-06T12:22:56.299 INFO:tasks.workunit.client.1.smithi195.stdout:6/4: mknod c3 0 2024-04-06T12:22:56.300 INFO:tasks.workunit.client.1.smithi195.stdout:6/5: readlink - no filename 2024-04-06T12:22:56.300 INFO:tasks.workunit.client.1.smithi195.stdout:5/8: mknod d0/c2 0 2024-04-06T12:22:56.300 INFO:tasks.workunit.client.1.smithi195.stdout:5/9: read - no filename 2024-04-06T12:22:56.301 INFO:tasks.workunit.client.1.smithi195.stdout:5/10: chown d0/c2 16187049 1 2024-04-06T12:22:56.302 INFO:tasks.workunit.client.1.smithi195.stdout:3/7: link f2 f3 0 2024-04-06T12:22:56.303 INFO:tasks.workunit.client.1.smithi195.stdout:9/2: rename f0 to f1 0 2024-04-06T12:22:56.306 INFO:tasks.workunit.client.1.smithi195.stdout:6/6: rename c3 to c4 0 2024-04-06T12:22:56.308 INFO:tasks.workunit.client.1.smithi195.stdout:5/11: creat d0/f3 x:0 0 0 2024-04-06T12:22:56.310 INFO:tasks.workunit.client.1.smithi195.stdout:3/8: write f3 [647863,115736] 0 2024-04-06T12:22:56.314 INFO:tasks.workunit.client.1.smithi195.stdout:6/7: creat f5 x:0 0 0 2024-04-06T12:22:56.315 INFO:tasks.workunit.client.1.smithi195.stdout:5/12: unlink d0/c2 0 2024-04-06T12:22:56.319 INFO:tasks.workunit.client.1.smithi195.stdout:5/13: creat d0/f4 x:0 0 0 2024-04-06T12:22:56.320 INFO:tasks.workunit.client.1.smithi195.stdout:5/14: fdatasync d0/f3 0 2024-04-06T12:22:56.321 INFO:tasks.workunit.client.1.smithi195.stdout:3/9: write f0 [896152,34537] 0 2024-04-06T12:22:56.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/3: dwrite f1 [0,4194304] 0 2024-04-06T12:22:56.322 INFO:tasks.workunit.client.1.smithi195.stdout:5/15: rename d0 to d0/d5 22 2024-04-06T12:22:56.322 INFO:tasks.workunit.client.1.smithi195.stdout:5/16: chown d0 27861 1 2024-04-06T12:22:56.323 INFO:tasks.workunit.client.1.smithi195.stdout:5/17: readlink - no filename 2024-04-06T12:22:56.323 INFO:tasks.workunit.client.1.smithi195.stdout:6/8: link f2 f6 0 2024-04-06T12:22:56.324 INFO:tasks.workunit.client.1.smithi195.stdout:5/18: write d0/f4 [136561,124129] 0 2024-04-06T12:22:56.325 INFO:tasks.workunit.client.1.smithi195.stdout:5/19: chown d0 82 1 2024-04-06T12:22:56.325 INFO:tasks.workunit.client.1.smithi195.stdout:5/20: stat d0/f3 0 2024-04-06T12:22:56.326 INFO:tasks.workunit.client.1.smithi195.stdout:5/21: dread - d0/f3 zero size 2024-04-06T12:22:56.327 INFO:tasks.workunit.client.1.smithi195.stdout:9/4: dread f1 [0,4194304] 0 2024-04-06T12:22:56.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/10: mkdir d4 0 2024-04-06T12:22:56.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/5: chown f1 11 1 2024-04-06T12:22:56.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/11: stat f2 0 2024-04-06T12:22:56.329 INFO:tasks.workunit.client.1.smithi195.stdout:6/9: creat f7 x:0 0 0 2024-04-06T12:22:56.330 INFO:tasks.workunit.client.1.smithi195.stdout:6/10: truncate f2 629653 0 2024-04-06T12:22:56.330 INFO:tasks.workunit.client.1.smithi195.stdout:6/11: write f7 [633253,8476] 0 2024-04-06T12:22:56.332 INFO:tasks.workunit.client.1.smithi195.stdout:5/22: creat d0/f6 x:0 0 0 2024-04-06T12:22:56.333 INFO:tasks.workunit.client.1.smithi195.stdout:9/6: symlink l2 0 2024-04-06T12:22:56.336 INFO:tasks.workunit.client.1.smithi195.stdout:6/12: mkdir d8 0 2024-04-06T12:22:56.337 INFO:tasks.workunit.client.1.smithi195.stdout:6/13: write f5 [451399,6110] 0 2024-04-06T12:22:56.337 INFO:tasks.workunit.client.1.smithi195.stdout:5/23: creat d0/f7 x:0 0 0 2024-04-06T12:22:56.338 INFO:tasks.workunit.client.1.smithi195.stdout:9/7: mkdir d3 0 2024-04-06T12:22:56.338 INFO:tasks.workunit.client.1.smithi195.stdout:5/24: truncate d0/f4 1052056 0 2024-04-06T12:22:56.339 INFO:tasks.workunit.client.1.smithi195.stdout:5/25: rename d0 to d0/d8 22 2024-04-06T12:22:56.340 INFO:tasks.workunit.client.1.smithi195.stdout:3/12: symlink d4/l5 0 2024-04-06T12:22:56.342 INFO:tasks.workunit.client.1.smithi195.stdout:9/8: write f1 [2411667,39939] 0 2024-04-06T12:22:56.344 INFO:tasks.workunit.client.1.smithi195.stdout:3/13: dread f2 [0,4194304] 0 2024-04-06T12:22:56.347 INFO:tasks.workunit.client.1.smithi195.stdout:3/14: write f0 [567071,89005] 0 2024-04-06T12:22:56.354 INFO:tasks.workunit.client.1.smithi195.stdout:6/14: dwrite f2 [0,4194304] 0 2024-04-06T12:22:56.356 INFO:tasks.workunit.client.1.smithi195.stdout:9/9: dwrite f1 [0,4194304] 0 2024-04-06T12:22:56.361 INFO:tasks.workunit.client.1.smithi195.stdout:6/15: unlink f7 0 2024-04-06T12:22:56.365 INFO:tasks.workunit.client.1.smithi195.stdout:9/10: dwrite f1 [0,4194304] 0 2024-04-06T12:22:56.436 INFO:tasks.workunit.client.1.smithi195.stdout:0/8: fsync f0 0 2024-04-06T12:22:56.439 INFO:tasks.workunit.client.1.smithi195.stdout:0/9: mknod c1 0 2024-04-06T12:22:56.448 INFO:tasks.workunit.client.1.smithi195.stdout:2/8: getdents . 0 2024-04-06T12:22:56.449 INFO:tasks.workunit.client.1.smithi195.stdout:2/9: write - no filename 2024-04-06T12:22:56.449 INFO:tasks.workunit.client.1.smithi195.stdout:2/10: dwrite - no filename 2024-04-06T12:22:56.449 INFO:tasks.workunit.client.1.smithi195.stdout:2/11: rmdir - no directory 2024-04-06T12:22:56.450 INFO:tasks.workunit.client.1.smithi195.stdout:1/11: fsync f3 0 2024-04-06T12:22:56.454 INFO:tasks.workunit.client.1.smithi195.stdout:2/12: mkdir d2 0 2024-04-06T12:22:56.454 INFO:tasks.workunit.client.1.smithi195.stdout:2/13: dread - no filename 2024-04-06T12:22:56.454 INFO:tasks.workunit.client.1.smithi195.stdout:2/14: read - no filename 2024-04-06T12:22:56.454 INFO:tasks.workunit.client.1.smithi195.stdout:2/15: dread - no filename 2024-04-06T12:22:56.454 INFO:tasks.workunit.client.1.smithi195.stdout:1/12: mkdir d4 0 2024-04-06T12:22:56.454 INFO:tasks.workunit.client.1.smithi195.stdout:1/13: dread - f1 zero size 2024-04-06T12:22:56.455 INFO:tasks.workunit.client.1.smithi195.stdout:1/14: readlink l2 0 2024-04-06T12:22:56.456 INFO:tasks.workunit.client.1.smithi195.stdout:4/10: chown c1 123493566 1 2024-04-06T12:22:56.456 INFO:tasks.workunit.client.1.smithi195.stdout:4/11: fdatasync - no filename 2024-04-06T12:22:56.456 INFO:tasks.workunit.client.1.smithi195.stdout:4/12: truncate - no filename 2024-04-06T12:22:56.457 INFO:tasks.workunit.client.1.smithi195.stdout:4/13: chown c1 32579679 1 2024-04-06T12:22:56.457 INFO:tasks.workunit.client.1.smithi195.stdout:4/14: write - no filename 2024-04-06T12:22:56.457 INFO:tasks.workunit.client.1.smithi195.stdout:2/16: creat d2/f3 x:0 0 0 2024-04-06T12:22:56.457 INFO:tasks.workunit.client.1.smithi195.stdout:2/17: write d2/f3 [897514,70394] 0 2024-04-06T12:22:56.460 INFO:tasks.workunit.client.1.smithi195.stdout:4/15: symlink l2 0 2024-04-06T12:22:56.462 INFO:tasks.workunit.client.1.smithi195.stdout:1/15: mknod d4/c5 0 2024-04-06T12:22:56.464 INFO:tasks.workunit.client.1.smithi195.stdout:2/18: creat d2/f4 x:0 0 0 2024-04-06T12:22:56.468 INFO:tasks.workunit.client.1.smithi195.stdout:2/19: dread d2/f3 [0,4194304] 0 2024-04-06T12:22:56.471 INFO:tasks.workunit.client.1.smithi195.stdout:8/5: fsync f0 0 2024-04-06T12:22:56.471 INFO:tasks.workunit.client.1.smithi195.stdout:8/6: chown l1 54 1 2024-04-06T12:22:56.472 INFO:tasks.workunit.client.1.smithi195.stdout:8/7: write f0 [954222,97214] 0 2024-04-06T12:22:56.472 INFO:tasks.workunit.client.1.smithi195.stdout:8/8: rmdir - no directory 2024-04-06T12:22:56.477 INFO:tasks.workunit.client.1.smithi195.stdout:2/20: creat d2/f5 x:0 0 0 2024-04-06T12:22:56.478 INFO:tasks.workunit.client.1.smithi195.stdout:8/9: dwrite f0 [0,4194304] 0 2024-04-06T12:22:56.478 INFO:tasks.workunit.client.1.smithi195.stdout:8/10: chown l1 5016440 1 2024-04-06T12:22:56.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/11: dread f0 [0,4194304] 0 2024-04-06T12:22:56.483 INFO:tasks.workunit.client.1.smithi195.stdout:1/16: link l0 d4/l6 0 2024-04-06T12:22:56.483 INFO:tasks.workunit.client.1.smithi195.stdout:1/17: dread - f3 zero size 2024-04-06T12:22:56.484 INFO:tasks.workunit.client.1.smithi195.stdout:1/18: chown f3 104995 1 2024-04-06T12:22:56.485 INFO:tasks.workunit.client.1.smithi195.stdout:6/16: chown c4 440570930 1 2024-04-06T12:22:56.486 INFO:tasks.workunit.client.1.smithi195.stdout:6/17: write f6 [154118,61434] 0 2024-04-06T12:22:56.487 INFO:tasks.workunit.client.1.smithi195.stdout:6/18: truncate f5 801924 0 2024-04-06T12:22:56.487 INFO:tasks.workunit.client.1.smithi195.stdout:2/21: stat l1 0 2024-04-06T12:22:56.501 INFO:tasks.workunit.client.1.smithi195.stdout:2/22: dread d2/f3 [0,4194304] 0 2024-04-06T12:22:56.508 INFO:tasks.workunit.client.1.smithi195.stdout:3/15: getdents d4 0 2024-04-06T12:22:56.508 INFO:tasks.workunit.client.1.smithi195.stdout:3/16: dread f2 [0,4194304] 0 2024-04-06T12:22:56.510 INFO:tasks.workunit.client.1.smithi195.stdout:2/23: mkdir d2/d6 0 2024-04-06T12:22:56.511 INFO:tasks.workunit.client.1.smithi195.stdout:2/24: dread d2/f3 [0,4194304] 0 2024-04-06T12:22:56.512 INFO:tasks.workunit.client.1.smithi195.stdout:2/25: chown d2/f4 38 1 2024-04-06T12:22:56.517 INFO:tasks.workunit.client.1.smithi195.stdout:9/11: truncate f1 798965 0 2024-04-06T12:22:56.518 INFO:tasks.workunit.client.1.smithi195.stdout:2/26: symlink d2/l7 0 2024-04-06T12:22:56.519 INFO:tasks.workunit.client.1.smithi195.stdout:3/17: dwrite f3 [0,4194304] 0 2024-04-06T12:22:56.524 INFO:tasks.workunit.client.1.smithi195.stdout:2/27: symlink d2/l8 0 2024-04-06T12:22:56.524 INFO:tasks.workunit.client.1.smithi195.stdout:2/28: stat d2 0 2024-04-06T12:22:56.528 INFO:tasks.workunit.client.1.smithi195.stdout:2/29: unlink d2/l8 0 2024-04-06T12:22:56.580 INFO:tasks.workunit.client.1.smithi195.stdout:0/10: getdents . 0 2024-04-06T12:22:56.581 INFO:tasks.workunit.client.1.smithi195.stdout:0/11: write f0 [4773519,65701] 0 2024-04-06T12:22:56.581 INFO:tasks.workunit.client.1.smithi195.stdout:0/12: chown c1 791 1 2024-04-06T12:22:56.581 INFO:tasks.workunit.client.1.smithi195.stdout:0/13: chown c1 31588615 1 2024-04-06T12:22:56.596 INFO:tasks.workunit.client.1.smithi195.stdout:4/16: getdents . 0 2024-04-06T12:22:56.596 INFO:tasks.workunit.client.1.smithi195.stdout:4/17: chown l2 49 1 2024-04-06T12:22:56.597 INFO:tasks.workunit.client.1.smithi195.stdout:4/18: chown c1 1 1 2024-04-06T12:22:56.606 INFO:tasks.workunit.client.1.smithi195.stdout:1/19: getdents d4 0 2024-04-06T12:22:56.616 INFO:tasks.workunit.client.1.smithi195.stdout:8/12: write f0 [5072472,47939] 0 2024-04-06T12:22:56.627 INFO:tasks.workunit.client.1.smithi195.stdout:6/19: truncate f6 3013135 0 2024-04-06T12:22:56.636 INFO:tasks.workunit.client.1.smithi195.stdout:9/12: write f1 [1230849,99534] 0 2024-04-06T12:22:56.648 INFO:tasks.workunit.client.1.smithi195.stdout:3/18: truncate f0 257710 0 2024-04-06T12:22:56.649 INFO:tasks.workunit.client.1.smithi195.stdout:3/19: write f2 [4481172,14219] 0 2024-04-06T12:22:56.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:55.311470+0000 mon.smithi152 (mon.0) 693 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:56.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:22:55.316997+0000 mon.smithi152 (mon.0) 694 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:56.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:55.358309+0000 mgr.smithi195.ausetj (mgr.24375) 42 : cephadm [INF] Reconfiguring grafana.smithi152 (dependencies changed)... 2024-04-06T12:22:56.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:22:55.370190+0000 mgr.smithi195.ausetj (mgr.24375) 43 : cephadm [INF] Reconfiguring daemon grafana.smithi152 on smithi152 2024-04-06T12:22:56.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:55.570868+0000 mgr.smithi195.ausetj (mgr.24375) 44 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.3 MiB/s wr, 467 op/s 2024-04-06T12:22:56.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:55.311470+0000 mon.smithi152 (mon.0) 693 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:56.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:22:55.316997+0000 mon.smithi152 (mon.0) 694 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:22:56.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:55.358309+0000 mgr.smithi195.ausetj (mgr.24375) 42 : cephadm [INF] Reconfiguring grafana.smithi152 (dependencies changed)... 2024-04-06T12:22:56.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:22:55.370190+0000 mgr.smithi195.ausetj (mgr.24375) 43 : cephadm [INF] Reconfiguring daemon grafana.smithi152 on smithi152 2024-04-06T12:22:56.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:55.570868+0000 mgr.smithi195.ausetj (mgr.24375) 44 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.3 MiB/s wr, 467 op/s 2024-04-06T12:22:56.931 INFO:tasks.workunit.client.1.smithi195.stdout:2/30: rmdir d2/d6 0 2024-04-06T12:22:56.931 INFO:tasks.workunit.client.1.smithi195.stdout:2/31: dread - d2/f4 zero size 2024-04-06T12:22:56.932 INFO:tasks.workunit.client.1.smithi195.stdout:0/14: rename c1 to c2 0 2024-04-06T12:22:56.932 INFO:tasks.workunit.client.1.smithi195.stdout:0/15: readlink - no filename 2024-04-06T12:22:56.933 INFO:tasks.workunit.client.1.smithi195.stdout:4/19: creat f3 x:0 0 0 2024-04-06T12:22:56.934 INFO:tasks.workunit.client.1.smithi195.stdout:1/20: readlink d4/l6 0 2024-04-06T12:22:56.936 INFO:tasks.workunit.client.1.smithi195.stdout:8/13: mknod c2 0 2024-04-06T12:22:56.940 INFO:tasks.workunit.client.1.smithi195.stdout:3/20: mknod d4/c6 0 2024-04-06T12:22:56.943 INFO:tasks.workunit.client.1.smithi195.stdout:8/14: dwrite f0 [4194304,4194304] 0 2024-04-06T12:22:56.945 INFO:tasks.workunit.client.1.smithi195.stdout:2/32: symlink d2/l9 0 2024-04-06T12:22:56.945 INFO:tasks.workunit.client.1.smithi195.stdout:0/16: mknod c3 0 2024-04-06T12:22:56.945 INFO:tasks.workunit.client.1.smithi195.stdout:0/17: fsync f0 0 2024-04-06T12:22:56.947 INFO:tasks.workunit.client.1.smithi195.stdout:4/20: unlink l2 0 2024-04-06T12:22:56.949 INFO:tasks.workunit.client.1.smithi195.stdout:1/21: rmdir d4 39 2024-04-06T12:22:56.950 INFO:tasks.workunit.client.1.smithi195.stdout:1/22: fdatasync f3 0 2024-04-06T12:22:56.951 INFO:tasks.workunit.client.1.smithi195.stdout:1/23: write f3 [988720,59809] 0 2024-04-06T12:22:56.953 INFO:tasks.workunit.client.1.smithi195.stdout:9/13: creat d3/f4 x:0 0 0 2024-04-06T12:22:56.955 INFO:tasks.workunit.client.1.smithi195.stdout:4/21: dwrite f3 [0,4194304] 0 2024-04-06T12:22:56.959 INFO:tasks.workunit.client.1.smithi195.stdout:3/21: creat d4/f7 x:0 0 0 2024-04-06T12:22:56.962 INFO:tasks.workunit.client.1.smithi195.stdout:8/15: unlink f0 0 2024-04-06T12:22:56.962 INFO:tasks.workunit.client.1.smithi195.stdout:1/24: dwrite f3 [0,4194304] 0 2024-04-06T12:22:56.966 INFO:tasks.workunit.client.1.smithi195.stdout:3/22: dread f2 [0,4194304] 0 2024-04-06T12:22:56.966 INFO:tasks.workunit.client.1.smithi195.stdout:2/33: symlink d2/la 0 2024-04-06T12:22:56.967 INFO:tasks.workunit.client.1.smithi195.stdout:3/23: chown d4/c6 237700 1 2024-04-06T12:22:56.973 INFO:tasks.workunit.client.1.smithi195.stdout:9/14: creat d3/f5 x:0 0 0 2024-04-06T12:22:56.975 INFO:tasks.workunit.client.1.smithi195.stdout:3/24: dread f3 [0,4194304] 0 2024-04-06T12:22:56.976 INFO:tasks.workunit.client.1.smithi195.stdout:9/15: write d3/f5 [485372,98568] 0 2024-04-06T12:22:56.977 INFO:tasks.workunit.client.1.smithi195.stdout:2/34: dwrite d2/f4 [0,4194304] 0 2024-04-06T12:22:56.982 INFO:tasks.workunit.client.1.smithi195.stdout:8/16: rename l1 to l3 0 2024-04-06T12:22:56.990 INFO:tasks.workunit.client.1.smithi195.stdout:3/25: mknod d4/c8 0 2024-04-06T12:22:56.991 INFO:tasks.workunit.client.1.smithi195.stdout:9/16: mknod d3/c6 0 2024-04-06T12:22:56.994 INFO:tasks.workunit.client.1.smithi195.stdout:1/25: symlink d4/l7 0 2024-04-06T12:22:56.997 INFO:tasks.workunit.client.1.smithi195.stdout:3/26: fsync f2 0 2024-04-06T12:22:56.998 INFO:tasks.workunit.client.1.smithi195.stdout:3/27: fdatasync d4/f7 0 2024-04-06T12:22:56.999 INFO:tasks.workunit.client.1.smithi195.stdout:9/17: mknod d3/c7 0 2024-04-06T12:22:57.002 INFO:tasks.workunit.client.1.smithi195.stdout:1/26: creat d4/f8 x:0 0 0 2024-04-06T12:22:57.003 INFO:tasks.workunit.client.1.smithi195.stdout:3/28: mkdir d4/d9 0 2024-04-06T12:22:57.005 INFO:tasks.workunit.client.1.smithi195.stdout:9/18: symlink d3/l8 0 2024-04-06T12:22:57.007 INFO:tasks.workunit.client.1.smithi195.stdout:1/27: mknod d4/c9 0 2024-04-06T12:22:57.009 INFO:tasks.workunit.client.1.smithi195.stdout:1/28: write f1 [519468,60749] 0 2024-04-06T12:22:57.009 INFO:tasks.workunit.client.1.smithi195.stdout:9/19: creat d3/f9 x:0 0 0 2024-04-06T12:22:57.011 INFO:tasks.workunit.client.1.smithi195.stdout:1/29: write f3 [383723,35146] 0 2024-04-06T12:22:57.011 INFO:tasks.workunit.client.1.smithi195.stdout:3/29: dwrite d4/f7 [0,4194304] 0 2024-04-06T12:22:57.014 INFO:tasks.workunit.client.1.smithi195.stdout:1/30: write f3 [1696249,91995] 0 2024-04-06T12:22:57.014 INFO:tasks.workunit.client.1.smithi195.stdout:9/20: dread f1 [0,4194304] 0 2024-04-06T12:22:57.072 INFO:tasks.workunit.client.1.smithi195.stdout:6/20: read f2 [761920,74499] 0 2024-04-06T12:22:57.073 INFO:tasks.workunit.client.1.smithi195.stdout:6/21: chown f6 302 1 2024-04-06T12:22:57.082 INFO:tasks.workunit.client.1.smithi195.stdout:3/30: link f0 d4/d9/fa 0 2024-04-06T12:22:57.086 INFO:tasks.workunit.client.1.smithi195.stdout:0/18: truncate f0 386373 0 2024-04-06T12:22:57.088 INFO:tasks.workunit.client.1.smithi195.stdout:4/22: write f3 [4884786,52557] 0 2024-04-06T12:22:57.091 INFO:tasks.workunit.client.1.smithi195.stdout:3/31: dread d4/d9/fa [0,4194304] 0 2024-04-06T12:22:57.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/23: dwrite f3 [4194304,4194304] 0 2024-04-06T12:22:57.098 INFO:tasks.workunit.client.1.smithi195.stdout:8/17: chown l3 1694 1 2024-04-06T12:22:57.098 INFO:tasks.workunit.client.1.smithi195.stdout:8/18: dwrite - no filename 2024-04-06T12:22:57.098 INFO:tasks.workunit.client.1.smithi195.stdout:8/19: dwrite - no filename 2024-04-06T12:22:57.101 INFO:tasks.workunit.client.1.smithi195.stdout:4/24: dread f3 [4194304,4194304] 0 2024-04-06T12:22:57.102 INFO:tasks.workunit.client.1.smithi195.stdout:3/32: link f0 d4/d9/fb 0 2024-04-06T12:22:57.103 INFO:tasks.workunit.client.1.smithi195.stdout:3/33: read f3 [908312,72559] 0 2024-04-06T12:22:57.105 INFO:tasks.workunit.client.1.smithi195.stdout:4/25: mkdir d4 0 2024-04-06T12:22:57.105 INFO:tasks.workunit.client.1.smithi195.stdout:4/26: read f3 [1333131,27687] 0 2024-04-06T12:22:57.109 INFO:tasks.workunit.client.1.smithi195.stdout:3/34: mknod d4/d9/cc 0 2024-04-06T12:22:57.113 INFO:tasks.workunit.client.1.smithi195.stdout:4/27: link f3 d4/f5 0 2024-04-06T12:22:57.118 INFO:tasks.workunit.client.1.smithi195.stdout:4/28: mkdir d4/d6 0 2024-04-06T12:22:57.122 INFO:tasks.workunit.client.1.smithi195.stdout:4/29: write d4/f5 [3808859,69178] 0 2024-04-06T12:22:57.122 INFO:tasks.workunit.client.1.smithi195.stdout:3/35: truncate d4/d9/fa 928047 0 2024-04-06T12:22:57.126 INFO:tasks.workunit.client.1.smithi195.stdout:4/30: link d4/f5 d4/d6/f7 0 2024-04-06T12:22:57.130 INFO:tasks.workunit.client.1.smithi195.stdout:1/31: truncate f3 2257016 0 2024-04-06T12:22:57.130 INFO:tasks.workunit.client.1.smithi195.stdout:1/32: readlink l2 0 2024-04-06T12:22:57.131 INFO:tasks.workunit.client.1.smithi195.stdout:9/21: truncate d3/f5 152020 0 2024-04-06T12:22:57.132 INFO:tasks.workunit.client.1.smithi195.stdout:1/33: creat d4/fa x:0 0 0 2024-04-06T12:22:57.132 INFO:tasks.workunit.client.1.smithi195.stdout:9/22: fsync f1 0 2024-04-06T12:22:57.133 INFO:tasks.workunit.client.1.smithi195.stdout:9/23: dread - d3/f4 zero size 2024-04-06T12:22:57.135 INFO:tasks.workunit.client.1.smithi195.stdout:9/24: creat d3/fa x:0 0 0 2024-04-06T12:22:57.138 INFO:tasks.workunit.client.1.smithi195.stdout:9/25: rename d3/c7 to d3/cb 0 2024-04-06T12:22:57.140 INFO:tasks.workunit.client.1.smithi195.stdout:9/26: symlink d3/lc 0 2024-04-06T12:22:57.142 INFO:tasks.workunit.client.1.smithi195.stdout:9/27: creat d3/fd x:0 0 0 2024-04-06T12:22:57.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/28: read - d3/fd zero size 2024-04-06T12:22:57.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/29: chown d3/fa 111592775 1 2024-04-06T12:22:57.144 INFO:tasks.workunit.client.1.smithi195.stdout:9/30: dread - d3/fa zero size 2024-04-06T12:22:57.144 INFO:tasks.workunit.client.1.smithi195.stdout:9/31: write f1 [1175886,14281] 0 2024-04-06T12:22:57.148 INFO:tasks.workunit.client.1.smithi195.stdout:9/32: mkdir d3/de 0 2024-04-06T12:22:57.149 INFO:tasks.workunit.client.1.smithi195.stdout:9/33: chown d3/f4 120504097 1 2024-04-06T12:22:57.155 INFO:tasks.workunit.client.1.smithi195.stdout:6/22: dwrite f2 [0,4194304] 0 2024-04-06T12:22:57.161 INFO:tasks.workunit.client.1.smithi195.stdout:6/23: mkdir d8/d9 0 2024-04-06T12:22:57.164 INFO:tasks.workunit.client.1.smithi195.stdout:6/24: dread f6 [0,4194304] 0 2024-04-06T12:22:57.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/25: mknod d8/ca 0 2024-04-06T12:22:57.170 INFO:tasks.workunit.client.1.smithi195.stdout:4/31: truncate f3 7378608 0 2024-04-06T12:22:57.171 INFO:tasks.workunit.client.1.smithi195.stdout:6/26: rmdir d8 39 2024-04-06T12:22:57.172 INFO:tasks.workunit.client.1.smithi195.stdout:6/27: write f5 [1487784,130379] 0 2024-04-06T12:22:57.176 INFO:tasks.workunit.client.1.smithi195.stdout:6/28: fdatasync f2 0 2024-04-06T12:22:57.177 INFO:tasks.workunit.client.1.smithi195.stdout:6/29: truncate f6 4951407 0 2024-04-06T12:22:57.181 INFO:tasks.workunit.client.1.smithi195.stdout:6/30: unlink f6 0 2024-04-06T12:22:57.181 INFO:tasks.workunit.client.1.smithi195.stdout:6/31: chown c0 2000 1 2024-04-06T12:22:57.186 INFO:tasks.workunit.client.1.smithi195.stdout:9/34: chown d3/cb 7 1 2024-04-06T12:22:57.189 INFO:tasks.workunit.client.1.smithi195.stdout:9/35: rename l2 to d3/de/lf 0 2024-04-06T12:22:57.189 INFO:tasks.workunit.client.1.smithi195.stdout:9/36: fsync f1 0 2024-04-06T12:22:57.194 INFO:tasks.workunit.client.1.smithi195.stdout:9/37: mkdir d3/d10 0 2024-04-06T12:22:57.197 INFO:tasks.workunit.client.1.smithi195.stdout:9/38: rename d3/fa to d3/d10/f11 0 2024-04-06T12:22:57.198 INFO:tasks.workunit.client.1.smithi195.stdout:9/39: rename d3/d10 to d3/d10/d12 22 2024-04-06T12:22:57.198 INFO:tasks.workunit.client.1.smithi195.stdout:9/40: chown d3 53 1 2024-04-06T12:22:57.200 INFO:tasks.workunit.client.1.smithi195.stdout:9/41: rmdir d3/d10 39 2024-04-06T12:22:57.202 INFO:tasks.workunit.client.1.smithi195.stdout:0/19: dwrite f0 [0,4194304] 0 2024-04-06T12:22:57.202 INFO:tasks.workunit.client.1.smithi195.stdout:0/20: chown c3 14 1 2024-04-06T12:22:57.202 INFO:tasks.workunit.client.1.smithi195.stdout:0/21: rmdir - no directory 2024-04-06T12:22:57.204 INFO:tasks.workunit.client.1.smithi195.stdout:9/42: symlink d3/de/l13 0 2024-04-06T12:22:57.207 INFO:tasks.workunit.client.1.smithi195.stdout:0/22: mkdir d4 0 2024-04-06T12:22:57.208 INFO:tasks.workunit.client.1.smithi195.stdout:9/43: creat d3/de/f14 x:0 0 0 2024-04-06T12:22:57.212 INFO:tasks.workunit.client.1.smithi195.stdout:0/23: creat d4/f5 x:0 0 0 2024-04-06T12:22:57.212 INFO:tasks.workunit.client.1.smithi195.stdout:4/32: dread d4/d6/f7 [0,4194304] 0 2024-04-06T12:22:57.218 INFO:tasks.workunit.client.1.smithi195.stdout:0/24: dwrite f0 [0,4194304] 0 2024-04-06T12:22:57.221 INFO:tasks.workunit.client.1.smithi195.stdout:4/33: creat d4/d6/f8 x:0 0 0 2024-04-06T12:22:57.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/25: chown c2 512383 1 2024-04-06T12:22:57.230 INFO:tasks.workunit.client.1.smithi195.stdout:0/26: unlink c2 0 2024-04-06T12:22:57.231 INFO:tasks.workunit.client.1.smithi195.stdout:0/27: write f0 [1654773,102668] 0 2024-04-06T12:22:57.232 INFO:tasks.workunit.client.1.smithi195.stdout:0/28: chown d4 19 1 2024-04-06T12:22:57.233 INFO:tasks.workunit.client.1.smithi195.stdout:9/44: rename d3/lc to d3/d10/l15 0 2024-04-06T12:22:57.235 INFO:tasks.workunit.client.1.smithi195.stdout:0/29: mkdir d4/d6 0 2024-04-06T12:22:57.236 INFO:tasks.workunit.client.1.smithi195.stdout:0/30: write f0 [1432695,51843] 0 2024-04-06T12:22:57.238 INFO:tasks.workunit.client.1.smithi195.stdout:9/45: rename d3/f4 to d3/d10/f16 0 2024-04-06T12:22:57.243 INFO:tasks.workunit.client.1.smithi195.stdout:0/31: dwrite d4/f5 [0,4194304] 0 2024-04-06T12:22:57.243 INFO:tasks.workunit.client.1.smithi195.stdout:9/46: rmdir d3/de 39 2024-04-06T12:22:57.244 INFO:tasks.workunit.client.1.smithi195.stdout:0/32: stat d4/d6 0 2024-04-06T12:22:57.249 INFO:tasks.workunit.client.1.smithi195.stdout:4/34: rmdir d4/d6 39 2024-04-06T12:22:57.250 INFO:tasks.workunit.client.1.smithi195.stdout:6/32: write f2 [3783010,36197] 0 2024-04-06T12:22:57.250 INFO:tasks.workunit.client.1.smithi195.stdout:4/35: chown d4 2491869 1 2024-04-06T12:22:57.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/47: dwrite d3/fd [0,4194304] 0 2024-04-06T12:22:57.256 INFO:tasks.workunit.client.1.smithi195.stdout:6/33: chown d8/ca 17356 1 2024-04-06T12:22:57.259 INFO:tasks.workunit.client.1.smithi195.stdout:0/33: fdatasync d4/f5 0 2024-04-06T12:22:57.260 INFO:tasks.workunit.client.1.smithi195.stdout:4/36: write d4/d6/f7 [246214,85124] 0 2024-04-06T12:22:57.266 INFO:tasks.workunit.client.1.smithi195.stdout:6/34: symlink d8/d9/lb 0 2024-04-06T12:22:57.268 INFO:tasks.workunit.client.1.smithi195.stdout:0/34: mknod d4/d6/c7 0 2024-04-06T12:22:57.272 INFO:tasks.workunit.client.1.smithi195.stdout:6/35: creat d8/fc x:0 0 0 2024-04-06T12:22:57.272 INFO:tasks.workunit.client.1.smithi195.stdout:9/48: write d3/f5 [160970,17160] 0 2024-04-06T12:22:57.273 INFO:tasks.workunit.client.1.smithi195.stdout:6/36: dread - d8/fc zero size 2024-04-06T12:22:57.275 INFO:tasks.workunit.client.1.smithi195.stdout:6/37: dread - d8/fc zero size 2024-04-06T12:22:57.276 INFO:tasks.workunit.client.1.smithi195.stdout:0/35: dwrite d4/f5 [0,4194304] 0 2024-04-06T12:22:57.276 INFO:tasks.workunit.client.1.smithi195.stdout:6/38: chown f5 5880 1 2024-04-06T12:22:57.277 INFO:tasks.workunit.client.1.smithi195.stdout:0/36: chown d4/d6 16325 1 2024-04-06T12:22:57.279 INFO:tasks.workunit.client.1.smithi195.stdout:9/49: rename d3/fd to d3/f17 0 2024-04-06T12:22:57.280 INFO:tasks.workunit.client.1.smithi195.stdout:6/39: creat d8/fd x:0 0 0 2024-04-06T12:22:57.280 INFO:tasks.workunit.client.1.smithi195.stdout:6/40: truncate d8/fc 745724 0 2024-04-06T12:22:57.282 INFO:tasks.workunit.client.1.smithi195.stdout:4/37: truncate d4/f5 1859259 0 2024-04-06T12:22:57.283 INFO:tasks.workunit.client.1.smithi195.stdout:4/38: dread - d4/d6/f8 zero size 2024-04-06T12:22:57.284 INFO:tasks.workunit.client.1.smithi195.stdout:0/37: creat d4/d6/f8 x:0 0 0 2024-04-06T12:22:57.285 INFO:tasks.workunit.client.1.smithi195.stdout:0/38: dread - d4/d6/f8 zero size 2024-04-06T12:22:57.285 INFO:tasks.workunit.client.1.smithi195.stdout:6/41: dread f2 [0,4194304] 0 2024-04-06T12:22:57.291 INFO:tasks.workunit.client.1.smithi195.stdout:6/42: creat d8/d9/fe x:0 0 0 2024-04-06T12:22:57.295 INFO:tasks.workunit.client.1.smithi195.stdout:6/43: creat d8/ff x:0 0 0 2024-04-06T12:22:57.296 INFO:tasks.workunit.client.1.smithi195.stdout:4/39: write d4/f5 [2298868,97902] 0 2024-04-06T12:22:57.297 INFO:tasks.workunit.client.1.smithi195.stdout:4/40: dread - d4/d6/f8 zero size 2024-04-06T12:22:57.300 INFO:tasks.workunit.client.1.smithi195.stdout:6/44: rename d8/fd to d8/f10 0 2024-04-06T12:22:57.303 INFO:tasks.workunit.client.1.smithi195.stdout:6/45: creat d8/d9/f11 x:0 0 0 2024-04-06T12:22:57.305 INFO:tasks.workunit.client.1.smithi195.stdout:4/41: getdents d4 0 2024-04-06T12:22:57.306 INFO:tasks.workunit.client.1.smithi195.stdout:6/46: symlink d8/d9/l12 0 2024-04-06T12:22:57.306 INFO:tasks.workunit.client.1.smithi195.stdout:6/47: chown c4 9 1 2024-04-06T12:22:57.308 INFO:tasks.workunit.client.1.smithi195.stdout:4/42: mknod d4/c9 0 2024-04-06T12:22:57.313 INFO:tasks.workunit.client.1.smithi195.stdout:6/48: dwrite d8/d9/f11 [0,4194304] 0 2024-04-06T12:22:57.314 INFO:tasks.workunit.client.1.smithi195.stdout:6/49: read - d8/d9/fe zero size 2024-04-06T12:22:57.318 INFO:tasks.workunit.client.1.smithi195.stdout:6/50: symlink d8/d9/l13 0 2024-04-06T12:22:57.319 INFO:tasks.workunit.client.1.smithi195.stdout:6/51: write d8/d9/fe [711016,66285] 0 2024-04-06T12:22:57.320 INFO:tasks.workunit.client.1.smithi195.stdout:6/52: dread - d8/ff zero size 2024-04-06T12:22:57.322 INFO:tasks.workunit.client.1.smithi195.stdout:4/43: mknod d4/d6/ca 0 2024-04-06T12:22:57.330 INFO:tasks.workunit.client.1.smithi195.stdout:6/53: dwrite d8/d9/fe [0,4194304] 0 2024-04-06T12:22:57.332 INFO:tasks.workunit.client.1.smithi195.stdout:4/44: dwrite d4/d6/f8 [0,4194304] 0 2024-04-06T12:22:57.333 INFO:tasks.workunit.client.1.smithi195.stdout:6/54: creat d8/f14 x:0 0 0 2024-04-06T12:22:57.336 INFO:tasks.workunit.client.1.smithi195.stdout:4/45: rmdir d4/d6 39 2024-04-06T12:22:57.338 INFO:tasks.workunit.client.1.smithi195.stdout:6/55: creat d8/f15 x:0 0 0 2024-04-06T12:22:57.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/56: creat d8/d9/f16 x:0 0 0 2024-04-06T12:22:57.345 INFO:tasks.workunit.client.1.smithi195.stdout:6/57: symlink d8/d9/l17 0 2024-04-06T12:22:57.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/58: truncate d8/ff 501218 0 2024-04-06T12:22:57.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/59: chown c0 206647 1 2024-04-06T12:22:57.347 INFO:tasks.workunit.client.1.smithi195.stdout:4/46: mkdir d4/db 0 2024-04-06T12:22:57.348 INFO:tasks.workunit.client.1.smithi195.stdout:6/60: symlink d8/d9/l18 0 2024-04-06T12:22:57.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/61: rename d8/d9/f16 to d8/f19 0 2024-04-06T12:22:57.353 INFO:tasks.workunit.client.1.smithi195.stdout:6/62: truncate d8/f15 942985 0 2024-04-06T12:22:57.353 INFO:tasks.workunit.client.1.smithi195.stdout:6/63: write d8/fc [1324756,83689] 0 2024-04-06T12:22:57.355 INFO:tasks.workunit.client.1.smithi195.stdout:6/64: fdatasync d8/f10 0 2024-04-06T12:22:57.361 INFO:tasks.workunit.client.1.smithi195.stdout:6/65: dwrite d8/d9/f11 [0,4194304] 0 2024-04-06T12:22:57.362 INFO:tasks.workunit.client.1.smithi195.stdout:6/66: truncate f5 1711046 0 2024-04-06T12:22:57.363 INFO:tasks.workunit.client.1.smithi195.stdout:6/67: write d8/ff [1214872,98190] 0 2024-04-06T12:22:57.365 INFO:tasks.workunit.client.1.smithi195.stdout:4/47: creat d4/fc x:0 0 0 2024-04-06T12:22:57.365 INFO:tasks.workunit.client.1.smithi195.stdout:4/48: read f3 [1499758,5004] 0 2024-04-06T12:22:57.366 INFO:tasks.workunit.client.1.smithi195.stdout:6/68: creat d8/f1a x:0 0 0 2024-04-06T12:22:57.910 INFO:tasks.workunit.client.1.smithi195.stdout:6/69: symlink d8/d9/l1b 0 2024-04-06T12:22:57.927 INFO:tasks.workunit.client.1.smithi195.stdout:4/49: creat d4/db/fd x:0 0 0 2024-04-06T12:22:57.931 INFO:tasks.workunit.client.1.smithi195.stdout:6/70: dread d8/fc [0,4194304] 0 2024-04-06T12:22:57.931 INFO:tasks.workunit.client.1.smithi195.stdout:6/71: write f5 [1430357,124272] 0 2024-04-06T12:22:57.933 INFO:tasks.workunit.client.1.smithi195.stdout:6/72: readlink d8/d9/lb 0 2024-04-06T12:22:57.985 INFO:tasks.workunit.client.1.smithi195.stdout:7/6: sync 2024-04-06T12:22:57.986 INFO:tasks.workunit.client.1.smithi195.stdout:7/7: write - no filename 2024-04-06T12:22:58.231 INFO:tasks.workunit.client.1.smithi195.stdout:5/26: sync 2024-04-06T12:22:58.231 INFO:tasks.workunit.client.1.smithi195.stdout:2/35: sync 2024-04-06T12:22:58.237 INFO:tasks.workunit.client.1.smithi195.stdout:2/36: dwrite d2/f5 [0,4194304] 0 2024-04-06T12:22:58.253 INFO:tasks.workunit.client.1.smithi195.stdout:2/37: truncate d2/f3 334420 0 2024-04-06T12:22:58.256 INFO:tasks.workunit.client.1.smithi195.stdout:7/8: creat f0 x:0 0 0 2024-04-06T12:22:58.256 INFO:tasks.workunit.client.1.smithi195.stdout:7/9: rmdir - no directory 2024-04-06T12:22:58.257 INFO:tasks.workunit.client.1.smithi195.stdout:7/10: dread - f0 zero size 2024-04-06T12:22:58.263 INFO:tasks.workunit.client.1.smithi195.stdout:6/73: getdents d8/d9 0 2024-04-06T12:22:58.264 INFO:tasks.workunit.client.1.smithi195.stdout:5/27: getdents d0 0 2024-04-06T12:22:58.264 INFO:tasks.workunit.client.1.smithi195.stdout:5/28: rename d0 to d0/d9 22 2024-04-06T12:22:58.268 INFO:tasks.workunit.client.1.smithi195.stdout:5/29: dread d0/f4 [0,4194304] 0 2024-04-06T12:22:58.271 INFO:tasks.workunit.client.1.smithi195.stdout:1/34: sync 2024-04-06T12:22:58.271 INFO:tasks.workunit.client.1.smithi195.stdout:0/39: sync 2024-04-06T12:22:58.271 INFO:tasks.workunit.client.1.smithi195.stdout:3/36: sync 2024-04-06T12:22:58.271 INFO:tasks.workunit.client.1.smithi195.stdout:8/20: sync 2024-04-06T12:22:58.271 INFO:tasks.workunit.client.1.smithi195.stdout:9/50: sync 2024-04-06T12:22:58.272 INFO:tasks.workunit.client.1.smithi195.stdout:2/38: getdents d2 0 2024-04-06T12:22:58.275 INFO:tasks.workunit.client.1.smithi195.stdout:0/40: creat d4/f9 x:0 0 0 2024-04-06T12:22:58.276 INFO:tasks.workunit.client.1.smithi195.stdout:8/21: symlink l4 0 2024-04-06T12:22:58.279 INFO:tasks.workunit.client.1.smithi195.stdout:3/37: rmdir d4/d9 39 2024-04-06T12:22:58.280 INFO:tasks.workunit.client.1.smithi195.stdout:9/51: write d3/de/f14 [349384,45116] 0 2024-04-06T12:22:58.280 INFO:tasks.workunit.client.1.smithi195.stdout:1/35: mkdir d4/db 0 2024-04-06T12:22:58.283 INFO:tasks.workunit.client.1.smithi195.stdout:8/22: mknod c5 0 2024-04-06T12:22:58.283 INFO:tasks.workunit.client.1.smithi195.stdout:8/23: dwrite - no filename 2024-04-06T12:22:58.283 INFO:tasks.workunit.client.1.smithi195.stdout:8/24: dread - no filename 2024-04-06T12:22:58.283 INFO:tasks.workunit.client.1.smithi195.stdout:8/25: dwrite - no filename 2024-04-06T12:22:58.283 INFO:tasks.workunit.client.1.smithi195.stdout:8/26: write - no filename 2024-04-06T12:22:58.284 INFO:tasks.workunit.client.1.smithi195.stdout:0/41: dwrite d4/f9 [0,4194304] 0 2024-04-06T12:22:58.285 INFO:tasks.workunit.client.1.smithi195.stdout:0/42: write d4/f9 [2849975,15635] 0 2024-04-06T12:22:58.287 INFO:tasks.workunit.client.1.smithi195.stdout:0/43: write f0 [3845317,104690] 0 2024-04-06T12:22:58.292 INFO:tasks.workunit.client.1.smithi195.stdout:8/27: mkdir d6 0 2024-04-06T12:22:58.292 INFO:tasks.workunit.client.1.smithi195.stdout:8/28: fsync - no filename 2024-04-06T12:22:58.292 INFO:tasks.workunit.client.1.smithi195.stdout:8/29: chown c2 6326863 1 2024-04-06T12:22:58.294 INFO:tasks.workunit.client.1.smithi195.stdout:3/38: creat d4/d9/fd x:0 0 0 2024-04-06T12:22:58.299 INFO:tasks.workunit.client.1.smithi195.stdout:0/44: mknod d4/ca 0 2024-04-06T12:22:58.299 INFO:tasks.workunit.client.1.smithi195.stdout:0/45: read f0 [1357291,71290] 0 2024-04-06T12:22:58.303 INFO:tasks.workunit.client.1.smithi195.stdout:9/52: truncate f1 1278108 0 2024-04-06T12:22:58.311 INFO:tasks.workunit.client.1.smithi195.stdout:0/46: creat d4/d6/fb x:0 0 0 2024-04-06T12:22:58.314 INFO:tasks.workunit.client.1.smithi195.stdout:8/30: creat d6/f7 x:0 0 0 2024-04-06T12:22:58.317 INFO:tasks.workunit.client.1.smithi195.stdout:0/47: dwrite d4/f5 [0,4194304] 0 2024-04-06T12:22:58.319 INFO:tasks.workunit.client.1.smithi195.stdout:9/53: symlink d3/l18 0 2024-04-06T12:22:58.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/54: write d3/f9 [204612,32340] 0 2024-04-06T12:22:58.321 INFO:tasks.workunit.client.1.smithi195.stdout:8/31: mkdir d6/d8 0 2024-04-06T12:22:58.324 INFO:tasks.workunit.client.1.smithi195.stdout:9/55: fdatasync d3/d10/f11 0 2024-04-06T12:22:58.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/56: rename d3/l8 to d3/d10/l19 0 2024-04-06T12:22:58.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/32: dwrite d6/f7 [0,4194304] 0 2024-04-06T12:22:58.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/57: mknod d3/d10/c1a 0 2024-04-06T12:22:58.332 INFO:tasks.workunit.client.1.smithi195.stdout:9/58: write d3/f5 [35474,52912] 0 2024-04-06T12:22:58.334 INFO:tasks.workunit.client.1.smithi195.stdout:9/59: read d3/de/f14 [34891,27960] 0 2024-04-06T12:22:58.334 INFO:tasks.workunit.client.1.smithi195.stdout:8/33: dread d6/f7 [0,4194304] 0 2024-04-06T12:22:58.337 INFO:tasks.workunit.client.1.smithi195.stdout:9/60: dread d3/de/f14 [0,4194304] 0 2024-04-06T12:22:58.338 INFO:tasks.workunit.client.1.smithi195.stdout:8/34: symlink d6/d8/l9 0 2024-04-06T12:22:58.343 INFO:tasks.workunit.client.1.smithi195.stdout:8/35: rename c5 to d6/ca 0 2024-04-06T12:22:58.344 INFO:tasks.workunit.client.1.smithi195.stdout:9/61: mkdir d3/d1b 0 2024-04-06T12:22:58.346 INFO:tasks.workunit.client.1.smithi195.stdout:8/36: mkdir d6/db 0 2024-04-06T12:22:58.347 INFO:tasks.workunit.client.1.smithi195.stdout:9/62: rmdir d3/de 39 2024-04-06T12:22:58.348 INFO:tasks.workunit.client.1.smithi195.stdout:5/30: sync 2024-04-06T12:22:58.350 INFO:tasks.workunit.client.1.smithi195.stdout:8/37: write d6/f7 [499020,127570] 0 2024-04-06T12:22:58.351 INFO:tasks.workunit.client.1.smithi195.stdout:8/38: write d6/f7 [1344150,64641] 0 2024-04-06T12:22:58.352 INFO:tasks.workunit.client.1.smithi195.stdout:5/31: fdatasync d0/f4 0 2024-04-06T12:22:58.356 INFO:tasks.workunit.client.1.smithi195.stdout:9/63: creat d3/de/f1c x:0 0 0 2024-04-06T12:22:58.359 INFO:tasks.workunit.client.1.smithi195.stdout:5/32: mkdir d0/da 0 2024-04-06T12:22:58.363 INFO:tasks.workunit.client.1.smithi195.stdout:5/33: creat d0/da/fb x:0 0 0 2024-04-06T12:22:58.364 INFO:tasks.workunit.client.1.smithi195.stdout:9/64: rmdir d3/d1b 0 2024-04-06T12:22:58.367 INFO:tasks.workunit.client.1.smithi195.stdout:5/34: unlink d0/f4 0 2024-04-06T12:22:58.372 INFO:tasks.workunit.client.1.smithi195.stdout:5/35: unlink d0/f7 0 2024-04-06T12:22:58.751 INFO:tasks.workunit.client.1.smithi195.stdout:2/39: rename d2/f3 to d2/fb 0 2024-04-06T12:22:58.751 INFO:tasks.workunit.client.1.smithi195.stdout:4/50: write d4/f5 [1792028,69626] 0 2024-04-06T12:22:58.752 INFO:tasks.workunit.client.1.smithi195.stdout:7/11: fsync f0 0 2024-04-06T12:22:58.752 INFO:tasks.workunit.client.1.smithi195.stdout:7/12: fdatasync f0 0 2024-04-06T12:22:58.753 INFO:tasks.workunit.client.1.smithi195.stdout:2/40: chown d2/f5 432 1 2024-04-06T12:22:58.755 INFO:tasks.workunit.client.1.smithi195.stdout:4/51: rename f3 to d4/db/fe 0 2024-04-06T12:22:58.755 INFO:tasks.workunit.client.1.smithi195.stdout:6/74: truncate f5 817353 0 2024-04-06T12:22:58.758 INFO:tasks.workunit.client.1.smithi195.stdout:2/41: mkdir d2/dc 0 2024-04-06T12:22:58.761 INFO:tasks.workunit.client.1.smithi195.stdout:4/52: write d4/d6/f8 [293855,108832] 0 2024-04-06T12:22:58.762 INFO:tasks.workunit.client.1.smithi195.stdout:1/36: getdents d4 0 2024-04-06T12:22:58.763 INFO:tasks.workunit.client.1.smithi195.stdout:6/75: rmdir d8/d9 39 2024-04-06T12:22:58.766 INFO:tasks.workunit.client.1.smithi195.stdout:7/13: link f0 f1 0 2024-04-06T12:22:58.766 INFO:tasks.workunit.client.1.smithi195.stdout:7/14: stat f0 0 2024-04-06T12:22:58.770 INFO:tasks.workunit.client.1.smithi195.stdout:7/15: mknod c2 0 2024-04-06T12:22:58.771 INFO:tasks.workunit.client.1.smithi195.stdout:3/39: rmdir d4/d9 39 2024-04-06T12:22:58.772 INFO:tasks.workunit.client.1.smithi195.stdout:1/37: mkdir d4/db/dc 0 2024-04-06T12:22:58.777 INFO:tasks.workunit.client.1.smithi195.stdout:1/38: creat d4/db/fd x:0 0 0 2024-04-06T12:22:58.778 INFO:tasks.workunit.client.1.smithi195.stdout:1/39: dread - d4/db/fd zero size 2024-04-06T12:22:58.778 INFO:tasks.workunit.client.1.smithi195.stdout:1/40: chown l2 536845468 1 2024-04-06T12:22:58.786 INFO:tasks.workunit.client.1.smithi195.stdout:1/41: rename d4/l7 to d4/db/dc/le 0 2024-04-06T12:22:58.787 INFO:tasks.workunit.client.1.smithi195.stdout:0/48: truncate f0 1809810 0 2024-04-06T12:22:58.791 INFO:tasks.workunit.client.1.smithi195.stdout:0/49: symlink d4/d6/lc 0 2024-04-06T12:22:58.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/50: rename d4/d6/fb to d4/fd 0 2024-04-06T12:22:58.795 INFO:tasks.workunit.client.1.smithi195.stdout:8/39: write d6/f7 [4482418,61618] 0 2024-04-06T12:22:58.800 INFO:tasks.workunit.client.1.smithi195.stdout:0/51: chown f0 2677532 1 2024-04-06T12:22:58.800 INFO:tasks.workunit.client.1.smithi195.stdout:0/52: chown d4/f5 75 1 2024-04-06T12:22:58.809 INFO:tasks.workunit.client.1.smithi195.stdout:0/53: dwrite d4/fd [0,4194304] 0 2024-04-06T12:22:58.810 INFO:tasks.workunit.client.1.smithi195.stdout:0/54: dread - d4/d6/f8 zero size 2024-04-06T12:22:58.810 INFO:tasks.workunit.client.1.smithi195.stdout:5/36: rmdir d0/da 39 2024-04-06T12:22:58.811 INFO:tasks.workunit.client.1.smithi195.stdout:0/55: fsync d4/f9 0 2024-04-06T12:22:58.812 INFO:tasks.workunit.client.1.smithi195.stdout:0/56: write d4/f5 [4998516,15515] 0 2024-04-06T12:22:58.823 INFO:tasks.workunit.client.1.smithi195.stdout:5/37: creat d0/da/fc x:0 0 0 2024-04-06T12:22:58.829 INFO:tasks.workunit.client.1.smithi195.stdout:5/38: getdents d0 0 2024-04-06T12:22:58.830 INFO:tasks.workunit.client.1.smithi195.stdout:5/39: dread - d0/da/fb zero size 2024-04-06T12:22:58.831 INFO:tasks.workunit.client.1.smithi195.stdout:5/40: dread - d0/da/fb zero size 2024-04-06T12:22:58.831 INFO:tasks.workunit.client.1.smithi195.stdout:5/41: write d0/da/fb [344755,32983] 0 2024-04-06T12:22:58.834 INFO:tasks.workunit.client.1.smithi195.stdout:5/42: mkdir d0/da/dd 0 2024-04-06T12:22:58.835 INFO:tasks.workunit.client.1.smithi195.stdout:5/43: read d0/da/fb [147482,77953] 0 2024-04-06T12:22:58.838 INFO:tasks.workunit.client.1.smithi195.stdout:5/44: creat d0/fe x:0 0 0 2024-04-06T12:22:58.891 INFO:tasks.workunit.client.0.smithi152.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-06T12:22:58.907 INFO:tasks.workunit.client.1.smithi195.stdout:4/53: sync 2024-04-06T12:22:58.907 INFO:tasks.workunit.client.1.smithi195.stdout:6/76: sync 2024-04-06T12:22:58.908 INFO:tasks.workunit.client.1.smithi195.stdout:4/54: read - d4/db/fd zero size 2024-04-06T12:22:58.908 INFO:tasks.workunit.client.1.smithi195.stdout:4/55: chown d4/d6/f8 83 1 2024-04-06T12:22:58.912 INFO:tasks.workunit.client.1.smithi195.stdout:6/77: stat d8/d9/f11 0 2024-04-06T12:22:58.914 INFO:tasks.workunit.client.1.smithi195.stdout:4/56: unlink d4/d6/ca 0 2024-04-06T12:22:58.917 INFO:tasks.workunit.client.1.smithi195.stdout:4/57: rename d4/fc to d4/db/ff 0 2024-04-06T12:22:58.919 INFO:tasks.workunit.client.0.smithi152.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-06T12:22:58.919 INFO:tasks.workunit.client.0.smithi152.stderr:+ make 2024-04-06T12:22:58.920 INFO:tasks.workunit.client.1.smithi195.stdout:4/58: mknod d4/d6/c10 0 2024-04-06T12:22:58.922 INFO:tasks.workunit.client.1.smithi195.stdout:4/59: mkdir d4/db/d11 0 2024-04-06T12:22:58.923 INFO:tasks.workunit.client.1.smithi195.stdout:6/78: link d8/ca d8/c1c 0 2024-04-06T12:22:58.925 INFO:tasks.workunit.client.1.smithi195.stdout:6/79: symlink d8/d9/l1d 0 2024-04-06T12:22:58.945 INFO:tasks.workunit.client.1.smithi195.stdout:6/80: symlink d8/d9/l1e 0 2024-04-06T12:22:59.008 INFO:tasks.workunit.client.1.smithi195.stdout:6/81: sync 2024-04-06T12:22:59.020 INFO:tasks.workunit.client.1.smithi195.stdout:7/16: getdents . 0 2024-04-06T12:22:59.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:22:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:57.571158+0000 mgr.smithi195.ausetj (mgr.24375) 45 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 346 op/s 2024-04-06T12:22:59.026 INFO:tasks.workunit.client.1.smithi195.stdout:9/65: write f1 [1931651,100245] 0 2024-04-06T12:22:59.026 INFO:tasks.workunit.client.1.smithi195.stdout:9/66: chown d3 720 1 2024-04-06T12:22:59.027 INFO:tasks.workunit.client.1.smithi195.stdout:3/40: write d4/d9/fb [37,5348] 0 2024-04-06T12:22:59.030 INFO:tasks.workunit.client.1.smithi195.stdout:3/41: dread f2 [0,4194304] 0 2024-04-06T12:22:59.032 INFO:tasks.workunit.client.1.smithi195.stdout:3/42: truncate f0 1692859 0 2024-04-06T12:22:59.037 INFO:tasks.workunit.client.1.smithi195.stdout:8/40: truncate d6/f7 2439704 0 2024-04-06T12:22:59.038 INFO:tasks.workunit.client.1.smithi195.stdout:1/42: dwrite f3 [0,4194304] 0 2024-04-06T12:22:59.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:22:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:57.571158+0000 mgr.smithi195.ausetj (mgr.24375) 45 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 346 op/s 2024-04-06T12:22:59.054 INFO:tasks.workunit.client.1.smithi195.stdout:5/45: truncate d0/fe 374863 0 2024-04-06T12:22:59.117 INFO:tasks.workunit.client.0.smithi152.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-06T12:22:59.172 INFO:tasks.workunit.client.1.smithi195.stdout:0/57: dwrite f0 [0,4194304] 0 2024-04-06T12:22:59.205 INFO:tasks.workunit.client.1.smithi195.stdout:4/60: link d4/db/fe d4/f12 0 2024-04-06T12:22:59.208 INFO:tasks.workunit.client.1.smithi195.stdout:6/82: creat d8/d9/f1f x:0 0 0 2024-04-06T12:22:59.210 INFO:tasks.workunit.client.1.smithi195.stdout:7/17: symlink l3 0 2024-04-06T12:22:59.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/58: symlink d4/le 0 2024-04-06T12:22:59.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/59: chown f0 2 1 2024-04-06T12:22:59.218 INFO:tasks.workunit.client.1.smithi195.stdout:4/61: mknod d4/db/c13 0 2024-04-06T12:22:59.220 INFO:tasks.workunit.client.1.smithi195.stdout:7/18: mkdir d4 0 2024-04-06T12:22:59.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/83: dread d8/fc [0,4194304] 0 2024-04-06T12:22:59.222 INFO:tasks.workunit.client.1.smithi195.stdout:3/43: mkdir d4/de 0 2024-04-06T12:22:59.224 INFO:tasks.workunit.client.1.smithi195.stdout:3/44: write d4/f7 [3270902,118974] 0 2024-04-06T12:22:59.225 INFO:tasks.workunit.client.1.smithi195.stdout:0/60: dwrite d4/fd [0,4194304] 0 2024-04-06T12:22:59.225 INFO:tasks.workunit.client.1.smithi195.stdout:4/62: fdatasync d4/f5 0 2024-04-06T12:22:59.225 INFO:tasks.workunit.client.1.smithi195.stdout:3/45: stat d4/d9 0 2024-04-06T12:22:59.227 INFO:tasks.workunit.client.1.smithi195.stdout:3/46: stat d4/d9/fd 0 2024-04-06T12:22:59.227 INFO:tasks.workunit.client.1.smithi195.stdout:4/63: read d4/d6/f7 [152493,115387] 0 2024-04-06T12:22:59.228 INFO:tasks.workunit.client.1.smithi195.stdout:3/47: chown d4/d9/fb 88621 1 2024-04-06T12:22:59.231 INFO:tasks.workunit.client.1.smithi195.stdout:5/46: creat d0/ff x:0 0 0 2024-04-06T12:22:59.232 INFO:tasks.workunit.client.1.smithi195.stdout:6/84: mknod d8/d9/c20 0 2024-04-06T12:22:59.234 INFO:tasks.workunit.client.1.smithi195.stdout:9/67: getdents d3/de 0 2024-04-06T12:22:59.236 INFO:tasks.workunit.client.1.smithi195.stdout:7/19: mkdir d4/d5 0 2024-04-06T12:22:59.236 INFO:tasks.workunit.client.1.smithi195.stdout:7/20: stat f1 0 2024-04-06T12:22:59.237 INFO:tasks.workunit.client.1.smithi195.stdout:7/21: readlink l3 0 2024-04-06T12:22:59.237 INFO:tasks.workunit.client.1.smithi195.stdout:7/22: chown f0 8061966 1 2024-04-06T12:22:59.238 INFO:tasks.workunit.client.1.smithi195.stdout:0/61: rename d4/d6/lc to d4/d6/lf 0 2024-04-06T12:22:59.239 INFO:tasks.workunit.client.1.smithi195.stdout:1/43: getdents d4/db 0 2024-04-06T12:22:59.240 INFO:tasks.workunit.client.1.smithi195.stdout:6/85: dwrite d8/f15 [0,4194304] 0 2024-04-06T12:22:59.243 INFO:tasks.workunit.client.1.smithi195.stdout:5/47: chown d0/da/fb 206 1 2024-04-06T12:22:59.245 INFO:tasks.workunit.client.1.smithi195.stdout:9/68: mknod d3/d10/c1d 0 2024-04-06T12:22:59.248 INFO:tasks.workunit.client.1.smithi195.stdout:1/44: dread f3 [0,4194304] 0 2024-04-06T12:22:59.248 INFO:tasks.workunit.client.1.smithi195.stdout:0/62: dwrite d4/f5 [4194304,4194304] 0 2024-04-06T12:22:59.251 INFO:tasks.workunit.client.1.smithi195.stdout:3/48: mkdir d4/df 0 2024-04-06T12:22:59.252 INFO:tasks.workunit.client.1.smithi195.stdout:0/63: write d4/fd [826059,127926] 0 2024-04-06T12:22:59.259 INFO:tasks.workunit.client.1.smithi195.stdout:9/69: dwrite d3/f5 [0,4194304] 0 2024-04-06T12:22:59.260 INFO:tasks.workunit.client.1.smithi195.stdout:7/23: symlink d4/d5/l6 0 2024-04-06T12:22:59.264 INFO:tasks.workunit.client.1.smithi195.stdout:3/49: dread d4/d9/fb [0,4194304] 0 2024-04-06T12:22:59.264 INFO:tasks.workunit.client.1.smithi195.stdout:0/64: creat d4/d6/f10 x:0 0 0 2024-04-06T12:22:59.265 INFO:tasks.workunit.client.1.smithi195.stdout:3/50: chown d4/c6 497 1 2024-04-06T12:22:59.265 INFO:tasks.workunit.client.1.smithi195.stdout:3/51: fsync d4/f7 0 2024-04-06T12:22:59.266 INFO:tasks.workunit.client.1.smithi195.stdout:7/24: creat d4/f7 x:0 0 0 2024-04-06T12:22:59.267 INFO:tasks.workunit.client.1.smithi195.stdout:9/70: symlink d3/de/l1e 0 2024-04-06T12:22:59.269 INFO:tasks.workunit.client.1.smithi195.stdout:9/71: dread d3/f9 [0,4194304] 0 2024-04-06T12:22:59.270 INFO:tasks.workunit.client.1.smithi195.stdout:5/48: creat d0/f10 x:0 0 0 2024-04-06T12:22:59.271 INFO:tasks.workunit.client.1.smithi195.stdout:0/65: creat d4/d6/f11 x:0 0 0 2024-04-06T12:22:59.275 INFO:tasks.workunit.client.1.smithi195.stdout:0/66: dread d4/f9 [0,4194304] 0 2024-04-06T12:22:59.276 INFO:tasks.workunit.client.1.smithi195.stdout:7/25: mknod d4/c8 0 2024-04-06T12:22:59.276 INFO:tasks.workunit.client.1.smithi195.stdout:7/26: truncate f0 666430 0 2024-04-06T12:22:59.278 INFO:tasks.workunit.client.1.smithi195.stdout:1/45: getdents d4/db 0 2024-04-06T12:22:59.278 INFO:tasks.workunit.client.1.smithi195.stdout:1/46: write f1 [1196749,3429] 0 2024-04-06T12:22:59.282 INFO:tasks.workunit.client.1.smithi195.stdout:0/67: symlink d4/l12 0 2024-04-06T12:22:59.283 INFO:tasks.workunit.client.1.smithi195.stdout:3/52: symlink d4/de/l10 0 2024-04-06T12:22:59.283 INFO:tasks.workunit.client.1.smithi195.stdout:3/53: chown f0 28 1 2024-04-06T12:22:59.284 INFO:tasks.workunit.client.1.smithi195.stdout:7/27: mknod d4/c9 0 2024-04-06T12:22:59.288 INFO:tasks.workunit.client.1.smithi195.stdout:1/47: mkdir d4/db/df 0 2024-04-06T12:22:59.293 INFO:tasks.workunit.client.1.smithi195.stdout:3/54: fsync f0 0 2024-04-06T12:22:59.297 INFO:tasks.workunit.client.1.smithi195.stdout:5/49: creat d0/f11 x:0 0 0 2024-04-06T12:22:59.299 INFO:tasks.workunit.client.1.smithi195.stdout:3/55: dwrite d4/f7 [0,4194304] 0 2024-04-06T12:22:59.302 INFO:tasks.workunit.client.1.smithi195.stdout:5/50: symlink d0/da/l12 0 2024-04-06T12:22:59.303 INFO:tasks.workunit.client.1.smithi195.stdout:0/68: link c3 d4/c13 0 2024-04-06T12:22:59.304 INFO:tasks.workunit.client.1.smithi195.stdout:0/69: truncate d4/d6/f10 216154 0 2024-04-06T12:22:59.304 INFO:tasks.workunit.client.1.smithi195.stdout:0/70: stat d4/d6/c7 0 2024-04-06T12:22:59.304 INFO:tasks.workunit.client.1.smithi195.stdout:1/48: rmdir d4/db/df 0 2024-04-06T12:22:59.305 INFO:tasks.workunit.client.1.smithi195.stdout:1/49: fsync f1 0 2024-04-06T12:22:59.305 INFO:tasks.workunit.client.1.smithi195.stdout:1/50: read - d4/f8 zero size 2024-04-06T12:22:59.309 INFO:tasks.workunit.client.1.smithi195.stdout:5/51: mkdir d0/da/d13 0 2024-04-06T12:22:59.310 INFO:tasks.workunit.client.1.smithi195.stdout:5/52: dread - d0/f11 zero size 2024-04-06T12:22:59.311 INFO:tasks.workunit.client.1.smithi195.stdout:0/71: dwrite d4/d6/f11 [0,4194304] 0 2024-04-06T12:22:59.313 INFO:tasks.workunit.client.1.smithi195.stdout:1/51: rmdir d4/db/dc 39 2024-04-06T12:22:59.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/53: fsync d0/f3 0 2024-04-06T12:22:59.318 INFO:tasks.workunit.client.1.smithi195.stdout:0/72: unlink d4/d6/c7 0 2024-04-06T12:22:59.319 INFO:tasks.workunit.client.1.smithi195.stdout:1/52: rmdir d4 39 2024-04-06T12:22:59.321 INFO:tasks.workunit.client.1.smithi195.stdout:0/73: creat d4/f14 x:0 0 0 2024-04-06T12:22:59.322 INFO:tasks.workunit.client.1.smithi195.stdout:0/74: write d4/d6/f8 [932589,110129] 0 2024-04-06T12:22:59.323 INFO:tasks.workunit.client.1.smithi195.stdout:0/75: chown d4/ca 84849 1 2024-04-06T12:22:59.326 INFO:tasks.workunit.client.1.smithi195.stdout:5/54: creat d0/f14 x:0 0 0 2024-04-06T12:22:59.331 INFO:tasks.workunit.client.1.smithi195.stdout:8/41: fsync d6/f7 0 2024-04-06T12:22:59.333 INFO:tasks.workunit.client.1.smithi195.stdout:1/53: dwrite f3 [0,4194304] 0 2024-04-06T12:22:59.335 INFO:tasks.workunit.client.1.smithi195.stdout:5/55: link d0/f11 d0/da/d13/f15 0 2024-04-06T12:22:59.335 INFO:tasks.workunit.client.1.smithi195.stdout:0/76: dwrite d4/d6/f8 [0,4194304] 0 2024-04-06T12:22:59.352 INFO:tasks.workunit.client.1.smithi195.stdout:5/56: dwrite d0/f3 [0,4194304] 0 2024-04-06T12:22:59.353 INFO:tasks.workunit.client.1.smithi195.stdout:0/77: dwrite f0 [0,4194304] 0 2024-04-06T12:22:59.355 INFO:tasks.workunit.client.1.smithi195.stdout:1/54: dwrite d4/db/fd [0,4194304] 0 2024-04-06T12:22:59.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/78: dwrite d4/d6/f8 [0,4194304] 0 2024-04-06T12:22:59.367 INFO:tasks.workunit.client.1.smithi195.stdout:0/79: write d4/d6/f10 [598676,67887] 0 2024-04-06T12:22:59.368 INFO:tasks.workunit.client.1.smithi195.stdout:0/80: readlink d4/le 0 2024-04-06T12:22:59.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/81: chown d4/d6 530 1 2024-04-06T12:22:59.392 INFO:tasks.workunit.client.1.smithi195.stdout:0/82: unlink d4/d6/f11 0 2024-04-06T12:22:59.392 INFO:tasks.workunit.client.1.smithi195.stdout:4/64: getdents d4/db 0 2024-04-06T12:22:59.393 INFO:tasks.workunit.client.1.smithi195.stdout:4/65: chown d4/f12 254 1 2024-04-06T12:22:59.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/66: rename d4/d6 to d4/d6/d14 22 2024-04-06T12:22:59.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/67: dread - d4/db/ff zero size 2024-04-06T12:22:59.396 INFO:tasks.workunit.client.1.smithi195.stdout:1/55: creat d4/db/dc/f10 x:0 0 0 2024-04-06T12:22:59.398 INFO:tasks.workunit.client.1.smithi195.stdout:4/68: write d4/f5 [756861,86413] 0 2024-04-06T12:22:59.398 INFO:tasks.workunit.client.1.smithi195.stdout:0/83: mknod d4/c15 0 2024-04-06T12:22:59.399 INFO:tasks.workunit.client.1.smithi195.stdout:0/84: fdatasync d4/fd 0 2024-04-06T12:22:59.400 INFO:tasks.workunit.client.1.smithi195.stdout:5/57: link d0/f6 d0/da/d13/f16 0 2024-04-06T12:22:59.405 INFO:tasks.workunit.client.1.smithi195.stdout:1/56: rename d4/f8 to d4/f11 0 2024-04-06T12:22:59.406 INFO:tasks.workunit.client.1.smithi195.stdout:4/69: creat d4/db/f15 x:0 0 0 2024-04-06T12:22:59.411 INFO:tasks.workunit.client.1.smithi195.stdout:4/70: dwrite d4/f5 [0,4194304] 0 2024-04-06T12:22:59.412 INFO:tasks.workunit.client.1.smithi195.stdout:4/71: dread - d4/db/f15 zero size 2024-04-06T12:22:59.413 INFO:tasks.workunit.client.1.smithi195.stdout:5/58: symlink d0/da/dd/l17 0 2024-04-06T12:22:59.416 INFO:tasks.workunit.client.1.smithi195.stdout:1/57: link f1 d4/f12 0 2024-04-06T12:22:59.416 INFO:tasks.workunit.client.1.smithi195.stdout:3/56: truncate d4/d9/fa 1579692 0 2024-04-06T12:22:59.419 INFO:tasks.workunit.client.1.smithi195.stdout:1/58: truncate d4/db/dc/f10 966823 0 2024-04-06T12:22:59.419 INFO:tasks.workunit.client.1.smithi195.stdout:8/42: sync 2024-04-06T12:22:59.420 INFO:tasks.workunit.client.1.smithi195.stdout:5/59: unlink d0/da/d13/f16 0 2024-04-06T12:22:59.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/57: symlink d4/d9/l11 0 2024-04-06T12:22:59.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/59: mknod d4/c13 0 2024-04-06T12:22:59.428 INFO:tasks.workunit.client.1.smithi195.stdout:5/60: rename d0/f14 to d0/da/dd/f18 0 2024-04-06T12:22:59.435 INFO:tasks.workunit.client.1.smithi195.stdout:5/61: symlink d0/da/d13/l19 0 2024-04-06T12:22:59.437 INFO:tasks.workunit.client.1.smithi195.stdout:9/72: truncate d3/f5 3610360 0 2024-04-06T12:22:59.438 INFO:tasks.workunit.client.1.smithi195.stdout:7/28: write f1 [153635,33091] 0 2024-04-06T12:22:59.439 INFO:tasks.workunit.client.1.smithi195.stdout:7/29: write f0 [411698,123093] 0 2024-04-06T12:22:59.439 INFO:tasks.workunit.client.1.smithi195.stdout:7/30: write d4/f7 [83107,30766] 0 2024-04-06T12:22:59.440 INFO:tasks.workunit.client.1.smithi195.stdout:7/31: chown d4/d5 8344136 1 2024-04-06T12:22:59.440 INFO:tasks.workunit.client.1.smithi195.stdout:5/62: mknod d0/da/d13/c1a 0 2024-04-06T12:22:59.441 INFO:tasks.workunit.client.1.smithi195.stdout:5/63: fdatasync d0/fe 0 2024-04-06T12:22:59.441 INFO:tasks.workunit.client.1.smithi195.stdout:5/64: chown d0/da/l12 16479722 1 2024-04-06T12:22:59.442 INFO:tasks.workunit.client.1.smithi195.stdout:5/65: truncate d0/f11 853369 0 2024-04-06T12:22:59.443 INFO:tasks.workunit.client.1.smithi195.stdout:3/58: creat d4/f12 x:0 0 0 2024-04-06T12:22:59.444 INFO:tasks.workunit.client.1.smithi195.stdout:3/59: fdatasync f3 0 2024-04-06T12:22:59.444 INFO:tasks.workunit.client.1.smithi195.stdout:3/60: dread - d4/d9/fd zero size 2024-04-06T12:22:59.452 INFO:tasks.workunit.client.1.smithi195.stdout:9/73: dwrite d3/de/f14 [0,4194304] 0 2024-04-06T12:22:59.455 INFO:tasks.workunit.client.1.smithi195.stdout:7/32: rename l3 to d4/la 0 2024-04-06T12:22:59.457 INFO:tasks.workunit.client.1.smithi195.stdout:5/66: rmdir d0/da/dd 39 2024-04-06T12:22:59.457 INFO:tasks.workunit.client.1.smithi195.stdout:5/67: stat d0/da/l12 0 2024-04-06T12:22:59.459 INFO:tasks.workunit.client.1.smithi195.stdout:3/61: mknod d4/de/c13 0 2024-04-06T12:22:59.459 INFO:tasks.workunit.client.1.smithi195.stdout:3/62: chown d4/l5 29953 1 2024-04-06T12:22:59.459 INFO:tasks.workunit.client.1.smithi195.stdout:3/63: fsync f3 0 2024-04-06T12:22:59.471 INFO:tasks.workunit.client.1.smithi195.stdout:9/74: creat d3/de/f1f x:0 0 0 2024-04-06T12:22:59.473 INFO:tasks.workunit.client.1.smithi195.stdout:7/33: symlink d4/lb 0 2024-04-06T12:22:59.478 INFO:tasks.workunit.client.1.smithi195.stdout:3/64: mknod d4/de/c14 0 2024-04-06T12:22:59.480 INFO:tasks.workunit.client.1.smithi195.stdout:7/34: dwrite f1 [0,4194304] 0 2024-04-06T12:22:59.480 INFO:tasks.workunit.client.1.smithi195.stdout:7/35: chown d4/lb 50463 1 2024-04-06T12:22:59.482 INFO:tasks.workunit.client.1.smithi195.stdout:9/75: chown d3/d10/l19 60 1 2024-04-06T12:22:59.489 INFO:tasks.workunit.client.1.smithi195.stdout:5/68: symlink d0/da/l1b 0 2024-04-06T12:22:59.490 INFO:tasks.workunit.client.1.smithi195.stdout:4/72: sync 2024-04-06T12:22:59.493 INFO:tasks.workunit.client.1.smithi195.stdout:7/36: symlink d4/d5/lc 0 2024-04-06T12:22:59.498 INFO:tasks.workunit.client.1.smithi195.stdout:9/76: unlink d3/cb 0 2024-04-06T12:22:59.503 INFO:tasks.workunit.client.1.smithi195.stdout:3/65: symlink d4/l15 0 2024-04-06T12:22:59.508 INFO:tasks.workunit.client.1.smithi195.stdout:7/37: mkdir d4/d5/dd 0 2024-04-06T12:22:59.513 INFO:tasks.workunit.client.1.smithi195.stdout:5/69: mkdir d0/da/dd/d1c 0 2024-04-06T12:22:59.524 INFO:tasks.workunit.client.1.smithi195.stdout:4/73: creat d4/f16 x:0 0 0 2024-04-06T12:22:59.525 INFO:tasks.workunit.client.1.smithi195.stdout:7/38: getdents d4/d5/dd 0 2024-04-06T12:22:59.528 INFO:tasks.workunit.client.1.smithi195.stdout:0/85: getdents d4/d6 0 2024-04-06T12:22:59.529 INFO:tasks.workunit.client.1.smithi195.stdout:6/86: write f5 [1217048,70708] 0 2024-04-06T12:22:59.530 INFO:tasks.workunit.client.1.smithi195.stdout:2/42: dwrite d2/fb [0,4194304] 0 2024-04-06T12:22:59.531 INFO:tasks.workunit.client.1.smithi195.stdout:1/60: rename d4/db to d4/d14 0 2024-04-06T12:22:59.532 INFO:tasks.workunit.client.1.smithi195.stdout:2/43: read d2/f5 [1430302,2782] 0 2024-04-06T12:22:59.533 INFO:tasks.workunit.client.1.smithi195.stdout:4/74: dread d4/f5 [0,4194304] 0 2024-04-06T12:22:59.535 INFO:tasks.workunit.client.1.smithi195.stdout:6/87: dread d8/d9/fe [0,4194304] 0 2024-04-06T12:22:59.543 INFO:tasks.workunit.client.1.smithi195.stdout:5/70: rename d0/da/l12 to d0/l1d 0 2024-04-06T12:22:59.544 INFO:tasks.workunit.client.1.smithi195.stdout:5/71: write d0/f10 [32551,29718] 0 2024-04-06T12:22:59.547 INFO:tasks.workunit.client.1.smithi195.stdout:0/86: symlink d4/d6/l16 0 2024-04-06T12:22:59.551 INFO:tasks.workunit.client.1.smithi195.stdout:2/44: fsync d2/fb 0 2024-04-06T12:22:59.554 INFO:tasks.workunit.client.1.smithi195.stdout:5/72: dwrite d0/f10 [0,4194304] 0 2024-04-06T12:22:59.557 INFO:tasks.workunit.client.1.smithi195.stdout:0/87: dwrite d4/d6/f8 [0,4194304] 0 2024-04-06T12:22:59.566 INFO:tasks.workunit.client.1.smithi195.stdout:3/66: sync 2024-04-06T12:22:59.568 INFO:tasks.workunit.client.1.smithi195.stdout:0/88: dwrite d4/d6/f8 [0,4194304] 0 2024-04-06T12:22:59.571 INFO:tasks.workunit.client.1.smithi195.stdout:0/89: write d4/fd [2456417,10483] 0 2024-04-06T12:22:59.572 INFO:tasks.workunit.client.1.smithi195.stdout:0/90: chown d4/d6/lf 1572356 1 2024-04-06T12:22:59.574 INFO:tasks.workunit.client.1.smithi195.stdout:6/88: dwrite d8/f19 [0,4194304] 0 2024-04-06T12:22:59.577 INFO:tasks.workunit.client.1.smithi195.stdout:8/43: dread d6/f7 [0,4194304] 0 2024-04-06T12:22:59.581 INFO:tasks.workunit.client.1.smithi195.stdout:2/45: symlink d2/ld 0 2024-04-06T12:22:59.588 INFO:tasks.workunit.client.1.smithi195.stdout:4/75: mknod d4/c17 0 2024-04-06T12:22:59.597 INFO:tasks.workunit.client.1.smithi195.stdout:0/91: mknod d4/d6/c17 0 2024-04-06T12:22:59.602 INFO:tasks.workunit.client.1.smithi195.stdout:0/92: dwrite d4/fd [0,4194304] 0 2024-04-06T12:22:59.604 INFO:tasks.workunit.client.1.smithi195.stdout:1/61: creat d4/d14/f15 x:0 0 0 2024-04-06T12:22:59.606 INFO:tasks.workunit.client.1.smithi195.stdout:5/73: mknod d0/da/dd/d1c/c1e 0 2024-04-06T12:22:59.609 INFO:tasks.workunit.client.1.smithi195.stdout:4/76: rmdir d4/d6 39 2024-04-06T12:22:59.611 INFO:tasks.workunit.client.1.smithi195.stdout:1/62: dwrite d4/d14/dc/f10 [0,4194304] 0 2024-04-06T12:22:59.613 INFO:tasks.workunit.client.1.smithi195.stdout:9/77: getdents d3 0 2024-04-06T12:22:59.616 INFO:tasks.workunit.client.1.smithi195.stdout:6/89: mkdir d8/d21 0 2024-04-06T12:22:59.617 INFO:tasks.workunit.client.1.smithi195.stdout:6/90: chown d8/d9/f1f 28982632 1 2024-04-06T12:22:59.619 INFO:tasks.workunit.client.1.smithi195.stdout:8/44: symlink d6/db/lc 0 2024-04-06T12:22:59.625 INFO:tasks.workunit.client.1.smithi195.stdout:0/93: creat d4/d6/f18 x:0 0 0 2024-04-06T12:22:59.626 INFO:tasks.workunit.client.1.smithi195.stdout:0/94: write f0 [2171709,15013] 0 2024-04-06T12:22:59.626 INFO:tasks.workunit.client.1.smithi195.stdout:0/95: stat d4/d6/lf 0 2024-04-06T12:22:59.629 INFO:tasks.workunit.client.1.smithi195.stdout:5/74: creat d0/da/d13/f1f x:0 0 0 2024-04-06T12:22:59.634 INFO:tasks.workunit.client.1.smithi195.stdout:3/67: creat d4/f16 x:0 0 0 2024-04-06T12:22:59.639 INFO:tasks.workunit.client.1.smithi195.stdout:9/78: unlink d3/de/f1f 0 2024-04-06T12:22:59.645 INFO:tasks.workunit.client.1.smithi195.stdout:2/46: rmdir d2/dc 0 2024-04-06T12:22:59.650 INFO:tasks.workunit.client.1.smithi195.stdout:0/96: mknod d4/d6/c19 0 2024-04-06T12:22:59.651 INFO:tasks.workunit.client.1.smithi195.stdout:5/75: creat d0/da/dd/d1c/f20 x:0 0 0 2024-04-06T12:22:59.659 INFO:tasks.workunit.client.1.smithi195.stdout:6/91: mknod d8/d21/c22 0 2024-04-06T12:22:59.663 INFO:tasks.workunit.client.1.smithi195.stdout:2/47: creat d2/fe x:0 0 0 2024-04-06T12:22:59.663 INFO:tasks.workunit.client.1.smithi195.stdout:7/39: truncate f1 3818834 0 2024-04-06T12:22:59.664 INFO:tasks.workunit.client.1.smithi195.stdout:0/97: mkdir d4/d6/d1a 0 2024-04-06T12:22:59.666 INFO:tasks.workunit.client.1.smithi195.stdout:2/48: dread d2/fb [0,4194304] 0 2024-04-06T12:22:59.668 INFO:tasks.workunit.client.1.smithi195.stdout:4/77: rmdir d4/db/d11 0 2024-04-06T12:22:59.681 INFO:tasks.workunit.client.1.smithi195.stdout:3/68: rename d4/de/l10 to d4/l17 0 2024-04-06T12:22:59.684 INFO:tasks.workunit.client.1.smithi195.stdout:8/45: getdents d6/d8 0 2024-04-06T12:22:59.689 INFO:tasks.workunit.client.1.smithi195.stdout:5/76: creat d0/da/f21 x:0 0 0 2024-04-06T12:22:59.693 INFO:tasks.workunit.client.1.smithi195.stdout:9/79: rename d3/c6 to d3/d10/c20 0 2024-04-06T12:22:59.693 INFO:tasks.workunit.client.1.smithi195.stdout:2/49: rename d2 to d2/df 22 2024-04-06T12:22:59.694 INFO:tasks.workunit.client.1.smithi195.stdout:2/50: stat d2/la 0 2024-04-06T12:22:59.695 INFO:tasks.workunit.client.1.smithi195.stdout:3/69: chown d4/d9/fa 1 1 2024-04-06T12:22:59.695 INFO:tasks.workunit.client.1.smithi195.stdout:5/77: dwrite d0/f10 [0,4194304] 0 2024-04-06T12:22:59.697 INFO:tasks.workunit.client.1.smithi195.stdout:6/92: creat d8/f23 x:0 0 0 2024-04-06T12:22:59.698 INFO:tasks.workunit.client.1.smithi195.stdout:8/46: mkdir d6/dd 0 2024-04-06T12:22:59.704 INFO:tasks.workunit.client.1.smithi195.stdout:6/93: dwrite d8/ff [0,4194304] 0 2024-04-06T12:22:59.710 INFO:tasks.workunit.client.1.smithi195.stdout:3/70: creat d4/d9/f18 x:0 0 0 2024-04-06T12:22:59.717 INFO:tasks.workunit.client.1.smithi195.stdout:4/78: getdents d4 0 2024-04-06T12:22:59.719 INFO:tasks.workunit.client.1.smithi195.stdout:6/94: mkdir d8/d21/d24 0 2024-04-06T12:22:59.721 INFO:tasks.workunit.client.1.smithi195.stdout:6/95: write d8/d9/f11 [4884111,106736] 0 2024-04-06T12:22:59.726 INFO:tasks.workunit.client.1.smithi195.stdout:2/51: truncate d2/fb 607791 0 2024-04-06T12:22:59.726 INFO:tasks.workunit.client.1.smithi195.stdout:1/63: dwrite f1 [0,4194304] 0 2024-04-06T12:22:59.727 INFO:tasks.workunit.client.1.smithi195.stdout:3/71: truncate d4/d9/fa 189367 0 2024-04-06T12:22:59.729 INFO:tasks.workunit.client.1.smithi195.stdout:1/64: dread d4/f12 [0,4194304] 0 2024-04-06T12:22:59.729 INFO:tasks.workunit.client.1.smithi195.stdout:1/65: chown l0 0 1 2024-04-06T12:22:59.731 INFO:tasks.workunit.client.1.smithi195.stdout:4/79: mkdir d4/db/d18 0 2024-04-06T12:22:59.738 INFO:tasks.workunit.client.1.smithi195.stdout:6/96: unlink d8/d9/lb 0 2024-04-06T12:22:59.743 INFO:tasks.workunit.client.1.smithi195.stdout:3/72: symlink d4/de/l19 0 2024-04-06T12:22:59.747 INFO:tasks.workunit.client.1.smithi195.stdout:7/40: dread f0 [0,4194304] 0 2024-04-06T12:22:59.748 INFO:tasks.workunit.client.1.smithi195.stdout:7/41: fsync d4/f7 0 2024-04-06T12:22:59.749 INFO:tasks.workunit.client.1.smithi195.stdout:4/80: rename d4/db/c13 to d4/c19 0 2024-04-06T12:22:59.752 INFO:tasks.workunit.client.1.smithi195.stdout:6/97: unlink d8/ff 0 2024-04-06T12:22:59.753 INFO:tasks.workunit.client.1.smithi195.stdout:0/98: sync 2024-04-06T12:22:59.754 INFO:tasks.workunit.client.1.smithi195.stdout:0/99: readlink d4/d6/l16 0 2024-04-06T12:22:59.754 INFO:tasks.workunit.client.1.smithi195.stdout:0/100: chown d4/fd 3850069 1 2024-04-06T12:22:59.756 INFO:tasks.workunit.client.1.smithi195.stdout:3/73: symlink d4/d9/l1a 0 2024-04-06T12:22:59.758 INFO:tasks.workunit.client.1.smithi195.stdout:8/47: getdents d6/db 0 2024-04-06T12:22:59.760 INFO:tasks.workunit.client.1.smithi195.stdout:1/66: mknod d4/d14/c16 0 2024-04-06T12:22:59.765 INFO:tasks.workunit.client.1.smithi195.stdout:7/42: creat d4/d5/fe x:0 0 0 2024-04-06T12:22:59.768 INFO:tasks.workunit.client.1.smithi195.stdout:7/43: dread f0 [0,4194304] 0 2024-04-06T12:22:59.769 INFO:tasks.workunit.client.1.smithi195.stdout:7/44: truncate d4/d5/fe 23110 0 2024-04-06T12:22:59.771 INFO:tasks.workunit.client.1.smithi195.stdout:6/98: rename d8/d21/c22 to d8/d21/c25 0 2024-04-06T12:22:59.772 INFO:tasks.workunit.client.1.smithi195.stdout:6/99: chown d8/d9/l13 2727 1 2024-04-06T12:22:59.778 INFO:tasks.workunit.client.1.smithi195.stdout:8/48: creat d6/d8/fe x:0 0 0 2024-04-06T12:22:59.778 INFO:tasks.workunit.client.1.smithi195.stdout:8/49: fdatasync d6/f7 0 2024-04-06T12:22:59.782 INFO:tasks.workunit.client.1.smithi195.stdout:9/80: dread - d3/d10/f11 zero size 2024-04-06T12:22:59.783 INFO:tasks.workunit.client.1.smithi195.stdout:5/78: sync 2024-04-06T12:22:59.784 INFO:tasks.workunit.client.1.smithi195.stdout:5/79: fdatasync d0/da/f21 0 2024-04-06T12:22:59.786 INFO:tasks.workunit.client.1.smithi195.stdout:7/45: creat d4/d5/ff x:0 0 0 2024-04-06T12:22:59.787 INFO:tasks.workunit.client.1.smithi195.stdout:7/46: readlink d4/d5/lc 0 2024-04-06T12:22:59.789 INFO:tasks.workunit.client.1.smithi195.stdout:2/52: getdents d2 0 2024-04-06T12:22:59.792 INFO:tasks.workunit.client.1.smithi195.stdout:6/100: mkdir d8/d9/d26 0 2024-04-06T12:22:59.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/101: creat d4/d6/d1a/f1b x:0 0 0 2024-04-06T12:22:59.797 INFO:tasks.workunit.client.1.smithi195.stdout:3/74: creat d4/df/f1b x:0 0 0 2024-04-06T12:22:59.798 INFO:tasks.workunit.client.1.smithi195.stdout:6/101: dwrite d8/f23 [0,4194304] 0 2024-04-06T12:22:59.799 INFO:tasks.workunit.client.1.smithi195.stdout:8/50: creat d6/d8/ff x:0 0 0 2024-04-06T12:22:59.805 INFO:tasks.workunit.client.1.smithi195.stdout:8/51: dwrite d6/d8/fe [0,4194304] 0 2024-04-06T12:22:59.807 INFO:tasks.workunit.client.1.smithi195.stdout:8/52: write d6/f7 [223549,97911] 0 2024-04-06T12:22:59.807 INFO:tasks.workunit.client.1.smithi195.stdout:8/53: chown d6/dd 3038342 1 2024-04-06T12:22:59.814 INFO:tasks.workunit.client.1.smithi195.stdout:7/47: fdatasync f0 0 2024-04-06T12:22:59.824 INFO:tasks.workunit.client.1.smithi195.stdout:1/67: rename d4/d14/dc to d4/d14/d17 0 2024-04-06T12:22:59.827 INFO:tasks.workunit.client.1.smithi195.stdout:9/81: rename d3/d10/f16 to d3/de/f21 0 2024-04-06T12:22:59.833 INFO:tasks.workunit.client.1.smithi195.stdout:2/53: dread d2/fb [0,4194304] 0 2024-04-06T12:22:59.834 INFO:tasks.workunit.client.1.smithi195.stdout:7/48: mkdir d4/d10 0 2024-04-06T12:22:59.838 INFO:tasks.workunit.client.1.smithi195.stdout:6/102: mkdir d8/d21/d24/d27 0 2024-04-06T12:22:59.838 INFO:tasks.workunit.client.1.smithi195.stdout:6/103: dread - d8/f14 zero size 2024-04-06T12:22:59.840 INFO:tasks.workunit.client.1.smithi195.stdout:1/68: write d4/f12 [3818872,70020] 0 2024-04-06T12:22:59.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/82: rmdir d3 39 2024-04-06T12:22:59.844 INFO:tasks.workunit.client.1.smithi195.stdout:5/80: creat d0/da/f22 x:0 0 0 2024-04-06T12:22:59.846 INFO:tasks.workunit.client.1.smithi195.stdout:2/54: rename d2/l9 to d2/l10 0 2024-04-06T12:22:59.847 INFO:tasks.workunit.client.1.smithi195.stdout:0/102: rmdir d4/d6/d1a 39 2024-04-06T12:22:59.849 INFO:tasks.workunit.client.1.smithi195.stdout:7/49: mkdir d4/d5/d11 0 2024-04-06T12:22:59.850 INFO:tasks.workunit.client.1.smithi195.stdout:4/81: mkdir d4/db/d18/d1a 0 2024-04-06T12:22:59.850 INFO:tasks.workunit.client.1.smithi195.stdout:8/54: fsync d6/d8/ff 0 2024-04-06T12:22:59.852 INFO:tasks.workunit.client.1.smithi195.stdout:4/82: dread - d4/db/ff zero size 2024-04-06T12:22:59.852 INFO:tasks.workunit.client.1.smithi195.stdout:5/81: dwrite d0/da/dd/d1c/f20 [0,4194304] 0 2024-04-06T12:22:59.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/82: fdatasync d0/da/d13/f1f 0 2024-04-06T12:22:59.854 INFO:tasks.workunit.client.1.smithi195.stdout:2/55: dread d2/f4 [0,4194304] 0 2024-04-06T12:22:59.855 INFO:tasks.workunit.client.1.smithi195.stdout:5/83: stat d0/da/d13 0 2024-04-06T12:22:59.856 INFO:tasks.workunit.client.1.smithi195.stdout:3/75: fdatasync f0 0 2024-04-06T12:22:59.857 INFO:tasks.workunit.client.1.smithi195.stdout:8/55: dread d6/d8/fe [0,4194304] 0 2024-04-06T12:22:59.863 INFO:tasks.workunit.client.1.smithi195.stdout:5/84: dwrite d0/fe [0,4194304] 0 2024-04-06T12:22:59.872 INFO:tasks.workunit.client.1.smithi195.stdout:6/104: symlink d8/d9/d26/l28 0 2024-04-06T12:22:59.877 INFO:tasks.workunit.client.1.smithi195.stdout:4/83: rmdir d4 39 2024-04-06T12:22:59.880 INFO:tasks.workunit.client.1.smithi195.stdout:2/56: rmdir d2 39 2024-04-06T12:22:59.882 INFO:tasks.workunit.client.1.smithi195.stdout:3/76: unlink d4/de/c13 0 2024-04-06T12:22:59.888 INFO:tasks.workunit.client.1.smithi195.stdout:3/77: dwrite f3 [0,4194304] 0 2024-04-06T12:22:59.889 INFO:tasks.workunit.client.1.smithi195.stdout:3/78: dread - d4/d9/f18 zero size 2024-04-06T12:22:59.890 INFO:tasks.workunit.client.1.smithi195.stdout:3/79: readlink d4/l15 0 2024-04-06T12:22:59.890 INFO:tasks.workunit.client.1.smithi195.stdout:3/80: chown d4/f12 2592 1 2024-04-06T12:22:59.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/103: symlink d4/d6/d1a/l1c 0 2024-04-06T12:22:59.893 INFO:tasks.workunit.client.1.smithi195.stdout:7/50: mkdir d4/d10/d12 0 2024-04-06T12:22:59.894 INFO:tasks.workunit.client.1.smithi195.stdout:7/51: write f0 [1141720,84174] 0 2024-04-06T12:22:59.900 INFO:tasks.workunit.client.1.smithi195.stdout:1/69: creat d4/d14/f18 x:0 0 0 2024-04-06T12:22:59.908 INFO:tasks.workunit.client.1.smithi195.stdout:1/70: dwrite d4/d14/f15 [0,4194304] 0 2024-04-06T12:22:59.908 INFO:tasks.workunit.client.1.smithi195.stdout:8/56: unlink d6/d8/fe 0 2024-04-06T12:22:59.912 INFO:tasks.workunit.client.1.smithi195.stdout:5/85: mkdir d0/da/d23 0 2024-04-06T12:22:59.913 INFO:tasks.workunit.client.1.smithi195.stdout:3/81: mknod d4/de/c1c 0 2024-04-06T12:22:59.914 INFO:tasks.workunit.client.1.smithi195.stdout:5/86: write d0/f3 [976916,116962] 0 2024-04-06T12:22:59.916 INFO:tasks.workunit.client.1.smithi195.stdout:3/82: write d4/d9/fb [788795,3721] 0 2024-04-06T12:22:59.917 INFO:tasks.workunit.client.1.smithi195.stdout:8/57: dwrite d6/d8/ff [0,4194304] 0 2024-04-06T12:22:59.917 INFO:tasks.workunit.client.1.smithi195.stdout:4/84: fsync d4/f16 0 2024-04-06T12:22:59.920 INFO:tasks.workunit.client.1.smithi195.stdout:2/57: mknod d2/c11 0 2024-04-06T12:22:59.926 INFO:tasks.workunit.client.1.smithi195.stdout:5/87: dwrite d0/ff [0,4194304] 0 2024-04-06T12:22:59.929 INFO:tasks.workunit.client.1.smithi195.stdout:6/105: write d8/fc [2377744,85667] 0 2024-04-06T12:22:59.931 INFO:tasks.workunit.client.1.smithi195.stdout:6/106: write d8/d9/f11 [4016451,123274] 0 2024-04-06T12:22:59.932 INFO:tasks.workunit.client.1.smithi195.stdout:6/107: fdatasync d8/f14 0 2024-04-06T12:22:59.936 INFO:tasks.workunit.client.1.smithi195.stdout:6/108: dread d8/f19 [0,4194304] 0 2024-04-06T12:22:59.936 INFO:tasks.workunit.client.1.smithi195.stdout:8/58: rename d6/d8/ff to d6/d8/f10 0 2024-04-06T12:22:59.936 INFO:tasks.workunit.client.1.smithi195.stdout:2/58: truncate d2/fb 694415 0 2024-04-06T12:22:59.937 INFO:tasks.workunit.client.1.smithi195.stdout:6/109: write d8/f15 [2937930,98073] 0 2024-04-06T12:22:59.958 INFO:tasks.workunit.client.1.smithi195.stdout:6/110: symlink d8/d9/l29 0 2024-04-06T12:22:59.958 INFO:tasks.workunit.client.1.smithi195.stdout:8/59: write d6/d8/f10 [4512601,55856] 0 2024-04-06T12:22:59.959 INFO:tasks.workunit.client.1.smithi195.stdout:0/104: getdents d4/d6 0 2024-04-06T12:22:59.959 INFO:tasks.workunit.client.1.smithi195.stdout:4/85: write d4/db/fe [1095883,112026] 0 2024-04-06T12:22:59.961 INFO:tasks.workunit.client.1.smithi195.stdout:9/83: dwrite d3/f9 [0,4194304] 0 2024-04-06T12:22:59.962 INFO:tasks.workunit.client.1.smithi195.stdout:9/84: dread - d3/de/f21 zero size 2024-04-06T12:22:59.987 INFO:tasks.workunit.client.0.smithi152.stderr:++ readlink -f fsstress 2024-04-06T12:22:59.989 INFO:tasks.workunit.client.0.smithi152.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-06T12:22:59.989 INFO:tasks.workunit.client.0.smithi152.stderr:+ popd 2024-04-06T12:22:59.990 INFO:tasks.workunit.client.0.smithi152.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-06T12:22:59.991 INFO:tasks.workunit.client.0.smithi152.stderr:+ popd 2024-04-06T12:22:59.993 INFO:tasks.workunit.client.0.smithi152.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-06T12:22:59.993 INFO:tasks.workunit.client.0.smithi152.stderr:++ mktemp -d -p . 2024-04-06T12:22:59.996 INFO:tasks.workunit.client.0.smithi152.stderr:+ T=./tmp.IfyeenMBIz 2024-04-06T12:22:59.996 INFO:tasks.workunit.client.0.smithi152.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.IfyeenMBIz -l 1 -n 1000 -p 10 -v 2024-04-06T12:23:00.004 INFO:tasks.workunit.client.0.smithi152.stdout:seed = 1712399320 2024-04-06T12:23:00.009 INFO:tasks.workunit.client.0.smithi152.stdout:0/0: unlink - no file 2024-04-06T12:23:00.010 INFO:tasks.workunit.client.0.smithi152.stdout:0/1: truncate - no filename 2024-04-06T12:23:00.010 INFO:tasks.workunit.client.0.smithi152.stdout:0/2: dwrite - no filename 2024-04-06T12:23:00.012 INFO:tasks.workunit.client.0.smithi152.stdout:2/0: truncate - no filename 2024-04-06T12:23:00.012 INFO:tasks.workunit.client.0.smithi152.stdout:2/1: stat - no entries 2024-04-06T12:23:00.015 INFO:tasks.workunit.client.0.smithi152.stdout:4/0: rename - no filename 2024-04-06T12:23:00.015 INFO:tasks.workunit.client.0.smithi152.stdout:4/1: chown . 652637 1 2024-04-06T12:23:00.015 INFO:tasks.workunit.client.0.smithi152.stdout:4/2: read - no filename 2024-04-06T12:23:00.016 INFO:tasks.workunit.client.0.smithi152.stdout:4/3: truncate - no filename 2024-04-06T12:23:00.016 INFO:tasks.workunit.client.0.smithi152.stdout:4/4: read - no filename 2024-04-06T12:23:00.016 INFO:tasks.workunit.client.0.smithi152.stdout:4/5: fsync - no filename 2024-04-06T12:23:00.016 INFO:tasks.workunit.client.0.smithi152.stdout:0/3: creat f0 x:0 0 0 2024-04-06T12:23:00.016 INFO:tasks.workunit.client.1.smithi195.stdout:7/52: sync 2024-04-06T12:23:00.018 INFO:tasks.workunit.client.1.smithi195.stdout:7/53: write f0 [4437598,124394] 0 2024-04-06T12:23:00.018 INFO:tasks.workunit.client.1.smithi195.stdout:7/54: dread - d4/d5/ff zero size 2024-04-06T12:23:00.019 INFO:tasks.workunit.client.0.smithi152.stdout:6/0: rmdir - no directory 2024-04-06T12:23:00.019 INFO:tasks.workunit.client.0.smithi152.stdout:6/1: fsync - no filename 2024-04-06T12:23:00.019 INFO:tasks.workunit.client.0.smithi152.stdout:6/2: link - no file 2024-04-06T12:23:00.020 INFO:tasks.workunit.client.0.smithi152.stdout:0/4: creat f1 x:0 0 0 2024-04-06T12:23:00.020 INFO:tasks.workunit.client.0.smithi152.stdout:0/5: dread - f0 zero size 2024-04-06T12:23:00.021 INFO:tasks.workunit.client.0.smithi152.stdout:0/6: readlink - no filename 2024-04-06T12:23:00.021 INFO:tasks.workunit.client.0.smithi152.stdout:2/2: getdents . 0 2024-04-06T12:23:00.021 INFO:tasks.workunit.client.0.smithi152.stdout:2/3: fdatasync - no filename 2024-04-06T12:23:00.021 INFO:tasks.workunit.client.0.smithi152.stdout:2/4: chown . 0 1 2024-04-06T12:23:00.021 INFO:tasks.workunit.client.0.smithi152.stdout:2/5: dread - no filename 2024-04-06T12:23:00.022 INFO:tasks.workunit.client.0.smithi152.stdout:2/6: unlink - no file 2024-04-06T12:23:00.022 INFO:tasks.workunit.client.0.smithi152.stdout:2/7: dread - no filename 2024-04-06T12:23:00.022 INFO:tasks.workunit.client.0.smithi152.stdout:2/8: chown . 220 1 2024-04-06T12:23:00.022 INFO:tasks.workunit.client.0.smithi152.stdout:2/9: truncate - no filename 2024-04-06T12:23:00.026 INFO:tasks.workunit.client.0.smithi152.stdout:4/6: mknod c0 0 2024-04-06T12:23:00.031 INFO:tasks.workunit.client.0.smithi152.stdout:6/3: getdents . 0 2024-04-06T12:23:00.032 INFO:tasks.workunit.client.0.smithi152.stdout:6/4: dwrite - no filename 2024-04-06T12:23:00.032 INFO:tasks.workunit.client.0.smithi152.stdout:6/5: write - no filename 2024-04-06T12:23:00.032 INFO:tasks.workunit.client.0.smithi152.stdout:6/6: dread - no filename 2024-04-06T12:23:00.032 INFO:tasks.workunit.client.0.smithi152.stdout:0/7: link f0 f2 0 2024-04-06T12:23:00.033 INFO:tasks.workunit.client.0.smithi152.stdout:2/10: mkdir d0 0 2024-04-06T12:23:00.033 INFO:tasks.workunit.client.0.smithi152.stdout:2/11: fsync - no filename 2024-04-06T12:23:00.035 INFO:tasks.workunit.client.0.smithi152.stdout:2/12: rename d0 to d0/d1 22 2024-04-06T12:23:00.036 INFO:tasks.workunit.client.0.smithi152.stdout:4/7: creat f1 x:0 0 0 2024-04-06T12:23:00.037 INFO:tasks.workunit.client.0.smithi152.stdout:4/8: write f1 [238105,119679] 0 2024-04-06T12:23:00.037 INFO:tasks.workunit.client.0.smithi152.stdout:7/0: symlink l0 0 2024-04-06T12:23:00.038 INFO:tasks.workunit.client.0.smithi152.stdout:4/9: chown c0 111024471 1 2024-04-06T12:23:00.039 INFO:tasks.workunit.client.0.smithi152.stdout:1/0: unlink - no file 2024-04-06T12:23:00.039 INFO:tasks.workunit.client.0.smithi152.stdout:1/1: chown . 3999 1 2024-04-06T12:23:00.040 INFO:tasks.workunit.client.0.smithi152.stdout:0/8: creat f3 x:0 0 0 2024-04-06T12:23:00.040 INFO:tasks.workunit.client.0.smithi152.stdout:0/9: stat f3 0 2024-04-06T12:23:00.043 INFO:tasks.workunit.client.0.smithi152.stdout:9/0: creat f0 x:0 0 0 2024-04-06T12:23:00.045 INFO:tasks.workunit.client.0.smithi152.stdout:6/7: creat f0 x:0 0 0 2024-04-06T12:23:00.047 INFO:tasks.workunit.client.0.smithi152.stdout:3/0: fdatasync - no filename 2024-04-06T12:23:00.049 INFO:tasks.workunit.client.0.smithi152.stdout:7/1: creat f1 x:0 0 0 2024-04-06T12:23:00.050 INFO:tasks.workunit.client.1.smithi195.stdout:8/60: sync 2024-04-06T12:23:00.052 INFO:tasks.workunit.client.0.smithi152.stdout:4/10: symlink l2 0 2024-04-06T12:23:00.053 INFO:tasks.workunit.client.0.smithi152.stdout:7/2: write f1 [857674,34188] 0 2024-04-06T12:23:00.054 INFO:tasks.workunit.client.0.smithi152.stdout:0/10: write f0 [479412,2476] 0 2024-04-06T12:23:00.055 INFO:tasks.workunit.client.0.smithi152.stdout:2/13: mkdir d0/d2 0 2024-04-06T12:23:00.057 INFO:tasks.workunit.client.0.smithi152.stdout:9/1: unlink f0 0 2024-04-06T12:23:00.058 INFO:tasks.workunit.client.0.smithi152.stdout:6/8: rename f0 to f1 0 2024-04-06T12:23:00.063 INFO:tasks.workunit.client.0.smithi152.stdout:4/11: dread f1 [0,4194304] 0 2024-04-06T12:23:00.064 INFO:tasks.workunit.client.0.smithi152.stdout:8/0: dread - no filename 2024-04-06T12:23:00.064 INFO:tasks.workunit.client.0.smithi152.stdout:8/1: write - no filename 2024-04-06T12:23:00.064 INFO:tasks.workunit.client.0.smithi152.stdout:8/2: chown . 34422621 1 2024-04-06T12:23:00.064 INFO:tasks.workunit.client.0.smithi152.stdout:8/3: chown . 64054774 1 2024-04-06T12:23:00.064 INFO:tasks.workunit.client.0.smithi152.stdout:8/4: rmdir - no directory 2024-04-06T12:23:00.064 INFO:tasks.workunit.client.0.smithi152.stdout:8/5: write - no filename 2024-04-06T12:23:00.065 INFO:tasks.workunit.client.0.smithi152.stdout:8/6: dread - no filename 2024-04-06T12:23:00.065 INFO:tasks.workunit.client.0.smithi152.stdout:1/2: symlink l0 0 2024-04-06T12:23:00.065 INFO:tasks.workunit.client.0.smithi152.stdout:1/3: dread - no filename 2024-04-06T12:23:00.067 INFO:tasks.workunit.client.0.smithi152.stdout:7/3: dwrite f1 [0,4194304] 0 2024-04-06T12:23:00.074 INFO:tasks.workunit.client.0.smithi152.stdout:0/11: mkdir d4 0 2024-04-06T12:23:00.074 INFO:tasks.workunit.client.0.smithi152.stdout:7/4: dread f1 [0,4194304] 0 2024-04-06T12:23:00.077 INFO:tasks.workunit.client.0.smithi152.stdout:2/14: creat d0/f3 x:0 0 0 2024-04-06T12:23:00.077 INFO:tasks.workunit.client.0.smithi152.stdout:2/15: dread - d0/f3 zero size 2024-04-06T12:23:00.078 INFO:tasks.workunit.client.0.smithi152.stdout:2/16: fdatasync d0/f3 0 2024-04-06T12:23:00.078 INFO:tasks.workunit.client.0.smithi152.stdout:2/17: fdatasync d0/f3 0 2024-04-06T12:23:00.084 INFO:tasks.workunit.client.0.smithi152.stdout:9/2: mknod c1 0 2024-04-06T12:23:00.084 INFO:tasks.workunit.client.0.smithi152.stdout:9/3: write - no filename 2024-04-06T12:23:00.088 INFO:tasks.workunit.client.0.smithi152.stdout:2/18: dwrite d0/f3 [0,4194304] 0 2024-04-06T12:23:00.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/1: mkdir d0 0 2024-04-06T12:23:00.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/2: stat d0 0 2024-04-06T12:23:00.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/3: dread - no filename 2024-04-06T12:23:00.096 INFO:tasks.workunit.client.0.smithi152.stdout:4/12: symlink l3 0 2024-04-06T12:23:00.096 INFO:tasks.workunit.client.0.smithi152.stdout:6/9: dwrite f1 [0,4194304] 0 2024-04-06T12:23:00.098 INFO:tasks.workunit.client.0.smithi152.stdout:1/4: symlink l1 0 2024-04-06T12:23:00.099 INFO:tasks.workunit.client.0.smithi152.stdout:1/5: truncate - no filename 2024-04-06T12:23:00.099 INFO:tasks.workunit.client.0.smithi152.stdout:1/6: dwrite - no filename 2024-04-06T12:23:00.100 INFO:tasks.workunit.client.0.smithi152.stdout:1/7: rmdir - no directory 2024-04-06T12:23:00.106 INFO:tasks.workunit.client.0.smithi152.stdout:7/5: rename l0 to l2 0 2024-04-06T12:23:00.110 INFO:tasks.workunit.client.0.smithi152.stdout:9/4: creat f2 x:0 0 0 2024-04-06T12:23:00.113 INFO:tasks.workunit.client.0.smithi152.stdout:9/5: write f2 [991170,83715] 0 2024-04-06T12:23:00.113 INFO:tasks.workunit.client.0.smithi152.stdout:9/6: chown f2 21764806 1 2024-04-06T12:23:00.117 INFO:tasks.workunit.client.0.smithi152.stdout:8/7: creat f0 x:0 0 0 2024-04-06T12:23:00.120 INFO:tasks.workunit.client.0.smithi152.stdout:4/13: write f1 [21224,106746] 0 2024-04-06T12:23:00.121 INFO:tasks.workunit.client.0.smithi152.stdout:4/14: chown l2 7255438 1 2024-04-06T12:23:00.126 INFO:tasks.workunit.client.0.smithi152.stdout:1/8: mkdir d2 0 2024-04-06T12:23:00.126 INFO:tasks.workunit.client.0.smithi152.stdout:1/9: dwrite - no filename 2024-04-06T12:23:00.129 INFO:tasks.workunit.client.0.smithi152.stdout:0/12: getdents d4 0 2024-04-06T12:23:00.130 INFO:tasks.workunit.client.0.smithi152.stdout:4/15: dwrite f1 [0,4194304] 0 2024-04-06T12:23:00.131 INFO:tasks.workunit.client.0.smithi152.stdout:4/16: rmdir - no directory 2024-04-06T12:23:00.131 INFO:tasks.workunit.client.0.smithi152.stdout:0/13: write f0 [173318,59442] 0 2024-04-06T12:23:00.132 INFO:tasks.workunit.client.0.smithi152.stdout:7/6: rename f1 to f3 0 2024-04-06T12:23:00.133 INFO:tasks.workunit.client.0.smithi152.stdout:0/14: write f2 [699403,29673] 0 2024-04-06T12:23:00.133 INFO:tasks.workunit.client.0.smithi152.stdout:0/15: readlink - no filename 2024-04-06T12:23:00.134 INFO:tasks.workunit.client.0.smithi152.stdout:2/19: mknod d0/d2/c4 0 2024-04-06T12:23:00.134 INFO:tasks.workunit.client.0.smithi152.stdout:0/16: dread - f3 zero size 2024-04-06T12:23:00.138 INFO:tasks.workunit.client.0.smithi152.stdout:4/17: dread f1 [0,4194304] 0 2024-04-06T12:23:00.139 INFO:tasks.workunit.client.0.smithi152.stdout:0/17: write f3 [185970,52600] 0 2024-04-06T12:23:00.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/0: mknod c0 0 2024-04-06T12:23:00.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/1: read - no filename 2024-04-06T12:23:00.142 INFO:tasks.workunit.client.0.smithi152.stdout:9/7: unlink f2 0 2024-04-06T12:23:00.142 INFO:tasks.workunit.client.0.smithi152.stdout:9/8: write - no filename 2024-04-06T12:23:00.142 INFO:tasks.workunit.client.0.smithi152.stdout:9/9: fsync - no filename 2024-04-06T12:23:00.142 INFO:tasks.workunit.client.0.smithi152.stdout:9/10: dwrite - no filename 2024-04-06T12:23:00.144 INFO:tasks.workunit.client.0.smithi152.stdout:9/11: chown c1 7 1 2024-04-06T12:23:00.144 INFO:tasks.workunit.client.1.smithi195.stdout:1/71: getdents d4/d14/d17 0 2024-04-06T12:23:00.145 INFO:tasks.workunit.client.1.smithi195.stdout:1/72: read d4/d14/d17/f10 [906892,99941] 0 2024-04-06T12:23:00.146 INFO:tasks.workunit.client.1.smithi195.stdout:1/73: write f3 [4212992,10943] 0 2024-04-06T12:23:00.147 INFO:tasks.workunit.client.0.smithi152.stdout:8/8: creat f1 x:0 0 0 2024-04-06T12:23:00.147 INFO:tasks.workunit.client.1.smithi195.stdout:5/88: creat d0/f24 x:0 0 0 2024-04-06T12:23:00.148 INFO:tasks.workunit.client.0.smithi152.stdout:3/4: symlink d0/l1 0 2024-04-06T12:23:00.148 INFO:tasks.workunit.client.0.smithi152.stdout:3/5: write - no filename 2024-04-06T12:23:00.148 INFO:tasks.workunit.client.0.smithi152.stdout:3/6: write - no filename 2024-04-06T12:23:00.149 INFO:tasks.workunit.client.0.smithi152.stdout:0/18: dwrite f3 [0,4194304] 0 2024-04-06T12:23:00.149 INFO:tasks.workunit.client.1.smithi195.stdout:6/111: rmdir d8/d21/d24 39 2024-04-06T12:23:00.150 INFO:tasks.workunit.client.0.smithi152.stdout:0/19: truncate f3 5223852 0 2024-04-06T12:23:00.155 INFO:tasks.workunit.client.1.smithi195.stdout:3/83: getdents d4/df 0 2024-04-06T12:23:00.156 INFO:tasks.workunit.client.1.smithi195.stdout:3/84: chown d4/d9/l11 58 1 2024-04-06T12:23:00.157 INFO:tasks.workunit.client.1.smithi195.stdout:0/105: creat d4/d6/f1d x:0 0 0 2024-04-06T12:23:00.161 INFO:tasks.workunit.client.1.smithi195.stdout:9/85: creat d3/d10/f22 x:0 0 0 2024-04-06T12:23:00.165 INFO:tasks.workunit.client.0.smithi152.stdout:2/20: mkdir d0/d2/d5 0 2024-04-06T12:23:00.165 INFO:tasks.workunit.client.0.smithi152.stdout:2/21: read d0/f3 [2955783,56752] 0 2024-04-06T12:23:00.167 INFO:tasks.workunit.client.0.smithi152.stdout:4/18: unlink c0 0 2024-04-06T12:23:00.167 INFO:tasks.workunit.client.0.smithi152.stdout:4/19: chown f1 3 1 2024-04-06T12:23:00.168 INFO:tasks.workunit.client.1.smithi195.stdout:2/59: link d2/f4 d2/f12 0 2024-04-06T12:23:00.169 INFO:tasks.workunit.client.0.smithi152.stdout:2/22: dread d0/f3 [0,4194304] 0 2024-04-06T12:23:00.169 INFO:tasks.workunit.client.0.smithi152.stdout:2/23: readlink - no filename 2024-04-06T12:23:00.169 INFO:tasks.workunit.client.0.smithi152.stdout:2/24: write d0/f3 [861094,413] 0 2024-04-06T12:23:00.170 INFO:tasks.workunit.client.0.smithi152.stdout:2/25: chown d0/d2/d5 866 1 2024-04-06T12:23:00.172 INFO:tasks.workunit.client.0.smithi152.stdout:5/2: mknod c1 0 2024-04-06T12:23:00.176 INFO:tasks.workunit.client.0.smithi152.stdout:9/12: creat f3 x:0 0 0 2024-04-06T12:23:00.177 INFO:tasks.workunit.client.1.smithi195.stdout:5/89: mknod d0/da/dd/c25 0 2024-04-06T12:23:00.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/90: read d0/fe [801783,97812] 0 2024-04-06T12:23:00.178 INFO:tasks.workunit.client.0.smithi152.stdout:8/9: creat f2 x:0 0 0 2024-04-06T12:23:00.178 INFO:tasks.workunit.client.0.smithi152.stdout:8/10: readlink - no filename 2024-04-06T12:23:00.180 INFO:tasks.workunit.client.1.smithi195.stdout:6/112: unlink c0 0 2024-04-06T12:23:00.180 INFO:tasks.workunit.client.1.smithi195.stdout:6/113: write d8/f15 [667866,123329] 0 2024-04-06T12:23:00.181 INFO:tasks.workunit.client.0.smithi152.stdout:3/7: rename d0/l1 to d0/l2 0 2024-04-06T12:23:00.185 INFO:tasks.workunit.client.1.smithi195.stdout:3/85: mknod d4/df/c1d 0 2024-04-06T12:23:00.185 INFO:tasks.workunit.client.1.smithi195.stdout:3/86: readlink d4/de/l19 0 2024-04-06T12:23:00.186 INFO:tasks.workunit.client.0.smithi152.stdout:1/10: getdents d2 0 2024-04-06T12:23:00.186 INFO:tasks.workunit.client.1.smithi195.stdout:3/87: dread - d4/f16 zero size 2024-04-06T12:23:00.190 INFO:tasks.workunit.client.1.smithi195.stdout:7/55: mkdir d4/d10/d12/d13 0 2024-04-06T12:23:00.192 INFO:tasks.workunit.client.1.smithi195.stdout:3/88: dwrite d4/d9/fb [0,4194304] 0 2024-04-06T12:23:00.192 INFO:tasks.workunit.client.1.smithi195.stdout:8/61: symlink d6/dd/l11 0 2024-04-06T12:23:00.192 INFO:tasks.workunit.client.1.smithi195.stdout:7/56: write d4/d5/ff [664411,1869] 0 2024-04-06T12:23:00.193 INFO:tasks.workunit.client.0.smithi152.stdout:2/26: creat d0/f6 x:0 0 0 2024-04-06T12:23:00.194 INFO:tasks.workunit.client.1.smithi195.stdout:7/57: dread d4/d5/fe [0,4194304] 0 2024-04-06T12:23:00.195 INFO:tasks.workunit.client.1.smithi195.stdout:2/60: stat d2/fb 0 2024-04-06T12:23:00.196 INFO:tasks.workunit.client.1.smithi195.stdout:7/58: chown d4/f7 1 1 2024-04-06T12:23:00.197 INFO:tasks.workunit.client.0.smithi152.stdout:5/3: symlink l2 0 2024-04-06T12:23:00.197 INFO:tasks.workunit.client.0.smithi152.stdout:5/4: write - no filename 2024-04-06T12:23:00.197 INFO:tasks.workunit.client.0.smithi152.stdout:5/5: dwrite - no filename 2024-04-06T12:23:00.198 INFO:tasks.workunit.client.0.smithi152.stdout:5/6: write - no filename 2024-04-06T12:23:00.198 INFO:tasks.workunit.client.0.smithi152.stdout:5/7: write - no filename 2024-04-06T12:23:00.198 INFO:tasks.workunit.client.0.smithi152.stdout:9/13: mknod c4 0 2024-04-06T12:23:00.199 INFO:tasks.workunit.client.0.smithi152.stdout:4/20: dwrite f1 [0,4194304] 0 2024-04-06T12:23:00.201 INFO:tasks.workunit.client.1.smithi195.stdout:1/74: mkdir d4/d14/d19 0 2024-04-06T12:23:00.201 INFO:tasks.workunit.client.1.smithi195.stdout:3/89: dwrite d4/f7 [0,4194304] 0 2024-04-06T12:23:00.206 INFO:tasks.workunit.client.0.smithi152.stdout:0/20: mknod d4/c5 0 2024-04-06T12:23:00.207 INFO:tasks.workunit.client.0.smithi152.stdout:0/21: fdatasync f2 0 2024-04-06T12:23:00.207 INFO:tasks.workunit.client.0.smithi152.stdout:0/22: chown f1 110145 1 2024-04-06T12:23:00.217 INFO:tasks.workunit.client.0.smithi152.stdout:2/27: rename d0/f6 to d0/d2/f7 0 2024-04-06T12:23:00.220 INFO:tasks.workunit.client.0.smithi152.stdout:5/8: mkdir d3 0 2024-04-06T12:23:00.220 INFO:tasks.workunit.client.0.smithi152.stdout:5/9: dread - no filename 2024-04-06T12:23:00.221 INFO:tasks.workunit.client.0.smithi152.stdout:5/10: dread - no filename 2024-04-06T12:23:00.221 INFO:tasks.workunit.client.0.smithi152.stdout:5/11: dread - no filename 2024-04-06T12:23:00.227 INFO:tasks.workunit.client.0.smithi152.stdout:9/14: mkdir d5 0 2024-04-06T12:23:00.230 INFO:tasks.workunit.client.0.smithi152.stdout:8/11: link f1 f3 0 2024-04-06T12:23:00.232 INFO:tasks.workunit.client.0.smithi152.stdout:8/12: dread - f0 zero size 2024-04-06T12:23:00.234 INFO:tasks.workunit.client.1.smithi195.stdout:3/90: unlink d4/d9/l1a 0 2024-04-06T12:23:00.235 INFO:tasks.workunit.client.0.smithi152.stdout:0/23: symlink d4/l6 0 2024-04-06T12:23:00.236 INFO:tasks.workunit.client.0.smithi152.stdout:0/24: write f3 [2832149,23367] 0 2024-04-06T12:23:00.237 INFO:tasks.workunit.client.0.smithi152.stdout:1/11: creat d2/f3 x:0 0 0 2024-04-06T12:23:00.238 INFO:tasks.workunit.client.0.smithi152.stdout:1/12: dread - d2/f3 zero size 2024-04-06T12:23:00.241 INFO:tasks.workunit.client.0.smithi152.stdout:0/25: dread f3 [0,4194304] 0 2024-04-06T12:23:00.245 INFO:tasks.workunit.client.1.smithi195.stdout:9/86: creat d3/f23 x:0 0 0 2024-04-06T12:23:00.247 INFO:tasks.workunit.client.0.smithi152.stdout:8/13: mkdir d4 0 2024-04-06T12:23:00.249 INFO:tasks.workunit.client.1.smithi195.stdout:7/59: link d4/d5/ff d4/d10/d12/f14 0 2024-04-06T12:23:00.252 INFO:tasks.workunit.client.1.smithi195.stdout:3/91: rename d4/f16 to d4/d9/f1e 0 2024-04-06T12:23:00.252 INFO:tasks.workunit.client.1.smithi195.stdout:3/92: fsync d4/f12 0 2024-04-06T12:23:00.253 INFO:tasks.workunit.client.1.smithi195.stdout:3/93: write d4/d9/fa [388331,54513] 0 2024-04-06T12:23:00.254 INFO:tasks.workunit.client.1.smithi195.stdout:1/75: creat d4/d14/d19/f1a x:0 0 0 2024-04-06T12:23:00.255 INFO:tasks.workunit.client.1.smithi195.stdout:1/76: readlink l0 0 2024-04-06T12:23:00.255 INFO:tasks.workunit.client.1.smithi195.stdout:1/77: readlink d4/d14/d17/le 0 2024-04-06T12:23:00.255 INFO:tasks.workunit.client.1.smithi195.stdout:3/94: fsync f0 0 2024-04-06T12:23:00.256 INFO:tasks.workunit.client.0.smithi152.stdout:1/13: mknod d2/c4 0 2024-04-06T12:23:00.256 INFO:tasks.workunit.client.1.smithi195.stdout:3/95: read - d4/d9/f18 zero size 2024-04-06T12:23:00.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/114: creat d8/f2a x:0 0 0 2024-04-06T12:23:00.258 INFO:tasks.workunit.client.1.smithi195.stdout:4/86: getdents d4/d6 0 2024-04-06T12:23:00.260 INFO:tasks.workunit.client.0.smithi152.stdout:5/12: symlink d3/l4 0 2024-04-06T12:23:00.260 INFO:tasks.workunit.client.0.smithi152.stdout:5/13: chown d3/l4 230923 1 2024-04-06T12:23:00.260 INFO:tasks.workunit.client.0.smithi152.stdout:5/14: write - no filename 2024-04-06T12:23:00.263 INFO:tasks.workunit.client.0.smithi152.stdout:9/15: mkdir d5/d6 0 2024-04-06T12:23:00.263 INFO:tasks.workunit.client.0.smithi152.stdout:9/16: readlink - no filename 2024-04-06T12:23:00.264 INFO:tasks.workunit.client.0.smithi152.stdout:4/21: link l3 l4 0 2024-04-06T12:23:00.264 INFO:tasks.workunit.client.0.smithi152.stdout:4/22: fsync f1 0 2024-04-06T12:23:00.271 INFO:tasks.workunit.client.1.smithi195.stdout:1/78: rename f3 to d4/d14/d19/f1b 0 2024-04-06T12:23:00.271 INFO:tasks.workunit.client.1.smithi195.stdout:1/79: readlink l0 0 2024-04-06T12:23:00.272 INFO:tasks.workunit.client.0.smithi152.stdout:6/10: write f1 [4434778,4249] 0 2024-04-06T12:23:00.273 INFO:tasks.workunit.client.0.smithi152.stdout:1/14: mknod d2/c5 0 2024-04-06T12:23:00.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/62: sync 2024-04-06T12:23:00.276 INFO:tasks.workunit.client.0.smithi152.stdout:0/26: link f0 d4/f7 0 2024-04-06T12:23:00.279 INFO:tasks.workunit.client.0.smithi152.stdout:5/15: creat d3/f5 x:0 0 0 2024-04-06T12:23:00.280 INFO:tasks.workunit.client.1.smithi195.stdout:4/87: mknod d4/d6/c1b 0 2024-04-06T12:23:00.280 INFO:tasks.workunit.client.1.smithi195.stdout:8/63: dwrite d6/f7 [0,4194304] 0 2024-04-06T12:23:00.281 INFO:tasks.workunit.client.1.smithi195.stdout:4/88: write d4/d6/f7 [3371730,2579] 0 2024-04-06T12:23:00.282 INFO:tasks.workunit.client.0.smithi152.stdout:7/7: rename l2 to l4 0 2024-04-06T12:23:00.289 INFO:tasks.workunit.client.0.smithi152.stdout:8/14: mknod d4/c5 0 2024-04-06T12:23:00.290 INFO:tasks.workunit.client.0.smithi152.stdout:8/15: dread - f3 zero size 2024-04-06T12:23:00.292 INFO:tasks.workunit.client.0.smithi152.stdout:1/15: mknod d2/c6 0 2024-04-06T12:23:00.293 INFO:tasks.workunit.client.1.smithi195.stdout:6/115: mkdir d8/d21/d2b 0 2024-04-06T12:23:00.296 INFO:tasks.workunit.client.0.smithi152.stdout:0/27: creat d4/f8 x:0 0 0 2024-04-06T12:23:00.297 INFO:tasks.workunit.client.0.smithi152.stdout:0/28: chown d4/l6 47 1 2024-04-06T12:23:00.303 INFO:tasks.workunit.client.0.smithi152.stdout:9/17: creat d5/d6/f7 x:0 0 0 2024-04-06T12:23:00.304 INFO:tasks.workunit.client.0.smithi152.stdout:9/18: truncate f3 400128 0 2024-04-06T12:23:00.305 INFO:tasks.workunit.client.1.smithi195.stdout:4/89: fsync d4/f5 0 2024-04-06T12:23:00.305 INFO:tasks.workunit.client.0.smithi152.stdout:9/19: dread - d5/d6/f7 zero size 2024-04-06T12:23:00.306 INFO:tasks.workunit.client.0.smithi152.stdout:9/20: write d5/d6/f7 [308610,78259] 0 2024-04-06T12:23:00.307 INFO:tasks.workunit.client.1.smithi195.stdout:9/87: creat d3/f24 x:0 0 0 2024-04-06T12:23:00.308 INFO:tasks.workunit.client.1.smithi195.stdout:2/61: sync 2024-04-06T12:23:00.309 INFO:tasks.workunit.client.1.smithi195.stdout:9/88: truncate d3/f23 696272 0 2024-04-06T12:23:00.309 INFO:tasks.workunit.client.1.smithi195.stdout:1/80: getdents d4/d14/d17 0 2024-04-06T12:23:00.310 INFO:tasks.workunit.client.1.smithi195.stdout:1/81: read d4/d14/d19/f1b [4142885,46373] 0 2024-04-06T12:23:00.313 INFO:tasks.workunit.client.0.smithi152.stdout:8/16: rename d4/c5 to d4/c6 0 2024-04-06T12:23:00.313 INFO:tasks.workunit.client.1.smithi195.stdout:3/96: link d4/l15 d4/d9/l1f 0 2024-04-06T12:23:00.316 INFO:tasks.workunit.client.0.smithi152.stdout:9/21: dwrite d5/d6/f7 [0,4194304] 0 2024-04-06T12:23:00.318 INFO:tasks.workunit.client.0.smithi152.stdout:6/11: link f1 f2 0 2024-04-06T12:23:00.325 INFO:tasks.workunit.client.1.smithi195.stdout:4/90: dread d4/f12 [0,4194304] 0 2024-04-06T12:23:00.325 INFO:tasks.workunit.client.1.smithi195.stdout:4/91: read - d4/db/ff zero size 2024-04-06T12:23:00.331 INFO:tasks.workunit.client.0.smithi152.stdout:1/16: link d2/f3 d2/f7 0 2024-04-06T12:23:00.333 INFO:tasks.workunit.client.1.smithi195.stdout:1/82: creat d4/f1c x:0 0 0 2024-04-06T12:23:00.334 INFO:tasks.workunit.client.1.smithi195.stdout:1/83: stat d4/d14/c16 0 2024-04-06T12:23:00.336 INFO:tasks.workunit.client.0.smithi152.stdout:9/22: creat d5/f8 x:0 0 0 2024-04-06T12:23:00.338 INFO:tasks.workunit.client.1.smithi195.stdout:3/97: fdatasync d4/d9/f1e 0 2024-04-06T12:23:00.341 INFO:tasks.workunit.client.0.smithi152.stdout:2/28: fsync d0/d2/f7 0 2024-04-06T12:23:00.343 INFO:tasks.workunit.client.0.smithi152.stdout:1/17: creat d2/f8 x:0 0 0 2024-04-06T12:23:00.345 INFO:tasks.workunit.client.0.smithi152.stdout:6/12: dwrite f1 [4194304,4194304] 0 2024-04-06T12:23:00.349 INFO:tasks.workunit.client.1.smithi195.stdout:9/89: fsync d3/f5 0 2024-04-06T12:23:00.349 INFO:tasks.workunit.client.0.smithi152.stdout:3/8: link d0/l2 d0/l3 0 2024-04-06T12:23:00.349 INFO:tasks.workunit.client.0.smithi152.stdout:3/9: dwrite - no filename 2024-04-06T12:23:00.350 INFO:tasks.workunit.client.0.smithi152.stdout:3/10: dread - no filename 2024-04-06T12:23:00.352 INFO:tasks.workunit.client.0.smithi152.stdout:3/11: rename d0 to d0/d4 22 2024-04-06T12:23:00.352 INFO:tasks.workunit.client.0.smithi152.stdout:3/12: dwrite - no filename 2024-04-06T12:23:00.352 INFO:tasks.workunit.client.0.smithi152.stdout:3/13: write - no filename 2024-04-06T12:23:00.352 INFO:tasks.workunit.client.0.smithi152.stdout:2/29: symlink d0/l8 0 2024-04-06T12:23:00.353 INFO:tasks.workunit.client.1.smithi195.stdout:1/84: creat d4/d14/d19/f1d x:0 0 0 2024-04-06T12:23:00.353 INFO:tasks.workunit.client.1.smithi195.stdout:1/85: chown d4/d14/f15 113020324 1 2024-04-06T12:23:00.355 INFO:tasks.workunit.client.0.smithi152.stdout:1/18: creat d2/f9 x:0 0 0 2024-04-06T12:23:00.355 INFO:tasks.workunit.client.1.smithi195.stdout:6/116: symlink d8/d21/d24/d27/l2c 0 2024-04-06T12:23:00.356 INFO:tasks.workunit.client.0.smithi152.stdout:6/13: dread f2 [4194304,4194304] 0 2024-04-06T12:23:00.358 INFO:tasks.workunit.client.1.smithi195.stdout:3/98: creat d4/df/f20 x:0 0 0 2024-04-06T12:23:00.359 INFO:tasks.workunit.client.1.smithi195.stdout:5/91: truncate d0/da/d13/f15 433891 0 2024-04-06T12:23:00.361 INFO:tasks.workunit.client.0.smithi152.stdout:2/30: dwrite d0/d2/f7 [0,4194304] 0 2024-04-06T12:23:00.362 INFO:tasks.workunit.client.1.smithi195.stdout:8/64: getdents d6 0 2024-04-06T12:23:00.363 INFO:tasks.workunit.client.1.smithi195.stdout:8/65: chown d6/d8 576529618 1 2024-04-06T12:23:00.363 INFO:tasks.workunit.client.0.smithi152.stdout:4/23: getdents . 0 2024-04-06T12:23:00.368 INFO:tasks.workunit.client.1.smithi195.stdout:8/66: dwrite d6/d8/f10 [0,4194304] 0 2024-04-06T12:23:00.369 INFO:tasks.workunit.client.1.smithi195.stdout:8/67: write d6/f7 [1124315,34000] 0 2024-04-06T12:23:00.370 INFO:tasks.workunit.client.0.smithi152.stdout:6/14: rename f1 to f3 0 2024-04-06T12:23:00.376 INFO:tasks.workunit.client.0.smithi152.stdout:2/31: fsync d0/f3 0 2024-04-06T12:23:00.378 INFO:tasks.workunit.client.0.smithi152.stdout:2/32: write d0/d2/f7 [361579,93215] 0 2024-04-06T12:23:00.379 INFO:tasks.workunit.client.1.smithi195.stdout:9/90: read d3/f17 [2866025,55526] 0 2024-04-06T12:23:00.383 INFO:tasks.workunit.client.0.smithi152.stdout:2/33: dread d0/f3 [0,4194304] 0 2024-04-06T12:23:00.384 INFO:tasks.workunit.client.0.smithi152.stdout:3/14: rename d0/l2 to d0/l5 0 2024-04-06T12:23:00.385 INFO:tasks.workunit.client.1.smithi195.stdout:1/86: write d4/f11 [202629,86569] 0 2024-04-06T12:23:00.385 INFO:tasks.workunit.client.1.smithi195.stdout:1/87: chown d4/f11 657724089 1 2024-04-06T12:23:00.386 INFO:tasks.workunit.client.0.smithi152.stdout:4/24: creat f5 x:0 0 0 2024-04-06T12:23:00.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/99: write f0 [4154479,61919] 0 2024-04-06T12:23:00.387 INFO:tasks.workunit.client.0.smithi152.stdout:4/25: truncate f5 695386 0 2024-04-06T12:23:00.390 INFO:tasks.workunit.client.0.smithi152.stdout:2/34: fsync d0/d2/f7 0 2024-04-06T12:23:00.391 INFO:tasks.workunit.client.0.smithi152.stdout:6/15: mknod c4 0 2024-04-06T12:23:00.393 INFO:tasks.workunit.client.1.smithi195.stdout:5/92: rmdir d0/da/d13 39 2024-04-06T12:23:00.393 INFO:tasks.workunit.client.0.smithi152.stdout:2/35: dread d0/d2/f7 [0,4194304] 0 2024-04-06T12:23:00.394 INFO:tasks.workunit.client.0.smithi152.stdout:2/36: fdatasync d0/d2/f7 0 2024-04-06T12:23:00.396 INFO:tasks.workunit.client.0.smithi152.stdout:5/16: rmdir d3 39 2024-04-06T12:23:00.400 INFO:tasks.workunit.client.1.smithi195.stdout:7/60: truncate f0 766916 0 2024-04-06T12:23:00.401 INFO:tasks.workunit.client.1.smithi195.stdout:7/61: chown d4/d5/fe 1977 1 2024-04-06T12:23:00.402 INFO:tasks.workunit.client.1.smithi195.stdout:7/62: read d4/d10/d12/f14 [199907,61986] 0 2024-04-06T12:23:00.405 INFO:tasks.workunit.client.1.smithi195.stdout:8/68: mkdir d6/d8/d12 0 2024-04-06T12:23:00.405 INFO:tasks.workunit.client.1.smithi195.stdout:8/69: chown d6/dd/l11 3331 1 2024-04-06T12:23:00.406 INFO:tasks.workunit.client.1.smithi195.stdout:8/70: read d6/d8/f10 [1828454,84498] 0 2024-04-06T12:23:00.406 INFO:tasks.workunit.client.0.smithi152.stdout:3/15: creat d0/f6 x:0 0 0 2024-04-06T12:23:00.407 INFO:tasks.workunit.client.0.smithi152.stdout:3/16: truncate d0/f6 400067 0 2024-04-06T12:23:00.408 INFO:tasks.workunit.client.0.smithi152.stdout:4/26: symlink l6 0 2024-04-06T12:23:00.408 INFO:tasks.workunit.client.0.smithi152.stdout:0/29: rmdir d4 39 2024-04-06T12:23:00.409 INFO:tasks.workunit.client.0.smithi152.stdout:4/27: chown f5 3 1 2024-04-06T12:23:00.410 INFO:tasks.workunit.client.1.smithi195.stdout:1/88: symlink d4/l1e 0 2024-04-06T12:23:00.411 INFO:tasks.workunit.client.0.smithi152.stdout:9/23: rmdir d5/d6 39 2024-04-06T12:23:00.412 INFO:tasks.workunit.client.0.smithi152.stdout:9/24: dread - d5/f8 zero size 2024-04-06T12:23:00.413 INFO:tasks.workunit.client.0.smithi152.stdout:6/16: creat f5 x:0 0 0 2024-04-06T12:23:00.414 INFO:tasks.workunit.client.1.smithi195.stdout:3/100: creat d4/d9/f21 x:0 0 0 2024-04-06T12:23:00.418 INFO:tasks.workunit.client.0.smithi152.stdout:6/17: dread f3 [4194304,4194304] 0 2024-04-06T12:23:00.418 INFO:tasks.workunit.client.0.smithi152.stdout:6/18: read - f5 zero size 2024-04-06T12:23:00.418 INFO:tasks.workunit.client.1.smithi195.stdout:5/93: dread - d0/da/d13/f1f zero size 2024-04-06T12:23:00.419 INFO:tasks.workunit.client.0.smithi152.stdout:5/17: fsync d3/f5 0 2024-04-06T12:23:00.420 INFO:tasks.workunit.client.0.smithi152.stdout:5/18: dread - d3/f5 zero size 2024-04-06T12:23:00.420 INFO:tasks.workunit.client.1.smithi195.stdout:0/106: getdents d4/d6/d1a 0 2024-04-06T12:23:00.421 INFO:tasks.workunit.client.1.smithi195.stdout:4/92: getdents d4/db/d18 0 2024-04-06T12:23:00.422 INFO:tasks.workunit.client.1.smithi195.stdout:4/93: truncate d4/db/ff 4556 0 2024-04-06T12:23:00.427 INFO:tasks.workunit.client.1.smithi195.stdout:7/63: symlink d4/d10/l15 0 2024-04-06T12:23:00.428 INFO:tasks.workunit.client.1.smithi195.stdout:2/62: write d2/f4 [2078314,83958] 0 2024-04-06T12:23:00.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/64: readlink d4/lb 0 2024-04-06T12:23:00.430 INFO:tasks.workunit.client.0.smithi152.stdout:9/25: read d5/d6/f7 [1671387,10209] 0 2024-04-06T12:23:00.431 INFO:tasks.workunit.client.1.smithi195.stdout:8/71: mknod d6/c13 0 2024-04-06T12:23:00.433 INFO:tasks.workunit.client.0.smithi152.stdout:8/17: rename d4/c6 to d4/c7 0 2024-04-06T12:23:00.434 INFO:tasks.workunit.client.0.smithi152.stdout:1/19: getdents d2 0 2024-04-06T12:23:00.435 INFO:tasks.workunit.client.1.smithi195.stdout:9/91: symlink d3/l25 0 2024-04-06T12:23:00.440 INFO:tasks.workunit.client.1.smithi195.stdout:6/117: creat d8/d21/f2d x:0 0 0 2024-04-06T12:23:00.441 INFO:tasks.workunit.client.0.smithi152.stdout:5/19: symlink d3/l6 0 2024-04-06T12:23:00.441 INFO:tasks.workunit.client.1.smithi195.stdout:9/92: dwrite d3/f23 [0,4194304] 0 2024-04-06T12:23:00.441 INFO:tasks.workunit.client.0.smithi152.stdout:5/20: stat l2 0 2024-04-06T12:23:00.447 INFO:tasks.workunit.client.1.smithi195.stdout:5/94: rmdir d0/da 39 2024-04-06T12:23:00.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/118: dwrite d8/d21/f2d [0,4194304] 0 2024-04-06T12:23:00.449 INFO:tasks.workunit.client.0.smithi152.stdout:6/19: dwrite f2 [4194304,4194304] 0 2024-04-06T12:23:00.456 INFO:tasks.workunit.client.1.smithi195.stdout:0/107: unlink d4/f14 0 2024-04-06T12:23:00.457 INFO:tasks.workunit.client.1.smithi195.stdout:6/119: dwrite d8/f1a [0,4194304] 0 2024-04-06T12:23:00.458 INFO:tasks.workunit.client.1.smithi195.stdout:6/120: truncate d8/f2a 757223 0 2024-04-06T12:23:00.463 INFO:tasks.workunit.client.0.smithi152.stdout:0/30: mknod d4/c9 0 2024-04-06T12:23:00.466 INFO:tasks.workunit.client.1.smithi195.stdout:2/63: unlink l1 0 2024-04-06T12:23:00.467 INFO:tasks.workunit.client.0.smithi152.stdout:3/17: rmdir d0 39 2024-04-06T12:23:00.468 INFO:tasks.workunit.client.0.smithi152.stdout:0/31: chown f1 202 1 2024-04-06T12:23:00.469 INFO:tasks.workunit.client.0.smithi152.stdout:0/32: truncate f1 851435 0 2024-04-06T12:23:00.470 INFO:tasks.workunit.client.1.smithi195.stdout:8/72: creat d6/dd/f14 x:0 0 0 2024-04-06T12:23:00.473 INFO:tasks.workunit.client.0.smithi152.stdout:5/21: creat d3/f7 x:0 0 0 2024-04-06T12:23:00.474 INFO:tasks.workunit.client.0.smithi152.stdout:7/8: link l4 l5 0 2024-04-06T12:23:00.475 INFO:tasks.workunit.client.0.smithi152.stdout:5/22: write d3/f7 [962114,58487] 0 2024-04-06T12:23:00.477 INFO:tasks.workunit.client.0.smithi152.stdout:6/20: rename f2 to f6 0 2024-04-06T12:23:00.479 INFO:tasks.workunit.client.0.smithi152.stdout:2/37: dwrite d0/f3 [0,4194304] 0 2024-04-06T12:23:00.482 INFO:tasks.workunit.client.1.smithi195.stdout:9/93: mknod d3/de/c26 0 2024-04-06T12:23:00.483 INFO:tasks.workunit.client.0.smithi152.stdout:8/18: dwrite f3 [0,4194304] 0 2024-04-06T12:23:00.485 INFO:tasks.workunit.client.0.smithi152.stdout:8/19: fdatasync f2 0 2024-04-06T12:23:00.487 INFO:tasks.workunit.client.0.smithi152.stdout:6/21: dread f6 [4194304,4194304] 0 2024-04-06T12:23:00.487 INFO:tasks.workunit.client.0.smithi152.stdout:8/20: chown f2 1929983 1 2024-04-06T12:23:00.489 INFO:tasks.workunit.client.0.smithi152.stdout:6/22: chown c4 2029319 1 2024-04-06T12:23:00.489 INFO:tasks.workunit.client.0.smithi152.stdout:8/21: chown f3 61321434 1 2024-04-06T12:23:00.489 INFO:tasks.workunit.client.0.smithi152.stdout:2/38: dwrite d0/d2/f7 [0,4194304] 0 2024-04-06T12:23:00.491 INFO:tasks.workunit.client.0.smithi152.stdout:2/39: read d0/d2/f7 [2551473,128164] 0 2024-04-06T12:23:00.492 INFO:tasks.workunit.client.1.smithi195.stdout:5/95: dread - d0/da/d13/f1f zero size 2024-04-06T12:23:00.494 INFO:tasks.workunit.client.0.smithi152.stdout:2/40: stat d0/d2/f7 0 2024-04-06T12:23:00.494 INFO:tasks.workunit.client.0.smithi152.stdout:2/41: readlink d0/l8 0 2024-04-06T12:23:00.501 INFO:tasks.workunit.client.1.smithi195.stdout:4/94: creat d4/db/d18/d1a/f1c x:0 0 0 2024-04-06T12:23:00.503 INFO:tasks.workunit.client.1.smithi195.stdout:0/108: symlink d4/l1e 0 2024-04-06T12:23:00.509 INFO:tasks.workunit.client.1.smithi195.stdout:2/64: creat d2/f13 x:0 0 0 2024-04-06T12:23:00.509 INFO:tasks.workunit.client.1.smithi195.stdout:2/65: chown d2/f5 27929 1 2024-04-06T12:23:00.511 INFO:tasks.workunit.client.1.smithi195.stdout:8/73: rmdir d6 39 2024-04-06T12:23:00.513 INFO:tasks.workunit.client.1.smithi195.stdout:1/89: creat d4/d14/f1f x:0 0 0 2024-04-06T12:23:00.515 INFO:tasks.workunit.client.1.smithi195.stdout:1/90: write d4/fa [882987,113647] 0 2024-04-06T12:23:00.516 INFO:tasks.workunit.client.1.smithi195.stdout:1/91: dread - d4/d14/f1f zero size 2024-04-06T12:23:00.517 INFO:tasks.workunit.client.1.smithi195.stdout:2/66: dwrite d2/f4 [0,4194304] 0 2024-04-06T12:23:00.517 INFO:tasks.workunit.client.1.smithi195.stdout:3/101: rename f2 to d4/f22 0 2024-04-06T12:23:00.527 INFO:tasks.workunit.client.1.smithi195.stdout:2/67: dwrite d2/fe [0,4194304] 0 2024-04-06T12:23:00.527 INFO:tasks.workunit.client.1.smithi195.stdout:3/102: dwrite f0 [0,4194304] 0 2024-04-06T12:23:00.529 INFO:tasks.workunit.client.1.smithi195.stdout:3/103: fsync d4/d9/fd 0 2024-04-06T12:23:00.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/104: write f0 [937105,110570] 0 2024-04-06T12:23:00.535 INFO:tasks.workunit.client.1.smithi195.stdout:7/65: fdatasync f1 0 2024-04-06T12:23:00.535 INFO:tasks.workunit.client.1.smithi195.stdout:7/66: chown d4/d5/d11 118 1 2024-04-06T12:23:00.536 INFO:tasks.workunit.client.1.smithi195.stdout:2/68: fsync d2/f4 0 2024-04-06T12:23:00.536 INFO:tasks.workunit.client.1.smithi195.stdout:7/67: read d4/d5/ff [2399,67654] 0 2024-04-06T12:23:00.536 INFO:tasks.workunit.client.1.smithi195.stdout:9/94: symlink d3/l27 0 2024-04-06T12:23:00.539 INFO:tasks.workunit.client.1.smithi195.stdout:7/68: dread d4/d5/ff [0,4194304] 0 2024-04-06T12:23:00.540 INFO:tasks.workunit.client.1.smithi195.stdout:1/92: write d4/d14/d19/f1b [778006,100118] 0 2024-04-06T12:23:00.540 INFO:tasks.workunit.client.1.smithi195.stdout:7/69: chown d4/d5/dd 54343049 1 2024-04-06T12:23:00.543 INFO:tasks.workunit.client.1.smithi195.stdout:5/96: fsync d0/f6 0 2024-04-06T12:23:00.544 INFO:tasks.workunit.client.1.smithi195.stdout:5/97: dread - d0/f6 zero size 2024-04-06T12:23:00.546 INFO:tasks.workunit.client.1.smithi195.stdout:4/95: link d4/db/d18/d1a/f1c d4/db/d18/f1d 0 2024-04-06T12:23:00.550 INFO:tasks.workunit.client.1.smithi195.stdout:4/96: chown d4/db/d18/d1a/f1c 332 1 2024-04-06T12:23:00.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/109: mknod d4/d6/c1f 0 2024-04-06T12:23:00.560 INFO:tasks.workunit.client.1.smithi195.stdout:2/69: mkdir d2/d14 0 2024-04-06T12:23:00.561 INFO:tasks.workunit.client.1.smithi195.stdout:6/121: truncate d8/f23 1583699 0 2024-04-06T12:23:00.562 INFO:tasks.workunit.client.1.smithi195.stdout:6/122: write d8/fc [3323562,42929] 0 2024-04-06T12:23:00.562 INFO:tasks.workunit.client.1.smithi195.stdout:6/123: readlink d8/d9/l12 0 2024-04-06T12:23:00.563 INFO:tasks.workunit.client.1.smithi195.stdout:9/95: symlink d3/d10/l28 0 2024-04-06T12:23:00.568 INFO:tasks.workunit.client.1.smithi195.stdout:7/70: rename d4/d5 to d4/d16 0 2024-04-06T12:23:00.568 INFO:tasks.workunit.client.1.smithi195.stdout:7/71: readlink d4/d10/l15 0 2024-04-06T12:23:00.571 INFO:tasks.workunit.client.1.smithi195.stdout:1/93: dread d4/d14/d17/f10 [0,4194304] 0 2024-04-06T12:23:00.572 INFO:tasks.workunit.client.1.smithi195.stdout:5/98: fsync d0/fe 0 2024-04-06T12:23:00.575 INFO:tasks.workunit.client.1.smithi195.stdout:4/97: symlink d4/db/d18/d1a/l1e 0 2024-04-06T12:23:00.575 INFO:tasks.workunit.client.1.smithi195.stdout:4/98: read d4/f5 [1851117,31665] 0 2024-04-06T12:23:00.576 INFO:tasks.workunit.client.1.smithi195.stdout:4/99: truncate d4/db/f15 889389 0 2024-04-06T12:23:00.580 INFO:tasks.workunit.client.1.smithi195.stdout:2/70: creat d2/f15 x:0 0 0 2024-04-06T12:23:00.583 INFO:tasks.workunit.client.1.smithi195.stdout:9/96: write d3/f17 [4472123,84413] 0 2024-04-06T12:23:00.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/124: rename d8/d9/l18 to d8/d21/d24/l2e 0 2024-04-06T12:23:00.590 INFO:tasks.workunit.client.1.smithi195.stdout:1/94: creat d4/d14/d19/f20 x:0 0 0 2024-04-06T12:23:00.591 INFO:tasks.workunit.client.1.smithi195.stdout:1/95: write f1 [586414,83657] 0 2024-04-06T12:23:00.592 INFO:tasks.workunit.client.1.smithi195.stdout:1/96: fsync d4/d14/f15 0 2024-04-06T12:23:00.595 INFO:tasks.workunit.client.1.smithi195.stdout:4/100: mknod d4/db/c1f 0 2024-04-06T12:23:00.597 INFO:tasks.workunit.client.1.smithi195.stdout:8/74: link d6/c13 d6/d8/d12/c15 0 2024-04-06T12:23:00.598 INFO:tasks.workunit.client.1.smithi195.stdout:8/75: stat l4 0 2024-04-06T12:23:00.598 INFO:tasks.workunit.client.1.smithi195.stdout:8/76: truncate d6/dd/f14 416811 0 2024-04-06T12:23:00.599 INFO:tasks.workunit.client.1.smithi195.stdout:2/71: mknod d2/c16 0 2024-04-06T12:23:00.599 INFO:tasks.workunit.client.1.smithi195.stdout:8/77: write d6/dd/f14 [835082,21669] 0 2024-04-06T12:23:00.600 INFO:tasks.workunit.client.1.smithi195.stdout:2/72: write d2/f15 [28841,31296] 0 2024-04-06T12:23:00.601 INFO:tasks.workunit.client.1.smithi195.stdout:9/97: creat d3/d10/f29 x:0 0 0 2024-04-06T12:23:00.602 INFO:tasks.workunit.client.1.smithi195.stdout:9/98: write d3/d10/f22 [76881,109949] 0 2024-04-06T12:23:00.603 INFO:tasks.workunit.client.1.smithi195.stdout:6/125: mkdir d8/d21/d24/d27/d2f 0 2024-04-06T12:23:00.606 INFO:tasks.workunit.client.1.smithi195.stdout:7/72: creat d4/d16/dd/f17 x:0 0 0 2024-04-06T12:23:00.611 INFO:tasks.workunit.client.1.smithi195.stdout:5/99: mknod d0/c26 0 2024-04-06T12:23:00.611 INFO:tasks.workunit.client.1.smithi195.stdout:5/100: stat d0/da/dd 0 2024-04-06T12:23:00.612 INFO:tasks.workunit.client.1.smithi195.stdout:5/101: write d0/f24 [735281,49856] 0 2024-04-06T12:23:00.617 INFO:tasks.workunit.client.1.smithi195.stdout:3/105: getdents d4/df 0 2024-04-06T12:23:00.620 INFO:tasks.workunit.client.1.smithi195.stdout:4/101: mkdir d4/db/d20 0 2024-04-06T12:23:00.621 INFO:tasks.workunit.client.1.smithi195.stdout:4/102: chown d4/db/d18/d1a 168 1 2024-04-06T12:23:00.625 INFO:tasks.workunit.client.1.smithi195.stdout:2/73: mknod d2/c17 0 2024-04-06T12:23:00.635 INFO:tasks.workunit.client.1.smithi195.stdout:1/97: symlink d4/d14/l21 0 2024-04-06T12:23:00.636 INFO:tasks.workunit.client.1.smithi195.stdout:1/98: truncate d4/d14/f18 738649 0 2024-04-06T12:23:00.637 INFO:tasks.workunit.client.1.smithi195.stdout:3/106: write f3 [4812946,67357] 0 2024-04-06T12:23:00.637 INFO:tasks.workunit.client.1.smithi195.stdout:3/107: fsync d4/d9/f21 0 2024-04-06T12:23:00.638 INFO:tasks.workunit.client.1.smithi195.stdout:3/108: dread - d4/df/f20 zero size 2024-04-06T12:23:00.639 INFO:tasks.workunit.client.1.smithi195.stdout:4/103: read - d4/db/d18/f1d zero size 2024-04-06T12:23:00.652 INFO:tasks.workunit.client.1.smithi195.stdout:5/102: symlink d0/l27 0 2024-04-06T12:23:00.654 INFO:tasks.workunit.client.1.smithi195.stdout:1/99: creat d4/d14/d19/f22 x:0 0 0 2024-04-06T12:23:00.656 INFO:tasks.workunit.client.1.smithi195.stdout:1/100: dread - d4/d14/d19/f1a zero size 2024-04-06T12:23:00.657 INFO:tasks.workunit.client.1.smithi195.stdout:3/109: mknod d4/df/c23 0 2024-04-06T12:23:00.657 INFO:tasks.workunit.client.1.smithi195.stdout:1/101: stat d4/d14/d17/le 0 2024-04-06T12:23:00.658 INFO:tasks.workunit.client.1.smithi195.stdout:7/73: dwrite d4/d10/d12/f14 [0,4194304] 0 2024-04-06T12:23:00.658 INFO:tasks.workunit.client.1.smithi195.stdout:1/102: read - d4/d14/f1f zero size 2024-04-06T12:23:00.659 INFO:tasks.workunit.client.1.smithi195.stdout:0/110: sync 2024-04-06T12:23:00.660 INFO:tasks.workunit.client.1.smithi195.stdout:4/104: truncate d4/db/d18/d1a/f1c 947553 0 2024-04-06T12:23:00.660 INFO:tasks.workunit.client.1.smithi195.stdout:0/111: fdatasync d4/f9 0 2024-04-06T12:23:00.661 INFO:tasks.workunit.client.1.smithi195.stdout:1/103: truncate d4/d14/d19/f1a 980557 0 2024-04-06T12:23:00.662 INFO:tasks.workunit.client.1.smithi195.stdout:2/74: creat d2/d14/f18 x:0 0 0 2024-04-06T12:23:00.663 INFO:tasks.workunit.client.1.smithi195.stdout:0/112: write d4/fd [4779984,12806] 0 2024-04-06T12:23:00.665 INFO:tasks.workunit.client.1.smithi195.stdout:7/74: dread d4/d16/ff [0,4194304] 0 2024-04-06T12:23:00.665 INFO:tasks.workunit.client.1.smithi195.stdout:8/78: truncate d6/dd/f14 338763 0 2024-04-06T12:23:00.668 INFO:tasks.workunit.client.1.smithi195.stdout:9/99: truncate d3/f9 4027173 0 2024-04-06T12:23:00.672 INFO:tasks.workunit.client.1.smithi195.stdout:9/100: dread d3/de/f14 [0,4194304] 0 2024-04-06T12:23:00.674 INFO:tasks.workunit.client.1.smithi195.stdout:1/104: mkdir d4/d14/d19/d23 0 2024-04-06T12:23:00.677 INFO:tasks.workunit.client.1.smithi195.stdout:6/126: link f2 d8/d21/f30 0 2024-04-06T12:23:00.678 INFO:tasks.workunit.client.1.smithi195.stdout:6/127: write d8/f2a [1397826,52454] 0 2024-04-06T12:23:00.680 INFO:tasks.workunit.client.1.smithi195.stdout:0/113: chown d4/d6/f18 53079 1 2024-04-06T12:23:00.682 INFO:tasks.workunit.client.1.smithi195.stdout:5/103: mkdir d0/d28 0 2024-04-06T12:23:00.684 INFO:tasks.workunit.client.1.smithi195.stdout:8/79: creat d6/f16 x:0 0 0 2024-04-06T12:23:00.684 INFO:tasks.workunit.client.1.smithi195.stdout:8/80: dread - d6/f16 zero size 2024-04-06T12:23:00.685 INFO:tasks.workunit.client.1.smithi195.stdout:8/81: truncate d6/f16 984763 0 2024-04-06T12:23:00.685 INFO:tasks.workunit.client.1.smithi195.stdout:7/75: fsync d4/d16/fe 0 2024-04-06T12:23:00.686 INFO:tasks.workunit.client.1.smithi195.stdout:7/76: chown d4/c8 528254 1 2024-04-06T12:23:00.695 INFO:tasks.workunit.client.1.smithi195.stdout:4/105: fsync d4/db/d18/f1d 0 2024-04-06T12:23:00.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/101: rmdir d3/d10 39 2024-04-06T12:23:00.702 INFO:tasks.workunit.client.1.smithi195.stdout:2/75: write d2/fb [154279,130550] 0 2024-04-06T12:23:00.712 INFO:tasks.workunit.client.1.smithi195.stdout:3/110: truncate d4/f22 1644454 0 2024-04-06T12:23:00.718 INFO:tasks.workunit.client.1.smithi195.stdout:9/102: write d3/d10/f22 [35511,60542] 0 2024-04-06T12:23:00.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/77: dwrite d4/d16/ff [0,4194304] 0 2024-04-06T12:23:00.721 INFO:tasks.workunit.client.1.smithi195.stdout:7/78: stat d4/d16/lc 0 2024-04-06T12:23:00.721 INFO:tasks.workunit.client.1.smithi195.stdout:9/103: write d3/d10/f29 [204026,123502] 0 2024-04-06T12:23:00.723 INFO:tasks.workunit.client.1.smithi195.stdout:3/111: dwrite d4/d9/f21 [0,4194304] 0 2024-04-06T12:23:00.726 INFO:tasks.workunit.client.1.smithi195.stdout:5/104: mknod d0/da/d23/c29 0 2024-04-06T12:23:00.727 INFO:tasks.workunit.client.1.smithi195.stdout:5/105: dread - d0/da/fc zero size 2024-04-06T12:23:00.730 INFO:tasks.workunit.client.1.smithi195.stdout:5/106: chown d0/da/dd/d1c/c1e 106 1 2024-04-06T12:23:00.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/112: dwrite f0 [0,4194304] 0 2024-04-06T12:23:00.732 INFO:tasks.workunit.client.1.smithi195.stdout:3/113: chown d4/f12 8 1 2024-04-06T12:23:00.735 INFO:tasks.workunit.client.1.smithi195.stdout:1/105: truncate d4/d14/d19/f1b 3394010 0 2024-04-06T12:23:00.737 INFO:tasks.workunit.client.1.smithi195.stdout:1/106: readlink d4/d14/d17/le 0 2024-04-06T12:23:00.737 INFO:tasks.workunit.client.1.smithi195.stdout:3/114: dread d4/f7 [0,4194304] 0 2024-04-06T12:23:00.738 INFO:tasks.workunit.client.1.smithi195.stdout:1/107: stat d4/d14/d19/d23 0 2024-04-06T12:23:00.739 INFO:tasks.workunit.client.1.smithi195.stdout:1/108: write d4/d14/d19/f20 [683435,118367] 0 2024-04-06T12:23:00.744 INFO:tasks.workunit.client.1.smithi195.stdout:6/128: rename d8/d9 to d8/d21/d31 0 2024-04-06T12:23:00.744 INFO:tasks.workunit.client.1.smithi195.stdout:1/109: chown d4/d14/fd 128154 1 2024-04-06T12:23:00.746 INFO:tasks.workunit.client.1.smithi195.stdout:7/79: mkdir d4/d10/d18 0 2024-04-06T12:23:00.746 INFO:tasks.workunit.client.1.smithi195.stdout:7/80: dread f1 [0,4194304] 0 2024-04-06T12:23:00.746 INFO:tasks.workunit.client.1.smithi195.stdout:7/81: chown c2 70324774 1 2024-04-06T12:23:00.749 INFO:tasks.workunit.client.1.smithi195.stdout:6/129: dread d8/f1a [0,4194304] 0 2024-04-06T12:23:00.749 INFO:tasks.workunit.client.1.smithi195.stdout:0/114: creat d4/d6/f20 x:0 0 0 2024-04-06T12:23:00.755 INFO:tasks.workunit.client.1.smithi195.stdout:7/82: dwrite d4/d16/ff [4194304,4194304] 0 2024-04-06T12:23:00.758 INFO:tasks.workunit.client.1.smithi195.stdout:4/106: creat d4/f21 x:0 0 0 2024-04-06T12:23:00.759 INFO:tasks.workunit.client.1.smithi195.stdout:8/82: sync 2024-04-06T12:23:00.763 INFO:tasks.workunit.client.1.smithi195.stdout:2/76: rename d2/l7 to d2/d14/l19 0 2024-04-06T12:23:00.764 INFO:tasks.workunit.client.1.smithi195.stdout:7/83: dwrite d4/f7 [0,4194304] 0 2024-04-06T12:23:00.766 INFO:tasks.workunit.client.1.smithi195.stdout:2/77: chown d2/f13 2 1 2024-04-06T12:23:00.770 INFO:tasks.workunit.client.1.smithi195.stdout:4/107: dwrite d4/d6/f7 [0,4194304] 0 2024-04-06T12:23:00.772 INFO:tasks.workunit.client.1.smithi195.stdout:4/108: write d4/db/fe [3771750,9205] 0 2024-04-06T12:23:00.773 INFO:tasks.workunit.client.1.smithi195.stdout:6/130: chown d8/d21/d24/l2e 31431 1 2024-04-06T12:23:00.774 INFO:tasks.workunit.client.1.smithi195.stdout:0/115: creat d4/f21 x:0 0 0 2024-04-06T12:23:00.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/107: truncate d0/f11 180528 0 2024-04-06T12:23:00.787 INFO:tasks.workunit.client.1.smithi195.stdout:2/78: creat d2/f1a x:0 0 0 2024-04-06T12:23:00.789 INFO:tasks.workunit.client.1.smithi195.stdout:9/104: creat d3/f2a x:0 0 0 2024-04-06T12:23:00.789 INFO:tasks.workunit.client.1.smithi195.stdout:9/105: chown d3/d10/f22 4264657 1 2024-04-06T12:23:00.789 INFO:tasks.workunit.client.1.smithi195.stdout:9/106: chown d3/f2a 2245128 1 2024-04-06T12:23:00.790 INFO:tasks.workunit.client.1.smithi195.stdout:9/107: readlink d3/d10/l19 0 2024-04-06T12:23:00.790 INFO:tasks.workunit.client.1.smithi195.stdout:9/108: fsync f1 0 2024-04-06T12:23:00.793 INFO:tasks.workunit.client.1.smithi195.stdout:4/109: unlink d4/d6/f8 0 2024-04-06T12:23:00.796 INFO:tasks.workunit.client.1.smithi195.stdout:0/116: write d4/d6/d1a/f1b [238623,104518] 0 2024-04-06T12:23:00.796 INFO:tasks.workunit.client.1.smithi195.stdout:5/108: creat d0/da/dd/f2a x:0 0 0 2024-04-06T12:23:00.799 INFO:tasks.workunit.client.1.smithi195.stdout:3/115: creat d4/f24 x:0 0 0 2024-04-06T12:23:00.799 INFO:tasks.workunit.client.1.smithi195.stdout:9/109: dwrite d3/f23 [4194304,4194304] 0 2024-04-06T12:23:00.801 INFO:tasks.workunit.client.1.smithi195.stdout:7/84: mkdir d4/d10/d18/d19 0 2024-04-06T12:23:00.809 INFO:tasks.workunit.client.1.smithi195.stdout:1/110: dread d4/d14/d19/f1b [0,4194304] 0 2024-04-06T12:23:00.815 INFO:tasks.workunit.client.1.smithi195.stdout:4/110: symlink d4/db/d18/d1a/l22 0 2024-04-06T12:23:00.816 INFO:tasks.workunit.client.1.smithi195.stdout:1/111: dwrite d4/d14/d19/f20 [0,4194304] 0 2024-04-06T12:23:00.817 INFO:tasks.workunit.client.1.smithi195.stdout:4/111: write d4/db/d18/f1d [506607,42288] 0 2024-04-06T12:23:00.818 INFO:tasks.workunit.client.1.smithi195.stdout:0/117: write d4/d6/f8 [1924716,59200] 0 2024-04-06T12:23:00.820 INFO:tasks.workunit.client.1.smithi195.stdout:5/109: mknod d0/da/dd/c2b 0 2024-04-06T12:23:00.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/112: dread d4/fa [0,4194304] 0 2024-04-06T12:23:00.825 INFO:tasks.workunit.client.1.smithi195.stdout:9/110: symlink d3/d10/l2b 0 2024-04-06T12:23:00.826 INFO:tasks.workunit.client.1.smithi195.stdout:9/111: fsync d3/d10/f29 0 2024-04-06T12:23:00.826 INFO:tasks.workunit.client.1.smithi195.stdout:1/113: dread d4/f12 [0,4194304] 0 2024-04-06T12:23:00.827 INFO:tasks.workunit.client.1.smithi195.stdout:9/112: write d3/de/f1c [37965,73420] 0 2024-04-06T12:23:00.828 INFO:tasks.workunit.client.1.smithi195.stdout:1/114: write d4/d14/f1f [156240,27857] 0 2024-04-06T12:23:00.831 INFO:tasks.workunit.client.1.smithi195.stdout:9/113: dread d3/de/f14 [0,4194304] 0 2024-04-06T12:23:00.838 INFO:tasks.workunit.client.1.smithi195.stdout:0/118: readlink d4/d6/l16 0 2024-04-06T12:23:00.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/110: rmdir d0/da 39 2024-04-06T12:23:00.843 INFO:tasks.workunit.client.1.smithi195.stdout:7/85: creat d4/d10/d12/d13/f1a x:0 0 0 2024-04-06T12:23:00.847 INFO:tasks.workunit.client.1.smithi195.stdout:4/112: mkdir d4/db/d20/d23 0 2024-04-06T12:23:00.848 INFO:tasks.workunit.client.1.smithi195.stdout:4/113: stat d4/f5 0 2024-04-06T12:23:00.849 INFO:tasks.workunit.client.1.smithi195.stdout:0/119: symlink d4/d6/d1a/l22 0 2024-04-06T12:23:00.851 INFO:tasks.workunit.client.1.smithi195.stdout:8/83: sync 2024-04-06T12:23:00.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/111: chown d0/da/dd/c2b 730112 1 2024-04-06T12:23:00.852 INFO:tasks.workunit.client.1.smithi195.stdout:5/112: fsync d0/f24 0 2024-04-06T12:23:00.853 INFO:tasks.workunit.client.1.smithi195.stdout:3/116: link d4/d9/f21 d4/f25 0 2024-04-06T12:23:00.858 INFO:tasks.workunit.client.1.smithi195.stdout:7/86: rename d4/d16/ff to d4/d16/f1b 0 2024-04-06T12:23:00.860 INFO:tasks.workunit.client.1.smithi195.stdout:2/79: getdents d2/d14 0 2024-04-06T12:23:00.862 INFO:tasks.workunit.client.1.smithi195.stdout:9/114: mknod d3/c2c 0 2024-04-06T12:23:00.862 INFO:tasks.workunit.client.1.smithi195.stdout:7/87: dread d4/d10/d12/f14 [4194304,4194304] 0 2024-04-06T12:23:00.863 INFO:tasks.workunit.client.1.smithi195.stdout:7/88: truncate d4/f7 4328320 0 2024-04-06T12:23:00.864 INFO:tasks.workunit.client.1.smithi195.stdout:4/114: creat d4/db/d18/d1a/f24 x:0 0 0 2024-04-06T12:23:00.864 INFO:tasks.workunit.client.1.smithi195.stdout:7/89: write f1 [1690373,25325] 0 2024-04-06T12:23:00.865 INFO:tasks.workunit.client.1.smithi195.stdout:4/115: chown d4/db/d20/d23 23962857 1 2024-04-06T12:23:00.865 INFO:tasks.workunit.client.1.smithi195.stdout:4/116: chown d4/db/d20 55008999 1 2024-04-06T12:23:00.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/120: mknod d4/c23 0 2024-04-06T12:23:00.866 INFO:tasks.workunit.client.1.smithi195.stdout:4/117: read d4/db/ff [2722,118570] 0 2024-04-06T12:23:00.867 INFO:tasks.workunit.client.1.smithi195.stdout:8/84: symlink d6/db/l17 0 2024-04-06T12:23:00.872 INFO:tasks.workunit.client.1.smithi195.stdout:3/117: symlink d4/d9/l26 0 2024-04-06T12:23:00.876 INFO:tasks.workunit.client.1.smithi195.stdout:2/80: creat d2/d14/f1b x:0 0 0 2024-04-06T12:23:00.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/115: symlink d3/d10/l2d 0 2024-04-06T12:23:00.877 INFO:tasks.workunit.client.1.smithi195.stdout:9/116: stat f1 0 2024-04-06T12:23:00.877 INFO:tasks.workunit.client.1.smithi195.stdout:2/81: read - d2/f1a zero size 2024-04-06T12:23:00.879 INFO:tasks.workunit.client.1.smithi195.stdout:7/90: unlink f1 0 2024-04-06T12:23:00.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/118: dwrite d4/f24 [0,4194304] 0 2024-04-06T12:23:00.880 INFO:tasks.workunit.client.1.smithi195.stdout:7/91: chown c2 4426600 1 2024-04-06T12:23:00.880 INFO:tasks.workunit.client.1.smithi195.stdout:7/92: chown d4/d16/d11 10627904 1 2024-04-06T12:23:00.881 INFO:tasks.workunit.client.1.smithi195.stdout:7/93: stat d4/d16/dd/f17 0 2024-04-06T12:23:00.881 INFO:tasks.workunit.client.1.smithi195.stdout:7/94: chown d4/d10 0 1 2024-04-06T12:23:00.882 INFO:tasks.workunit.client.1.smithi195.stdout:7/95: chown d4/f7 518543246 1 2024-04-06T12:23:00.883 INFO:tasks.workunit.client.1.smithi195.stdout:4/118: mknod d4/db/d18/d1a/c25 0 2024-04-06T12:23:00.887 INFO:tasks.workunit.client.1.smithi195.stdout:5/113: mkdir d0/d2c 0 2024-04-06T12:23:00.887 INFO:tasks.workunit.client.1.smithi195.stdout:5/114: dread - d0/da/dd/f18 zero size 2024-04-06T12:23:00.893 INFO:tasks.workunit.client.1.smithi195.stdout:2/82: creat d2/f1c x:0 0 0 2024-04-06T12:23:00.894 INFO:tasks.workunit.client.1.smithi195.stdout:0/121: mkdir d4/d6/d24 0 2024-04-06T12:23:00.895 INFO:tasks.workunit.client.0.smithi152.stdout:1/20: getdents d2 0 2024-04-06T12:23:00.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/96: creat d4/d16/f1c x:0 0 0 2024-04-06T12:23:00.899 INFO:tasks.workunit.client.0.smithi152.stdout:3/18: write d0/f6 [909539,80540] 0 2024-04-06T12:23:00.899 INFO:tasks.workunit.client.1.smithi195.stdout:4/119: mknod d4/db/d20/c26 0 2024-04-06T12:23:00.903 INFO:tasks.workunit.client.1.smithi195.stdout:5/115: creat d0/da/dd/d1c/f2d x:0 0 0 2024-04-06T12:23:00.905 INFO:tasks.workunit.client.1.smithi195.stdout:9/117: symlink d3/l2e 0 2024-04-06T12:23:00.907 INFO:tasks.workunit.client.1.smithi195.stdout:2/83: creat d2/d14/f1d x:0 0 0 2024-04-06T12:23:00.909 INFO:tasks.workunit.client.1.smithi195.stdout:0/122: write d4/d6/f10 [1260023,13928] 0 2024-04-06T12:23:00.909 INFO:tasks.workunit.client.1.smithi195.stdout:0/123: dread - d4/f21 zero size 2024-04-06T12:23:00.910 INFO:tasks.workunit.client.0.smithi152.stdout:6/23: mkdir d7 0 2024-04-06T12:23:00.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/124: chown d4/d6/f10 3526 1 2024-04-06T12:23:00.912 INFO:tasks.workunit.client.0.smithi152.stdout:8/22: creat d4/f8 x:0 0 0 2024-04-06T12:23:00.913 INFO:tasks.workunit.client.1.smithi195.stdout:4/120: symlink d4/db/l27 0 2024-04-06T12:23:00.913 INFO:tasks.workunit.client.1.smithi195.stdout:4/121: stat d4/db/d20/c26 0 2024-04-06T12:23:00.915 INFO:tasks.workunit.client.0.smithi152.stdout:2/42: rmdir d0/d2 39 2024-04-06T12:23:00.916 INFO:tasks.workunit.client.1.smithi195.stdout:6/131: sync 2024-04-06T12:23:00.917 INFO:tasks.workunit.client.1.smithi195.stdout:5/116: mkdir d0/da/dd/d2e 0 2024-04-06T12:23:00.918 INFO:tasks.workunit.client.1.smithi195.stdout:5/117: fsync d0/da/f22 0 2024-04-06T12:23:00.918 INFO:tasks.workunit.client.0.smithi152.stdout:4/28: getdents . 0 2024-04-06T12:23:00.919 INFO:tasks.workunit.client.0.smithi152.stdout:4/29: truncate f5 1643009 0 2024-04-06T12:23:00.920 INFO:tasks.workunit.client.0.smithi152.stdout:9/26: creat d5/f9 x:0 0 0 2024-04-06T12:23:00.921 INFO:tasks.workunit.client.0.smithi152.stdout:9/27: chown c1 370509824 1 2024-04-06T12:23:00.922 INFO:tasks.workunit.client.1.smithi195.stdout:2/84: creat d2/f1e x:0 0 0 2024-04-06T12:23:00.922 INFO:tasks.workunit.client.0.smithi152.stdout:9/28: truncate d5/d6/f7 4617711 0 2024-04-06T12:23:00.923 INFO:tasks.workunit.client.0.smithi152.stdout:1/21: mknod d2/ca 0 2024-04-06T12:23:00.923 INFO:tasks.workunit.client.0.smithi152.stdout:9/29: truncate d5/f9 114910 0 2024-04-06T12:23:00.926 INFO:tasks.workunit.client.1.smithi195.stdout:7/97: dread f0 [0,4194304] 0 2024-04-06T12:23:00.929 INFO:tasks.workunit.client.0.smithi152.stdout:3/19: creat d0/f7 x:0 0 0 2024-04-06T12:23:00.930 INFO:tasks.workunit.client.1.smithi195.stdout:4/122: creat d4/db/d18/f28 x:0 0 0 2024-04-06T12:23:00.933 INFO:tasks.workunit.client.1.smithi195.stdout:4/123: chown d4/db/d18/d1a/l1e 28 1 2024-04-06T12:23:00.934 INFO:tasks.workunit.client.0.smithi152.stdout:0/33: dwrite f3 [0,4194304] 0 2024-04-06T12:23:00.936 INFO:tasks.workunit.client.0.smithi152.stdout:0/34: read f0 [311259,57270] 0 2024-04-06T12:23:00.936 INFO:tasks.workunit.client.0.smithi152.stdout:3/20: dread d0/f6 [0,4194304] 0 2024-04-06T12:23:00.937 INFO:tasks.workunit.client.1.smithi195.stdout:8/85: dwrite d6/dd/f14 [0,4194304] 0 2024-04-06T12:23:00.939 INFO:tasks.workunit.client.0.smithi152.stdout:0/35: read f0 [447202,48149] 0 2024-04-06T12:23:00.942 INFO:tasks.workunit.client.1.smithi195.stdout:0/125: unlink d4/c13 0 2024-04-06T12:23:00.945 INFO:tasks.workunit.client.1.smithi195.stdout:1/115: sync 2024-04-06T12:23:00.945 INFO:tasks.workunit.client.1.smithi195.stdout:7/98: symlink d4/d10/d18/l1d 0 2024-04-06T12:23:00.948 INFO:tasks.workunit.client.1.smithi195.stdout:6/132: truncate d8/d21/f30 3486195 0 2024-04-06T12:23:00.950 INFO:tasks.workunit.client.0.smithi152.stdout:9/30: symlink d5/d6/la 0 2024-04-06T12:23:00.957 INFO:tasks.workunit.client.1.smithi195.stdout:4/124: rmdir d4/db 39 2024-04-06T12:23:00.966 INFO:tasks.workunit.client.1.smithi195.stdout:2/85: dwrite d2/f5 [0,4194304] 0 2024-04-06T12:23:00.967 INFO:tasks.workunit.client.0.smithi152.stdout:6/24: link f3 d7/f8 0 2024-04-06T12:23:00.967 INFO:tasks.workunit.client.1.smithi195.stdout:8/86: write d6/dd/f14 [4772949,76332] 0 2024-04-06T12:23:00.969 INFO:tasks.workunit.client.0.smithi152.stdout:1/22: dwrite d2/f3 [0,4194304] 0 2024-04-06T12:23:00.971 INFO:tasks.workunit.client.0.smithi152.stdout:3/21: chown d0/l5 741400 1 2024-04-06T12:23:00.971 INFO:tasks.workunit.client.1.smithi195.stdout:1/116: rmdir d4/d14/d17 39 2024-04-06T12:23:00.975 INFO:tasks.workunit.client.0.smithi152.stdout:0/36: creat d4/fa x:0 0 0 2024-04-06T12:23:00.975 INFO:tasks.workunit.client.1.smithi195.stdout:7/99: creat d4/d10/f1e x:0 0 0 2024-04-06T12:23:00.977 INFO:tasks.workunit.client.1.smithi195.stdout:6/133: mkdir d8/d21/d24/d32 0 2024-04-06T12:23:00.978 INFO:tasks.workunit.client.1.smithi195.stdout:6/134: write d8/fc [202333,46830] 0 2024-04-06T12:23:00.980 INFO:tasks.workunit.client.1.smithi195.stdout:6/135: stat d8/d21/d31/fe 0 2024-04-06T12:23:00.980 INFO:tasks.workunit.client.1.smithi195.stdout:4/125: write d4/db/fe [3088460,68856] 0 2024-04-06T12:23:00.983 INFO:tasks.workunit.client.0.smithi152.stdout:7/9: getdents . 0 2024-04-06T12:23:00.984 INFO:tasks.workunit.client.1.smithi195.stdout:9/118: getdents d3 0 2024-04-06T12:23:00.985 INFO:tasks.workunit.client.0.smithi152.stdout:5/23: getdents d3 0 2024-04-06T12:23:00.985 INFO:tasks.workunit.client.1.smithi195.stdout:0/126: symlink d4/d6/l25 0 2024-04-06T12:23:00.986 INFO:tasks.workunit.client.0.smithi152.stdout:0/37: dwrite f1 [0,4194304] 0 2024-04-06T12:23:00.987 INFO:tasks.workunit.client.1.smithi195.stdout:8/87: read d6/d8/f10 [4479706,56478] 0 2024-04-06T12:23:00.992 INFO:tasks.workunit.client.1.smithi195.stdout:4/126: dwrite d4/db/f15 [0,4194304] 0 2024-04-06T12:23:00.994 INFO:tasks.workunit.client.0.smithi152.stdout:4/30: truncate f5 96639 0 2024-04-06T12:23:00.996 INFO:tasks.workunit.client.0.smithi152.stdout:4/31: write f1 [3491429,38614] 0 2024-04-06T12:23:00.997 INFO:tasks.workunit.client.0.smithi152.stdout:5/24: dwrite d3/f5 [0,4194304] 0 2024-04-06T12:23:00.999 INFO:tasks.workunit.client.0.smithi152.stdout:1/23: rename d2/f8 to d2/fb 0 2024-04-06T12:23:01.001 INFO:tasks.workunit.client.1.smithi195.stdout:0/127: dwrite d4/d6/f20 [0,4194304] 0 2024-04-06T12:23:01.002 INFO:tasks.workunit.client.1.smithi195.stdout:0/128: chown d4/fd 0 1 2024-04-06T12:23:01.004 INFO:tasks.workunit.client.1.smithi195.stdout:7/100: write f0 [2317291,107408] 0 2024-04-06T12:23:01.005 INFO:tasks.workunit.client.1.smithi195.stdout:3/119: sync 2024-04-06T12:23:01.005 INFO:tasks.workunit.client.1.smithi195.stdout:6/136: symlink d8/d21/d24/l33 0 2024-04-06T12:23:01.006 INFO:tasks.workunit.client.0.smithi152.stdout:3/22: rename d0/f6 to d0/f8 0 2024-04-06T12:23:01.007 INFO:tasks.workunit.client.1.smithi195.stdout:6/137: fsync d8/f15 0 2024-04-06T12:23:01.008 INFO:tasks.workunit.client.0.smithi152.stdout:2/43: mknod d0/d2/d5/c9 0 2024-04-06T12:23:01.009 INFO:tasks.workunit.client.1.smithi195.stdout:5/118: rename d0/l1d to d0/da/l2f 0 2024-04-06T12:23:01.009 INFO:tasks.workunit.client.1.smithi195.stdout:3/120: dread d4/f24 [0,4194304] 0 2024-04-06T12:23:01.013 INFO:tasks.workunit.client.0.smithi152.stdout:5/25: dwrite d3/f7 [0,4194304] 0 2024-04-06T12:23:01.014 INFO:tasks.workunit.client.1.smithi195.stdout:9/119: creat d3/d10/f2f x:0 0 0 2024-04-06T12:23:01.016 INFO:tasks.workunit.client.1.smithi195.stdout:9/120: fsync f1 0 2024-04-06T12:23:01.017 INFO:tasks.workunit.client.0.smithi152.stdout:7/10: creat f6 x:0 0 0 2024-04-06T12:23:01.018 INFO:tasks.workunit.client.1.smithi195.stdout:9/121: chown d3/f24 218 1 2024-04-06T12:23:01.020 INFO:tasks.workunit.client.0.smithi152.stdout:6/25: dwrite f3 [0,4194304] 0 2024-04-06T12:23:01.021 INFO:tasks.workunit.client.0.smithi152.stdout:0/38: mknod d4/cb 0 2024-04-06T12:23:01.021 INFO:tasks.workunit.client.1.smithi195.stdout:3/121: dwrite d4/d9/fd [0,4194304] 0 2024-04-06T12:23:01.021 INFO:tasks.workunit.client.1.smithi195.stdout:4/127: mknod d4/d6/c29 0 2024-04-06T12:23:01.021 INFO:tasks.workunit.client.1.smithi195.stdout:3/122: dread - d4/f12 zero size 2024-04-06T12:23:01.021 INFO:tasks.workunit.client.1.smithi195.stdout:4/128: write d4/f16 [788859,70076] 0 2024-04-06T12:23:01.023 INFO:tasks.workunit.client.1.smithi195.stdout:4/129: chown d4/db/d18/f28 294 1 2024-04-06T12:23:01.025 INFO:tasks.workunit.client.1.smithi195.stdout:7/101: unlink d4/d16/lc 0 2024-04-06T12:23:01.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:22:59.571731+0000 mgr.smithi195.ausetj (mgr.24375) 46 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 441 op/s 2024-04-06T12:23:01.028 INFO:tasks.workunit.client.0.smithi152.stdout:8/23: getdents d4 0 2024-04-06T12:23:01.028 INFO:tasks.workunit.client.0.smithi152.stdout:4/32: mkdir d7 0 2024-04-06T12:23:01.029 INFO:tasks.workunit.client.1.smithi195.stdout:7/102: dread f0 [0,4194304] 0 2024-04-06T12:23:01.034 INFO:tasks.workunit.client.1.smithi195.stdout:7/103: dread - d4/d16/dd/f17 zero size 2024-04-06T12:23:01.034 INFO:tasks.workunit.client.1.smithi195.stdout:6/138: creat d8/d21/d31/d26/f34 x:0 0 0 2024-04-06T12:23:01.037 INFO:tasks.workunit.client.1.smithi195.stdout:8/88: rename l4 to d6/db/l18 0 2024-04-06T12:23:01.038 INFO:tasks.workunit.client.1.smithi195.stdout:6/139: dread d8/d21/f2d [0,4194304] 0 2024-04-06T12:23:01.039 INFO:tasks.workunit.client.1.smithi195.stdout:6/140: write d8/d21/f2d [3112264,63478] 0 2024-04-06T12:23:01.040 INFO:tasks.workunit.client.1.smithi195.stdout:6/141: fdatasync d8/d21/d31/f11 0 2024-04-06T12:23:01.041 INFO:tasks.workunit.client.0.smithi152.stdout:2/44: unlink d0/d2/c4 0 2024-04-06T12:23:01.043 INFO:tasks.workunit.client.0.smithi152.stdout:8/24: dwrite f2 [0,4194304] 0 2024-04-06T12:23:01.043 INFO:tasks.workunit.client.0.smithi152.stdout:2/45: fsync d0/f3 0 2024-04-06T12:23:01.046 INFO:tasks.workunit.client.0.smithi152.stdout:3/23: creat d0/f9 x:0 0 0 2024-04-06T12:23:01.046 INFO:tasks.workunit.client.0.smithi152.stdout:3/24: readlink d0/l3 0 2024-04-06T12:23:01.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:22:59.571731+0000 mgr.smithi195.ausetj (mgr.24375) 46 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 441 op/s 2024-04-06T12:23:01.051 INFO:tasks.workunit.client.0.smithi152.stdout:0/39: mknod d4/cc 0 2024-04-06T12:23:01.051 INFO:tasks.workunit.client.1.smithi195.stdout:9/122: creat d3/d10/f30 x:0 0 0 2024-04-06T12:23:01.051 INFO:tasks.workunit.client.1.smithi195.stdout:9/123: write d3/d10/f30 [791478,31426] 0 2024-04-06T12:23:01.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/86: sync 2024-04-06T12:23:01.052 INFO:tasks.workunit.client.1.smithi195.stdout:1/117: sync 2024-04-06T12:23:01.053 INFO:tasks.workunit.client.0.smithi152.stdout:7/11: mknod c7 0 2024-04-06T12:23:01.053 INFO:tasks.workunit.client.0.smithi152.stdout:7/12: rmdir - no directory 2024-04-06T12:23:01.054 INFO:tasks.workunit.client.1.smithi195.stdout:1/118: fdatasync d4/d14/d19/f20 0 2024-04-06T12:23:01.054 INFO:tasks.workunit.client.0.smithi152.stdout:5/26: fdatasync d3/f7 0 2024-04-06T12:23:01.056 INFO:tasks.workunit.client.0.smithi152.stdout:5/27: fsync d3/f5 0 2024-04-06T12:23:01.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/87: truncate d2/f1c 119627 0 2024-04-06T12:23:01.057 INFO:tasks.workunit.client.1.smithi195.stdout:4/130: unlink d4/f21 0 2024-04-06T12:23:01.057 INFO:tasks.workunit.client.0.smithi152.stdout:5/28: write d3/f5 [1718728,16803] 0 2024-04-06T12:23:01.059 INFO:tasks.workunit.client.1.smithi195.stdout:9/124: dread d3/f9 [0,4194304] 0 2024-04-06T12:23:01.063 INFO:tasks.workunit.client.1.smithi195.stdout:7/104: creat d4/d10/d12/d13/f1f x:0 0 0 2024-04-06T12:23:01.064 INFO:tasks.workunit.client.1.smithi195.stdout:7/105: chown f0 192802 1 2024-04-06T12:23:01.066 INFO:tasks.workunit.client.1.smithi195.stdout:7/106: dread - d4/d16/f1c zero size 2024-04-06T12:23:01.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/89: truncate d6/d8/f10 995411 0 2024-04-06T12:23:01.069 INFO:tasks.workunit.client.1.smithi195.stdout:8/90: chown c2 13749 1 2024-04-06T12:23:01.070 INFO:tasks.workunit.client.1.smithi195.stdout:5/119: dwrite d0/f6 [0,4194304] 0 2024-04-06T12:23:01.070 INFO:tasks.workunit.client.0.smithi152.stdout:3/25: chown d0/f8 134116854 1 2024-04-06T12:23:01.070 INFO:tasks.workunit.client.0.smithi152.stdout:3/26: stat d0/f8 0 2024-04-06T12:23:01.071 INFO:tasks.workunit.client.0.smithi152.stdout:0/40: creat d4/fd x:0 0 0 2024-04-06T12:23:01.074 INFO:tasks.workunit.client.1.smithi195.stdout:6/142: rename d8/d21/d24 to d8/d21/d31/d35 0 2024-04-06T12:23:01.075 INFO:tasks.workunit.client.0.smithi152.stdout:6/26: mkdir d7/d9 0 2024-04-06T12:23:01.078 INFO:tasks.workunit.client.0.smithi152.stdout:7/13: mkdir d8 0 2024-04-06T12:23:01.079 INFO:tasks.workunit.client.1.smithi195.stdout:3/123: dwrite d4/d9/f21 [0,4194304] 0 2024-04-06T12:23:01.083 INFO:tasks.workunit.client.0.smithi152.stdout:4/33: rename l3 to d7/l8 0 2024-04-06T12:23:01.089 INFO:tasks.workunit.client.1.smithi195.stdout:0/129: rmdir d4/d6/d24 0 2024-04-06T12:23:01.090 INFO:tasks.workunit.client.1.smithi195.stdout:0/130: chown d4/d6/f20 33528 1 2024-04-06T12:23:01.090 INFO:tasks.workunit.client.0.smithi152.stdout:1/24: link l1 d2/lc 0 2024-04-06T12:23:01.091 INFO:tasks.workunit.client.0.smithi152.stdout:2/46: write d0/d2/f7 [4871948,98203] 0 2024-04-06T12:23:01.093 INFO:tasks.workunit.client.0.smithi152.stdout:1/25: dread - d2/fb zero size 2024-04-06T12:23:01.093 INFO:tasks.workunit.client.0.smithi152.stdout:2/47: chown d0/l8 77158 1 2024-04-06T12:23:01.095 INFO:tasks.workunit.client.0.smithi152.stdout:3/27: truncate d0/f8 782015 0 2024-04-06T12:23:01.097 INFO:tasks.workunit.client.1.smithi195.stdout:2/88: mknod d2/d14/c1f 0 2024-04-06T12:23:01.099 INFO:tasks.workunit.client.1.smithi195.stdout:2/89: dread d2/f15 [0,4194304] 0 2024-04-06T12:23:01.099 INFO:tasks.workunit.client.0.smithi152.stdout:0/41: mkdir d4/de 0 2024-04-06T12:23:01.105 INFO:tasks.workunit.client.1.smithi195.stdout:4/131: creat d4/db/d18/f2a x:0 0 0 2024-04-06T12:23:01.112 INFO:tasks.workunit.client.1.smithi195.stdout:8/91: symlink d6/l19 0 2024-04-06T12:23:01.112 INFO:tasks.workunit.client.1.smithi195.stdout:7/107: fdatasync d4/d16/f1b 0 2024-04-06T12:23:01.114 INFO:tasks.workunit.client.0.smithi152.stdout:4/34: mknod d7/c9 0 2024-04-06T12:23:01.114 INFO:tasks.workunit.client.0.smithi152.stdout:2/48: creat d0/d2/fa x:0 0 0 2024-04-06T12:23:01.114 INFO:tasks.workunit.client.0.smithi152.stdout:3/28: dwrite d0/f7 [0,4194304] 0 2024-04-06T12:23:01.114 INFO:tasks.workunit.client.0.smithi152.stdout:6/27: symlink d7/d9/la 0 2024-04-06T12:23:01.115 INFO:tasks.workunit.client.1.smithi195.stdout:6/143: write d8/d21/f2d [125787,124189] 0 2024-04-06T12:23:01.115 INFO:tasks.workunit.client.1.smithi195.stdout:6/144: stat d8/d21/d31/d35 0 2024-04-06T12:23:01.115 INFO:tasks.workunit.client.0.smithi152.stdout:3/29: dread - d0/f9 zero size 2024-04-06T12:23:01.116 INFO:tasks.workunit.client.1.smithi195.stdout:6/145: dread - d8/d21/d31/d26/f34 zero size 2024-04-06T12:23:01.120 INFO:tasks.workunit.client.1.smithi195.stdout:3/124: mknod d4/d9/c27 0 2024-04-06T12:23:01.122 INFO:tasks.workunit.client.0.smithi152.stdout:7/14: mknod d8/c9 0 2024-04-06T12:23:01.123 INFO:tasks.workunit.client.1.smithi195.stdout:1/119: mkdir d4/d14/d17/d24 0 2024-04-06T12:23:01.123 INFO:tasks.workunit.client.0.smithi152.stdout:2/49: dread d0/f3 [0,4194304] 0 2024-04-06T12:23:01.123 INFO:tasks.workunit.client.1.smithi195.stdout:1/120: write d4/d14/f15 [3123361,93534] 0 2024-04-06T12:23:01.125 INFO:tasks.workunit.client.0.smithi152.stdout:7/15: dread - f6 zero size 2024-04-06T12:23:01.130 INFO:tasks.workunit.client.0.smithi152.stdout:6/28: creat d7/fb x:0 0 0 2024-04-06T12:23:01.130 INFO:tasks.workunit.client.0.smithi152.stdout:6/29: dread - f5 zero size 2024-04-06T12:23:01.131 INFO:tasks.workunit.client.1.smithi195.stdout:2/90: symlink d2/d14/l20 0 2024-04-06T12:23:01.132 INFO:tasks.workunit.client.1.smithi195.stdout:2/91: write d2/d14/f1d [483150,118594] 0 2024-04-06T12:23:01.133 INFO:tasks.workunit.client.1.smithi195.stdout:2/92: read d2/f12 [2775449,20242] 0 2024-04-06T12:23:01.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/132: symlink d4/db/d18/l2b 0 2024-04-06T12:23:01.136 INFO:tasks.workunit.client.1.smithi195.stdout:4/133: dread d4/db/ff [0,4194304] 0 2024-04-06T12:23:01.138 INFO:tasks.workunit.client.1.smithi195.stdout:8/92: symlink d6/dd/l1a 0 2024-04-06T12:23:01.139 INFO:tasks.workunit.client.0.smithi152.stdout:3/30: write d0/f7 [4574844,125328] 0 2024-04-06T12:23:01.139 INFO:tasks.workunit.client.0.smithi152.stdout:0/42: dwrite f0 [0,4194304] 0 2024-04-06T12:23:01.142 INFO:tasks.workunit.client.1.smithi195.stdout:4/134: dwrite d4/db/fd [0,4194304] 0 2024-04-06T12:23:01.144 INFO:tasks.workunit.client.0.smithi152.stdout:4/35: truncate f5 328469 0 2024-04-06T12:23:01.145 INFO:tasks.workunit.client.1.smithi195.stdout:6/146: rmdir d8/d21/d31/d35 39 2024-04-06T12:23:01.147 INFO:tasks.workunit.client.0.smithi152.stdout:3/31: dread d0/f7 [0,4194304] 0 2024-04-06T12:23:01.150 INFO:tasks.workunit.client.1.smithi195.stdout:3/125: creat d4/df/f28 x:0 0 0 2024-04-06T12:23:01.150 INFO:tasks.workunit.client.1.smithi195.stdout:3/126: fdatasync d4/d9/fa 0 2024-04-06T12:23:01.151 INFO:tasks.workunit.client.0.smithi152.stdout:6/30: creat d7/fc x:0 0 0 2024-04-06T12:23:01.162 INFO:tasks.workunit.client.0.smithi152.stdout:4/36: dread f1 [0,4194304] 0 2024-04-06T12:23:01.220 INFO:tasks.workunit.client.0.smithi152.stdout:6/31: rename f5 to d7/fd 0 2024-04-06T12:23:01.220 INFO:tasks.workunit.client.0.smithi152.stdout:3/32: dwrite d0/f9 [0,4194304] 0 2024-04-06T12:23:01.220 INFO:tasks.workunit.client.0.smithi152.stdout:4/37: chown d7/l8 14446277 1 2024-04-06T12:23:01.220 INFO:tasks.workunit.client.0.smithi152.stdout:4/38: rename d7 to d7/da 22 2024-04-06T12:23:01.220 INFO:tasks.workunit.client.0.smithi152.stdout:2/50: getdents d0 0 2024-04-06T12:23:01.220 INFO:tasks.workunit.client.0.smithi152.stdout:6/32: dwrite d7/fc [0,4194304] 0 2024-04-06T12:23:01.220 INFO:tasks.workunit.client.0.smithi152.stdout:3/33: write d0/f7 [767654,119556] 0 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:3/34: chown d0/f7 1587248 1 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:0/43: link d4/cb d4/de/cf 0 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:4/39: write f1 [2993697,82926] 0 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:7/16: dwrite f3 [0,4194304] 0 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:6/33: dwrite f3 [0,4194304] 0 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:0/44: mknod d4/c10 0 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:3/35: dread d0/f8 [0,4194304] 0 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:7/17: rmdir d8 39 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:0/45: write d4/f8 [476033,24336] 0 2024-04-06T12:23:01.221 INFO:tasks.workunit.client.0.smithi152.stdout:2/51: truncate d0/d2/f7 2172470 0 2024-04-06T12:23:01.222 INFO:tasks.workunit.client.1.smithi195.stdout:0/131: symlink d4/d6/l26 0 2024-04-06T12:23:01.222 INFO:tasks.workunit.client.1.smithi195.stdout:5/120: creat d0/f30 x:0 0 0 2024-04-06T12:23:01.222 INFO:tasks.workunit.client.1.smithi195.stdout:4/135: creat d4/db/d18/f2c x:0 0 0 2024-04-06T12:23:01.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/147: creat d8/d21/d31/d26/f36 x:0 0 0 2024-04-06T12:23:01.222 INFO:tasks.workunit.client.1.smithi195.stdout:5/121: read d0/f3 [3011270,102818] 0 2024-04-06T12:23:01.222 INFO:tasks.workunit.client.1.smithi195.stdout:5/122: readlink d0/da/l1b 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:5/123: read - d0/da/dd/f18 zero size 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:1/121: dread d4/f12 [0,4194304] 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:5/124: read - d0/da/d13/f1f zero size 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:6/148: dread d8/f1a [0,4194304] 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:4/136: rename d4/db/d18/f2a to d4/db/d18/d1a/f2d 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:8/93: link l3 d6/l1b 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:8/94: write d6/f7 [3929976,83930] 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:2/93: getdents d2/d14 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:9/125: sync 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:9/126: readlink d3/l2e 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:8/95: dread d6/d8/f10 [0,4194304] 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/132: creat d4/d6/f27 x:0 0 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/133: chown d4/d6/f1d 390 1 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/134: write d4/f9 [1537569,47019] 0 2024-04-06T12:23:01.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/135: write d4/f5 [8733878,106835] 0 2024-04-06T12:23:01.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/94: mkdir d2/d21 0 2024-04-06T12:23:01.224 INFO:tasks.workunit.client.1.smithi195.stdout:8/96: dread d6/dd/f14 [0,4194304] 0 2024-04-06T12:23:01.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/95: readlink d2/ld 0 2024-04-06T12:23:01.224 INFO:tasks.workunit.client.1.smithi195.stdout:8/97: chown d6/l19 39 1 2024-04-06T12:23:01.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/96: dread - d2/f13 zero size 2024-04-06T12:23:01.225 INFO:tasks.workunit.client.1.smithi195.stdout:5/125: link d0/fe d0/d2c/f31 0 2024-04-06T12:23:01.225 INFO:tasks.workunit.client.1.smithi195.stdout:9/127: creat d3/d10/f31 x:0 0 0 2024-04-06T12:23:01.225 INFO:tasks.workunit.client.0.smithi152.stdout:3/36: creat d0/fa x:0 0 0 2024-04-06T12:23:01.225 INFO:tasks.workunit.client.0.smithi152.stdout:0/46: rename d4/fd to d4/de/f11 0 2024-04-06T12:23:01.226 INFO:tasks.workunit.client.1.smithi195.stdout:6/149: creat d8/d21/d31/d35/d32/f37 x:0 0 0 2024-04-06T12:23:01.226 INFO:tasks.workunit.client.0.smithi152.stdout:0/47: chown d4/cc 2 1 2024-04-06T12:23:01.228 INFO:tasks.workunit.client.1.smithi195.stdout:0/136: dwrite d4/d6/f20 [0,4194304] 0 2024-04-06T12:23:01.229 INFO:tasks.workunit.client.1.smithi195.stdout:0/137: chown d4/l1e 25201 1 2024-04-06T12:23:01.229 INFO:tasks.workunit.client.0.smithi152.stdout:7/18: dwrite f3 [0,4194304] 0 2024-04-06T12:23:01.230 INFO:tasks.workunit.client.1.smithi195.stdout:2/97: dwrite d2/f13 [0,4194304] 0 2024-04-06T12:23:01.230 INFO:tasks.workunit.client.1.smithi195.stdout:2/98: readlink d2/d14/l20 0 2024-04-06T12:23:01.232 INFO:tasks.workunit.client.1.smithi195.stdout:4/137: rename d4/db/d18/d1a/f1c to d4/f2e 0 2024-04-06T12:23:01.232 INFO:tasks.workunit.client.1.smithi195.stdout:8/98: rmdir d6/db 39 2024-04-06T12:23:01.234 INFO:tasks.workunit.client.1.smithi195.stdout:8/99: stat d6/d8 0 2024-04-06T12:23:01.234 INFO:tasks.workunit.client.1.smithi195.stdout:1/122: getdents d4/d14/d17 0 2024-04-06T12:23:01.234 INFO:tasks.workunit.client.0.smithi152.stdout:6/34: dwrite d7/fb [0,4194304] 0 2024-04-06T12:23:01.234 INFO:tasks.workunit.client.1.smithi195.stdout:5/126: symlink d0/da/d13/l32 0 2024-04-06T12:23:01.236 INFO:tasks.workunit.client.0.smithi152.stdout:2/52: dwrite d0/f3 [0,4194304] 0 2024-04-06T12:23:01.236 INFO:tasks.workunit.client.1.smithi195.stdout:5/127: chown d0 48418 1 2024-04-06T12:23:01.236 INFO:tasks.workunit.client.1.smithi195.stdout:8/100: chown d6/d8/d12 2814 1 2024-04-06T12:23:01.237 INFO:tasks.workunit.client.1.smithi195.stdout:1/123: readlink d4/l1e 0 2024-04-06T12:23:01.241 INFO:tasks.workunit.client.1.smithi195.stdout:0/138: symlink d4/l28 0 2024-04-06T12:23:01.246 INFO:tasks.workunit.client.0.smithi152.stdout:6/35: mknod d7/ce 0 2024-04-06T12:23:01.247 INFO:tasks.workunit.client.1.smithi195.stdout:2/99: creat d2/d14/f22 x:0 0 0 2024-04-06T12:23:01.247 INFO:tasks.workunit.client.1.smithi195.stdout:1/124: dread d4/d14/f18 [0,4194304] 0 2024-04-06T12:23:01.248 INFO:tasks.workunit.client.0.smithi152.stdout:6/36: chown c4 112140 1 2024-04-06T12:23:01.251 INFO:tasks.workunit.client.0.smithi152.stdout:2/53: symlink d0/d2/lb 0 2024-04-06T12:23:01.252 INFO:tasks.workunit.client.0.smithi152.stdout:3/37: fsync d0/fa 0 2024-04-06T12:23:01.252 INFO:tasks.workunit.client.0.smithi152.stdout:7/19: dwrite f3 [0,4194304] 0 2024-04-06T12:23:01.252 INFO:tasks.workunit.client.0.smithi152.stdout:7/20: fdatasync f6 0 2024-04-06T12:23:01.254 INFO:tasks.workunit.client.0.smithi152.stdout:2/54: write d0/f3 [2545747,63798] 0 2024-04-06T12:23:01.254 INFO:tasks.workunit.client.1.smithi195.stdout:4/138: dwrite d4/db/d18/d1a/f24 [0,4194304] 0 2024-04-06T12:23:01.254 INFO:tasks.workunit.client.0.smithi152.stdout:7/21: read f3 [2205018,120831] 0 2024-04-06T12:23:01.255 INFO:tasks.workunit.client.1.smithi195.stdout:9/128: rmdir d3/d10 39 2024-04-06T12:23:01.255 INFO:tasks.workunit.client.0.smithi152.stdout:3/38: write d0/fa [10046,97292] 0 2024-04-06T12:23:01.256 INFO:tasks.workunit.client.0.smithi152.stdout:2/55: write d0/f3 [4644604,56983] 0 2024-04-06T12:23:01.256 INFO:tasks.workunit.client.0.smithi152.stdout:6/37: creat d7/ff x:0 0 0 2024-04-06T12:23:01.256 INFO:tasks.workunit.client.1.smithi195.stdout:8/101: dwrite d6/f7 [4194304,4194304] 0 2024-04-06T12:23:01.258 INFO:tasks.workunit.client.1.smithi195.stdout:8/102: readlink d6/dd/l1a 0 2024-04-06T12:23:01.260 INFO:tasks.workunit.client.1.smithi195.stdout:0/139: dread d4/d6/f8 [0,4194304] 0 2024-04-06T12:23:01.269 INFO:tasks.workunit.client.1.smithi195.stdout:2/100: creat d2/f23 x:0 0 0 2024-04-06T12:23:01.271 INFO:tasks.workunit.client.0.smithi152.stdout:2/56: creat d0/fc x:0 0 0 2024-04-06T12:23:01.275 INFO:tasks.workunit.client.1.smithi195.stdout:6/150: creat d8/f38 x:0 0 0 2024-04-06T12:23:01.276 INFO:tasks.workunit.client.0.smithi152.stdout:3/39: creat d0/fb x:0 0 0 2024-04-06T12:23:01.278 INFO:tasks.workunit.client.1.smithi195.stdout:7/108: sync 2024-04-06T12:23:01.279 INFO:tasks.workunit.client.1.smithi195.stdout:0/140: dwrite d4/d6/f18 [0,4194304] 0 2024-04-06T12:23:01.281 INFO:tasks.workunit.client.1.smithi195.stdout:6/151: dread - d8/d21/d31/d26/f34 zero size 2024-04-06T12:23:01.283 INFO:tasks.workunit.client.0.smithi152.stdout:6/38: dwrite d7/fd [0,4194304] 0 2024-04-06T12:23:01.285 INFO:tasks.workunit.client.1.smithi195.stdout:0/141: dread d4/d6/d1a/f1b [0,4194304] 0 2024-04-06T12:23:01.287 INFO:tasks.workunit.client.1.smithi195.stdout:7/109: dwrite d4/f7 [0,4194304] 0 2024-04-06T12:23:01.287 INFO:tasks.workunit.client.1.smithi195.stdout:7/110: chown d4/d16 538180 1 2024-04-06T12:23:01.289 INFO:tasks.workunit.client.1.smithi195.stdout:7/111: write d4/d10/f1e [126816,17138] 0 2024-04-06T12:23:01.291 INFO:tasks.workunit.client.1.smithi195.stdout:4/139: mknod d4/d6/c2f 0 2024-04-06T12:23:01.291 INFO:tasks.workunit.client.1.smithi195.stdout:4/140: fsync d4/db/d18/f2c 0 2024-04-06T12:23:01.293 INFO:tasks.workunit.client.1.smithi195.stdout:8/103: rmdir d6/d8 39 2024-04-06T12:23:01.295 INFO:tasks.workunit.client.0.smithi152.stdout:6/39: creat d7/d9/f10 x:0 0 0 2024-04-06T12:23:01.296 INFO:tasks.workunit.client.0.smithi152.stdout:6/40: chown f6 494 1 2024-04-06T12:23:01.296 INFO:tasks.workunit.client.1.smithi195.stdout:1/125: mkdir d4/d14/d25 0 2024-04-06T12:23:01.297 INFO:tasks.workunit.client.1.smithi195.stdout:4/141: dread d4/f2e [0,4194304] 0 2024-04-06T12:23:01.298 INFO:tasks.workunit.client.1.smithi195.stdout:4/142: fdatasync d4/db/fd 0 2024-04-06T12:23:01.299 INFO:tasks.workunit.client.1.smithi195.stdout:2/101: rename d2/f15 to d2/d21/f24 0 2024-04-06T12:23:01.301 INFO:tasks.workunit.client.1.smithi195.stdout:1/126: truncate d4/d14/d19/f22 287847 0 2024-04-06T12:23:01.301 INFO:tasks.workunit.client.0.smithi152.stdout:2/57: dread - d0/fc zero size 2024-04-06T12:23:01.301 INFO:tasks.workunit.client.0.smithi152.stdout:2/58: write d0/fc [710191,59542] 0 2024-04-06T12:23:01.301 INFO:tasks.workunit.client.0.smithi152.stdout:3/40: rmdir d0 39 2024-04-06T12:23:01.301 INFO:tasks.workunit.client.1.smithi195.stdout:2/102: read - d2/d14/f1b zero size 2024-04-06T12:23:01.302 INFO:tasks.workunit.client.1.smithi195.stdout:1/127: readlink d4/l6 0 2024-04-06T12:23:01.302 INFO:tasks.workunit.client.1.smithi195.stdout:8/104: dwrite d6/f7 [0,4194304] 0 2024-04-06T12:23:01.303 INFO:tasks.workunit.client.1.smithi195.stdout:5/128: truncate d0/ff 3745786 0 2024-04-06T12:23:01.304 INFO:tasks.workunit.client.1.smithi195.stdout:2/103: truncate d2/f1c 1113009 0 2024-04-06T12:23:01.304 INFO:tasks.workunit.client.0.smithi152.stdout:6/41: dread d7/f8 [0,4194304] 0 2024-04-06T12:23:01.305 INFO:tasks.workunit.client.1.smithi195.stdout:2/104: fsync d2/f5 0 2024-04-06T12:23:01.309 INFO:tasks.workunit.client.1.smithi195.stdout:8/105: dwrite d6/f7 [4194304,4194304] 0 2024-04-06T12:23:01.313 INFO:tasks.workunit.client.0.smithi152.stdout:6/42: dwrite d7/fc [4194304,4194304] 0 2024-04-06T12:23:01.314 INFO:tasks.workunit.client.0.smithi152.stdout:2/59: dread d0/f3 [0,4194304] 0 2024-04-06T12:23:01.315 INFO:tasks.workunit.client.0.smithi152.stdout:6/43: read d7/f8 [2994064,27266] 0 2024-04-06T12:23:01.316 INFO:tasks.workunit.client.1.smithi195.stdout:6/152: read d8/f23 [175985,128010] 0 2024-04-06T12:23:01.319 INFO:tasks.workunit.client.0.smithi152.stdout:3/41: mknod d0/cc 0 2024-04-06T12:23:01.322 INFO:tasks.workunit.client.1.smithi195.stdout:0/142: creat d4/d6/d1a/f29 x:0 0 0 2024-04-06T12:23:01.323 INFO:tasks.workunit.client.1.smithi195.stdout:0/143: chown d4/d6/d1a/l1c 131133 1 2024-04-06T12:23:01.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/144: write d4/d6/f20 [3139224,46315] 0 2024-04-06T12:23:01.326 INFO:tasks.workunit.client.0.smithi152.stdout:6/44: mkdir d7/d9/d11 0 2024-04-06T12:23:01.327 INFO:tasks.workunit.client.0.smithi152.stdout:6/45: chown d7/ce 325 1 2024-04-06T12:23:01.328 INFO:tasks.workunit.client.0.smithi152.stdout:3/42: dwrite d0/f7 [0,4194304] 0 2024-04-06T12:23:01.329 INFO:tasks.workunit.client.0.smithi152.stdout:6/46: fdatasync d7/fd 0 2024-04-06T12:23:01.330 INFO:tasks.workunit.client.0.smithi152.stdout:6/47: dread - d7/ff zero size 2024-04-06T12:23:01.331 INFO:tasks.workunit.client.1.smithi195.stdout:4/143: unlink d4/db/fd 0 2024-04-06T12:23:01.332 INFO:tasks.workunit.client.0.smithi152.stdout:6/48: dread - d7/d9/f10 zero size 2024-04-06T12:23:01.338 INFO:tasks.workunit.client.0.smithi152.stdout:2/60: creat d0/fd x:0 0 0 2024-04-06T12:23:01.338 INFO:tasks.workunit.client.1.smithi195.stdout:1/128: creat d4/f26 x:0 0 0 2024-04-06T12:23:01.338 INFO:tasks.workunit.client.1.smithi195.stdout:5/129: mkdir d0/da/dd/d33 0 2024-04-06T12:23:01.339 INFO:tasks.workunit.client.1.smithi195.stdout:1/129: read d4/f12 [1848279,45653] 0 2024-04-06T12:23:01.340 INFO:tasks.workunit.client.1.smithi195.stdout:9/129: mkdir d3/d10/d32 0 2024-04-06T12:23:01.341 INFO:tasks.workunit.client.0.smithi152.stdout:3/43: dwrite d0/fb [0,4194304] 0 2024-04-06T12:23:01.342 INFO:tasks.workunit.client.0.smithi152.stdout:3/44: write d0/fb [2054638,106052] 0 2024-04-06T12:23:01.346 INFO:tasks.workunit.client.1.smithi195.stdout:2/105: rename d2/d14/l20 to d2/d14/l25 0 2024-04-06T12:23:01.348 INFO:tasks.workunit.client.0.smithi152.stdout:3/45: dread d0/fb [0,4194304] 0 2024-04-06T12:23:01.350 INFO:tasks.workunit.client.0.smithi152.stdout:2/61: read d0/f3 [1151184,107369] 0 2024-04-06T12:23:01.354 INFO:tasks.workunit.client.1.smithi195.stdout:6/153: creat d8/d21/d31/d35/f39 x:0 0 0 2024-04-06T12:23:01.368 INFO:tasks.workunit.client.1.smithi195.stdout:3/127: sync 2024-04-06T12:23:01.419 INFO:tasks.workunit.client.1.smithi195.stdout:7/112: sync 2024-04-06T12:23:01.424 INFO:tasks.workunit.client.0.smithi152.stdout:3/46: unlink d0/l5 0 2024-04-06T12:23:01.428 INFO:tasks.workunit.client.0.smithi152.stdout:3/47: dread d0/fb [0,4194304] 0 2024-04-06T12:23:01.428 INFO:tasks.workunit.client.1.smithi195.stdout:0/145: mknod d4/c2a 0 2024-04-06T12:23:01.435 INFO:tasks.workunit.client.0.smithi152.stdout:2/62: link d0/fc d0/d2/d5/fe 0 2024-04-06T12:23:01.438 INFO:tasks.workunit.client.1.smithi195.stdout:4/144: dwrite d4/db/d18/d1a/f2d [0,4194304] 0 2024-04-06T12:23:01.439 INFO:tasks.workunit.client.1.smithi195.stdout:4/145: stat d4/db 0 2024-04-06T12:23:01.443 INFO:tasks.workunit.client.1.smithi195.stdout:2/106: unlink d2/d14/f1b 0 2024-04-06T12:23:01.443 INFO:tasks.workunit.client.1.smithi195.stdout:2/107: read - d2/f1a zero size 2024-04-06T12:23:01.448 INFO:tasks.workunit.client.1.smithi195.stdout:6/154: creat d8/d21/d31/d35/d32/f3a x:0 0 0 2024-04-06T12:23:01.452 INFO:tasks.workunit.client.0.smithi152.stdout:2/63: rename d0/d2/f7 to d0/ff 0 2024-04-06T12:23:01.453 INFO:tasks.workunit.client.0.smithi152.stdout:3/48: dwrite d0/f8 [0,4194304] 0 2024-04-06T12:23:01.455 INFO:tasks.workunit.client.0.smithi152.stdout:2/64: readlink d0/l8 0 2024-04-06T12:23:01.456 INFO:tasks.workunit.client.1.smithi195.stdout:5/130: mkdir d0/d2c/d34 0 2024-04-06T12:23:01.458 INFO:tasks.workunit.client.1.smithi195.stdout:5/131: write d0/da/dd/d1c/f20 [4471867,93740] 0 2024-04-06T12:23:01.461 INFO:tasks.workunit.client.1.smithi195.stdout:9/130: symlink d3/de/l33 0 2024-04-06T12:23:01.461 INFO:tasks.workunit.client.0.smithi152.stdout:3/49: truncate d0/fa 200589 0 2024-04-06T12:23:01.462 INFO:tasks.workunit.client.1.smithi195.stdout:4/146: symlink d4/db/d18/d1a/l30 0 2024-04-06T12:23:01.465 INFO:tasks.workunit.client.1.smithi195.stdout:2/108: creat d2/f26 x:0 0 0 2024-04-06T12:23:01.466 INFO:tasks.workunit.client.1.smithi195.stdout:8/106: creat d6/f1c x:0 0 0 2024-04-06T12:23:01.466 INFO:tasks.workunit.client.1.smithi195.stdout:8/107: fdatasync d6/f1c 0 2024-04-06T12:23:01.467 INFO:tasks.workunit.client.1.smithi195.stdout:8/108: write d6/f7 [8827391,89057] 0 2024-04-06T12:23:01.469 INFO:tasks.workunit.client.1.smithi195.stdout:6/155: unlink d8/f38 0 2024-04-06T12:23:01.470 INFO:tasks.workunit.client.1.smithi195.stdout:6/156: readlink d8/d21/d31/d35/d27/l2c 0 2024-04-06T12:23:01.472 INFO:tasks.workunit.client.1.smithi195.stdout:3/128: fdatasync f3 0 2024-04-06T12:23:01.475 INFO:tasks.workunit.client.1.smithi195.stdout:7/113: truncate d4/d16/f1b 2016815 0 2024-04-06T12:23:01.480 INFO:tasks.workunit.client.1.smithi195.stdout:0/146: rename d4/d6/c17 to d4/d6/d1a/c2b 0 2024-04-06T12:23:01.484 INFO:tasks.workunit.client.0.smithi152.stdout:2/65: write d0/fc [799928,62538] 0 2024-04-06T12:23:01.493 INFO:tasks.workunit.client.1.smithi195.stdout:1/130: link d4/d14/d17/f10 d4/d14/d17/d24/f27 0 2024-04-06T12:23:01.494 INFO:tasks.workunit.client.1.smithi195.stdout:1/131: dread d4/d14/d19/f22 [0,4194304] 0 2024-04-06T12:23:01.497 INFO:tasks.workunit.client.1.smithi195.stdout:2/109: unlink d2/d14/c1f 0 2024-04-06T12:23:01.502 INFO:tasks.workunit.client.1.smithi195.stdout:6/157: symlink d8/d21/d31/d35/d32/l3b 0 2024-04-06T12:23:01.510 INFO:tasks.workunit.client.1.smithi195.stdout:7/114: rmdir d4/d10/d12/d13 39 2024-04-06T12:23:01.514 INFO:tasks.workunit.client.1.smithi195.stdout:6/158: dread f5 [0,4194304] 0 2024-04-06T12:23:01.515 INFO:tasks.workunit.client.1.smithi195.stdout:9/131: dread d3/f5 [0,4194304] 0 2024-04-06T12:23:01.516 INFO:tasks.workunit.client.1.smithi195.stdout:4/147: creat d4/db/d20/d23/f31 x:0 0 0 2024-04-06T12:23:01.524 INFO:tasks.workunit.client.1.smithi195.stdout:2/110: creat d2/d21/f27 x:0 0 0 2024-04-06T12:23:01.527 INFO:tasks.workunit.client.1.smithi195.stdout:8/109: mkdir d6/d1d 0 2024-04-06T12:23:01.529 INFO:tasks.workunit.client.1.smithi195.stdout:2/111: dwrite d2/f26 [0,4194304] 0 2024-04-06T12:23:01.535 INFO:tasks.workunit.client.1.smithi195.stdout:7/115: creat d4/f20 x:0 0 0 2024-04-06T12:23:01.535 INFO:tasks.workunit.client.1.smithi195.stdout:7/116: dread - d4/d16/dd/f17 zero size 2024-04-06T12:23:01.543 INFO:tasks.workunit.client.1.smithi195.stdout:3/129: write d4/f7 [3541486,122159] 0 2024-04-06T12:23:01.546 INFO:tasks.workunit.client.1.smithi195.stdout:5/132: write d0/ff [507173,33663] 0 2024-04-06T12:23:01.547 INFO:tasks.workunit.client.1.smithi195.stdout:1/132: mkdir d4/d14/d19/d23/d28 0 2024-04-06T12:23:01.549 INFO:tasks.workunit.client.1.smithi195.stdout:8/110: dread d6/d8/f10 [0,4194304] 0 2024-04-06T12:23:01.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/112: creat d2/d21/f28 x:0 0 0 2024-04-06T12:23:01.559 INFO:tasks.workunit.client.1.smithi195.stdout:7/117: dread d4/d10/d12/f14 [0,4194304] 0 2024-04-06T12:23:01.559 INFO:tasks.workunit.client.1.smithi195.stdout:2/113: dwrite d2/f13 [0,4194304] 0 2024-04-06T12:23:01.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/147: rename d4/d6/f10 to d4/d6/f2c 0 2024-04-06T12:23:01.564 INFO:tasks.workunit.client.1.smithi195.stdout:3/130: creat d4/d9/f29 x:0 0 0 2024-04-06T12:23:01.566 INFO:tasks.workunit.client.1.smithi195.stdout:7/118: dwrite d4/d10/f1e [0,4194304] 0 2024-04-06T12:23:01.572 INFO:tasks.workunit.client.1.smithi195.stdout:8/111: read d6/dd/f14 [1166973,56195] 0 2024-04-06T12:23:01.580 INFO:tasks.workunit.client.1.smithi195.stdout:2/114: dread d2/d21/f24 [0,4194304] 0 2024-04-06T12:23:01.582 INFO:tasks.workunit.client.1.smithi195.stdout:0/148: symlink d4/d6/d1a/l2d 0 2024-04-06T12:23:01.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/159: creat d8/d21/d31/f3c x:0 0 0 2024-04-06T12:23:01.588 INFO:tasks.workunit.client.1.smithi195.stdout:2/115: dwrite d2/d21/f27 [0,4194304] 0 2024-04-06T12:23:01.588 INFO:tasks.workunit.client.1.smithi195.stdout:7/119: write f0 [3433421,108801] 0 2024-04-06T12:23:01.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/131: dread d4/f22 [0,4194304] 0 2024-04-06T12:23:01.589 INFO:tasks.workunit.client.1.smithi195.stdout:5/133: mkdir d0/d35 0 2024-04-06T12:23:01.589 INFO:tasks.workunit.client.1.smithi195.stdout:3/132: stat d4/d9 0 2024-04-06T12:23:01.591 INFO:tasks.workunit.client.1.smithi195.stdout:3/133: fsync d4/f12 0 2024-04-06T12:23:01.594 INFO:tasks.workunit.client.1.smithi195.stdout:7/120: dwrite f0 [0,4194304] 0 2024-04-06T12:23:01.594 INFO:tasks.workunit.client.1.smithi195.stdout:9/132: sync 2024-04-06T12:23:01.597 INFO:tasks.workunit.client.1.smithi195.stdout:8/112: symlink d6/d8/l1e 0 2024-04-06T12:23:01.598 INFO:tasks.workunit.client.1.smithi195.stdout:1/133: write d4/fa [760922,70577] 0 2024-04-06T12:23:01.601 INFO:tasks.workunit.client.1.smithi195.stdout:0/149: rename d4/d6/d1a/f1b to d4/f2e 0 2024-04-06T12:23:01.603 INFO:tasks.workunit.client.1.smithi195.stdout:0/150: dread - d4/d6/d1a/f29 zero size 2024-04-06T12:23:01.603 INFO:tasks.workunit.client.1.smithi195.stdout:7/121: dwrite d4/f20 [0,4194304] 0 2024-04-06T12:23:01.604 INFO:tasks.workunit.client.1.smithi195.stdout:0/151: fdatasync d4/d6/f20 0 2024-04-06T12:23:01.609 INFO:tasks.workunit.client.1.smithi195.stdout:2/116: truncate d2/d21/f24 755021 0 2024-04-06T12:23:01.614 INFO:tasks.workunit.client.1.smithi195.stdout:3/134: creat d4/d9/f2a x:0 0 0 2024-04-06T12:23:01.614 INFO:tasks.workunit.client.1.smithi195.stdout:3/135: stat d4/d9/f1e 0 2024-04-06T12:23:01.615 INFO:tasks.workunit.client.1.smithi195.stdout:3/136: fdatasync d4/f7 0 2024-04-06T12:23:01.616 INFO:tasks.workunit.client.1.smithi195.stdout:9/133: write d3/f17 [3781161,17534] 0 2024-04-06T12:23:01.617 INFO:tasks.workunit.client.1.smithi195.stdout:9/134: chown d3/de/f14 5282 1 2024-04-06T12:23:01.621 INFO:tasks.workunit.client.1.smithi195.stdout:1/134: creat d4/d14/d19/f29 x:0 0 0 2024-04-06T12:23:01.622 INFO:tasks.workunit.client.1.smithi195.stdout:6/160: mkdir d8/d3d 0 2024-04-06T12:23:01.627 INFO:tasks.workunit.client.1.smithi195.stdout:6/161: dwrite d8/f15 [0,4194304] 0 2024-04-06T12:23:01.630 INFO:tasks.workunit.client.1.smithi195.stdout:5/134: symlink d0/da/dd/d33/l36 0 2024-04-06T12:23:01.644 INFO:tasks.workunit.client.1.smithi195.stdout:2/117: truncate d2/f5 3422738 0 2024-04-06T12:23:01.645 INFO:tasks.workunit.client.1.smithi195.stdout:5/135: mkdir d0/d2c/d37 0 2024-04-06T12:23:01.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/136: dread - d0/da/f22 zero size 2024-04-06T12:23:01.658 INFO:tasks.workunit.client.1.smithi195.stdout:5/137: mkdir d0/da/d23/d38 0 2024-04-06T12:23:01.662 INFO:tasks.workunit.client.1.smithi195.stdout:4/148: sync 2024-04-06T12:23:01.662 INFO:tasks.workunit.client.1.smithi195.stdout:9/135: rename d3/d10/l2d to d3/l34 0 2024-04-06T12:23:01.663 INFO:tasks.workunit.client.1.smithi195.stdout:4/149: chown d4/d6/c1b 1 1 2024-04-06T12:23:01.664 INFO:tasks.workunit.client.1.smithi195.stdout:1/135: rmdir d4/d14/d25 0 2024-04-06T12:23:01.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/118: truncate d2/d21/f24 171881 0 2024-04-06T12:23:01.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/150: dwrite d4/db/fe [0,4194304] 0 2024-04-06T12:23:01.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/151: stat d4/db/c1f 0 2024-04-06T12:23:01.670 INFO:tasks.workunit.client.1.smithi195.stdout:4/152: write d4/db/d20/d23/f31 [462140,85459] 0 2024-04-06T12:23:01.670 INFO:tasks.workunit.client.1.smithi195.stdout:6/162: write d8/d21/f30 [454095,114742] 0 2024-04-06T12:23:01.671 INFO:tasks.workunit.client.1.smithi195.stdout:5/138: creat d0/da/d13/f39 x:0 0 0 2024-04-06T12:23:01.673 INFO:tasks.workunit.client.1.smithi195.stdout:5/139: chown d0/da/d23 13 1 2024-04-06T12:23:01.675 INFO:tasks.workunit.client.1.smithi195.stdout:3/137: getdents d4/de 0 2024-04-06T12:23:01.675 INFO:tasks.workunit.client.1.smithi195.stdout:3/138: dread - d4/df/f1b zero size 2024-04-06T12:23:01.676 INFO:tasks.workunit.client.1.smithi195.stdout:9/136: creat d3/d10/f35 x:0 0 0 2024-04-06T12:23:01.677 INFO:tasks.workunit.client.1.smithi195.stdout:9/137: rename d3 to d3/d10/d32/d36 22 2024-04-06T12:23:01.680 INFO:tasks.workunit.client.1.smithi195.stdout:7/122: link d4/la d4/d10/d12/d13/l21 0 2024-04-06T12:23:01.681 INFO:tasks.workunit.client.1.smithi195.stdout:2/119: mkdir d2/d21/d29 0 2024-04-06T12:23:01.688 INFO:tasks.workunit.client.1.smithi195.stdout:5/140: creat d0/da/d23/f3a x:0 0 0 2024-04-06T12:23:01.690 INFO:tasks.workunit.client.1.smithi195.stdout:4/153: dwrite d4/f2e [0,4194304] 0 2024-04-06T12:23:01.690 INFO:tasks.workunit.client.1.smithi195.stdout:6/163: dread f2 [0,4194304] 0 2024-04-06T12:23:01.690 INFO:tasks.workunit.client.1.smithi195.stdout:4/154: stat d4 0 2024-04-06T12:23:01.691 INFO:tasks.workunit.client.1.smithi195.stdout:3/139: mkdir d4/d9/d2b 0 2024-04-06T12:23:01.691 INFO:tasks.workunit.client.1.smithi195.stdout:4/155: write d4/db/d18/f1d [1204263,118154] 0 2024-04-06T12:23:01.697 INFO:tasks.workunit.client.1.smithi195.stdout:3/140: dread d4/f25 [0,4194304] 0 2024-04-06T12:23:01.697 INFO:tasks.workunit.client.1.smithi195.stdout:7/123: dread d4/d16/fe [0,4194304] 0 2024-04-06T12:23:01.697 INFO:tasks.workunit.client.1.smithi195.stdout:7/124: chown d4/d16/d11 147471 1 2024-04-06T12:23:01.698 INFO:tasks.workunit.client.1.smithi195.stdout:3/141: chown d4/de/c1c 421790 1 2024-04-06T12:23:01.698 INFO:tasks.workunit.client.1.smithi195.stdout:7/125: stat d4/d10/d18/l1d 0 2024-04-06T12:23:01.702 INFO:tasks.workunit.client.1.smithi195.stdout:1/136: write d4/d14/d19/f22 [739800,129426] 0 2024-04-06T12:23:01.704 INFO:tasks.workunit.client.1.smithi195.stdout:8/113: sync 2024-04-06T12:23:01.712 INFO:tasks.workunit.client.1.smithi195.stdout:4/156: creat d4/db/f32 x:0 0 0 2024-04-06T12:23:01.716 INFO:tasks.workunit.client.1.smithi195.stdout:3/142: mknod d4/df/c2c 0 2024-04-06T12:23:01.717 INFO:tasks.workunit.client.1.smithi195.stdout:3/143: read - d4/d9/f18 zero size 2024-04-06T12:23:01.717 INFO:tasks.workunit.client.1.smithi195.stdout:3/144: chown d4/d9/d2b 282892503 1 2024-04-06T12:23:01.719 INFO:tasks.workunit.client.1.smithi195.stdout:3/145: dread f3 [0,4194304] 0 2024-04-06T12:23:01.727 INFO:tasks.workunit.client.1.smithi195.stdout:8/114: chown d6/db 13 1 2024-04-06T12:23:01.730 INFO:tasks.workunit.client.1.smithi195.stdout:6/164: mknod d8/d3d/c3e 0 2024-04-06T12:23:01.733 INFO:tasks.workunit.client.1.smithi195.stdout:4/157: mknod d4/db/d18/c33 0 2024-04-06T12:23:01.736 INFO:tasks.workunit.client.1.smithi195.stdout:2/120: truncate d2/d21/f27 3389832 0 2024-04-06T12:23:01.736 INFO:tasks.workunit.client.1.smithi195.stdout:9/138: dwrite d3/f9 [0,4194304] 0 2024-04-06T12:23:01.737 INFO:tasks.workunit.client.1.smithi195.stdout:9/139: fdatasync f1 0 2024-04-06T12:23:01.737 INFO:tasks.workunit.client.1.smithi195.stdout:9/140: chown d3/de/l13 22 1 2024-04-06T12:23:01.738 INFO:tasks.workunit.client.1.smithi195.stdout:9/141: dread - d3/d10/f35 zero size 2024-04-06T12:23:01.740 INFO:tasks.workunit.client.1.smithi195.stdout:3/146: creat d4/d9/f2d x:0 0 0 2024-04-06T12:23:01.741 INFO:tasks.workunit.client.1.smithi195.stdout:3/147: fdatasync d4/d9/f2d 0 2024-04-06T12:23:01.741 INFO:tasks.workunit.client.1.smithi195.stdout:1/137: mkdir d4/d14/d17/d24/d2a 0 2024-04-06T12:23:01.744 INFO:tasks.workunit.client.1.smithi195.stdout:9/142: dwrite d3/d10/f30 [0,4194304] 0 2024-04-06T12:23:01.748 INFO:tasks.workunit.client.1.smithi195.stdout:6/165: rmdir d8/d21/d31/d35/d27 39 2024-04-06T12:23:01.754 INFO:tasks.workunit.client.1.smithi195.stdout:2/121: chown d2/d14/l25 4069291 1 2024-04-06T12:23:01.754 INFO:tasks.workunit.client.1.smithi195.stdout:2/122: chown d2/f4 306000 1 2024-04-06T12:23:01.755 INFO:tasks.workunit.client.1.smithi195.stdout:2/123: write d2/f13 [3445182,45888] 0 2024-04-06T12:23:01.756 INFO:tasks.workunit.client.1.smithi195.stdout:2/124: write d2/f1c [1686911,11368] 0 2024-04-06T12:23:01.757 INFO:tasks.workunit.client.1.smithi195.stdout:2/125: write d2/fe [4885185,64604] 0 2024-04-06T12:23:01.762 INFO:tasks.workunit.client.1.smithi195.stdout:3/148: chown d4/d9/l1f 24547174 1 2024-04-06T12:23:01.762 INFO:tasks.workunit.client.1.smithi195.stdout:2/126: dread d2/f4 [0,4194304] 0 2024-04-06T12:23:01.762 INFO:tasks.workunit.client.1.smithi195.stdout:7/126: truncate d4/f7 129650 0 2024-04-06T12:23:01.762 INFO:tasks.workunit.client.1.smithi195.stdout:2/127: fsync d2/f26 0 2024-04-06T12:23:01.763 INFO:tasks.workunit.client.1.smithi195.stdout:2/128: dread - d2/f1a zero size 2024-04-06T12:23:01.764 INFO:tasks.workunit.client.1.smithi195.stdout:5/141: link d0/f11 d0/da/dd/f3b 0 2024-04-06T12:23:01.772 INFO:tasks.workunit.client.1.smithi195.stdout:9/143: dwrite d3/f24 [0,4194304] 0 2024-04-06T12:23:01.772 INFO:tasks.workunit.client.1.smithi195.stdout:9/144: stat d3/d10/f29 0 2024-04-06T12:23:01.778 INFO:tasks.workunit.client.1.smithi195.stdout:6/166: dwrite f2 [0,4194304] 0 2024-04-06T12:23:01.779 INFO:tasks.workunit.client.1.smithi195.stdout:0/152: sync 2024-04-06T12:23:01.780 INFO:tasks.workunit.client.1.smithi195.stdout:0/153: chown d4/d6/f1d 4 1 2024-04-06T12:23:01.785 INFO:tasks.workunit.client.1.smithi195.stdout:8/115: truncate d6/f16 35577 0 2024-04-06T12:23:01.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/149: creat d4/de/f2e x:0 0 0 2024-04-06T12:23:01.790 INFO:tasks.workunit.client.1.smithi195.stdout:4/158: truncate d4/f16 22621 0 2024-04-06T12:23:01.792 INFO:tasks.workunit.client.1.smithi195.stdout:4/159: write d4/db/d18/f2c [258783,115540] 0 2024-04-06T12:23:01.793 INFO:tasks.workunit.client.1.smithi195.stdout:6/167: fdatasync f2 0 2024-04-06T12:23:01.808 INFO:tasks.workunit.client.1.smithi195.stdout:9/145: dwrite d3/de/f21 [0,4194304] 0 2024-04-06T12:23:01.810 INFO:tasks.workunit.client.1.smithi195.stdout:8/116: mknod d6/db/c1f 0 2024-04-06T12:23:01.811 INFO:tasks.workunit.client.1.smithi195.stdout:8/117: dread d6/d8/f10 [0,4194304] 0 2024-04-06T12:23:01.818 INFO:tasks.workunit.client.1.smithi195.stdout:1/138: link d4/d14/d17/d24/f27 d4/d14/d19/d23/d28/f2b 0 2024-04-06T12:23:01.830 INFO:tasks.workunit.client.1.smithi195.stdout:0/154: mkdir d4/d6/d2f 0 2024-04-06T12:23:01.831 INFO:tasks.workunit.client.1.smithi195.stdout:7/127: truncate d4/f20 1855227 0 2024-04-06T12:23:01.832 INFO:tasks.workunit.client.1.smithi195.stdout:9/146: truncate d3/f5 4651984 0 2024-04-06T12:23:01.836 INFO:tasks.workunit.client.1.smithi195.stdout:8/118: truncate d6/d8/f10 1595635 0 2024-04-06T12:23:01.836 INFO:tasks.workunit.client.1.smithi195.stdout:0/155: dwrite d4/f9 [0,4194304] 0 2024-04-06T12:23:01.839 INFO:tasks.workunit.client.1.smithi195.stdout:0/156: write d4/f5 [6039125,127920] 0 2024-04-06T12:23:01.840 INFO:tasks.workunit.client.1.smithi195.stdout:6/168: dwrite d8/d21/d31/fe [0,4194304] 0 2024-04-06T12:23:01.844 INFO:tasks.workunit.client.1.smithi195.stdout:2/129: dwrite d2/f5 [0,4194304] 0 2024-04-06T12:23:01.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/142: creat d0/da/f3c x:0 0 0 2024-04-06T12:23:01.853 INFO:tasks.workunit.client.1.smithi195.stdout:5/143: chown d0/c26 1652 1 2024-04-06T12:23:01.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/128: mkdir d4/d16/dd/d22 0 2024-04-06T12:23:01.860 INFO:tasks.workunit.client.1.smithi195.stdout:5/144: dwrite d0/f24 [0,4194304] 0 2024-04-06T12:23:01.861 INFO:tasks.workunit.client.1.smithi195.stdout:1/139: dwrite d4/f12 [0,4194304] 0 2024-04-06T12:23:01.861 INFO:tasks.workunit.client.1.smithi195.stdout:9/147: mkdir d3/de/d37 0 2024-04-06T12:23:01.867 INFO:tasks.workunit.client.1.smithi195.stdout:4/160: truncate d4/db/d18/d1a/f2d 1964098 0 2024-04-06T12:23:01.867 INFO:tasks.workunit.client.1.smithi195.stdout:5/145: truncate d0/da/f22 221793 0 2024-04-06T12:23:01.867 INFO:tasks.workunit.client.1.smithi195.stdout:3/150: creat d4/f2f x:0 0 0 2024-04-06T12:23:01.871 INFO:tasks.workunit.client.1.smithi195.stdout:0/157: rename d4/d6/l26 to d4/d6/d1a/l30 0 2024-04-06T12:23:01.871 INFO:tasks.workunit.client.1.smithi195.stdout:9/148: dwrite d3/d10/f11 [0,4194304] 0 2024-04-06T12:23:01.875 INFO:tasks.workunit.client.1.smithi195.stdout:6/169: unlink d8/d21/f2d 0 2024-04-06T12:23:01.875 INFO:tasks.workunit.client.1.smithi195.stdout:2/130: rmdir d2/d14 39 2024-04-06T12:23:01.883 INFO:tasks.workunit.client.1.smithi195.stdout:5/146: symlink d0/da/dd/d1c/l3d 0 2024-04-06T12:23:01.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/147: chown d0/f3 1733 1 2024-04-06T12:23:01.885 INFO:tasks.workunit.client.1.smithi195.stdout:5/148: readlink d0/da/dd/d33/l36 0 2024-04-06T12:23:01.886 INFO:tasks.workunit.client.1.smithi195.stdout:3/151: unlink d4/c6 0 2024-04-06T12:23:01.898 INFO:tasks.workunit.client.1.smithi195.stdout:6/170: mkdir d8/d3d/d3f 0 2024-04-06T12:23:01.902 INFO:tasks.workunit.client.1.smithi195.stdout:8/119: creat d6/f20 x:0 0 0 2024-04-06T12:23:01.905 INFO:tasks.workunit.client.1.smithi195.stdout:3/152: symlink d4/de/l30 0 2024-04-06T12:23:01.907 INFO:tasks.workunit.client.1.smithi195.stdout:4/161: rename d4/c19 to d4/d6/c34 0 2024-04-06T12:23:01.914 INFO:tasks.workunit.client.1.smithi195.stdout:7/129: dwrite d4/d16/f1b [0,4194304] 0 2024-04-06T12:23:01.915 INFO:tasks.workunit.client.1.smithi195.stdout:8/120: symlink d6/d8/l21 0 2024-04-06T12:23:01.916 INFO:tasks.workunit.client.1.smithi195.stdout:5/149: symlink d0/l3e 0 2024-04-06T12:23:01.917 INFO:tasks.workunit.client.1.smithi195.stdout:5/150: fdatasync d0/da/d13/f1f 0 2024-04-06T12:23:01.920 INFO:tasks.workunit.client.1.smithi195.stdout:4/162: mknod d4/db/d18/d1a/c35 0 2024-04-06T12:23:01.922 INFO:tasks.workunit.client.1.smithi195.stdout:4/163: read d4/db/d18/f2c [27336,52958] 0 2024-04-06T12:23:01.923 INFO:tasks.workunit.client.1.smithi195.stdout:4/164: chown d4/db/d18 3844 1 2024-04-06T12:23:01.923 INFO:tasks.workunit.client.1.smithi195.stdout:4/165: read d4/d6/f7 [2141376,113738] 0 2024-04-06T12:23:01.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/166: read d4/f12 [3995029,18163] 0 2024-04-06T12:23:01.926 INFO:tasks.workunit.client.1.smithi195.stdout:6/171: symlink d8/d21/l40 0 2024-04-06T12:23:01.927 INFO:tasks.workunit.client.1.smithi195.stdout:6/172: chown d8/f23 1 1 2024-04-06T12:23:01.927 INFO:tasks.workunit.client.1.smithi195.stdout:6/173: write d8/d21/f30 [3096134,92509] 0 2024-04-06T12:23:01.931 INFO:tasks.workunit.client.1.smithi195.stdout:6/174: dread f2 [0,4194304] 0 2024-04-06T12:23:01.932 INFO:tasks.workunit.client.1.smithi195.stdout:6/175: fdatasync d8/f15 0 2024-04-06T12:23:01.933 INFO:tasks.workunit.client.1.smithi195.stdout:8/121: symlink d6/db/l22 0 2024-04-06T12:23:01.934 INFO:tasks.workunit.client.1.smithi195.stdout:3/153: mknod d4/c31 0 2024-04-06T12:23:01.935 INFO:tasks.workunit.client.1.smithi195.stdout:9/149: write d3/f5 [4257559,17736] 0 2024-04-06T12:23:01.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/140: sync 2024-04-06T12:23:01.939 INFO:tasks.workunit.client.1.smithi195.stdout:1/141: chown d4/d14/d17/le 22 1 2024-04-06T12:23:01.940 INFO:tasks.workunit.client.1.smithi195.stdout:1/142: stat d4/d14/fd 0 2024-04-06T12:23:01.941 INFO:tasks.workunit.client.1.smithi195.stdout:9/150: dread d3/f9 [0,4194304] 0 2024-04-06T12:23:01.941 INFO:tasks.workunit.client.1.smithi195.stdout:5/151: dwrite d0/da/dd/f18 [0,4194304] 0 2024-04-06T12:23:01.942 INFO:tasks.workunit.client.1.smithi195.stdout:0/158: getdents d4/d6/d1a 0 2024-04-06T12:23:01.944 INFO:tasks.workunit.client.1.smithi195.stdout:4/167: creat d4/db/d18/d1a/f36 x:0 0 0 2024-04-06T12:23:01.949 INFO:tasks.workunit.client.1.smithi195.stdout:7/130: mknod d4/d10/d12/c23 0 2024-04-06T12:23:01.950 INFO:tasks.workunit.client.1.smithi195.stdout:7/131: chown d4/d10/d12/d13 829886957 1 2024-04-06T12:23:01.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/122: mkdir d6/db/d23 0 2024-04-06T12:23:01.956 INFO:tasks.workunit.client.1.smithi195.stdout:7/132: dwrite d4/d10/f1e [0,4194304] 0 2024-04-06T12:23:01.960 INFO:tasks.workunit.client.1.smithi195.stdout:0/159: creat d4/f31 x:0 0 0 2024-04-06T12:23:01.964 INFO:tasks.workunit.client.1.smithi195.stdout:0/160: read d4/f5 [7826706,72162] 0 2024-04-06T12:23:01.964 INFO:tasks.workunit.client.1.smithi195.stdout:2/131: link d2/d14/l19 d2/l2a 0 2024-04-06T12:23:01.970 INFO:tasks.workunit.client.1.smithi195.stdout:4/168: dwrite d4/f5 [0,4194304] 0 2024-04-06T12:23:01.974 INFO:tasks.workunit.client.1.smithi195.stdout:3/154: creat d4/d9/d2b/f32 x:0 0 0 2024-04-06T12:23:01.975 INFO:tasks.workunit.client.1.smithi195.stdout:3/155: chown d4/d9/d2b 180 1 2024-04-06T12:23:01.976 INFO:tasks.workunit.client.1.smithi195.stdout:3/156: fdatasync f0 0 2024-04-06T12:23:01.978 INFO:tasks.workunit.client.1.smithi195.stdout:7/133: rename d4/d10/d12/d13 to d4/d24 0 2024-04-06T12:23:01.979 INFO:tasks.workunit.client.1.smithi195.stdout:7/134: fsync d4/d16/f1c 0 2024-04-06T12:23:01.980 INFO:tasks.workunit.client.1.smithi195.stdout:9/151: creat d3/de/d37/f38 x:0 0 0 2024-04-06T12:23:01.980 INFO:tasks.workunit.client.1.smithi195.stdout:4/169: dwrite d4/f5 [4194304,4194304] 0 2024-04-06T12:23:01.982 INFO:tasks.workunit.client.1.smithi195.stdout:4/170: truncate d4/db/ff 497331 0 2024-04-06T12:23:01.993 INFO:tasks.workunit.client.1.smithi195.stdout:6/176: rename d8/d21/d31/d35/l2e to d8/d21/d31/d35/l41 0 2024-04-06T12:23:01.995 INFO:tasks.workunit.client.1.smithi195.stdout:8/123: mkdir d6/db/d23/d24 0 2024-04-06T12:23:01.996 INFO:tasks.workunit.client.1.smithi195.stdout:8/124: write d6/f1c [563698,104779] 0 2024-04-06T12:23:01.998 INFO:tasks.workunit.client.1.smithi195.stdout:3/157: rmdir d4/de 39 2024-04-06T12:23:02.000 INFO:tasks.workunit.client.1.smithi195.stdout:0/161: rename d4/d6/f18 to d4/f32 0 2024-04-06T12:23:02.001 INFO:tasks.workunit.client.1.smithi195.stdout:0/162: fsync d4/d6/d1a/f29 0 2024-04-06T12:23:02.003 INFO:tasks.workunit.client.1.smithi195.stdout:8/125: dwrite d6/f1c [0,4194304] 0 2024-04-06T12:23:02.003 INFO:tasks.workunit.client.1.smithi195.stdout:0/163: write d4/f9 [1478992,115768] 0 2024-04-06T12:23:02.011 INFO:tasks.workunit.client.1.smithi195.stdout:2/132: creat d2/d21/d29/f2b x:0 0 0 2024-04-06T12:23:02.011 INFO:tasks.workunit.client.1.smithi195.stdout:2/133: chown d2/ld 3247 1 2024-04-06T12:23:02.018 INFO:tasks.workunit.client.1.smithi195.stdout:5/152: write d0/da/d13/f15 [170782,127824] 0 2024-04-06T12:23:02.018 INFO:tasks.workunit.client.1.smithi195.stdout:2/134: dwrite d2/f1e [0,4194304] 0 2024-04-06T12:23:02.023 INFO:tasks.workunit.client.1.smithi195.stdout:9/152: symlink d3/d10/d32/l39 0 2024-04-06T12:23:02.025 INFO:tasks.workunit.client.1.smithi195.stdout:6/177: symlink d8/d3d/d3f/l42 0 2024-04-06T12:23:02.028 INFO:tasks.workunit.client.1.smithi195.stdout:3/158: rename d4/de/l30 to d4/df/l33 0 2024-04-06T12:23:02.031 INFO:tasks.workunit.client.1.smithi195.stdout:5/153: creat d0/d2c/f3f x:0 0 0 2024-04-06T12:23:02.032 INFO:tasks.workunit.client.1.smithi195.stdout:2/135: mkdir d2/d21/d2c 0 2024-04-06T12:23:02.033 INFO:tasks.workunit.client.1.smithi195.stdout:2/136: chown d2/c17 371171024 1 2024-04-06T12:23:02.033 INFO:tasks.workunit.client.1.smithi195.stdout:6/178: dwrite d8/f14 [0,4194304] 0 2024-04-06T12:23:02.034 INFO:tasks.workunit.client.1.smithi195.stdout:8/126: mkdir d6/db/d23/d24/d25 0 2024-04-06T12:23:02.034 INFO:tasks.workunit.client.1.smithi195.stdout:2/137: stat d2/f13 0 2024-04-06T12:23:02.034 INFO:tasks.workunit.client.0.smithi152.stdout:2/66: mkdir d0/d2/d5/d10 0 2024-04-06T12:23:02.035 INFO:tasks.workunit.client.1.smithi195.stdout:2/138: write d2/f12 [2864711,17511] 0 2024-04-06T12:23:02.037 INFO:tasks.workunit.client.1.smithi195.stdout:0/164: rmdir d4 39 2024-04-06T12:23:02.037 INFO:tasks.workunit.client.1.smithi195.stdout:1/143: sync 2024-04-06T12:23:02.039 INFO:tasks.workunit.client.0.smithi152.stdout:2/67: chown d0/ff 75 1 2024-04-06T12:23:02.040 INFO:tasks.workunit.client.0.smithi152.stdout:3/50: rename d0/l3 to d0/ld 0 2024-04-06T12:23:02.042 INFO:tasks.workunit.client.1.smithi195.stdout:2/139: dwrite d2/f1e [0,4194304] 0 2024-04-06T12:23:02.042 INFO:tasks.workunit.client.1.smithi195.stdout:3/159: creat d4/de/f34 x:0 0 0 2024-04-06T12:23:02.043 INFO:tasks.workunit.client.1.smithi195.stdout:2/140: stat d2/la 0 2024-04-06T12:23:02.046 INFO:tasks.workunit.client.0.smithi152.stdout:3/51: unlink d0/fa 0 2024-04-06T12:23:02.050 INFO:tasks.workunit.client.1.smithi195.stdout:8/127: creat d6/d8/f26 x:0 0 0 2024-04-06T12:23:02.052 INFO:tasks.workunit.client.1.smithi195.stdout:6/179: rename d8/d21/d31/f3c to d8/d21/d2b/f43 0 2024-04-06T12:23:02.053 INFO:tasks.workunit.client.0.smithi152.stdout:3/52: write d0/f7 [4932509,95952] 0 2024-04-06T12:23:02.054 INFO:tasks.workunit.client.1.smithi195.stdout:3/160: dwrite d4/d9/f18 [0,4194304] 0 2024-04-06T12:23:02.054 INFO:tasks.workunit.client.1.smithi195.stdout:3/161: chown d4/de 0 1 2024-04-06T12:23:02.055 INFO:tasks.workunit.client.0.smithi152.stdout:2/68: creat d0/f11 x:0 0 0 2024-04-06T12:23:02.055 INFO:tasks.workunit.client.1.smithi195.stdout:3/162: write d4/f7 [48086,2666] 0 2024-04-06T12:23:02.058 INFO:tasks.workunit.client.1.smithi195.stdout:3/163: truncate d4/de/f34 521626 0 2024-04-06T12:23:02.059 INFO:tasks.workunit.client.0.smithi152.stdout:3/53: read d0/f8 [3387552,27021] 0 2024-04-06T12:23:02.060 INFO:tasks.workunit.client.1.smithi195.stdout:3/164: truncate d4/f2f 397477 0 2024-04-06T12:23:02.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/144: truncate d4/d14/d17/d24/f27 3823689 0 2024-04-06T12:23:02.063 INFO:tasks.workunit.client.1.smithi195.stdout:7/135: dwrite d4/f7 [0,4194304] 0 2024-04-06T12:23:02.065 INFO:tasks.workunit.client.0.smithi152.stdout:2/69: symlink d0/d2/d5/d10/l12 0 2024-04-06T12:23:02.066 INFO:tasks.workunit.client.0.smithi152.stdout:2/70: read - d0/d2/fa zero size 2024-04-06T12:23:02.068 INFO:tasks.workunit.client.1.smithi195.stdout:1/145: write d4/d14/d19/f1d [209531,73368] 0 2024-04-06T12:23:02.069 INFO:tasks.workunit.client.0.smithi152.stdout:3/54: mkdir d0/de 0 2024-04-06T12:23:02.072 INFO:tasks.workunit.client.1.smithi195.stdout:1/146: write d4/d14/fd [4939179,64752] 0 2024-04-06T12:23:02.076 INFO:tasks.workunit.client.1.smithi195.stdout:4/171: dwrite d4/f16 [0,4194304] 0 2024-04-06T12:23:02.077 INFO:tasks.workunit.client.1.smithi195.stdout:1/147: truncate d4/f26 572614 0 2024-04-06T12:23:02.077 INFO:tasks.workunit.client.1.smithi195.stdout:0/165: symlink d4/d6/d1a/l33 0 2024-04-06T12:23:02.078 INFO:tasks.workunit.client.1.smithi195.stdout:3/165: dwrite d4/d9/f2d [0,4194304] 0 2024-04-06T12:23:02.085 INFO:tasks.workunit.client.0.smithi152.stdout:3/55: rename d0/f9 to d0/ff 0 2024-04-06T12:23:02.086 INFO:tasks.workunit.client.1.smithi195.stdout:5/154: dwrite d0/da/fb [0,4194304] 0 2024-04-06T12:23:02.087 INFO:tasks.workunit.client.1.smithi195.stdout:4/172: dread d4/db/f15 [0,4194304] 0 2024-04-06T12:23:02.087 INFO:tasks.workunit.client.1.smithi195.stdout:9/153: truncate d3/de/f21 1699255 0 2024-04-06T12:23:02.090 INFO:tasks.workunit.client.1.smithi195.stdout:9/154: fdatasync d3/d10/f30 0 2024-04-06T12:23:02.091 INFO:tasks.workunit.client.1.smithi195.stdout:5/155: write d0/da/dd/d1c/f2d [355097,15510] 0 2024-04-06T12:23:02.092 INFO:tasks.workunit.client.1.smithi195.stdout:4/173: truncate d4/db/d18/d1a/f36 935399 0 2024-04-06T12:23:02.093 INFO:tasks.workunit.client.1.smithi195.stdout:4/174: chown d4/db/d18/f28 92 1 2024-04-06T12:23:02.094 INFO:tasks.workunit.client.1.smithi195.stdout:0/166: creat d4/d6/d1a/f34 x:0 0 0 2024-04-06T12:23:02.098 INFO:tasks.workunit.client.1.smithi195.stdout:7/136: mknod d4/d10/d12/c25 0 2024-04-06T12:23:02.099 INFO:tasks.workunit.client.1.smithi195.stdout:7/137: rename d4/d16/dd to d4/d16/dd/d22/d26 22 2024-04-06T12:23:02.099 INFO:tasks.workunit.client.1.smithi195.stdout:7/138: chown d4/d24 2 1 2024-04-06T12:23:02.099 INFO:tasks.workunit.client.0.smithi152.stdout:2/71: write d0/ff [3084954,115968] 0 2024-04-06T12:23:02.100 INFO:tasks.workunit.client.1.smithi195.stdout:7/139: write d4/d16/f1b [264532,107806] 0 2024-04-06T12:23:02.104 INFO:tasks.workunit.client.1.smithi195.stdout:9/155: mkdir d3/d10/d3a 0 2024-04-06T12:23:02.107 INFO:tasks.workunit.client.1.smithi195.stdout:2/141: getdents d2 0 2024-04-06T12:23:02.108 INFO:tasks.workunit.client.1.smithi195.stdout:4/175: symlink d4/db/d20/d23/l37 0 2024-04-06T12:23:02.109 INFO:tasks.workunit.client.1.smithi195.stdout:2/142: fdatasync d2/f1e 0 2024-04-06T12:23:02.110 INFO:tasks.workunit.client.0.smithi152.stdout:2/72: dwrite d0/f3 [4194304,4194304] 0 2024-04-06T12:23:02.110 INFO:tasks.workunit.client.1.smithi195.stdout:6/180: dwrite d8/f19 [0,4194304] 0 2024-04-06T12:23:02.111 INFO:tasks.workunit.client.1.smithi195.stdout:6/181: stat d8 0 2024-04-06T12:23:02.113 INFO:tasks.workunit.client.1.smithi195.stdout:3/166: fdatasync d4/d9/f2d 0 2024-04-06T12:23:02.115 INFO:tasks.workunit.client.1.smithi195.stdout:9/156: dread d3/d10/f29 [0,4194304] 0 2024-04-06T12:23:02.116 INFO:tasks.workunit.client.1.smithi195.stdout:7/140: rename d4/d10/f1e to d4/d10/f27 0 2024-04-06T12:23:02.118 INFO:tasks.workunit.client.1.smithi195.stdout:5/156: mkdir d0/d40 0 2024-04-06T12:23:02.120 INFO:tasks.workunit.client.1.smithi195.stdout:2/143: dwrite d2/d14/f22 [0,4194304] 0 2024-04-06T12:23:02.120 INFO:tasks.workunit.client.0.smithi152.stdout:2/73: creat d0/f13 x:0 0 0 2024-04-06T12:23:02.121 INFO:tasks.workunit.client.0.smithi152.stdout:2/74: chown d0/d2/d5/c9 178077407 1 2024-04-06T12:23:02.123 INFO:tasks.workunit.client.1.smithi195.stdout:4/176: rename d4/db/d18 to d4/d6/d38 0 2024-04-06T12:23:02.123 INFO:tasks.workunit.client.1.smithi195.stdout:4/177: readlink d4/db/l27 0 2024-04-06T12:23:02.126 INFO:tasks.workunit.client.0.smithi152.stdout:2/75: creat d0/d2/f14 x:0 0 0 2024-04-06T12:23:02.129 INFO:tasks.workunit.client.1.smithi195.stdout:8/128: sync 2024-04-06T12:23:02.131 INFO:tasks.workunit.client.1.smithi195.stdout:1/148: truncate d4/fa 849992 0 2024-04-06T12:23:02.133 INFO:tasks.workunit.client.1.smithi195.stdout:3/167: creat d4/df/f35 x:0 0 0 2024-04-06T12:23:02.137 INFO:tasks.workunit.client.1.smithi195.stdout:9/157: rmdir d3/de 39 2024-04-06T12:23:02.137 INFO:tasks.workunit.client.1.smithi195.stdout:9/158: readlink d3/d10/d32/l39 0 2024-04-06T12:23:02.139 INFO:tasks.workunit.client.1.smithi195.stdout:7/141: creat d4/d16/dd/f28 x:0 0 0 2024-04-06T12:23:02.140 INFO:tasks.workunit.client.1.smithi195.stdout:0/167: creat d4/d6/f35 x:0 0 0 2024-04-06T12:23:02.141 INFO:tasks.workunit.client.1.smithi195.stdout:6/182: write d8/f23 [566595,110616] 0 2024-04-06T12:23:02.142 INFO:tasks.workunit.client.1.smithi195.stdout:0/168: stat d4/le 0 2024-04-06T12:23:02.144 INFO:tasks.workunit.client.1.smithi195.stdout:8/129: mknod d6/db/c27 0 2024-04-06T12:23:02.144 INFO:tasks.workunit.client.1.smithi195.stdout:0/169: write d4/f31 [885086,78884] 0 2024-04-06T12:23:02.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/170: read - d4/d6/f35 zero size 2024-04-06T12:23:02.147 INFO:tasks.workunit.client.1.smithi195.stdout:3/168: creat d4/d9/d2b/f36 x:0 0 0 2024-04-06T12:23:02.147 INFO:tasks.workunit.client.0.smithi152.stdout:2/76: truncate d0/f3 842280 0 2024-04-06T12:23:02.148 INFO:tasks.workunit.client.1.smithi195.stdout:7/142: dwrite d4/d16/f1b [0,4194304] 0 2024-04-06T12:23:02.148 INFO:tasks.workunit.client.1.smithi195.stdout:9/159: mkdir d3/d10/d3b 0 2024-04-06T12:23:02.148 INFO:tasks.workunit.client.1.smithi195.stdout:0/171: fsync d4/d6/d1a/f34 0 2024-04-06T12:23:02.149 INFO:tasks.workunit.client.0.smithi152.stdout:2/77: chown d0/d2/fa 112608492 1 2024-04-06T12:23:02.149 INFO:tasks.workunit.client.1.smithi195.stdout:3/169: dread - d4/d9/d2b/f36 zero size 2024-04-06T12:23:02.150 INFO:tasks.workunit.client.1.smithi195.stdout:5/157: mkdir d0/da/d23/d38/d41 0 2024-04-06T12:23:02.151 INFO:tasks.workunit.client.1.smithi195.stdout:0/172: write d4/d6/d1a/f29 [250724,69428] 0 2024-04-06T12:23:02.152 INFO:tasks.workunit.client.1.smithi195.stdout:4/178: write d4/db/f15 [3586841,120779] 0 2024-04-06T12:23:02.153 INFO:tasks.workunit.client.1.smithi195.stdout:5/158: fsync d0/da/d13/f1f 0 2024-04-06T12:23:02.155 INFO:tasks.workunit.client.1.smithi195.stdout:4/179: write d4/f5 [2344540,107447] 0 2024-04-06T12:23:02.155 INFO:tasks.workunit.client.1.smithi195.stdout:2/144: mkdir d2/d21/d2c/d2d 0 2024-04-06T12:23:02.155 INFO:tasks.workunit.client.0.smithi152.stdout:2/78: mkdir d0/d15 0 2024-04-06T12:23:02.155 INFO:tasks.workunit.client.0.smithi152.stdout:2/79: stat d0 0 2024-04-06T12:23:02.156 INFO:tasks.workunit.client.0.smithi152.stdout:2/80: stat d0 0 2024-04-06T12:23:02.157 INFO:tasks.workunit.client.1.smithi195.stdout:2/145: dread - d2/d14/f18 zero size 2024-04-06T12:23:02.157 INFO:tasks.workunit.client.0.smithi152.stdout:2/81: chown d0/fd 26582 1 2024-04-06T12:23:02.157 INFO:tasks.workunit.client.0.smithi152.stdout:2/82: truncate d0/f13 810884 0 2024-04-06T12:23:02.157 INFO:tasks.workunit.client.1.smithi195.stdout:8/130: creat d6/db/f28 x:0 0 0 2024-04-06T12:23:02.159 INFO:tasks.workunit.client.1.smithi195.stdout:8/131: chown d6/dd/f14 173956702 1 2024-04-06T12:23:02.160 INFO:tasks.workunit.client.0.smithi152.stdout:2/83: creat d0/d2/d5/f16 x:0 0 0 2024-04-06T12:23:02.162 INFO:tasks.workunit.client.1.smithi195.stdout:8/132: fdatasync d6/f7 0 2024-04-06T12:23:02.165 INFO:tasks.workunit.client.0.smithi152.stdout:2/84: symlink d0/l17 0 2024-04-06T12:23:02.166 INFO:tasks.workunit.client.1.smithi195.stdout:8/133: rename d6/d8/d12 to d6/d8/d12/d29 22 2024-04-06T12:23:02.166 INFO:tasks.workunit.client.1.smithi195.stdout:4/180: dread d4/db/fe [4194304,4194304] 0 2024-04-06T12:23:02.167 INFO:tasks.workunit.client.1.smithi195.stdout:1/149: link d4/c9 d4/d14/d17/d24/d2a/c2c 0 2024-04-06T12:23:02.168 INFO:tasks.workunit.client.1.smithi195.stdout:7/143: unlink d4/d24/l21 0 2024-04-06T12:23:02.168 INFO:tasks.workunit.client.1.smithi195.stdout:2/146: dwrite d2/d14/f1d [0,4194304] 0 2024-04-06T12:23:02.169 INFO:tasks.workunit.client.0.smithi152.stdout:2/85: creat d0/d2/d5/d10/f18 x:0 0 0 2024-04-06T12:23:02.170 INFO:tasks.workunit.client.1.smithi195.stdout:1/150: chown d4/f26 31708049 1 2024-04-06T12:23:02.171 INFO:tasks.workunit.client.1.smithi195.stdout:3/170: dread d4/f25 [0,4194304] 0 2024-04-06T12:23:02.174 INFO:tasks.workunit.client.1.smithi195.stdout:0/173: symlink d4/d6/l36 0 2024-04-06T12:23:02.174 INFO:tasks.workunit.client.0.smithi152.stdout:2/86: mknod d0/c19 0 2024-04-06T12:23:02.176 INFO:tasks.workunit.client.1.smithi195.stdout:6/183: dwrite d8/d21/f30 [0,4194304] 0 2024-04-06T12:23:02.177 INFO:tasks.workunit.client.1.smithi195.stdout:0/174: chown d4/d6/d1a/l30 188 1 2024-04-06T12:23:02.178 INFO:tasks.workunit.client.1.smithi195.stdout:4/181: creat d4/d6/d38/f39 x:0 0 0 2024-04-06T12:23:02.180 INFO:tasks.workunit.client.1.smithi195.stdout:9/160: link d3/de/f14 d3/de/d37/f3c 0 2024-04-06T12:23:02.180 INFO:tasks.workunit.client.1.smithi195.stdout:6/184: chown d8/d21/d31/l17 1155 1 2024-04-06T12:23:02.181 INFO:tasks.workunit.client.1.smithi195.stdout:1/151: creat d4/d14/d19/d23/f2d x:0 0 0 2024-04-06T12:23:02.181 INFO:tasks.workunit.client.1.smithi195.stdout:7/144: dwrite f0 [0,4194304] 0 2024-04-06T12:23:02.182 INFO:tasks.workunit.client.0.smithi152.stdout:2/87: dwrite d0/d2/d5/d10/f18 [0,4194304] 0 2024-04-06T12:23:02.182 INFO:tasks.workunit.client.1.smithi195.stdout:5/159: rename d0/f10 to d0/f42 0 2024-04-06T12:23:02.183 INFO:tasks.workunit.client.1.smithi195.stdout:1/152: chown d4/f12 0 1 2024-04-06T12:23:02.185 INFO:tasks.workunit.client.1.smithi195.stdout:6/185: write d8/d21/d31/d35/d32/f3a [142162,38022] 0 2024-04-06T12:23:02.186 INFO:tasks.workunit.client.1.smithi195.stdout:3/171: mkdir d4/d9/d37 0 2024-04-06T12:23:02.186 INFO:tasks.workunit.client.1.smithi195.stdout:5/160: chown d0/da/d13/l32 12189414 1 2024-04-06T12:23:02.190 INFO:tasks.workunit.client.1.smithi195.stdout:1/153: chown d4/f1c 459193 1 2024-04-06T12:23:02.190 INFO:tasks.workunit.client.1.smithi195.stdout:3/172: fdatasync d4/de/f2e 0 2024-04-06T12:23:02.190 INFO:tasks.workunit.client.1.smithi195.stdout:6/186: write d8/f23 [2495033,59621] 0 2024-04-06T12:23:02.191 INFO:tasks.workunit.client.0.smithi152.stdout:2/88: mknod d0/d2/d5/c1a 0 2024-04-06T12:23:02.191 INFO:tasks.workunit.client.1.smithi195.stdout:5/161: write d0/f11 [810166,111279] 0 2024-04-06T12:23:02.191 INFO:tasks.workunit.client.1.smithi195.stdout:8/134: unlink d6/db/f28 0 2024-04-06T12:23:02.194 INFO:tasks.workunit.client.1.smithi195.stdout:9/161: dread d3/f5 [0,4194304] 0 2024-04-06T12:23:02.195 INFO:tasks.workunit.client.0.smithi152.stdout:2/89: symlink d0/d2/d5/l1b 0 2024-04-06T12:23:02.196 INFO:tasks.workunit.client.1.smithi195.stdout:4/182: creat d4/db/d20/d23/f3a x:0 0 0 2024-04-06T12:23:02.197 INFO:tasks.workunit.client.1.smithi195.stdout:0/175: rename d4/d6/d1a/f29 to d4/d6/d1a/f37 0 2024-04-06T12:23:02.200 INFO:tasks.workunit.client.1.smithi195.stdout:7/145: truncate d4/d16/fe 787200 0 2024-04-06T12:23:02.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/187: dwrite d8/f10 [0,4194304] 0 2024-04-06T12:23:02.204 INFO:tasks.workunit.client.0.smithi152.stdout:2/90: link d0/d2/fa d0/f1c 0 2024-04-06T12:23:02.208 INFO:tasks.workunit.client.0.smithi152.stdout:2/91: mknod d0/d2/d5/c1d 0 2024-04-06T12:23:02.209 INFO:tasks.workunit.client.1.smithi195.stdout:4/183: dwrite d4/d6/d38/f39 [0,4194304] 0 2024-04-06T12:23:02.210 INFO:tasks.workunit.client.1.smithi195.stdout:3/173: creat d4/d9/d2b/f38 x:0 0 0 2024-04-06T12:23:02.210 INFO:tasks.workunit.client.0.smithi152.stdout:2/92: symlink d0/d2/d5/d10/l1e 0 2024-04-06T12:23:02.212 INFO:tasks.workunit.client.1.smithi195.stdout:6/188: truncate d8/d21/d2b/f43 800112 0 2024-04-06T12:23:02.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/174: truncate d4/f2f 1283446 0 2024-04-06T12:23:02.212 INFO:tasks.workunit.client.1.smithi195.stdout:4/184: stat d4/d6/d38/f1d 0 2024-04-06T12:23:02.212 INFO:tasks.workunit.client.0.smithi152.stdout:2/93: readlink d0/d2/d5/l1b 0 2024-04-06T12:23:02.213 INFO:tasks.workunit.client.1.smithi195.stdout:2/147: getdents d2 0 2024-04-06T12:23:02.214 INFO:tasks.workunit.client.1.smithi195.stdout:8/135: creat d6/db/d23/d24/d25/f2a x:0 0 0 2024-04-06T12:23:02.215 INFO:tasks.workunit.client.1.smithi195.stdout:9/162: symlink d3/d10/d3a/l3d 0 2024-04-06T12:23:02.216 INFO:tasks.workunit.client.1.smithi195.stdout:4/185: write d4/d6/d38/f39 [3225344,58490] 0 2024-04-06T12:23:02.217 INFO:tasks.workunit.client.0.smithi152.stdout:2/94: rename d0/ff to d0/d2/d5/f1f 0 2024-04-06T12:23:02.217 INFO:tasks.workunit.client.1.smithi195.stdout:9/163: readlink d3/d10/d32/l39 0 2024-04-06T12:23:02.218 INFO:tasks.workunit.client.0.smithi152.stdout:2/95: chown d0/d2/d5/d10/l1e 365 1 2024-04-06T12:23:02.221 INFO:tasks.workunit.client.1.smithi195.stdout:9/164: chown d3/d10/d3a/l3d 209660 1 2024-04-06T12:23:02.223 INFO:tasks.workunit.client.1.smithi195.stdout:6/189: dwrite d8/fc [0,4194304] 0 2024-04-06T12:23:02.223 INFO:tasks.workunit.client.1.smithi195.stdout:9/165: chown d3/d10/f29 30377317 1 2024-04-06T12:23:02.223 INFO:tasks.workunit.client.0.smithi152.stdout:2/96: rename d0/d2/d5/f16 to d0/d2/d5/f20 0 2024-04-06T12:23:02.225 INFO:tasks.workunit.client.1.smithi195.stdout:4/186: creat d4/db/f3b x:0 0 0 2024-04-06T12:23:02.226 INFO:tasks.workunit.client.1.smithi195.stdout:6/190: chown d8/d21/d31/l1b 4 1 2024-04-06T12:23:02.228 INFO:tasks.workunit.client.1.smithi195.stdout:4/187: write d4/db/f15 [760368,84330] 0 2024-04-06T12:23:02.230 INFO:tasks.workunit.client.1.smithi195.stdout:8/136: dwrite d6/f20 [0,4194304] 0 2024-04-06T12:23:02.232 INFO:tasks.workunit.client.1.smithi195.stdout:4/188: readlink d4/d6/d38/d1a/l30 0 2024-04-06T12:23:02.232 INFO:tasks.workunit.client.1.smithi195.stdout:3/175: truncate d4/d9/fb 464522 0 2024-04-06T12:23:02.233 INFO:tasks.workunit.client.0.smithi152.stdout:2/97: dwrite d0/f13 [0,4194304] 0 2024-04-06T12:23:02.239 INFO:tasks.workunit.client.1.smithi195.stdout:1/154: dread d4/d14/d17/d24/f27 [0,4194304] 0 2024-04-06T12:23:02.240 INFO:tasks.workunit.client.1.smithi195.stdout:8/137: fdatasync d6/dd/f14 0 2024-04-06T12:23:02.241 INFO:tasks.workunit.client.1.smithi195.stdout:4/189: dread d4/db/f15 [0,4194304] 0 2024-04-06T12:23:02.243 INFO:tasks.workunit.client.1.smithi195.stdout:3/176: mkdir d4/df/d39 0 2024-04-06T12:23:02.243 INFO:tasks.workunit.client.1.smithi195.stdout:1/155: truncate d4/d14/d19/f1d 631813 0 2024-04-06T12:23:02.244 INFO:tasks.workunit.client.1.smithi195.stdout:4/190: read d4/d6/f7 [6879375,81457] 0 2024-04-06T12:23:02.246 INFO:tasks.workunit.client.1.smithi195.stdout:1/156: write d4/f26 [246457,21824] 0 2024-04-06T12:23:02.250 INFO:tasks.workunit.client.1.smithi195.stdout:8/138: creat d6/db/f2b x:0 0 0 2024-04-06T12:23:02.251 INFO:tasks.workunit.client.1.smithi195.stdout:3/177: truncate d4/d9/d2b/f32 169388 0 2024-04-06T12:23:02.251 INFO:tasks.workunit.client.1.smithi195.stdout:9/166: dread d3/de/f14 [0,4194304] 0 2024-04-06T12:23:02.251 INFO:tasks.workunit.client.1.smithi195.stdout:4/191: write d4/d6/d38/d1a/f36 [1974181,40159] 0 2024-04-06T12:23:02.252 INFO:tasks.workunit.client.1.smithi195.stdout:8/139: readlink d6/d8/l9 0 2024-04-06T12:23:02.253 INFO:tasks.workunit.client.1.smithi195.stdout:1/157: chown d4/d14/c16 451383822 1 2024-04-06T12:23:02.254 INFO:tasks.workunit.client.1.smithi195.stdout:9/167: truncate d3/de/d37/f38 168101 0 2024-04-06T12:23:02.255 INFO:tasks.workunit.client.1.smithi195.stdout:1/158: write d4/f26 [1342770,11508] 0 2024-04-06T12:23:02.257 INFO:tasks.workunit.client.1.smithi195.stdout:3/178: creat d4/d9/d37/f3a x:0 0 0 2024-04-06T12:23:02.258 INFO:tasks.workunit.client.1.smithi195.stdout:2/148: truncate d2/f13 2942275 0 2024-04-06T12:23:02.262 INFO:tasks.workunit.client.1.smithi195.stdout:8/140: dread d6/dd/f14 [0,4194304] 0 2024-04-06T12:23:02.262 INFO:tasks.workunit.client.1.smithi195.stdout:1/159: symlink d4/d14/d17/d24/l2e 0 2024-04-06T12:23:02.264 INFO:tasks.workunit.client.1.smithi195.stdout:9/168: rename d3/de/d37/f3c to d3/d10/d3a/f3e 0 2024-04-06T12:23:02.265 INFO:tasks.workunit.client.1.smithi195.stdout:6/191: truncate d8/f14 3267542 0 2024-04-06T12:23:02.267 INFO:tasks.workunit.client.1.smithi195.stdout:2/149: dwrite d2/d14/f18 [0,4194304] 0 2024-04-06T12:23:02.269 INFO:tasks.workunit.client.1.smithi195.stdout:2/150: stat d2/d21/f28 0 2024-04-06T12:23:02.269 INFO:tasks.workunit.client.1.smithi195.stdout:4/192: link d4/d6/d38/d1a/f2d d4/d6/d38/d1a/f3c 0 2024-04-06T12:23:02.269 INFO:tasks.workunit.client.1.smithi195.stdout:1/160: mkdir d4/d14/d19/d23/d28/d2f 0 2024-04-06T12:23:02.272 INFO:tasks.workunit.client.1.smithi195.stdout:2/151: rmdir d2/d21/d2c 39 2024-04-06T12:23:02.272 INFO:tasks.workunit.client.1.smithi195.stdout:4/193: chown d4/f5 23 1 2024-04-06T12:23:02.272 INFO:tasks.workunit.client.1.smithi195.stdout:3/179: rmdir d4 39 2024-04-06T12:23:02.274 INFO:tasks.workunit.client.1.smithi195.stdout:4/194: fsync d4/db/f32 0 2024-04-06T12:23:02.274 INFO:tasks.workunit.client.1.smithi195.stdout:6/192: mkdir d8/d21/d31/d35/d27/d44 0 2024-04-06T12:23:02.274 INFO:tasks.workunit.client.1.smithi195.stdout:9/169: dread d3/f24 [0,4194304] 0 2024-04-06T12:23:02.277 INFO:tasks.workunit.client.1.smithi195.stdout:9/170: rmdir d3/de 39 2024-04-06T12:23:02.281 INFO:tasks.workunit.client.1.smithi195.stdout:4/195: rename d4/d6/d38/d1a/c25 to d4/d6/d38/d1a/c3d 0 2024-04-06T12:23:02.283 INFO:tasks.workunit.client.1.smithi195.stdout:3/180: mkdir d4/d9/d2b/d3b 0 2024-04-06T12:23:02.284 INFO:tasks.workunit.client.1.smithi195.stdout:3/181: fsync d4/d9/f29 0 2024-04-06T12:23:02.285 INFO:tasks.workunit.client.1.smithi195.stdout:3/182: chown d4/d9/l1f 2068099 1 2024-04-06T12:23:02.289 INFO:tasks.workunit.client.1.smithi195.stdout:2/152: getdents d2/d21/d29 0 2024-04-06T12:23:02.290 INFO:tasks.workunit.client.1.smithi195.stdout:2/153: fsync d2/f23 0 2024-04-06T12:23:02.293 INFO:tasks.workunit.client.1.smithi195.stdout:4/196: mkdir d4/d3e 0 2024-04-06T12:23:02.293 INFO:tasks.workunit.client.1.smithi195.stdout:1/161: dwrite d4/d14/d17/d24/f27 [0,4194304] 0 2024-04-06T12:23:02.294 INFO:tasks.workunit.client.1.smithi195.stdout:9/171: fdatasync d3/de/f21 0 2024-04-06T12:23:02.299 INFO:tasks.workunit.client.1.smithi195.stdout:3/183: rename d4/d9/fb to d4/df/f3c 0 2024-04-06T12:23:02.303 INFO:tasks.workunit.client.1.smithi195.stdout:1/162: dread d4/d14/f18 [0,4194304] 0 2024-04-06T12:23:02.305 INFO:tasks.workunit.client.1.smithi195.stdout:4/197: unlink d4/d6/d38/d1a/f36 0 2024-04-06T12:23:02.309 INFO:tasks.workunit.client.1.smithi195.stdout:1/163: rmdir d4/d14/d17 39 2024-04-06T12:23:02.313 INFO:tasks.workunit.client.1.smithi195.stdout:9/172: write d3/f9 [2899063,103594] 0 2024-04-06T12:23:02.313 INFO:tasks.workunit.client.1.smithi195.stdout:2/154: write d2/d21/f24 [31973,97839] 0 2024-04-06T12:23:02.314 INFO:tasks.workunit.client.1.smithi195.stdout:3/184: truncate d4/df/f3c 377455 0 2024-04-06T12:23:02.316 INFO:tasks.workunit.client.1.smithi195.stdout:4/198: link d4/d6/d38/d1a/f24 d4/d6/d38/f3f 0 2024-04-06T12:23:02.316 INFO:tasks.workunit.client.1.smithi195.stdout:9/173: readlink d3/l27 0 2024-04-06T12:23:02.317 INFO:tasks.workunit.client.1.smithi195.stdout:1/164: creat d4/d14/d17/f30 x:0 0 0 2024-04-06T12:23:02.317 INFO:tasks.workunit.client.1.smithi195.stdout:2/155: symlink d2/l2e 0 2024-04-06T12:23:02.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/185: rmdir d4/df 39 2024-04-06T12:23:02.319 INFO:tasks.workunit.client.1.smithi195.stdout:4/199: write d4/d6/f7 [2900091,31499] 0 2024-04-06T12:23:02.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/186: dread - d4/d9/d2b/f36 zero size 2024-04-06T12:23:02.319 INFO:tasks.workunit.client.1.smithi195.stdout:9/174: unlink d3/d10/d32/l39 0 2024-04-06T12:23:02.322 INFO:tasks.workunit.client.1.smithi195.stdout:1/165: write d4/d14/d19/f1b [3006449,37598] 0 2024-04-06T12:23:02.322 INFO:tasks.workunit.client.1.smithi195.stdout:9/175: chown d3/d10/c20 1843964 1 2024-04-06T12:23:02.325 INFO:tasks.workunit.client.1.smithi195.stdout:2/156: dread d2/d14/f18 [0,4194304] 0 2024-04-06T12:23:02.325 INFO:tasks.workunit.client.1.smithi195.stdout:4/200: truncate d4/db/f15 2274101 0 2024-04-06T12:23:02.326 INFO:tasks.workunit.client.1.smithi195.stdout:9/176: mknod d3/d10/c3f 0 2024-04-06T12:23:02.327 INFO:tasks.workunit.client.1.smithi195.stdout:3/187: link d4/d9/l11 d4/d9/l3d 0 2024-04-06T12:23:02.327 INFO:tasks.workunit.client.1.smithi195.stdout:4/201: write d4/db/fe [7477871,103847] 0 2024-04-06T12:23:02.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/177: symlink d3/d10/l40 0 2024-04-06T12:23:02.330 INFO:tasks.workunit.client.1.smithi195.stdout:3/188: chown d4/d9/fd 120466 1 2024-04-06T12:23:02.331 INFO:tasks.workunit.client.1.smithi195.stdout:1/166: dwrite d4/f12 [0,4194304] 0 2024-04-06T12:23:02.332 INFO:tasks.workunit.client.1.smithi195.stdout:9/178: mknod d3/d10/d3b/c41 0 2024-04-06T12:23:02.334 INFO:tasks.workunit.client.1.smithi195.stdout:3/189: mknod d4/de/c3e 0 2024-04-06T12:23:02.334 INFO:tasks.workunit.client.1.smithi195.stdout:2/157: dwrite d2/f26 [4194304,4194304] 0 2024-04-06T12:23:02.336 INFO:tasks.workunit.client.1.smithi195.stdout:3/190: dread - d4/d9/f29 zero size 2024-04-06T12:23:02.339 INFO:tasks.workunit.client.1.smithi195.stdout:2/158: chown d2/d21/d2c/d2d 2236 1 2024-04-06T12:23:02.339 INFO:tasks.workunit.client.1.smithi195.stdout:3/191: write d4/de/f34 [716246,92221] 0 2024-04-06T12:23:02.339 INFO:tasks.workunit.client.1.smithi195.stdout:2/159: stat d2/f1e 0 2024-04-06T12:23:02.340 INFO:tasks.workunit.client.1.smithi195.stdout:3/192: dread - d4/d9/f2a zero size 2024-04-06T12:23:02.342 INFO:tasks.workunit.client.1.smithi195.stdout:1/167: dread d4/fa [0,4194304] 0 2024-04-06T12:23:02.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/193: truncate d4/d9/d37/f3a 263461 0 2024-04-06T12:23:02.342 INFO:tasks.workunit.client.1.smithi195.stdout:1/168: chown d4/c13 151919863 1 2024-04-06T12:23:02.344 INFO:tasks.workunit.client.1.smithi195.stdout:3/194: fsync d4/df/f35 0 2024-04-06T12:23:02.346 INFO:tasks.workunit.client.1.smithi195.stdout:3/195: mknod d4/d9/c3f 0 2024-04-06T12:23:02.346 INFO:tasks.workunit.client.1.smithi195.stdout:2/160: link d2/l2e d2/d21/l2f 0 2024-04-06T12:23:02.347 INFO:tasks.workunit.client.1.smithi195.stdout:1/169: mknod d4/d14/d17/d24/d2a/c31 0 2024-04-06T12:23:02.349 INFO:tasks.workunit.client.1.smithi195.stdout:5/162: sync 2024-04-06T12:23:02.349 INFO:tasks.workunit.client.1.smithi195.stdout:7/146: sync 2024-04-06T12:23:02.349 INFO:tasks.workunit.client.1.smithi195.stdout:0/176: sync 2024-04-06T12:23:02.354 INFO:tasks.workunit.client.1.smithi195.stdout:7/147: dread - d4/d24/f1a zero size 2024-04-06T12:23:02.354 INFO:tasks.workunit.client.1.smithi195.stdout:1/170: dread d4/d14/f1f [0,4194304] 0 2024-04-06T12:23:02.354 INFO:tasks.workunit.client.1.smithi195.stdout:5/163: write d0/da/dd/f18 [5129857,121352] 0 2024-04-06T12:23:02.357 INFO:tasks.workunit.client.1.smithi195.stdout:0/177: creat d4/d6/d2f/f38 x:0 0 0 2024-04-06T12:23:02.357 INFO:tasks.workunit.client.1.smithi195.stdout:5/164: truncate d0/da/fc 754444 0 2024-04-06T12:23:02.361 INFO:tasks.workunit.client.1.smithi195.stdout:4/202: rename d4/db to d4/d6/d38/d1a/d40 0 2024-04-06T12:23:02.363 INFO:tasks.workunit.client.1.smithi195.stdout:7/148: dread d4/d10/f27 [0,4194304] 0 2024-04-06T12:23:02.364 INFO:tasks.workunit.client.1.smithi195.stdout:5/165: rename d0/f11 to d0/d40/f43 0 2024-04-06T12:23:02.366 INFO:tasks.workunit.client.1.smithi195.stdout:3/196: getdents d4/de 0 2024-04-06T12:23:02.367 INFO:tasks.workunit.client.1.smithi195.stdout:0/178: dwrite d4/f32 [4194304,4194304] 0 2024-04-06T12:23:02.367 INFO:tasks.workunit.client.1.smithi195.stdout:7/149: mknod d4/d24/c29 0 2024-04-06T12:23:02.368 INFO:tasks.workunit.client.1.smithi195.stdout:9/179: write d3/d10/d3a/f3e [893430,89611] 0 2024-04-06T12:23:02.368 INFO:tasks.workunit.client.1.smithi195.stdout:3/197: dread - d4/df/f28 zero size 2024-04-06T12:23:02.372 INFO:tasks.workunit.client.1.smithi195.stdout:7/150: write d4/d10/f27 [926950,23523] 0 2024-04-06T12:23:02.374 INFO:tasks.workunit.client.1.smithi195.stdout:9/180: creat d3/d10/d3a/f42 x:0 0 0 2024-04-06T12:23:02.374 INFO:tasks.workunit.client.1.smithi195.stdout:2/161: write d2/f13 [2667912,81309] 0 2024-04-06T12:23:02.376 INFO:tasks.workunit.client.1.smithi195.stdout:0/179: link d4/l28 d4/l39 0 2024-04-06T12:23:02.376 INFO:tasks.workunit.client.1.smithi195.stdout:9/181: write d3/d10/f11 [2086208,23764] 0 2024-04-06T12:23:02.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/198: mkdir d4/d9/d2b/d3b/d40 0 2024-04-06T12:23:02.378 INFO:tasks.workunit.client.1.smithi195.stdout:0/180: chown d4/ca 1911747065 1 2024-04-06T12:23:02.378 INFO:tasks.workunit.client.1.smithi195.stdout:2/162: read d2/f1c [261619,52271] 0 2024-04-06T12:23:02.381 INFO:tasks.workunit.client.1.smithi195.stdout:3/199: truncate d4/d9/d2b/f38 810979 0 2024-04-06T12:23:02.381 INFO:tasks.workunit.client.1.smithi195.stdout:7/151: creat d4/d16/dd/f2a x:0 0 0 2024-04-06T12:23:02.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/171: truncate d4/d14/d19/d23/d28/f2b 3401781 0 2024-04-06T12:23:02.384 INFO:tasks.workunit.client.1.smithi195.stdout:3/200: write d4/de/f34 [1133513,66830] 0 2024-04-06T12:23:02.384 INFO:tasks.workunit.client.1.smithi195.stdout:7/152: chown d4/d16/dd/f2a 1896 1 2024-04-06T12:23:02.385 INFO:tasks.workunit.client.1.smithi195.stdout:3/201: stat d4/de/c1c 0 2024-04-06T12:23:02.385 INFO:tasks.workunit.client.1.smithi195.stdout:2/163: rename d2/f5 to d2/d21/d2c/d2d/f30 0 2024-04-06T12:23:02.386 INFO:tasks.workunit.client.1.smithi195.stdout:7/153: dread - d4/d24/f1f zero size 2024-04-06T12:23:02.393 INFO:tasks.workunit.client.1.smithi195.stdout:7/154: dread - d4/d16/dd/f28 zero size 2024-04-06T12:23:02.393 INFO:tasks.workunit.client.1.smithi195.stdout:9/182: rmdir d3/d10/d32 0 2024-04-06T12:23:02.394 INFO:tasks.workunit.client.1.smithi195.stdout:0/181: dwrite d4/d6/d1a/f34 [0,4194304] 0 2024-04-06T12:23:02.394 INFO:tasks.workunit.client.1.smithi195.stdout:2/164: creat d2/d14/f31 x:0 0 0 2024-04-06T12:23:02.394 INFO:tasks.workunit.client.1.smithi195.stdout:3/202: creat d4/d9/f41 x:0 0 0 2024-04-06T12:23:02.395 INFO:tasks.workunit.client.1.smithi195.stdout:0/182: readlink d4/d6/d1a/l33 0 2024-04-06T12:23:02.397 INFO:tasks.workunit.client.1.smithi195.stdout:5/166: dwrite d0/fe [0,4194304] 0 2024-04-06T12:23:02.397 INFO:tasks.workunit.client.1.smithi195.stdout:2/165: write d2/d14/f31 [809455,129070] 0 2024-04-06T12:23:02.397 INFO:tasks.workunit.client.1.smithi195.stdout:9/183: truncate d3/de/f1c 967306 0 2024-04-06T12:23:02.399 INFO:tasks.workunit.client.1.smithi195.stdout:1/172: write d4/d14/f1f [418866,12694] 0 2024-04-06T12:23:02.399 INFO:tasks.workunit.client.1.smithi195.stdout:9/184: chown d3/f5 2098 1 2024-04-06T12:23:02.400 INFO:tasks.workunit.client.1.smithi195.stdout:7/155: link d4/d10/d12/f14 d4/d16/dd/d22/f2b 0 2024-04-06T12:23:02.402 INFO:tasks.workunit.client.1.smithi195.stdout:3/203: creat d4/d9/d2b/f42 x:0 0 0 2024-04-06T12:23:02.402 INFO:tasks.workunit.client.1.smithi195.stdout:7/156: stat d4/d24/c29 0 2024-04-06T12:23:02.403 INFO:tasks.workunit.client.1.smithi195.stdout:1/173: write f1 [1227639,96299] 0 2024-04-06T12:23:02.403 INFO:tasks.workunit.client.1.smithi195.stdout:0/183: symlink d4/d6/d1a/l3a 0 2024-04-06T12:23:02.406 INFO:tasks.workunit.client.1.smithi195.stdout:9/185: truncate d3/d10/d3a/f42 299564 0 2024-04-06T12:23:02.408 INFO:tasks.workunit.client.1.smithi195.stdout:0/184: write d4/d6/f1d [187107,82161] 0 2024-04-06T12:23:02.408 INFO:tasks.workunit.client.1.smithi195.stdout:3/204: symlink d4/df/l43 0 2024-04-06T12:23:02.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/174: chown d4/d14/d19/f1b 3017 1 2024-04-06T12:23:02.411 INFO:tasks.workunit.client.1.smithi195.stdout:2/166: dread d2/f13 [0,4194304] 0 2024-04-06T12:23:02.413 INFO:tasks.workunit.client.1.smithi195.stdout:3/205: write d4/d9/f29 [902255,130146] 0 2024-04-06T12:23:02.417 INFO:tasks.workunit.client.1.smithi195.stdout:0/185: symlink d4/d6/d1a/l3b 0 2024-04-06T12:23:02.418 INFO:tasks.workunit.client.1.smithi195.stdout:1/175: creat d4/d14/f32 x:0 0 0 2024-04-06T12:23:02.419 INFO:tasks.workunit.client.1.smithi195.stdout:7/157: dwrite d4/d10/f27 [0,4194304] 0 2024-04-06T12:23:02.420 INFO:tasks.workunit.client.1.smithi195.stdout:5/167: dwrite d0/da/d13/f39 [0,4194304] 0 2024-04-06T12:23:02.422 INFO:tasks.workunit.client.1.smithi195.stdout:0/186: fdatasync d4/d6/f2c 0 2024-04-06T12:23:02.422 INFO:tasks.workunit.client.1.smithi195.stdout:1/176: fdatasync d4/d14/d19/f22 0 2024-04-06T12:23:02.425 INFO:tasks.workunit.client.1.smithi195.stdout:5/168: readlink d0/da/dd/l17 0 2024-04-06T12:23:02.425 INFO:tasks.workunit.client.1.smithi195.stdout:9/186: truncate d3/f17 1464684 0 2024-04-06T12:23:02.428 INFO:tasks.workunit.client.1.smithi195.stdout:9/187: fsync d3/d10/f31 0 2024-04-06T12:23:02.428 INFO:tasks.workunit.client.1.smithi195.stdout:2/167: write d2/f1c [1761286,112993] 0 2024-04-06T12:23:02.429 INFO:tasks.workunit.client.1.smithi195.stdout:1/177: creat d4/d14/d19/d23/d28/d2f/f33 x:0 0 0 2024-04-06T12:23:02.432 INFO:tasks.workunit.client.1.smithi195.stdout:5/169: creat d0/da/d23/d38/f44 x:0 0 0 2024-04-06T12:23:02.432 INFO:tasks.workunit.client.1.smithi195.stdout:2/168: chown d2/f13 912 1 2024-04-06T12:23:02.433 INFO:tasks.workunit.client.1.smithi195.stdout:3/206: dwrite d4/d9/d2b/f38 [0,4194304] 0 2024-04-06T12:23:02.435 INFO:tasks.workunit.client.1.smithi195.stdout:5/170: read - d0/da/d23/d38/f44 zero size 2024-04-06T12:23:02.435 INFO:tasks.workunit.client.1.smithi195.stdout:7/158: dread f0 [0,4194304] 0 2024-04-06T12:23:02.439 INFO:tasks.workunit.client.1.smithi195.stdout:1/178: creat d4/d14/f34 x:0 0 0 2024-04-06T12:23:02.441 INFO:tasks.workunit.client.1.smithi195.stdout:7/159: symlink d4/d16/dd/l2c 0 2024-04-06T12:23:02.442 INFO:tasks.workunit.client.1.smithi195.stdout:3/207: mknod d4/d9/d2b/d3b/d40/c44 0 2024-04-06T12:23:02.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/171: creat d0/da/d23/f45 x:0 0 0 2024-04-06T12:23:02.443 INFO:tasks.workunit.client.1.smithi195.stdout:7/160: fsync d4/d24/f1f 0 2024-04-06T12:23:02.445 INFO:tasks.workunit.client.1.smithi195.stdout:1/179: symlink d4/d14/d17/d24/l35 0 2024-04-06T12:23:02.448 INFO:tasks.workunit.client.1.smithi195.stdout:7/161: readlink d4/d16/dd/l2c 0 2024-04-06T12:23:02.448 INFO:tasks.workunit.client.1.smithi195.stdout:9/188: dwrite d3/f5 [4194304,4194304] 0 2024-04-06T12:23:02.452 INFO:tasks.workunit.client.1.smithi195.stdout:2/169: truncate d2/d14/f1d 4024012 0 2024-04-06T12:23:02.452 INFO:tasks.workunit.client.1.smithi195.stdout:5/172: read d0/da/dd/d1c/f2d [154131,100253] 0 2024-04-06T12:23:02.453 INFO:tasks.workunit.client.1.smithi195.stdout:7/162: creat d4/d16/f2d x:0 0 0 2024-04-06T12:23:02.454 INFO:tasks.workunit.client.1.smithi195.stdout:9/189: chown d3/d10/c1a 777 1 2024-04-06T12:23:02.460 INFO:tasks.workunit.client.1.smithi195.stdout:9/190: truncate d3/d10/f22 1062576 0 2024-04-06T12:23:02.461 INFO:tasks.workunit.client.1.smithi195.stdout:2/170: rename d2/d21/f27 to d2/d21/d2c/f32 0 2024-04-06T12:23:02.461 INFO:tasks.workunit.client.1.smithi195.stdout:3/208: dwrite d4/d9/f18 [0,4194304] 0 2024-04-06T12:23:02.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/163: creat d4/d10/d12/f2e x:0 0 0 2024-04-06T12:23:02.463 INFO:tasks.workunit.client.1.smithi195.stdout:0/187: dread d4/d6/f20 [0,4194304] 0 2024-04-06T12:23:02.464 INFO:tasks.workunit.client.1.smithi195.stdout:5/173: link d0/da/dd/d33/l36 d0/d2c/l46 0 2024-04-06T12:23:02.465 INFO:tasks.workunit.client.1.smithi195.stdout:1/180: dwrite d4/d14/f18 [0,4194304] 0 2024-04-06T12:23:02.465 INFO:tasks.workunit.client.1.smithi195.stdout:3/209: dread - d4/f12 zero size 2024-04-06T12:23:02.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/164: fdatasync f0 0 2024-04-06T12:23:02.467 INFO:tasks.workunit.client.1.smithi195.stdout:1/181: read - d4/d14/f34 zero size 2024-04-06T12:23:02.468 INFO:tasks.workunit.client.1.smithi195.stdout:9/191: truncate d3/de/f21 776864 0 2024-04-06T12:23:02.469 INFO:tasks.workunit.client.1.smithi195.stdout:5/174: chown d0/l27 3 1 2024-04-06T12:23:02.470 INFO:tasks.workunit.client.1.smithi195.stdout:8/141: sync 2024-04-06T12:23:02.470 INFO:tasks.workunit.client.1.smithi195.stdout:0/188: symlink d4/d6/d2f/l3c 0 2024-04-06T12:23:02.473 INFO:tasks.workunit.client.1.smithi195.stdout:7/165: symlink d4/d10/d18/d19/l2f 0 2024-04-06T12:23:02.473 INFO:tasks.workunit.client.1.smithi195.stdout:1/182: fdatasync d4/d14/d17/f30 0 2024-04-06T12:23:02.476 INFO:tasks.workunit.client.1.smithi195.stdout:7/166: dread - d4/d24/f1f zero size 2024-04-06T12:23:02.478 INFO:tasks.workunit.client.1.smithi195.stdout:2/171: dwrite d2/d14/f22 [0,4194304] 0 2024-04-06T12:23:02.479 INFO:tasks.workunit.client.1.smithi195.stdout:1/183: write d4/d14/d19/f29 [343703,114959] 0 2024-04-06T12:23:02.480 INFO:tasks.workunit.client.1.smithi195.stdout:5/175: symlink d0/da/d13/l47 0 2024-04-06T12:23:02.481 INFO:tasks.workunit.client.1.smithi195.stdout:0/189: creat d4/f3d x:0 0 0 2024-04-06T12:23:02.484 INFO:tasks.workunit.client.1.smithi195.stdout:9/192: dread d3/f17 [0,4194304] 0 2024-04-06T12:23:02.485 INFO:tasks.workunit.client.1.smithi195.stdout:7/167: dread d4/d16/dd/d22/f2b [0,4194304] 0 2024-04-06T12:23:02.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/193: chown d3/d10/d3b/c41 3 1 2024-04-06T12:23:02.488 INFO:tasks.workunit.client.1.smithi195.stdout:0/190: dwrite d4/fd [0,4194304] 0 2024-04-06T12:23:02.488 INFO:tasks.workunit.client.1.smithi195.stdout:4/203: sync 2024-04-06T12:23:02.488 INFO:tasks.workunit.client.1.smithi195.stdout:6/193: sync 2024-04-06T12:23:02.489 INFO:tasks.workunit.client.1.smithi195.stdout:0/191: chown d4/d6/f1d 12110 1 2024-04-06T12:23:02.490 INFO:tasks.workunit.client.1.smithi195.stdout:6/194: read - d8/d21/d31/f1f zero size 2024-04-06T12:23:02.580 INFO:tasks.workunit.client.1.smithi195.stdout:8/142: mkdir d6/d2c 0 2024-04-06T12:23:02.580 INFO:tasks.workunit.client.1.smithi195.stdout:8/143: truncate d6/f7 9840764 0 2024-04-06T12:23:02.584 INFO:tasks.workunit.client.1.smithi195.stdout:1/184: symlink d4/l36 0 2024-04-06T12:23:02.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/210: dwrite d4/d9/fa [0,4194304] 0 2024-04-06T12:23:02.594 INFO:tasks.workunit.client.1.smithi195.stdout:7/168: creat d4/d24/f30 x:0 0 0 2024-04-06T12:23:02.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/194: write d3/f24 [1311343,77290] 0 2024-04-06T12:23:02.597 INFO:tasks.workunit.client.1.smithi195.stdout:9/195: read - d3/d10/f2f zero size 2024-04-06T12:23:02.598 INFO:tasks.workunit.client.1.smithi195.stdout:4/204: creat d4/d6/d38/d1a/d40/f41 x:0 0 0 2024-04-06T12:23:02.600 INFO:tasks.workunit.client.1.smithi195.stdout:0/192: creat d4/d6/d2f/f3e x:0 0 0 2024-04-06T12:23:02.602 INFO:tasks.workunit.client.1.smithi195.stdout:7/169: dwrite d4/d16/dd/f28 [0,4194304] 0 2024-04-06T12:23:02.603 INFO:tasks.workunit.client.1.smithi195.stdout:1/185: stat d4/d14/d17/f10 0 2024-04-06T12:23:02.604 INFO:tasks.workunit.client.1.smithi195.stdout:1/186: chown d4/d14/d17/d24/d2a/c31 12446 1 2024-04-06T12:23:02.604 INFO:tasks.workunit.client.1.smithi195.stdout:2/172: getdents d2/d21/d29 0 2024-04-06T12:23:02.605 INFO:tasks.workunit.client.1.smithi195.stdout:1/187: fdatasync d4/d14/d19/f29 0 2024-04-06T12:23:02.608 INFO:tasks.workunit.client.1.smithi195.stdout:3/211: fdatasync d4/f24 0 2024-04-06T12:23:02.611 INFO:tasks.workunit.client.1.smithi195.stdout:9/196: unlink d3/f9 0 2024-04-06T12:23:02.614 INFO:tasks.workunit.client.1.smithi195.stdout:6/195: getdents d8/d21/d31/d35/d27/d44 0 2024-04-06T12:23:02.616 INFO:tasks.workunit.client.1.smithi195.stdout:4/205: mknod d4/d6/d38/d1a/d40/d20/c42 0 2024-04-06T12:23:02.617 INFO:tasks.workunit.client.1.smithi195.stdout:4/206: dread - d4/d6/d38/d1a/d40/f41 zero size 2024-04-06T12:23:02.619 INFO:tasks.workunit.client.1.smithi195.stdout:0/193: creat d4/d6/d1a/f3f x:0 0 0 2024-04-06T12:23:02.622 INFO:tasks.workunit.client.1.smithi195.stdout:7/170: mknod d4/d10/d18/d19/c31 0 2024-04-06T12:23:02.625 INFO:tasks.workunit.client.1.smithi195.stdout:7/171: dread d4/f7 [0,4194304] 0 2024-04-06T12:23:02.626 INFO:tasks.workunit.client.1.smithi195.stdout:2/173: rmdir d2/d21/d2c/d2d 39 2024-04-06T12:23:02.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/176: link d0/da/d13/l32 d0/d40/l48 0 2024-04-06T12:23:02.629 INFO:tasks.workunit.client.1.smithi195.stdout:5/177: truncate d0/da/d23/d38/f44 261728 0 2024-04-06T12:23:02.630 INFO:tasks.workunit.client.1.smithi195.stdout:3/212: creat d4/d9/d2b/d3b/d40/f45 x:0 0 0 2024-04-06T12:23:02.630 INFO:tasks.workunit.client.1.smithi195.stdout:3/213: stat d4/l15 0 2024-04-06T12:23:02.637 INFO:tasks.workunit.client.1.smithi195.stdout:0/194: creat d4/d6/d1a/f40 x:0 0 0 2024-04-06T12:23:02.641 INFO:tasks.workunit.client.1.smithi195.stdout:7/172: creat d4/d24/f32 x:0 0 0 2024-04-06T12:23:02.643 INFO:tasks.workunit.client.1.smithi195.stdout:8/144: truncate d6/f1c 116994 0 2024-04-06T12:23:02.644 INFO:tasks.workunit.client.1.smithi195.stdout:8/145: write d6/f7 [9911115,99613] 0 2024-04-06T12:23:02.651 INFO:tasks.workunit.client.1.smithi195.stdout:6/196: mknod d8/d21/d31/d35/d27/d2f/c45 0 2024-04-06T12:23:02.653 INFO:tasks.workunit.client.1.smithi195.stdout:1/188: write d4/fa [1433421,41029] 0 2024-04-06T12:23:02.654 INFO:tasks.workunit.client.1.smithi195.stdout:4/207: mknod d4/c43 0 2024-04-06T12:23:02.656 INFO:tasks.workunit.client.1.smithi195.stdout:0/195: mkdir d4/d41 0 2024-04-06T12:23:02.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/178: link d0/f24 d0/d2c/d37/f49 0 2024-04-06T12:23:02.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/179: dread d0/da/fc [0,4194304] 0 2024-04-06T12:23:02.666 INFO:tasks.workunit.client.1.smithi195.stdout:3/214: rename f0 to d4/de/f46 0 2024-04-06T12:23:02.667 INFO:tasks.workunit.client.1.smithi195.stdout:3/215: dread - d4/df/f35 zero size 2024-04-06T12:23:02.667 INFO:tasks.workunit.client.1.smithi195.stdout:9/197: creat d3/f43 x:0 0 0 2024-04-06T12:23:02.669 INFO:tasks.workunit.client.1.smithi195.stdout:1/189: creat d4/d14/d17/d24/d2a/f37 x:0 0 0 2024-04-06T12:23:02.672 INFO:tasks.workunit.client.1.smithi195.stdout:4/208: creat d4/d6/d38/f44 x:0 0 0 2024-04-06T12:23:02.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/190: dwrite d4/d14/f18 [0,4194304] 0 2024-04-06T12:23:02.681 INFO:tasks.workunit.client.1.smithi195.stdout:6/197: rename d8/d21/d31/d35/d27 to d8/d21/d2b/d46 0 2024-04-06T12:23:02.683 INFO:tasks.workunit.client.1.smithi195.stdout:9/198: fdatasync d3/f17 0 2024-04-06T12:23:02.689 INFO:tasks.workunit.client.1.smithi195.stdout:4/209: mknod d4/d6/d38/d1a/d40/c45 0 2024-04-06T12:23:02.692 INFO:tasks.workunit.client.1.smithi195.stdout:1/191: mknod d4/d14/d19/d23/d28/c38 0 2024-04-06T12:23:02.692 INFO:tasks.workunit.client.1.smithi195.stdout:1/192: fdatasync d4/d14/d19/f29 0 2024-04-06T12:23:02.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/198: symlink d8/d3d/l47 0 2024-04-06T12:23:02.697 INFO:tasks.workunit.client.1.smithi195.stdout:6/199: truncate d8/f10 4847869 0 2024-04-06T12:23:02.697 INFO:tasks.workunit.client.1.smithi195.stdout:3/216: creat d4/df/d39/f47 x:0 0 0 2024-04-06T12:23:02.699 INFO:tasks.workunit.client.1.smithi195.stdout:1/193: dwrite d4/f11 [0,4194304] 0 2024-04-06T12:23:02.699 INFO:tasks.workunit.client.1.smithi195.stdout:1/194: chown d4/d14/f1f 23 1 2024-04-06T12:23:02.700 INFO:tasks.workunit.client.1.smithi195.stdout:2/174: truncate d2/d21/d2c/d2d/f30 257955 0 2024-04-06T12:23:02.703 INFO:tasks.workunit.client.1.smithi195.stdout:0/196: creat d4/d6/f42 x:0 0 0 2024-04-06T12:23:02.703 INFO:tasks.workunit.client.1.smithi195.stdout:8/146: write d6/f16 [909586,2037] 0 2024-04-06T12:23:02.705 INFO:tasks.workunit.client.1.smithi195.stdout:0/197: write d4/d6/d1a/f40 [139704,37640] 0 2024-04-06T12:23:02.707 INFO:tasks.workunit.client.1.smithi195.stdout:2/175: dwrite d2/f26 [4194304,4194304] 0 2024-04-06T12:23:02.708 INFO:tasks.workunit.client.1.smithi195.stdout:1/195: dread d4/d14/d19/f29 [0,4194304] 0 2024-04-06T12:23:02.708 INFO:tasks.workunit.client.1.smithi195.stdout:1/196: chown d4/c5 1068656737 1 2024-04-06T12:23:02.711 INFO:tasks.workunit.client.1.smithi195.stdout:3/217: fdatasync d4/d9/fa 0 2024-04-06T12:23:02.713 INFO:tasks.workunit.client.1.smithi195.stdout:3/218: readlink d4/d9/l26 0 2024-04-06T12:23:02.715 INFO:tasks.workunit.client.1.smithi195.stdout:9/199: mknod d3/c44 0 2024-04-06T12:23:02.716 INFO:tasks.workunit.client.1.smithi195.stdout:9/200: write d3/d10/f2f [535634,113209] 0 2024-04-06T12:23:02.717 INFO:tasks.workunit.client.1.smithi195.stdout:4/210: getdents d4/d3e 0 2024-04-06T12:23:02.718 INFO:tasks.workunit.client.1.smithi195.stdout:4/211: fdatasync d4/d6/d38/d1a/d40/f3b 0 2024-04-06T12:23:02.722 INFO:tasks.workunit.client.1.smithi195.stdout:2/176: mknod d2/d21/d2c/d2d/c33 0 2024-04-06T12:23:02.723 INFO:tasks.workunit.client.1.smithi195.stdout:1/197: creat d4/d14/d19/f39 x:0 0 0 2024-04-06T12:23:02.727 INFO:tasks.workunit.client.1.smithi195.stdout:6/200: link d8/f2a d8/d21/d2b/f48 0 2024-04-06T12:23:02.728 INFO:tasks.workunit.client.1.smithi195.stdout:3/219: mknod d4/d9/d2b/d3b/c48 0 2024-04-06T12:23:02.731 INFO:tasks.workunit.client.1.smithi195.stdout:9/201: creat d3/d10/d3a/f45 x:0 0 0 2024-04-06T12:23:02.733 INFO:tasks.workunit.client.1.smithi195.stdout:8/147: symlink d6/d8/d12/l2d 0 2024-04-06T12:23:02.737 INFO:tasks.workunit.client.1.smithi195.stdout:1/198: mkdir d4/d14/d17/d3a 0 2024-04-06T12:23:02.737 INFO:tasks.workunit.client.1.smithi195.stdout:1/199: chown d4/d14/d17/d3a 36516 1 2024-04-06T12:23:02.740 INFO:tasks.workunit.client.1.smithi195.stdout:3/220: fsync d4/d9/f21 0 2024-04-06T12:23:02.742 INFO:tasks.workunit.client.1.smithi195.stdout:9/202: creat d3/d10/f46 x:0 0 0 2024-04-06T12:23:02.742 INFO:tasks.workunit.client.1.smithi195.stdout:9/203: chown d3 139361 1 2024-04-06T12:23:02.743 INFO:tasks.workunit.client.1.smithi195.stdout:9/204: chown d3/d10/c1a 301430 1 2024-04-06T12:23:02.743 INFO:tasks.workunit.client.1.smithi195.stdout:8/148: symlink d6/dd/l2e 0 2024-04-06T12:23:02.744 INFO:tasks.workunit.client.1.smithi195.stdout:8/149: fsync d6/d8/f26 0 2024-04-06T12:23:02.745 INFO:tasks.workunit.client.1.smithi195.stdout:8/150: truncate d6/d8/f26 843841 0 2024-04-06T12:23:02.746 INFO:tasks.workunit.client.1.smithi195.stdout:3/221: dread d4/f22 [0,4194304] 0 2024-04-06T12:23:02.748 INFO:tasks.workunit.client.1.smithi195.stdout:2/177: truncate d2/f1e 4094815 0 2024-04-06T12:23:02.749 INFO:tasks.workunit.client.1.smithi195.stdout:1/200: mknod d4/d14/d17/d24/c3b 0 2024-04-06T12:23:02.751 INFO:tasks.workunit.client.1.smithi195.stdout:6/201: mkdir d8/d21/d31/d49 0 2024-04-06T12:23:02.752 INFO:tasks.workunit.client.1.smithi195.stdout:8/151: dwrite d6/f16 [0,4194304] 0 2024-04-06T12:23:02.755 INFO:tasks.workunit.client.1.smithi195.stdout:9/205: creat d3/d10/d3b/f47 x:0 0 0 2024-04-06T12:23:02.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/198: link d4/d6/l36 d4/d6/l43 0 2024-04-06T12:23:02.757 INFO:tasks.workunit.client.1.smithi195.stdout:9/206: chown d3/d10/l40 0 1 2024-04-06T12:23:02.757 INFO:tasks.workunit.client.1.smithi195.stdout:1/201: dwrite d4/d14/d19/f1d [0,4194304] 0 2024-04-06T12:23:02.758 INFO:tasks.workunit.client.1.smithi195.stdout:0/199: write d4/f32 [2604768,76694] 0 2024-04-06T12:23:02.760 INFO:tasks.workunit.client.1.smithi195.stdout:0/200: read - d4/d6/f42 zero size 2024-04-06T12:23:02.763 INFO:tasks.workunit.client.1.smithi195.stdout:3/222: rename d4/de/f2e to d4/d9/f49 0 2024-04-06T12:23:02.763 INFO:tasks.workunit.client.1.smithi195.stdout:3/223: stat d4 0 2024-04-06T12:23:02.765 INFO:tasks.workunit.client.1.smithi195.stdout:9/207: dwrite d3/d10/d3a/f42 [0,4194304] 0 2024-04-06T12:23:02.765 INFO:tasks.workunit.client.1.smithi195.stdout:3/224: write d4/d9/f2a [684392,64103] 0 2024-04-06T12:23:02.770 INFO:tasks.workunit.client.1.smithi195.stdout:6/202: mkdir d8/d21/d2b/d46/d4a 0 2024-04-06T12:23:02.771 INFO:tasks.workunit.client.1.smithi195.stdout:8/152: creat d6/d8/d12/f2f x:0 0 0 2024-04-06T12:23:02.776 INFO:tasks.workunit.client.1.smithi195.stdout:3/225: dwrite d4/f2f [0,4194304] 0 2024-04-06T12:23:02.780 INFO:tasks.workunit.client.1.smithi195.stdout:0/201: unlink d4/ca 0 2024-04-06T12:23:02.781 INFO:tasks.workunit.client.1.smithi195.stdout:8/153: dwrite d6/f7 [4194304,4194304] 0 2024-04-06T12:23:02.785 INFO:tasks.workunit.client.1.smithi195.stdout:9/208: mkdir d3/d10/d3b/d48 0 2024-04-06T12:23:02.788 INFO:tasks.workunit.client.1.smithi195.stdout:3/226: dread d4/df/f3c [0,4194304] 0 2024-04-06T12:23:02.790 INFO:tasks.workunit.client.1.smithi195.stdout:3/227: read d4/d9/d37/f3a [162518,27169] 0 2024-04-06T12:23:02.793 INFO:tasks.workunit.client.1.smithi195.stdout:6/203: rename d8/d21/d31/l1d to d8/d21/d31/d35/d32/l4b 0 2024-04-06T12:23:02.793 INFO:tasks.workunit.client.1.smithi195.stdout:0/202: dwrite d4/d6/f27 [0,4194304] 0 2024-04-06T12:23:02.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/203: dread - d4/d6/f42 zero size 2024-04-06T12:23:02.796 INFO:tasks.workunit.client.1.smithi195.stdout:0/204: dread - d4/d6/d2f/f3e zero size 2024-04-06T12:23:02.798 INFO:tasks.workunit.client.1.smithi195.stdout:5/180: sync 2024-04-06T12:23:02.798 INFO:tasks.workunit.client.1.smithi195.stdout:7/173: sync 2024-04-06T12:23:02.800 INFO:tasks.workunit.client.1.smithi195.stdout:8/154: dread d6/f1c [0,4194304] 0 2024-04-06T12:23:02.801 INFO:tasks.workunit.client.1.smithi195.stdout:0/205: dread d4/d6/f27 [0,4194304] 0 2024-04-06T12:23:02.802 INFO:tasks.workunit.client.1.smithi195.stdout:0/206: write d4/d6/f42 [376055,54735] 0 2024-04-06T12:23:02.809 INFO:tasks.workunit.client.1.smithi195.stdout:3/228: creat d4/d9/d2b/d3b/d40/f4a x:0 0 0 2024-04-06T12:23:02.809 INFO:tasks.workunit.client.1.smithi195.stdout:3/229: chown d4 5659 1 2024-04-06T12:23:02.809 INFO:tasks.workunit.client.1.smithi195.stdout:3/230: stat d4/de/l19 0 2024-04-06T12:23:02.810 INFO:tasks.workunit.client.1.smithi195.stdout:6/204: creat d8/d21/d2b/d46/f4c x:0 0 0 2024-04-06T12:23:02.810 INFO:tasks.workunit.client.1.smithi195.stdout:1/202: link d4/d14/l21 d4/d14/d17/l3c 0 2024-04-06T12:23:02.812 INFO:tasks.workunit.client.1.smithi195.stdout:2/178: getdents d2/d14 0 2024-04-06T12:23:02.813 INFO:tasks.workunit.client.1.smithi195.stdout:7/174: mkdir d4/d10/d18/d33 0 2024-04-06T12:23:02.815 INFO:tasks.workunit.client.1.smithi195.stdout:8/155: mknod d6/db/d23/d24/d25/c30 0 2024-04-06T12:23:02.816 INFO:tasks.workunit.client.1.smithi195.stdout:9/209: creat d3/d10/d3b/d48/f49 x:0 0 0 2024-04-06T12:23:02.817 INFO:tasks.workunit.client.1.smithi195.stdout:9/210: write d3/d10/d3a/f45 [823195,64117] 0 2024-04-06T12:23:02.818 INFO:tasks.workunit.client.1.smithi195.stdout:0/207: creat d4/d6/d2f/f44 x:0 0 0 2024-04-06T12:23:02.824 INFO:tasks.workunit.client.1.smithi195.stdout:9/211: creat d3/d10/d3b/d48/f4a x:0 0 0 2024-04-06T12:23:02.825 INFO:tasks.workunit.client.1.smithi195.stdout:6/205: mknod d8/c4d 0 2024-04-06T12:23:02.827 INFO:tasks.workunit.client.1.smithi195.stdout:5/181: creat d0/f4a x:0 0 0 2024-04-06T12:23:02.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/179: getdents d2/d21/d29 0 2024-04-06T12:23:02.831 INFO:tasks.workunit.client.1.smithi195.stdout:4/212: sync 2024-04-06T12:23:02.831 INFO:tasks.workunit.client.1.smithi195.stdout:9/212: dwrite d3/de/f1c [0,4194304] 0 2024-04-06T12:23:02.832 INFO:tasks.workunit.client.1.smithi195.stdout:1/203: link d4/d14/d19/d23/f2d d4/d14/f3d 0 2024-04-06T12:23:02.833 INFO:tasks.workunit.client.1.smithi195.stdout:9/213: dread - d3/d10/d3b/f47 zero size 2024-04-06T12:23:02.834 INFO:tasks.workunit.client.1.smithi195.stdout:4/213: write d4/d6/d38/f1d [1951276,4566] 0 2024-04-06T12:23:02.835 INFO:tasks.workunit.client.1.smithi195.stdout:5/182: rmdir d0/da 39 2024-04-06T12:23:02.837 INFO:tasks.workunit.client.1.smithi195.stdout:1/204: dread d4/d14/d19/f1a [0,4194304] 0 2024-04-06T12:23:02.837 INFO:tasks.workunit.client.1.smithi195.stdout:2/180: dwrite d2/f12 [0,4194304] 0 2024-04-06T12:23:02.839 INFO:tasks.workunit.client.1.smithi195.stdout:6/206: mkdir d8/d21/d2b/d46/d4a/d4e 0 2024-04-06T12:23:02.845 INFO:tasks.workunit.client.1.smithi195.stdout:8/156: getdents d6/d8/d12 0 2024-04-06T12:23:02.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/205: dwrite d4/d14/f32 [0,4194304] 0 2024-04-06T12:23:02.847 INFO:tasks.workunit.client.1.smithi195.stdout:9/214: creat d3/d10/d3b/d48/f4b x:0 0 0 2024-04-06T12:23:02.849 INFO:tasks.workunit.client.1.smithi195.stdout:3/231: truncate d4/d9/d37/f3a 410406 0 2024-04-06T12:23:02.850 INFO:tasks.workunit.client.1.smithi195.stdout:2/181: stat d2/d21/d2c/f32 0 2024-04-06T12:23:02.850 INFO:tasks.workunit.client.1.smithi195.stdout:1/206: readlink d4/d14/d17/d24/l2e 0 2024-04-06T12:23:02.850 INFO:tasks.workunit.client.1.smithi195.stdout:6/207: unlink d8/f15 0 2024-04-06T12:23:02.854 INFO:tasks.workunit.client.1.smithi195.stdout:0/208: truncate f0 4098800 0 2024-04-06T12:23:02.854 INFO:tasks.workunit.client.1.smithi195.stdout:4/214: truncate d4/d6/d38/d1a/f3c 1216261 0 2024-04-06T12:23:02.855 INFO:tasks.workunit.client.1.smithi195.stdout:3/232: mknod d4/de/c4b 0 2024-04-06T12:23:02.865 INFO:tasks.workunit.client.1.smithi195.stdout:5/183: write d0/f24 [473020,128104] 0 2024-04-06T12:23:02.872 INFO:tasks.workunit.client.1.smithi195.stdout:7/175: dwrite d4/d10/d12/f14 [4194304,4194304] 0 2024-04-06T12:23:02.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/157: creat d6/f31 x:0 0 0 2024-04-06T12:23:02.875 INFO:tasks.workunit.client.1.smithi195.stdout:9/215: dwrite d3/d10/d3b/d48/f4b [0,4194304] 0 2024-04-06T12:23:02.880 INFO:tasks.workunit.client.1.smithi195.stdout:5/184: unlink d0/f42 0 2024-04-06T12:23:02.882 INFO:tasks.workunit.client.1.smithi195.stdout:2/182: dwrite d2/f23 [0,4194304] 0 2024-04-06T12:23:02.884 INFO:tasks.workunit.client.1.smithi195.stdout:6/208: dwrite d8/d21/d31/d26/f34 [0,4194304] 0 2024-04-06T12:23:02.886 INFO:tasks.workunit.client.1.smithi195.stdout:3/233: write d4/d9/f21 [3638980,33656] 0 2024-04-06T12:23:02.887 INFO:tasks.workunit.client.1.smithi195.stdout:5/185: write d0/fe [223379,4718] 0 2024-04-06T12:23:02.890 INFO:tasks.workunit.client.1.smithi195.stdout:8/158: creat d6/db/d23/d24/f32 x:0 0 0 2024-04-06T12:23:02.890 INFO:tasks.workunit.client.1.smithi195.stdout:0/209: dwrite d4/d6/d1a/f3f [0,4194304] 0 2024-04-06T12:23:02.892 INFO:tasks.workunit.client.1.smithi195.stdout:3/234: dread - d4/d9/f49 zero size 2024-04-06T12:23:02.893 INFO:tasks.workunit.client.1.smithi195.stdout:0/210: chown d4/d6/d1a 1 1 2024-04-06T12:23:02.895 INFO:tasks.workunit.client.1.smithi195.stdout:3/235: dread - d4/df/f1b zero size 2024-04-06T12:23:02.895 INFO:tasks.workunit.client.1.smithi195.stdout:2/183: creat d2/d21/d29/f34 x:0 0 0 2024-04-06T12:23:02.898 INFO:tasks.workunit.client.1.smithi195.stdout:7/176: fdatasync d4/d16/fe 0 2024-04-06T12:23:02.899 INFO:tasks.workunit.client.1.smithi195.stdout:3/236: stat d4/de/c3e 0 2024-04-06T12:23:02.900 INFO:tasks.workunit.client.1.smithi195.stdout:9/216: dwrite d3/d10/f46 [0,4194304] 0 2024-04-06T12:23:02.901 INFO:tasks.workunit.client.1.smithi195.stdout:1/207: link d4/c9 d4/d14/c3e 0 2024-04-06T12:23:02.903 INFO:tasks.workunit.client.1.smithi195.stdout:0/211: creat d4/d6/d2f/f45 x:0 0 0 2024-04-06T12:23:02.904 INFO:tasks.workunit.client.1.smithi195.stdout:3/237: read - d4/df/f35 zero size 2024-04-06T12:23:02.905 INFO:tasks.workunit.client.1.smithi195.stdout:6/209: symlink d8/d21/d2b/d46/d44/l4f 0 2024-04-06T12:23:02.905 INFO:tasks.workunit.client.1.smithi195.stdout:0/212: fsync d4/d6/f1d 0 2024-04-06T12:23:02.906 INFO:tasks.workunit.client.1.smithi195.stdout:7/177: dread d4/d16/fe [0,4194304] 0 2024-04-06T12:23:02.907 INFO:tasks.workunit.client.1.smithi195.stdout:1/208: fsync d4/d14/d19/f39 0 2024-04-06T12:23:02.909 INFO:tasks.workunit.client.1.smithi195.stdout:0/213: rename d4 to d4/d46 22 2024-04-06T12:23:02.909 INFO:tasks.workunit.client.1.smithi195.stdout:5/186: mkdir d0/da/d4b 0 2024-04-06T12:23:02.909 INFO:tasks.workunit.client.1.smithi195.stdout:3/238: dread - d4/df/f1b zero size 2024-04-06T12:23:02.910 INFO:tasks.workunit.client.1.smithi195.stdout:6/210: write d8/fc [3851690,33067] 0 2024-04-06T12:23:02.912 INFO:tasks.workunit.client.1.smithi195.stdout:8/159: dwrite d6/db/d23/d24/f32 [0,4194304] 0 2024-04-06T12:23:02.950 INFO:tasks.workunit.client.1.smithi195.stdout:1/209: write d4/d14/d17/f30 [986654,79694] 0 2024-04-06T12:23:02.950 INFO:tasks.workunit.client.1.smithi195.stdout:0/214: creat d4/d6/d1a/f47 x:0 0 0 2024-04-06T12:23:02.951 INFO:tasks.workunit.client.1.smithi195.stdout:2/184: truncate d2/d21/d2c/d2d/f30 425362 0 2024-04-06T12:23:02.953 INFO:tasks.workunit.client.1.smithi195.stdout:6/211: fsync d8/d21/d31/d26/f36 0 2024-04-06T12:23:02.953 INFO:tasks.workunit.client.1.smithi195.stdout:3/239: read - d4/d9/d2b/d3b/d40/f4a zero size 2024-04-06T12:23:02.953 INFO:tasks.workunit.client.1.smithi195.stdout:8/160: truncate d6/db/f2b 432156 0 2024-04-06T12:23:02.954 INFO:tasks.workunit.client.1.smithi195.stdout:0/215: mkdir d4/d48 0 2024-04-06T12:23:02.955 INFO:tasks.workunit.client.1.smithi195.stdout:5/187: creat d0/da/dd/d2e/f4c x:0 0 0 2024-04-06T12:23:02.955 INFO:tasks.workunit.client.1.smithi195.stdout:9/217: dwrite d3/d10/f31 [0,4194304] 0 2024-04-06T12:23:02.956 INFO:tasks.workunit.client.1.smithi195.stdout:8/161: creat d6/db/f33 x:0 0 0 2024-04-06T12:23:02.958 INFO:tasks.workunit.client.1.smithi195.stdout:5/188: readlink d0/da/d13/l47 0 2024-04-06T12:23:02.959 INFO:tasks.workunit.client.1.smithi195.stdout:9/218: fdatasync d3/d10/f2f 0 2024-04-06T12:23:02.962 INFO:tasks.workunit.client.1.smithi195.stdout:6/212: rename d8/d21/d31/d35 to d8/d50 0 2024-04-06T12:23:02.963 INFO:tasks.workunit.client.1.smithi195.stdout:8/162: unlink d6/db/f33 0 2024-04-06T12:23:02.968 INFO:tasks.workunit.client.1.smithi195.stdout:5/189: creat d0/d2c/d34/f4d x:0 0 0 2024-04-06T12:23:02.968 INFO:tasks.workunit.client.1.smithi195.stdout:0/216: dread d4/d6/d1a/f37 [0,4194304] 0 2024-04-06T12:23:02.970 INFO:tasks.workunit.client.1.smithi195.stdout:2/185: dwrite d2/f12 [0,4194304] 0 2024-04-06T12:23:02.972 INFO:tasks.workunit.client.1.smithi195.stdout:6/213: unlink d8/d50/d32/l4b 0 2024-04-06T12:23:02.972 INFO:tasks.workunit.client.1.smithi195.stdout:0/217: read d4/d6/f20 [1676400,91863] 0 2024-04-06T12:23:02.973 INFO:tasks.workunit.client.1.smithi195.stdout:2/186: creat d2/f35 x:0 0 0 2024-04-06T12:23:02.973 INFO:tasks.workunit.client.1.smithi195.stdout:5/190: read d0/f6 [2461043,113911] 0 2024-04-06T12:23:02.974 INFO:tasks.workunit.client.1.smithi195.stdout:9/219: rename d3/d10/l15 to d3/d10/d3b/l4c 0 2024-04-06T12:23:02.975 INFO:tasks.workunit.client.1.smithi195.stdout:8/163: truncate d6/db/d23/d24/d25/f2a 114315 0 2024-04-06T12:23:02.975 INFO:tasks.workunit.client.1.smithi195.stdout:2/187: chown d2/f23 119162135 1 2024-04-06T12:23:02.980 INFO:tasks.workunit.client.1.smithi195.stdout:1/210: dread d4/d14/d19/f20 [0,4194304] 0 2024-04-06T12:23:02.980 INFO:tasks.workunit.client.1.smithi195.stdout:9/220: symlink d3/l4d 0 2024-04-06T12:23:02.982 INFO:tasks.workunit.client.1.smithi195.stdout:8/164: rmdir d6/d2c 0 2024-04-06T12:23:02.984 INFO:tasks.workunit.client.1.smithi195.stdout:9/221: mknod d3/d10/d3b/d48/c4e 0 2024-04-06T12:23:02.986 INFO:tasks.workunit.client.1.smithi195.stdout:8/165: chown d6/l19 13930629 1 2024-04-06T12:23:02.987 INFO:tasks.workunit.client.1.smithi195.stdout:2/188: link d2/c17 d2/d21/c36 0 2024-04-06T12:23:02.988 INFO:tasks.workunit.client.1.smithi195.stdout:5/191: dwrite d0/d2c/d34/f4d [0,4194304] 0 2024-04-06T12:23:02.989 INFO:tasks.workunit.client.1.smithi195.stdout:9/222: mkdir d3/d10/d4f 0 2024-04-06T12:23:02.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.991+0000 7f14a4855700 1 -- 172.21.15.152:0/229731706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f8cb0 msgr2=0x7f14a00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:02.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.991+0000 7f14a4855700 1 --2- 172.21.15.152:0/229731706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f8cb0 0x7f14a00f9110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f14940047f0 tx=0x7f1494009cb0).stop 2024-04-06T12:23:02.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.991+0000 7f14a4855700 1 -- 172.21.15.152:0/229731706 shutdown_connections 2024-04-06T12:23:02.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.991+0000 7f14a4855700 1 --2- 172.21.15.152:0/229731706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f8cb0 0x7f14a00f9110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:02.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.991+0000 7f14a4855700 1 --2- 172.21.15.152:0/229731706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14a00f7a10 0x7f14a00f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:02.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.991+0000 7f14a4855700 1 -- 172.21.15.152:0/229731706 >> 172.21.15.152:0/229731706 conn(0x7f14a00f3150 msgr2=0x7f14a00f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:02.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.991+0000 7f14a4855700 1 -- 172.21.15.152:0/229731706 shutdown_connections 2024-04-06T12:23:02.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.991+0000 7f14a4855700 1 -- 172.21.15.152:0/229731706 wait complete. 2024-04-06T12:23:02.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f14a4855700 1 Processor -- start 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f14a4855700 1 -- start start 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f14a4855700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f7a10 0x7f14a0108290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f14a4855700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14a00f8cb0 0x7f14a0108780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f14a4855700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0108d30 con 0x7f14a00f7a10 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f14a4855700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0108e70 con 0x7f14a00f8cb0 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f149e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f7a10 0x7f14a0108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f149e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f7a10 0x7f14a0108290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52226/0 (socket says 172.21.15.152:52226) 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f149e59c700 1 -- 172.21.15.152:0/2474051791 learned_addr learned my addr 172.21.15.152:0/2474051791 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.992+0000 7f149dd9b700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14a00f8cb0 0x7f14a0108780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.993+0000 7f149e59c700 1 -- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14a00f8cb0 msgr2=0x7f14a0108780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.993+0000 7f149e59c700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14a00f8cb0 0x7f14a0108780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.993+0000 7f149e59c700 1 -- 172.21.15.152:0/2474051791 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494005040 con 0x7f14a00f7a10 2024-04-06T12:23:02.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.993+0000 7f149e59c700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f7a10 0x7f14a0108290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f149000e910 tx=0x7f149000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:02.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.993+0000 7f148f7fe700 1 -- 172.21.15.152:0/2474051791 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1490007b40 con 0x7f14a00f7a10 2024-04-06T12:23:02.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.993+0000 7f148f7fe700 1 -- 172.21.15.152:0/2474051791 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f149000f040 con 0x7f14a00f7a10 2024-04-06T12:23:02.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.993+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a010d910 con 0x7f14a00f7a10 2024-04-06T12:23:02.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.993+0000 7f148f7fe700 1 -- 172.21.15.152:0/2474051791 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1490014910 con 0x7f14a00f7a10 2024-04-06T12:23:02.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.993+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a006af90 con 0x7f14a00f7a10 2024-04-06T12:23:02.996 INFO:tasks.workunit.client.1.smithi195.stdout:6/214: dread d8/f14 [0,4194304] 0 2024-04-06T12:23:02.996 INFO:tasks.workunit.client.1.smithi195.stdout:1/211: rename d4/d14/d19/f39 to d4/d14/d19/d23/d28/d2f/f3f 0 2024-04-06T12:23:02.996 INFO:tasks.workunit.client.1.smithi195.stdout:2/189: dread d2/f12 [0,4194304] 0 2024-04-06T12:23:02.996 INFO:tasks.workunit.client.1.smithi195.stdout:8/166: mkdir d6/db/d23/d24/d34 0 2024-04-06T12:23:02.996 INFO:tasks.workunit.client.1.smithi195.stdout:0/218: truncate d4/d6/d1a/f3f 2610322 0 2024-04-06T12:23:02.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.994+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a005fb50 con 0x7f14a00f7a10 2024-04-06T12:23:02.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.995+0000 7f148f7fe700 1 -- 172.21.15.152:0/2474051791 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f1490007ca0 con 0x7f14a00f7a10 2024-04-06T12:23:02.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.996+0000 7f148f7fe700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f148806b1d0 0x7f148806d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:02.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.996+0000 7f148f7fe700 1 -- 172.21.15.152:0/2474051791 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f1490083db0 con 0x7f14a00f7a10 2024-04-06T12:23:02.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.996+0000 7f149dd9b700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f148806b1d0 0x7f148806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:02.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:02.997+0000 7f149dd9b700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f148806b1d0 0x7f148806d690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f14940047c0 tx=0x7f1494009cb0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:02.998 INFO:tasks.workunit.client.1.smithi195.stdout:4/215: sync 2024-04-06T12:23:02.998 INFO:tasks.workunit.client.1.smithi195.stdout:9/223: mkdir d3/d10/d3b/d50 0 2024-04-06T12:23:02.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.001+0000 7f148f7fe700 1 -- 172.21.15.152:0/2474051791 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f1490051e50 con 0x7f14a00f7a10 2024-04-06T12:23:02.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/216: chown d4/d6 2273048 1 2024-04-06T12:23:03.001 INFO:tasks.workunit.client.1.smithi195.stdout:5/192: mkdir d0/da/d4b/d4e 0 2024-04-06T12:23:03.004 INFO:tasks.workunit.client.1.smithi195.stdout:6/215: creat d8/d21/d31/d49/f51 x:0 0 0 2024-04-06T12:23:03.005 INFO:tasks.workunit.client.1.smithi195.stdout:8/167: dread d6/db/d23/d24/f32 [0,4194304] 0 2024-04-06T12:23:03.005 INFO:tasks.workunit.client.1.smithi195.stdout:4/217: write d4/d6/d38/f44 [546144,80760] 0 2024-04-06T12:23:03.006 INFO:tasks.workunit.client.1.smithi195.stdout:2/190: dwrite d2/d14/f31 [0,4194304] 0 2024-04-06T12:23:03.009 INFO:tasks.workunit.client.1.smithi195.stdout:6/216: chown d8/d50/d32 30305401 1 2024-04-06T12:23:03.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/168: unlink d6/db/f2b 0 2024-04-06T12:23:03.011 INFO:tasks.workunit.client.1.smithi195.stdout:6/217: write d8/d50/f39 [408423,2] 0 2024-04-06T12:23:03.012 INFO:tasks.workunit.client.1.smithi195.stdout:9/224: dread d3/de/f14 [0,4194304] 0 2024-04-06T12:23:03.013 INFO:tasks.workunit.client.1.smithi195.stdout:4/218: creat d4/d6/f46 x:0 0 0 2024-04-06T12:23:03.014 INFO:tasks.workunit.client.1.smithi195.stdout:2/191: truncate d2/f12 3971118 0 2024-04-06T12:23:03.015 INFO:tasks.workunit.client.1.smithi195.stdout:8/169: rmdir d6/d8 39 2024-04-06T12:23:03.017 INFO:tasks.workunit.client.1.smithi195.stdout:1/212: write d4/d14/f3d [853443,49725] 0 2024-04-06T12:23:03.019 INFO:tasks.workunit.client.1.smithi195.stdout:2/192: dread - d2/d21/d29/f34 zero size 2024-04-06T12:23:03.020 INFO:tasks.workunit.client.1.smithi195.stdout:0/219: truncate d4/d6/f42 233109 0 2024-04-06T12:23:03.021 INFO:tasks.workunit.client.1.smithi195.stdout:4/219: mknod d4/d3e/c47 0 2024-04-06T12:23:03.022 INFO:tasks.workunit.client.1.smithi195.stdout:5/193: write d0/da/fc [662270,24952] 0 2024-04-06T12:23:03.022 INFO:tasks.workunit.client.1.smithi195.stdout:8/170: creat d6/d8/f35 x:0 0 0 2024-04-06T12:23:03.023 INFO:tasks.workunit.client.1.smithi195.stdout:6/218: dwrite d8/d21/f30 [0,4194304] 0 2024-04-06T12:23:03.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:01.572139+0000 mgr.smithi195.ausetj (mgr.24375) 47 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 279 op/s 2024-04-06T12:23:03.027 INFO:tasks.workunit.client.1.smithi195.stdout:9/225: dread d3/d10/d3a/f42 [0,4194304] 0 2024-04-06T12:23:03.027 INFO:tasks.workunit.client.1.smithi195.stdout:0/220: stat d4/d6/d2f/f38 0 2024-04-06T12:23:03.029 INFO:tasks.workunit.client.1.smithi195.stdout:6/219: creat d8/d3d/d3f/f52 x:0 0 0 2024-04-06T12:23:03.029 INFO:tasks.workunit.client.1.smithi195.stdout:9/226: write d3/f5 [2471229,82707] 0 2024-04-06T12:23:03.029 INFO:tasks.workunit.client.1.smithi195.stdout:8/171: dread - d6/d8/d12/f2f zero size 2024-04-06T12:23:03.030 INFO:tasks.workunit.client.1.smithi195.stdout:2/193: symlink d2/d21/d2c/l37 0 2024-04-06T12:23:03.031 INFO:tasks.workunit.client.1.smithi195.stdout:2/194: chown d2/d14/f22 2 1 2024-04-06T12:23:03.036 INFO:tasks.workunit.client.1.smithi195.stdout:9/227: creat d3/de/f51 x:0 0 0 2024-04-06T12:23:03.039 INFO:tasks.workunit.client.1.smithi195.stdout:0/221: getdents d4/d41 0 2024-04-06T12:23:03.040 INFO:tasks.workunit.client.1.smithi195.stdout:9/228: dread d3/d10/f46 [0,4194304] 0 2024-04-06T12:23:03.041 INFO:tasks.workunit.client.1.smithi195.stdout:9/229: chown d3/d10/d3b/d48/f4a 94127804 1 2024-04-06T12:23:03.041 INFO:tasks.workunit.client.1.smithi195.stdout:5/194: creat d0/d28/f4f x:0 0 0 2024-04-06T12:23:03.044 INFO:tasks.workunit.client.1.smithi195.stdout:1/213: truncate d4/d14/f1f 132642 0 2024-04-06T12:23:03.048 INFO:tasks.workunit.client.1.smithi195.stdout:8/172: write d6/dd/f14 [4919006,95697] 0 2024-04-06T12:23:03.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:01.572139+0000 mgr.smithi195.ausetj (mgr.24375) 47 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 279 op/s 2024-04-06T12:23:03.049 INFO:tasks.workunit.client.1.smithi195.stdout:6/220: truncate d8/d21/d31/f11 1862861 0 2024-04-06T12:23:03.051 INFO:tasks.workunit.client.1.smithi195.stdout:0/222: mkdir d4/d6/d2f/d49 0 2024-04-06T12:23:03.054 INFO:tasks.workunit.client.1.smithi195.stdout:5/195: mknod d0/da/d13/c50 0 2024-04-06T12:23:03.059 INFO:tasks.workunit.client.1.smithi195.stdout:6/221: creat d8/d21/d2b/d46/d2f/f53 x:0 0 0 2024-04-06T12:23:03.060 INFO:tasks.workunit.client.1.smithi195.stdout:9/230: creat d3/d10/d3b/d50/f52 x:0 0 0 2024-04-06T12:23:03.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/195: creat d2/d21/d2c/f38 x:0 0 0 2024-04-06T12:23:03.062 INFO:tasks.workunit.client.1.smithi195.stdout:5/196: read d0/f3 [1825600,120731] 0 2024-04-06T12:23:03.063 INFO:tasks.workunit.client.1.smithi195.stdout:8/173: mknod d6/db/d23/d24/d34/c36 0 2024-04-06T12:23:03.064 INFO:tasks.workunit.client.1.smithi195.stdout:6/222: creat d8/d21/d2b/f54 x:0 0 0 2024-04-06T12:23:03.065 INFO:tasks.workunit.client.1.smithi195.stdout:9/231: fsync d3/d10/d3a/f42 0 2024-04-06T12:23:03.066 INFO:tasks.workunit.client.1.smithi195.stdout:1/214: link d4/c13 d4/d14/d19/d23/c40 0 2024-04-06T12:23:03.067 INFO:tasks.workunit.client.1.smithi195.stdout:5/197: creat d0/d28/f51 x:0 0 0 2024-04-06T12:23:03.067 INFO:tasks.workunit.client.1.smithi195.stdout:2/196: dread d2/fb [0,4194304] 0 2024-04-06T12:23:03.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/174: creat d6/d8/d12/f37 x:0 0 0 2024-04-06T12:23:03.069 INFO:tasks.workunit.client.1.smithi195.stdout:6/223: unlink d8/d50/d32/f37 0 2024-04-06T12:23:03.069 INFO:tasks.workunit.client.1.smithi195.stdout:2/197: dread - d2/d21/f28 zero size 2024-04-06T12:23:03.069 INFO:tasks.workunit.client.1.smithi195.stdout:0/223: link d4/f5 d4/d6/d2f/f4a 0 2024-04-06T12:23:03.071 INFO:tasks.workunit.client.1.smithi195.stdout:5/198: unlink d0/da/dd/f2a 0 2024-04-06T12:23:03.076 INFO:tasks.workunit.client.1.smithi195.stdout:0/224: mknod d4/d6/c4b 0 2024-04-06T12:23:03.077 INFO:tasks.workunit.client.1.smithi195.stdout:5/199: chown d0/da/dd/l17 19776 1 2024-04-06T12:23:03.079 INFO:tasks.workunit.client.1.smithi195.stdout:1/215: dwrite d4/d14/d19/d23/d28/d2f/f33 [0,4194304] 0 2024-04-06T12:23:03.080 INFO:tasks.workunit.client.1.smithi195.stdout:0/225: stat d4/d6/d2f/f38 0 2024-04-06T12:23:03.086 INFO:tasks.workunit.client.1.smithi195.stdout:8/175: dwrite d6/f20 [0,4194304] 0 2024-04-06T12:23:03.088 INFO:tasks.workunit.client.1.smithi195.stdout:2/198: getdents d2/d21/d2c/d2d 0 2024-04-06T12:23:03.089 INFO:tasks.workunit.client.1.smithi195.stdout:9/232: dwrite d3/de/f14 [4194304,4194304] 0 2024-04-06T12:23:03.090 INFO:tasks.workunit.client.1.smithi195.stdout:6/224: dwrite d8/d21/d2b/f54 [0,4194304] 0 2024-04-06T12:23:03.090 INFO:tasks.workunit.client.1.smithi195.stdout:5/200: mkdir d0/d52 0 2024-04-06T12:23:03.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/216: symlink d4/d14/l41 0 2024-04-06T12:23:03.097 INFO:tasks.workunit.client.1.smithi195.stdout:5/201: write d0/d2c/d37/f49 [4126904,106343] 0 2024-04-06T12:23:03.097 INFO:tasks.workunit.client.1.smithi195.stdout:0/226: dread d4/d6/f20 [0,4194304] 0 2024-04-06T12:23:03.098 INFO:tasks.workunit.client.1.smithi195.stdout:6/225: chown d8/d21/c25 40824 1 2024-04-06T12:23:03.104 INFO:tasks.workunit.client.1.smithi195.stdout:8/176: dwrite d6/f20 [0,4194304] 0 2024-04-06T12:23:03.104 INFO:tasks.workunit.client.1.smithi195.stdout:5/202: creat d0/da/dd/d33/f53 x:0 0 0 2024-04-06T12:23:03.104 INFO:tasks.workunit.client.1.smithi195.stdout:6/226: rmdir d8 39 2024-04-06T12:23:03.105 INFO:tasks.workunit.client.1.smithi195.stdout:2/199: creat d2/d21/f39 x:0 0 0 2024-04-06T12:23:03.108 INFO:tasks.workunit.client.1.smithi195.stdout:1/217: dread d4/d14/d19/f22 [0,4194304] 0 2024-04-06T12:23:03.109 INFO:tasks.workunit.client.1.smithi195.stdout:5/203: write d0/f24 [1681118,14969] 0 2024-04-06T12:23:03.109 INFO:tasks.workunit.client.1.smithi195.stdout:9/233: getdents d3 0 2024-04-06T12:23:03.114 INFO:tasks.workunit.client.1.smithi195.stdout:9/234: write d3/de/f1c [2969683,77755] 0 2024-04-06T12:23:03.117 INFO:tasks.workunit.client.1.smithi195.stdout:8/177: creat d6/dd/f38 x:0 0 0 2024-04-06T12:23:03.120 INFO:tasks.workunit.client.1.smithi195.stdout:9/235: write d3/d10/d3b/f47 [946307,103243] 0 2024-04-06T12:23:03.120 INFO:tasks.workunit.client.1.smithi195.stdout:6/227: creat d8/d21/d2b/d46/d4a/f55 x:0 0 0 2024-04-06T12:23:03.124 INFO:tasks.workunit.client.1.smithi195.stdout:5/204: symlink d0/da/l54 0 2024-04-06T12:23:03.125 INFO:tasks.workunit.client.1.smithi195.stdout:8/178: creat d6/db/d23/d24/f39 x:0 0 0 2024-04-06T12:23:03.129 INFO:tasks.workunit.client.1.smithi195.stdout:9/236: truncate d3/f43 891781 0 2024-04-06T12:23:03.130 INFO:tasks.workunit.client.1.smithi195.stdout:1/218: dwrite d4/d14/f3d [0,4194304] 0 2024-04-06T12:23:03.130 INFO:tasks.workunit.client.1.smithi195.stdout:2/200: dread d2/fe [0,4194304] 0 2024-04-06T12:23:03.131 INFO:tasks.workunit.client.1.smithi195.stdout:5/205: mknod d0/d35/c55 0 2024-04-06T12:23:03.132 INFO:tasks.workunit.client.1.smithi195.stdout:1/219: truncate f1 4970641 0 2024-04-06T12:23:03.132 INFO:tasks.workunit.client.1.smithi195.stdout:0/227: dwrite d4/d6/d1a/f3f [0,4194304] 0 2024-04-06T12:23:03.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/179: fdatasync d6/db/d23/d24/f32 0 2024-04-06T12:23:03.135 INFO:tasks.workunit.client.1.smithi195.stdout:6/228: link d8/f14 d8/d21/d2b/d46/d44/f56 0 2024-04-06T12:23:03.135 INFO:tasks.workunit.client.1.smithi195.stdout:0/228: chown d4/d6 3163 1 2024-04-06T12:23:03.138 INFO:tasks.workunit.client.1.smithi195.stdout:9/237: unlink d3/de/l1e 0 2024-04-06T12:23:03.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/229: fdatasync d8/d21/f30 0 2024-04-06T12:23:03.139 INFO:tasks.workunit.client.1.smithi195.stdout:7/178: sync 2024-04-06T12:23:03.139 INFO:tasks.workunit.client.1.smithi195.stdout:2/201: mkdir d2/d21/d29/d3a 0 2024-04-06T12:23:03.140 INFO:tasks.workunit.client.1.smithi195.stdout:0/229: mknod d4/c4c 0 2024-04-06T12:23:03.140 INFO:tasks.workunit.client.1.smithi195.stdout:1/220: rename d4/d14/f15 to d4/d14/d17/f42 0 2024-04-06T12:23:03.141 INFO:tasks.workunit.client.1.smithi195.stdout:6/230: chown d8/d3d/d3f 30435 1 2024-04-06T12:23:03.141 INFO:tasks.workunit.client.1.smithi195.stdout:9/238: write f1 [690116,81959] 0 2024-04-06T12:23:03.142 INFO:tasks.workunit.client.1.smithi195.stdout:8/180: mkdir d6/d3a 0 2024-04-06T12:23:03.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/239: chown d3 2978825 1 2024-04-06T12:23:03.148 INFO:tasks.workunit.client.1.smithi195.stdout:0/230: creat d4/f4d x:0 0 0 2024-04-06T12:23:03.148 INFO:tasks.workunit.client.1.smithi195.stdout:8/181: creat d6/db/d23/f3b x:0 0 0 2024-04-06T12:23:03.150 INFO:tasks.workunit.client.1.smithi195.stdout:5/206: dwrite d0/da/f21 [0,4194304] 0 2024-04-06T12:23:03.150 INFO:tasks.workunit.client.1.smithi195.stdout:9/240: write d3/d10/f22 [103311,68103] 0 2024-04-06T12:23:03.152 INFO:tasks.workunit.client.1.smithi195.stdout:1/221: rename d4/d14/d17/d24/d2a/f37 to d4/d14/d17/d24/f43 0 2024-04-06T12:23:03.153 INFO:tasks.workunit.client.1.smithi195.stdout:5/207: read - d0/f4a zero size 2024-04-06T12:23:03.216 INFO:tasks.workunit.client.1.smithi195.stdout:8/182: symlink d6/d8/d12/l3c 0 2024-04-06T12:23:03.216 INFO:tasks.workunit.client.1.smithi195.stdout:7/179: dwrite d4/d16/dd/f28 [4194304,4194304] 0 2024-04-06T12:23:03.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/231: mkdir d4/d48/d4e 0 2024-04-06T12:23:03.218 INFO:tasks.workunit.client.1.smithi195.stdout:2/202: dread d2/f4 [0,4194304] 0 2024-04-06T12:23:03.218 INFO:tasks.workunit.client.1.smithi195.stdout:9/241: mknod d3/d10/d4f/c53 0 2024-04-06T12:23:03.219 INFO:tasks.workunit.client.1.smithi195.stdout:5/208: creat d0/da/d13/f56 x:0 0 0 2024-04-06T12:23:03.220 INFO:tasks.workunit.client.1.smithi195.stdout:7/180: creat d4/f34 x:0 0 0 2024-04-06T12:23:03.221 INFO:tasks.workunit.client.1.smithi195.stdout:1/222: truncate d4/d14/d17/d24/f27 102181 0 2024-04-06T12:23:03.222 INFO:tasks.workunit.client.1.smithi195.stdout:8/183: creat d6/d1d/f3d x:0 0 0 2024-04-06T12:23:03.224 INFO:tasks.workunit.client.1.smithi195.stdout:9/242: mknod d3/d10/c54 0 2024-04-06T12:23:03.225 INFO:tasks.workunit.client.1.smithi195.stdout:0/232: creat d4/d6/d2f/d49/f4f x:0 0 0 2024-04-06T12:23:03.227 INFO:tasks.workunit.client.1.smithi195.stdout:9/243: read d3/de/f1c [1672972,5917] 0 2024-04-06T12:23:03.227 INFO:tasks.workunit.client.1.smithi195.stdout:2/203: rename d2/l2e to d2/d21/d2c/d2d/l3b 0 2024-04-06T12:23:03.228 INFO:tasks.workunit.client.1.smithi195.stdout:8/184: mknod d6/db/d23/d24/c3e 0 2024-04-06T12:23:03.230 INFO:tasks.workunit.client.1.smithi195.stdout:9/244: readlink d3/d10/l28 0 2024-04-06T12:23:03.231 INFO:tasks.workunit.client.1.smithi195.stdout:5/209: dwrite d0/ff [4194304,4194304] 0 2024-04-06T12:23:03.232 INFO:tasks.workunit.client.1.smithi195.stdout:8/185: write d6/f20 [8520,124357] 0 2024-04-06T12:23:03.232 INFO:tasks.workunit.client.1.smithi195.stdout:7/181: rename d4/d24/c29 to d4/d10/d18/d33/c35 0 2024-04-06T12:23:03.234 INFO:tasks.workunit.client.1.smithi195.stdout:8/186: fsync d6/d8/f26 0 2024-04-06T12:23:03.235 INFO:tasks.workunit.client.1.smithi195.stdout:5/210: write d0/da/dd/f18 [1654559,78928] 0 2024-04-06T12:23:03.235 INFO:tasks.workunit.client.1.smithi195.stdout:2/204: mknod d2/d21/d2c/d2d/c3c 0 2024-04-06T12:23:03.236 INFO:tasks.workunit.client.1.smithi195.stdout:1/223: dwrite d4/d14/d19/d23/d28/d2f/f33 [0,4194304] 0 2024-04-06T12:23:03.236 INFO:tasks.workunit.client.1.smithi195.stdout:8/187: dread - d6/d8/d12/f37 zero size 2024-04-06T12:23:03.237 INFO:tasks.workunit.client.1.smithi195.stdout:9/245: creat d3/d10/d3b/f55 x:0 0 0 2024-04-06T12:23:03.238 INFO:tasks.workunit.client.1.smithi195.stdout:9/246: stat d3 0 2024-04-06T12:23:03.239 INFO:tasks.workunit.client.1.smithi195.stdout:8/188: dread d6/f1c [0,4194304] 0 2024-04-06T12:23:03.239 INFO:tasks.workunit.client.1.smithi195.stdout:1/224: write d4/d14/fd [1818633,45960] 0 2024-04-06T12:23:03.239 INFO:tasks.workunit.client.1.smithi195.stdout:9/247: write d3/f23 [3437161,49975] 0 2024-04-06T12:23:03.244 INFO:tasks.workunit.client.1.smithi195.stdout:0/233: rename d4/d6/d1a/l30 to d4/d6/d2f/l50 0 2024-04-06T12:23:03.247 INFO:tasks.workunit.client.1.smithi195.stdout:7/182: symlink d4/d16/l36 0 2024-04-06T12:23:03.248 INFO:tasks.workunit.client.1.smithi195.stdout:5/211: creat d0/d2c/f57 x:0 0 0 2024-04-06T12:23:03.252 INFO:tasks.workunit.client.1.smithi195.stdout:7/183: read d4/d16/dd/d22/f2b [7506670,112364] 0 2024-04-06T12:23:03.254 INFO:tasks.workunit.client.1.smithi195.stdout:5/212: mkdir d0/d28/d58 0 2024-04-06T12:23:03.257 INFO:tasks.workunit.client.1.smithi195.stdout:3/240: sync 2024-04-06T12:23:03.257 INFO:tasks.workunit.client.1.smithi195.stdout:8/189: dwrite d6/db/d23/d24/f39 [0,4194304] 0 2024-04-06T12:23:03.258 INFO:tasks.workunit.client.1.smithi195.stdout:1/225: dwrite d4/d14/d19/f22 [0,4194304] 0 2024-04-06T12:23:03.258 INFO:tasks.workunit.client.1.smithi195.stdout:0/234: fsync d4/f5 0 2024-04-06T12:23:03.261 INFO:tasks.workunit.client.1.smithi195.stdout:0/235: fdatasync d4/d6/d2f/f45 0 2024-04-06T12:23:03.261 INFO:tasks.workunit.client.1.smithi195.stdout:1/226: truncate d4/fa 1501703 0 2024-04-06T12:23:03.262 INFO:tasks.workunit.client.1.smithi195.stdout:8/190: chown d6/db/l22 13 1 2024-04-06T12:23:03.265 INFO:tasks.workunit.client.1.smithi195.stdout:8/191: truncate d6/d8/d12/f2f 428035 0 2024-04-06T12:23:03.265 INFO:tasks.workunit.client.1.smithi195.stdout:3/241: creat d4/d9/d2b/d3b/f4c x:0 0 0 2024-04-06T12:23:03.266 INFO:tasks.workunit.client.1.smithi195.stdout:5/213: write d0/d28/f4f [60950,92082] 0 2024-04-06T12:23:03.268 INFO:tasks.workunit.client.1.smithi195.stdout:1/227: rmdir d4 39 2024-04-06T12:23:03.270 INFO:tasks.workunit.client.1.smithi195.stdout:2/205: dread d2/d14/f18 [0,4194304] 0 2024-04-06T12:23:03.270 INFO:tasks.workunit.client.1.smithi195.stdout:3/242: unlink d4/c8 0 2024-04-06T12:23:03.272 INFO:tasks.workunit.client.1.smithi195.stdout:3/243: read - d4/d9/d2b/f42 zero size 2024-04-06T12:23:03.273 INFO:tasks.workunit.client.1.smithi195.stdout:0/236: stat d4/d6/d2f/l50 0 2024-04-06T12:23:03.273 INFO:tasks.workunit.client.1.smithi195.stdout:3/244: write d4/df/f35 [520803,15957] 0 2024-04-06T12:23:03.274 INFO:tasks.workunit.client.1.smithi195.stdout:0/237: readlink d4/d6/d1a/l33 0 2024-04-06T12:23:03.277 INFO:tasks.workunit.client.1.smithi195.stdout:2/206: creat d2/d21/d29/d3a/f3d x:0 0 0 2024-04-06T12:23:03.278 INFO:tasks.workunit.client.1.smithi195.stdout:3/245: mknod d4/de/c4d 0 2024-04-06T12:23:03.279 INFO:tasks.workunit.client.1.smithi195.stdout:2/207: chown d2/d14/f18 68 1 2024-04-06T12:23:03.283 INFO:tasks.workunit.client.1.smithi195.stdout:5/214: getdents d0/da 0 2024-04-06T12:23:03.284 INFO:tasks.workunit.client.1.smithi195.stdout:7/184: dwrite d4/d16/fe [0,4194304] 0 2024-04-06T12:23:03.285 INFO:tasks.workunit.client.1.smithi195.stdout:0/238: dwrite d4/d6/d2f/f45 [0,4194304] 0 2024-04-06T12:23:03.285 INFO:tasks.workunit.client.1.smithi195.stdout:1/228: truncate d4/d14/d19/d23/f2d 3629591 0 2024-04-06T12:23:03.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.288+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14a0102200 con 0x7f148806b1d0 2024-04-06T12:23:03.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.291+0000 7f148f7fe700 1 -- 172.21.15.152:0/2474051791 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f14a0102200 con 0x7f148806b1d0 2024-04-06T12:23:03.289 INFO:tasks.workunit.client.1.smithi195.stdout:1/229: write d4/d14/d19/f20 [4380136,36961] 0 2024-04-06T12:23:03.289 INFO:tasks.workunit.client.1.smithi195.stdout:5/215: fdatasync d0/da/dd/d1c/f20 0 2024-04-06T12:23:03.291 INFO:tasks.workunit.client.1.smithi195.stdout:3/246: creat d4/f4e x:0 0 0 2024-04-06T12:23:03.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f148806b1d0 msgr2=0x7f148806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:03.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f148806b1d0 0x7f148806d690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f14940047c0 tx=0x7f1494009cb0).stop 2024-04-06T12:23:03.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f7a10 msgr2=0x7f14a0108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:03.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f7a10 0x7f14a0108290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f149000e910 tx=0x7f149000b040).stop 2024-04-06T12:23:03.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 shutdown_connections 2024-04-06T12:23:03.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f148806b1d0 0x7f148806d690 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14a00f7a10 0x7f14a0108290 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 --2- 172.21.15.152:0/2474051791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14a00f8cb0 0x7f14a0108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 >> 172.21.15.152:0/2474051791 conn(0x7f14a00f3150 msgr2=0x7f14a00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:03.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 shutdown_connections 2024-04-06T12:23:03.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.294+0000 7f14a4855700 1 -- 172.21.15.152:0/2474051791 wait complete. 2024-04-06T12:23:03.294 INFO:tasks.workunit.client.1.smithi195.stdout:0/239: truncate d4/d6/d1a/f47 410873 0 2024-04-06T12:23:03.296 INFO:tasks.workunit.client.1.smithi195.stdout:5/216: chown d0/da/dd/d1c/l3d 4 1 2024-04-06T12:23:03.297 INFO:tasks.workunit.client.1.smithi195.stdout:3/247: rmdir d4/d9/d2b 39 2024-04-06T12:23:03.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/208: dwrite d2/f1c [0,4194304] 0 2024-04-06T12:23:03.299 INFO:tasks.workunit.client.1.smithi195.stdout:0/240: symlink d4/l51 0 2024-04-06T12:23:03.301 INFO:tasks.workunit.client.1.smithi195.stdout:7/185: dread d4/d10/d12/f14 [0,4194304] 0 2024-04-06T12:23:03.301 INFO:tasks.workunit.client.1.smithi195.stdout:7/186: chown d4/d10 2916 1 2024-04-06T12:23:03.304 INFO:tasks.workunit.client.1.smithi195.stdout:5/217: rename d0/f4a to d0/da/dd/d2e/f59 0 2024-04-06T12:23:03.306 INFO:tasks.workunit.client.1.smithi195.stdout:0/241: creat d4/d6/d2f/d49/f52 x:0 0 0 2024-04-06T12:23:03.306 INFO:tasks.workunit.client.1.smithi195.stdout:5/218: chown d0/da/d13/f1f 161229 1 2024-04-06T12:23:03.308 INFO:tasks.workunit.client.1.smithi195.stdout:3/248: write d4/df/f3c [2268713,84694] 0 2024-04-06T12:23:03.310 INFO:tasks.workunit.client.1.smithi195.stdout:7/187: dwrite d4/f34 [0,4194304] 0 2024-04-06T12:23:03.311 INFO:tasks.workunit.client.1.smithi195.stdout:0/242: mkdir d4/d53 0 2024-04-06T12:23:03.313 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:23:03.313 INFO:tasks.workunit.client.1.smithi195.stdout:2/209: getdents d2/d21/d29/d3a 0 2024-04-06T12:23:03.314 INFO:tasks.workunit.client.1.smithi195.stdout:0/243: creat d4/d6/d1a/f54 x:0 0 0 2024-04-06T12:23:03.315 INFO:tasks.workunit.client.1.smithi195.stdout:3/249: symlink d4/d9/l4f 0 2024-04-06T12:23:03.321 INFO:tasks.workunit.client.1.smithi195.stdout:7/188: dwrite d4/d16/dd/f17 [0,4194304] 0 2024-04-06T12:23:03.323 INFO:tasks.workunit.client.1.smithi195.stdout:3/250: symlink d4/de/l50 0 2024-04-06T12:23:03.325 INFO:tasks.workunit.client.1.smithi195.stdout:2/210: dread d2/f1c [0,4194304] 0 2024-04-06T12:23:03.330 INFO:tasks.workunit.client.1.smithi195.stdout:3/251: truncate d4/f24 2086696 0 2024-04-06T12:23:03.334 INFO:tasks.workunit.client.1.smithi195.stdout:3/252: creat d4/de/f51 x:0 0 0 2024-04-06T12:23:03.339 INFO:tasks.workunit.client.1.smithi195.stdout:2/211: dwrite d2/d14/f1d [0,4194304] 0 2024-04-06T12:23:03.340 INFO:tasks.workunit.client.1.smithi195.stdout:1/230: dread d4/d14/fd [0,4194304] 0 2024-04-06T12:23:03.340 INFO:tasks.workunit.client.1.smithi195.stdout:2/212: write d2/f35 [390387,57934] 0 2024-04-06T12:23:03.341 INFO:tasks.workunit.client.1.smithi195.stdout:1/231: write d4/d14/f18 [3409715,80450] 0 2024-04-06T12:23:03.343 INFO:tasks.workunit.client.1.smithi195.stdout:1/232: fdatasync d4/d14/d19/f20 0 2024-04-06T12:23:03.351 INFO:tasks.workunit.client.1.smithi195.stdout:1/233: truncate d4/f26 169760 0 2024-04-06T12:23:03.352 INFO:tasks.workunit.client.1.smithi195.stdout:1/234: fdatasync d4/f1c 0 2024-04-06T12:23:03.352 INFO:tasks.workunit.client.1.smithi195.stdout:1/235: truncate d4/f11 4260712 0 2024-04-06T12:23:03.354 INFO:tasks.workunit.client.1.smithi195.stdout:1/236: creat d4/f44 x:0 0 0 2024-04-06T12:23:03.357 INFO:tasks.workunit.client.1.smithi195.stdout:1/237: rmdir d4/d14/d17 39 2024-04-06T12:23:03.363 INFO:tasks.workunit.client.1.smithi195.stdout:1/238: dwrite d4/d14/d17/f42 [0,4194304] 0 2024-04-06T12:23:03.380 INFO:tasks.workunit.client.1.smithi195.stdout:1/239: dread d4/f12 [0,4194304] 0 2024-04-06T12:23:03.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/240: mkdir d4/d14/d17/d24/d2a/d45 0 2024-04-06T12:23:03.386 INFO:tasks.workunit.client.1.smithi195.stdout:1/241: rename d4/d14/d17/d24/d2a/c31 to d4/d14/c46 0 2024-04-06T12:23:03.388 INFO:tasks.workunit.client.1.smithi195.stdout:1/242: symlink d4/d14/d17/d24/d2a/l47 0 2024-04-06T12:23:03.392 INFO:tasks.workunit.client.1.smithi195.stdout:4/220: sync 2024-04-06T12:23:03.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/221: write d4/d6/d38/f1d [4397633,97163] 0 2024-04-06T12:23:03.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/222: readlink d4/d6/d38/d1a/l30 0 2024-04-06T12:23:03.401 INFO:tasks.workunit.client.1.smithi195.stdout:1/243: dwrite d4/d14/f1f [0,4194304] 0 2024-04-06T12:23:03.403 INFO:tasks.workunit.client.1.smithi195.stdout:1/244: creat d4/d14/d19/d23/f48 x:0 0 0 2024-04-06T12:23:03.405 INFO:tasks.workunit.client.1.smithi195.stdout:1/245: rename d4/d14/d19/d23/d28 to d4/d14/d19/d23/d28/d49 22 2024-04-06T12:23:03.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/246: chown d4/d14/d17/d24/f27 0 1 2024-04-06T12:23:03.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/247: fsync d4/d14/d17/f42 0 2024-04-06T12:23:03.411 INFO:tasks.workunit.client.1.smithi195.stdout:1/248: getdents d4 0 2024-04-06T12:23:03.413 INFO:tasks.workunit.client.1.smithi195.stdout:1/249: creat d4/d14/d17/d24/f4a x:0 0 0 2024-04-06T12:23:03.419 INFO:tasks.workunit.client.1.smithi195.stdout:1/250: dwrite d4/d14/f34 [0,4194304] 0 2024-04-06T12:23:03.420 INFO:tasks.workunit.client.1.smithi195.stdout:1/251: read d4/d14/d19/f1d [3277396,67605] 0 2024-04-06T12:23:03.422 INFO:tasks.workunit.client.1.smithi195.stdout:1/252: truncate d4/d14/f1f 4786932 0 2024-04-06T12:23:03.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.439+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/2489913062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 msgr2=0x7f2b780f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:03.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.439+0000 7f2b7f4e5700 1 --2- 172.21.15.152:0/2489913062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 0x7f2b780f7df0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f2b680047f0 tx=0x7f2b68009cb0).stop 2024-04-06T12:23:03.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/2489913062 shutdown_connections 2024-04-06T12:23:03.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 --2- 172.21.15.152:0/2489913062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 0x7f2b780f7df0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 --2- 172.21.15.152:0/2489913062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b780f66f0 0x7f2b780f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/2489913062 >> 172.21.15.152:0/2489913062 conn(0x7f2b780f1e50 msgr2=0x7f2b780f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:03.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/2489913062 shutdown_connections 2024-04-06T12:23:03.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/2489913062 wait complete. 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 Processor -- start 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 -- start start 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b780f66f0 0x7f2b78060ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 0x7f2b7810cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7810d290 con 0x7f2b780f7990 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.440+0000 7f2b7f4e5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7810d3d0 con 0x7f2b780f66f0 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7ca80700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 0x7f2b7810cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7ca80700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 0x7f2b7810cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52240/0 (socket says 172.21.15.152:52240) 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7ca80700 1 -- 172.21.15.152:0/249219591 learned_addr learned my addr 172.21.15.152:0/249219591 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7d281700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b780f66f0 0x7f2b78060ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7ca80700 1 -- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b780f66f0 msgr2=0x7f2b78060ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7ca80700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b780f66f0 0x7f2b78060ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7ca80700 1 -- 172.21.15.152:0/249219591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68005040 con 0x7f2b780f7990 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7ca80700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 0x7f2b7810cda0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f2b68013620 tx=0x7f2b68009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b6e7fc700 1 -- 172.21.15.152:0/249219591 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b6800e070 con 0x7f2b780f7990 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b6e7fc700 1 -- 172.21.15.152:0/249219591 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b68007e90 con 0x7f2b780f7990 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7810d570 con 0x7f2b780f7990 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b6e7fc700 1 -- 172.21.15.152:0/249219591 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b68018070 con 0x7f2b780f7990 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.441+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7810dad0 con 0x7f2b780f7990 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.442+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b780feeb0 con 0x7f2b780f7990 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.442+0000 7f2b6e7fc700 1 -- 172.21.15.152:0/249219591 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f2b6801d420 con 0x7f2b780f7990 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.443+0000 7f2b6e7fc700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2b64066dc0 0x7f2b64069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.443+0000 7f2b6e7fc700 1 -- 172.21.15.152:0/249219591 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f2b68085180 con 0x7f2b780f7990 2024-04-06T12:23:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.443+0000 7f2b7d281700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2b64066dc0 0x7f2b64069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:03.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.443+0000 7f2b7d281700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2b64066dc0 0x7f2b64069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2b780f77f0 tx=0x7f2b74009d80).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:03.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.447+0000 7f2b6e7fc700 1 -- 172.21.15.152:0/249219591 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f2b68053220 con 0x7f2b780f7990 2024-04-06T12:23:03.481 INFO:tasks.workunit.client.1.smithi195.stdout:6/231: sync 2024-04-06T12:23:03.481 INFO:tasks.workunit.client.1.smithi195.stdout:9/248: sync 2024-04-06T12:23:03.482 INFO:tasks.workunit.client.1.smithi195.stdout:6/232: chown d8/d21/d31/l13 0 1 2024-04-06T12:23:03.482 INFO:tasks.workunit.client.1.smithi195.stdout:9/249: chown d3/d10/d3b/c41 8 1 2024-04-06T12:23:03.486 INFO:tasks.workunit.client.1.smithi195.stdout:6/233: link d8/d21/d31/d49/f51 d8/d50/d32/f57 0 2024-04-06T12:23:03.489 INFO:tasks.workunit.client.1.smithi195.stdout:6/234: mkdir d8/d58 0 2024-04-06T12:23:03.492 INFO:tasks.workunit.client.1.smithi195.stdout:9/250: truncate d3/d10/d3b/f47 3994 0 2024-04-06T12:23:03.497 INFO:tasks.workunit.client.1.smithi195.stdout:6/235: getdents d8 0 2024-04-06T12:23:03.498 INFO:tasks.workunit.client.1.smithi195.stdout:9/251: rmdir d3/d10/d3b 39 2024-04-06T12:23:03.498 INFO:tasks.workunit.client.1.smithi195.stdout:9/252: stat d3/l34 0 2024-04-06T12:23:03.499 INFO:tasks.workunit.client.1.smithi195.stdout:9/253: chown d3/d10/d3a/l3d 6 1 2024-04-06T12:23:03.501 INFO:tasks.workunit.client.1.smithi195.stdout:9/254: mknod d3/c56 0 2024-04-06T12:23:03.502 INFO:tasks.workunit.client.1.smithi195.stdout:6/236: dread d8/f14 [0,4194304] 0 2024-04-06T12:23:03.505 INFO:tasks.workunit.client.1.smithi195.stdout:6/237: creat d8/d21/d2b/d46/d4a/f59 x:0 0 0 2024-04-06T12:23:03.506 INFO:tasks.workunit.client.1.smithi195.stdout:6/238: chown d8/d50/f39 440967244 1 2024-04-06T12:23:03.508 INFO:tasks.workunit.client.1.smithi195.stdout:9/255: creat d3/d10/d4f/f57 x:0 0 0 2024-04-06T12:23:03.510 INFO:tasks.workunit.client.1.smithi195.stdout:6/239: creat d8/d21/f5a x:0 0 0 2024-04-06T12:23:03.513 INFO:tasks.workunit.client.1.smithi195.stdout:9/256: creat d3/de/f58 x:0 0 0 2024-04-06T12:23:03.516 INFO:tasks.workunit.client.1.smithi195.stdout:9/257: symlink d3/d10/d3a/l59 0 2024-04-06T12:23:03.518 INFO:tasks.workunit.client.1.smithi195.stdout:9/258: creat d3/d10/d4f/f5a x:0 0 0 2024-04-06T12:23:03.522 INFO:tasks.workunit.client.1.smithi195.stdout:6/240: dread d8/f23 [0,4194304] 0 2024-04-06T12:23:03.522 INFO:tasks.workunit.client.1.smithi195.stdout:9/259: rmdir d3/de 39 2024-04-06T12:23:03.522 INFO:tasks.workunit.client.1.smithi195.stdout:6/241: truncate d8/fc 4468981 0 2024-04-06T12:23:03.523 INFO:tasks.workunit.client.1.smithi195.stdout:6/242: fsync d8/d21/d31/fe 0 2024-04-06T12:23:03.528 INFO:tasks.workunit.client.1.smithi195.stdout:6/243: getdents d8/d21/d31/d26 0 2024-04-06T12:23:03.529 INFO:tasks.workunit.client.1.smithi195.stdout:6/244: symlink d8/d21/d2b/d46/d2f/l5b 0 2024-04-06T12:23:03.530 INFO:tasks.workunit.client.1.smithi195.stdout:6/245: dread - d8/d21/d2b/d46/f4c zero size 2024-04-06T12:23:03.533 INFO:tasks.workunit.client.1.smithi195.stdout:5/219: sync 2024-04-06T12:23:03.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/244: sync 2024-04-06T12:23:03.533 INFO:tasks.workunit.client.1.smithi195.stdout:8/192: sync 2024-04-06T12:23:03.534 INFO:tasks.workunit.client.1.smithi195.stdout:6/246: rmdir d8/d58 0 2024-04-06T12:23:03.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/260: dread d3/d10/f11 [0,4194304] 0 2024-04-06T12:23:03.535 INFO:tasks.workunit.client.1.smithi195.stdout:5/220: rmdir d0/d2c/d34 39 2024-04-06T12:23:03.536 INFO:tasks.workunit.client.1.smithi195.stdout:5/221: fdatasync d0/fe 0 2024-04-06T12:23:03.536 INFO:tasks.workunit.client.1.smithi195.stdout:8/193: unlink d6/db/l17 0 2024-04-06T12:23:03.537 INFO:tasks.workunit.client.1.smithi195.stdout:0/245: symlink d4/d6/d2f/d49/l55 0 2024-04-06T12:23:03.538 INFO:tasks.workunit.client.1.smithi195.stdout:6/247: symlink d8/d3d/l5c 0 2024-04-06T12:23:03.538 INFO:tasks.workunit.client.1.smithi195.stdout:6/248: read - d8/d21/d2b/d46/f4c zero size 2024-04-06T12:23:03.542 INFO:tasks.workunit.client.1.smithi195.stdout:0/246: unlink d4/f9 0 2024-04-06T12:23:03.542 INFO:tasks.workunit.client.1.smithi195.stdout:0/247: fsync d4/f31 0 2024-04-06T12:23:03.542 INFO:tasks.workunit.client.1.smithi195.stdout:5/222: mkdir d0/da/dd/d1c/d5a 0 2024-04-06T12:23:03.544 INFO:tasks.workunit.client.1.smithi195.stdout:8/194: rename c2 to d6/db/d23/d24/d34/c3f 0 2024-04-06T12:23:03.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/248: dwrite d4/fd [0,4194304] 0 2024-04-06T12:23:03.550 INFO:tasks.workunit.client.1.smithi195.stdout:5/223: getdents d0/da/d23/d38/d41 0 2024-04-06T12:23:03.552 INFO:tasks.workunit.client.1.smithi195.stdout:5/224: chown d0/d2c/d37/f49 60400 1 2024-04-06T12:23:03.552 INFO:tasks.workunit.client.1.smithi195.stdout:5/225: chown d0/f24 450065418 1 2024-04-06T12:23:03.552 INFO:tasks.workunit.client.1.smithi195.stdout:8/195: mknod d6/c40 0 2024-04-06T12:23:03.553 INFO:tasks.workunit.client.1.smithi195.stdout:8/196: fdatasync d6/db/d23/d24/d25/f2a 0 2024-04-06T12:23:03.553 INFO:tasks.workunit.client.1.smithi195.stdout:0/249: creat d4/d48/f56 x:0 0 0 2024-04-06T12:23:03.554 INFO:tasks.workunit.client.1.smithi195.stdout:0/250: fsync d4/f3d 0 2024-04-06T12:23:03.555 INFO:tasks.workunit.client.1.smithi195.stdout:0/251: write d4/d6/d2f/f45 [301065,97681] 0 2024-04-06T12:23:03.556 INFO:tasks.workunit.client.1.smithi195.stdout:0/252: write d4/d6/d1a/f54 [813176,1853] 0 2024-04-06T12:23:03.557 INFO:tasks.workunit.client.1.smithi195.stdout:6/249: write d8/d50/d32/f57 [476778,31232] 0 2024-04-06T12:23:03.558 INFO:tasks.workunit.client.1.smithi195.stdout:6/250: stat d8/f2a 0 2024-04-06T12:23:03.558 INFO:tasks.workunit.client.1.smithi195.stdout:0/253: stat d4/d6/d1a/l22 0 2024-04-06T12:23:03.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/254: write d4/f32 [4671961,117602] 0 2024-04-06T12:23:03.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/251: rename d8/d3d/l5c to d8/l5d 0 2024-04-06T12:23:03.564 INFO:tasks.workunit.client.1.smithi195.stdout:8/197: mknod d6/d3a/c41 0 2024-04-06T12:23:03.564 INFO:tasks.workunit.client.1.smithi195.stdout:0/255: write d4/d6/f35 [248259,11737] 0 2024-04-06T12:23:03.567 INFO:tasks.workunit.client.1.smithi195.stdout:6/252: readlink d8/d21/d31/l13 0 2024-04-06T12:23:03.571 INFO:tasks.workunit.client.1.smithi195.stdout:6/253: rmdir d8/d3d/d3f 39 2024-04-06T12:23:03.571 INFO:tasks.workunit.client.1.smithi195.stdout:0/256: dread d4/d6/f35 [0,4194304] 0 2024-04-06T12:23:03.571 INFO:tasks.workunit.client.1.smithi195.stdout:5/226: dread d0/d2c/d34/f4d [0,4194304] 0 2024-04-06T12:23:03.572 INFO:tasks.workunit.client.1.smithi195.stdout:7/189: sync 2024-04-06T12:23:03.572 INFO:tasks.workunit.client.1.smithi195.stdout:4/223: sync 2024-04-06T12:23:03.572 INFO:tasks.workunit.client.1.smithi195.stdout:2/213: sync 2024-04-06T12:23:03.573 INFO:tasks.workunit.client.1.smithi195.stdout:3/253: sync 2024-04-06T12:23:03.573 INFO:tasks.workunit.client.1.smithi195.stdout:1/253: sync 2024-04-06T12:23:03.573 INFO:tasks.workunit.client.1.smithi195.stdout:9/261: dwrite d3/d10/d3b/f47 [0,4194304] 0 2024-04-06T12:23:03.576 INFO:tasks.workunit.client.1.smithi195.stdout:8/198: dwrite d6/f16 [0,4194304] 0 2024-04-06T12:23:03.576 INFO:tasks.workunit.client.1.smithi195.stdout:0/257: rmdir d4/d6/d1a 39 2024-04-06T12:23:03.577 INFO:tasks.workunit.client.1.smithi195.stdout:0/258: dread - d4/d6/d2f/d49/f4f zero size 2024-04-06T12:23:03.581 INFO:tasks.workunit.client.1.smithi195.stdout:0/259: write d4/d6/d2f/f45 [2052861,129970] 0 2024-04-06T12:23:03.582 INFO:tasks.workunit.client.1.smithi195.stdout:9/262: stat d3/d10/d3a 0 2024-04-06T12:23:03.582 INFO:tasks.workunit.client.1.smithi195.stdout:3/254: dread - d4/df/f28 zero size 2024-04-06T12:23:03.585 INFO:tasks.workunit.client.1.smithi195.stdout:6/254: dwrite d8/d21/f30 [0,4194304] 0 2024-04-06T12:23:03.593 INFO:tasks.workunit.client.1.smithi195.stdout:5/227: rmdir d0/da/dd/d33 39 2024-04-06T12:23:03.594 INFO:tasks.workunit.client.1.smithi195.stdout:4/224: dwrite d4/d6/d38/f28 [0,4194304] 0 2024-04-06T12:23:03.597 INFO:tasks.workunit.client.1.smithi195.stdout:7/190: dread d4/d16/dd/d22/f2b [4194304,4194304] 0 2024-04-06T12:23:03.598 INFO:tasks.workunit.client.1.smithi195.stdout:1/254: dread d4/d14/d19/f29 [0,4194304] 0 2024-04-06T12:23:03.598 INFO:tasks.workunit.client.1.smithi195.stdout:3/255: dread - d4/d9/d2b/d3b/d40/f4a zero size 2024-04-06T12:23:03.598 INFO:tasks.workunit.client.1.smithi195.stdout:7/191: stat d4/d10/d12 0 2024-04-06T12:23:03.600 INFO:tasks.workunit.client.1.smithi195.stdout:3/256: chown d4/df/c1d 1 1 2024-04-06T12:23:03.602 INFO:tasks.workunit.client.1.smithi195.stdout:7/192: read d4/d16/dd/f28 [3640269,79790] 0 2024-04-06T12:23:03.607 INFO:tasks.workunit.client.1.smithi195.stdout:4/225: dwrite d4/d6/d38/d1a/d40/d20/d23/f31 [0,4194304] 0 2024-04-06T12:23:03.607 INFO:tasks.workunit.client.1.smithi195.stdout:0/260: truncate f0 844414 0 2024-04-06T12:23:03.608 INFO:tasks.workunit.client.1.smithi195.stdout:4/226: fdatasync d4/f12 0 2024-04-06T12:23:03.612 INFO:tasks.workunit.client.1.smithi195.stdout:5/228: chown d0/da/dd/d33/f53 2596720 1 2024-04-06T12:23:03.613 INFO:tasks.workunit.client.1.smithi195.stdout:8/199: dwrite d6/f1c [0,4194304] 0 2024-04-06T12:23:03.618 INFO:tasks.workunit.client.1.smithi195.stdout:3/257: rmdir d4/d9/d2b/d3b/d40 39 2024-04-06T12:23:03.621 INFO:tasks.workunit.client.1.smithi195.stdout:2/214: dwrite d2/f1e [0,4194304] 0 2024-04-06T12:23:03.626 INFO:tasks.workunit.client.1.smithi195.stdout:6/255: mkdir d8/d3d/d5e 0 2024-04-06T12:23:03.630 INFO:tasks.workunit.client.1.smithi195.stdout:3/258: dwrite d4/f2f [4194304,4194304] 0 2024-04-06T12:23:03.634 INFO:tasks.workunit.client.1.smithi195.stdout:3/259: dread - d4/df/f20 zero size 2024-04-06T12:23:03.634 INFO:tasks.workunit.client.1.smithi195.stdout:0/261: rename d4/d6/l25 to d4/d6/d2f/d49/l57 0 2024-04-06T12:23:03.636 INFO:tasks.workunit.client.1.smithi195.stdout:5/229: fdatasync d0/da/dd/f3b 0 2024-04-06T12:23:03.636 INFO:tasks.workunit.client.1.smithi195.stdout:3/260: fsync d4/df/f35 0 2024-04-06T12:23:03.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/200: mkdir d6/dd/d42 0 2024-04-06T12:23:03.640 INFO:tasks.workunit.client.1.smithi195.stdout:2/215: creat d2/d21/d29/f3e x:0 0 0 2024-04-06T12:23:03.648 INFO:tasks.workunit.client.1.smithi195.stdout:2/216: dread d2/f23 [0,4194304] 0 2024-04-06T12:23:03.648 INFO:tasks.workunit.client.1.smithi195.stdout:4/227: fsync d4/d6/d38/d1a/d40/f15 0 2024-04-06T12:23:03.650 INFO:tasks.workunit.client.1.smithi195.stdout:7/193: dread d4/f7 [0,4194304] 0 2024-04-06T12:23:03.655 INFO:tasks.workunit.client.1.smithi195.stdout:8/201: mknod d6/db/d23/c43 0 2024-04-06T12:23:03.656 INFO:tasks.workunit.client.1.smithi195.stdout:4/228: dwrite d4/d6/d38/d1a/d40/f32 [0,4194304] 0 2024-04-06T12:23:03.657 INFO:tasks.workunit.client.1.smithi195.stdout:8/202: chown d6/dd/l2e 36 1 2024-04-06T12:23:03.657 INFO:tasks.workunit.client.1.smithi195.stdout:8/203: stat d6/d8/f26 0 2024-04-06T12:23:03.658 INFO:tasks.workunit.client.1.smithi195.stdout:1/255: write d4/d14/f3d [4465276,122647] 0 2024-04-06T12:23:03.659 INFO:tasks.workunit.client.1.smithi195.stdout:8/204: dread - d6/d8/d12/f37 zero size 2024-04-06T12:23:03.660 INFO:tasks.workunit.client.1.smithi195.stdout:4/229: truncate d4/d6/d38/d1a/d40/f3b 358109 0 2024-04-06T12:23:03.662 INFO:tasks.workunit.client.1.smithi195.stdout:1/256: write d4/d14/d19/d23/f48 [553490,108772] 0 2024-04-06T12:23:03.664 INFO:tasks.workunit.client.1.smithi195.stdout:1/257: write d4/d14/d19/f29 [80436,107100] 0 2024-04-06T12:23:03.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/217: mkdir d2/d3f 0 2024-04-06T12:23:03.669 INFO:tasks.workunit.client.1.smithi195.stdout:7/194: dread f0 [0,4194304] 0 2024-04-06T12:23:03.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/218: read d2/d14/f31 [841365,11454] 0 2024-04-06T12:23:03.671 INFO:tasks.workunit.client.1.smithi195.stdout:7/195: write d4/d10/d12/f2e [625357,84322] 0 2024-04-06T12:23:03.674 INFO:tasks.workunit.client.1.smithi195.stdout:3/261: mkdir d4/d9/d52 0 2024-04-06T12:23:03.675 INFO:tasks.workunit.client.1.smithi195.stdout:5/230: symlink d0/d52/l5b 0 2024-04-06T12:23:03.682 INFO:tasks.workunit.client.1.smithi195.stdout:8/205: symlink d6/db/d23/l44 0 2024-04-06T12:23:03.682 INFO:tasks.workunit.client.1.smithi195.stdout:9/263: sync 2024-04-06T12:23:03.688 INFO:tasks.workunit.client.1.smithi195.stdout:1/258: dread d4/f11 [0,4194304] 0 2024-04-06T12:23:03.688 INFO:tasks.workunit.client.1.smithi195.stdout:8/206: dwrite d6/f16 [0,4194304] 0 2024-04-06T12:23:03.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/262: dwrite d4/d6/f42 [0,4194304] 0 2024-04-06T12:23:03.694 INFO:tasks.workunit.client.1.smithi195.stdout:6/256: link d8/d21/d2b/d46/d44/f56 d8/d21/d2b/d46/d4a/f5f 0 2024-04-06T12:23:03.698 INFO:tasks.workunit.client.1.smithi195.stdout:1/259: dread d4/d14/d19/f20 [0,4194304] 0 2024-04-06T12:23:03.701 INFO:tasks.workunit.client.1.smithi195.stdout:3/262: rmdir d4/d9/d2b/d3b 39 2024-04-06T12:23:03.701 INFO:tasks.workunit.client.1.smithi195.stdout:3/263: stat d4/f22 0 2024-04-06T12:23:03.703 INFO:tasks.workunit.client.1.smithi195.stdout:5/231: symlink d0/d52/l5c 0 2024-04-06T12:23:03.715 INFO:tasks.workunit.client.1.smithi195.stdout:3/264: dread d4/d9/fa [0,4194304] 0 2024-04-06T12:23:03.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/196: mkdir d4/d10/d12/d37 0 2024-04-06T12:23:03.720 INFO:tasks.workunit.client.1.smithi195.stdout:4/230: write d4/d6/d38/d1a/f2d [1241366,123114] 0 2024-04-06T12:23:03.721 INFO:tasks.workunit.client.1.smithi195.stdout:1/260: mknod d4/d14/d19/c4b 0 2024-04-06T12:23:03.725 INFO:tasks.workunit.client.1.smithi195.stdout:4/231: dwrite d4/f5 [0,4194304] 0 2024-04-06T12:23:03.735 INFO:tasks.workunit.client.1.smithi195.stdout:5/232: dwrite d0/da/dd/d2e/f59 [0,4194304] 0 2024-04-06T12:23:03.736 INFO:tasks.workunit.client.1.smithi195.stdout:0/263: mkdir d4/d6/d58 0 2024-04-06T12:23:03.741 INFO:tasks.workunit.client.1.smithi195.stdout:6/257: creat d8/d3d/d3f/f60 x:0 0 0 2024-04-06T12:23:03.742 INFO:tasks.workunit.client.1.smithi195.stdout:7/197: creat d4/d24/f38 x:0 0 0 2024-04-06T12:23:03.745 INFO:tasks.workunit.client.1.smithi195.stdout:1/261: creat d4/d14/d19/f4c x:0 0 0 2024-04-06T12:23:03.746 INFO:tasks.workunit.client.1.smithi195.stdout:2/219: link d2/d21/d2c/d2d/f30 d2/d3f/f40 0 2024-04-06T12:23:03.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.749+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b78059120 con 0x7f2b64066dc0 2024-04-06T12:23:03.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.751+0000 7f2b6e7fc700 1 -- 172.21.15.152:0/249219591 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2b78059120 con 0x7f2b64066dc0 2024-04-06T12:23:03.749 INFO:tasks.workunit.client.1.smithi195.stdout:9/264: truncate d3/d10/d3b/d48/f4b 4135637 0 2024-04-06T12:23:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2b64066dc0 msgr2=0x7f2b64069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2b64066dc0 0x7f2b64069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2b780f77f0 tx=0x7f2b74009d80).stop 2024-04-06T12:23:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 msgr2=0x7f2b7810cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 0x7f2b7810cda0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f2b68013620 tx=0x7f2b68009cb0).stop 2024-04-06T12:23:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 shutdown_connections 2024-04-06T12:23:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2b64066dc0 0x7f2b64069280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b780f66f0 0x7f2b78060ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 --2- 172.21.15.152:0/249219591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b780f7990 0x7f2b7810cda0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 >> 172.21.15.152:0/249219591 conn(0x7f2b780f1e50 msgr2=0x7f2b780fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:03.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 shutdown_connections 2024-04-06T12:23:03.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.753+0000 7f2b7f4e5700 1 -- 172.21.15.152:0/249219591 wait complete. 2024-04-06T12:23:03.753 INFO:tasks.workunit.client.1.smithi195.stdout:5/233: unlink d0/ff 0 2024-04-06T12:23:03.754 INFO:tasks.workunit.client.1.smithi195.stdout:5/234: truncate d0/d28/f51 345566 0 2024-04-06T12:23:03.755 INFO:tasks.workunit.client.1.smithi195.stdout:0/264: creat d4/f59 x:0 0 0 2024-04-06T12:23:03.758 INFO:tasks.workunit.client.1.smithi195.stdout:3/265: mkdir d4/d53 0 2024-04-06T12:23:03.762 INFO:tasks.workunit.client.1.smithi195.stdout:1/262: rmdir d4/d14/d17 39 2024-04-06T12:23:03.763 INFO:tasks.workunit.client.1.smithi195.stdout:1/263: chown d4/d14/d19/d23/f48 320 1 2024-04-06T12:23:03.794 INFO:tasks.workunit.client.1.smithi195.stdout:2/220: mkdir d2/d41 0 2024-04-06T12:23:03.794 INFO:tasks.workunit.client.1.smithi195.stdout:9/265: creat d3/d10/d3b/f5b x:0 0 0 2024-04-06T12:23:03.795 INFO:tasks.workunit.client.1.smithi195.stdout:5/235: mknod d0/da/d4b/c5d 0 2024-04-06T12:23:03.796 INFO:tasks.workunit.client.1.smithi195.stdout:0/265: creat d4/d48/f5a x:0 0 0 2024-04-06T12:23:03.796 INFO:tasks.workunit.client.1.smithi195.stdout:3/266: rename d4/df/f3c to d4/d53/f54 0 2024-04-06T12:23:03.796 INFO:tasks.workunit.client.1.smithi195.stdout:4/232: dread d4/d6/f7 [4194304,4194304] 0 2024-04-06T12:23:03.796 INFO:tasks.workunit.client.1.smithi195.stdout:2/221: write d2/d21/d29/f34 [980943,41853] 0 2024-04-06T12:23:03.797 INFO:tasks.workunit.client.1.smithi195.stdout:6/258: mkdir d8/d21/d61 0 2024-04-06T12:23:03.799 INFO:tasks.workunit.client.1.smithi195.stdout:4/233: truncate d4/d6/d38/d1a/d40/f41 292038 0 2024-04-06T12:23:03.819 INFO:tasks.workunit.client.1.smithi195.stdout:1/264: creat d4/d14/d19/f4d x:0 0 0 2024-04-06T12:23:03.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/265: dread d4/d14/d19/d23/f48 [0,4194304] 0 2024-04-06T12:23:03.823 INFO:tasks.workunit.client.1.smithi195.stdout:5/236: mkdir d0/da/d13/d5e 0 2024-04-06T12:23:03.824 INFO:tasks.workunit.client.1.smithi195.stdout:8/207: sync 2024-04-06T12:23:03.826 INFO:tasks.workunit.client.1.smithi195.stdout:3/267: rmdir d4/de 39 2024-04-06T12:23:03.827 INFO:tasks.workunit.client.1.smithi195.stdout:5/237: dread d0/d2c/d34/f4d [0,4194304] 0 2024-04-06T12:23:03.837 INFO:tasks.workunit.client.1.smithi195.stdout:9/266: mknod d3/de/d37/c5c 0 2024-04-06T12:23:03.842 INFO:tasks.workunit.client.1.smithi195.stdout:9/267: dwrite d3/d10/d3a/f42 [0,4194304] 0 2024-04-06T12:23:03.842 INFO:tasks.workunit.client.1.smithi195.stdout:8/208: creat d6/d3a/f45 x:0 0 0 2024-04-06T12:23:03.845 INFO:tasks.workunit.client.1.smithi195.stdout:5/238: rmdir d0/da/d4b 39 2024-04-06T12:23:03.850 INFO:tasks.workunit.client.1.smithi195.stdout:0/266: rename f0 to d4/d48/d4e/f5b 0 2024-04-06T12:23:03.852 INFO:tasks.workunit.client.1.smithi195.stdout:2/222: creat d2/d3f/f42 x:0 0 0 2024-04-06T12:23:03.857 INFO:tasks.workunit.client.1.smithi195.stdout:8/209: mkdir d6/d3a/d46 0 2024-04-06T12:23:03.859 INFO:tasks.workunit.client.1.smithi195.stdout:5/239: creat d0/d35/f5f x:0 0 0 2024-04-06T12:23:03.864 INFO:tasks.workunit.client.1.smithi195.stdout:8/210: dwrite d6/db/d23/f3b [0,4194304] 0 2024-04-06T12:23:03.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/267: dread d4/d6/d1a/f40 [0,4194304] 0 2024-04-06T12:23:03.865 INFO:tasks.workunit.client.1.smithi195.stdout:6/259: rename d8/d21/d31/f1f to d8/d21/d2b/f62 0 2024-04-06T12:23:03.865 INFO:tasks.workunit.client.1.smithi195.stdout:8/211: fdatasync d6/d3a/f45 0 2024-04-06T12:23:03.867 INFO:tasks.workunit.client.1.smithi195.stdout:2/223: write d2/f13 [1152788,102252] 0 2024-04-06T12:23:03.867 INFO:tasks.workunit.client.1.smithi195.stdout:0/268: truncate d4/d6/d2f/d49/f52 947639 0 2024-04-06T12:23:03.878 INFO:tasks.workunit.client.1.smithi195.stdout:4/234: rename d4/d6/c2f to d4/d6/d38/c48 0 2024-04-06T12:23:03.879 INFO:tasks.workunit.client.1.smithi195.stdout:4/235: stat d4/f12 0 2024-04-06T12:23:03.879 INFO:tasks.workunit.client.1.smithi195.stdout:1/266: truncate d4/d14/fd 354928 0 2024-04-06T12:23:03.879 INFO:tasks.workunit.client.1.smithi195.stdout:1/267: readlink d4/l6 0 2024-04-06T12:23:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.882+0000 7fc2eeea0700 1 -- 172.21.15.152:0/2777612216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2e80fa9b0 msgr2=0x7fc2e80fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.882+0000 7fc2eeea0700 1 --2- 172.21.15.152:0/2777612216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2e80fa9b0 0x7fc2e80fcda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc2d4004730 tx=0x7fc2d4009cb0).stop 2024-04-06T12:23:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.882+0000 7fc2eeea0700 1 -- 172.21.15.152:0/2777612216 shutdown_connections 2024-04-06T12:23:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.882+0000 7fc2eeea0700 1 --2- 172.21.15.152:0/2777612216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2e80fa9b0 0x7fc2e80fcda0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.882+0000 7fc2eeea0700 1 --2- 172.21.15.152:0/2777612216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8061220 0x7fc2e80fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.882+0000 7fc2eeea0700 1 -- 172.21.15.152:0/2777612216 >> 172.21.15.152:0/2777612216 conn(0x7fc2e80f1e50 msgr2=0x7fc2e80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.882+0000 7fc2eeea0700 1 -- 172.21.15.152:0/2777612216 shutdown_connections 2024-04-06T12:23:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.882+0000 7fc2eeea0700 1 -- 172.21.15.152:0/2777612216 wait complete. 2024-04-06T12:23:03.881 INFO:tasks.workunit.client.1.smithi195.stdout:1/268: write d4/fa [442965,73076] 0 2024-04-06T12:23:03.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.883+0000 7fc2eeea0700 1 Processor -- start 2024-04-06T12:23:03.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.883+0000 7fc2eeea0700 1 -- start start 2024-04-06T12:23:03.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.883+0000 7fc2eeea0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8061220 0x7fc2e8104110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:03.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.883+0000 7fc2eeea0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2e80fa9b0 0x7fc2e8104600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:03.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.883+0000 7fc2eeea0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8100b60 con 0x7fc2e8061220 2024-04-06T12:23:03.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.883+0000 7fc2eeea0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8100ca0 con 0x7fc2e80fa9b0 2024-04-06T12:23:03.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.883+0000 7fc2e7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2e80fa9b0 0x7fc2e8104600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:03.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.884+0000 7fc2ecc3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8061220 0x7fc2e8104110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:03.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.884+0000 7fc2ecc3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8061220 0x7fc2e8104110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52258/0 (socket says 172.21.15.152:52258) 2024-04-06T12:23:03.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.884+0000 7fc2ecc3c700 1 -- 172.21.15.152:0/673998647 learned_addr learned my addr 172.21.15.152:0/673998647 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:03.883 INFO:tasks.workunit.client.1.smithi195.stdout:8/212: mkdir d6/db/d47 0 2024-04-06T12:23:03.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.884+0000 7fc2ecc3c700 1 -- 172.21.15.152:0/673998647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2e80fa9b0 msgr2=0x7fc2e8104600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:03.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.884+0000 7fc2ecc3c700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2e80fa9b0 0x7fc2e8104600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:03.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.884+0000 7fc2ecc3c700 1 -- 172.21.15.152:0/673998647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4005040 con 0x7fc2e8061220 2024-04-06T12:23:03.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.884+0000 7fc2ecc3c700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8061220 0x7fc2e8104110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fc2dc00e8f0 tx=0x7fc2dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:03.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.885+0000 7fc2e5ffb700 1 -- 172.21.15.152:0/673998647 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc007b40 con 0x7fc2e8061220 2024-04-06T12:23:03.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.885+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e8100f80 con 0x7fc2e8061220 2024-04-06T12:23:03.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.885+0000 7fc2e5ffb700 1 -- 172.21.15.152:0/673998647 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc2dc00f040 con 0x7fc2e8061220 2024-04-06T12:23:03.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.885+0000 7fc2e5ffb700 1 -- 172.21.15.152:0/673998647 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc0147e0 con 0x7fc2e8061220 2024-04-06T12:23:03.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.885+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e8101540 con 0x7fc2e8061220 2024-04-06T12:23:03.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.886+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e81017b0 con 0x7fc2e8061220 2024-04-06T12:23:03.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.887+0000 7fc2e5ffb700 1 -- 172.21.15.152:0/673998647 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fc2dc007ca0 con 0x7fc2e8061220 2024-04-06T12:23:03.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.887+0000 7fc2e5ffb700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fc2d8066dc0 0x7fc2d8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:03.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.887+0000 7fc2e5ffb700 1 -- 172.21.15.152:0/673998647 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fc2dc083cf0 con 0x7fc2e8061220 2024-04-06T12:23:03.886 INFO:tasks.workunit.client.1.smithi195.stdout:0/269: fdatasync d4/f5 0 2024-04-06T12:23:03.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.888+0000 7fc2e7fff700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fc2d8066dc0 0x7fc2d8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:03.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.888+0000 7fc2e7fff700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fc2d8066dc0 0x7fc2d8069280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc2d4004700 tx=0x7fc2d4016040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:03.889 INFO:tasks.workunit.client.1.smithi195.stdout:7/198: sync 2024-04-06T12:23:03.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:03.892+0000 7fc2e5ffb700 1 -- 172.21.15.152:0/673998647 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fc2dc051e60 con 0x7fc2e8061220 2024-04-06T12:23:03.890 INFO:tasks.workunit.client.1.smithi195.stdout:6/260: mknod d8/d3d/c63 0 2024-04-06T12:23:03.895 INFO:tasks.workunit.client.1.smithi195.stdout:1/269: mkdir d4/d14/d19/d4e 0 2024-04-06T12:23:03.895 INFO:tasks.workunit.client.1.smithi195.stdout:7/199: dwrite d4/d16/dd/f2a [0,4194304] 0 2024-04-06T12:23:03.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/200: readlink d4/d16/l6 0 2024-04-06T12:23:03.906 INFO:tasks.workunit.client.1.smithi195.stdout:0/270: mknod d4/d48/c5c 0 2024-04-06T12:23:03.916 INFO:tasks.workunit.client.1.smithi195.stdout:1/270: rename d4/d14/d19/d23/f2d to d4/d14/d19/d23/d28/f4f 0 2024-04-06T12:23:03.919 INFO:tasks.workunit.client.1.smithi195.stdout:2/224: creat d2/d21/f43 x:0 0 0 2024-04-06T12:23:03.920 INFO:tasks.workunit.client.1.smithi195.stdout:2/225: stat d2/d3f/f42 0 2024-04-06T12:23:03.926 INFO:tasks.workunit.client.1.smithi195.stdout:5/240: rename d0/da/d13/f39 to d0/da/d23/d38/f60 0 2024-04-06T12:23:03.926 INFO:tasks.workunit.client.1.smithi195.stdout:5/241: read d0/d28/f4f [115070,70533] 0 2024-04-06T12:23:03.927 INFO:tasks.workunit.client.1.smithi195.stdout:5/242: truncate d0/d2c/f3f 223660 0 2024-04-06T12:23:03.929 INFO:tasks.workunit.client.1.smithi195.stdout:8/213: link d6/dd/l2e d6/d8/l48 0 2024-04-06T12:23:03.932 INFO:tasks.workunit.client.1.smithi195.stdout:2/226: symlink d2/l44 0 2024-04-06T12:23:03.933 INFO:tasks.workunit.client.1.smithi195.stdout:2/227: dread - d2/d21/d29/f3e zero size 2024-04-06T12:23:03.933 INFO:tasks.workunit.client.1.smithi195.stdout:0/271: mknod d4/d6/d58/c5d 0 2024-04-06T12:23:03.935 INFO:tasks.workunit.client.1.smithi195.stdout:6/261: creat d8/d21/d31/f64 x:0 0 0 2024-04-06T12:23:03.935 INFO:tasks.workunit.client.1.smithi195.stdout:6/262: chown d8/d50 308 1 2024-04-06T12:23:03.937 INFO:tasks.workunit.client.1.smithi195.stdout:7/201: link d4/d24/f32 d4/d10/d12/f39 0 2024-04-06T12:23:03.940 INFO:tasks.workunit.client.1.smithi195.stdout:1/271: link d4/f44 d4/d14/d19/d23/d28/f50 0 2024-04-06T12:23:03.941 INFO:tasks.workunit.client.1.smithi195.stdout:6/263: dwrite d8/d21/d2b/f54 [0,4194304] 0 2024-04-06T12:23:03.941 INFO:tasks.workunit.client.1.smithi195.stdout:1/272: write d4/d14/d19/f1b [1949867,37777] 0 2024-04-06T12:23:03.943 INFO:tasks.workunit.client.1.smithi195.stdout:2/228: write d2/fe [1085261,72057] 0 2024-04-06T12:23:03.947 INFO:tasks.workunit.client.1.smithi195.stdout:2/229: fdatasync d2/d3f/f42 0 2024-04-06T12:23:03.948 INFO:tasks.workunit.client.1.smithi195.stdout:7/202: fdatasync d4/d16/f1b 0 2024-04-06T12:23:03.949 INFO:tasks.workunit.client.1.smithi195.stdout:7/203: read d4/f34 [2459071,73915] 0 2024-04-06T12:23:03.950 INFO:tasks.workunit.client.1.smithi195.stdout:1/273: fdatasync d4/d14/d17/f30 0 2024-04-06T12:23:03.951 INFO:tasks.workunit.client.1.smithi195.stdout:6/264: creat d8/d21/d2b/d46/f65 x:0 0 0 2024-04-06T12:23:03.952 INFO:tasks.workunit.client.1.smithi195.stdout:6/265: dread - d8/d21/d2b/d46/f65 zero size 2024-04-06T12:23:03.959 INFO:tasks.workunit.client.1.smithi195.stdout:7/204: symlink d4/d16/l3a 0 2024-04-06T12:23:03.959 INFO:tasks.workunit.client.1.smithi195.stdout:6/266: dwrite d8/d21/f5a [0,4194304] 0 2024-04-06T12:23:03.963 INFO:tasks.workunit.client.1.smithi195.stdout:1/274: mknod d4/d14/d19/c51 0 2024-04-06T12:23:03.963 INFO:tasks.workunit.client.1.smithi195.stdout:6/267: dread d8/d21/d2b/d46/d44/f56 [0,4194304] 0 2024-04-06T12:23:03.963 INFO:tasks.workunit.client.1.smithi195.stdout:1/275: write d4/d14/f18 [4354929,120011] 0 2024-04-06T12:23:03.963 INFO:tasks.workunit.client.1.smithi195.stdout:2/230: getdents d2/d41 0 2024-04-06T12:23:03.966 INFO:tasks.workunit.client.1.smithi195.stdout:6/268: dread d8/f23 [0,4194304] 0 2024-04-06T12:23:03.971 INFO:tasks.workunit.client.1.smithi195.stdout:2/231: dread d2/d21/d29/f34 [0,4194304] 0 2024-04-06T12:23:03.972 INFO:tasks.workunit.client.1.smithi195.stdout:7/205: rmdir d4/d24 39 2024-04-06T12:23:03.975 INFO:tasks.workunit.client.1.smithi195.stdout:3/268: sync 2024-04-06T12:23:03.978 INFO:tasks.workunit.client.1.smithi195.stdout:6/269: dwrite d8/f19 [0,4194304] 0 2024-04-06T12:23:03.980 INFO:tasks.workunit.client.1.smithi195.stdout:2/232: dwrite d2/d21/f39 [0,4194304] 0 2024-04-06T12:23:03.981 INFO:tasks.workunit.client.1.smithi195.stdout:1/276: creat d4/d14/d19/d4e/f52 x:0 0 0 2024-04-06T12:23:03.988 INFO:tasks.workunit.client.1.smithi195.stdout:6/270: mknod d8/d50/d32/c66 0 2024-04-06T12:23:03.989 INFO:tasks.workunit.client.1.smithi195.stdout:7/206: dwrite d4/d24/f38 [0,4194304] 0 2024-04-06T12:23:03.994 INFO:tasks.workunit.client.1.smithi195.stdout:7/207: dread d4/d10/d12/f2e [0,4194304] 0 2024-04-06T12:23:03.996 INFO:tasks.workunit.client.1.smithi195.stdout:1/277: rename d4/d14/d19/d23/d28/f4f to d4/d14/d17/f53 0 2024-04-06T12:23:03.999 INFO:tasks.workunit.client.1.smithi195.stdout:3/269: chown d4/d9/d2b/d3b/d40 7085119 1 2024-04-06T12:23:04.002 INFO:tasks.workunit.client.1.smithi195.stdout:6/271: symlink d8/d21/d2b/l67 0 2024-04-06T12:23:04.003 INFO:tasks.workunit.client.1.smithi195.stdout:1/278: dwrite d4/d14/f1f [4194304,4194304] 0 2024-04-06T12:23:04.003 INFO:tasks.workunit.client.1.smithi195.stdout:2/233: getdents d2/d14 0 2024-04-06T12:23:04.008 INFO:tasks.workunit.client.1.smithi195.stdout:7/208: unlink d4/d16/dd/l2c 0 2024-04-06T12:23:04.009 INFO:tasks.workunit.client.1.smithi195.stdout:4/236: sync 2024-04-06T12:23:04.010 INFO:tasks.workunit.client.1.smithi195.stdout:5/243: sync 2024-04-06T12:23:04.010 INFO:tasks.workunit.client.1.smithi195.stdout:9/268: sync 2024-04-06T12:23:04.011 INFO:tasks.workunit.client.1.smithi195.stdout:4/237: stat d4/f16 0 2024-04-06T12:23:04.012 INFO:tasks.workunit.client.1.smithi195.stdout:1/279: dwrite d4/d14/d19/d23/d28/d2f/f33 [0,4194304] 0 2024-04-06T12:23:04.013 INFO:tasks.workunit.client.1.smithi195.stdout:5/244: write d0/d35/f5f [688478,91312] 0 2024-04-06T12:23:04.016 INFO:tasks.workunit.client.1.smithi195.stdout:2/234: write d2/fb [11602,89667] 0 2024-04-06T12:23:04.026 INFO:tasks.workunit.client.1.smithi195.stdout:9/269: mkdir d3/d10/d3a/d5d 0 2024-04-06T12:23:04.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:02.785910+0000 mon.smithi195 (mon.1) 60 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:23:04.027 INFO:tasks.workunit.client.1.smithi195.stdout:5/245: stat d0/da/dd/f18 0 2024-04-06T12:23:04.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/280: dread f1 [0,4194304] 0 2024-04-06T12:23:04.028 INFO:tasks.workunit.client.1.smithi195.stdout:3/270: link d4/d9/d2b/f42 d4/d9/d2b/d3b/d40/f55 0 2024-04-06T12:23:04.029 INFO:tasks.workunit.client.1.smithi195.stdout:1/281: stat l2 0 2024-04-06T12:23:04.029 INFO:tasks.workunit.client.1.smithi195.stdout:3/271: fdatasync d4/df/f35 0 2024-04-06T12:23:04.029 INFO:tasks.workunit.client.1.smithi195.stdout:2/235: dread d2/f4 [0,4194304] 0 2024-04-06T12:23:04.030 INFO:tasks.workunit.client.1.smithi195.stdout:3/272: dread - d4/d9/f41 zero size 2024-04-06T12:23:04.032 INFO:tasks.workunit.client.1.smithi195.stdout:7/209: rename d4/d24/f38 to d4/d10/d12/d37/f3b 0 2024-04-06T12:23:04.033 INFO:tasks.workunit.client.1.smithi195.stdout:9/270: mkdir d3/d10/d3b/d48/d5e 0 2024-04-06T12:23:04.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/246: readlink d0/da/l54 0 2024-04-06T12:23:04.036 INFO:tasks.workunit.client.1.smithi195.stdout:5/247: read d0/f3 [2050574,72077] 0 2024-04-06T12:23:04.037 INFO:tasks.workunit.client.1.smithi195.stdout:6/272: creat d8/d3d/f68 x:0 0 0 2024-04-06T12:23:04.040 INFO:tasks.workunit.client.1.smithi195.stdout:1/282: creat d4/d14/d17/d24/d2a/f54 x:0 0 0 2024-04-06T12:23:04.042 INFO:tasks.workunit.client.1.smithi195.stdout:5/248: dwrite d0/da/dd/f18 [4194304,4194304] 0 2024-04-06T12:23:04.047 INFO:tasks.workunit.client.1.smithi195.stdout:4/238: rename d4/d6/d38/d1a/d40/ff to d4/d3e/f49 0 2024-04-06T12:23:04.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:02.785910+0000 mon.smithi195 (mon.1) 60 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:23:04.050 INFO:tasks.workunit.client.1.smithi195.stdout:9/271: write d3/d10/f46 [750386,121075] 0 2024-04-06T12:23:04.055 INFO:tasks.workunit.client.1.smithi195.stdout:6/273: mknod d8/d21/d2b/d46/c69 0 2024-04-06T12:23:04.057 INFO:tasks.workunit.client.1.smithi195.stdout:1/283: fsync d4/d14/f3d 0 2024-04-06T12:23:04.057 INFO:tasks.workunit.client.1.smithi195.stdout:9/272: dwrite d3/de/f58 [0,4194304] 0 2024-04-06T12:23:04.057 INFO:tasks.workunit.client.1.smithi195.stdout:6/274: chown d8/d3d/d3f/f60 895264 1 2024-04-06T12:23:04.058 INFO:tasks.workunit.client.1.smithi195.stdout:8/214: sync 2024-04-06T12:23:04.058 INFO:tasks.workunit.client.1.smithi195.stdout:0/272: sync 2024-04-06T12:23:04.059 INFO:tasks.workunit.client.1.smithi195.stdout:8/215: stat d6/d8/d12 0 2024-04-06T12:23:04.060 INFO:tasks.workunit.client.1.smithi195.stdout:5/249: creat d0/da/d23/f61 x:0 0 0 2024-04-06T12:23:04.065 INFO:tasks.workunit.client.1.smithi195.stdout:7/210: link d4/d24/f1a d4/d10/f3c 0 2024-04-06T12:23:04.068 INFO:tasks.workunit.client.1.smithi195.stdout:7/211: dread - d4/d24/f30 zero size 2024-04-06T12:23:04.068 INFO:tasks.workunit.client.1.smithi195.stdout:9/273: dwrite d3/d10/f30 [0,4194304] 0 2024-04-06T12:23:04.071 INFO:tasks.workunit.client.1.smithi195.stdout:3/273: dwrite f3 [0,4194304] 0 2024-04-06T12:23:04.075 INFO:tasks.workunit.client.1.smithi195.stdout:9/274: dread - d3/d10/d3b/d48/f49 zero size 2024-04-06T12:23:04.075 INFO:tasks.workunit.client.1.smithi195.stdout:3/274: dread - d4/df/f1b zero size 2024-04-06T12:23:04.075 INFO:tasks.workunit.client.1.smithi195.stdout:3/275: dread - d4/f12 zero size 2024-04-06T12:23:04.075 INFO:tasks.workunit.client.1.smithi195.stdout:4/239: dread d4/d6/d38/f2c [0,4194304] 0 2024-04-06T12:23:04.076 INFO:tasks.workunit.client.1.smithi195.stdout:0/273: write d4/d6/d1a/f37 [629453,91751] 0 2024-04-06T12:23:04.077 INFO:tasks.workunit.client.1.smithi195.stdout:3/276: write d4/d9/d2b/f38 [4363492,85806] 0 2024-04-06T12:23:04.078 INFO:tasks.workunit.client.1.smithi195.stdout:3/277: write d4/f25 [1536600,98797] 0 2024-04-06T12:23:04.079 INFO:tasks.workunit.client.1.smithi195.stdout:1/284: rename d4/d14/f32 to d4/d14/d17/d24/d2a/d45/f55 0 2024-04-06T12:23:04.081 INFO:tasks.workunit.client.1.smithi195.stdout:3/278: read - d4/d9/d2b/d3b/d40/f45 zero size 2024-04-06T12:23:04.095 INFO:tasks.workunit.client.1.smithi195.stdout:2/236: getdents d2/d3f 0 2024-04-06T12:23:04.095 INFO:tasks.workunit.client.1.smithi195.stdout:7/212: creat d4/d10/d18/d19/f3d x:0 0 0 2024-04-06T12:23:04.098 INFO:tasks.workunit.client.1.smithi195.stdout:1/285: fsync d4/d14/d17/d24/f27 0 2024-04-06T12:23:04.099 INFO:tasks.workunit.client.1.smithi195.stdout:6/275: write d8/f2a [1045666,11125] 0 2024-04-06T12:23:04.099 INFO:tasks.workunit.client.1.smithi195.stdout:3/279: rename d4/df/f1b to d4/d9/d2b/d3b/d40/f56 0 2024-04-06T12:23:04.100 INFO:tasks.workunit.client.1.smithi195.stdout:8/216: dread d6/f7 [0,4194304] 0 2024-04-06T12:23:04.101 INFO:tasks.workunit.client.1.smithi195.stdout:0/274: unlink c3 0 2024-04-06T12:23:04.102 INFO:tasks.workunit.client.1.smithi195.stdout:7/213: creat d4/d16/f3e x:0 0 0 2024-04-06T12:23:04.104 INFO:tasks.workunit.client.1.smithi195.stdout:6/276: write d8/f10 [553985,80150] 0 2024-04-06T12:23:04.104 INFO:tasks.workunit.client.1.smithi195.stdout:5/250: dwrite d0/da/f21 [0,4194304] 0 2024-04-06T12:23:04.106 INFO:tasks.workunit.client.1.smithi195.stdout:4/240: creat d4/f4a x:0 0 0 2024-04-06T12:23:04.108 INFO:tasks.workunit.client.1.smithi195.stdout:0/275: mknod d4/d48/c5e 0 2024-04-06T12:23:04.108 INFO:tasks.workunit.client.1.smithi195.stdout:7/214: chown d4/d16/dd/f28 1474154 1 2024-04-06T12:23:04.115 INFO:tasks.workunit.client.1.smithi195.stdout:0/276: read d4/d6/f2c [1074091,77420] 0 2024-04-06T12:23:04.115 INFO:tasks.workunit.client.1.smithi195.stdout:2/237: dwrite d2/f1a [0,4194304] 0 2024-04-06T12:23:04.115 INFO:tasks.workunit.client.1.smithi195.stdout:3/280: truncate d4/d9/d2b/d3b/d40/f45 353977 0 2024-04-06T12:23:04.117 INFO:tasks.workunit.client.1.smithi195.stdout:4/241: write d4/f12 [4792693,25005] 0 2024-04-06T12:23:04.119 INFO:tasks.workunit.client.1.smithi195.stdout:5/251: rename d0/d40 to d0/da/dd/d1c/d5a/d62 0 2024-04-06T12:23:04.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/238: chown d2/d14/l25 53110189 1 2024-04-06T12:23:04.122 INFO:tasks.workunit.client.1.smithi195.stdout:1/286: dread d4/f12 [0,4194304] 0 2024-04-06T12:23:04.124 INFO:tasks.workunit.client.1.smithi195.stdout:4/242: stat d4/d6/d38/d1a/f24 0 2024-04-06T12:23:04.127 INFO:tasks.workunit.client.1.smithi195.stdout:8/217: dwrite d6/d3a/f45 [0,4194304] 0 2024-04-06T12:23:04.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/277: write d4/d6/d1a/f40 [1196877,100060] 0 2024-04-06T12:23:04.130 INFO:tasks.workunit.client.1.smithi195.stdout:7/215: dwrite d4/d16/f1c [0,4194304] 0 2024-04-06T12:23:04.134 INFO:tasks.workunit.client.1.smithi195.stdout:1/287: fsync d4/d14/d19/d23/d28/d2f/f3f 0 2024-04-06T12:23:04.134 INFO:tasks.workunit.client.1.smithi195.stdout:4/243: mknod d4/c4b 0 2024-04-06T12:23:04.136 INFO:tasks.workunit.client.1.smithi195.stdout:5/252: creat d0/f63 x:0 0 0 2024-04-06T12:23:04.137 INFO:tasks.workunit.client.1.smithi195.stdout:3/281: truncate f3 3860619 0 2024-04-06T12:23:04.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/277: dwrite d8/d21/d2b/d46/d4a/f5f [0,4194304] 0 2024-04-06T12:23:04.139 INFO:tasks.workunit.client.1.smithi195.stdout:4/244: chown d4/c17 486 1 2024-04-06T12:23:04.141 INFO:tasks.workunit.client.1.smithi195.stdout:8/218: rename d6/d1d to d6/db/d23/d24/d25/d49 0 2024-04-06T12:23:04.145 INFO:tasks.workunit.client.1.smithi195.stdout:8/219: write d6/db/d23/f3b [1466082,1657] 0 2024-04-06T12:23:04.149 INFO:tasks.workunit.client.1.smithi195.stdout:1/288: dread d4/d14/d19/d23/d28/d2f/f33 [0,4194304] 0 2024-04-06T12:23:04.151 INFO:tasks.workunit.client.1.smithi195.stdout:3/282: dwrite d4/d9/d2b/f32 [0,4194304] 0 2024-04-06T12:23:04.151 INFO:tasks.workunit.client.1.smithi195.stdout:7/216: mkdir d4/d16/dd/d22/d3f 0 2024-04-06T12:23:04.153 INFO:tasks.workunit.client.1.smithi195.stdout:0/278: creat d4/d6/f5f x:0 0 0 2024-04-06T12:23:04.154 INFO:tasks.workunit.client.1.smithi195.stdout:8/220: dread d6/f1c [0,4194304] 0 2024-04-06T12:23:04.155 INFO:tasks.workunit.client.1.smithi195.stdout:8/221: write d6/d8/f35 [255821,86353] 0 2024-04-06T12:23:04.155 INFO:tasks.workunit.client.1.smithi195.stdout:4/245: rmdir d4/d6/d38/d1a 39 2024-04-06T12:23:04.157 INFO:tasks.workunit.client.1.smithi195.stdout:8/222: truncate d6/db/d23/d24/d25/f2a 445957 0 2024-04-06T12:23:04.159 INFO:tasks.workunit.client.1.smithi195.stdout:8/223: write d6/f20 [4396410,105552] 0 2024-04-06T12:23:04.163 INFO:tasks.workunit.client.1.smithi195.stdout:1/289: write d4/d14/d17/d24/f43 [19420,75257] 0 2024-04-06T12:23:04.165 INFO:tasks.workunit.client.1.smithi195.stdout:3/283: creat d4/df/f57 x:0 0 0 2024-04-06T12:23:04.168 INFO:tasks.workunit.client.1.smithi195.stdout:7/217: rename d4/d24/f30 to d4/d10/f40 0 2024-04-06T12:23:04.171 INFO:tasks.workunit.client.1.smithi195.stdout:7/218: dread d4/d16/f1c [0,4194304] 0 2024-04-06T12:23:04.172 INFO:tasks.workunit.client.1.smithi195.stdout:7/219: dread - d4/d24/f1f zero size 2024-04-06T12:23:04.173 INFO:tasks.workunit.client.1.smithi195.stdout:6/278: link d8/d21/d2b/f62 d8/d50/f6a 0 2024-04-06T12:23:04.175 INFO:tasks.workunit.client.1.smithi195.stdout:1/290: mknod d4/d14/d17/d24/d2a/c56 0 2024-04-06T12:23:04.179 INFO:tasks.workunit.client.1.smithi195.stdout:5/253: getdents d0/da/d23/d38 0 2024-04-06T12:23:04.182 INFO:tasks.workunit.client.1.smithi195.stdout:6/279: symlink d8/d21/d2b/l6b 0 2024-04-06T12:23:04.185 INFO:tasks.workunit.client.1.smithi195.stdout:3/284: fdatasync d4/d9/d37/f3a 0 2024-04-06T12:23:04.186 INFO:tasks.workunit.client.1.smithi195.stdout:6/280: dread d8/d21/f5a [0,4194304] 0 2024-04-06T12:23:04.188 INFO:tasks.workunit.client.1.smithi195.stdout:4/246: creat d4/d6/d38/f4c x:0 0 0 2024-04-06T12:23:04.190 INFO:tasks.workunit.client.1.smithi195.stdout:7/220: symlink d4/d16/d11/l41 0 2024-04-06T12:23:04.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.195+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2e80f6940 con 0x7fc2d8066dc0 2024-04-06T12:23:04.195 INFO:tasks.workunit.client.1.smithi195.stdout:8/224: getdents d6/db/d23/d24/d25 0 2024-04-06T12:23:04.198 INFO:tasks.workunit.client.1.smithi195.stdout:6/281: mkdir d8/d21/d31/d6c 0 2024-04-06T12:23:04.199 INFO:tasks.workunit.client.1.smithi195.stdout:8/225: read d6/db/d23/d24/d25/f2a [109916,95622] 0 2024-04-06T12:23:04.199 INFO:tasks.workunit.client.1.smithi195.stdout:1/291: dwrite d4/f11 [4194304,4194304] 0 2024-04-06T12:23:04.200 INFO:tasks.workunit.client.1.smithi195.stdout:9/275: sync 2024-04-06T12:23:04.202 INFO:tasks.workunit.client.1.smithi195.stdout:8/226: write d6/f31 [453486,123313] 0 2024-04-06T12:23:04.202 INFO:tasks.workunit.client.1.smithi195.stdout:6/282: mknod d8/d21/c6d 0 2024-04-06T12:23:04.203 INFO:tasks.workunit.client.1.smithi195.stdout:1/292: dread - d4/d14/d17/d24/f4a zero size 2024-04-06T12:23:04.204 INFO:tasks.workunit.client.1.smithi195.stdout:9/276: creat d3/d10/d4f/f5f x:0 0 0 2024-04-06T12:23:04.204 INFO:tasks.workunit.client.1.smithi195.stdout:6/283: read f2 [2930141,18553] 0 2024-04-06T12:23:04.204 INFO:tasks.workunit.client.1.smithi195.stdout:3/285: dread d4/f7 [0,4194304] 0 2024-04-06T12:23:04.207 INFO:tasks.workunit.client.1.smithi195.stdout:8/227: symlink d6/db/d23/d24/d25/l4a 0 2024-04-06T12:23:04.209 INFO:tasks.workunit.client.1.smithi195.stdout:4/247: write d4/d6/d38/f2c [1291346,95376] 0 2024-04-06T12:23:04.209 INFO:tasks.workunit.client.1.smithi195.stdout:1/293: truncate d4/d14/d17/d24/d2a/f54 551933 0 2024-04-06T12:23:04.209 INFO:tasks.workunit.client.1.smithi195.stdout:3/286: symlink d4/d9/d52/l58 0 2024-04-06T12:23:04.210 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:23:04.210 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 starting - - - - 2024-04-06T12:23:04.210 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (8m) 39s ago 8m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:23:04.210 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (7m) 32s ago 7m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:23:04.210 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (6m) 39s ago 7m 57.2M - 8.3.5 dad864ee21e9 68f8b2b6d071 2024-04-06T12:23:04.210 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (2m) 39s ago 2m 79.0M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:23:04.210 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (3m) 39s ago 2m 111M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:23:04.210 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (2m) 32s ago 2m 12.0M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (2m) 32s ago 2m 12.8M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:9283 running (9m) 39s ago 9m 317M - 16.2.15-1-g8963e9de 727f386679cb 10652d2c4bd5 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283 running (56s) 32s ago 7m 476M - 18.2.2-1086-g052adcad 87261d5ece5a 5089ad242cab 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (9m) 39s ago 9m 47.7M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (7m) 32s ago 7m 39.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (7m) 39s ago 7m 25.9M - 1.3.1 1dbe0e931976 7122c2020056 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 32s ago 7m 23.6M - 1.3.1 1dbe0e931976 9dbc0ed205d9 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (6m) 39s ago 6m 63.4M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (6m) 39s ago 6m 62.1M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (5m) 39s ago 5m 53.4M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (5m) 32s ago 5m 64.5M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (4m) 32s ago 4m 57.7M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:23:04.211 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (4m) 32s ago 4m 58.3M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:23:04.212 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (7m) 32s ago 7m 60.4M - 2.33.4 514e6a882f6e d9a8fc6b6cf9 2024-04-06T12:23:04.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.212+0000 7fc2e5ffb700 1 -- 172.21.15.152:0/673998647 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc2e80f6940 con 0x7fc2d8066dc0 2024-04-06T12:23:04.212 INFO:tasks.workunit.client.1.smithi195.stdout:9/277: rename d3/d10/d4f/f5f to d3/d10/d3a/f60 0 2024-04-06T12:23:04.212 INFO:tasks.workunit.client.1.smithi195.stdout:1/294: stat d4/d14/d17/d3a 0 2024-04-06T12:23:04.213 INFO:tasks.workunit.client.1.smithi195.stdout:4/248: write d4/f16 [2076962,100521] 0 2024-04-06T12:23:04.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fc2d8066dc0 msgr2=0x7fc2d8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:04.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fc2d8066dc0 0x7fc2d8069280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc2d4004700 tx=0x7fc2d4016040).stop 2024-04-06T12:23:04.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8061220 msgr2=0x7fc2e8104110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:04.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8061220 0x7fc2e8104110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fc2dc00e8f0 tx=0x7fc2dc00b040).stop 2024-04-06T12:23:04.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 shutdown_connections 2024-04-06T12:23:04.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fc2d8066dc0 0x7fc2d8069280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8061220 0x7fc2e8104110 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 --2- 172.21.15.152:0/673998647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2e80fa9b0 0x7fc2e8104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 >> 172.21.15.152:0/673998647 conn(0x7fc2e80f1e50 msgr2=0x7fc2e80f6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:04.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 shutdown_connections 2024-04-06T12:23:04.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.215+0000 7fc2eeea0700 1 -- 172.21.15.152:0/673998647 wait complete. 2024-04-06T12:23:04.215 INFO:tasks.workunit.client.1.smithi195.stdout:3/287: symlink d4/d53/l59 0 2024-04-06T12:23:04.215 INFO:tasks.workunit.client.1.smithi195.stdout:8/228: mkdir d6/db/d47/d4b 0 2024-04-06T12:23:04.219 INFO:tasks.workunit.client.1.smithi195.stdout:7/221: dwrite d4/f7 [0,4194304] 0 2024-04-06T12:23:04.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/284: dread d8/d21/d31/fe [0,4194304] 0 2024-04-06T12:23:04.222 INFO:tasks.workunit.client.1.smithi195.stdout:9/278: link d3/d10/d3a/f45 d3/d10/f61 0 2024-04-06T12:23:04.223 INFO:tasks.workunit.client.1.smithi195.stdout:3/288: creat d4/df/d39/f5a x:0 0 0 2024-04-06T12:23:04.224 INFO:tasks.workunit.client.1.smithi195.stdout:8/229: mknod d6/db/d23/d24/c4c 0 2024-04-06T12:23:04.225 INFO:tasks.workunit.client.1.smithi195.stdout:9/279: write d3/de/f14 [2480397,129812] 0 2024-04-06T12:23:04.228 INFO:tasks.workunit.client.1.smithi195.stdout:6/285: write d8/d21/d31/fe [2170351,50935] 0 2024-04-06T12:23:04.233 INFO:tasks.workunit.client.1.smithi195.stdout:3/289: creat d4/d9/f5b x:0 0 0 2024-04-06T12:23:04.236 INFO:tasks.workunit.client.1.smithi195.stdout:6/286: creat d8/d21/d2b/d46/d4a/d4e/f6e x:0 0 0 2024-04-06T12:23:04.237 INFO:tasks.workunit.client.1.smithi195.stdout:9/280: link d3/d10/d3b/d48/c4e d3/d10/d3a/c62 0 2024-04-06T12:23:04.238 INFO:tasks.workunit.client.1.smithi195.stdout:1/295: dread d4/d14/d19/f1b [0,4194304] 0 2024-04-06T12:23:04.239 INFO:tasks.workunit.client.1.smithi195.stdout:8/230: rmdir d6/db 39 2024-04-06T12:23:04.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/290: dread d4/f7 [0,4194304] 0 2024-04-06T12:23:04.240 INFO:tasks.workunit.client.1.smithi195.stdout:7/222: dread d4/d10/d12/f14 [0,4194304] 0 2024-04-06T12:23:04.242 INFO:tasks.workunit.client.1.smithi195.stdout:4/249: truncate d4/d6/d38/d1a/d40/f41 221014 0 2024-04-06T12:23:04.242 INFO:tasks.workunit.client.1.smithi195.stdout:1/296: stat d4/d14/c3e 0 2024-04-06T12:23:04.244 INFO:tasks.workunit.client.1.smithi195.stdout:6/287: symlink d8/d3d/d5e/l6f 0 2024-04-06T12:23:04.245 INFO:tasks.workunit.client.1.smithi195.stdout:3/291: read f3 [781543,35746] 0 2024-04-06T12:23:04.246 INFO:tasks.workunit.client.1.smithi195.stdout:9/281: creat d3/d10/d3a/d5d/f63 x:0 0 0 2024-04-06T12:23:04.248 INFO:tasks.workunit.client.1.smithi195.stdout:7/223: creat d4/d10/d12/d37/f42 x:0 0 0 2024-04-06T12:23:04.250 INFO:tasks.workunit.client.1.smithi195.stdout:3/292: dwrite d4/d9/f18 [0,4194304] 0 2024-04-06T12:23:04.251 INFO:tasks.workunit.client.1.smithi195.stdout:4/250: unlink d4/d3e/f49 0 2024-04-06T12:23:04.255 INFO:tasks.workunit.client.1.smithi195.stdout:4/251: chown d4/d6/d38/d1a/d40/fe 0 1 2024-04-06T12:23:04.255 INFO:tasks.workunit.client.1.smithi195.stdout:6/288: unlink d8/d21/f30 0 2024-04-06T12:23:04.255 INFO:tasks.workunit.client.1.smithi195.stdout:9/282: fsync d3/f23 0 2024-04-06T12:23:04.255 INFO:tasks.workunit.client.1.smithi195.stdout:8/231: link d6/d8/f26 d6/d3a/f4d 0 2024-04-06T12:23:04.256 INFO:tasks.workunit.client.1.smithi195.stdout:8/232: write d6/f31 [1387574,37984] 0 2024-04-06T12:23:04.258 INFO:tasks.workunit.client.1.smithi195.stdout:3/293: mknod d4/d9/d52/c5c 0 2024-04-06T12:23:04.258 INFO:tasks.workunit.client.1.smithi195.stdout:4/252: symlink d4/d6/d38/d1a/d40/l4d 0 2024-04-06T12:23:04.261 INFO:tasks.workunit.client.1.smithi195.stdout:3/294: dread - d4/d9/d2b/d3b/d40/f56 zero size 2024-04-06T12:23:04.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/295: write d4/d9/d2b/d3b/f4c [195182,122328] 0 2024-04-06T12:23:04.263 INFO:tasks.workunit.client.1.smithi195.stdout:8/233: readlink d6/d8/l48 0 2024-04-06T12:23:04.263 INFO:tasks.workunit.client.1.smithi195.stdout:7/224: dread d4/d16/fe [0,4194304] 0 2024-04-06T12:23:04.264 INFO:tasks.workunit.client.1.smithi195.stdout:6/289: mkdir d8/d21/d31/d70 0 2024-04-06T12:23:04.265 INFO:tasks.workunit.client.1.smithi195.stdout:3/296: truncate d4/f4e 648720 0 2024-04-06T12:23:04.269 INFO:tasks.workunit.client.1.smithi195.stdout:9/283: creat d3/f64 x:0 0 0 2024-04-06T12:23:04.270 INFO:tasks.workunit.client.1.smithi195.stdout:9/284: dread - d3/d10/d3b/d48/f4a zero size 2024-04-06T12:23:04.273 INFO:tasks.workunit.client.1.smithi195.stdout:8/234: creat d6/db/d23/d24/f4e x:0 0 0 2024-04-06T12:23:04.274 INFO:tasks.workunit.client.1.smithi195.stdout:6/290: mknod d8/d21/d31/d6c/c71 0 2024-04-06T12:23:04.274 INFO:tasks.workunit.client.1.smithi195.stdout:8/235: write d6/d8/d12/f2f [667058,36543] 0 2024-04-06T12:23:04.276 INFO:tasks.workunit.client.1.smithi195.stdout:4/253: link d4/d6/d38/f44 d4/f4e 0 2024-04-06T12:23:04.279 INFO:tasks.workunit.client.1.smithi195.stdout:8/236: mknod d6/db/d23/d24/c4f 0 2024-04-06T12:23:04.283 INFO:tasks.workunit.client.1.smithi195.stdout:9/285: link d3/f2a d3/d10/d3a/d5d/f65 0 2024-04-06T12:23:04.284 INFO:tasks.workunit.client.1.smithi195.stdout:7/225: dwrite d4/d10/f3c [0,4194304] 0 2024-04-06T12:23:04.284 INFO:tasks.workunit.client.1.smithi195.stdout:4/254: mknod d4/d6/d38/c4f 0 2024-04-06T12:23:04.285 INFO:tasks.workunit.client.1.smithi195.stdout:3/297: truncate d4/d9/fd 2097259 0 2024-04-06T12:23:04.285 INFO:tasks.workunit.client.1.smithi195.stdout:8/237: rmdir d6/db/d23/d24/d25/d49 39 2024-04-06T12:23:04.286 INFO:tasks.workunit.client.1.smithi195.stdout:7/226: write d4/d24/f1a [1445631,122363] 0 2024-04-06T12:23:04.288 INFO:tasks.workunit.client.1.smithi195.stdout:9/286: rmdir d3/de 39 2024-04-06T12:23:04.289 INFO:tasks.workunit.client.1.smithi195.stdout:6/291: getdents d8/d21/d31 0 2024-04-06T12:23:04.290 INFO:tasks.workunit.client.1.smithi195.stdout:8/238: creat d6/d3a/d46/f50 x:0 0 0 2024-04-06T12:23:04.293 INFO:tasks.workunit.client.1.smithi195.stdout:4/255: rename d4/d6/d38/f4c to d4/d6/d38/d1a/f50 0 2024-04-06T12:23:04.293 INFO:tasks.workunit.client.1.smithi195.stdout:3/298: dread d4/d9/f2a [0,4194304] 0 2024-04-06T12:23:04.294 INFO:tasks.workunit.client.1.smithi195.stdout:3/299: chown d4/l15 54 1 2024-04-06T12:23:04.295 INFO:tasks.workunit.client.1.smithi195.stdout:7/227: dread d4/d16/f1c [0,4194304] 0 2024-04-06T12:23:04.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/239: stat d6/db/l18 0 2024-04-06T12:23:04.297 INFO:tasks.workunit.client.1.smithi195.stdout:9/287: mknod d3/c66 0 2024-04-06T12:23:04.297 INFO:tasks.workunit.client.1.smithi195.stdout:8/240: write d6/f31 [975743,125557] 0 2024-04-06T12:23:04.303 INFO:tasks.workunit.client.1.smithi195.stdout:3/300: rename d4/df/f20 to d4/df/d39/f5d 0 2024-04-06T12:23:04.305 INFO:tasks.workunit.client.1.smithi195.stdout:9/288: creat d3/d10/d3a/d5d/f67 x:0 0 0 2024-04-06T12:23:04.307 INFO:tasks.workunit.client.1.smithi195.stdout:8/241: write d6/db/d23/d24/d25/d49/f3d [1000345,30093] 0 2024-04-06T12:23:04.310 INFO:tasks.workunit.client.1.smithi195.stdout:7/228: rename d4/d16/dd/f17 to d4/d10/d18/d19/f43 0 2024-04-06T12:23:04.310 INFO:tasks.workunit.client.1.smithi195.stdout:6/292: write d8/d21/d31/f11 [1806107,114312] 0 2024-04-06T12:23:04.311 INFO:tasks.workunit.client.1.smithi195.stdout:6/293: dread - d8/d21/d2b/d46/f4c zero size 2024-04-06T12:23:04.312 INFO:tasks.workunit.client.1.smithi195.stdout:9/289: unlink d3/d10/d3a/d5d/f67 0 2024-04-06T12:23:04.313 INFO:tasks.workunit.client.1.smithi195.stdout:9/290: chown d3/d10/d4f 5 1 2024-04-06T12:23:04.314 INFO:tasks.workunit.client.1.smithi195.stdout:8/242: creat d6/db/d47/f51 x:0 0 0 2024-04-06T12:23:04.315 INFO:tasks.workunit.client.1.smithi195.stdout:3/301: mkdir d4/d9/d2b/d3b/d5e 0 2024-04-06T12:23:04.315 INFO:tasks.workunit.client.1.smithi195.stdout:8/243: stat d6/db/l22 0 2024-04-06T12:23:04.316 INFO:tasks.workunit.client.1.smithi195.stdout:6/294: mkdir d8/d3d/d5e/d72 0 2024-04-06T12:23:04.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/302: dread - d4/d9/d2b/f36 zero size 2024-04-06T12:23:04.319 INFO:tasks.workunit.client.1.smithi195.stdout:7/229: mknod d4/d10/d12/c44 0 2024-04-06T12:23:04.321 INFO:tasks.workunit.client.1.smithi195.stdout:6/295: write d8/d3d/f68 [648097,115759] 0 2024-04-06T12:23:04.322 INFO:tasks.workunit.client.1.smithi195.stdout:4/256: dwrite d4/d6/d38/f44 [0,4194304] 0 2024-04-06T12:23:04.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/303: fsync d4/d9/d2b/d3b/d40/f4a 0 2024-04-06T12:23:04.326 INFO:tasks.workunit.client.1.smithi195.stdout:7/230: symlink d4/d10/d18/l45 0 2024-04-06T12:23:04.327 INFO:tasks.workunit.client.1.smithi195.stdout:6/296: mknod d8/d21/d31/c73 0 2024-04-06T12:23:04.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/291: dwrite d3/d10/d3b/f47 [0,4194304] 0 2024-04-06T12:23:04.328 INFO:tasks.workunit.client.1.smithi195.stdout:8/244: dread d6/f16 [0,4194304] 0 2024-04-06T12:23:04.330 INFO:tasks.workunit.client.1.smithi195.stdout:3/304: mknod d4/d9/c5f 0 2024-04-06T12:23:04.332 INFO:tasks.workunit.client.1.smithi195.stdout:3/305: dread - d4/df/d39/f47 zero size 2024-04-06T12:23:04.333 INFO:tasks.workunit.client.1.smithi195.stdout:6/297: symlink d8/d3d/d3f/l74 0 2024-04-06T12:23:04.333 INFO:tasks.workunit.client.1.smithi195.stdout:3/306: chown d4/d9/d2b/f38 225915686 1 2024-04-06T12:23:04.334 INFO:tasks.workunit.client.1.smithi195.stdout:8/245: mkdir d6/d8/d52 0 2024-04-06T12:23:04.334 INFO:tasks.workunit.client.1.smithi195.stdout:6/298: dread - d8/d21/d2b/d46/f65 zero size 2024-04-06T12:23:04.335 INFO:tasks.workunit.client.1.smithi195.stdout:4/257: link d4/f12 d4/d6/d38/f51 0 2024-04-06T12:23:04.336 INFO:tasks.workunit.client.1.smithi195.stdout:7/231: getdents d4/d16/dd/d22/d3f 0 2024-04-06T12:23:04.337 INFO:tasks.workunit.client.1.smithi195.stdout:3/307: rmdir d4/d53 39 2024-04-06T12:23:04.338 INFO:tasks.workunit.client.1.smithi195.stdout:8/246: mkdir d6/db/d23/d24/d53 0 2024-04-06T12:23:04.338 INFO:tasks.workunit.client.1.smithi195.stdout:4/258: dread - d4/d6/f46 zero size 2024-04-06T12:23:04.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.341+0000 7fde2c851700 1 -- 172.21.15.152:0/1137714480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 msgr2=0x7fde280fa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:04.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.341+0000 7fde2c851700 1 --2- 172.21.15.152:0/1137714480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 0x7fde280fa3e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fde180047f0 tx=0x7fde18009cb0).stop 2024-04-06T12:23:04.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.341+0000 7fde2c851700 1 -- 172.21.15.152:0/1137714480 shutdown_connections 2024-04-06T12:23:04.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.341+0000 7fde2c851700 1 --2- 172.21.15.152:0/1137714480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde280fa960 0x7fde280fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.341+0000 7fde2c851700 1 --2- 172.21.15.152:0/1137714480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 0x7fde280fa3e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.341+0000 7fde2c851700 1 -- 172.21.15.152:0/1137714480 >> 172.21.15.152:0/1137714480 conn(0x7fde280f1e60 msgr2=0x7fde280f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:04.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.341+0000 7fde2c851700 1 -- 172.21.15.152:0/1137714480 shutdown_connections 2024-04-06T12:23:04.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.341+0000 7fde2c851700 1 -- 172.21.15.152:0/1137714480 wait complete. 2024-04-06T12:23:04.341 INFO:tasks.workunit.client.1.smithi195.stdout:3/308: write d4/d9/f5b [403419,19148] 0 2024-04-06T12:23:04.341 INFO:tasks.workunit.client.1.smithi195.stdout:7/232: chown d4/d10/d18/d33 117521782 1 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.342+0000 7fde2c851700 1 Processor -- start 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.342+0000 7fde2c851700 1 -- start start 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.342+0000 7fde2c851700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 0x7fde28107ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.342+0000 7fde2c851700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde280fa960 0x7fde281083d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.342+0000 7fde2c851700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde28108980 con 0x7fde28061280 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.342+0000 7fde2c851700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde28108ac0 con 0x7fde280fa960 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde2659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 0x7fde28107ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde2659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 0x7fde28107ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52284/0 (socket says 172.21.15.152:52284) 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde2659c700 1 -- 172.21.15.152:0/3538795745 learned_addr learned my addr 172.21.15.152:0/3538795745 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:04.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde25d9b700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde280fa960 0x7fde281083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:04.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde2659c700 1 -- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde280fa960 msgr2=0x7fde281083d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:04.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde2659c700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde280fa960 0x7fde281083d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde2659c700 1 -- 172.21.15.152:0/3538795745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18005040 con 0x7fde28061280 2024-04-06T12:23:04.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde2659c700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 0x7fde28107ee0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fde18013620 tx=0x7fde18009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:04.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde177fe700 1 -- 172.21.15.152:0/3538795745 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde1800e030 con 0x7fde28061280 2024-04-06T12:23:04.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2810d500 con 0x7fde28061280 2024-04-06T12:23:04.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde177fe700 1 -- 172.21.15.152:0/3538795745 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde18007e90 con 0x7fde28061280 2024-04-06T12:23:04.344 INFO:tasks.workunit.client.1.smithi195.stdout:6/299: truncate d8/d21/d2b/d46/d4a/f59 535597 0 2024-04-06T12:23:04.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.343+0000 7fde177fe700 1 -- 172.21.15.152:0/3538795745 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde18018070 con 0x7fde28061280 2024-04-06T12:23:04.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.344+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2810dac0 con 0x7fde28061280 2024-04-06T12:23:04.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.345+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde280ffff0 con 0x7fde28061280 2024-04-06T12:23:04.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.346+0000 7fde177fe700 1 -- 172.21.15.152:0/3538795745 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fde1801d420 con 0x7fde28061280 2024-04-06T12:23:04.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.346+0000 7fde177fe700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fde10066e60 0x7fde10069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:04.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.347+0000 7fde177fe700 1 -- 172.21.15.152:0/3538795745 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fde180858a0 con 0x7fde28061280 2024-04-06T12:23:04.345 INFO:tasks.workunit.client.1.smithi195.stdout:3/309: write d4/d9/f2a [1737499,81800] 0 2024-04-06T12:23:04.345 INFO:tasks.workunit.client.1.smithi195.stdout:7/233: mknod d4/d10/c46 0 2024-04-06T12:23:04.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.347+0000 7fde25d9b700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fde10066e60 0x7fde10069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:04.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.348+0000 7fde25d9b700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fde10066e60 0x7fde10069320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fde28061050 tx=0x7fde1c00b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:04.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.353+0000 7fde177fe700 1 -- 172.21.15.152:0/3538795745 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fde18053900 con 0x7fde28061280 2024-04-06T12:23:04.354 INFO:tasks.workunit.client.1.smithi195.stdout:4/259: dwrite d4/d6/d38/d1a/d40/d20/d23/f3a [0,4194304] 0 2024-04-06T12:23:04.358 INFO:tasks.workunit.client.1.smithi195.stdout:3/310: dwrite d4/f2f [4194304,4194304] 0 2024-04-06T12:23:04.361 INFO:tasks.workunit.client.1.smithi195.stdout:3/311: write d4/d9/f21 [3291806,48080] 0 2024-04-06T12:23:04.389 INFO:tasks.workunit.client.1.smithi195.stdout:8/247: creat d6/db/d23/d24/d25/f54 x:0 0 0 2024-04-06T12:23:04.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/260: stat d4/d6/d38/c48 0 2024-04-06T12:23:04.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/261: stat d4/d3e/c47 0 2024-04-06T12:23:04.397 INFO:tasks.workunit.client.1.smithi195.stdout:8/248: creat d6/d8/f55 x:0 0 0 2024-04-06T12:23:04.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/262: rmdir d4/d6/d38/d1a/d40 39 2024-04-06T12:23:04.399 INFO:tasks.workunit.client.1.smithi195.stdout:8/249: stat d6/db/d23/d24/d25 0 2024-04-06T12:23:04.401 INFO:tasks.workunit.client.1.smithi195.stdout:3/312: creat d4/d53/f60 x:0 0 0 2024-04-06T12:23:04.401 INFO:tasks.workunit.client.1.smithi195.stdout:7/234: link d4/d10/d12/f39 d4/d16/f47 0 2024-04-06T12:23:04.402 INFO:tasks.workunit.client.1.smithi195.stdout:6/300: write d8/d50/f6a [381627,35042] 0 2024-04-06T12:23:04.405 INFO:tasks.workunit.client.1.smithi195.stdout:9/292: dwrite d3/de/f21 [0,4194304] 0 2024-04-06T12:23:04.406 INFO:tasks.workunit.client.1.smithi195.stdout:7/235: chown d4/d16/l3a 107028227 1 2024-04-06T12:23:04.408 INFO:tasks.workunit.client.1.smithi195.stdout:9/293: write d3/d10/d4f/f57 [842879,27346] 0 2024-04-06T12:23:04.408 INFO:tasks.workunit.client.1.smithi195.stdout:7/236: write d4/d10/d12/d37/f42 [788678,111146] 0 2024-04-06T12:23:04.409 INFO:tasks.workunit.client.1.smithi195.stdout:9/294: readlink d3/d10/l40 0 2024-04-06T12:23:04.411 INFO:tasks.workunit.client.1.smithi195.stdout:2/239: sync 2024-04-06T12:23:04.421 INFO:tasks.workunit.client.1.smithi195.stdout:2/240: dread d2/f26 [4194304,4194304] 0 2024-04-06T12:23:04.421 INFO:tasks.workunit.client.1.smithi195.stdout:2/241: chown d2/d21/d2c 8974 1 2024-04-06T12:23:04.422 INFO:tasks.workunit.client.1.smithi195.stdout:2/242: fdatasync d2/f26 0 2024-04-06T12:23:04.434 INFO:tasks.workunit.client.1.smithi195.stdout:1/297: sync 2024-04-06T12:23:04.434 INFO:tasks.workunit.client.1.smithi195.stdout:0/279: sync 2024-04-06T12:23:04.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/254: sync 2024-04-06T12:23:04.438 INFO:tasks.workunit.client.1.smithi195.stdout:3/313: creat d4/d53/f61 x:0 0 0 2024-04-06T12:23:04.438 INFO:tasks.workunit.client.1.smithi195.stdout:6/301: symlink d8/d21/d2b/l75 0 2024-04-06T12:23:04.438 INFO:tasks.workunit.client.1.smithi195.stdout:1/298: write d4/fa [2270363,33758] 0 2024-04-06T12:23:04.439 INFO:tasks.workunit.client.1.smithi195.stdout:5/255: write d0/da/dd/d2e/f4c [141677,104158] 0 2024-04-06T12:23:04.441 INFO:tasks.workunit.client.1.smithi195.stdout:8/250: dread d6/d8/f10 [0,4194304] 0 2024-04-06T12:23:04.441 INFO:tasks.workunit.client.1.smithi195.stdout:3/314: chown d4/d9/d2b/d3b/d40/c44 305 1 2024-04-06T12:23:04.444 INFO:tasks.workunit.client.1.smithi195.stdout:6/302: dread d8/d50/d32/f3a [0,4194304] 0 2024-04-06T12:23:04.444 INFO:tasks.workunit.client.1.smithi195.stdout:9/295: creat d3/de/d37/f68 x:0 0 0 2024-04-06T12:23:04.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/303: dread d8/d21/d2b/d46/d4a/f59 [0,4194304] 0 2024-04-06T12:23:04.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/304: fsync d8/f14 0 2024-04-06T12:23:04.447 INFO:tasks.workunit.client.1.smithi195.stdout:6/305: chown d8/d21/f5a 24978 1 2024-04-06T12:23:04.447 INFO:tasks.workunit.client.1.smithi195.stdout:2/243: mkdir d2/d21/d29/d3a/d45 0 2024-04-06T12:23:04.452 INFO:tasks.workunit.client.1.smithi195.stdout:5/256: mkdir d0/da/dd/d1c/d5a/d62/d64 0 2024-04-06T12:23:04.452 INFO:tasks.workunit.client.1.smithi195.stdout:1/299: mkdir d4/d14/d19/d4e/d57 0 2024-04-06T12:23:04.454 INFO:tasks.workunit.client.1.smithi195.stdout:1/300: truncate d4/d14/d17/d24/f43 754080 0 2024-04-06T12:23:04.455 INFO:tasks.workunit.client.1.smithi195.stdout:8/251: fdatasync d6/d8/f10 0 2024-04-06T12:23:04.462 INFO:tasks.workunit.client.1.smithi195.stdout:6/306: creat d8/d3d/d3f/f76 x:0 0 0 2024-04-06T12:23:04.463 INFO:tasks.workunit.client.1.smithi195.stdout:2/244: fdatasync d2/f1c 0 2024-04-06T12:23:04.469 INFO:tasks.workunit.client.1.smithi195.stdout:1/301: rmdir d4/d14/d17/d24 39 2024-04-06T12:23:04.479 INFO:tasks.workunit.client.1.smithi195.stdout:6/307: creat d8/d3d/d5e/f77 x:0 0 0 2024-04-06T12:23:04.481 INFO:tasks.workunit.client.1.smithi195.stdout:1/302: chown d4/d14/d17/d24 75 1 2024-04-06T12:23:04.482 INFO:tasks.workunit.client.1.smithi195.stdout:3/315: rename d4/d9/d2b/d3b/d40/c44 to d4/d9/d2b/d3b/c62 0 2024-04-06T12:23:04.484 INFO:tasks.workunit.client.1.smithi195.stdout:1/303: dread d4/d14/d17/d24/d2a/f54 [0,4194304] 0 2024-04-06T12:23:04.486 INFO:tasks.workunit.client.1.smithi195.stdout:2/245: mknod d2/d21/d29/d3a/d45/c46 0 2024-04-06T12:23:04.487 INFO:tasks.workunit.client.1.smithi195.stdout:6/308: dwrite d8/f19 [0,4194304] 0 2024-04-06T12:23:04.488 INFO:tasks.workunit.client.1.smithi195.stdout:2/246: chown d2/c11 0 1 2024-04-06T12:23:04.488 INFO:tasks.workunit.client.1.smithi195.stdout:2/247: read d2/d21/f39 [1985248,16038] 0 2024-04-06T12:23:04.489 INFO:tasks.workunit.client.1.smithi195.stdout:5/257: getdents d0/da/d23/d38 0 2024-04-06T12:23:04.490 INFO:tasks.workunit.client.1.smithi195.stdout:2/248: write d2/d14/f22 [1148574,62101] 0 2024-04-06T12:23:04.491 INFO:tasks.workunit.client.1.smithi195.stdout:2/249: write d2/d21/f28 [139900,70820] 0 2024-04-06T12:23:04.494 INFO:tasks.workunit.client.1.smithi195.stdout:9/296: getdents d3/d10/d3b/d50 0 2024-04-06T12:23:04.496 INFO:tasks.workunit.client.1.smithi195.stdout:9/297: dread - d3/de/f51 zero size 2024-04-06T12:23:04.496 INFO:tasks.workunit.client.1.smithi195.stdout:9/298: dread - d3/f2a zero size 2024-04-06T12:23:04.497 INFO:tasks.workunit.client.1.smithi195.stdout:1/304: symlink d4/d14/d17/d24/l58 0 2024-04-06T12:23:04.503 INFO:tasks.workunit.client.1.smithi195.stdout:2/250: rmdir d2/d21/d29/d3a 39 2024-04-06T12:23:04.503 INFO:tasks.workunit.client.1.smithi195.stdout:9/299: dwrite d3/d10/d3a/f42 [0,4194304] 0 2024-04-06T12:23:04.505 INFO:tasks.workunit.client.1.smithi195.stdout:2/251: truncate d2/d21/f43 329588 0 2024-04-06T12:23:04.505 INFO:tasks.workunit.client.1.smithi195.stdout:8/252: link d6/dd/l11 d6/db/d23/d24/d25/l56 0 2024-04-06T12:23:04.506 INFO:tasks.workunit.client.1.smithi195.stdout:3/316: mknod d4/d9/d2b/d3b/c63 0 2024-04-06T12:23:04.507 INFO:tasks.workunit.client.1.smithi195.stdout:2/252: truncate d2/d21/f43 843978 0 2024-04-06T12:23:04.514 INFO:tasks.workunit.client.1.smithi195.stdout:5/258: symlink d0/da/dd/l65 0 2024-04-06T12:23:04.515 INFO:tasks.workunit.client.1.smithi195.stdout:5/259: write d0/da/dd/d1c/f20 [2867227,95460] 0 2024-04-06T12:23:04.516 INFO:tasks.workunit.client.1.smithi195.stdout:9/300: creat d3/d10/d3b/d48/f69 x:0 0 0 2024-04-06T12:23:04.517 INFO:tasks.workunit.client.1.smithi195.stdout:3/317: symlink d4/df/l64 0 2024-04-06T12:23:04.517 INFO:tasks.workunit.client.1.smithi195.stdout:4/263: write d4/f5 [2031811,107343] 0 2024-04-06T12:23:04.518 INFO:tasks.workunit.client.1.smithi195.stdout:2/253: fsync d2/d14/f31 0 2024-04-06T12:23:04.519 INFO:tasks.workunit.client.1.smithi195.stdout:4/264: write d4/d6/f7 [8519368,33575] 0 2024-04-06T12:23:04.519 INFO:tasks.workunit.client.1.smithi195.stdout:2/254: fdatasync d2/d21/d29/f3e 0 2024-04-06T12:23:04.520 INFO:tasks.workunit.client.1.smithi195.stdout:8/253: creat d6/db/d23/d24/d34/f57 x:0 0 0 2024-04-06T12:23:04.522 INFO:tasks.workunit.client.1.smithi195.stdout:8/254: readlink d6/db/lc 0 2024-04-06T12:23:04.522 INFO:tasks.workunit.client.1.smithi195.stdout:6/309: creat d8/d21/d31/d26/f78 x:0 0 0 2024-04-06T12:23:04.523 INFO:tasks.workunit.client.1.smithi195.stdout:8/255: write d6/db/d23/d24/f32 [4359532,34806] 0 2024-04-06T12:23:04.523 INFO:tasks.workunit.client.1.smithi195.stdout:5/260: mknod d0/da/dd/d2e/c66 0 2024-04-06T12:23:04.525 INFO:tasks.workunit.client.1.smithi195.stdout:9/301: creat d3/d10/d3a/f6a x:0 0 0 2024-04-06T12:23:04.532 INFO:tasks.workunit.client.1.smithi195.stdout:4/265: rename d4/d6/d38/f44 to d4/d3e/f52 0 2024-04-06T12:23:04.534 INFO:tasks.workunit.client.1.smithi195.stdout:8/256: write d6/f16 [4143035,93222] 0 2024-04-06T12:23:04.535 INFO:tasks.workunit.client.1.smithi195.stdout:5/261: write d0/d2c/d34/f4d [703792,6882] 0 2024-04-06T12:23:04.540 INFO:tasks.workunit.client.1.smithi195.stdout:6/310: creat d8/d3d/d5e/d72/f79 x:0 0 0 2024-04-06T12:23:04.540 INFO:tasks.workunit.client.1.smithi195.stdout:8/257: creat d6/d8/f58 x:0 0 0 2024-04-06T12:23:04.542 INFO:tasks.workunit.client.1.smithi195.stdout:2/255: creat d2/d21/f47 x:0 0 0 2024-04-06T12:23:04.542 INFO:tasks.workunit.client.1.smithi195.stdout:0/280: dwrite d4/d6/f8 [0,4194304] 0 2024-04-06T12:23:04.544 INFO:tasks.workunit.client.1.smithi195.stdout:5/262: mkdir d0/da/dd/d1c/d5a/d62/d64/d67 0 2024-04-06T12:23:04.545 INFO:tasks.workunit.client.1.smithi195.stdout:5/263: write d0/d2c/f57 [41199,28195] 0 2024-04-06T12:23:04.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/318: rename d4/de/c4b to d4/d9/d2b/d3b/c65 0 2024-04-06T12:23:04.551 INFO:tasks.workunit.client.1.smithi195.stdout:2/256: link d2/d21/f43 d2/d41/f48 0 2024-04-06T12:23:04.552 INFO:tasks.workunit.client.1.smithi195.stdout:2/257: stat d2/d21/f24 0 2024-04-06T12:23:04.555 INFO:tasks.workunit.client.1.smithi195.stdout:3/319: dwrite d4/d9/f29 [0,4194304] 0 2024-04-06T12:23:04.558 INFO:tasks.workunit.client.1.smithi195.stdout:8/258: getdents d6/dd 0 2024-04-06T12:23:04.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/281: getdents d4/d6/d1a 0 2024-04-06T12:23:04.561 INFO:tasks.workunit.client.1.smithi195.stdout:2/258: rename d2/d41/f48 to d2/d41/f49 0 2024-04-06T12:23:04.562 INFO:tasks.workunit.client.1.smithi195.stdout:9/302: rmdir d3 39 2024-04-06T12:23:04.562 INFO:tasks.workunit.client.1.smithi195.stdout:8/259: truncate d6/d8/d12/f2f 1647991 0 2024-04-06T12:23:04.564 INFO:tasks.workunit.client.1.smithi195.stdout:3/320: dwrite d4/df/f28 [0,4194304] 0 2024-04-06T12:23:04.565 INFO:tasks.workunit.client.1.smithi195.stdout:8/260: fdatasync d6/db/d23/d24/d34/f57 0 2024-04-06T12:23:04.565 INFO:tasks.workunit.client.1.smithi195.stdout:6/311: rename d8/fc to d8/d3d/f7a 0 2024-04-06T12:23:04.566 INFO:tasks.workunit.client.1.smithi195.stdout:8/261: dread - d6/d8/f55 zero size 2024-04-06T12:23:04.566 INFO:tasks.workunit.client.1.smithi195.stdout:4/266: rmdir d4 39 2024-04-06T12:23:04.567 INFO:tasks.workunit.client.1.smithi195.stdout:8/262: chown d6/dd/f38 25248914 1 2024-04-06T12:23:04.573 INFO:tasks.workunit.client.1.smithi195.stdout:3/321: mknod d4/d53/c66 0 2024-04-06T12:23:04.575 INFO:tasks.workunit.client.1.smithi195.stdout:0/282: mknod d4/d6/c60 0 2024-04-06T12:23:04.582 INFO:tasks.workunit.client.1.smithi195.stdout:6/312: mkdir d8/d21/d31/d6c/d7b 0 2024-04-06T12:23:04.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/313: write d8/d21/d2b/d46/d44/f56 [494587,61965] 0 2024-04-06T12:23:04.584 INFO:tasks.workunit.client.1.smithi195.stdout:0/283: creat d4/f61 x:0 0 0 2024-04-06T12:23:04.584 INFO:tasks.workunit.client.1.smithi195.stdout:8/263: symlink d6/db/d23/d24/d53/l59 0 2024-04-06T12:23:04.584 INFO:tasks.workunit.client.1.smithi195.stdout:8/264: fdatasync d6/dd/f38 0 2024-04-06T12:23:04.586 INFO:tasks.workunit.client.1.smithi195.stdout:2/259: creat d2/d21/d29/f4a x:0 0 0 2024-04-06T12:23:04.586 INFO:tasks.workunit.client.1.smithi195.stdout:0/284: write d4/f59 [725282,77063] 0 2024-04-06T12:23:04.586 INFO:tasks.workunit.client.1.smithi195.stdout:3/322: truncate d4/de/f46 916989 0 2024-04-06T12:23:04.587 INFO:tasks.workunit.client.1.smithi195.stdout:6/314: creat d8/d21/d31/d6c/f7c x:0 0 0 2024-04-06T12:23:04.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/323: write d4/d9/f18 [2262228,53149] 0 2024-04-06T12:23:04.590 INFO:tasks.workunit.client.1.smithi195.stdout:2/260: dread - d2/d21/d29/d3a/f3d zero size 2024-04-06T12:23:04.591 INFO:tasks.workunit.client.1.smithi195.stdout:1/305: write d4/d14/d19/f1d [1205653,81927] 0 2024-04-06T12:23:04.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/315: unlink d8/d3d/l47 0 2024-04-06T12:23:04.595 INFO:tasks.workunit.client.1.smithi195.stdout:7/237: mknod d4/c48 0 2024-04-06T12:23:04.596 INFO:tasks.workunit.client.1.smithi195.stdout:8/265: mknod d6/db/d23/d24/d25/c5a 0 2024-04-06T12:23:04.599 INFO:tasks.workunit.client.1.smithi195.stdout:3/324: unlink d4/d9/f2d 0 2024-04-06T12:23:04.602 INFO:tasks.workunit.client.1.smithi195.stdout:2/261: fsync d2/d21/d2c/f32 0 2024-04-06T12:23:04.604 INFO:tasks.workunit.client.1.smithi195.stdout:1/306: dread d4/d14/f18 [0,4194304] 0 2024-04-06T12:23:04.607 INFO:tasks.workunit.client.1.smithi195.stdout:6/316: creat d8/d21/d2b/d46/d44/f7d x:0 0 0 2024-04-06T12:23:04.609 INFO:tasks.workunit.client.1.smithi195.stdout:7/238: creat d4/d24/f49 x:0 0 0 2024-04-06T12:23:04.613 INFO:tasks.workunit.client.1.smithi195.stdout:8/266: symlink d6/db/d23/d24/d34/l5b 0 2024-04-06T12:23:04.614 INFO:tasks.workunit.client.1.smithi195.stdout:0/285: dread d4/d6/f20 [0,4194304] 0 2024-04-06T12:23:04.615 INFO:tasks.workunit.client.1.smithi195.stdout:0/286: fsync d4/d6/d1a/f54 0 2024-04-06T12:23:04.615 INFO:tasks.workunit.client.1.smithi195.stdout:3/325: creat d4/d9/d2b/d3b/d40/f67 x:0 0 0 2024-04-06T12:23:04.619 INFO:tasks.workunit.client.1.smithi195.stdout:0/287: dread d4/d6/f20 [0,4194304] 0 2024-04-06T12:23:04.620 INFO:tasks.workunit.client.1.smithi195.stdout:2/262: rmdir d2/d21/d2c 39 2024-04-06T12:23:04.621 INFO:tasks.workunit.client.1.smithi195.stdout:2/263: dread - d2/d21/d29/f2b zero size 2024-04-06T12:23:04.625 INFO:tasks.workunit.client.1.smithi195.stdout:3/326: dwrite d4/d9/d2b/d3b/f4c [0,4194304] 0 2024-04-06T12:23:04.625 INFO:tasks.workunit.client.1.smithi195.stdout:2/264: fsync d2/d14/f31 0 2024-04-06T12:23:04.627 INFO:tasks.workunit.client.1.smithi195.stdout:3/327: write d4/df/d39/f5a [768305,49518] 0 2024-04-06T12:23:04.627 INFO:tasks.workunit.client.1.smithi195.stdout:2/265: dread - d2/d21/d29/d3a/f3d zero size 2024-04-06T12:23:04.629 INFO:tasks.workunit.client.1.smithi195.stdout:0/288: dwrite d4/f21 [0,4194304] 0 2024-04-06T12:23:04.630 INFO:tasks.workunit.client.1.smithi195.stdout:3/328: chown d4/l5 30403 1 2024-04-06T12:23:04.631 INFO:tasks.workunit.client.1.smithi195.stdout:2/266: read d2/f1c [3092939,36569] 0 2024-04-06T12:23:04.633 INFO:tasks.workunit.client.1.smithi195.stdout:2/267: stat d2/d21/d29/d3a/d45 0 2024-04-06T12:23:04.633 INFO:tasks.workunit.client.1.smithi195.stdout:2/268: readlink d2/ld 0 2024-04-06T12:23:04.635 INFO:tasks.workunit.client.1.smithi195.stdout:8/267: rmdir d6/d8/d12 39 2024-04-06T12:23:04.635 INFO:tasks.workunit.client.1.smithi195.stdout:9/303: write d3/d10/f61 [577687,43167] 0 2024-04-06T12:23:04.636 INFO:tasks.workunit.client.1.smithi195.stdout:9/304: write d3/d10/d4f/f57 [675701,6956] 0 2024-04-06T12:23:04.638 INFO:tasks.workunit.client.1.smithi195.stdout:9/305: write d3/d10/d3b/d48/f69 [1023623,45515] 0 2024-04-06T12:23:04.641 INFO:tasks.workunit.client.1.smithi195.stdout:9/306: fdatasync d3/d10/d3b/d48/f4a 0 2024-04-06T12:23:04.645 INFO:tasks.workunit.client.1.smithi195.stdout:0/289: readlink d4/d6/d2f/d49/l57 0 2024-04-06T12:23:04.649 INFO:tasks.workunit.client.1.smithi195.stdout:3/329: fsync d4/df/d39/f5d 0 2024-04-06T12:23:04.650 INFO:tasks.workunit.client.1.smithi195.stdout:3/330: read d4/d9/d2b/d3b/f4c [2737556,52491] 0 2024-04-06T12:23:04.650 INFO:tasks.workunit.client.1.smithi195.stdout:3/331: chown d4/f7 50974913 1 2024-04-06T12:23:04.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/268: symlink d6/db/d47/l5c 0 2024-04-06T12:23:04.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/269: write d6/f16 [864551,128947] 0 2024-04-06T12:23:04.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/270: chown d6/d8/l21 57306026 1 2024-04-06T12:23:04.654 INFO:tasks.workunit.client.1.smithi195.stdout:8/271: write d6/dd/f14 [2291911,130669] 0 2024-04-06T12:23:04.656 INFO:tasks.workunit.client.1.smithi195.stdout:8/272: write d6/db/d23/d24/d25/d49/f3d [1484711,10505] 0 2024-04-06T12:23:04.656 INFO:tasks.workunit.client.1.smithi195.stdout:9/307: mkdir d3/d10/d3a/d6b 0 2024-04-06T12:23:04.657 INFO:tasks.workunit.client.1.smithi195.stdout:8/273: dread - d6/db/d23/d24/f4e zero size 2024-04-06T12:23:04.657 INFO:tasks.workunit.client.1.smithi195.stdout:8/274: readlink d6/db/l18 0 2024-04-06T12:23:04.659 INFO:tasks.workunit.client.1.smithi195.stdout:8/275: write d6/d3a/d46/f50 [489371,58041] 0 2024-04-06T12:23:04.659 INFO:tasks.workunit.client.1.smithi195.stdout:6/317: rmdir d8/d21/d61 0 2024-04-06T12:23:04.661 INFO:tasks.workunit.client.1.smithi195.stdout:0/290: rename d4/d6/f35 to d4/d41/f62 0 2024-04-06T12:23:04.665 INFO:tasks.workunit.client.1.smithi195.stdout:0/291: dread d4/d6/d1a/f40 [0,4194304] 0 2024-04-06T12:23:04.671 INFO:tasks.workunit.client.1.smithi195.stdout:9/308: mknod d3/de/c6c 0 2024-04-06T12:23:04.671 INFO:tasks.workunit.client.1.smithi195.stdout:1/307: dwrite f1 [4194304,4194304] 0 2024-04-06T12:23:04.672 INFO:tasks.workunit.client.1.smithi195.stdout:9/309: fdatasync d3/d10/d3a/f3e 0 2024-04-06T12:23:04.672 INFO:tasks.workunit.client.1.smithi195.stdout:6/318: rmdir d8/d50/d32 39 2024-04-06T12:23:04.676 INFO:tasks.workunit.client.1.smithi195.stdout:8/276: chown d6/db/d23/d24/d25/l56 24792 1 2024-04-06T12:23:04.680 INFO:tasks.workunit.client.1.smithi195.stdout:2/269: creat d2/d21/d29/f4b x:0 0 0 2024-04-06T12:23:04.681 INFO:tasks.workunit.client.1.smithi195.stdout:2/270: dread - d2/d21/d29/f4a zero size 2024-04-06T12:23:04.682 INFO:tasks.workunit.client.1.smithi195.stdout:7/239: truncate d4/d10/d18/d19/f43 3724229 0 2024-04-06T12:23:04.685 INFO:tasks.workunit.client.1.smithi195.stdout:0/292: creat d4/d6/d58/f63 x:0 0 0 2024-04-06T12:23:04.685 INFO:tasks.workunit.client.1.smithi195.stdout:0/293: chown d4/d6/d2f/f45 10 1 2024-04-06T12:23:04.686 INFO:tasks.workunit.client.1.smithi195.stdout:0/294: readlink d4/d6/d1a/l3b 0 2024-04-06T12:23:04.689 INFO:tasks.workunit.client.1.smithi195.stdout:1/308: rename d4/f12 to d4/f59 0 2024-04-06T12:23:04.692 INFO:tasks.workunit.client.1.smithi195.stdout:9/310: creat d3/d10/d3a/f6d x:0 0 0 2024-04-06T12:23:04.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/264: sync 2024-04-06T12:23:04.694 INFO:tasks.workunit.client.1.smithi195.stdout:4/267: sync 2024-04-06T12:23:04.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/265: dread - d0/f63 zero size 2024-04-06T12:23:04.700 INFO:tasks.workunit.client.1.smithi195.stdout:2/271: fsync d2/d21/d29/f34 0 2024-04-06T12:23:04.702 INFO:tasks.workunit.client.1.smithi195.stdout:3/332: creat d4/d9/f68 x:0 0 0 2024-04-06T12:23:04.703 INFO:tasks.workunit.client.1.smithi195.stdout:0/295: creat d4/f64 x:0 0 0 2024-04-06T12:23:04.706 INFO:tasks.workunit.client.1.smithi195.stdout:1/309: mkdir d4/d14/d17/d24/d2a/d5a 0 2024-04-06T12:23:04.707 INFO:tasks.workunit.client.1.smithi195.stdout:9/311: rmdir d3/d10/d3b/d50 39 2024-04-06T12:23:04.708 INFO:tasks.workunit.client.1.smithi195.stdout:3/333: dwrite d4/d9/d2b/f36 [0,4194304] 0 2024-04-06T12:23:04.709 INFO:tasks.workunit.client.1.smithi195.stdout:6/319: mknod d8/d21/c7e 0 2024-04-06T12:23:04.711 INFO:tasks.workunit.client.1.smithi195.stdout:1/310: dread d4/d14/d19/f1b [0,4194304] 0 2024-04-06T12:23:04.714 INFO:tasks.workunit.client.1.smithi195.stdout:5/266: mkdir d0/da/dd/d1c/d5a/d68 0 2024-04-06T12:23:04.719 INFO:tasks.workunit.client.1.smithi195.stdout:1/311: dwrite d4/d14/f34 [0,4194304] 0 2024-04-06T12:23:04.721 INFO:tasks.workunit.client.1.smithi195.stdout:7/240: mkdir d4/d4a 0 2024-04-06T12:23:04.729 INFO:tasks.workunit.client.1.smithi195.stdout:7/241: dwrite d4/d10/f3c [0,4194304] 0 2024-04-06T12:23:04.730 INFO:tasks.workunit.client.1.smithi195.stdout:6/320: fsync d8/d21/d31/fe 0 2024-04-06T12:23:04.731 INFO:tasks.workunit.client.1.smithi195.stdout:4/268: fsync d4/d6/d38/d1a/d40/d20/d23/f31 0 2024-04-06T12:23:04.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.734+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fde28101e60 con 0x7fde28061280 2024-04-06T12:23:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.735+0000 7fde177fe700 1 -- 172.21.15.152:0/3538795745 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fde180534f0 con 0x7fde28061280 2024-04-06T12:23:04.733 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:23:04.733 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:23:04.733 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:23:04.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:23:04.733 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:23:04.733 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-04-06T12:23:04.733 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:23:04.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:23:04.734 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:23:04.736 INFO:tasks.workunit.client.1.smithi195.stdout:8/277: link d6/d3a/c41 d6/db/c5d 0 2024-04-06T12:23:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.738+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fde10066e60 msgr2=0x7fde10069320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.738+0000 7fde2c851700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fde10066e60 0x7fde10069320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fde28061050 tx=0x7fde1c00b040).stop 2024-04-06T12:23:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.738+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 msgr2=0x7fde28107ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.738+0000 7fde2c851700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 0x7fde28107ee0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fde18013620 tx=0x7fde18009cb0).stop 2024-04-06T12:23:04.737 INFO:tasks.workunit.client.1.smithi195.stdout:5/267: dread d0/f3 [0,4194304] 0 2024-04-06T12:23:04.737 INFO:tasks.workunit.client.1.smithi195.stdout:2/272: rmdir d2/d21/d2c 39 2024-04-06T12:23:04.738 INFO:tasks.workunit.client.1.smithi195.stdout:5/268: stat d0/da/d13 0 2024-04-06T12:23:04.738 INFO:tasks.workunit.client.1.smithi195.stdout:2/273: fdatasync d2/f1a 0 2024-04-06T12:23:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.741+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 shutdown_connections 2024-04-06T12:23:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.741+0000 7fde2c851700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fde10066e60 0x7fde10069320 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.741+0000 7fde2c851700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde28061280 0x7fde28107ee0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.741+0000 7fde2c851700 1 --2- 172.21.15.152:0/3538795745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde280fa960 0x7fde281083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.741+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 >> 172.21.15.152:0/3538795745 conn(0x7fde280f1e60 msgr2=0x7fde280f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.741+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 shutdown_connections 2024-04-06T12:23:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.741+0000 7fde2c851700 1 -- 172.21.15.152:0/3538795745 wait complete. 2024-04-06T12:23:04.739 INFO:tasks.workunit.client.1.smithi195.stdout:5/269: fdatasync d0/da/d23/f45 0 2024-04-06T12:23:04.745 INFO:tasks.workunit.client.1.smithi195.stdout:6/321: mkdir d8/d21/d2b/d46/d7f 0 2024-04-06T12:23:04.747 INFO:tasks.workunit.client.1.smithi195.stdout:4/269: rmdir d4/d3e 39 2024-04-06T12:23:04.749 INFO:tasks.workunit.client.1.smithi195.stdout:2/274: mknod d2/d21/d29/d3a/c4c 0 2024-04-06T12:23:04.753 INFO:tasks.workunit.client.1.smithi195.stdout:3/334: creat d4/f69 x:0 0 0 2024-04-06T12:23:04.754 INFO:tasks.workunit.client.1.smithi195.stdout:9/312: link d3/de/lf d3/d10/d3a/d5d/l6e 0 2024-04-06T12:23:04.754 INFO:tasks.workunit.client.1.smithi195.stdout:9/313: chown d3/d10/d4f 80 1 2024-04-06T12:23:04.757 INFO:tasks.workunit.client.1.smithi195.stdout:6/322: mknod d8/d21/d2b/d46/d4a/c80 0 2024-04-06T12:23:04.759 INFO:tasks.workunit.client.1.smithi195.stdout:4/270: creat d4/d6/d38/d1a/d40/d20/f53 x:0 0 0 2024-04-06T12:23:04.760 INFO:tasks.workunit.client.1.smithi195.stdout:4/271: chown d4/d6/d38/f2c 803214257 1 2024-04-06T12:23:04.760 INFO:tasks.workunit.client.1.smithi195.stdout:4/272: readlink d4/d6/d38/l2b 0 2024-04-06T12:23:04.766 INFO:tasks.workunit.client.1.smithi195.stdout:2/275: mknod d2/d21/c4d 0 2024-04-06T12:23:04.767 INFO:tasks.workunit.client.1.smithi195.stdout:1/312: getdents d4/d14/d19/d23 0 2024-04-06T12:23:04.768 INFO:tasks.workunit.client.1.smithi195.stdout:4/273: dwrite d4/d6/f46 [0,4194304] 0 2024-04-06T12:23:04.769 INFO:tasks.workunit.client.1.smithi195.stdout:2/276: write d2/d3f/f42 [584476,5411] 0 2024-04-06T12:23:04.770 INFO:tasks.workunit.client.1.smithi195.stdout:5/270: rename d0/da/fc to d0/da/d4b/f69 0 2024-04-06T12:23:04.772 INFO:tasks.workunit.client.1.smithi195.stdout:7/242: link d4/d16/l3a d4/l4b 0 2024-04-06T12:23:04.775 INFO:tasks.workunit.client.1.smithi195.stdout:9/314: dread d3/d10/d3a/f3e [4194304,4194304] 0 2024-04-06T12:23:04.775 INFO:tasks.workunit.client.1.smithi195.stdout:7/243: read d4/d10/d12/d37/f3b [565717,27118] 0 2024-04-06T12:23:04.777 INFO:tasks.workunit.client.1.smithi195.stdout:7/244: truncate d4/d16/f3e 601918 0 2024-04-06T12:23:04.778 INFO:tasks.workunit.client.1.smithi195.stdout:9/315: write d3/de/f51 [780517,49450] 0 2024-04-06T12:23:04.778 INFO:tasks.workunit.client.1.smithi195.stdout:4/274: mknod d4/d6/d38/d1a/d40/d20/c54 0 2024-04-06T12:23:04.780 INFO:tasks.workunit.client.1.smithi195.stdout:1/313: rename d4/f59 to d4/d14/d17/d24/d2a/f5b 0 2024-04-06T12:23:04.782 INFO:tasks.workunit.client.1.smithi195.stdout:9/316: dread d3/d10/d3a/f42 [0,4194304] 0 2024-04-06T12:23:04.786 INFO:tasks.workunit.client.1.smithi195.stdout:4/275: mknod d4/d6/d38/d1a/d40/d20/c55 0 2024-04-06T12:23:04.786 INFO:tasks.workunit.client.1.smithi195.stdout:4/276: chown d4/d6/d38/d1a/d40/d20/c55 13019 1 2024-04-06T12:23:04.787 INFO:tasks.workunit.client.1.smithi195.stdout:1/314: unlink d4/f44 0 2024-04-06T12:23:04.789 INFO:tasks.workunit.client.1.smithi195.stdout:5/271: rename d0/da/d13/f56 to d0/da/d4b/f6a 0 2024-04-06T12:23:04.791 INFO:tasks.workunit.client.1.smithi195.stdout:6/323: link d8/d50/d32/f57 d8/d3d/f81 0 2024-04-06T12:23:04.793 INFO:tasks.workunit.client.1.smithi195.stdout:7/245: symlink d4/d16/dd/d22/d3f/l4c 0 2024-04-06T12:23:04.793 INFO:tasks.workunit.client.1.smithi195.stdout:7/246: chown d4/c8 7573 1 2024-04-06T12:23:04.793 INFO:tasks.workunit.client.1.smithi195.stdout:6/324: truncate d8/d21/d2b/d46/f65 153314 0 2024-04-06T12:23:04.797 INFO:tasks.workunit.client.1.smithi195.stdout:4/277: dread d4/d6/d38/f1d [0,4194304] 0 2024-04-06T12:23:04.797 INFO:tasks.workunit.client.1.smithi195.stdout:1/315: fsync d4/d14/d19/f1a 0 2024-04-06T12:23:04.798 INFO:tasks.workunit.client.1.smithi195.stdout:2/277: write d2/d21/f39 [3416948,93801] 0 2024-04-06T12:23:04.801 INFO:tasks.workunit.client.1.smithi195.stdout:4/278: readlink d4/d6/d38/l2b 0 2024-04-06T12:23:04.802 INFO:tasks.workunit.client.1.smithi195.stdout:6/325: mkdir d8/d50/d82 0 2024-04-06T12:23:04.803 INFO:tasks.workunit.client.1.smithi195.stdout:3/335: dwrite d4/d9/fa [0,4194304] 0 2024-04-06T12:23:04.833 INFO:tasks.workunit.client.1.smithi195.stdout:0/296: sync 2024-04-06T12:23:04.846 INFO:tasks.workunit.client.1.smithi195.stdout:2/278: creat d2/d14/f4e x:0 0 0 2024-04-06T12:23:04.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/316: symlink d4/d14/d19/d23/d28/d2f/l5c 0 2024-04-06T12:23:04.846 INFO:tasks.workunit.client.1.smithi195.stdout:6/326: chown d8/f2a 62 1 2024-04-06T12:23:04.847 INFO:tasks.workunit.client.1.smithi195.stdout:2/279: chown d2/d3f/f40 3673698 1 2024-04-06T12:23:04.849 INFO:tasks.workunit.client.1.smithi195.stdout:9/317: write d3/d10/d3b/d48/f4b [1963058,45581] 0 2024-04-06T12:23:04.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.849+0000 7f2ddd59a700 1 -- 172.21.15.152:0/3071557235 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dd0013a70 con 0x7f2de00f6930 2024-04-06T12:23:04.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.850+0000 7f2de4a65700 1 -- 172.21.15.152:0/3071557235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2de00f6930 msgr2=0x7f2de00f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:04.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.850+0000 7f2de4a65700 1 --2- 172.21.15.152:0/3071557235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2de00f6930 0x7f2de00f6d50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f2dd00047f0 tx=0x7f2dd0009cb0).stop 2024-04-06T12:23:04.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.850+0000 7f2de4a65700 1 -- 172.21.15.152:0/3071557235 shutdown_connections 2024-04-06T12:23:04.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.850+0000 7f2de4a65700 1 --2- 172.21.15.152:0/3071557235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de00f7bd0 0x7f2de00f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:23:04.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.850+0000 7f2de4a65700 1 --2- 172.21.15.152:0/3071557235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2de00f6930 0x7f2de00f6d50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:04.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.850+0000 7f2de4a65700 1 -- 172.21.15.152:0/3071557235 >> 172.21.15.152:0/3071557235 conn(0x7f2de00f2070 msgr2=0x7f2de00f44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:04.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.851+0000 7f2de4a65700 1 -- 172.21.15.152:0/3071557235 shutdown_connections 2024-04-06T12:23:04.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.851+0000 7f2de4a65700 1 -- 172.21.15.152:0/3071557235 wait complete. 2024-04-06T12:23:04.850 INFO:tasks.workunit.client.1.smithi195.stdout:0/297: mkdir d4/d65 0 2024-04-06T12:23:04.852 INFO:tasks.workunit.client.1.smithi195.stdout:1/317: mkdir d4/d14/d19/d23/d5d 0 2024-04-06T12:23:04.852 INFO:tasks.workunit.client.1.smithi195.stdout:5/272: dwrite d0/da/d23/d38/f60 [0,4194304] 0 2024-04-06T12:23:04.853 INFO:tasks.workunit.client.1.smithi195.stdout:9/318: fsync d3/d10/d4f/f5a 0 2024-04-06T12:23:04.854 INFO:tasks.workunit.client.1.smithi195.stdout:1/318: stat d4/d14/d19/d4e/d57 0 2024-04-06T12:23:04.855 INFO:tasks.workunit.client.1.smithi195.stdout:6/327: dread d8/d3d/f81 [0,4194304] 0 2024-04-06T12:23:04.855 INFO:tasks.workunit.client.1.smithi195.stdout:4/279: dread d4/f2e [0,4194304] 0 2024-04-06T12:23:04.857 INFO:tasks.workunit.client.1.smithi195.stdout:2/280: symlink d2/d21/l4f 0 2024-04-06T12:23:04.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.852+0000 7f2de4a65700 1 Processor -- start 2024-04-06T12:23:04.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.852+0000 7f2de4a65700 1 -- start start 2024-04-06T12:23:04.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.852+0000 7f2de4a65700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de00f6930 0x7f2de0108230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:04.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.852+0000 7f2de4a65700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2de00f7bd0 0x7f2de0108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:04.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.852+0000 7f2de4a65700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de0108d60 con 0x7f2de00f7bd0 2024-04-06T12:23:04.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.852+0000 7f2de4a65700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de0108ea0 con 0x7f2de00f6930 2024-04-06T12:23:04.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.852+0000 7f2dde59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de00f6930 0x7f2de0108230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:04.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.852+0000 7f2dde59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de00f6930 0x7f2de0108230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:43864/0 (socket says 172.21.15.152:43864) 2024-04-06T12:23:04.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.852+0000 7f2dde59c700 1 -- 172.21.15.152:0/2513069343 learned_addr learned my addr 172.21.15.152:0/2513069343 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:04.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.853+0000 7f2dde59c700 1 -- 172.21.15.152:0/2513069343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2de00f7bd0 msgr2=0x7f2de0108720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:04.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.853+0000 7f2dde59c700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2de00f7bd0 0x7f2de0108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:23:04.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.853+0000 7f2dde59c700 1 -- 172.21.15.152:0/2513069343 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0005040 con 0x7f2de00f6930 2024-04-06T12:23:04.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.853+0000 7f2dde59c700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de00f6930 0x7f2de0108230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2dd000b120 tx=0x7f2dd0009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:04.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.859+0000 7f2dcf7fe700 1 -- 172.21.15.152:0/2513069343 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dd000e030 con 0x7f2de00f6930 2024-04-06T12:23:04.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.859+0000 7f2dcf7fe700 1 -- 172.21.15.152:0/2513069343 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2dd0007e90 con 0x7f2de00f6930 2024-04-06T12:23:04.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.859+0000 7f2dcf7fe700 1 -- 172.21.15.152:0/2513069343 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dd0018070 con 0x7f2de00f6930 2024-04-06T12:23:04.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.859+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de00627c0 con 0x7f2de00f6930 2024-04-06T12:23:04.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.859+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de0062c40 con 0x7f2de00f6930 2024-04-06T12:23:04.860 INFO:tasks.workunit.client.1.smithi195.stdout:3/336: creat d4/d9/d2b/f6a x:0 0 0 2024-04-06T12:23:04.860 INFO:tasks.workunit.client.1.smithi195.stdout:5/273: creat d0/d35/f6b x:0 0 0 2024-04-06T12:23:04.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.860+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de005fb50 con 0x7f2de00f6930 2024-04-06T12:23:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.861+0000 7f2dcf7fe700 1 -- 172.21.15.152:0/2513069343 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f2dd001d9d0 con 0x7f2de00f6930 2024-04-06T12:23:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.862+0000 7f2dcf7fe700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2dc8066e10 0x7f2dc80692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.862+0000 7f2dcf7fe700 1 -- 172.21.15.152:0/2513069343 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f2dd00858d0 con 0x7f2de00f6930 2024-04-06T12:23:04.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.862+0000 7f2dddd9b700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2dc8066e10 0x7f2dc80692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:04.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.863+0000 7f2dddd9b700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2dc8066e10 0x7f2dc80692d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2dd4009700 tx=0x7f2dd4006c30).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:04.862 INFO:tasks.workunit.client.1.smithi195.stdout:0/298: creat d4/d65/f66 x:0 0 0 2024-04-06T12:23:04.862 INFO:tasks.workunit.client.1.smithi195.stdout:0/299: chown d4/d53 88671 1 2024-04-06T12:23:04.867 INFO:tasks.workunit.client.1.smithi195.stdout:0/300: dwrite d4/d6/d1a/f54 [0,4194304] 0 2024-04-06T12:23:04.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:04.866+0000 7f2dcf7fe700 1 -- 172.21.15.152:0/2513069343 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f2dd00539b0 con 0x7f2de00f6930 2024-04-06T12:23:04.869 INFO:tasks.workunit.client.1.smithi195.stdout:9/319: creat d3/d10/d3b/d48/f6f x:0 0 0 2024-04-06T12:23:04.870 INFO:tasks.workunit.client.1.smithi195.stdout:1/319: mknod d4/c5e 0 2024-04-06T12:23:04.873 INFO:tasks.workunit.client.1.smithi195.stdout:6/328: write d8/d3d/f81 [156295,88874] 0 2024-04-06T12:23:04.880 INFO:tasks.workunit.client.1.smithi195.stdout:2/281: rmdir d2/d21 39 2024-04-06T12:23:04.880 INFO:tasks.workunit.client.1.smithi195.stdout:6/329: fsync d8/d21/d31/d49/f51 0 2024-04-06T12:23:04.880 INFO:tasks.workunit.client.1.smithi195.stdout:1/320: dread d4/d14/d17/f30 [0,4194304] 0 2024-04-06T12:23:04.882 INFO:tasks.workunit.client.1.smithi195.stdout:6/330: truncate d8/d21/d2b/d46/d44/f7d 717403 0 2024-04-06T12:23:04.882 INFO:tasks.workunit.client.1.smithi195.stdout:6/331: chown d8/d21/d2b/d46/d44 13388339 1 2024-04-06T12:23:04.889 INFO:tasks.workunit.client.1.smithi195.stdout:3/337: creat d4/d9/d2b/d3b/f6b x:0 0 0 2024-04-06T12:23:04.889 INFO:tasks.workunit.client.1.smithi195.stdout:5/274: link d0/d28/f4f d0/da/dd/d2e/f6c 0 2024-04-06T12:23:04.890 INFO:tasks.workunit.client.1.smithi195.stdout:1/321: creat d4/d14/d19/f5f x:0 0 0 2024-04-06T12:23:04.890 INFO:tasks.workunit.client.1.smithi195.stdout:5/275: chown d0/d35/f6b 901771192 1 2024-04-06T12:23:04.891 INFO:tasks.workunit.client.1.smithi195.stdout:2/282: stat d2/d21/d2c 0 2024-04-06T12:23:04.891 INFO:tasks.workunit.client.1.smithi195.stdout:9/320: write d3/f2a [278761,121450] 0 2024-04-06T12:23:04.891 INFO:tasks.workunit.client.1.smithi195.stdout:6/332: write d8/f23 [1012250,78560] 0 2024-04-06T12:23:04.896 INFO:tasks.workunit.client.1.smithi195.stdout:2/283: rmdir d2/d21/d2c 39 2024-04-06T12:23:04.897 INFO:tasks.workunit.client.1.smithi195.stdout:0/301: dread d4/d6/d1a/f34 [0,4194304] 0 2024-04-06T12:23:04.897 INFO:tasks.workunit.client.1.smithi195.stdout:1/322: dread d4/d14/d19/f29 [0,4194304] 0 2024-04-06T12:23:04.898 INFO:tasks.workunit.client.1.smithi195.stdout:6/333: fsync d8/d21/d2b/d46/d4a/f59 0 2024-04-06T12:23:04.899 INFO:tasks.workunit.client.1.smithi195.stdout:4/280: dread d4/d6/f7 [4194304,4194304] 0 2024-04-06T12:23:04.900 INFO:tasks.workunit.client.1.smithi195.stdout:6/334: fsync d8/f10 0 2024-04-06T12:23:04.900 INFO:tasks.workunit.client.1.smithi195.stdout:0/302: truncate d4/d6/d2f/f38 892274 0 2024-04-06T12:23:04.901 INFO:tasks.workunit.client.1.smithi195.stdout:2/284: rename d2/d21/f47 to d2/d14/f50 0 2024-04-06T12:23:04.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/281: write d4/d6/d38/f28 [1186913,26540] 0 2024-04-06T12:23:04.902 INFO:tasks.workunit.client.1.smithi195.stdout:2/285: readlink d2/l44 0 2024-04-06T12:23:04.902 INFO:tasks.workunit.client.1.smithi195.stdout:0/303: write d4/f59 [105892,125793] 0 2024-04-06T12:23:04.903 INFO:tasks.workunit.client.1.smithi195.stdout:4/282: chown d4/f4e 27456 1 2024-04-06T12:23:04.903 INFO:tasks.workunit.client.1.smithi195.stdout:0/304: stat d4/d6/d2f 0 2024-04-06T12:23:04.906 INFO:tasks.workunit.client.1.smithi195.stdout:3/338: link d4/d9/fd d4/d9/d52/f6c 0 2024-04-06T12:23:04.906 INFO:tasks.workunit.client.1.smithi195.stdout:3/339: chown d4/d9/f2a 321 1 2024-04-06T12:23:04.907 INFO:tasks.workunit.client.1.smithi195.stdout:3/340: dread - d4/d9/f1e zero size 2024-04-06T12:23:04.907 INFO:tasks.workunit.client.1.smithi195.stdout:3/341: dread - d4/d9/f68 zero size 2024-04-06T12:23:04.908 INFO:tasks.workunit.client.1.smithi195.stdout:3/342: chown d4/d53/f60 1321 1 2024-04-06T12:23:04.909 INFO:tasks.workunit.client.1.smithi195.stdout:6/335: rename d8/d3d/f7a to d8/d21/d2b/d46/f83 0 2024-04-06T12:23:04.910 INFO:tasks.workunit.client.1.smithi195.stdout:6/336: chown d8/d21/d31/d26/f78 71 1 2024-04-06T12:23:04.911 INFO:tasks.workunit.client.1.smithi195.stdout:0/305: mkdir d4/d48/d67 0 2024-04-06T12:23:04.911 INFO:tasks.workunit.client.1.smithi195.stdout:9/321: link d3/d10/l28 d3/l70 0 2024-04-06T12:23:04.913 INFO:tasks.workunit.client.1.smithi195.stdout:9/322: dread - d3/d10/d3a/f6d zero size 2024-04-06T12:23:04.913 INFO:tasks.workunit.client.1.smithi195.stdout:5/276: getdents d0/da/dd/d1c/d5a/d62 0 2024-04-06T12:23:04.915 INFO:tasks.workunit.client.1.smithi195.stdout:5/277: chown d0/da/d13/c1a 1116319 1 2024-04-06T12:23:04.915 INFO:tasks.workunit.client.1.smithi195.stdout:4/283: dwrite d4/f12 [0,4194304] 0 2024-04-06T12:23:04.916 INFO:tasks.workunit.client.1.smithi195.stdout:5/278: dread d0/d28/f51 [0,4194304] 0 2024-04-06T12:23:04.917 INFO:tasks.workunit.client.1.smithi195.stdout:2/286: rename d2/d21/d29/d3a to d2/d41/d51 0 2024-04-06T12:23:04.918 INFO:tasks.workunit.client.1.smithi195.stdout:2/287: readlink d2/ld 0 2024-04-06T12:23:04.918 INFO:tasks.workunit.client.1.smithi195.stdout:5/279: stat d0/d35/f5f 0 2024-04-06T12:23:04.919 INFO:tasks.workunit.client.1.smithi195.stdout:2/288: readlink d2/l10 0 2024-04-06T12:23:04.920 INFO:tasks.workunit.client.1.smithi195.stdout:9/323: truncate d3/de/f14 5897148 0 2024-04-06T12:23:04.920 INFO:tasks.workunit.client.1.smithi195.stdout:2/289: write d2/d14/f1d [150642,116146] 0 2024-04-06T12:23:04.922 INFO:tasks.workunit.client.1.smithi195.stdout:3/343: rename d4/l15 to d4/d9/d52/l6d 0 2024-04-06T12:23:04.923 INFO:tasks.workunit.client.1.smithi195.stdout:4/284: symlink d4/d3e/l56 0 2024-04-06T12:23:04.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/285: chown d4/d6/d38/c48 857103718 1 2024-04-06T12:23:04.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/286: stat d4/d6/d38/f51 0 2024-04-06T12:23:04.930 INFO:tasks.workunit.client.1.smithi195.stdout:3/344: creat d4/df/d39/f6e x:0 0 0 2024-04-06T12:23:04.971 INFO:tasks.workunit.client.1.smithi195.stdout:8/278: sync 2024-04-06T12:23:04.982 INFO:tasks.workunit.client.1.smithi195.stdout:3/345: write d4/f4e [877306,1776] 0 2024-04-06T12:23:04.984 INFO:tasks.workunit.client.1.smithi195.stdout:9/324: symlink d3/l71 0 2024-04-06T12:23:04.984 INFO:tasks.workunit.client.1.smithi195.stdout:8/279: dread - d6/d8/f55 zero size 2024-04-06T12:23:04.984 INFO:tasks.workunit.client.1.smithi195.stdout:6/337: rename d8/d21/d31/f64 to d8/d3d/d5e/f84 0 2024-04-06T12:23:04.985 INFO:tasks.workunit.client.1.smithi195.stdout:9/325: stat d3/d10/c3f 0 2024-04-06T12:23:04.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/346: write d4/df/d39/f6e [976344,37604] 0 2024-04-06T12:23:04.988 INFO:tasks.workunit.client.1.smithi195.stdout:8/280: write d6/d3a/d46/f50 [771804,106114] 0 2024-04-06T12:23:04.988 INFO:tasks.workunit.client.1.smithi195.stdout:6/338: dread - d8/d21/d2b/d46/d4a/f55 zero size 2024-04-06T12:23:04.989 INFO:tasks.workunit.client.1.smithi195.stdout:8/281: chown d6/db/d47/l5c 17737457 1 2024-04-06T12:23:04.990 INFO:tasks.workunit.client.1.smithi195.stdout:2/290: rename d2/d21/f43 to d2/d41/d51/d45/f52 0 2024-04-06T12:23:04.992 INFO:tasks.workunit.client.1.smithi195.stdout:9/326: dread d3/f17 [0,4194304] 0 2024-04-06T12:23:04.993 INFO:tasks.workunit.client.1.smithi195.stdout:3/347: creat d4/df/f6f x:0 0 0 2024-04-06T12:23:04.994 INFO:tasks.workunit.client.1.smithi195.stdout:6/339: mknod d8/d21/d2b/d46/d2f/c85 0 2024-04-06T12:23:04.995 INFO:tasks.workunit.client.1.smithi195.stdout:4/287: truncate d4/d6/d38/f51 4922974 0 2024-04-06T12:23:04.998 INFO:tasks.workunit.client.1.smithi195.stdout:9/327: mknod d3/d10/d3b/d48/c72 0 2024-04-06T12:23:04.999 INFO:tasks.workunit.client.1.smithi195.stdout:3/348: unlink d4/de/f51 0 2024-04-06T12:23:05.000 INFO:tasks.workunit.client.1.smithi195.stdout:9/328: chown d3/d10/d3b/d48/f4b 127376419 1 2024-04-06T12:23:05.000 INFO:tasks.workunit.client.1.smithi195.stdout:6/340: mkdir d8/d21/d2b/d46/d44/d86 0 2024-04-06T12:23:05.001 INFO:tasks.workunit.client.1.smithi195.stdout:8/282: mkdir d6/db/d23/d24/d25/d5e 0 2024-04-06T12:23:05.002 INFO:tasks.workunit.client.1.smithi195.stdout:9/329: write d3/d10/d3a/f6d [850779,49258] 0 2024-04-06T12:23:05.003 INFO:tasks.workunit.client.1.smithi195.stdout:2/291: dwrite d2/d14/f50 [0,4194304] 0 2024-04-06T12:23:05.005 INFO:tasks.workunit.client.1.smithi195.stdout:3/349: mkdir d4/d9/d52/d70 0 2024-04-06T12:23:05.007 INFO:tasks.workunit.client.1.smithi195.stdout:8/283: chown d6/c13 0 1 2024-04-06T12:23:05.007 INFO:tasks.workunit.client.1.smithi195.stdout:6/341: dread d8/d3d/f68 [0,4194304] 0 2024-04-06T12:23:05.008 INFO:tasks.workunit.client.1.smithi195.stdout:2/292: stat d2/d21/l2f 0 2024-04-06T12:23:05.010 INFO:tasks.workunit.client.1.smithi195.stdout:9/330: symlink d3/d10/d4f/l73 0 2024-04-06T12:23:05.015 INFO:tasks.workunit.client.1.smithi195.stdout:8/284: dwrite d6/db/d47/f51 [0,4194304] 0 2024-04-06T12:23:05.017 INFO:tasks.workunit.client.1.smithi195.stdout:3/350: rename d4/df/d39/f5d to d4/d9/d2b/d3b/d40/f71 0 2024-04-06T12:23:05.020 INFO:tasks.workunit.client.1.smithi195.stdout:3/351: truncate d4/d9/d2b/d3b/d40/f71 75791 0 2024-04-06T12:23:05.021 INFO:tasks.workunit.client.1.smithi195.stdout:9/331: mknod d3/d10/d3a/c74 0 2024-04-06T12:23:05.021 INFO:tasks.workunit.client.1.smithi195.stdout:4/288: getdents d4/d6/d38 0 2024-04-06T12:23:05.024 INFO:tasks.workunit.client.1.smithi195.stdout:8/285: stat d6/db/c5d 0 2024-04-06T12:23:05.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:03.290992+0000 mgr.smithi195.ausetj (mgr.24375) 48 : audit [DBG] from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:05.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:03.572522+0000 mgr.smithi195.ausetj (mgr.24375) 49 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 279 op/s 2024-04-06T12:23:05.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:03.751999+0000 mgr.smithi195.ausetj (mgr.24375) 50 : audit [DBG] from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:05.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/286: truncate d6/dd/f38 766024 0 2024-04-06T12:23:05.027 INFO:tasks.workunit.client.1.smithi195.stdout:2/293: rename d2/d41/d51/d45 to d2/d14/d53 0 2024-04-06T12:23:05.028 INFO:tasks.workunit.client.1.smithi195.stdout:2/294: stat d2/d41/d51/f3d 0 2024-04-06T12:23:05.028 INFO:tasks.workunit.client.1.smithi195.stdout:6/342: mknod d8/d21/d31/d6c/d7b/c87 0 2024-04-06T12:23:05.028 INFO:tasks.workunit.client.1.smithi195.stdout:3/352: dwrite d4/d9/d2b/f38 [4194304,4194304] 0 2024-04-06T12:23:05.030 INFO:tasks.workunit.client.1.smithi195.stdout:6/343: dread - d8/d21/d31/d6c/f7c zero size 2024-04-06T12:23:05.032 INFO:tasks.workunit.client.1.smithi195.stdout:9/332: creat d3/de/d37/f75 x:0 0 0 2024-04-06T12:23:05.036 INFO:tasks.workunit.client.1.smithi195.stdout:9/333: write d3/d10/d4f/f5a [878336,114177] 0 2024-04-06T12:23:05.038 INFO:tasks.workunit.client.1.smithi195.stdout:8/287: dwrite d6/dd/f38 [0,4194304] 0 2024-04-06T12:23:05.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/295: rename d2/d14/f50 to d2/d41/d51/f54 0 2024-04-06T12:23:05.039 INFO:tasks.workunit.client.1.smithi195.stdout:4/289: dread d4/d6/d38/d1a/f2d [0,4194304] 0 2024-04-06T12:23:05.043 INFO:tasks.workunit.client.1.smithi195.stdout:6/344: dwrite d8/d21/d2b/f54 [0,4194304] 0 2024-04-06T12:23:05.046 INFO:tasks.workunit.client.1.smithi195.stdout:6/345: read d8/d21/d2b/d46/f83 [1082127,124716] 0 2024-04-06T12:23:05.046 INFO:tasks.workunit.client.1.smithi195.stdout:6/346: stat d8/d21/d2b/d46/f65 0 2024-04-06T12:23:05.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:03.290992+0000 mgr.smithi195.ausetj (mgr.24375) 48 : audit [DBG] from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:05.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:03.572522+0000 mgr.smithi195.ausetj (mgr.24375) 49 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 279 op/s 2024-04-06T12:23:05.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:03.751999+0000 mgr.smithi195.ausetj (mgr.24375) 50 : audit [DBG] from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:05.055 INFO:tasks.workunit.client.1.smithi195.stdout:3/353: creat d4/d9/d2b/f72 x:0 0 0 2024-04-06T12:23:05.055 INFO:tasks.workunit.client.1.smithi195.stdout:3/354: fsync d4/f69 0 2024-04-06T12:23:05.055 INFO:tasks.workunit.client.1.smithi195.stdout:4/290: mkdir d4/d6/d38/d1a/d40/d57 0 2024-04-06T12:23:05.055 INFO:tasks.workunit.client.1.smithi195.stdout:3/355: dread - d4/d9/d2b/d3b/f6b zero size 2024-04-06T12:23:05.055 INFO:tasks.workunit.client.1.smithi195.stdout:9/334: symlink d3/d10/d3b/d48/d5e/l76 0 2024-04-06T12:23:05.057 INFO:tasks.workunit.client.1.smithi195.stdout:6/347: dwrite d8/d3d/d5e/d72/f79 [0,4194304] 0 2024-04-06T12:23:05.057 INFO:tasks.workunit.client.1.smithi195.stdout:9/335: write d3/f23 [9064086,48029] 0 2024-04-06T12:23:05.058 INFO:tasks.workunit.client.1.smithi195.stdout:2/296: creat d2/f55 x:0 0 0 2024-04-06T12:23:05.058 INFO:tasks.workunit.client.1.smithi195.stdout:2/297: dread - d2/f55 zero size 2024-04-06T12:23:05.059 INFO:tasks.workunit.client.1.smithi195.stdout:9/336: dread - d3/d10/d3b/d48/f4a zero size 2024-04-06T12:23:05.061 INFO:tasks.workunit.client.1.smithi195.stdout:4/291: mknod d4/d6/d38/d1a/d40/d20/d23/c58 0 2024-04-06T12:23:05.063 INFO:tasks.workunit.client.1.smithi195.stdout:3/356: mkdir d4/d73 0 2024-04-06T12:23:05.065 INFO:tasks.workunit.client.1.smithi195.stdout:9/337: dread d3/d10/f61 [0,4194304] 0 2024-04-06T12:23:05.067 INFO:tasks.workunit.client.1.smithi195.stdout:9/338: chown d3/d10/d3a 120 1 2024-04-06T12:23:05.070 INFO:tasks.workunit.client.1.smithi195.stdout:3/357: stat d4/d9/d52/l6d 0 2024-04-06T12:23:05.070 INFO:tasks.workunit.client.1.smithi195.stdout:8/288: dwrite d6/d3a/f4d [0,4194304] 0 2024-04-06T12:23:05.074 INFO:tasks.workunit.client.1.smithi195.stdout:3/358: mknod d4/d9/d37/c74 0 2024-04-06T12:23:05.075 INFO:tasks.workunit.client.1.smithi195.stdout:8/289: symlink d6/db/d47/l5f 0 2024-04-06T12:23:05.076 INFO:tasks.workunit.client.1.smithi195.stdout:6/348: getdents d8/d21 0 2024-04-06T12:23:05.076 INFO:tasks.workunit.client.1.smithi195.stdout:3/359: chown d4/de/f46 894911384 1 2024-04-06T12:23:05.079 INFO:tasks.workunit.client.1.smithi195.stdout:7/247: sync 2024-04-06T12:23:05.080 INFO:tasks.workunit.client.1.smithi195.stdout:2/298: dwrite d2/d21/d29/f34 [0,4194304] 0 2024-04-06T12:23:05.082 INFO:tasks.workunit.client.1.smithi195.stdout:8/290: readlink l3 0 2024-04-06T12:23:05.084 INFO:tasks.workunit.client.1.smithi195.stdout:9/339: creat d3/d10/d3b/f77 x:0 0 0 2024-04-06T12:23:05.089 INFO:tasks.workunit.client.1.smithi195.stdout:6/349: dwrite d8/d21/d2b/d46/d44/f7d [0,4194304] 0 2024-04-06T12:23:05.089 INFO:tasks.workunit.client.1.smithi195.stdout:7/248: unlink d4/d10/d18/d19/l2f 0 2024-04-06T12:23:05.090 INFO:tasks.workunit.client.1.smithi195.stdout:3/360: symlink d4/d9/d2b/d3b/d5e/l75 0 2024-04-06T12:23:05.093 INFO:tasks.workunit.client.1.smithi195.stdout:9/340: write d3/d10/d3a/f45 [1825104,38] 0 2024-04-06T12:23:05.094 INFO:tasks.workunit.client.1.smithi195.stdout:8/291: creat d6/db/f60 x:0 0 0 2024-04-06T12:23:05.096 INFO:tasks.workunit.client.1.smithi195.stdout:9/341: chown d3/d10/d4f/l73 34 1 2024-04-06T12:23:05.096 INFO:tasks.workunit.client.1.smithi195.stdout:2/299: creat d2/d21/d2c/d2d/f56 x:0 0 0 2024-04-06T12:23:05.097 INFO:tasks.workunit.client.1.smithi195.stdout:7/249: creat d4/d10/d12/d37/f4d x:0 0 0 2024-04-06T12:23:05.099 INFO:tasks.workunit.client.1.smithi195.stdout:2/300: dread - d2/d21/d2c/d2d/f56 zero size 2024-04-06T12:23:05.100 INFO:tasks.workunit.client.1.smithi195.stdout:9/342: chown d3/d10/d3b/d48/f4a 1493 1 2024-04-06T12:23:05.101 INFO:tasks.workunit.client.1.smithi195.stdout:3/361: link d4/d9/d2b/d3b/d40/f4a d4/d9/d2b/d3b/f76 0 2024-04-06T12:23:05.102 INFO:tasks.workunit.client.1.smithi195.stdout:7/250: rmdir d4/d16/d11 39 2024-04-06T12:23:05.102 INFO:tasks.workunit.client.1.smithi195.stdout:9/343: fdatasync d3/d10/d4f/f57 0 2024-04-06T12:23:05.103 INFO:tasks.workunit.client.1.smithi195.stdout:3/362: chown d4/d9/d52 12 1 2024-04-06T12:23:05.105 INFO:tasks.workunit.client.1.smithi195.stdout:7/251: chown d4/d16/f3e 0 1 2024-04-06T12:23:05.106 INFO:tasks.workunit.client.1.smithi195.stdout:3/363: chown d4/de/c3e 535935 1 2024-04-06T12:23:05.106 INFO:tasks.workunit.client.1.smithi195.stdout:4/292: dread d4/d6/d38/f28 [0,4194304] 0 2024-04-06T12:23:05.107 INFO:tasks.workunit.client.1.smithi195.stdout:8/292: dwrite d6/db/d23/d24/d34/f57 [0,4194304] 0 2024-04-06T12:23:05.107 INFO:tasks.workunit.client.1.smithi195.stdout:7/252: dread - d4/d24/f49 zero size 2024-04-06T12:23:05.108 INFO:tasks.workunit.client.1.smithi195.stdout:8/293: read - d6/db/d23/d24/f4e zero size 2024-04-06T12:23:05.111 INFO:tasks.workunit.client.1.smithi195.stdout:2/301: write d2/d3f/f40 [1324016,31324] 0 2024-04-06T12:23:05.114 INFO:tasks.workunit.client.1.smithi195.stdout:3/364: mkdir d4/d9/d2b/d77 0 2024-04-06T12:23:05.116 INFO:tasks.workunit.client.1.smithi195.stdout:4/293: unlink d4/d6/f7 0 2024-04-06T12:23:05.119 INFO:tasks.workunit.client.1.smithi195.stdout:4/294: write d4/d6/d38/d1a/d40/f3b [858957,97472] 0 2024-04-06T12:23:05.119 INFO:tasks.workunit.client.1.smithi195.stdout:2/302: dwrite d2/d14/f1d [4194304,4194304] 0 2024-04-06T12:23:05.119 INFO:tasks.workunit.client.1.smithi195.stdout:9/344: link d3/f43 d3/d10/d3b/d48/d5e/f78 0 2024-04-06T12:23:05.120 INFO:tasks.workunit.client.1.smithi195.stdout:3/365: dread d4/df/d39/f5a [0,4194304] 0 2024-04-06T12:23:05.121 INFO:tasks.workunit.client.1.smithi195.stdout:9/345: stat d3/d10/d4f/f57 0 2024-04-06T12:23:05.122 INFO:tasks.workunit.client.1.smithi195.stdout:7/253: link d4/d16/dd/f2a d4/d10/d12/d37/f4e 0 2024-04-06T12:23:05.122 INFO:tasks.workunit.client.1.smithi195.stdout:3/366: chown d4/f7 98933 1 2024-04-06T12:23:05.122 INFO:tasks.workunit.client.1.smithi195.stdout:9/346: fsync d3/d10/f30 0 2024-04-06T12:23:05.123 INFO:tasks.workunit.client.1.smithi195.stdout:8/294: mkdir d6/d8/d12/d61 0 2024-04-06T12:23:05.124 INFO:tasks.workunit.client.1.smithi195.stdout:8/295: fsync d6/dd/f14 0 2024-04-06T12:23:05.129 INFO:tasks.workunit.client.1.smithi195.stdout:3/367: dwrite d4/d9/f2a [0,4194304] 0 2024-04-06T12:23:05.130 INFO:tasks.workunit.client.1.smithi195.stdout:2/303: creat d2/d21/d2c/d2d/f57 x:0 0 0 2024-04-06T12:23:05.133 INFO:tasks.workunit.client.1.smithi195.stdout:7/254: mknod d4/d24/c4f 0 2024-04-06T12:23:05.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/296: rmdir d6/db/d23/d24/d53 39 2024-04-06T12:23:05.133 INFO:tasks.workunit.client.1.smithi195.stdout:2/304: write d2/d14/f31 [1328556,6755] 0 2024-04-06T12:23:05.134 INFO:tasks.workunit.client.1.smithi195.stdout:7/255: write d4/f7 [3640940,33189] 0 2024-04-06T12:23:05.135 INFO:tasks.workunit.client.1.smithi195.stdout:2/305: readlink d2/d21/d2c/d2d/l3b 0 2024-04-06T12:23:05.136 INFO:tasks.workunit.client.1.smithi195.stdout:9/347: unlink d3/f5 0 2024-04-06T12:23:05.138 INFO:tasks.workunit.client.1.smithi195.stdout:9/348: read d3/d10/f22 [253299,100652] 0 2024-04-06T12:23:05.140 INFO:tasks.workunit.client.1.smithi195.stdout:8/297: dread d6/dd/f38 [0,4194304] 0 2024-04-06T12:23:05.142 INFO:tasks.workunit.client.1.smithi195.stdout:8/298: write d6/f31 [339190,22019] 0 2024-04-06T12:23:05.145 INFO:tasks.workunit.client.1.smithi195.stdout:7/256: creat d4/d10/d18/d19/f50 x:0 0 0 2024-04-06T12:23:05.147 INFO:tasks.workunit.client.1.smithi195.stdout:4/295: dread d4/d6/d38/d1a/f24 [0,4194304] 0 2024-04-06T12:23:05.147 INFO:tasks.workunit.client.1.smithi195.stdout:8/299: dread d6/f16 [0,4194304] 0 2024-04-06T12:23:05.147 INFO:tasks.workunit.client.1.smithi195.stdout:2/306: rename d2/d21/d2c/d2d/f56 to d2/d14/d53/f58 0 2024-04-06T12:23:05.149 INFO:tasks.workunit.client.1.smithi195.stdout:2/307: write d2/d14/f22 [379061,100790] 0 2024-04-06T12:23:05.150 INFO:tasks.workunit.client.1.smithi195.stdout:3/368: rmdir d4/d73 0 2024-04-06T12:23:05.151 INFO:tasks.workunit.client.1.smithi195.stdout:4/296: dread d4/d6/f46 [0,4194304] 0 2024-04-06T12:23:05.152 INFO:tasks.workunit.client.1.smithi195.stdout:4/297: read d4/d6/d38/d1a/d40/d20/d23/f3a [2464422,115914] 0 2024-04-06T12:23:05.161 INFO:tasks.workunit.client.1.smithi195.stdout:7/257: unlink d4/d10/d12/c25 0 2024-04-06T12:23:05.165 INFO:tasks.workunit.client.1.smithi195.stdout:8/300: dread d6/f1c [0,4194304] 0 2024-04-06T12:23:05.165 INFO:tasks.workunit.client.1.smithi195.stdout:9/349: unlink d3/d10/d3b/d48/d5e/f78 0 2024-04-06T12:23:05.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/308: symlink d2/d41/d51/l59 0 2024-04-06T12:23:05.167 INFO:tasks.workunit.client.1.smithi195.stdout:3/369: mknod d4/de/c78 0 2024-04-06T12:23:05.167 INFO:tasks.workunit.client.1.smithi195.stdout:8/301: chown d6/dd/f14 725 1 2024-04-06T12:23:05.167 INFO:tasks.workunit.client.1.smithi195.stdout:7/258: dwrite d4/d10/f3c [0,4194304] 0 2024-04-06T12:23:05.172 INFO:tasks.workunit.client.1.smithi195.stdout:7/259: read d4/d10/f27 [2240878,76898] 0 2024-04-06T12:23:05.174 INFO:tasks.workunit.client.1.smithi195.stdout:9/350: mknod d3/d10/d3a/d5d/c79 0 2024-04-06T12:23:05.175 INFO:tasks.workunit.client.1.smithi195.stdout:2/309: mkdir d2/d41/d5a 0 2024-04-06T12:23:05.178 INFO:tasks.workunit.client.1.smithi195.stdout:8/302: write d6/f1c [3670708,108286] 0 2024-04-06T12:23:05.181 INFO:tasks.workunit.client.1.smithi195.stdout:4/298: creat d4/d6/d38/d1a/d40/d57/f59 x:0 0 0 2024-04-06T12:23:05.181 INFO:tasks.workunit.client.1.smithi195.stdout:9/351: dwrite d3/d10/f35 [0,4194304] 0 2024-04-06T12:23:05.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.186+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2de00fc010 con 0x7f2dc8066e10 2024-04-06T12:23:05.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.188+0000 7f2dcf7fe700 1 -- 172.21.15.152:0/2513069343 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2de00fc010 con 0x7f2dc8066e10 2024-04-06T12:23:05.186 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:23:05.186 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:23:05.186 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:23:05.186 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:23:05.186 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2024-04-06T12:23:05.186 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "1/2 daemons upgraded", 2024-04-06T12:23:05.186 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2024-04-06T12:23:05.186 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:23:05.187 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:23:05.187 INFO:tasks.workunit.client.1.smithi195.stdout:7/260: mknod d4/d4a/c51 0 2024-04-06T12:23:05.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2dc8066e10 msgr2=0x7f2dc80692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:05.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2dc8066e10 0x7f2dc80692d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2dd4009700 tx=0x7f2dd4006c30).stop 2024-04-06T12:23:05.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de00f6930 msgr2=0x7f2de0108230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:05.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de00f6930 0x7f2de0108230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2dd000b120 tx=0x7f2dd0009cb0).stop 2024-04-06T12:23:05.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 shutdown_connections 2024-04-06T12:23:05.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2dc8066e10 0x7f2dc80692d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:05.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de00f6930 0x7f2de0108230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:05.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 --2- 172.21.15.152:0/2513069343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2de00f7bd0 0x7f2de0108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:23:05.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 >> 172.21.15.152:0/2513069343 conn(0x7f2de00f2070 msgr2=0x7f2de0060e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:05.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 shutdown_connections 2024-04-06T12:23:05.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:05.191+0000 7f2de4a65700 1 -- 172.21.15.152:0/2513069343 wait complete. 2024-04-06T12:23:05.190 INFO:tasks.workunit.client.1.smithi195.stdout:4/299: mknod d4/d6/d38/c5a 0 2024-04-06T12:23:05.190 INFO:tasks.workunit.client.1.smithi195.stdout:7/261: fsync d4/d10/d12/d37/f4d 0 2024-04-06T12:23:05.190 INFO:tasks.workunit.client.1.smithi195.stdout:3/370: dwrite d4/d9/d2b/d3b/d40/f56 [0,4194304] 0 2024-04-06T12:23:05.197 INFO:tasks.workunit.client.1.smithi195.stdout:9/352: dwrite d3/d10/d3b/f5b [0,4194304] 0 2024-04-06T12:23:05.197 INFO:tasks.workunit.client.1.smithi195.stdout:2/310: truncate d2/d14/f31 3244672 0 2024-04-06T12:23:05.198 INFO:tasks.workunit.client.1.smithi195.stdout:2/311: readlink d2/l44 0 2024-04-06T12:23:05.204 INFO:tasks.workunit.client.1.smithi195.stdout:2/312: unlink d2/f1a 0 2024-04-06T12:23:05.205 INFO:tasks.workunit.client.1.smithi195.stdout:2/313: chown d2/fb 169589470 1 2024-04-06T12:23:05.207 INFO:tasks.workunit.client.1.smithi195.stdout:9/353: getdents d3/d10/d3b/d48 0 2024-04-06T12:23:05.208 INFO:tasks.workunit.client.1.smithi195.stdout:0/306: sync 2024-04-06T12:23:05.208 INFO:tasks.workunit.client.1.smithi195.stdout:5/280: sync 2024-04-06T12:23:05.208 INFO:tasks.workunit.client.1.smithi195.stdout:1/323: sync 2024-04-06T12:23:05.208 INFO:tasks.workunit.client.1.smithi195.stdout:2/314: mknod d2/d41/d5a/c5b 0 2024-04-06T12:23:05.209 INFO:tasks.workunit.client.1.smithi195.stdout:8/303: truncate d6/d8/d12/f2f 1109559 0 2024-04-06T12:23:05.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/307: readlink d4/d6/d1a/l1c 0 2024-04-06T12:23:05.211 INFO:tasks.workunit.client.1.smithi195.stdout:5/281: chown d0/da/d13/l47 1 1 2024-04-06T12:23:05.213 INFO:tasks.workunit.client.1.smithi195.stdout:7/262: dread d4/d10/d12/f14 [4194304,4194304] 0 2024-04-06T12:23:05.214 INFO:tasks.workunit.client.1.smithi195.stdout:8/304: chown d6/db/d23/d24/d25/l4a 590083243 1 2024-04-06T12:23:05.214 INFO:tasks.workunit.client.1.smithi195.stdout:7/263: readlink d4/d10/d18/l45 0 2024-04-06T12:23:05.216 INFO:tasks.workunit.client.1.smithi195.stdout:4/300: write d4/d6/d38/f1d [3324717,106281] 0 2024-04-06T12:23:05.217 INFO:tasks.workunit.client.1.smithi195.stdout:8/305: write d6/db/d23/d24/d25/d49/f3d [1106237,129307] 0 2024-04-06T12:23:05.218 INFO:tasks.workunit.client.1.smithi195.stdout:2/315: rmdir d2 39 2024-04-06T12:23:05.222 INFO:tasks.workunit.client.1.smithi195.stdout:9/354: creat d3/d10/d3a/d6b/f7a x:0 0 0 2024-04-06T12:23:05.225 INFO:tasks.workunit.client.1.smithi195.stdout:2/316: dread - d2/d41/d51/f3d zero size 2024-04-06T12:23:05.226 INFO:tasks.workunit.client.1.smithi195.stdout:8/306: mknod d6/db/d23/c62 0 2024-04-06T12:23:05.226 INFO:tasks.workunit.client.1.smithi195.stdout:0/308: dread d4/f32 [4194304,4194304] 0 2024-04-06T12:23:05.229 INFO:tasks.workunit.client.1.smithi195.stdout:2/317: truncate d2/d14/f18 4506350 0 2024-04-06T12:23:05.229 INFO:tasks.workunit.client.1.smithi195.stdout:9/355: creat d3/de/f7b x:0 0 0 2024-04-06T12:23:05.230 INFO:tasks.workunit.client.1.smithi195.stdout:1/324: dwrite d4/d14/d19/d23/f48 [0,4194304] 0 2024-04-06T12:23:05.232 INFO:tasks.workunit.client.1.smithi195.stdout:2/318: dread d2/d21/f24 [0,4194304] 0 2024-04-06T12:23:05.233 INFO:tasks.workunit.client.1.smithi195.stdout:0/309: unlink d4/le 0 2024-04-06T12:23:05.235 INFO:tasks.workunit.client.1.smithi195.stdout:7/264: creat d4/d10/d12/f52 x:0 0 0 2024-04-06T12:23:05.238 INFO:tasks.workunit.client.1.smithi195.stdout:9/356: readlink d3/l34 0 2024-04-06T12:23:05.239 INFO:tasks.workunit.client.1.smithi195.stdout:5/282: link d0/da/l1b d0/da/dd/d33/l6d 0 2024-04-06T12:23:05.240 INFO:tasks.workunit.client.1.smithi195.stdout:5/283: readlink d0/d52/l5b 0 2024-04-06T12:23:05.240 INFO:tasks.workunit.client.1.smithi195.stdout:1/325: mkdir d4/d14/d19/d4e/d60 0 2024-04-06T12:23:05.245 INFO:tasks.workunit.client.1.smithi195.stdout:4/301: getdents d4/d3e 0 2024-04-06T12:23:05.246 INFO:tasks.workunit.client.1.smithi195.stdout:7/265: creat d4/d10/d18/f53 x:0 0 0 2024-04-06T12:23:05.246 INFO:tasks.workunit.client.1.smithi195.stdout:0/310: dread d4/d6/d1a/f40 [0,4194304] 0 2024-04-06T12:23:05.248 INFO:tasks.workunit.client.1.smithi195.stdout:9/357: symlink d3/d10/d3b/d48/l7c 0 2024-04-06T12:23:05.248 INFO:tasks.workunit.client.1.smithi195.stdout:5/284: dwrite d0/d2c/d37/f49 [0,4194304] 0 2024-04-06T12:23:05.248 INFO:tasks.workunit.client.1.smithi195.stdout:0/311: fsync d4/d6/d2f/f38 0 2024-04-06T12:23:05.250 INFO:tasks.workunit.client.1.smithi195.stdout:9/358: dread - d3/d10/d3b/d48/f49 zero size 2024-04-06T12:23:05.253 INFO:tasks.workunit.client.1.smithi195.stdout:1/326: rename d4/d14/d17/d24/d2a/f5b to d4/d14/d19/d4e/f61 0 2024-04-06T12:23:05.256 INFO:tasks.workunit.client.1.smithi195.stdout:1/327: dread - d4/d14/d19/f4c zero size 2024-04-06T12:23:05.258 INFO:tasks.workunit.client.1.smithi195.stdout:9/359: mkdir d3/d10/d7d 0 2024-04-06T12:23:05.258 INFO:tasks.workunit.client.1.smithi195.stdout:2/319: dread d2/d14/f31 [0,4194304] 0 2024-04-06T12:23:05.259 INFO:tasks.workunit.client.1.smithi195.stdout:1/328: write d4/d14/d19/f20 [5404623,69109] 0 2024-04-06T12:23:05.262 INFO:tasks.workunit.client.1.smithi195.stdout:4/302: dread d4/d6/d38/d1a/d40/f3b [0,4194304] 0 2024-04-06T12:23:05.262 INFO:tasks.workunit.client.1.smithi195.stdout:5/285: creat d0/da/d23/d38/d41/f6e x:0 0 0 2024-04-06T12:23:05.263 INFO:tasks.workunit.client.1.smithi195.stdout:0/312: link d4/d6/d2f/d49/l57 d4/d48/d67/l68 0 2024-04-06T12:23:05.264 INFO:tasks.workunit.client.1.smithi195.stdout:2/320: creat d2/d21/d2c/d2d/f5c x:0 0 0 2024-04-06T12:23:05.265 INFO:tasks.workunit.client.1.smithi195.stdout:9/360: unlink d3/d10/d3a/c62 0 2024-04-06T12:23:05.268 INFO:tasks.workunit.client.1.smithi195.stdout:4/303: mknod d4/d6/c5b 0 2024-04-06T12:23:05.268 INFO:tasks.workunit.client.1.smithi195.stdout:7/266: dread d4/d16/fe [0,4194304] 0 2024-04-06T12:23:05.269 INFO:tasks.workunit.client.1.smithi195.stdout:2/321: mkdir d2/d41/d51/d5d 0 2024-04-06T12:23:05.270 INFO:tasks.workunit.client.1.smithi195.stdout:0/313: creat d4/d41/f69 x:0 0 0 2024-04-06T12:23:05.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/307: dwrite d6/d8/d12/f2f [0,4194304] 0 2024-04-06T12:23:05.277 INFO:tasks.workunit.client.1.smithi195.stdout:4/304: readlink d4/d6/d38/l2b 0 2024-04-06T12:23:05.278 INFO:tasks.workunit.client.1.smithi195.stdout:9/361: truncate d3/d10/d3a/d5d/f63 827863 0 2024-04-06T12:23:05.280 INFO:tasks.workunit.client.1.smithi195.stdout:7/267: fsync d4/d10/d12/d37/f4e 0 2024-04-06T12:23:05.281 INFO:tasks.workunit.client.1.smithi195.stdout:0/314: rename d4/d6/d1a/f40 to d4/d48/d67/f6a 0 2024-04-06T12:23:05.281 INFO:tasks.workunit.client.1.smithi195.stdout:5/286: dwrite d0/f30 [0,4194304] 0 2024-04-06T12:23:05.286 INFO:tasks.workunit.client.1.smithi195.stdout:8/308: creat d6/d3a/d46/f63 x:0 0 0 2024-04-06T12:23:05.288 INFO:tasks.workunit.client.1.smithi195.stdout:1/329: dread d4/d14/d19/f22 [0,4194304] 0 2024-04-06T12:23:05.288 INFO:tasks.workunit.client.1.smithi195.stdout:8/309: chown d6/db/d23/d24/d25/d49 167276508 1 2024-04-06T12:23:05.289 INFO:tasks.workunit.client.1.smithi195.stdout:1/330: chown d4/d14/d17/d24/d2a 98217 1 2024-04-06T12:23:05.289 INFO:tasks.workunit.client.1.smithi195.stdout:0/315: fdatasync d4/f5 0 2024-04-06T12:23:05.290 INFO:tasks.workunit.client.1.smithi195.stdout:2/322: write d2/d14/d53/f52 [762719,117849] 0 2024-04-06T12:23:05.290 INFO:tasks.workunit.client.1.smithi195.stdout:5/287: fdatasync d0/da/fb 0 2024-04-06T12:23:05.291 INFO:tasks.workunit.client.1.smithi195.stdout:9/362: creat d3/de/d37/f7e x:0 0 0 2024-04-06T12:23:05.292 INFO:tasks.workunit.client.1.smithi195.stdout:7/268: mkdir d4/d16/dd/d22/d3f/d54 0 2024-04-06T12:23:05.294 INFO:tasks.workunit.client.1.smithi195.stdout:7/269: rename d4 to d4/d16/dd/d22/d3f/d55 22 2024-04-06T12:23:05.295 INFO:tasks.workunit.client.1.smithi195.stdout:2/323: dread - d2/d21/d2c/d2d/f57 zero size 2024-04-06T12:23:05.296 INFO:tasks.workunit.client.1.smithi195.stdout:1/331: write d4/d14/d17/f42 [1105922,85886] 0 2024-04-06T12:23:05.298 INFO:tasks.workunit.client.1.smithi195.stdout:5/288: chown d0/da/d13/c50 7 1 2024-04-06T12:23:05.298 INFO:tasks.workunit.client.1.smithi195.stdout:0/316: dread d4/d41/f62 [0,4194304] 0 2024-04-06T12:23:05.298 INFO:tasks.workunit.client.1.smithi195.stdout:9/363: mkdir d3/d10/d3b/d48/d7f 0 2024-04-06T12:23:05.299 INFO:tasks.workunit.client.1.smithi195.stdout:2/324: rmdir d2/d21/d29 39 2024-04-06T12:23:05.301 INFO:tasks.workunit.client.1.smithi195.stdout:4/305: dwrite d4/f4a [0,4194304] 0 2024-04-06T12:23:05.301 INFO:tasks.workunit.client.1.smithi195.stdout:9/364: stat d3/d10/c20 0 2024-04-06T12:23:05.303 INFO:tasks.workunit.client.1.smithi195.stdout:1/332: write d4/d14/d17/f30 [1443322,115111] 0 2024-04-06T12:23:05.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/270: read d4/d10/d18/d19/f43 [3705057,107775] 0 2024-04-06T12:23:05.305 INFO:tasks.workunit.client.1.smithi195.stdout:2/325: chown d2/d21/d2c/d2d/c33 1 1 2024-04-06T12:23:05.306 INFO:tasks.workunit.client.1.smithi195.stdout:0/317: creat d4/d6/f6b x:0 0 0 2024-04-06T12:23:05.307 INFO:tasks.workunit.client.1.smithi195.stdout:5/289: truncate d0/da/dd/d2e/f59 5116890 0 2024-04-06T12:23:05.310 INFO:tasks.workunit.client.1.smithi195.stdout:8/310: dwrite d6/db/d23/d24/d25/f54 [0,4194304] 0 2024-04-06T12:23:05.311 INFO:tasks.workunit.client.1.smithi195.stdout:9/365: rename f1 to d3/d10/d3a/f80 0 2024-04-06T12:23:05.312 INFO:tasks.workunit.client.1.smithi195.stdout:8/311: readlink d6/db/d23/l44 0 2024-04-06T12:23:05.314 INFO:tasks.workunit.client.1.smithi195.stdout:4/306: write d4/d6/d38/f3f [4523670,27774] 0 2024-04-06T12:23:05.315 INFO:tasks.workunit.client.1.smithi195.stdout:2/326: mkdir d2/d21/d5e 0 2024-04-06T12:23:05.317 INFO:tasks.workunit.client.1.smithi195.stdout:0/318: creat d4/d48/f6c x:0 0 0 2024-04-06T12:23:05.319 INFO:tasks.workunit.client.1.smithi195.stdout:5/290: rename d0/d28 to d0/da/dd/d2e/d6f 0 2024-04-06T12:23:05.320 INFO:tasks.workunit.client.1.smithi195.stdout:6/350: sync 2024-04-06T12:23:05.321 INFO:tasks.workunit.client.1.smithi195.stdout:2/327: truncate d2/f12 1128185 0 2024-04-06T12:23:05.322 INFO:tasks.workunit.client.1.smithi195.stdout:6/351: fsync d8/f10 0 2024-04-06T12:23:05.322 INFO:tasks.workunit.client.1.smithi195.stdout:5/291: truncate d0/d2c/f57 690498 0 2024-04-06T12:23:05.322 INFO:tasks.workunit.client.1.smithi195.stdout:9/366: fsync d3/d10/d3a/f80 0 2024-04-06T12:23:05.323 INFO:tasks.workunit.client.1.smithi195.stdout:4/307: mkdir d4/d6/d38/d5c 0 2024-04-06T12:23:05.324 INFO:tasks.workunit.client.1.smithi195.stdout:1/333: truncate d4/d14/d19/d23/d28/f2b 59120 0 2024-04-06T12:23:05.325 INFO:tasks.workunit.client.1.smithi195.stdout:9/367: write d3/de/f7b [1030561,5806] 0 2024-04-06T12:23:05.326 INFO:tasks.workunit.client.1.smithi195.stdout:6/352: write d8/d21/d2b/d46/d2f/f53 [58349,2613] 0 2024-04-06T12:23:05.328 INFO:tasks.workunit.client.1.smithi195.stdout:1/334: write d4/d14/d17/f30 [315610,122912] 0 2024-04-06T12:23:05.328 INFO:tasks.workunit.client.1.smithi195.stdout:8/312: link d6/db/d23/d24/d34/f57 d6/db/d23/d24/d25/d5e/f64 0 2024-04-06T12:23:05.330 INFO:tasks.workunit.client.1.smithi195.stdout:2/328: rename d2/d3f/f40 to d2/d21/d2c/d2d/f5f 0 2024-04-06T12:23:05.335 INFO:tasks.workunit.client.1.smithi195.stdout:1/335: chown d4/d14/d19/c51 57863699 1 2024-04-06T12:23:05.335 INFO:tasks.workunit.client.1.smithi195.stdout:2/329: write d2/fb [1520768,113677] 0 2024-04-06T12:23:05.340 INFO:tasks.workunit.client.1.smithi195.stdout:0/319: dread d4/f5 [4194304,4194304] 0 2024-04-06T12:23:05.340 INFO:tasks.workunit.client.1.smithi195.stdout:7/271: dwrite d4/d10/f27 [0,4194304] 0 2024-04-06T12:23:05.340 INFO:tasks.workunit.client.1.smithi195.stdout:1/336: chown d4/d14/d19/f4c 1360 1 2024-04-06T12:23:05.340 INFO:tasks.workunit.client.1.smithi195.stdout:8/313: creat d6/db/d23/d24/d25/d49/f65 x:0 0 0 2024-04-06T12:23:05.341 INFO:tasks.workunit.client.1.smithi195.stdout:4/308: creat d4/d6/d38/f5d x:0 0 0 2024-04-06T12:23:05.343 INFO:tasks.workunit.client.1.smithi195.stdout:9/368: creat d3/d10/d3b/f81 x:0 0 0 2024-04-06T12:23:05.343 INFO:tasks.workunit.client.1.smithi195.stdout:5/292: dwrite d0/f6 [0,4194304] 0 2024-04-06T12:23:05.345 INFO:tasks.workunit.client.1.smithi195.stdout:2/330: write d2/d21/d29/f2b [660410,65460] 0 2024-04-06T12:23:05.345 INFO:tasks.workunit.client.1.smithi195.stdout:8/314: creat d6/db/f66 x:0 0 0 2024-04-06T12:23:05.345 INFO:tasks.workunit.client.1.smithi195.stdout:0/320: mknod d4/d48/d4e/c6d 0 2024-04-06T12:23:05.349 INFO:tasks.workunit.client.1.smithi195.stdout:6/353: truncate d8/f14 1390056 0 2024-04-06T12:23:05.349 INFO:tasks.workunit.client.1.smithi195.stdout:0/321: chown d4/d6/c4b 114633643 1 2024-04-06T12:23:05.350 INFO:tasks.workunit.client.1.smithi195.stdout:5/293: creat d0/da/dd/d2e/f70 x:0 0 0 2024-04-06T12:23:05.351 INFO:tasks.workunit.client.1.smithi195.stdout:5/294: stat d0 0 2024-04-06T12:23:05.354 INFO:tasks.workunit.client.1.smithi195.stdout:8/315: mkdir d6/db/d23/d24/d34/d67 0 2024-04-06T12:23:05.357 INFO:tasks.workunit.client.1.smithi195.stdout:6/354: symlink d8/d21/l88 0 2024-04-06T12:23:05.357 INFO:tasks.workunit.client.1.smithi195.stdout:0/322: mknod d4/d6/d2f/c6e 0 2024-04-06T12:23:05.358 INFO:tasks.workunit.client.1.smithi195.stdout:4/309: dwrite d4/f4a [0,4194304] 0 2024-04-06T12:23:05.359 INFO:tasks.workunit.client.1.smithi195.stdout:1/337: link d4/d14/l21 d4/d14/d17/d24/l62 0 2024-04-06T12:23:05.359 INFO:tasks.workunit.client.1.smithi195.stdout:8/316: read d6/f1c [3558151,126615] 0 2024-04-06T12:23:05.370 INFO:tasks.workunit.client.1.smithi195.stdout:2/331: dwrite d2/d21/d29/f3e [0,4194304] 0 2024-04-06T12:23:05.370 INFO:tasks.workunit.client.1.smithi195.stdout:0/323: read d4/d6/d1a/f3f [4001953,43516] 0 2024-04-06T12:23:05.370 INFO:tasks.workunit.client.1.smithi195.stdout:9/369: dwrite d3/f24 [0,4194304] 0 2024-04-06T12:23:05.372 INFO:tasks.workunit.client.1.smithi195.stdout:2/332: fsync d2/f35 0 2024-04-06T12:23:05.373 INFO:tasks.workunit.client.1.smithi195.stdout:4/310: creat d4/f5e x:0 0 0 2024-04-06T12:23:05.376 INFO:tasks.workunit.client.1.smithi195.stdout:0/324: symlink d4/l6f 0 2024-04-06T12:23:05.376 INFO:tasks.workunit.client.1.smithi195.stdout:4/311: symlink d4/d6/l5f 0 2024-04-06T12:23:05.380 INFO:tasks.workunit.client.1.smithi195.stdout:8/317: rename d6/f16 to d6/db/d23/d24/d53/f68 0 2024-04-06T12:23:05.383 INFO:tasks.workunit.client.1.smithi195.stdout:2/333: creat d2/d3f/f60 x:0 0 0 2024-04-06T12:23:05.385 INFO:tasks.workunit.client.1.smithi195.stdout:8/318: read d6/d3a/f45 [4098860,44993] 0 2024-04-06T12:23:05.386 INFO:tasks.workunit.client.1.smithi195.stdout:1/338: dwrite d4/d14/d17/f30 [0,4194304] 0 2024-04-06T12:23:05.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/312: fsync d4/d6/d38/d1a/d40/f15 0 2024-04-06T12:23:05.392 INFO:tasks.workunit.client.1.smithi195.stdout:4/313: dread - d4/d6/d38/f5d zero size 2024-04-06T12:23:05.394 INFO:tasks.workunit.client.1.smithi195.stdout:1/339: rename d4 to d4/d14/d19/d63 22 2024-04-06T12:23:05.394 INFO:tasks.workunit.client.1.smithi195.stdout:5/295: truncate d0/da/f21 3939894 0 2024-04-06T12:23:05.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/319: write d6/d3a/d46/f63 [65649,129266] 0 2024-04-06T12:23:05.395 INFO:tasks.workunit.client.1.smithi195.stdout:9/370: dwrite d3/d10/d3a/f6a [0,4194304] 0 2024-04-06T12:23:05.401 INFO:tasks.workunit.client.1.smithi195.stdout:0/325: dread d4/f21 [0,4194304] 0 2024-04-06T12:23:05.401 INFO:tasks.workunit.client.1.smithi195.stdout:6/355: mknod d8/d21/d31/d26/c89 0 2024-04-06T12:23:05.401 INFO:tasks.workunit.client.1.smithi195.stdout:1/340: chown d4/d14/d17/d24/f43 25 1 2024-04-06T12:23:05.401 INFO:tasks.workunit.client.1.smithi195.stdout:6/356: stat d8/d3d/d5e 0 2024-04-06T12:23:05.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/320: rename d6/d8/f10 to d6/dd/f69 0 2024-04-06T12:23:05.403 INFO:tasks.workunit.client.1.smithi195.stdout:6/357: write d8/d3d/d5e/f77 [148672,26213] 0 2024-04-06T12:23:05.403 INFO:tasks.workunit.client.1.smithi195.stdout:5/296: symlink d0/da/d13/d5e/l71 0 2024-04-06T12:23:05.404 INFO:tasks.workunit.client.1.smithi195.stdout:6/358: dread - d8/d3d/d3f/f60 zero size 2024-04-06T12:23:05.405 INFO:tasks.workunit.client.1.smithi195.stdout:4/314: rmdir d4/d6/d38/d5c 0 2024-04-06T12:23:05.406 INFO:tasks.workunit.client.1.smithi195.stdout:8/321: symlink d6/d3a/l6a 0 2024-04-06T12:23:05.408 INFO:tasks.workunit.client.1.smithi195.stdout:5/297: symlink d0/d35/l72 0 2024-04-06T12:23:05.409 INFO:tasks.workunit.client.1.smithi195.stdout:8/322: dread d6/d3a/d46/f63 [0,4194304] 0 2024-04-06T12:23:05.409 INFO:tasks.workunit.client.1.smithi195.stdout:6/359: mknod d8/d3d/d5e/d72/c8a 0 2024-04-06T12:23:05.411 INFO:tasks.workunit.client.1.smithi195.stdout:1/341: mkdir d4/d14/d19/d4e/d57/d64 0 2024-04-06T12:23:05.413 INFO:tasks.workunit.client.1.smithi195.stdout:9/371: getdents d3/d10/d3a/d6b 0 2024-04-06T12:23:05.414 INFO:tasks.workunit.client.1.smithi195.stdout:9/372: readlink d3/de/l13 0 2024-04-06T12:23:05.415 INFO:tasks.workunit.client.1.smithi195.stdout:0/326: getdents d4/d48/d67 0 2024-04-06T12:23:05.417 INFO:tasks.workunit.client.1.smithi195.stdout:0/327: truncate d4/f4d 240916 0 2024-04-06T12:23:05.418 INFO:tasks.workunit.client.1.smithi195.stdout:4/315: dwrite d4/d6/d38/d1a/f2d [0,4194304] 0 2024-04-06T12:23:05.418 INFO:tasks.workunit.client.1.smithi195.stdout:3/371: sync 2024-04-06T12:23:05.419 INFO:tasks.workunit.client.1.smithi195.stdout:0/328: fsync d4/f61 0 2024-04-06T12:23:05.419 INFO:tasks.workunit.client.1.smithi195.stdout:5/298: symlink d0/da/dd/d2e/d6f/d58/l73 0 2024-04-06T12:23:05.422 INFO:tasks.workunit.client.1.smithi195.stdout:9/373: creat d3/d10/d3b/d48/d5e/f82 x:0 0 0 2024-04-06T12:23:05.422 INFO:tasks.workunit.client.1.smithi195.stdout:0/329: read d4/fd [2625031,84327] 0 2024-04-06T12:23:05.423 INFO:tasks.workunit.client.1.smithi195.stdout:1/342: fdatasync d4/d14/d19/d23/d28/d2f/f33 0 2024-04-06T12:23:05.426 INFO:tasks.workunit.client.1.smithi195.stdout:4/316: creat d4/d6/d38/d1a/d40/d20/f60 x:0 0 0 2024-04-06T12:23:05.427 INFO:tasks.workunit.client.1.smithi195.stdout:8/323: link d6/d8/l9 d6/d8/d12/l6b 0 2024-04-06T12:23:05.428 INFO:tasks.workunit.client.1.smithi195.stdout:5/299: mknod d0/da/d13/d5e/c74 0 2024-04-06T12:23:05.428 INFO:tasks.workunit.client.1.smithi195.stdout:3/372: dwrite d4/df/d39/f47 [0,4194304] 0 2024-04-06T12:23:05.429 INFO:tasks.workunit.client.1.smithi195.stdout:4/317: chown d4/d6/d38/d1a/d40/f32 2 1 2024-04-06T12:23:05.431 INFO:tasks.workunit.client.1.smithi195.stdout:9/374: symlink d3/d10/d3a/d5d/l83 0 2024-04-06T12:23:05.434 INFO:tasks.workunit.client.1.smithi195.stdout:8/324: rename d6/f20 to d6/db/d23/d24/d34/d67/f6c 0 2024-04-06T12:23:05.435 INFO:tasks.workunit.client.1.smithi195.stdout:3/373: dread d4/df/d39/f5a [0,4194304] 0 2024-04-06T12:23:05.438 INFO:tasks.workunit.client.1.smithi195.stdout:9/375: creat d3/de/d37/f84 x:0 0 0 2024-04-06T12:23:05.439 INFO:tasks.workunit.client.1.smithi195.stdout:1/343: dwrite d4/d14/d19/d4e/f61 [0,4194304] 0 2024-04-06T12:23:05.440 INFO:tasks.workunit.client.1.smithi195.stdout:4/318: creat d4/d6/d38/d1a/d40/d20/f61 x:0 0 0 2024-04-06T12:23:05.442 INFO:tasks.workunit.client.1.smithi195.stdout:6/360: truncate d8/d21/d2b/d46/d44/f7d 3906601 0 2024-04-06T12:23:05.442 INFO:tasks.workunit.client.1.smithi195.stdout:8/325: write d6/db/d23/d24/d34/d67/f6c [4858009,85612] 0 2024-04-06T12:23:05.443 INFO:tasks.workunit.client.1.smithi195.stdout:8/326: readlink d6/d3a/l6a 0 2024-04-06T12:23:05.443 INFO:tasks.workunit.client.1.smithi195.stdout:9/376: creat d3/de/f85 x:0 0 0 2024-04-06T12:23:05.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/361: creat d8/d21/d2b/d46/d2f/f8b x:0 0 0 2024-04-06T12:23:05.449 INFO:tasks.workunit.client.1.smithi195.stdout:4/319: dwrite d4/f2e [0,4194304] 0 2024-04-06T12:23:05.450 INFO:tasks.workunit.client.1.smithi195.stdout:8/327: write d6/f1c [642720,20499] 0 2024-04-06T12:23:05.452 INFO:tasks.workunit.client.1.smithi195.stdout:1/344: unlink d4/c13 0 2024-04-06T12:23:05.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/330: dwrite d4/f2e [0,4194304] 0 2024-04-06T12:23:05.456 INFO:tasks.workunit.client.1.smithi195.stdout:8/328: chown d6/d8/d12/f2f 0 1 2024-04-06T12:23:05.457 INFO:tasks.workunit.client.1.smithi195.stdout:5/300: link d0/da/f21 d0/da/dd/d2e/d6f/f75 0 2024-04-06T12:23:05.457 INFO:tasks.workunit.client.1.smithi195.stdout:6/362: creat d8/d21/d2b/d46/d44/f8c x:0 0 0 2024-04-06T12:23:05.459 INFO:tasks.workunit.client.1.smithi195.stdout:9/377: creat d3/d10/d3b/d50/f86 x:0 0 0 2024-04-06T12:23:05.459 INFO:tasks.workunit.client.1.smithi195.stdout:6/363: chown d8/d50/d82 41356864 1 2024-04-06T12:23:05.461 INFO:tasks.workunit.client.1.smithi195.stdout:6/364: write d8/d21/d31/d6c/f7c [563380,32149] 0 2024-04-06T12:23:05.461 INFO:tasks.workunit.client.1.smithi195.stdout:1/345: truncate d4/d14/d17/f10 75181 0 2024-04-06T12:23:05.462 INFO:tasks.workunit.client.1.smithi195.stdout:8/329: getdents d6/dd 0 2024-04-06T12:23:05.464 INFO:tasks.workunit.client.1.smithi195.stdout:1/346: write d4/d14/d17/f53 [4511510,10285] 0 2024-04-06T12:23:05.464 INFO:tasks.workunit.client.1.smithi195.stdout:6/365: chown d8/d50/d32/f57 12186 1 2024-04-06T12:23:05.467 INFO:tasks.workunit.client.1.smithi195.stdout:6/366: write d8/f1a [1047968,31207] 0 2024-04-06T12:23:05.467 INFO:tasks.workunit.client.1.smithi195.stdout:1/347: mknod d4/d14/d19/d4e/c65 0 2024-04-06T12:23:05.468 INFO:tasks.workunit.client.1.smithi195.stdout:5/301: dwrite d0/da/dd/d1c/f20 [0,4194304] 0 2024-04-06T12:23:05.470 INFO:tasks.workunit.client.1.smithi195.stdout:8/330: link d6/db/d47/f51 d6/db/d23/d24/d34/f6d 0 2024-04-06T12:23:05.471 INFO:tasks.workunit.client.1.smithi195.stdout:6/367: mknod d8/d21/d2b/d46/d44/d86/c8d 0 2024-04-06T12:23:05.473 INFO:tasks.workunit.client.1.smithi195.stdout:6/368: mkdir d8/d8e 0 2024-04-06T12:23:05.474 INFO:tasks.workunit.client.1.smithi195.stdout:1/348: dread d4/d14/d19/f22 [0,4194304] 0 2024-04-06T12:23:05.475 INFO:tasks.workunit.client.1.smithi195.stdout:5/302: dwrite d0/da/fb [0,4194304] 0 2024-04-06T12:23:05.476 INFO:tasks.workunit.client.1.smithi195.stdout:6/369: creat d8/d3d/d5e/f8f x:0 0 0 2024-04-06T12:23:05.478 INFO:tasks.workunit.client.1.smithi195.stdout:6/370: write d8/d21/d31/fe [5076758,97804] 0 2024-04-06T12:23:05.479 INFO:tasks.workunit.client.1.smithi195.stdout:1/349: dread d4/d14/d19/f29 [0,4194304] 0 2024-04-06T12:23:05.483 INFO:tasks.workunit.client.1.smithi195.stdout:6/371: chown d8/d21/d2b/d46/d44/f56 4022 1 2024-04-06T12:23:05.484 INFO:tasks.workunit.client.1.smithi195.stdout:6/372: write d8/d21/d2b/f62 [1161202,37844] 0 2024-04-06T12:23:05.485 INFO:tasks.workunit.client.1.smithi195.stdout:6/373: readlink d8/d21/d2b/l6b 0 2024-04-06T12:23:05.487 INFO:tasks.workunit.client.1.smithi195.stdout:6/374: write d8/d21/d2b/d46/f83 [823794,107437] 0 2024-04-06T12:23:05.493 INFO:tasks.workunit.client.1.smithi195.stdout:6/375: dread d8/d21/d2b/d46/d4a/f5f [0,4194304] 0 2024-04-06T12:23:05.496 INFO:tasks.workunit.client.1.smithi195.stdout:6/376: rename d8/d21/d2b/l67 to d8/d21/d31/d6c/d7b/l90 0 2024-04-06T12:23:05.498 INFO:tasks.workunit.client.1.smithi195.stdout:6/377: mknod d8/d21/d2b/d46/d44/c91 0 2024-04-06T12:23:05.502 INFO:tasks.workunit.client.1.smithi195.stdout:6/378: creat d8/d21/d31/d6c/d7b/f92 x:0 0 0 2024-04-06T12:23:05.508 INFO:tasks.workunit.client.1.smithi195.stdout:6/379: unlink d8/d21/c7e 0 2024-04-06T12:23:05.509 INFO:tasks.workunit.client.1.smithi195.stdout:6/380: fdatasync d8/d50/f39 0 2024-04-06T12:23:05.516 INFO:tasks.workunit.client.1.smithi195.stdout:6/381: dread d8/d21/d2b/f62 [0,4194304] 0 2024-04-06T12:23:05.525 INFO:tasks.workunit.client.1.smithi195.stdout:7/272: sync 2024-04-06T12:23:05.538 INFO:tasks.workunit.client.1.smithi195.stdout:8/331: write d6/db/d23/d24/d25/d5e/f64 [1342576,38940] 0 2024-04-06T12:23:05.539 INFO:tasks.workunit.client.1.smithi195.stdout:7/273: dread - d4/d24/f49 zero size 2024-04-06T12:23:05.541 INFO:tasks.workunit.client.1.smithi195.stdout:1/350: write d4/d14/d17/f10 [113088,30736] 0 2024-04-06T12:23:05.541 INFO:tasks.workunit.client.1.smithi195.stdout:8/332: mknod d6/d8/d12/c6e 0 2024-04-06T12:23:05.542 INFO:tasks.workunit.client.1.smithi195.stdout:7/274: write f0 [2234715,58994] 0 2024-04-06T12:23:05.545 INFO:tasks.workunit.client.1.smithi195.stdout:8/333: stat d6/ca 0 2024-04-06T12:23:05.545 INFO:tasks.workunit.client.1.smithi195.stdout:6/382: mknod d8/d21/d31/d6c/d7b/c93 0 2024-04-06T12:23:05.547 INFO:tasks.workunit.client.1.smithi195.stdout:1/351: creat d4/d14/d19/d4e/d57/f66 x:0 0 0 2024-04-06T12:23:05.547 INFO:tasks.workunit.client.1.smithi195.stdout:5/303: dwrite d0/da/f21 [4194304,4194304] 0 2024-04-06T12:23:05.548 INFO:tasks.workunit.client.1.smithi195.stdout:8/334: creat d6/dd/d42/f6f x:0 0 0 2024-04-06T12:23:05.555 INFO:tasks.workunit.client.1.smithi195.stdout:5/304: dread d0/da/d13/f15 [0,4194304] 0 2024-04-06T12:23:05.558 INFO:tasks.workunit.client.1.smithi195.stdout:7/275: dwrite d4/d10/d12/f52 [0,4194304] 0 2024-04-06T12:23:05.558 INFO:tasks.workunit.client.1.smithi195.stdout:8/335: getdents d6/d8 0 2024-04-06T12:23:05.559 INFO:tasks.workunit.client.1.smithi195.stdout:5/305: dread - d0/da/d23/f3a zero size 2024-04-06T12:23:05.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/352: dwrite d4/d14/d17/f42 [4194304,4194304] 0 2024-04-06T12:23:05.562 INFO:tasks.workunit.client.1.smithi195.stdout:7/276: dread - d4/d10/d12/f39 zero size 2024-04-06T12:23:05.566 INFO:tasks.workunit.client.1.smithi195.stdout:5/306: creat d0/da/dd/d1c/d5a/d62/f76 x:0 0 0 2024-04-06T12:23:05.572 INFO:tasks.workunit.client.1.smithi195.stdout:8/336: rename d6/db/d23 to d6/dd/d70 0 2024-04-06T12:23:05.573 INFO:tasks.workunit.client.1.smithi195.stdout:7/277: dwrite d4/d10/f3c [0,4194304] 0 2024-04-06T12:23:05.574 INFO:tasks.workunit.client.1.smithi195.stdout:1/353: dwrite d4/d14/d19/d4e/f52 [0,4194304] 0 2024-04-06T12:23:05.583 INFO:tasks.workunit.client.1.smithi195.stdout:1/354: mknod d4/d14/d17/d24/c67 0 2024-04-06T12:23:05.584 INFO:tasks.workunit.client.1.smithi195.stdout:5/307: link d0/da/dd/l65 d0/da/l77 0 2024-04-06T12:23:05.586 INFO:tasks.workunit.client.1.smithi195.stdout:7/278: dwrite d4/d10/f40 [0,4194304] 0 2024-04-06T12:23:05.586 INFO:tasks.workunit.client.1.smithi195.stdout:5/308: readlink d0/l3e 0 2024-04-06T12:23:05.587 INFO:tasks.workunit.client.1.smithi195.stdout:5/309: readlink d0/da/d13/l19 0 2024-04-06T12:23:05.588 INFO:tasks.workunit.client.1.smithi195.stdout:5/310: fdatasync d0/d2c/f57 0 2024-04-06T12:23:05.590 INFO:tasks.workunit.client.1.smithi195.stdout:1/355: dread d4/d14/d19/d4e/f52 [0,4194304] 0 2024-04-06T12:23:05.591 INFO:tasks.workunit.client.1.smithi195.stdout:1/356: fsync d4/d14/d19/f5f 0 2024-04-06T12:23:05.591 INFO:tasks.workunit.client.1.smithi195.stdout:5/311: mkdir d0/da/dd/d2e/d6f/d58/d78 0 2024-04-06T12:23:05.593 INFO:tasks.workunit.client.1.smithi195.stdout:1/357: write d4/d14/f1f [1841417,8390] 0 2024-04-06T12:23:05.594 INFO:tasks.workunit.client.1.smithi195.stdout:7/279: link d4/d16/f1c d4/d10/d18/d33/f56 0 2024-04-06T12:23:05.598 INFO:tasks.workunit.client.1.smithi195.stdout:5/312: rename d0/da/dd/c25 to d0/da/dd/d1c/d5a/d62/d64/d67/c79 0 2024-04-06T12:23:05.601 INFO:tasks.workunit.client.1.smithi195.stdout:7/280: rmdir d4/d10/d12 39 2024-04-06T12:23:05.603 INFO:tasks.workunit.client.1.smithi195.stdout:1/358: creat d4/d14/d19/f68 x:0 0 0 2024-04-06T12:23:05.607 INFO:tasks.workunit.client.1.smithi195.stdout:5/313: mkdir d0/da/d23/d7a 0 2024-04-06T12:23:05.611 INFO:tasks.workunit.client.1.smithi195.stdout:1/359: dwrite f1 [0,4194304] 0 2024-04-06T12:23:05.611 INFO:tasks.workunit.client.1.smithi195.stdout:5/314: write d0/da/dd/d2e/f4c [166933,119275] 0 2024-04-06T12:23:05.611 INFO:tasks.workunit.client.1.smithi195.stdout:5/315: dread - d0/d35/f6b zero size 2024-04-06T12:23:05.617 INFO:tasks.workunit.client.1.smithi195.stdout:7/281: unlink d4/d10/d12/f52 0 2024-04-06T12:23:05.618 INFO:tasks.workunit.client.1.smithi195.stdout:7/282: write d4/d16/f2d [893844,829] 0 2024-04-06T12:23:05.621 INFO:tasks.workunit.client.1.smithi195.stdout:1/360: dread d4/d14/f1f [4194304,4194304] 0 2024-04-06T12:23:05.621 INFO:tasks.workunit.client.1.smithi195.stdout:5/316: symlink d0/d2c/l7b 0 2024-04-06T12:23:05.622 INFO:tasks.workunit.client.1.smithi195.stdout:7/283: mkdir d4/d10/d18/d57 0 2024-04-06T12:23:05.624 INFO:tasks.workunit.client.1.smithi195.stdout:5/317: creat d0/da/dd/d33/f7c x:0 0 0 2024-04-06T12:23:05.625 INFO:tasks.workunit.client.1.smithi195.stdout:7/284: rename d4/d24/f32 to d4/d16/dd/d22/f58 0 2024-04-06T12:23:05.627 INFO:tasks.workunit.client.1.smithi195.stdout:5/318: unlink d0/f63 0 2024-04-06T12:23:05.627 INFO:tasks.workunit.client.1.smithi195.stdout:5/319: chown d0/da/dd/d1c/d5a 98647 1 2024-04-06T12:23:05.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/320: fdatasync d0/da/d13/f1f 0 2024-04-06T12:23:05.629 INFO:tasks.workunit.client.1.smithi195.stdout:5/321: write d0/f30 [2752964,106986] 0 2024-04-06T12:23:05.632 INFO:tasks.workunit.client.1.smithi195.stdout:5/322: unlink d0/da/d13/l47 0 2024-04-06T12:23:05.632 INFO:tasks.workunit.client.1.smithi195.stdout:5/323: stat d0/d35/c55 0 2024-04-06T12:23:05.633 INFO:tasks.workunit.client.1.smithi195.stdout:7/285: link d4/d16/dd/f28 d4/d16/d11/f59 0 2024-04-06T12:23:05.635 INFO:tasks.workunit.client.1.smithi195.stdout:2/334: sync 2024-04-06T12:23:05.635 INFO:tasks.workunit.client.1.smithi195.stdout:3/374: sync 2024-04-06T12:23:05.636 INFO:tasks.workunit.client.1.smithi195.stdout:5/324: dread d0/da/d4b/f69 [0,4194304] 0 2024-04-06T12:23:05.636 INFO:tasks.workunit.client.1.smithi195.stdout:3/375: write d4/f12 [461812,105241] 0 2024-04-06T12:23:05.636 INFO:tasks.workunit.client.1.smithi195.stdout:7/286: mkdir d4/d10/d18/d19/d5a 0 2024-04-06T12:23:05.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/325: dwrite d0/da/dd/d1c/f2d [0,4194304] 0 2024-04-06T12:23:05.648 INFO:tasks.workunit.client.1.smithi195.stdout:2/335: link d2/d14/f18 d2/f61 0 2024-04-06T12:23:05.648 INFO:tasks.workunit.client.1.smithi195.stdout:2/336: chown d2/f26 1 1 2024-04-06T12:23:05.649 INFO:tasks.workunit.client.1.smithi195.stdout:2/337: fsync d2/f55 0 2024-04-06T12:23:05.654 INFO:tasks.workunit.client.1.smithi195.stdout:5/326: fsync d0/da/f22 0 2024-04-06T12:23:05.655 INFO:tasks.workunit.client.1.smithi195.stdout:7/287: rmdir d4/d10/d18/d19/d5a 0 2024-04-06T12:23:05.656 INFO:tasks.workunit.client.1.smithi195.stdout:5/327: readlink d0/d2c/l7b 0 2024-04-06T12:23:05.656 INFO:tasks.workunit.client.1.smithi195.stdout:2/338: dwrite d2/d41/f49 [0,4194304] 0 2024-04-06T12:23:05.659 INFO:tasks.workunit.client.1.smithi195.stdout:7/288: read d4/d16/f1b [8286862,14869] 0 2024-04-06T12:23:05.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/328: write d0/d2c/f57 [1097082,20680] 0 2024-04-06T12:23:05.665 INFO:tasks.workunit.client.1.smithi195.stdout:7/289: fsync d4/d10/f3c 0 2024-04-06T12:23:05.666 INFO:tasks.workunit.client.1.smithi195.stdout:3/376: dwrite d4/d9/d2b/d3b/d40/f4a [0,4194304] 0 2024-04-06T12:23:05.668 INFO:tasks.workunit.client.1.smithi195.stdout:5/329: mkdir d0/da/d23/d38/d41/d7d 0 2024-04-06T12:23:05.669 INFO:tasks.workunit.client.1.smithi195.stdout:3/377: truncate d4/d9/d2b/d3b/f6b 760397 0 2024-04-06T12:23:05.671 INFO:tasks.workunit.client.1.smithi195.stdout:5/330: creat d0/d2c/d34/f7e x:0 0 0 2024-04-06T12:23:05.672 INFO:tasks.workunit.client.1.smithi195.stdout:7/290: fdatasync d4/d10/d12/f39 0 2024-04-06T12:23:05.674 INFO:tasks.workunit.client.1.smithi195.stdout:5/331: truncate d0/da/dd/d1c/d5a/d62/f43 1663452 0 2024-04-06T12:23:05.674 INFO:tasks.workunit.client.1.smithi195.stdout:3/378: mknod d4/d9/d52/c79 0 2024-04-06T12:23:05.675 INFO:tasks.workunit.client.1.smithi195.stdout:5/332: chown d0/da/d13/d5e/l71 56001 1 2024-04-06T12:23:05.680 INFO:tasks.workunit.client.1.smithi195.stdout:3/379: getdents d4/d53 0 2024-04-06T12:23:05.684 INFO:tasks.workunit.client.1.smithi195.stdout:5/333: dwrite d0/da/dd/d1c/f2d [4194304,4194304] 0 2024-04-06T12:23:05.686 INFO:tasks.workunit.client.1.smithi195.stdout:3/380: rmdir d4 39 2024-04-06T12:23:05.689 INFO:tasks.workunit.client.1.smithi195.stdout:7/291: dwrite d4/d10/d12/f39 [0,4194304] 0 2024-04-06T12:23:05.695 INFO:tasks.workunit.client.1.smithi195.stdout:7/292: symlink d4/d16/dd/d22/d3f/d54/l5b 0 2024-04-06T12:23:05.696 INFO:tasks.workunit.client.1.smithi195.stdout:5/334: dwrite d0/da/f22 [0,4194304] 0 2024-04-06T12:23:05.698 INFO:tasks.workunit.client.1.smithi195.stdout:7/293: dread - d4/d24/f1f zero size 2024-04-06T12:23:05.701 INFO:tasks.workunit.client.1.smithi195.stdout:3/381: dwrite d4/d9/f1e [0,4194304] 0 2024-04-06T12:23:05.704 INFO:tasks.workunit.client.1.smithi195.stdout:3/382: read d4/d9/fa [2427358,68807] 0 2024-04-06T12:23:05.706 INFO:tasks.workunit.client.1.smithi195.stdout:7/294: mkdir d4/d16/dd/d22/d3f/d54/d5c 0 2024-04-06T12:23:05.709 INFO:tasks.workunit.client.1.smithi195.stdout:2/339: dread d2/d21/d2c/f32 [0,4194304] 0 2024-04-06T12:23:05.714 INFO:tasks.workunit.client.1.smithi195.stdout:2/340: creat d2/d14/d53/f62 x:0 0 0 2024-04-06T12:23:05.715 INFO:tasks.workunit.client.1.smithi195.stdout:3/383: getdents d4/df/d39 0 2024-04-06T12:23:05.716 INFO:tasks.workunit.client.1.smithi195.stdout:5/335: dwrite d0/da/dd/d2e/d6f/f4f [0,4194304] 0 2024-04-06T12:23:05.717 INFO:tasks.workunit.client.1.smithi195.stdout:7/295: rename d4/d10/d12/d37 to d4/d5d 0 2024-04-06T12:23:05.725 INFO:tasks.workunit.client.1.smithi195.stdout:7/296: creat d4/d10/d18/d19/f5e x:0 0 0 2024-04-06T12:23:05.728 INFO:tasks.workunit.client.1.smithi195.stdout:5/336: dread d0/da/f22 [0,4194304] 0 2024-04-06T12:23:05.728 INFO:tasks.workunit.client.1.smithi195.stdout:3/384: dwrite d4/d53/f61 [0,4194304] 0 2024-04-06T12:23:05.731 INFO:tasks.workunit.client.1.smithi195.stdout:2/341: dwrite d2/d14/d53/f58 [0,4194304] 0 2024-04-06T12:23:05.731 INFO:tasks.workunit.client.1.smithi195.stdout:7/297: creat d4/d16/dd/d22/d3f/d54/f5f x:0 0 0 2024-04-06T12:23:05.739 INFO:tasks.workunit.client.1.smithi195.stdout:4/320: sync 2024-04-06T12:23:05.743 INFO:tasks.workunit.client.1.smithi195.stdout:3/385: rmdir d4/d9/d52/d70 0 2024-04-06T12:23:05.743 INFO:tasks.workunit.client.1.smithi195.stdout:5/337: getdents d0/da/d23/d38 0 2024-04-06T12:23:05.747 INFO:tasks.workunit.client.1.smithi195.stdout:7/298: rmdir d4/d16/dd/d22/d3f/d54/d5c 0 2024-04-06T12:23:05.748 INFO:tasks.workunit.client.1.smithi195.stdout:2/342: dwrite d2/d14/f31 [0,4194304] 0 2024-04-06T12:23:05.749 INFO:tasks.workunit.client.1.smithi195.stdout:2/343: stat d2/d21/d2c/f32 0 2024-04-06T12:23:05.750 INFO:tasks.workunit.client.1.smithi195.stdout:3/386: truncate d4/d9/d2b/d3b/f4c 4885966 0 2024-04-06T12:23:05.758 INFO:tasks.workunit.client.1.smithi195.stdout:5/338: dwrite d0/da/d4b/f6a [0,4194304] 0 2024-04-06T12:23:05.760 INFO:tasks.workunit.client.1.smithi195.stdout:5/339: fdatasync d0/d35/f6b 0 2024-04-06T12:23:05.760 INFO:tasks.workunit.client.1.smithi195.stdout:2/344: dread d2/d41/f49 [0,4194304] 0 2024-04-06T12:23:05.763 INFO:tasks.workunit.client.1.smithi195.stdout:5/340: fsync d0/f3 0 2024-04-06T12:23:05.764 INFO:tasks.workunit.client.1.smithi195.stdout:5/341: chown d0/da/dd/d1c/d5a/d62/d64 358110638 1 2024-04-06T12:23:05.766 INFO:tasks.workunit.client.1.smithi195.stdout:5/342: rmdir d0/da/dd/d2e/d6f/d58 39 2024-04-06T12:23:05.771 INFO:tasks.workunit.client.1.smithi195.stdout:4/321: dwrite d4/d6/d38/d1a/d40/fe [0,4194304] 0 2024-04-06T12:23:05.773 INFO:tasks.workunit.client.1.smithi195.stdout:3/387: dwrite d4/de/f46 [0,4194304] 0 2024-04-06T12:23:05.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:04.197401+0000 mgr.smithi195.ausetj (mgr.24375) 51 : audit [DBG] from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:05.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:05 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:04.735800+0000 mon.smithi152 (mon.0) 695 : audit [DBG] from='client.? 172.21.15.152:0/3538795745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:23:05.779 INFO:tasks.workunit.client.1.smithi195.stdout:4/322: write d4/f4e [4982056,81310] 0 2024-04-06T12:23:05.779 INFO:tasks.workunit.client.1.smithi195.stdout:3/388: write d4/d9/d2b/d3b/f76 [3053096,123852] 0 2024-04-06T12:23:05.779 INFO:tasks.workunit.client.1.smithi195.stdout:3/389: symlink d4/d9/d2b/d3b/d5e/l7a 0 2024-04-06T12:23:05.782 INFO:tasks.workunit.client.1.smithi195.stdout:4/323: truncate d4/d6/d38/d1a/d40/f15 3005158 0 2024-04-06T12:23:05.785 INFO:tasks.workunit.client.1.smithi195.stdout:4/324: creat d4/f62 x:0 0 0 2024-04-06T12:23:05.788 INFO:tasks.workunit.client.1.smithi195.stdout:4/325: chown d4/d6/d38/d1a/f24 53193795 1 2024-04-06T12:23:05.789 INFO:tasks.workunit.client.1.smithi195.stdout:3/390: dwrite d4/d9/d2b/f6a [0,4194304] 0 2024-04-06T12:23:05.792 INFO:tasks.workunit.client.1.smithi195.stdout:3/391: fdatasync d4/d9/fd 0 2024-04-06T12:23:05.798 INFO:tasks.workunit.client.1.smithi195.stdout:4/326: getdents d4/d6/d38/d1a/d40/d20 0 2024-04-06T12:23:05.800 INFO:tasks.workunit.client.1.smithi195.stdout:3/392: dwrite d4/d9/f21 [0,4194304] 0 2024-04-06T12:23:05.804 INFO:tasks.workunit.client.1.smithi195.stdout:5/343: dread d0/f3 [0,4194304] 0 2024-04-06T12:23:05.805 INFO:tasks.workunit.client.1.smithi195.stdout:4/327: link d4/d6/d38/d1a/d40/f32 d4/d6/d38/d1a/d40/d20/d23/f63 0 2024-04-06T12:23:05.807 INFO:tasks.workunit.client.1.smithi195.stdout:4/328: chown d4/d6/f46 3944365 1 2024-04-06T12:23:05.811 INFO:tasks.workunit.client.1.smithi195.stdout:5/344: dwrite d0/d2c/f3f [0,4194304] 0 2024-04-06T12:23:05.811 INFO:tasks.workunit.client.1.smithi195.stdout:4/329: mkdir d4/d6/d38/d1a/d40/d57/d64 0 2024-04-06T12:23:05.818 INFO:tasks.workunit.client.1.smithi195.stdout:4/330: mkdir d4/d6/d38/d65 0 2024-04-06T12:23:05.819 INFO:tasks.workunit.client.1.smithi195.stdout:5/345: creat d0/da/d23/d7a/f7f x:0 0 0 2024-04-06T12:23:05.821 INFO:tasks.workunit.client.1.smithi195.stdout:5/346: mknod d0/da/dd/d2e/c80 0 2024-04-06T12:23:05.821 INFO:tasks.workunit.client.1.smithi195.stdout:4/331: mknod d4/d6/d38/d1a/c66 0 2024-04-06T12:23:05.825 INFO:tasks.workunit.client.1.smithi195.stdout:5/347: creat d0/da/dd/d2e/d6f/d58/d78/f81 x:0 0 0 2024-04-06T12:23:05.826 INFO:tasks.workunit.client.1.smithi195.stdout:5/348: mknod d0/da/d13/c82 0 2024-04-06T12:23:05.826 INFO:tasks.workunit.client.1.smithi195.stdout:3/393: fdatasync d4/f25 0 2024-04-06T12:23:05.827 INFO:tasks.workunit.client.1.smithi195.stdout:3/394: rmdir d4/df 39 2024-04-06T12:23:05.830 INFO:tasks.workunit.client.1.smithi195.stdout:5/349: link d0/da/dd/d2e/d6f/f75 d0/da/dd/d33/f83 0 2024-04-06T12:23:05.831 INFO:tasks.workunit.client.1.smithi195.stdout:4/332: getdents d4/d6/d38/d1a 0 2024-04-06T12:23:05.832 INFO:tasks.workunit.client.1.smithi195.stdout:5/350: read - d0/da/d23/d38/d41/f6e zero size 2024-04-06T12:23:05.832 INFO:tasks.workunit.client.1.smithi195.stdout:3/395: symlink d4/d9/d2b/d77/l7b 0 2024-04-06T12:23:05.833 INFO:tasks.workunit.client.1.smithi195.stdout:5/351: dread d0/da/d23/d38/f44 [0,4194304] 0 2024-04-06T12:23:05.834 INFO:tasks.workunit.client.1.smithi195.stdout:4/333: fsync d4/d6/d38/d1a/d40/f32 0 2024-04-06T12:23:05.834 INFO:tasks.workunit.client.1.smithi195.stdout:5/352: dread - d0/da/dd/d33/f53 zero size 2024-04-06T12:23:05.837 INFO:tasks.workunit.client.1.smithi195.stdout:0/331: sync 2024-04-06T12:23:05.837 INFO:tasks.workunit.client.1.smithi195.stdout:9/378: sync 2024-04-06T12:23:05.837 INFO:tasks.workunit.client.1.smithi195.stdout:4/334: unlink d4/d6/d38/d1a/f50 0 2024-04-06T12:23:05.838 INFO:tasks.workunit.client.1.smithi195.stdout:9/379: truncate d3/d10/d4f/f57 1850583 0 2024-04-06T12:23:05.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/353: symlink d0/da/dd/d2e/l84 0 2024-04-06T12:23:05.839 INFO:tasks.workunit.client.1.smithi195.stdout:4/335: read d4/f5 [4885048,19340] 0 2024-04-06T12:23:05.840 INFO:tasks.workunit.client.1.smithi195.stdout:0/332: creat d4/d6/d58/f70 x:0 0 0 2024-04-06T12:23:05.841 INFO:tasks.workunit.client.1.smithi195.stdout:0/333: truncate d4/d6/f8 4926394 0 2024-04-06T12:23:05.842 INFO:tasks.workunit.client.1.smithi195.stdout:9/380: symlink d3/de/d37/l87 0 2024-04-06T12:23:05.843 INFO:tasks.workunit.client.1.smithi195.stdout:9/381: chown d3/l71 2651 1 2024-04-06T12:23:05.844 INFO:tasks.workunit.client.1.smithi195.stdout:9/382: dread - d3/de/d37/f84 zero size 2024-04-06T12:23:05.845 INFO:tasks.workunit.client.1.smithi195.stdout:3/396: write d4/f24 [396350,35305] 0 2024-04-06T12:23:05.846 INFO:tasks.workunit.client.1.smithi195.stdout:0/334: creat d4/d41/f71 x:0 0 0 2024-04-06T12:23:05.847 INFO:tasks.workunit.client.1.smithi195.stdout:9/383: truncate d3/d10/d3b/d48/f4a 726544 0 2024-04-06T12:23:05.848 INFO:tasks.workunit.client.1.smithi195.stdout:9/384: write d3/d10/d3b/f55 [963009,55768] 0 2024-04-06T12:23:05.852 INFO:tasks.workunit.client.1.smithi195.stdout:0/335: creat d4/d6/d1a/f72 x:0 0 0 2024-04-06T12:23:05.852 INFO:tasks.workunit.client.1.smithi195.stdout:4/336: link d4/d6/d38/d1a/d40/d20/c42 d4/d6/d38/d65/c67 0 2024-04-06T12:23:05.853 INFO:tasks.workunit.client.1.smithi195.stdout:9/385: creat d3/d10/d3b/d48/d5e/f88 x:0 0 0 2024-04-06T12:23:05.854 INFO:tasks.workunit.client.1.smithi195.stdout:0/336: write d4/d41/f62 [180035,29034] 0 2024-04-06T12:23:05.854 INFO:tasks.workunit.client.1.smithi195.stdout:4/337: symlink d4/d6/d38/d65/l68 0 2024-04-06T12:23:05.855 INFO:tasks.workunit.client.1.smithi195.stdout:9/386: dread - d3/d10/d3b/d48/f49 zero size 2024-04-06T12:23:05.855 INFO:tasks.workunit.client.1.smithi195.stdout:5/354: dread d0/fe [0,4194304] 0 2024-04-06T12:23:05.857 INFO:tasks.workunit.client.1.smithi195.stdout:4/338: chown d4/d6/d38/d1a/d40/fe 15 1 2024-04-06T12:23:05.857 INFO:tasks.workunit.client.1.smithi195.stdout:5/355: read d0/f6 [2046695,92343] 0 2024-04-06T12:23:05.857 INFO:tasks.workunit.client.1.smithi195.stdout:0/337: unlink d4/d6/d1a/l2d 0 2024-04-06T12:23:05.858 INFO:tasks.workunit.client.1.smithi195.stdout:5/356: dread - d0/da/d23/d38/d41/f6e zero size 2024-04-06T12:23:05.865 INFO:tasks.workunit.client.1.smithi195.stdout:9/387: creat d3/d10/f89 x:0 0 0 2024-04-06T12:23:05.869 INFO:tasks.workunit.client.1.smithi195.stdout:5/357: creat d0/da/d23/d38/f85 x:0 0 0 2024-04-06T12:23:05.870 INFO:tasks.workunit.client.1.smithi195.stdout:5/358: write d0/d2c/f57 [1144874,6074] 0 2024-04-06T12:23:05.872 INFO:tasks.workunit.client.1.smithi195.stdout:0/338: rmdir d4 39 2024-04-06T12:23:05.873 INFO:tasks.workunit.client.1.smithi195.stdout:5/359: mknod d0/da/d23/d38/d41/c86 0 2024-04-06T12:23:05.874 INFO:tasks.workunit.client.1.smithi195.stdout:4/339: write d4/d6/d38/d1a/d40/d20/d23/f63 [2141409,40011] 0 2024-04-06T12:23:05.875 INFO:tasks.workunit.client.1.smithi195.stdout:9/388: rmdir d3/d10/d3b/d48/d7f 0 2024-04-06T12:23:05.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/389: readlink d3/l71 0 2024-04-06T12:23:05.876 INFO:tasks.workunit.client.1.smithi195.stdout:0/339: readlink d4/l39 0 2024-04-06T12:23:05.879 INFO:tasks.workunit.client.1.smithi195.stdout:0/340: read d4/d6/f42 [3818250,125132] 0 2024-04-06T12:23:05.884 INFO:tasks.workunit.client.1.smithi195.stdout:4/340: dwrite d4/d6/d38/f3f [4194304,4194304] 0 2024-04-06T12:23:05.884 INFO:tasks.workunit.client.1.smithi195.stdout:9/390: dwrite d3/d10/d3b/d50/f52 [0,4194304] 0 2024-04-06T12:23:05.886 INFO:tasks.workunit.client.1.smithi195.stdout:0/341: write d4/d48/d4e/f5b [150337,105300] 0 2024-04-06T12:23:05.887 INFO:tasks.workunit.client.1.smithi195.stdout:4/341: mknod d4/d6/c69 0 2024-04-06T12:23:05.890 INFO:tasks.workunit.client.1.smithi195.stdout:4/342: unlink d4/d6/l5f 0 2024-04-06T12:23:05.891 INFO:tasks.workunit.client.1.smithi195.stdout:4/343: chown d4/f12 0 1 2024-04-06T12:23:05.898 INFO:tasks.workunit.client.1.smithi195.stdout:0/342: dwrite d4/f5 [0,4194304] 0 2024-04-06T12:23:05.902 INFO:tasks.workunit.client.1.smithi195.stdout:0/343: mkdir d4/d6/d1a/d73 0 2024-04-06T12:23:05.905 INFO:tasks.workunit.client.1.smithi195.stdout:0/344: creat d4/d6/d1a/d73/f74 x:0 0 0 2024-04-06T12:23:05.911 INFO:tasks.workunit.client.1.smithi195.stdout:0/345: dwrite d4/d6/d1a/f54 [0,4194304] 0 2024-04-06T12:23:05.915 INFO:tasks.workunit.client.1.smithi195.stdout:0/346: mkdir d4/d48/d67/d75 0 2024-04-06T12:23:05.919 INFO:tasks.workunit.client.1.smithi195.stdout:0/347: rmdir d4/d6/d58 39 2024-04-06T12:23:05.924 INFO:tasks.workunit.client.1.smithi195.stdout:0/348: getdents d4/d6 0 2024-04-06T12:23:05.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/344: dread d4/d6/d38/f28 [0,4194304] 0 2024-04-06T12:23:05.924 INFO:tasks.workunit.client.1.smithi195.stdout:0/349: dread - d4/f3d zero size 2024-04-06T12:23:05.926 INFO:tasks.workunit.client.1.smithi195.stdout:4/345: symlink d4/l6a 0 2024-04-06T12:23:05.928 INFO:tasks.workunit.client.1.smithi195.stdout:4/346: read d4/d6/d38/d1a/d40/d20/d23/f31 [3188728,10771] 0 2024-04-06T12:23:05.928 INFO:tasks.workunit.client.1.smithi195.stdout:0/350: link d4/d6/c60 d4/d6/d1a/d73/c76 0 2024-04-06T12:23:05.928 INFO:tasks.workunit.client.1.smithi195.stdout:0/351: readlink d4/d6/d1a/l33 0 2024-04-06T12:23:05.929 INFO:tasks.workunit.client.1.smithi195.stdout:0/352: write d4/d6/d2f/f38 [100967,11533] 0 2024-04-06T12:23:05.929 INFO:tasks.workunit.client.1.smithi195.stdout:4/347: unlink d4/d6/f46 0 2024-04-06T12:23:05.930 INFO:tasks.workunit.client.1.smithi195.stdout:0/353: chown d4/d48/c5e 90518183 1 2024-04-06T12:23:05.932 INFO:tasks.workunit.client.1.smithi195.stdout:0/354: mkdir d4/d48/d77 0 2024-04-06T12:23:05.933 INFO:tasks.workunit.client.1.smithi195.stdout:0/355: truncate d4/d6/f6b 941270 0 2024-04-06T12:23:05.934 INFO:tasks.workunit.client.1.smithi195.stdout:4/348: link d4/d6/d38/l2b d4/d6/d38/d1a/d40/l6b 0 2024-04-06T12:23:05.935 INFO:tasks.workunit.client.1.smithi195.stdout:4/349: truncate d4/f4e 5578737 0 2024-04-06T12:23:05.935 INFO:tasks.workunit.client.1.smithi195.stdout:0/356: creat d4/d48/d67/d75/f78 x:0 0 0 2024-04-06T12:23:05.936 INFO:tasks.workunit.client.1.smithi195.stdout:0/357: chown d4/d48/d67/d75/f78 1014 1 2024-04-06T12:23:05.941 INFO:tasks.workunit.client.1.smithi195.stdout:0/358: dwrite d4/d65/f66 [0,4194304] 0 2024-04-06T12:23:05.941 INFO:tasks.workunit.client.1.smithi195.stdout:0/359: chown d4 0 1 2024-04-06T12:23:05.944 INFO:tasks.workunit.client.1.smithi195.stdout:0/360: symlink d4/d48/d67/l79 0 2024-04-06T12:23:05.948 INFO:tasks.workunit.client.1.smithi195.stdout:0/361: creat d4/d53/f7a x:0 0 0 2024-04-06T12:23:05.948 INFO:tasks.workunit.client.1.smithi195.stdout:0/362: chown d4/f61 2433818 1 2024-04-06T12:23:05.950 INFO:tasks.workunit.client.1.smithi195.stdout:0/363: mknod d4/d48/c7b 0 2024-04-06T12:23:05.951 INFO:tasks.workunit.client.1.smithi195.stdout:0/364: chown d4/d6/d2f/f38 53 1 2024-04-06T12:23:05.953 INFO:tasks.workunit.client.1.smithi195.stdout:0/365: symlink d4/d48/d77/l7c 0 2024-04-06T12:23:05.953 INFO:tasks.workunit.client.1.smithi195.stdout:0/366: truncate d4/f4d 1018014 0 2024-04-06T12:23:05.954 INFO:tasks.workunit.client.1.smithi195.stdout:0/367: dread - d4/d6/f5f zero size 2024-04-06T12:23:05.956 INFO:tasks.workunit.client.1.smithi195.stdout:0/368: creat d4/d48/d67/d75/f7d x:0 0 0 2024-04-06T12:23:05.959 INFO:tasks.workunit.client.1.smithi195.stdout:0/369: link d4/d6/d2f/d49/f52 d4/d48/d77/f7e 0 2024-04-06T12:23:05.960 INFO:tasks.workunit.client.1.smithi195.stdout:0/370: write d4/f64 [1018228,7769] 0 2024-04-06T12:23:05.968 INFO:tasks.workunit.client.1.smithi195.stdout:6/383: sync 2024-04-06T12:23:05.969 INFO:tasks.workunit.client.1.smithi195.stdout:6/384: write d8/d3d/f81 [371411,128595] 0 2024-04-06T12:23:05.974 INFO:tasks.workunit.client.1.smithi195.stdout:0/371: dread d4/fd [0,4194304] 0 2024-04-06T12:23:05.975 INFO:tasks.workunit.client.1.smithi195.stdout:6/385: dwrite d8/d21/d2b/d46/d2f/f53 [0,4194304] 0 2024-04-06T12:23:05.982 INFO:tasks.workunit.client.1.smithi195.stdout:0/372: dwrite d4/d48/f5a [0,4194304] 0 2024-04-06T12:23:05.990 INFO:tasks.workunit.client.1.smithi195.stdout:6/386: write d8/d21/d2b/d46/d44/f7d [3925700,72473] 0 2024-04-06T12:23:05.991 INFO:tasks.workunit.client.1.smithi195.stdout:0/373: getdents d4/d53 0 2024-04-06T12:23:05.995 INFO:tasks.workunit.client.1.smithi195.stdout:6/387: link d8/d21/d31/d6c/d7b/c87 d8/d3d/c94 0 2024-04-06T12:23:05.996 INFO:tasks.workunit.client.1.smithi195.stdout:0/374: link d4/d6/d2f/d49/l55 d4/d48/l7f 0 2024-04-06T12:23:05.997 INFO:tasks.workunit.client.1.smithi195.stdout:6/388: chown d8/ca 1541 1 2024-04-06T12:23:05.998 INFO:tasks.workunit.client.1.smithi195.stdout:0/375: chown d4/d48/l7f 4862158 1 2024-04-06T12:23:05.999 INFO:tasks.workunit.client.1.smithi195.stdout:6/389: symlink d8/d8e/l95 0 2024-04-06T12:23:05.999 INFO:tasks.workunit.client.1.smithi195.stdout:0/376: symlink d4/d6/l80 0 2024-04-06T12:23:06.005 INFO:tasks.workunit.client.1.smithi195.stdout:6/390: write d8/d21/d2b/d46/d4a/f5f [2286197,14355] 0 2024-04-06T12:23:06.006 INFO:tasks.workunit.client.1.smithi195.stdout:0/377: write d4/d6/d2f/f4a [7929972,45191] 0 2024-04-06T12:23:06.007 INFO:tasks.workunit.client.1.smithi195.stdout:0/378: dread - d4/f3d zero size 2024-04-06T12:23:06.009 INFO:tasks.workunit.client.1.smithi195.stdout:0/379: mkdir d4/d53/d81 0 2024-04-06T12:23:06.011 INFO:tasks.workunit.client.1.smithi195.stdout:6/391: truncate d8/d3d/f68 442022 0 2024-04-06T12:23:06.012 INFO:tasks.workunit.client.1.smithi195.stdout:6/392: chown d8/d50/d32/l3b 202643081 1 2024-04-06T12:23:06.014 INFO:tasks.workunit.client.1.smithi195.stdout:0/380: dread d4/d6/d1a/f37 [0,4194304] 0 2024-04-06T12:23:06.014 INFO:tasks.workunit.client.1.smithi195.stdout:6/393: symlink d8/d21/d31/d6c/d7b/l96 0 2024-04-06T12:23:06.018 INFO:tasks.workunit.client.1.smithi195.stdout:6/394: rename c4 to d8/d21/d2b/d46/d44/d86/c97 0 2024-04-06T12:23:06.019 INFO:tasks.workunit.client.1.smithi195.stdout:6/395: truncate f5 657792 0 2024-04-06T12:23:06.028 INFO:tasks.workunit.client.1.smithi195.stdout:6/396: truncate d8/f14 1694591 0 2024-04-06T12:23:06.037 INFO:tasks.workunit.client.1.smithi195.stdout:6/397: truncate d8/d21/d2b/d46/d44/f56 1943391 0 2024-04-06T12:23:06.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:04.197401+0000 mgr.smithi195.ausetj (mgr.24375) 51 : audit [DBG] from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:06.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:05 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:04.735800+0000 mon.smithi152 (mon.0) 695 : audit [DBG] from='client.? 172.21.15.152:0/3538795745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:23:06.074 INFO:tasks.workunit.client.1.smithi195.stdout:8/337: sync 2024-04-06T12:23:06.075 INFO:tasks.workunit.client.1.smithi195.stdout:1/361: sync 2024-04-06T12:23:06.075 INFO:tasks.workunit.client.1.smithi195.stdout:8/338: truncate d6/db/f60 354723 0 2024-04-06T12:23:06.078 INFO:tasks.workunit.client.1.smithi195.stdout:8/339: rename d6/dd/d70/d24/d25/d49/f65 to d6/d3a/d46/f71 0 2024-04-06T12:23:06.080 INFO:tasks.workunit.client.1.smithi195.stdout:8/340: mknod d6/dd/d70/d24/d25/d5e/c72 0 2024-04-06T12:23:06.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/341: dwrite d6/f31 [0,4194304] 0 2024-04-06T12:23:06.196 INFO:tasks.workunit.client.1.smithi195.stdout:4/350: sync 2024-04-06T12:23:06.197 INFO:tasks.workunit.client.1.smithi195.stdout:7/299: sync 2024-04-06T12:23:06.197 INFO:tasks.workunit.client.1.smithi195.stdout:5/360: sync 2024-04-06T12:23:06.197 INFO:tasks.workunit.client.1.smithi195.stdout:9/391: sync 2024-04-06T12:23:06.197 INFO:tasks.workunit.client.1.smithi195.stdout:2/345: sync 2024-04-06T12:23:06.197 INFO:tasks.workunit.client.1.smithi195.stdout:3/397: sync 2024-04-06T12:23:06.198 INFO:tasks.workunit.client.1.smithi195.stdout:3/398: stat d4/d9/d2b/d3b/c63 0 2024-04-06T12:23:06.199 INFO:tasks.workunit.client.1.smithi195.stdout:4/351: rmdir d4/d6/d38/d65 39 2024-04-06T12:23:06.199 INFO:tasks.workunit.client.1.smithi195.stdout:3/399: read - d4/d9/f49 zero size 2024-04-06T12:23:06.200 INFO:tasks.workunit.client.1.smithi195.stdout:9/392: write d3/d10/d3b/d48/d5e/f82 [441368,66746] 0 2024-04-06T12:23:06.202 INFO:tasks.workunit.client.1.smithi195.stdout:5/361: rename d0/d2c to d0/da/d13/d87 0 2024-04-06T12:23:06.203 INFO:tasks.workunit.client.1.smithi195.stdout:9/393: dread - d3/d10/d3b/d48/d5e/f88 zero size 2024-04-06T12:23:06.204 INFO:tasks.workunit.client.1.smithi195.stdout:3/400: symlink d4/d9/d2b/d77/l7c 0 2024-04-06T12:23:06.205 INFO:tasks.workunit.client.1.smithi195.stdout:4/352: write d4/d6/d38/d1a/d40/d20/d23/f31 [4084028,88810] 0 2024-04-06T12:23:06.206 INFO:tasks.workunit.client.1.smithi195.stdout:5/362: read d0/d35/f5f [486957,47248] 0 2024-04-06T12:23:06.209 INFO:tasks.workunit.client.1.smithi195.stdout:3/401: rmdir d4/df 39 2024-04-06T12:23:06.210 INFO:tasks.workunit.client.1.smithi195.stdout:9/394: getdents d3/d10/d7d 0 2024-04-06T12:23:06.211 INFO:tasks.workunit.client.1.smithi195.stdout:7/300: dwrite d4/d10/d18/d19/f5e [0,4194304] 0 2024-04-06T12:23:06.212 INFO:tasks.workunit.client.1.smithi195.stdout:2/346: dwrite d2/d41/d51/f54 [4194304,4194304] 0 2024-04-06T12:23:06.213 INFO:tasks.workunit.client.1.smithi195.stdout:7/301: chown d4/d10/d18 211118796 1 2024-04-06T12:23:06.214 INFO:tasks.workunit.client.1.smithi195.stdout:3/402: chown d4/d9/d2b/d3b/f76 0 1 2024-04-06T12:23:06.216 INFO:tasks.workunit.client.1.smithi195.stdout:9/395: creat d3/d10/d3b/d50/f8a x:0 0 0 2024-04-06T12:23:06.217 INFO:tasks.workunit.client.1.smithi195.stdout:2/347: creat d2/d14/d53/f63 x:0 0 0 2024-04-06T12:23:06.219 INFO:tasks.workunit.client.1.smithi195.stdout:9/396: chown d3/de/d37/f7e 21377924 1 2024-04-06T12:23:06.220 INFO:tasks.workunit.client.1.smithi195.stdout:4/353: rename d4/d6/d38/d1a/d40/fe to d4/d6/d38/d1a/f6c 0 2024-04-06T12:23:06.221 INFO:tasks.workunit.client.1.smithi195.stdout:5/363: dwrite d0/da/dd/d1c/f20 [0,4194304] 0 2024-04-06T12:23:06.221 INFO:tasks.workunit.client.1.smithi195.stdout:9/397: fsync d3/de/d37/f38 0 2024-04-06T12:23:06.221 INFO:tasks.workunit.client.1.smithi195.stdout:3/403: readlink d4/l17 0 2024-04-06T12:23:06.222 INFO:tasks.workunit.client.1.smithi195.stdout:7/302: creat d4/d5d/f60 x:0 0 0 2024-04-06T12:23:06.223 INFO:tasks.workunit.client.1.smithi195.stdout:3/404: write d4/d9/f1e [180227,59408] 0 2024-04-06T12:23:06.225 INFO:tasks.workunit.client.1.smithi195.stdout:5/364: rmdir d0/da 39 2024-04-06T12:23:06.227 INFO:tasks.workunit.client.1.smithi195.stdout:9/398: symlink d3/d10/d4f/l8b 0 2024-04-06T12:23:06.228 INFO:tasks.workunit.client.1.smithi195.stdout:2/348: getdents d2/d41/d51/d5d 0 2024-04-06T12:23:06.229 INFO:tasks.workunit.client.1.smithi195.stdout:4/354: dwrite d4/d6/d38/f39 [0,4194304] 0 2024-04-06T12:23:06.230 INFO:tasks.workunit.client.1.smithi195.stdout:3/405: creat d4/d9/d37/f7d x:0 0 0 2024-04-06T12:23:06.232 INFO:tasks.workunit.client.1.smithi195.stdout:4/355: write d4/d6/d38/d1a/d40/d20/f53 [321875,124532] 0 2024-04-06T12:23:06.238 INFO:tasks.workunit.client.1.smithi195.stdout:2/349: truncate d2/f1c 3575612 0 2024-04-06T12:23:06.238 INFO:tasks.workunit.client.1.smithi195.stdout:3/406: dwrite d4/d9/d2b/d3b/d40/f4a [0,4194304] 0 2024-04-06T12:23:06.240 INFO:tasks.workunit.client.1.smithi195.stdout:9/399: link d3/d10/f2f d3/de/d37/f8c 0 2024-04-06T12:23:06.241 INFO:tasks.workunit.client.1.smithi195.stdout:5/365: dwrite d0/da/d13/d87/d34/f7e [0,4194304] 0 2024-04-06T12:23:06.242 INFO:tasks.workunit.client.1.smithi195.stdout:9/400: stat d3/de/l33 0 2024-04-06T12:23:06.242 INFO:tasks.workunit.client.1.smithi195.stdout:7/303: creat d4/d10/d12/f61 x:0 0 0 2024-04-06T12:23:06.243 INFO:tasks.workunit.client.1.smithi195.stdout:5/366: write d0/da/dd/d1c/d5a/d62/f43 [1431667,8704] 0 2024-04-06T12:23:06.245 INFO:tasks.workunit.client.1.smithi195.stdout:3/407: mkdir d4/d9/d2b/d3b/d5e/d7e 0 2024-04-06T12:23:06.246 INFO:tasks.workunit.client.1.smithi195.stdout:3/408: write d4/f24 [2564690,47882] 0 2024-04-06T12:23:06.246 INFO:tasks.workunit.client.1.smithi195.stdout:2/350: mkdir d2/d21/d5e/d64 0 2024-04-06T12:23:06.248 INFO:tasks.workunit.client.1.smithi195.stdout:9/401: creat d3/d10/d3b/d50/f8d x:0 0 0 2024-04-06T12:23:06.250 INFO:tasks.workunit.client.1.smithi195.stdout:9/402: chown d3/d10/d3b/d48/f69 0 1 2024-04-06T12:23:06.250 INFO:tasks.workunit.client.1.smithi195.stdout:3/409: chown d4/d9/d2b/d3b/d5e/l75 13146703 1 2024-04-06T12:23:06.253 INFO:tasks.workunit.client.1.smithi195.stdout:7/304: unlink d4/d10/d18/d19/f3d 0 2024-04-06T12:23:06.254 INFO:tasks.workunit.client.1.smithi195.stdout:2/351: rmdir d2/d21/d2c 39 2024-04-06T12:23:06.254 INFO:tasks.workunit.client.1.smithi195.stdout:0/381: sync 2024-04-06T12:23:06.254 INFO:tasks.workunit.client.1.smithi195.stdout:9/403: unlink d3/d10/d3a/f6a 0 2024-04-06T12:23:06.257 INFO:tasks.workunit.client.1.smithi195.stdout:9/404: write d3/d10/d3b/d48/d5e/f88 [61527,31746] 0 2024-04-06T12:23:06.259 INFO:tasks.workunit.client.1.smithi195.stdout:7/305: mknod d4/d10/d18/d19/c62 0 2024-04-06T12:23:06.259 INFO:tasks.workunit.client.1.smithi195.stdout:2/352: rmdir d2/d41/d51 39 2024-04-06T12:23:06.261 INFO:tasks.workunit.client.1.smithi195.stdout:3/410: creat d4/d9/d2b/d3b/d5e/d7e/f7f x:0 0 0 2024-04-06T12:23:06.262 INFO:tasks.workunit.client.1.smithi195.stdout:0/382: rename d4/d6/d2f/f38 to d4/d6/d2f/d49/f82 0 2024-04-06T12:23:06.264 INFO:tasks.workunit.client.1.smithi195.stdout:7/306: mkdir d4/d10/d18/d19/d63 0 2024-04-06T12:23:06.264 INFO:tasks.workunit.client.1.smithi195.stdout:0/383: truncate d4/f31 1016827 0 2024-04-06T12:23:06.266 INFO:tasks.workunit.client.1.smithi195.stdout:9/405: dwrite d3/f2a [0,4194304] 0 2024-04-06T12:23:06.266 INFO:tasks.workunit.client.1.smithi195.stdout:2/353: creat d2/f65 x:0 0 0 2024-04-06T12:23:06.267 INFO:tasks.workunit.client.1.smithi195.stdout:3/411: mknod d4/d9/d2b/c80 0 2024-04-06T12:23:06.268 INFO:tasks.workunit.client.1.smithi195.stdout:2/354: write d2/d21/d29/f2b [858234,55104] 0 2024-04-06T12:23:06.269 INFO:tasks.workunit.client.1.smithi195.stdout:7/307: creat d4/d24/f64 x:0 0 0 2024-04-06T12:23:06.269 INFO:tasks.workunit.client.1.smithi195.stdout:0/384: mkdir d4/d48/d67/d83 0 2024-04-06T12:23:06.269 INFO:tasks.workunit.client.1.smithi195.stdout:3/412: write d4/d9/f18 [306081,119468] 0 2024-04-06T12:23:06.272 INFO:tasks.workunit.client.1.smithi195.stdout:9/406: rename d3/d10/d3b/d48/c72 to d3/de/d37/c8e 0 2024-04-06T12:23:06.272 INFO:tasks.workunit.client.1.smithi195.stdout:2/355: truncate d2/d3f/f60 526553 0 2024-04-06T12:23:06.277 INFO:tasks.workunit.client.1.smithi195.stdout:2/356: stat d2/d41/d51/f3d 0 2024-04-06T12:23:06.277 INFO:tasks.workunit.client.1.smithi195.stdout:9/407: creat d3/d10/d3a/f8f x:0 0 0 2024-04-06T12:23:06.279 INFO:tasks.workunit.client.1.smithi195.stdout:3/413: link d4/d9/d2b/d3b/d40/f56 d4/d9/d2b/f81 0 2024-04-06T12:23:06.281 INFO:tasks.workunit.client.1.smithi195.stdout:0/385: dwrite d4/d6/d1a/f72 [0,4194304] 0 2024-04-06T12:23:06.287 INFO:tasks.workunit.client.1.smithi195.stdout:0/386: unlink d4/d48/f6c 0 2024-04-06T12:23:06.291 INFO:tasks.workunit.client.1.smithi195.stdout:3/414: creat d4/df/d39/f82 x:0 0 0 2024-04-06T12:23:06.295 INFO:tasks.workunit.client.1.smithi195.stdout:2/357: dread d2/d21/f39 [0,4194304] 0 2024-04-06T12:23:06.296 INFO:tasks.workunit.client.1.smithi195.stdout:0/387: dwrite d4/d48/d4e/f5b [0,4194304] 0 2024-04-06T12:23:06.296 INFO:tasks.workunit.client.1.smithi195.stdout:0/388: stat d4/d48/f5a 0 2024-04-06T12:23:06.305 INFO:tasks.workunit.client.1.smithi195.stdout:0/389: write d4/d6/d1a/f37 [1230342,50719] 0 2024-04-06T12:23:06.309 INFO:tasks.workunit.client.1.smithi195.stdout:7/308: write d4/d10/d12/f2e [89542,96953] 0 2024-04-06T12:23:06.310 INFO:tasks.workunit.client.1.smithi195.stdout:5/367: dwrite d0/f3 [0,4194304] 0 2024-04-06T12:23:06.318 INFO:tasks.workunit.client.1.smithi195.stdout:5/368: rename d0/da/d23/d38/d41/f6e to d0/da/d23/d38/f88 0 2024-04-06T12:23:06.319 INFO:tasks.workunit.client.1.smithi195.stdout:7/309: dwrite d4/d24/f64 [0,4194304] 0 2024-04-06T12:23:06.322 INFO:tasks.workunit.client.1.smithi195.stdout:9/408: dread d3/d10/f35 [0,4194304] 0 2024-04-06T12:23:06.324 INFO:tasks.workunit.client.1.smithi195.stdout:5/369: dread d0/fe [0,4194304] 0 2024-04-06T12:23:06.325 INFO:tasks.workunit.client.1.smithi195.stdout:5/370: chown d0 186 1 2024-04-06T12:23:06.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/415: truncate d4/df/d39/f47 3592164 0 2024-04-06T12:23:06.326 INFO:tasks.workunit.client.1.smithi195.stdout:5/371: readlink d0/l27 0 2024-04-06T12:23:06.326 INFO:tasks.workunit.client.1.smithi195.stdout:7/310: creat d4/d4a/f65 x:0 0 0 2024-04-06T12:23:06.326 INFO:tasks.workunit.client.1.smithi195.stdout:9/409: creat d3/d10/d3a/f90 x:0 0 0 2024-04-06T12:23:06.327 INFO:tasks.workunit.client.1.smithi195.stdout:3/416: read - d4/d53/f60 zero size 2024-04-06T12:23:06.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/410: stat d3/d10/d7d 0 2024-04-06T12:23:06.329 INFO:tasks.workunit.client.1.smithi195.stdout:0/390: truncate d4/f64 146585 0 2024-04-06T12:23:06.330 INFO:tasks.workunit.client.1.smithi195.stdout:6/398: sync 2024-04-06T12:23:06.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/342: sync 2024-04-06T12:23:06.330 INFO:tasks.workunit.client.1.smithi195.stdout:1/362: sync 2024-04-06T12:23:06.332 INFO:tasks.workunit.client.1.smithi195.stdout:9/411: fdatasync d3/d10/d3a/d6b/f7a 0 2024-04-06T12:23:06.332 INFO:tasks.workunit.client.1.smithi195.stdout:3/417: symlink d4/de/l83 0 2024-04-06T12:23:06.334 INFO:tasks.workunit.client.1.smithi195.stdout:8/343: unlink d6/c40 0 2024-04-06T12:23:06.335 INFO:tasks.workunit.client.1.smithi195.stdout:2/358: dwrite d2/f26 [0,4194304] 0 2024-04-06T12:23:06.336 INFO:tasks.workunit.client.1.smithi195.stdout:5/372: creat d0/da/dd/f89 x:0 0 0 2024-04-06T12:23:06.336 INFO:tasks.workunit.client.1.smithi195.stdout:0/391: truncate d4/d6/d2f/f3e 443786 0 2024-04-06T12:23:06.338 INFO:tasks.workunit.client.1.smithi195.stdout:6/399: mknod d8/d3d/d5e/c98 0 2024-04-06T12:23:06.338 INFO:tasks.workunit.client.1.smithi195.stdout:8/344: chown d6/d8/d12/l2d 5301878 1 2024-04-06T12:23:06.338 INFO:tasks.workunit.client.1.smithi195.stdout:2/359: dread - d2/d14/f4e zero size 2024-04-06T12:23:06.339 INFO:tasks.workunit.client.1.smithi195.stdout:5/373: readlink d0/da/d13/d87/l7b 0 2024-04-06T12:23:06.340 INFO:tasks.workunit.client.1.smithi195.stdout:7/311: dwrite d4/d10/f40 [0,4194304] 0 2024-04-06T12:23:06.341 INFO:tasks.workunit.client.1.smithi195.stdout:3/418: creat d4/de/f84 x:0 0 0 2024-04-06T12:23:06.344 INFO:tasks.workunit.client.1.smithi195.stdout:7/312: chown d4/d10/d18/l1d 11766110 1 2024-04-06T12:23:06.344 INFO:tasks.workunit.client.1.smithi195.stdout:3/419: chown d4/d9/d2b/d3b/d40/f4a 0 1 2024-04-06T12:23:06.345 INFO:tasks.workunit.client.1.smithi195.stdout:5/374: read d0/da/d13/d87/d34/f4d [714717,95554] 0 2024-04-06T12:23:06.346 INFO:tasks.workunit.client.1.smithi195.stdout:5/375: fdatasync d0/da/d23/f61 0 2024-04-06T12:23:06.347 INFO:tasks.workunit.client.1.smithi195.stdout:9/412: creat d3/de/d37/f91 x:0 0 0 2024-04-06T12:23:06.348 INFO:tasks.workunit.client.1.smithi195.stdout:0/392: readlink d4/d6/l16 0 2024-04-06T12:23:06.353 INFO:tasks.workunit.client.1.smithi195.stdout:1/363: symlink d4/d14/d19/d23/d28/d2f/l69 0 2024-04-06T12:23:06.355 INFO:tasks.workunit.client.1.smithi195.stdout:7/313: chown d4/la 399833 1 2024-04-06T12:23:06.356 INFO:tasks.workunit.client.1.smithi195.stdout:3/420: symlink d4/d9/d37/l85 0 2024-04-06T12:23:06.356 INFO:tasks.workunit.client.1.smithi195.stdout:0/393: dwrite d4/d6/d1a/d73/f74 [0,4194304] 0 2024-04-06T12:23:06.356 INFO:tasks.workunit.client.1.smithi195.stdout:2/360: read d2/f1c [470886,116205] 0 2024-04-06T12:23:06.357 INFO:tasks.workunit.client.1.smithi195.stdout:3/421: dread - d4/d9/d2b/f42 zero size 2024-04-06T12:23:06.358 INFO:tasks.workunit.client.1.smithi195.stdout:5/376: creat d0/da/dd/d1c/d5a/d62/d64/f8a x:0 0 0 2024-04-06T12:23:06.363 INFO:tasks.workunit.client.1.smithi195.stdout:3/422: dread d4/f12 [0,4194304] 0 2024-04-06T12:23:06.363 INFO:tasks.workunit.client.1.smithi195.stdout:1/364: rmdir d4/d14/d17/d24/d2a/d45 39 2024-04-06T12:23:06.363 INFO:tasks.workunit.client.1.smithi195.stdout:4/356: sync 2024-04-06T12:23:06.364 INFO:tasks.workunit.client.1.smithi195.stdout:3/423: chown d4/d9/f21 4140 1 2024-04-06T12:23:06.368 INFO:tasks.workunit.client.1.smithi195.stdout:0/394: mkdir d4/d48/d67/d75/d84 0 2024-04-06T12:23:06.370 INFO:tasks.workunit.client.1.smithi195.stdout:8/345: dread d6/dd/d70/d24/d34/d67/f6c [0,4194304] 0 2024-04-06T12:23:06.371 INFO:tasks.workunit.client.1.smithi195.stdout:9/413: truncate d3/d10/f2f 497491 0 2024-04-06T12:23:06.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/365: read d4/d14/f18 [2376712,8784] 0 2024-04-06T12:23:06.374 INFO:tasks.workunit.client.1.smithi195.stdout:2/361: symlink d2/d41/l66 0 2024-04-06T12:23:06.375 INFO:tasks.workunit.client.1.smithi195.stdout:6/400: getdents d8/d3d/d5e/d72 0 2024-04-06T12:23:06.379 INFO:tasks.workunit.client.1.smithi195.stdout:0/395: fdatasync d4/d6/d2f/d49/f82 0 2024-04-06T12:23:06.379 INFO:tasks.workunit.client.1.smithi195.stdout:5/377: getdents d0/da/d23/d38/d41/d7d 0 2024-04-06T12:23:06.380 INFO:tasks.workunit.client.1.smithi195.stdout:6/401: truncate d8/d50/f6a 1568549 0 2024-04-06T12:23:06.381 INFO:tasks.workunit.client.1.smithi195.stdout:1/366: write d4/d14/f1f [3289972,35938] 0 2024-04-06T12:23:06.383 INFO:tasks.workunit.client.1.smithi195.stdout:8/346: creat d6/db/d47/d4b/f73 x:0 0 0 2024-04-06T12:23:06.384 INFO:tasks.workunit.client.1.smithi195.stdout:8/347: stat d6/dd/d42 0 2024-04-06T12:23:06.385 INFO:tasks.workunit.client.1.smithi195.stdout:7/314: write d4/d16/dd/d22/f2b [8861476,44008] 0 2024-04-06T12:23:06.390 INFO:tasks.workunit.client.1.smithi195.stdout:6/402: dwrite d8/d3d/f81 [0,4194304] 0 2024-04-06T12:23:06.391 INFO:tasks.workunit.client.1.smithi195.stdout:5/378: dwrite d0/da/d4b/f6a [4194304,4194304] 0 2024-04-06T12:23:06.395 INFO:tasks.workunit.client.1.smithi195.stdout:3/424: getdents d4/de 0 2024-04-06T12:23:06.396 INFO:tasks.workunit.client.1.smithi195.stdout:0/396: link d4/f4d d4/d48/d77/f85 0 2024-04-06T12:23:06.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/367: mknod d4/d14/d17/d24/d2a/d45/c6a 0 2024-04-06T12:23:06.408 INFO:tasks.workunit.client.1.smithi195.stdout:9/414: getdents d3/d10/d3a/d5d 0 2024-04-06T12:23:06.408 INFO:tasks.workunit.client.1.smithi195.stdout:6/403: mknod d8/d21/d2b/d46/d4a/d4e/c99 0 2024-04-06T12:23:06.408 INFO:tasks.workunit.client.1.smithi195.stdout:0/397: creat d4/d6/d1a/f86 x:0 0 0 2024-04-06T12:23:06.409 INFO:tasks.workunit.client.1.smithi195.stdout:2/362: link d2/d21/l2f d2/d21/l67 0 2024-04-06T12:23:06.409 INFO:tasks.workunit.client.1.smithi195.stdout:6/404: chown d8/ca 330973 1 2024-04-06T12:23:06.410 INFO:tasks.workunit.client.1.smithi195.stdout:5/379: creat d0/da/d13/d87/d37/f8b x:0 0 0 2024-04-06T12:23:06.411 INFO:tasks.workunit.client.1.smithi195.stdout:9/415: creat d3/d10/d3a/f92 x:0 0 0 2024-04-06T12:23:06.415 INFO:tasks.workunit.client.1.smithi195.stdout:5/380: rmdir d0/da/dd/d33 39 2024-04-06T12:23:06.416 INFO:tasks.workunit.client.1.smithi195.stdout:5/381: fsync d0/da/d23/d38/f85 0 2024-04-06T12:23:06.417 INFO:tasks.workunit.client.1.smithi195.stdout:0/398: truncate d4/d48/d77/f7e 870049 0 2024-04-06T12:23:06.420 INFO:tasks.workunit.client.1.smithi195.stdout:9/416: dread d3/de/f58 [0,4194304] 0 2024-04-06T12:23:06.420 INFO:tasks.workunit.client.1.smithi195.stdout:2/363: fsync d2/f4 0 2024-04-06T12:23:06.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/417: write d3/f24 [2235924,86997] 0 2024-04-06T12:23:06.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/368: link d4/d14/d19/f4d d4/d14/d17/d24/f6b 0 2024-04-06T12:23:06.424 INFO:tasks.workunit.client.1.smithi195.stdout:6/405: symlink d8/d3d/l9a 0 2024-04-06T12:23:06.424 INFO:tasks.workunit.client.1.smithi195.stdout:7/315: write d4/d5d/f3b [743177,81694] 0 2024-04-06T12:23:06.425 INFO:tasks.workunit.client.1.smithi195.stdout:9/418: dread d3/d10/d3b/d48/f69 [0,4194304] 0 2024-04-06T12:23:06.427 INFO:tasks.workunit.client.1.smithi195.stdout:1/369: read d4/d14/d17/f10 [87712,16647] 0 2024-04-06T12:23:06.427 INFO:tasks.workunit.client.1.smithi195.stdout:1/370: fdatasync d4/d14/d19/f20 0 2024-04-06T12:23:06.428 INFO:tasks.workunit.client.1.smithi195.stdout:0/399: creat d4/d53/f87 x:0 0 0 2024-04-06T12:23:06.428 INFO:tasks.workunit.client.1.smithi195.stdout:1/371: fsync d4/d14/d19/f4c 0 2024-04-06T12:23:06.429 INFO:tasks.workunit.client.1.smithi195.stdout:3/425: write d4/d9/d2b/f81 [4310194,13693] 0 2024-04-06T12:23:06.429 INFO:tasks.workunit.client.1.smithi195.stdout:1/372: stat d4/d14/d17/f10 0 2024-04-06T12:23:06.435 INFO:tasks.workunit.client.1.smithi195.stdout:2/364: rename d2/f35 to d2/d41/d51/f68 0 2024-04-06T12:23:06.438 INFO:tasks.workunit.client.1.smithi195.stdout:9/419: readlink d3/l4d 0 2024-04-06T12:23:06.442 INFO:tasks.workunit.client.1.smithi195.stdout:3/426: mkdir d4/df/d39/d86 0 2024-04-06T12:23:06.443 INFO:tasks.workunit.client.1.smithi195.stdout:1/373: chown d4/d14/d19/d23/c40 7443685 1 2024-04-06T12:23:06.444 INFO:tasks.workunit.client.1.smithi195.stdout:1/374: chown d4/d14/d19/d4e/f52 4 1 2024-04-06T12:23:06.447 INFO:tasks.workunit.client.1.smithi195.stdout:5/382: creat d0/da/d13/d87/f8c x:0 0 0 2024-04-06T12:23:06.448 INFO:tasks.workunit.client.1.smithi195.stdout:9/420: chown d3/l27 4 1 2024-04-06T12:23:06.449 INFO:tasks.workunit.client.1.smithi195.stdout:9/421: read d3/d10/d3b/f55 [834088,54662] 0 2024-04-06T12:23:06.450 INFO:tasks.workunit.client.1.smithi195.stdout:9/422: write d3/de/f85 [978143,5727] 0 2024-04-06T12:23:06.451 INFO:tasks.workunit.client.1.smithi195.stdout:0/400: creat d4/d53/d81/f88 x:0 0 0 2024-04-06T12:23:06.452 INFO:tasks.workunit.client.1.smithi195.stdout:0/401: readlink d4/d6/d2f/l50 0 2024-04-06T12:23:06.454 INFO:tasks.workunit.client.1.smithi195.stdout:7/316: link d4/d10/c46 d4/d10/d18/d33/c66 0 2024-04-06T12:23:06.456 INFO:tasks.workunit.client.1.smithi195.stdout:1/375: mknod d4/d14/d19/d4e/d60/c6c 0 2024-04-06T12:23:06.456 INFO:tasks.workunit.client.1.smithi195.stdout:0/402: dread d4/d6/d1a/d73/f74 [0,4194304] 0 2024-04-06T12:23:06.456 INFO:tasks.workunit.client.1.smithi195.stdout:2/365: write d2/f4 [504647,6064] 0 2024-04-06T12:23:06.458 INFO:tasks.workunit.client.1.smithi195.stdout:9/423: rename d3/de/d37/f7e to d3/d10/d3a/d5d/f93 0 2024-04-06T12:23:06.459 INFO:tasks.workunit.client.1.smithi195.stdout:1/376: write d4/f11 [7104835,110385] 0 2024-04-06T12:23:06.461 INFO:tasks.workunit.client.1.smithi195.stdout:6/406: truncate d8/d3d/f81 269742 0 2024-04-06T12:23:06.463 INFO:tasks.workunit.client.1.smithi195.stdout:6/407: chown d8/d21/d2b/f43 270176 1 2024-04-06T12:23:06.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/317: dwrite d4/d10/d12/f61 [0,4194304] 0 2024-04-06T12:23:06.464 INFO:tasks.workunit.client.1.smithi195.stdout:7/318: stat d4/d5d/f3b 0 2024-04-06T12:23:06.464 INFO:tasks.workunit.client.1.smithi195.stdout:6/408: dread - d8/d21/d2b/d46/d4a/d4e/f6e zero size 2024-04-06T12:23:06.465 INFO:tasks.workunit.client.1.smithi195.stdout:0/403: creat d4/d48/f89 x:0 0 0 2024-04-06T12:23:06.471 INFO:tasks.workunit.client.1.smithi195.stdout:4/357: sync 2024-04-06T12:23:06.472 INFO:tasks.workunit.client.1.smithi195.stdout:3/427: getdents d4/d9 0 2024-04-06T12:23:06.473 INFO:tasks.workunit.client.1.smithi195.stdout:3/428: dread - d4/d9/d2b/d3b/d40/f55 zero size 2024-04-06T12:23:06.475 INFO:tasks.workunit.client.1.smithi195.stdout:0/404: creat d4/d6/d2f/f8a x:0 0 0 2024-04-06T12:23:06.475 INFO:tasks.workunit.client.1.smithi195.stdout:3/429: read d4/d9/fa [2251059,98520] 0 2024-04-06T12:23:06.476 INFO:tasks.workunit.client.1.smithi195.stdout:9/424: symlink d3/d10/d7d/l94 0 2024-04-06T12:23:06.478 INFO:tasks.workunit.client.1.smithi195.stdout:7/319: mkdir d4/d67 0 2024-04-06T12:23:06.482 INFO:tasks.workunit.client.1.smithi195.stdout:3/430: rmdir d4/d9/d52 39 2024-04-06T12:23:06.483 INFO:tasks.workunit.client.1.smithi195.stdout:1/377: dwrite d4/d14/d19/f22 [4194304,4194304] 0 2024-04-06T12:23:06.483 INFO:tasks.workunit.client.1.smithi195.stdout:4/358: mkdir d4/d6d 0 2024-04-06T12:23:06.485 INFO:tasks.workunit.client.1.smithi195.stdout:2/366: dwrite d2/f1c [4194304,4194304] 0 2024-04-06T12:23:06.490 INFO:tasks.workunit.client.1.smithi195.stdout:0/405: creat d4/d6/d58/f8b x:0 0 0 2024-04-06T12:23:06.491 INFO:tasks.workunit.client.1.smithi195.stdout:3/431: rmdir d4 39 2024-04-06T12:23:06.492 INFO:tasks.workunit.client.1.smithi195.stdout:0/406: write d4/d6/d2f/d49/f82 [663418,34292] 0 2024-04-06T12:23:06.526 INFO:tasks.workunit.client.1.smithi195.stdout:4/359: creat d4/d6/d38/d1a/d40/d20/f6e x:0 0 0 2024-04-06T12:23:06.526 INFO:tasks.workunit.client.1.smithi195.stdout:1/378: dwrite d4/d14/d17/f42 [8388608,4194304] 0 2024-04-06T12:23:06.528 INFO:tasks.workunit.client.1.smithi195.stdout:9/425: truncate d3/d10/f11 2245763 0 2024-04-06T12:23:06.529 INFO:tasks.workunit.client.1.smithi195.stdout:1/379: symlink d4/d14/d19/l6d 0 2024-04-06T12:23:06.531 INFO:tasks.workunit.client.1.smithi195.stdout:1/380: chown d4/d14/d19/d4e/d60 27 1 2024-04-06T12:23:06.531 INFO:tasks.workunit.client.1.smithi195.stdout:2/367: rename d2/d14/d53 to d2/d21/d69 0 2024-04-06T12:23:06.534 INFO:tasks.workunit.client.1.smithi195.stdout:0/407: symlink d4/d48/d67/d75/d84/l8c 0 2024-04-06T12:23:06.535 INFO:tasks.workunit.client.1.smithi195.stdout:1/381: dread - d4/d14/d19/d23/d28/d2f/f3f zero size 2024-04-06T12:23:06.537 INFO:tasks.workunit.client.1.smithi195.stdout:0/408: truncate d4/f3d 215297 0 2024-04-06T12:23:06.538 INFO:tasks.workunit.client.1.smithi195.stdout:4/360: unlink d4/d6/d38/d1a/d40/d20/d23/l37 0 2024-04-06T12:23:06.539 INFO:tasks.workunit.client.1.smithi195.stdout:9/426: dwrite d3/d10/d3b/f77 [0,4194304] 0 2024-04-06T12:23:06.546 INFO:tasks.workunit.client.1.smithi195.stdout:0/409: read d4/d6/f6b [199702,39891] 0 2024-04-06T12:23:06.547 INFO:tasks.workunit.client.1.smithi195.stdout:4/361: symlink d4/d6/d38/d1a/d40/d57/l6f 0 2024-04-06T12:23:06.547 INFO:tasks.workunit.client.1.smithi195.stdout:7/320: dread d4/d16/dd/f2a [0,4194304] 0 2024-04-06T12:23:06.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/410: write d4/d53/f7a [983418,12649] 0 2024-04-06T12:23:06.548 INFO:tasks.workunit.client.1.smithi195.stdout:3/432: mkdir d4/d9/d2b/d87 0 2024-04-06T12:23:06.550 INFO:tasks.workunit.client.1.smithi195.stdout:3/433: read - d4/d9/d2b/d3b/d5e/d7e/f7f zero size 2024-04-06T12:23:06.551 INFO:tasks.workunit.client.1.smithi195.stdout:2/368: rename d2/c11 to d2/d41/c6a 0 2024-04-06T12:23:06.552 INFO:tasks.workunit.client.1.smithi195.stdout:9/427: rename d3 to d3/de/d37/d95 22 2024-04-06T12:23:06.552 INFO:tasks.workunit.client.1.smithi195.stdout:2/369: chown d2/d21/d5e/d64 690068 1 2024-04-06T12:23:06.553 INFO:tasks.workunit.client.1.smithi195.stdout:9/428: write d3/d10/f29 [468335,34021] 0 2024-04-06T12:23:06.553 INFO:tasks.workunit.client.1.smithi195.stdout:4/362: rmdir d4/d6/d38/d1a/d40/d20 39 2024-04-06T12:23:06.554 INFO:tasks.workunit.client.1.smithi195.stdout:1/382: dread d4/d14/d19/d4e/f61 [4194304,4194304] 0 2024-04-06T12:23:06.557 INFO:tasks.workunit.client.1.smithi195.stdout:2/370: write d2/d41/f49 [2104998,70248] 0 2024-04-06T12:23:06.558 INFO:tasks.workunit.client.1.smithi195.stdout:1/383: dread d4/d14/d17/d24/f43 [0,4194304] 0 2024-04-06T12:23:06.559 INFO:tasks.workunit.client.1.smithi195.stdout:1/384: stat d4/l36 0 2024-04-06T12:23:06.560 INFO:tasks.workunit.client.1.smithi195.stdout:7/321: link d4/d24/f1a d4/d16/dd/d22/d3f/f68 0 2024-04-06T12:23:06.561 INFO:tasks.workunit.client.1.smithi195.stdout:7/322: write d4/d10/d12/f39 [1025526,72866] 0 2024-04-06T12:23:06.562 INFO:tasks.workunit.client.1.smithi195.stdout:8/348: sync 2024-04-06T12:23:06.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/371: mkdir d2/d21/d69/d6b 0 2024-04-06T12:23:06.564 INFO:tasks.workunit.client.1.smithi195.stdout:2/372: stat d2/d3f/f60 0 2024-04-06T12:23:06.565 INFO:tasks.workunit.client.1.smithi195.stdout:1/385: unlink d4/d14/d19/d4e/f61 0 2024-04-06T12:23:06.570 INFO:tasks.workunit.client.1.smithi195.stdout:0/411: truncate d4/d65/f66 2812418 0 2024-04-06T12:23:06.570 INFO:tasks.workunit.client.1.smithi195.stdout:7/323: dread d4/d16/f1b [0,4194304] 0 2024-04-06T12:23:06.573 INFO:tasks.workunit.client.1.smithi195.stdout:8/349: symlink d6/dd/d70/d24/d25/d49/l74 0 2024-04-06T12:23:06.574 INFO:tasks.workunit.client.1.smithi195.stdout:8/350: read - d6/db/d47/d4b/f73 zero size 2024-04-06T12:23:06.578 INFO:tasks.workunit.client.1.smithi195.stdout:0/412: dwrite d4/d41/f69 [0,4194304] 0 2024-04-06T12:23:06.579 INFO:tasks.workunit.client.1.smithi195.stdout:9/429: getdents d3/d10/d3b/d50 0 2024-04-06T12:23:06.580 INFO:tasks.workunit.client.1.smithi195.stdout:2/373: dread d2/fe [0,4194304] 0 2024-04-06T12:23:06.580 INFO:tasks.workunit.client.1.smithi195.stdout:2/374: stat d2/d21/d69/f63 0 2024-04-06T12:23:06.587 INFO:tasks.workunit.client.1.smithi195.stdout:7/324: mknod d4/d10/d18/d19/d63/c69 0 2024-04-06T12:23:06.589 INFO:tasks.workunit.client.1.smithi195.stdout:0/413: creat d4/d65/f8d x:0 0 0 2024-04-06T12:23:06.589 INFO:tasks.workunit.client.1.smithi195.stdout:4/363: truncate d4/d6/d38/d1a/d40/d20/d23/f63 1456724 0 2024-04-06T12:23:06.591 INFO:tasks.workunit.client.1.smithi195.stdout:9/430: fdatasync d3/d10/d3b/f55 0 2024-04-06T12:23:06.592 INFO:tasks.workunit.client.1.smithi195.stdout:2/375: chown d2/d21/d2c/d2d/f57 792363 1 2024-04-06T12:23:06.593 INFO:tasks.workunit.client.1.smithi195.stdout:2/376: readlink d2/d21/d2c/l37 0 2024-04-06T12:23:06.594 INFO:tasks.workunit.client.1.smithi195.stdout:8/351: write d6/d3a/d46/f63 [1123071,28802] 0 2024-04-06T12:23:06.594 INFO:tasks.workunit.client.1.smithi195.stdout:8/352: dread - d6/d8/f58 zero size 2024-04-06T12:23:06.597 INFO:tasks.workunit.client.1.smithi195.stdout:4/364: rmdir d4/d6/d38/d1a/d40/d57 39 2024-04-06T12:23:06.598 INFO:tasks.workunit.client.1.smithi195.stdout:4/365: truncate d4/d6/d38/f28 5039635 0 2024-04-06T12:23:06.603 INFO:tasks.workunit.client.1.smithi195.stdout:4/366: read d4/d6/d38/d1a/d40/d20/d23/f31 [3542794,122881] 0 2024-04-06T12:23:06.603 INFO:tasks.workunit.client.1.smithi195.stdout:8/353: symlink d6/dd/d70/d24/d25/d49/l75 0 2024-04-06T12:23:06.604 INFO:tasks.workunit.client.1.smithi195.stdout:7/325: rename d4/d16/dd/d22/f58 to d4/d16/f6a 0 2024-04-06T12:23:06.604 INFO:tasks.workunit.client.1.smithi195.stdout:8/354: readlink d6/l19 0 2024-04-06T12:23:06.615 INFO:tasks.workunit.client.1.smithi195.stdout:0/414: chown d4/d65/f66 23632125 1 2024-04-06T12:23:06.621 INFO:tasks.workunit.client.1.smithi195.stdout:2/377: truncate d2/d41/f49 2979930 0 2024-04-06T12:23:06.623 INFO:tasks.workunit.client.1.smithi195.stdout:8/355: fsync d6/f7 0 2024-04-06T12:23:06.629 INFO:tasks.workunit.client.1.smithi195.stdout:9/431: rename d3/l18 to d3/d10/d3b/d48/l96 0 2024-04-06T12:23:06.630 INFO:tasks.workunit.client.1.smithi195.stdout:9/432: write d3/de/d37/f75 [929421,80417] 0 2024-04-06T12:23:06.634 INFO:tasks.workunit.client.1.smithi195.stdout:7/326: mkdir d4/d16/d6b 0 2024-04-06T12:23:06.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/356: creat d6/dd/d70/d24/d34/d67/f76 x:0 0 0 2024-04-06T12:23:06.644 INFO:tasks.workunit.client.1.smithi195.stdout:2/378: creat d2/d21/d5e/d64/f6c x:0 0 0 2024-04-06T12:23:06.644 INFO:tasks.workunit.client.1.smithi195.stdout:2/379: stat d2/fe 0 2024-04-06T12:23:06.649 INFO:tasks.workunit.client.1.smithi195.stdout:5/383: sync 2024-04-06T12:23:06.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/415: rename d4/d6/l43 to d4/l8e 0 2024-04-06T12:23:06.651 INFO:tasks.workunit.client.1.smithi195.stdout:9/433: mknod d3/d10/d3b/c97 0 2024-04-06T12:23:06.660 INFO:tasks.workunit.client.1.smithi195.stdout:8/357: link d6/d8/d12/f37 d6/db/d47/f77 0 2024-04-06T12:23:06.662 INFO:tasks.workunit.client.1.smithi195.stdout:0/416: unlink d4/d41/f62 0 2024-04-06T12:23:06.664 INFO:tasks.workunit.client.1.smithi195.stdout:9/434: unlink d3/d10/f31 0 2024-04-06T12:23:06.669 INFO:tasks.workunit.client.1.smithi195.stdout:5/384: creat d0/da/d23/d38/d41/d7d/f8d x:0 0 0 2024-04-06T12:23:06.671 INFO:tasks.workunit.client.1.smithi195.stdout:4/367: dwrite d4/d6/d38/f51 [0,4194304] 0 2024-04-06T12:23:06.672 INFO:tasks.workunit.client.1.smithi195.stdout:6/409: sync 2024-04-06T12:23:06.672 INFO:tasks.workunit.client.1.smithi195.stdout:3/434: sync 2024-04-06T12:23:06.673 INFO:tasks.workunit.client.1.smithi195.stdout:9/435: rmdir d3/de 39 2024-04-06T12:23:06.674 INFO:tasks.workunit.client.1.smithi195.stdout:2/380: creat d2/f6d x:0 0 0 2024-04-06T12:23:06.679 INFO:tasks.workunit.client.1.smithi195.stdout:8/358: creat d6/dd/d70/d24/d25/f78 x:0 0 0 2024-04-06T12:23:06.682 INFO:tasks.workunit.client.1.smithi195.stdout:4/368: dwrite d4/f2e [0,4194304] 0 2024-04-06T12:23:06.685 INFO:tasks.workunit.client.1.smithi195.stdout:3/435: dwrite d4/d9/d2b/f38 [4194304,4194304] 0 2024-04-06T12:23:06.686 INFO:tasks.workunit.client.1.smithi195.stdout:6/410: symlink d8/d21/d31/l9b 0 2024-04-06T12:23:06.688 INFO:tasks.workunit.client.1.smithi195.stdout:8/359: mknod d6/dd/d70/c79 0 2024-04-06T12:23:06.689 INFO:tasks.workunit.client.1.smithi195.stdout:2/381: creat d2/d21/d69/d6b/f6e x:0 0 0 2024-04-06T12:23:06.690 INFO:tasks.workunit.client.1.smithi195.stdout:2/382: chown d2/d3f 217020 1 2024-04-06T12:23:06.694 INFO:tasks.workunit.client.1.smithi195.stdout:6/411: write d8/d3d/d5e/f77 [1084236,61734] 0 2024-04-06T12:23:06.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/385: dread d0/da/dd/f18 [0,4194304] 0 2024-04-06T12:23:06.694 INFO:tasks.workunit.client.1.smithi195.stdout:8/360: truncate d6/db/f66 985822 0 2024-04-06T12:23:06.697 INFO:tasks.workunit.client.1.smithi195.stdout:4/369: stat d4/d6/d38/d1a/d40/d20/d23/f63 0 2024-04-06T12:23:06.697 INFO:tasks.workunit.client.1.smithi195.stdout:7/327: truncate d4/d24/f64 603497 0 2024-04-06T12:23:06.699 INFO:tasks.workunit.client.1.smithi195.stdout:5/386: mknod d0/da/d23/d7a/c8e 0 2024-04-06T12:23:06.701 INFO:tasks.workunit.client.1.smithi195.stdout:7/328: fsync d4/d10/d18/d19/f50 0 2024-04-06T12:23:06.701 INFO:tasks.workunit.client.1.smithi195.stdout:2/383: dread d2/fe [0,4194304] 0 2024-04-06T12:23:06.701 INFO:tasks.workunit.client.1.smithi195.stdout:8/361: mknod d6/dd/d70/d24/d53/c7a 0 2024-04-06T12:23:06.704 INFO:tasks.workunit.client.1.smithi195.stdout:3/436: dwrite d4/d9/f2a [0,4194304] 0 2024-04-06T12:23:06.705 INFO:tasks.workunit.client.1.smithi195.stdout:7/329: truncate d4/d24/f49 389125 0 2024-04-06T12:23:06.705 INFO:tasks.workunit.client.1.smithi195.stdout:2/384: dread d2/d3f/f60 [0,4194304] 0 2024-04-06T12:23:06.705 INFO:tasks.workunit.client.1.smithi195.stdout:9/436: rename d3/d10/d4f/l8b to d3/d10/d3b/l98 0 2024-04-06T12:23:06.705 INFO:tasks.workunit.client.1.smithi195.stdout:1/386: sync 2024-04-06T12:23:06.706 INFO:tasks.workunit.client.1.smithi195.stdout:6/412: mkdir d8/d50/d9c 0 2024-04-06T12:23:06.707 INFO:tasks.workunit.client.1.smithi195.stdout:6/413: write d8/f23 [1519491,116491] 0 2024-04-06T12:23:06.707 INFO:tasks.workunit.client.1.smithi195.stdout:6/414: readlink d8/d3d/d5e/l6f 0 2024-04-06T12:23:06.713 INFO:tasks.workunit.client.1.smithi195.stdout:0/417: dread d4/d6/f2c [0,4194304] 0 2024-04-06T12:23:06.714 INFO:tasks.workunit.client.1.smithi195.stdout:5/387: dread - d0/da/dd/d33/f7c zero size 2024-04-06T12:23:06.715 INFO:tasks.workunit.client.1.smithi195.stdout:7/330: symlink d4/d10/d18/d19/l6c 0 2024-04-06T12:23:06.716 INFO:tasks.workunit.client.1.smithi195.stdout:8/362: write d6/dd/d70/d24/d34/d67/f6c [5465408,73134] 0 2024-04-06T12:23:06.716 INFO:tasks.workunit.client.1.smithi195.stdout:9/437: creat d3/d10/d4f/f99 x:0 0 0 2024-04-06T12:23:06.716 INFO:tasks.workunit.client.1.smithi195.stdout:2/385: symlink d2/d21/d5e/d64/l6f 0 2024-04-06T12:23:06.717 INFO:tasks.workunit.client.1.smithi195.stdout:8/363: stat d6/d8/f26 0 2024-04-06T12:23:06.718 INFO:tasks.workunit.client.1.smithi195.stdout:5/388: chown d0/da/dd/d1c/d5a/d62/f76 796860285 1 2024-04-06T12:23:06.718 INFO:tasks.workunit.client.1.smithi195.stdout:1/387: mknod d4/d14/d19/d4e/c6e 0 2024-04-06T12:23:06.721 INFO:tasks.workunit.client.1.smithi195.stdout:4/370: symlink d4/d6/d38/d1a/l70 0 2024-04-06T12:23:06.722 INFO:tasks.workunit.client.1.smithi195.stdout:6/415: rmdir d8/d50 39 2024-04-06T12:23:06.726 INFO:tasks.workunit.client.1.smithi195.stdout:5/389: dwrite d0/da/dd/d2e/d6f/f4f [0,4194304] 0 2024-04-06T12:23:06.727 INFO:tasks.workunit.client.1.smithi195.stdout:3/437: creat d4/d9/d37/f88 x:0 0 0 2024-04-06T12:23:06.730 INFO:tasks.workunit.client.1.smithi195.stdout:2/386: fdatasync d2/f61 0 2024-04-06T12:23:06.732 INFO:tasks.workunit.client.1.smithi195.stdout:3/438: chown d4/de/c1c 128846 1 2024-04-06T12:23:06.733 INFO:tasks.workunit.client.1.smithi195.stdout:7/331: rename d4/d10/d18/d19/l6c to d4/d10/d18/d57/l6d 0 2024-04-06T12:23:06.734 INFO:tasks.workunit.client.1.smithi195.stdout:5/390: dwrite d0/da/d13/f1f [0,4194304] 0 2024-04-06T12:23:06.735 INFO:tasks.workunit.client.1.smithi195.stdout:8/364: symlink d6/dd/d42/l7b 0 2024-04-06T12:23:06.736 INFO:tasks.workunit.client.1.smithi195.stdout:5/391: dread - d0/da/dd/d33/f7c zero size 2024-04-06T12:23:06.738 INFO:tasks.workunit.client.1.smithi195.stdout:1/388: truncate d4/d14/f18 2286680 0 2024-04-06T12:23:06.738 INFO:tasks.workunit.client.1.smithi195.stdout:1/389: fsync d4/d14/d17/d24/f4a 0 2024-04-06T12:23:06.750 INFO:tasks.workunit.client.1.smithi195.stdout:0/418: dwrite d4/fd [0,4194304] 0 2024-04-06T12:23:06.751 INFO:tasks.workunit.client.1.smithi195.stdout:1/390: creat d4/d14/d19/f6f x:0 0 0 2024-04-06T12:23:06.752 INFO:tasks.workunit.client.1.smithi195.stdout:0/419: fsync d4/d48/f5a 0 2024-04-06T12:23:06.756 INFO:tasks.workunit.client.1.smithi195.stdout:5/392: dwrite d0/d35/f5f [0,4194304] 0 2024-04-06T12:23:06.756 INFO:tasks.workunit.client.1.smithi195.stdout:2/387: mknod d2/d21/d29/c70 0 2024-04-06T12:23:06.763 INFO:tasks.workunit.client.1.smithi195.stdout:6/416: rename d8/d21/d2b/d46/d44/d86/c97 to d8/d3d/d5e/d72/c9d 0 2024-04-06T12:23:06.764 INFO:tasks.workunit.client.1.smithi195.stdout:4/371: dread d4/d6/d38/d1a/f24 [0,4194304] 0 2024-04-06T12:23:06.765 INFO:tasks.workunit.client.1.smithi195.stdout:6/417: fdatasync d8/d21/d31/d26/f34 0 2024-04-06T12:23:06.765 INFO:tasks.workunit.client.1.smithi195.stdout:7/332: fsync d4/d10/d18/d33/f56 0 2024-04-06T12:23:06.767 INFO:tasks.workunit.client.1.smithi195.stdout:9/438: getdents d3/d10/d4f 0 2024-04-06T12:23:06.771 INFO:tasks.workunit.client.1.smithi195.stdout:1/391: readlink d4/d14/d17/l3c 0 2024-04-06T12:23:06.771 INFO:tasks.workunit.client.1.smithi195.stdout:5/393: mknod d0/da/d13/d5e/c8f 0 2024-04-06T12:23:06.772 INFO:tasks.workunit.client.1.smithi195.stdout:2/388: chown d2/d14/l19 126 1 2024-04-06T12:23:06.772 INFO:tasks.workunit.client.1.smithi195.stdout:3/439: rmdir d4/df/d39/d86 0 2024-04-06T12:23:06.772 INFO:tasks.workunit.client.1.smithi195.stdout:0/420: write d4/d6/f8 [679649,26425] 0 2024-04-06T12:23:06.773 INFO:tasks.workunit.client.1.smithi195.stdout:1/392: write d4/d14/d19/f5f [426138,95564] 0 2024-04-06T12:23:06.773 INFO:tasks.workunit.client.1.smithi195.stdout:5/394: write d0/da/dd/d2e/f6c [2477309,2889] 0 2024-04-06T12:23:06.775 INFO:tasks.workunit.client.1.smithi195.stdout:6/418: chown d8/d21/d31/l13 126772 1 2024-04-06T12:23:06.775 INFO:tasks.workunit.client.1.smithi195.stdout:0/421: chown d4/d48/d67/d75/f7d 7 1 2024-04-06T12:23:06.776 INFO:tasks.workunit.client.1.smithi195.stdout:4/372: fsync d4/d6/d38/d1a/d40/f3b 0 2024-04-06T12:23:06.776 INFO:tasks.workunit.client.1.smithi195.stdout:5/395: readlink d0/da/dd/d2e/l84 0 2024-04-06T12:23:06.777 INFO:tasks.workunit.client.1.smithi195.stdout:7/333: mkdir d4/d10/d18/d33/d6e 0 2024-04-06T12:23:06.777 INFO:tasks.workunit.client.1.smithi195.stdout:5/396: read d0/f3 [12067,126704] 0 2024-04-06T12:23:06.778 INFO:tasks.workunit.client.1.smithi195.stdout:4/373: write d4/d6/d38/f51 [2126323,63570] 0 2024-04-06T12:23:06.780 INFO:tasks.workunit.client.1.smithi195.stdout:5/397: write d0/da/d13/d87/f31 [1487071,108625] 0 2024-04-06T12:23:06.784 INFO:tasks.workunit.client.1.smithi195.stdout:0/422: readlink d4/d6/l16 0 2024-04-06T12:23:06.786 INFO:tasks.workunit.client.1.smithi195.stdout:8/365: dread d6/dd/d70/d24/d53/f68 [0,4194304] 0 2024-04-06T12:23:06.788 INFO:tasks.workunit.client.1.smithi195.stdout:2/389: mknod d2/c71 0 2024-04-06T12:23:06.789 INFO:tasks.workunit.client.1.smithi195.stdout:4/374: symlink d4/d6/d38/d1a/d40/d20/l71 0 2024-04-06T12:23:06.789 INFO:tasks.workunit.client.1.smithi195.stdout:9/439: dwrite d3/de/d37/f38 [0,4194304] 0 2024-04-06T12:23:06.791 INFO:tasks.workunit.client.1.smithi195.stdout:4/375: readlink d4/d6/d38/d1a/d40/l27 0 2024-04-06T12:23:06.791 INFO:tasks.workunit.client.1.smithi195.stdout:9/440: chown d3/de/d37/l87 521445547 1 2024-04-06T12:23:06.792 INFO:tasks.workunit.client.1.smithi195.stdout:6/419: fdatasync d8/d21/d31/d49/f51 0 2024-04-06T12:23:06.792 INFO:tasks.workunit.client.1.smithi195.stdout:4/376: write d4/f4e [678570,74615] 0 2024-04-06T12:23:06.796 INFO:tasks.workunit.client.1.smithi195.stdout:7/334: mkdir d4/d10/d12/d6f 0 2024-04-06T12:23:06.797 INFO:tasks.workunit.client.1.smithi195.stdout:0/423: rename d4/d48/d67/d75/d84 to d4/d65/d8f 0 2024-04-06T12:23:06.804 INFO:tasks.workunit.client.1.smithi195.stdout:8/366: mkdir d6/dd/d70/d24/d25/d7c 0 2024-04-06T12:23:06.804 INFO:tasks.workunit.client.1.smithi195.stdout:7/335: rmdir d4/d10/d18/d33 39 2024-04-06T12:23:06.805 INFO:tasks.workunit.client.1.smithi195.stdout:1/393: dwrite f1 [0,4194304] 0 2024-04-06T12:23:06.809 INFO:tasks.workunit.client.1.smithi195.stdout:2/390: creat d2/d21/d29/f72 x:0 0 0 2024-04-06T12:23:06.809 INFO:tasks.workunit.client.1.smithi195.stdout:3/440: dwrite f3 [0,4194304] 0 2024-04-06T12:23:06.814 INFO:tasks.workunit.client.1.smithi195.stdout:9/441: dwrite d3/d10/d3b/f5b [0,4194304] 0 2024-04-06T12:23:06.815 INFO:tasks.workunit.client.1.smithi195.stdout:8/367: mknod d6/db/c7d 0 2024-04-06T12:23:06.815 INFO:tasks.workunit.client.1.smithi195.stdout:7/336: chown d4/d10/d12/d6f 7540896 1 2024-04-06T12:23:06.817 INFO:tasks.workunit.client.1.smithi195.stdout:7/337: readlink d4/la 0 2024-04-06T12:23:06.817 INFO:tasks.workunit.client.1.smithi195.stdout:6/420: dwrite d8/f19 [0,4194304] 0 2024-04-06T12:23:06.817 INFO:tasks.workunit.client.1.smithi195.stdout:4/377: link d4/d6/d38/d1a/d40/c1f d4/c72 0 2024-04-06T12:23:06.818 INFO:tasks.workunit.client.1.smithi195.stdout:3/441: write d4/f24 [2545238,66304] 0 2024-04-06T12:23:06.823 INFO:tasks.workunit.client.1.smithi195.stdout:5/398: dread d0/da/fb [0,4194304] 0 2024-04-06T12:23:06.823 INFO:tasks.workunit.client.1.smithi195.stdout:8/368: creat d6/d3a/d46/f7e x:0 0 0 2024-04-06T12:23:06.826 INFO:tasks.workunit.client.1.smithi195.stdout:4/378: write d4/d6/d38/f28 [5827397,47036] 0 2024-04-06T12:23:06.827 INFO:tasks.workunit.client.1.smithi195.stdout:0/424: dwrite d4/d48/f89 [0,4194304] 0 2024-04-06T12:23:06.829 INFO:tasks.workunit.client.1.smithi195.stdout:9/442: rename d3/d10/c54 to d3/d10/d7d/c9a 0 2024-04-06T12:23:06.831 INFO:tasks.workunit.client.1.smithi195.stdout:5/399: write d0/da/dd/f18 [3985495,62232] 0 2024-04-06T12:23:06.836 INFO:tasks.workunit.client.1.smithi195.stdout:0/425: dread d4/f64 [0,4194304] 0 2024-04-06T12:23:06.836 INFO:tasks.workunit.client.1.smithi195.stdout:3/442: rename d4 to d4/d9/d89 22 2024-04-06T12:23:06.837 INFO:tasks.workunit.client.1.smithi195.stdout:5/400: creat d0/da/dd/d2e/f90 x:0 0 0 2024-04-06T12:23:06.838 INFO:tasks.workunit.client.1.smithi195.stdout:8/369: symlink d6/dd/d70/d24/d25/l7f 0 2024-04-06T12:23:06.838 INFO:tasks.workunit.client.1.smithi195.stdout:7/338: write d4/d16/f1c [4447499,129997] 0 2024-04-06T12:23:06.841 INFO:tasks.workunit.client.1.smithi195.stdout:5/401: mkdir d0/d52/d91 0 2024-04-06T12:23:06.843 INFO:tasks.workunit.client.1.smithi195.stdout:9/443: rename d3/f23 to d3/d10/f9b 0 2024-04-06T12:23:06.845 INFO:tasks.workunit.client.1.smithi195.stdout:5/402: truncate d0/da/d13/d87/d37/f8b 831157 0 2024-04-06T12:23:06.845 INFO:tasks.workunit.client.1.smithi195.stdout:0/426: truncate d4/d6/f6b 884772 0 2024-04-06T12:23:06.847 INFO:tasks.workunit.client.1.smithi195.stdout:6/421: dread d8/f23 [0,4194304] 0 2024-04-06T12:23:06.848 INFO:tasks.workunit.client.1.smithi195.stdout:3/443: rename d4/d9/d2b/f81 to d4/df/d39/f8a 0 2024-04-06T12:23:06.850 INFO:tasks.workunit.client.1.smithi195.stdout:8/370: dwrite d6/dd/d70/d24/d34/d67/f6c [0,4194304] 0 2024-04-06T12:23:06.854 INFO:tasks.workunit.client.1.smithi195.stdout:7/339: creat d4/d10/d12/f70 x:0 0 0 2024-04-06T12:23:06.855 INFO:tasks.workunit.client.1.smithi195.stdout:5/403: mknod d0/da/dd/d2e/c92 0 2024-04-06T12:23:06.857 INFO:tasks.workunit.client.1.smithi195.stdout:0/427: dwrite d4/d6/f8 [0,4194304] 0 2024-04-06T12:23:06.860 INFO:tasks.workunit.client.1.smithi195.stdout:6/422: symlink d8/d21/d2b/d46/d44/l9e 0 2024-04-06T12:23:06.862 INFO:tasks.workunit.client.1.smithi195.stdout:3/444: creat d4/d9/d2b/d3b/d5e/d7e/f8b x:0 0 0 2024-04-06T12:23:06.862 INFO:tasks.workunit.client.1.smithi195.stdout:0/428: write d4/fd [535155,60163] 0 2024-04-06T12:23:06.862 INFO:tasks.workunit.client.1.smithi195.stdout:8/371: fsync d6/db/d47/f77 0 2024-04-06T12:23:06.863 INFO:tasks.workunit.client.1.smithi195.stdout:4/379: dwrite d4/d6/d38/d1a/d40/f15 [0,4194304] 0 2024-04-06T12:23:06.871 INFO:tasks.workunit.client.1.smithi195.stdout:5/404: mkdir d0/da/d13/d5e/d93 0 2024-04-06T12:23:06.875 INFO:tasks.workunit.client.1.smithi195.stdout:8/372: write d6/d3a/d46/f63 [1188414,29611] 0 2024-04-06T12:23:06.875 INFO:tasks.workunit.client.1.smithi195.stdout:3/445: rmdir d4/d9/d2b/d3b/d40 39 2024-04-06T12:23:06.876 INFO:tasks.workunit.client.1.smithi195.stdout:0/429: mknod d4/d48/d4e/c90 0 2024-04-06T12:23:06.878 INFO:tasks.workunit.client.1.smithi195.stdout:1/394: dread d4/d14/d19/d23/f48 [0,4194304] 0 2024-04-06T12:23:06.878 INFO:tasks.workunit.client.1.smithi195.stdout:7/340: dwrite d4/d10/d12/f70 [0,4194304] 0 2024-04-06T12:23:06.886 INFO:tasks.workunit.client.1.smithi195.stdout:0/430: rename d4/c2a to d4/d48/d77/c91 0 2024-04-06T12:23:06.887 INFO:tasks.workunit.client.1.smithi195.stdout:4/380: dwrite d4/d6/d38/f51 [0,4194304] 0 2024-04-06T12:23:06.888 INFO:tasks.workunit.client.1.smithi195.stdout:5/405: creat d0/f94 x:0 0 0 2024-04-06T12:23:06.888 INFO:tasks.workunit.client.1.smithi195.stdout:6/423: link d8/d21/c6d d8/d21/d2b/d46/d4a/c9f 0 2024-04-06T12:23:06.889 INFO:tasks.workunit.client.1.smithi195.stdout:8/373: dread d6/d8/f35 [0,4194304] 0 2024-04-06T12:23:06.890 INFO:tasks.workunit.client.1.smithi195.stdout:9/444: dwrite d3/d10/d3a/d5d/f65 [4194304,4194304] 0 2024-04-06T12:23:06.894 INFO:tasks.workunit.client.1.smithi195.stdout:7/341: truncate d4/f20 813690 0 2024-04-06T12:23:06.894 INFO:tasks.workunit.client.1.smithi195.stdout:1/395: truncate d4/d14/d19/d23/d28/d2f/f3f 908723 0 2024-04-06T12:23:06.896 INFO:tasks.workunit.client.1.smithi195.stdout:5/406: mknod d0/da/d13/c95 0 2024-04-06T12:23:06.896 INFO:tasks.workunit.client.1.smithi195.stdout:9/445: write d3/d10/d4f/f57 [1994622,89258] 0 2024-04-06T12:23:06.897 INFO:tasks.workunit.client.1.smithi195.stdout:1/396: stat d4/d14/d19/f22 0 2024-04-06T12:23:06.897 INFO:tasks.workunit.client.1.smithi195.stdout:8/374: mknod d6/db/d47/d4b/c80 0 2024-04-06T12:23:06.901 INFO:tasks.workunit.client.1.smithi195.stdout:6/424: creat d8/d50/d82/fa0 x:0 0 0 2024-04-06T12:23:06.903 INFO:tasks.workunit.client.1.smithi195.stdout:1/397: rmdir d4/d14/d17/d24 39 2024-04-06T12:23:06.904 INFO:tasks.workunit.client.1.smithi195.stdout:1/398: fdatasync d4/f11 0 2024-04-06T12:23:06.904 INFO:tasks.workunit.client.1.smithi195.stdout:4/381: truncate d4/d6/d38/d1a/d40/f41 410620 0 2024-04-06T12:23:06.906 INFO:tasks.workunit.client.1.smithi195.stdout:0/431: getdents d4/d6 0 2024-04-06T12:23:06.907 INFO:tasks.workunit.client.1.smithi195.stdout:6/425: symlink d8/d8e/la1 0 2024-04-06T12:23:06.909 INFO:tasks.workunit.client.1.smithi195.stdout:5/407: creat d0/da/dd/d2e/d6f/f96 x:0 0 0 2024-04-06T12:23:06.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/432: fsync d4/d6/d1a/f47 0 2024-04-06T12:23:06.911 INFO:tasks.workunit.client.1.smithi195.stdout:6/426: chown d8/d21/d2b/l75 0 1 2024-04-06T12:23:06.912 INFO:tasks.workunit.client.1.smithi195.stdout:3/446: dread d4/d9/d2b/d3b/d40/f56 [0,4194304] 0 2024-04-06T12:23:06.913 INFO:tasks.workunit.client.1.smithi195.stdout:0/433: chown d4/d48/c5c 0 1 2024-04-06T12:23:06.916 INFO:tasks.workunit.client.1.smithi195.stdout:8/375: dwrite d6/d8/f35 [0,4194304] 0 2024-04-06T12:23:06.916 INFO:tasks.workunit.client.1.smithi195.stdout:6/427: write d8/d21/d2b/d46/f4c [503229,60176] 0 2024-04-06T12:23:06.919 INFO:tasks.workunit.client.1.smithi195.stdout:0/434: dread d4/d6/d1a/f47 [0,4194304] 0 2024-04-06T12:23:06.920 INFO:tasks.workunit.client.1.smithi195.stdout:9/446: write d3/d10/d3b/d48/f69 [885248,33174] 0 2024-04-06T12:23:06.922 INFO:tasks.workunit.client.1.smithi195.stdout:4/382: dread d4/f4a [0,4194304] 0 2024-04-06T12:23:06.925 INFO:tasks.workunit.client.1.smithi195.stdout:3/447: rename d4/d9/d52/c79 to d4/d9/d2b/d77/c8c 0 2024-04-06T12:23:06.926 INFO:tasks.workunit.client.1.smithi195.stdout:8/376: write d6/d3a/f45 [925426,78040] 0 2024-04-06T12:23:06.927 INFO:tasks.workunit.client.1.smithi195.stdout:6/428: mknod d8/d50/ca2 0 2024-04-06T12:23:06.927 INFO:tasks.workunit.client.1.smithi195.stdout:5/408: dwrite d0/da/dd/d2e/d6f/f96 [0,4194304] 0 2024-04-06T12:23:06.927 INFO:tasks.workunit.client.1.smithi195.stdout:9/447: write d3/d10/f35 [3800661,72194] 0 2024-04-06T12:23:06.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/391: sync 2024-04-06T12:23:06.929 INFO:tasks.workunit.client.1.smithi195.stdout:0/435: creat d4/d6/d1a/d73/f92 x:0 0 0 2024-04-06T12:23:06.929 INFO:tasks.workunit.client.1.smithi195.stdout:3/448: unlink d4/de/c78 0 2024-04-06T12:23:06.933 INFO:tasks.workunit.client.1.smithi195.stdout:6/429: rmdir d8/d21/d31/d6c 39 2024-04-06T12:23:06.934 INFO:tasks.workunit.client.1.smithi195.stdout:8/377: read d6/d3a/f4d [1726579,55997] 0 2024-04-06T12:23:06.939 INFO:tasks.workunit.client.1.smithi195.stdout:3/449: chown d4/d9/f18 3 1 2024-04-06T12:23:06.939 INFO:tasks.workunit.client.1.smithi195.stdout:2/392: write d2/d41/d51/f68 [17947,22324] 0 2024-04-06T12:23:06.940 INFO:tasks.workunit.client.1.smithi195.stdout:3/450: fdatasync d4/f24 0 2024-04-06T12:23:06.940 INFO:tasks.workunit.client.1.smithi195.stdout:9/448: rename d3/de/d37 to d3/d10/d3b/d48/d9c 0 2024-04-06T12:23:06.942 INFO:tasks.workunit.client.1.smithi195.stdout:2/393: creat d2/d41/d51/f73 x:0 0 0 2024-04-06T12:23:06.945 INFO:tasks.workunit.client.1.smithi195.stdout:2/394: fsync d2/d21/d2c/f32 0 2024-04-06T12:23:06.947 INFO:tasks.workunit.client.1.smithi195.stdout:6/430: rename d8/d21/d31/l12 to d8/d21/d31/d6c/d7b/la3 0 2024-04-06T12:23:06.955 INFO:tasks.workunit.client.1.smithi195.stdout:3/451: link d4/d9/d52/l58 d4/d9/d2b/d3b/d40/l8d 0 2024-04-06T12:23:06.956 INFO:tasks.workunit.client.1.smithi195.stdout:4/383: truncate d4/d6/d38/f3f 1652001 0 2024-04-06T12:23:06.957 INFO:tasks.workunit.client.1.smithi195.stdout:5/409: write d0/da/dd/d2e/d6f/f75 [9301642,121724] 0 2024-04-06T12:23:06.958 INFO:tasks.workunit.client.1.smithi195.stdout:6/431: unlink f2 0 2024-04-06T12:23:06.959 INFO:tasks.workunit.client.1.smithi195.stdout:5/410: write d0/da/d13/d87/f31 [3555441,77419] 0 2024-04-06T12:23:06.960 INFO:tasks.workunit.client.1.smithi195.stdout:0/436: dread d4/d6/d1a/f34 [0,4194304] 0 2024-04-06T12:23:06.961 INFO:tasks.workunit.client.1.smithi195.stdout:5/411: write d0/da/d13/d87/d37/f49 [2021022,101747] 0 2024-04-06T12:23:06.962 INFO:tasks.workunit.client.1.smithi195.stdout:5/412: dread - d0/da/d23/f3a zero size 2024-04-06T12:23:06.962 INFO:tasks.workunit.client.1.smithi195.stdout:8/378: truncate d6/d8/d12/f2f 2744062 0 2024-04-06T12:23:06.966 INFO:tasks.workunit.client.1.smithi195.stdout:3/452: rename d4/d9/d52 to d4/de/d8e 0 2024-04-06T12:23:06.968 INFO:tasks.workunit.client.1.smithi195.stdout:4/384: symlink d4/d6/d38/d1a/d40/d57/l73 0 2024-04-06T12:23:06.968 INFO:tasks.workunit.client.1.smithi195.stdout:3/453: fsync d4/f24 0 2024-04-06T12:23:06.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/449: truncate d3/d10/d3b/f47 2465091 0 2024-04-06T12:23:06.970 INFO:tasks.workunit.client.1.smithi195.stdout:2/395: dwrite d2/d21/d2c/f32 [0,4194304] 0 2024-04-06T12:23:06.970 INFO:tasks.workunit.client.1.smithi195.stdout:4/385: fsync d4/f16 0 2024-04-06T12:23:06.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/413: rmdir d0/da/d23/d38/d41 39 2024-04-06T12:23:06.971 INFO:tasks.workunit.client.1.smithi195.stdout:3/454: write d4/f69 [10655,62947] 0 2024-04-06T12:23:06.972 INFO:tasks.workunit.client.1.smithi195.stdout:0/437: getdents d4/d48/d67/d83 0 2024-04-06T12:23:06.972 INFO:tasks.workunit.client.1.smithi195.stdout:6/432: dwrite d8/d21/d2b/f43 [0,4194304] 0 2024-04-06T12:23:06.981 INFO:tasks.workunit.client.1.smithi195.stdout:8/379: creat d6/d8/d12/d61/f81 x:0 0 0 2024-04-06T12:23:06.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/455: creat d4/df/f8f x:0 0 0 2024-04-06T12:23:06.985 INFO:tasks.workunit.client.1.smithi195.stdout:0/438: mkdir d4/d41/d93 0 2024-04-06T12:23:06.985 INFO:tasks.workunit.client.1.smithi195.stdout:0/439: chown d4/d48/d77 0 1 2024-04-06T12:23:06.985 INFO:tasks.workunit.client.1.smithi195.stdout:8/380: dread d6/dd/d70/d24/d53/f68 [0,4194304] 0 2024-04-06T12:23:06.987 INFO:tasks.workunit.client.1.smithi195.stdout:0/440: read d4/f2e [3883482,91892] 0 2024-04-06T12:23:06.987 INFO:tasks.workunit.client.1.smithi195.stdout:6/433: truncate d8/d21/f5a 5229035 0 2024-04-06T12:23:06.988 INFO:tasks.workunit.client.1.smithi195.stdout:5/414: mkdir d0/da/dd/d2e/d6f/d58/d97 0 2024-04-06T12:23:06.994 INFO:tasks.workunit.client.1.smithi195.stdout:0/441: write d4/d6/d1a/f86 [1035526,106443] 0 2024-04-06T12:23:06.994 INFO:tasks.workunit.client.1.smithi195.stdout:6/434: write d8/d21/d31/d26/f36 [224331,31949] 0 2024-04-06T12:23:06.995 INFO:tasks.workunit.client.1.smithi195.stdout:5/415: read d0/da/dd/f18 [6943472,79342] 0 2024-04-06T12:23:06.996 INFO:tasks.workunit.client.1.smithi195.stdout:5/416: dread - d0/f94 zero size 2024-04-06T12:23:06.997 INFO:tasks.workunit.client.1.smithi195.stdout:0/442: write d4/d6/f2c [240232,17082] 0 2024-04-06T12:23:06.997 INFO:tasks.workunit.client.1.smithi195.stdout:2/396: creat d2/d21/f74 x:0 0 0 2024-04-06T12:23:06.998 INFO:tasks.workunit.client.1.smithi195.stdout:5/417: dread - d0/da/dd/d33/f7c zero size 2024-04-06T12:23:07.001 INFO:tasks.workunit.client.1.smithi195.stdout:8/381: truncate d6/db/d47/f51 1783280 0 2024-04-06T12:23:07.002 INFO:tasks.workunit.client.1.smithi195.stdout:4/386: link d4/d6/d38/d1a/d40/d20/c55 d4/d6d/c74 0 2024-04-06T12:23:07.002 INFO:tasks.workunit.client.1.smithi195.stdout:8/382: fdatasync d6/dd/d70/d24/d25/d5e/f64 0 2024-04-06T12:23:07.003 INFO:tasks.workunit.client.1.smithi195.stdout:9/450: chown d3/d10/d3b/f47 2774 1 2024-04-06T12:23:07.004 INFO:tasks.workunit.client.1.smithi195.stdout:2/397: symlink d2/d21/d5e/l75 0 2024-04-06T12:23:07.005 INFO:tasks.workunit.client.1.smithi195.stdout:2/398: chown d2/d3f 933 1 2024-04-06T12:23:07.005 INFO:tasks.workunit.client.1.smithi195.stdout:0/443: truncate d4/d48/d67/f6a 1331656 0 2024-04-06T12:23:07.007 INFO:tasks.workunit.client.1.smithi195.stdout:6/435: symlink d8/d21/la4 0 2024-04-06T12:23:07.011 INFO:tasks.workunit.client.1.smithi195.stdout:0/444: dwrite d4/d6/d1a/f54 [0,4194304] 0 2024-04-06T12:23:07.012 INFO:tasks.workunit.client.1.smithi195.stdout:2/399: chown d2/d21/l2f 299 1 2024-04-06T12:23:07.013 INFO:tasks.workunit.client.1.smithi195.stdout:3/456: truncate d4/f2f 7814228 0 2024-04-06T12:23:07.015 INFO:tasks.workunit.client.1.smithi195.stdout:6/436: rmdir d8/d21/d31/d6c/d7b 39 2024-04-06T12:23:07.023 INFO:tasks.workunit.client.1.smithi195.stdout:2/400: rename d2/d21/d69/f58 to d2/d21/d2c/d2d/f76 0 2024-04-06T12:23:07.024 INFO:tasks.workunit.client.1.smithi195.stdout:6/437: symlink d8/d3d/d5e/la5 0 2024-04-06T12:23:07.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:05.188938+0000 mgr.smithi195.ausetj (mgr.24375) 52 : audit [DBG] from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:07.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:05.573046+0000 mgr.smithi195.ausetj (mgr.24375) 53 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 810 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 8.2 MiB/s rd, 89 MiB/s wr, 397 op/s 2024-04-06T12:23:07.026 INFO:tasks.workunit.client.1.smithi195.stdout:5/418: truncate d0/da/dd/d33/f83 3931993 0 2024-04-06T12:23:07.028 INFO:tasks.workunit.client.1.smithi195.stdout:0/445: dwrite d4/f21 [4194304,4194304] 0 2024-04-06T12:23:07.031 INFO:tasks.workunit.client.1.smithi195.stdout:3/457: creat d4/d9/d2b/f90 x:0 0 0 2024-04-06T12:23:07.034 INFO:tasks.workunit.client.1.smithi195.stdout:3/458: stat d4/d9/f2a 0 2024-04-06T12:23:07.034 INFO:tasks.workunit.client.1.smithi195.stdout:4/387: truncate d4/d6/d38/f28 4534167 0 2024-04-06T12:23:07.036 INFO:tasks.workunit.client.1.smithi195.stdout:5/419: truncate d0/da/dd/d2e/f6c 5092073 0 2024-04-06T12:23:07.040 INFO:tasks.workunit.client.1.smithi195.stdout:0/446: dread d4/f59 [0,4194304] 0 2024-04-06T12:23:07.041 INFO:tasks.workunit.client.1.smithi195.stdout:6/438: dwrite d8/d3d/d3f/f76 [0,4194304] 0 2024-04-06T12:23:07.042 INFO:tasks.workunit.client.1.smithi195.stdout:3/459: dread - d4/d9/d2b/d3b/d5e/d7e/f7f zero size 2024-04-06T12:23:07.042 INFO:tasks.workunit.client.1.smithi195.stdout:2/401: dread d2/d21/f39 [0,4194304] 0 2024-04-06T12:23:07.047 INFO:tasks.workunit.client.1.smithi195.stdout:5/420: rename d0/d52/l5c to d0/da/d13/d87/d34/l98 0 2024-04-06T12:23:07.047 INFO:tasks.workunit.client.1.smithi195.stdout:8/383: dwrite d6/dd/d70/d24/d34/f6d [0,4194304] 0 2024-04-06T12:23:07.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:05.188938+0000 mgr.smithi195.ausetj (mgr.24375) 52 : audit [DBG] from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:07.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:05.573046+0000 mgr.smithi195.ausetj (mgr.24375) 53 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 810 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 8.2 MiB/s rd, 89 MiB/s wr, 397 op/s 2024-04-06T12:23:07.055 INFO:tasks.workunit.client.1.smithi195.stdout:6/439: creat d8/d8e/fa6 x:0 0 0 2024-04-06T12:23:07.056 INFO:tasks.workunit.client.1.smithi195.stdout:3/460: unlink d4/de/l83 0 2024-04-06T12:23:07.056 INFO:tasks.workunit.client.1.smithi195.stdout:6/440: rename d8/d50 to d8/d50/d32/da7 22 2024-04-06T12:23:07.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/402: mknod d2/c77 0 2024-04-06T12:23:07.057 INFO:tasks.workunit.client.1.smithi195.stdout:5/421: dwrite d0/da/d13/d87/d37/f8b [0,4194304] 0 2024-04-06T12:23:07.059 INFO:tasks.workunit.client.1.smithi195.stdout:3/461: read d4/d9/f21 [2551555,5886] 0 2024-04-06T12:23:07.060 INFO:tasks.workunit.client.1.smithi195.stdout:5/422: truncate d0/da/d23/d38/f85 768742 0 2024-04-06T12:23:07.063 INFO:tasks.workunit.client.1.smithi195.stdout:6/441: symlink d8/d3d/d5e/la8 0 2024-04-06T12:23:07.068 INFO:tasks.workunit.client.1.smithi195.stdout:5/423: symlink d0/da/d13/l99 0 2024-04-06T12:23:07.068 INFO:tasks.workunit.client.1.smithi195.stdout:4/388: truncate d4/d6/d38/d1a/f3c 451656 0 2024-04-06T12:23:07.069 INFO:tasks.workunit.client.1.smithi195.stdout:3/462: dread d4/d9/f5b [0,4194304] 0 2024-04-06T12:23:07.069 INFO:tasks.workunit.client.1.smithi195.stdout:2/403: symlink d2/d21/d29/l78 0 2024-04-06T12:23:07.070 INFO:tasks.workunit.client.1.smithi195.stdout:0/447: truncate d4/d6/d1a/f72 2127670 0 2024-04-06T12:23:07.070 INFO:tasks.workunit.client.1.smithi195.stdout:3/463: fdatasync d4/f4e 0 2024-04-06T12:23:07.074 INFO:tasks.workunit.client.1.smithi195.stdout:5/424: unlink d0/da/d13/d87/f8c 0 2024-04-06T12:23:07.075 INFO:tasks.workunit.client.1.smithi195.stdout:8/384: truncate d6/dd/d70/d24/d25/f54 1176218 0 2024-04-06T12:23:07.079 INFO:tasks.workunit.client.1.smithi195.stdout:3/464: symlink d4/d53/l91 0 2024-04-06T12:23:07.079 INFO:tasks.workunit.client.1.smithi195.stdout:7/342: sync 2024-04-06T12:23:07.080 INFO:tasks.workunit.client.1.smithi195.stdout:5/425: dwrite d0/da/dd/f89 [0,4194304] 0 2024-04-06T12:23:07.081 INFO:tasks.workunit.client.1.smithi195.stdout:7/343: fsync d4/d16/f2d 0 2024-04-06T12:23:07.082 INFO:tasks.workunit.client.1.smithi195.stdout:0/448: stat d4/d6/d2f/d49/l57 0 2024-04-06T12:23:07.083 INFO:tasks.workunit.client.1.smithi195.stdout:6/442: write d8/d50/d32/f57 [871602,3930] 0 2024-04-06T12:23:07.089 INFO:tasks.workunit.client.1.smithi195.stdout:8/385: creat d6/dd/d70/d24/d25/d5e/f82 x:0 0 0 2024-04-06T12:23:07.094 INFO:tasks.workunit.client.1.smithi195.stdout:3/465: mkdir d4/de/d8e/d92 0 2024-04-06T12:23:07.096 INFO:tasks.workunit.client.1.smithi195.stdout:3/466: chown d4/d9/d2b/d3b/c48 58788076 1 2024-04-06T12:23:07.096 INFO:tasks.workunit.client.1.smithi195.stdout:3/467: stat d4/d53/f54 0 2024-04-06T12:23:07.097 INFO:tasks.workunit.client.1.smithi195.stdout:7/344: fdatasync d4/d16/d11/f59 0 2024-04-06T12:23:07.097 INFO:tasks.workunit.client.1.smithi195.stdout:4/389: dwrite d4/d6/d38/d1a/d40/d20/d23/f3a [0,4194304] 0 2024-04-06T12:23:07.098 INFO:tasks.workunit.client.1.smithi195.stdout:3/468: read - d4/d9/d2b/d3b/d5e/d7e/f7f zero size 2024-04-06T12:23:07.100 INFO:tasks.workunit.client.1.smithi195.stdout:2/404: creat d2/f79 x:0 0 0 2024-04-06T12:23:07.101 INFO:tasks.workunit.client.1.smithi195.stdout:2/405: truncate d2/f65 632998 0 2024-04-06T12:23:07.105 INFO:tasks.workunit.client.1.smithi195.stdout:5/426: symlink d0/da/d23/d38/l9a 0 2024-04-06T12:23:07.106 INFO:tasks.workunit.client.1.smithi195.stdout:5/427: stat d0/da/dd/d1c/d5a/d62/f43 0 2024-04-06T12:23:07.107 INFO:tasks.workunit.client.1.smithi195.stdout:6/443: symlink d8/la9 0 2024-04-06T12:23:07.108 INFO:tasks.workunit.client.1.smithi195.stdout:6/444: dread - d8/d3d/d3f/f52 zero size 2024-04-06T12:23:07.108 INFO:tasks.workunit.client.1.smithi195.stdout:0/449: mkdir d4/d48/d67/d83/d94 0 2024-04-06T12:23:07.109 INFO:tasks.workunit.client.1.smithi195.stdout:3/469: symlink d4/d9/d2b/d3b/d5e/l93 0 2024-04-06T12:23:07.111 INFO:tasks.workunit.client.1.smithi195.stdout:2/406: mkdir d2/d41/d51/d7a 0 2024-04-06T12:23:07.112 INFO:tasks.workunit.client.1.smithi195.stdout:2/407: dread - d2/d14/f4e zero size 2024-04-06T12:23:07.112 INFO:tasks.workunit.client.1.smithi195.stdout:2/408: chown d2/f26 425613298 1 2024-04-06T12:23:07.113 INFO:tasks.workunit.client.1.smithi195.stdout:2/409: chown d2/d41/d51/d5d 13033 1 2024-04-06T12:23:07.114 INFO:tasks.workunit.client.1.smithi195.stdout:7/345: mknod d4/d10/d12/c71 0 2024-04-06T12:23:07.116 INFO:tasks.workunit.client.1.smithi195.stdout:3/470: chown d4/d9/f49 1 1 2024-04-06T12:23:07.117 INFO:tasks.workunit.client.1.smithi195.stdout:2/410: fdatasync d2/d3f/f60 0 2024-04-06T12:23:07.119 INFO:tasks.workunit.client.1.smithi195.stdout:6/445: creat d8/d50/d9c/faa x:0 0 0 2024-04-06T12:23:07.127 INFO:tasks.workunit.client.1.smithi195.stdout:8/386: truncate d6/d3a/d46/f50 333421 0 2024-04-06T12:23:07.128 INFO:tasks.workunit.client.1.smithi195.stdout:8/387: write d6/d3a/f45 [2471676,17936] 0 2024-04-06T12:23:07.129 INFO:tasks.workunit.client.1.smithi195.stdout:8/388: write d6/f7 [2310608,53874] 0 2024-04-06T12:23:07.129 INFO:tasks.workunit.client.1.smithi195.stdout:3/471: getdents d4/de/d8e/d92 0 2024-04-06T12:23:07.130 INFO:tasks.workunit.client.1.smithi195.stdout:8/389: dread - d6/db/d47/d4b/f73 zero size 2024-04-06T12:23:07.131 INFO:tasks.workunit.client.1.smithi195.stdout:2/411: mknod d2/c7b 0 2024-04-06T12:23:07.132 INFO:tasks.workunit.client.1.smithi195.stdout:8/390: fdatasync d6/db/d47/d4b/f73 0 2024-04-06T12:23:07.133 INFO:tasks.workunit.client.1.smithi195.stdout:6/446: unlink d8/d21/d31/d6c/d7b/f92 0 2024-04-06T12:23:07.135 INFO:tasks.workunit.client.1.smithi195.stdout:7/346: creat d4/d10/d12/f72 x:0 0 0 2024-04-06T12:23:07.136 INFO:tasks.workunit.client.1.smithi195.stdout:5/428: dwrite d0/da/d23/d38/f44 [0,4194304] 0 2024-04-06T12:23:07.136 INFO:tasks.workunit.client.1.smithi195.stdout:0/450: getdents d4/d48/d77 0 2024-04-06T12:23:07.141 INFO:tasks.workunit.client.1.smithi195.stdout:2/412: unlink d2/f55 0 2024-04-06T12:23:07.143 INFO:tasks.workunit.client.1.smithi195.stdout:8/391: mkdir d6/d8/d12/d83 0 2024-04-06T12:23:07.144 INFO:tasks.workunit.client.1.smithi195.stdout:6/447: mknod d8/d21/d31/d49/cab 0 2024-04-06T12:23:07.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/451: fsync d4/f4d 0 2024-04-06T12:23:07.147 INFO:tasks.workunit.client.1.smithi195.stdout:0/452: truncate d4/d6/d2f/f3e 933622 0 2024-04-06T12:23:07.147 INFO:tasks.workunit.client.1.smithi195.stdout:3/472: symlink d4/d9/d2b/l94 0 2024-04-06T12:23:07.150 INFO:tasks.workunit.client.1.smithi195.stdout:5/429: mkdir d0/da/dd/d1c/d5a/d62/d64/d9b 0 2024-04-06T12:23:07.153 INFO:tasks.workunit.client.1.smithi195.stdout:8/392: rename d6/dd/d70/d24/d34/c36 to d6/dd/d70/d24/d34/c84 0 2024-04-06T12:23:07.155 INFO:tasks.workunit.client.1.smithi195.stdout:0/453: mknod d4/d48/d4e/c95 0 2024-04-06T12:23:07.155 INFO:tasks.workunit.client.1.smithi195.stdout:0/454: chown d4/f5 64374 1 2024-04-06T12:23:07.156 INFO:tasks.workunit.client.1.smithi195.stdout:0/455: chown d4/d6/d1a/d73/f74 934440 1 2024-04-06T12:23:07.157 INFO:tasks.workunit.client.1.smithi195.stdout:5/430: read d0/da/f22 [131593,54018] 0 2024-04-06T12:23:07.157 INFO:tasks.workunit.client.1.smithi195.stdout:2/413: creat d2/d41/d51/d5d/f7c x:0 0 0 2024-04-06T12:23:07.157 INFO:tasks.workunit.client.1.smithi195.stdout:0/456: fsync d4/d53/d81/f88 0 2024-04-06T12:23:07.159 INFO:tasks.workunit.client.1.smithi195.stdout:0/457: symlink d4/d65/l96 0 2024-04-06T12:23:07.161 INFO:tasks.workunit.client.1.smithi195.stdout:3/473: getdents d4/de/d8e 0 2024-04-06T12:23:07.161 INFO:tasks.workunit.client.1.smithi195.stdout:1/399: sync 2024-04-06T12:23:07.162 INFO:tasks.workunit.client.1.smithi195.stdout:5/431: symlink d0/da/d13/d5e/d93/l9c 0 2024-04-06T12:23:07.163 INFO:tasks.workunit.client.1.smithi195.stdout:3/474: truncate d4/df/f6f 850071 0 2024-04-06T12:23:07.164 INFO:tasks.workunit.client.1.smithi195.stdout:1/400: truncate d4/d14/d19/f6f 212532 0 2024-04-06T12:23:07.165 INFO:tasks.workunit.client.1.smithi195.stdout:5/432: chown d0/da/dd/d1c/d5a/d62/d64/d9b 3 1 2024-04-06T12:23:07.203 INFO:tasks.workunit.client.1.smithi195.stdout:8/393: truncate d6/d3a/f45 841546 0 2024-04-06T12:23:07.204 INFO:tasks.workunit.client.1.smithi195.stdout:0/458: dwrite d4/d6/d2f/d49/f4f [0,4194304] 0 2024-04-06T12:23:07.205 INFO:tasks.workunit.client.1.smithi195.stdout:5/433: read d0/da/d23/d38/f44 [3333885,37265] 0 2024-04-06T12:23:07.205 INFO:tasks.workunit.client.1.smithi195.stdout:3/475: truncate d4/d9/d37/f3a 194717 0 2024-04-06T12:23:07.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/459: fsync d4/f3d 0 2024-04-06T12:23:07.207 INFO:tasks.workunit.client.1.smithi195.stdout:8/394: truncate d6/d3a/d46/f71 808824 0 2024-04-06T12:23:07.209 INFO:tasks.workunit.client.1.smithi195.stdout:0/460: truncate d4/d6/d58/f8b 910477 0 2024-04-06T12:23:07.215 INFO:tasks.workunit.client.1.smithi195.stdout:1/401: truncate d4/d14/d19/f20 2407102 0 2024-04-06T12:23:07.216 INFO:tasks.workunit.client.1.smithi195.stdout:8/395: dwrite d6/dd/d70/d24/d25/d5e/f82 [0,4194304] 0 2024-04-06T12:23:07.217 INFO:tasks.workunit.client.1.smithi195.stdout:3/476: symlink d4/d9/d2b/d3b/d40/l95 0 2024-04-06T12:23:07.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/461: dwrite d4/fd [0,4194304] 0 2024-04-06T12:23:07.217 INFO:tasks.workunit.client.1.smithi195.stdout:1/402: fsync d4/d14/d19/f6f 0 2024-04-06T12:23:07.222 INFO:tasks.workunit.client.1.smithi195.stdout:3/477: dread d4/d9/d2b/d3b/f6b [0,4194304] 0 2024-04-06T12:23:07.224 INFO:tasks.workunit.client.1.smithi195.stdout:4/390: sync 2024-04-06T12:23:07.225 INFO:tasks.workunit.client.1.smithi195.stdout:3/478: read d4/d9/d2b/d3b/d40/f45 [195179,99778] 0 2024-04-06T12:23:07.225 INFO:tasks.workunit.client.1.smithi195.stdout:9/451: sync 2024-04-06T12:23:07.227 INFO:tasks.workunit.client.1.smithi195.stdout:9/452: read d3/d10/f35 [630755,19955] 0 2024-04-06T12:23:07.228 INFO:tasks.workunit.client.1.smithi195.stdout:5/434: creat d0/da/dd/d2e/d6f/f9d x:0 0 0 2024-04-06T12:23:07.229 INFO:tasks.workunit.client.1.smithi195.stdout:5/435: write d0/f30 [963592,34043] 0 2024-04-06T12:23:07.230 INFO:tasks.workunit.client.1.smithi195.stdout:9/453: dread d3/d10/d3b/d48/f4a [0,4194304] 0 2024-04-06T12:23:07.232 INFO:tasks.workunit.client.1.smithi195.stdout:9/454: write d3/d10/d4f/f99 [151988,83834] 0 2024-04-06T12:23:07.233 INFO:tasks.workunit.client.1.smithi195.stdout:4/391: mkdir d4/d6/d38/d1a/d40/d20/d23/d75 0 2024-04-06T12:23:07.234 INFO:tasks.workunit.client.1.smithi195.stdout:8/396: symlink d6/dd/d70/d24/d25/d7c/l85 0 2024-04-06T12:23:07.234 INFO:tasks.workunit.client.1.smithi195.stdout:4/392: chown d4/d6/d38/d1a/d40/d20 57026937 1 2024-04-06T12:23:07.235 INFO:tasks.workunit.client.1.smithi195.stdout:4/393: readlink d4/d6/d38/d1a/d40/l4d 0 2024-04-06T12:23:07.236 INFO:tasks.workunit.client.1.smithi195.stdout:3/479: rename d4/df/d39/f6e to d4/de/f96 0 2024-04-06T12:23:07.236 INFO:tasks.workunit.client.1.smithi195.stdout:1/403: dread d4/fa [0,4194304] 0 2024-04-06T12:23:07.238 INFO:tasks.workunit.client.1.smithi195.stdout:5/436: write d0/da/d4b/f69 [237149,129728] 0 2024-04-06T12:23:07.240 INFO:tasks.workunit.client.1.smithi195.stdout:2/414: dread d2/d21/d2c/d2d/f76 [0,4194304] 0 2024-04-06T12:23:07.242 INFO:tasks.workunit.client.1.smithi195.stdout:4/394: symlink d4/d3e/l76 0 2024-04-06T12:23:07.245 INFO:tasks.workunit.client.1.smithi195.stdout:8/397: rename d6/db/d47/d4b/f73 to d6/dd/d70/d24/d34/d67/f86 0 2024-04-06T12:23:07.245 INFO:tasks.workunit.client.1.smithi195.stdout:8/398: chown l3 641 1 2024-04-06T12:23:07.246 INFO:tasks.workunit.client.1.smithi195.stdout:1/404: chown d4/d14/d17/d24/f6b 4690877 1 2024-04-06T12:23:07.247 INFO:tasks.workunit.client.1.smithi195.stdout:4/395: dread d4/d6/d38/d1a/d40/f3b [0,4194304] 0 2024-04-06T12:23:07.247 INFO:tasks.workunit.client.1.smithi195.stdout:5/437: symlink d0/da/d4b/l9e 0 2024-04-06T12:23:07.250 INFO:tasks.workunit.client.1.smithi195.stdout:8/399: dread d6/dd/d70/d24/d34/f6d [0,4194304] 0 2024-04-06T12:23:07.251 INFO:tasks.workunit.client.1.smithi195.stdout:2/415: rename d2/d41/d51 to d2/d3f/d7d 0 2024-04-06T12:23:07.253 INFO:tasks.workunit.client.1.smithi195.stdout:3/480: truncate d4/f4e 235422 0 2024-04-06T12:23:07.254 INFO:tasks.workunit.client.1.smithi195.stdout:3/481: dread - d4/d9/d37/f7d zero size 2024-04-06T12:23:07.258 INFO:tasks.workunit.client.1.smithi195.stdout:4/396: symlink d4/d6/l77 0 2024-04-06T12:23:07.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/397: fsync d4/d6/d38/d1a/d40/f3b 0 2024-04-06T12:23:07.261 INFO:tasks.workunit.client.1.smithi195.stdout:8/400: unlink d6/dd/d70/d24/d25/l7f 0 2024-04-06T12:23:07.266 INFO:tasks.workunit.client.1.smithi195.stdout:9/455: link d3/d10/d3b/d48/d9c/c8e d3/d10/d3b/d48/d5e/c9d 0 2024-04-06T12:23:07.270 INFO:tasks.workunit.client.1.smithi195.stdout:8/401: symlink d6/d3a/l87 0 2024-04-06T12:23:07.271 INFO:tasks.workunit.client.1.smithi195.stdout:8/402: fsync d6/d8/d12/d61/f81 0 2024-04-06T12:23:07.272 INFO:tasks.workunit.client.1.smithi195.stdout:4/398: dread d4/d6/d38/d1a/f2d [0,4194304] 0 2024-04-06T12:23:07.274 INFO:tasks.workunit.client.1.smithi195.stdout:9/456: truncate d3/de/f1c 1669524 0 2024-04-06T12:23:07.276 INFO:tasks.workunit.client.1.smithi195.stdout:5/438: creat d0/da/f9f x:0 0 0 2024-04-06T12:23:07.276 INFO:tasks.workunit.client.1.smithi195.stdout:1/405: link d4/d14/d17/d24/d2a/l47 d4/d14/d19/l70 0 2024-04-06T12:23:07.277 INFO:tasks.workunit.client.1.smithi195.stdout:2/416: creat d2/f7e x:0 0 0 2024-04-06T12:23:07.279 INFO:tasks.workunit.client.1.smithi195.stdout:2/417: write d2/f4 [143478,8314] 0 2024-04-06T12:23:07.279 INFO:tasks.workunit.client.1.smithi195.stdout:8/403: creat d6/dd/d70/d24/d34/d67/f88 x:0 0 0 2024-04-06T12:23:07.281 INFO:tasks.workunit.client.1.smithi195.stdout:8/404: chown d6/dd/d70/f3b 0 1 2024-04-06T12:23:07.282 INFO:tasks.workunit.client.1.smithi195.stdout:9/457: chown d3/d10/d3a/f3e 32446167 1 2024-04-06T12:23:07.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/406: dwrite d4/d14/d17/f30 [0,4194304] 0 2024-04-06T12:23:07.292 INFO:tasks.workunit.client.1.smithi195.stdout:5/439: symlink d0/la0 0 2024-04-06T12:23:07.293 INFO:tasks.workunit.client.1.smithi195.stdout:7/347: sync 2024-04-06T12:23:07.293 INFO:tasks.workunit.client.1.smithi195.stdout:5/440: chown d0/f94 33 1 2024-04-06T12:23:07.294 INFO:tasks.workunit.client.1.smithi195.stdout:7/348: stat d4/d16/d11/l41 0 2024-04-06T12:23:07.296 INFO:tasks.workunit.client.1.smithi195.stdout:9/458: mknod d3/d10/d3b/d50/c9e 0 2024-04-06T12:23:07.296 INFO:tasks.workunit.client.1.smithi195.stdout:3/482: dwrite d4/df/d39/f47 [0,4194304] 0 2024-04-06T12:23:07.296 INFO:tasks.workunit.client.1.smithi195.stdout:5/441: truncate d0/d35/f6b 58360 0 2024-04-06T12:23:07.298 INFO:tasks.workunit.client.1.smithi195.stdout:9/459: truncate d3/de/f85 1720928 0 2024-04-06T12:23:07.298 INFO:tasks.workunit.client.1.smithi195.stdout:1/407: mkdir d4/d14/d19/d4e/d71 0 2024-04-06T12:23:07.301 INFO:tasks.workunit.client.1.smithi195.stdout:2/418: symlink d2/d21/l7f 0 2024-04-06T12:23:07.301 INFO:tasks.workunit.client.1.smithi195.stdout:4/399: rmdir d4/d6/d38/d1a/d40/d20/d23/d75 0 2024-04-06T12:23:07.303 INFO:tasks.workunit.client.1.smithi195.stdout:3/483: creat d4/d9/d37/f97 x:0 0 0 2024-04-06T12:23:07.304 INFO:tasks.workunit.client.1.smithi195.stdout:3/484: dread - d4/d9/d2b/d3b/d40/f67 zero size 2024-04-06T12:23:07.306 INFO:tasks.workunit.client.1.smithi195.stdout:9/460: mknod d3/d10/d3a/d6b/c9f 0 2024-04-06T12:23:07.306 INFO:tasks.workunit.client.1.smithi195.stdout:3/485: read d4/d9/f18 [3994977,64078] 0 2024-04-06T12:23:07.307 INFO:tasks.workunit.client.1.smithi195.stdout:1/408: rename l2 to d4/d14/d19/d4e/l72 0 2024-04-06T12:23:07.307 INFO:tasks.workunit.client.1.smithi195.stdout:6/448: sync 2024-04-06T12:23:07.307 INFO:tasks.workunit.client.1.smithi195.stdout:0/462: sync 2024-04-06T12:23:07.308 INFO:tasks.workunit.client.1.smithi195.stdout:2/419: creat d2/d3f/f80 x:0 0 0 2024-04-06T12:23:07.308 INFO:tasks.workunit.client.1.smithi195.stdout:9/461: write d3/f64 [733143,116665] 0 2024-04-06T12:23:07.309 INFO:tasks.workunit.client.1.smithi195.stdout:6/449: stat d8/d3d/l9a 0 2024-04-06T12:23:07.309 INFO:tasks.workunit.client.1.smithi195.stdout:4/400: creat d4/d3e/f78 x:0 0 0 2024-04-06T12:23:07.310 INFO:tasks.workunit.client.1.smithi195.stdout:5/442: mknod d0/da/d13/d87/ca1 0 2024-04-06T12:23:07.311 INFO:tasks.workunit.client.1.smithi195.stdout:9/462: read - d3/d10/d3b/d50/f86 zero size 2024-04-06T12:23:07.311 INFO:tasks.workunit.client.1.smithi195.stdout:0/463: dread d4/d6/d2f/f3e [0,4194304] 0 2024-04-06T12:23:07.312 INFO:tasks.workunit.client.1.smithi195.stdout:5/443: readlink d0/da/dd/d1c/l3d 0 2024-04-06T12:23:07.312 INFO:tasks.workunit.client.1.smithi195.stdout:0/464: chown d4/d6/f1d 66312055 1 2024-04-06T12:23:07.313 INFO:tasks.workunit.client.1.smithi195.stdout:0/465: read d4/f59 [71124,56202] 0 2024-04-06T12:23:07.319 INFO:tasks.workunit.client.1.smithi195.stdout:1/409: dwrite d4/d14/d19/d4e/f52 [0,4194304] 0 2024-04-06T12:23:07.319 INFO:tasks.workunit.client.1.smithi195.stdout:8/405: truncate d6/d8/f26 2288029 0 2024-04-06T12:23:07.321 INFO:tasks.workunit.client.1.smithi195.stdout:0/466: mkdir d4/d48/d77/d97 0 2024-04-06T12:23:07.324 INFO:tasks.workunit.client.1.smithi195.stdout:7/349: getdents d4/d16/dd/d22 0 2024-04-06T12:23:07.326 INFO:tasks.workunit.client.1.smithi195.stdout:4/401: write d4/d6/d38/d1a/f2d [612026,75162] 0 2024-04-06T12:23:07.327 INFO:tasks.workunit.client.1.smithi195.stdout:8/406: creat d6/d3a/d46/f89 x:0 0 0 2024-04-06T12:23:07.327 INFO:tasks.workunit.client.1.smithi195.stdout:0/467: mknod d4/d48/c98 0 2024-04-06T12:23:07.329 INFO:tasks.workunit.client.1.smithi195.stdout:6/450: creat d8/d21/d31/fac x:0 0 0 2024-04-06T12:23:07.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/407: write d6/dd/f14 [527872,27192] 0 2024-04-06T12:23:07.330 INFO:tasks.workunit.client.1.smithi195.stdout:1/410: symlink d4/d14/d19/d4e/d71/l73 0 2024-04-06T12:23:07.331 INFO:tasks.workunit.client.1.smithi195.stdout:7/350: readlink d4/d16/l3a 0 2024-04-06T12:23:07.332 INFO:tasks.workunit.client.1.smithi195.stdout:0/468: creat d4/d41/f99 x:0 0 0 2024-04-06T12:23:07.334 INFO:tasks.workunit.client.1.smithi195.stdout:3/486: dwrite d4/d9/f5b [0,4194304] 0 2024-04-06T12:23:07.334 INFO:tasks.workunit.client.1.smithi195.stdout:9/463: getdents d3/d10/d7d 0 2024-04-06T12:23:07.334 INFO:tasks.workunit.client.1.smithi195.stdout:5/444: getdents d0/da/d13/d5e 0 2024-04-06T12:23:07.335 INFO:tasks.workunit.client.1.smithi195.stdout:9/464: stat d3/l4d 0 2024-04-06T12:23:07.335 INFO:tasks.workunit.client.1.smithi195.stdout:6/451: chown d8/d21/d31/d6c/c71 45275 1 2024-04-06T12:23:07.336 INFO:tasks.workunit.client.1.smithi195.stdout:5/445: stat d0/da/dd/d33 0 2024-04-06T12:23:07.344 INFO:tasks.workunit.client.1.smithi195.stdout:6/452: read - d8/d50/d9c/faa zero size 2024-04-06T12:23:07.344 INFO:tasks.workunit.client.1.smithi195.stdout:1/411: symlink d4/d14/l74 0 2024-04-06T12:23:07.344 INFO:tasks.workunit.client.1.smithi195.stdout:8/408: rename d6/dd/d70/d24/d25/d49/l74 to d6/d8/d12/l8a 0 2024-04-06T12:23:07.346 INFO:tasks.workunit.client.1.smithi195.stdout:5/446: readlink d0/da/d13/d87/d34/l98 0 2024-04-06T12:23:07.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/453: dread d8/d21/d2b/d46/d4a/f59 [0,4194304] 0 2024-04-06T12:23:07.348 INFO:tasks.workunit.client.1.smithi195.stdout:7/351: creat d4/d16/f73 x:0 0 0 2024-04-06T12:23:07.349 INFO:tasks.workunit.client.1.smithi195.stdout:9/465: dwrite d3/d10/d3a/d5d/f63 [0,4194304] 0 2024-04-06T12:23:07.350 INFO:tasks.workunit.client.1.smithi195.stdout:9/466: readlink d3/d10/l19 0 2024-04-06T12:23:07.351 INFO:tasks.workunit.client.1.smithi195.stdout:4/402: dread d4/d6/d38/f1d [0,4194304] 0 2024-04-06T12:23:07.351 INFO:tasks.workunit.client.1.smithi195.stdout:0/469: truncate d4/d6/d1a/f47 69876 0 2024-04-06T12:23:07.352 INFO:tasks.workunit.client.1.smithi195.stdout:0/470: stat d4/d48 0 2024-04-06T12:23:07.356 INFO:tasks.workunit.client.1.smithi195.stdout:8/409: creat d6/d3a/d46/f8b x:0 0 0 2024-04-06T12:23:07.357 INFO:tasks.workunit.client.1.smithi195.stdout:5/447: dwrite d0/da/dd/d2e/f90 [0,4194304] 0 2024-04-06T12:23:07.361 INFO:tasks.workunit.client.1.smithi195.stdout:3/487: link d4/d9/f1e d4/df/d39/f98 0 2024-04-06T12:23:07.364 INFO:tasks.workunit.client.1.smithi195.stdout:6/454: mknod d8/d21/d2b/d46/d44/d86/cad 0 2024-04-06T12:23:07.365 INFO:tasks.workunit.client.1.smithi195.stdout:5/448: dwrite d0/da/dd/d1c/f2d [4194304,4194304] 0 2024-04-06T12:23:07.367 INFO:tasks.workunit.client.1.smithi195.stdout:5/449: fsync d0/da/dd/d2e/f6c 0 2024-04-06T12:23:07.373 INFO:tasks.workunit.client.1.smithi195.stdout:6/455: rmdir d8/d21/d2b 39 2024-04-06T12:23:07.373 INFO:tasks.workunit.client.1.smithi195.stdout:8/410: rename d6/dd/d70/d24/d25/d49/f3d to d6/dd/d70/d24/d25/d7c/f8c 0 2024-04-06T12:23:07.374 INFO:tasks.workunit.client.1.smithi195.stdout:3/488: truncate d4/d9/f68 727264 0 2024-04-06T12:23:07.375 INFO:tasks.workunit.client.1.smithi195.stdout:1/412: dwrite d4/d14/d17/d24/d2a/f54 [0,4194304] 0 2024-04-06T12:23:07.379 INFO:tasks.workunit.client.1.smithi195.stdout:7/352: write d4/d24/f1a [2791656,41268] 0 2024-04-06T12:23:07.381 INFO:tasks.workunit.client.1.smithi195.stdout:3/489: dwrite d4/d9/d2b/f6a [0,4194304] 0 2024-04-06T12:23:07.382 INFO:tasks.workunit.client.1.smithi195.stdout:3/490: readlink d4/l5 0 2024-04-06T12:23:07.382 INFO:tasks.workunit.client.1.smithi195.stdout:2/420: sync 2024-04-06T12:23:07.386 INFO:tasks.workunit.client.1.smithi195.stdout:2/421: write d2/d3f/d7d/f68 [555315,62681] 0 2024-04-06T12:23:07.387 INFO:tasks.workunit.client.1.smithi195.stdout:2/422: fdatasync d2/f26 0 2024-04-06T12:23:07.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/403: link d4/d6/d38/d1a/d40/d20/f61 d4/f79 0 2024-04-06T12:23:07.391 INFO:tasks.workunit.client.1.smithi195.stdout:0/471: dwrite d4/f4d [0,4194304] 0 2024-04-06T12:23:07.393 INFO:tasks.workunit.client.1.smithi195.stdout:0/472: write d4/d53/f87 [646709,83069] 0 2024-04-06T12:23:07.393 INFO:tasks.workunit.client.1.smithi195.stdout:9/467: truncate d3/de/f58 3096392 0 2024-04-06T12:23:07.395 INFO:tasks.workunit.client.1.smithi195.stdout:9/468: fdatasync d3/d10/d3b/d48/f69 0 2024-04-06T12:23:07.395 INFO:tasks.workunit.client.1.smithi195.stdout:0/473: chown d4/d6/d1a/l3a 7155 1 2024-04-06T12:23:07.396 INFO:tasks.workunit.client.1.smithi195.stdout:6/456: mknod d8/d21/d2b/d46/d44/cae 0 2024-04-06T12:23:07.399 INFO:tasks.workunit.client.1.smithi195.stdout:2/423: rmdir d2/d3f/d7d/d5d 39 2024-04-06T12:23:07.400 INFO:tasks.workunit.client.1.smithi195.stdout:5/450: link d0/da/d4b/c5d d0/da/dd/d33/ca2 0 2024-04-06T12:23:07.402 INFO:tasks.workunit.client.1.smithi195.stdout:6/457: dwrite d8/f19 [0,4194304] 0 2024-04-06T12:23:07.402 INFO:tasks.workunit.client.1.smithi195.stdout:4/404: unlink d4/d6/d38/d1a/d40/d20/d23/c58 0 2024-04-06T12:23:07.404 INFO:tasks.workunit.client.1.smithi195.stdout:9/469: stat d3/de/f1c 0 2024-04-06T12:23:07.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/413: rename d4/d14/c16 to d4/d14/d17/d24/d2a/c75 0 2024-04-06T12:23:07.410 INFO:tasks.workunit.client.1.smithi195.stdout:5/451: symlink d0/da/dd/d1c/la3 0 2024-04-06T12:23:07.411 INFO:tasks.workunit.client.1.smithi195.stdout:8/411: getdents d6/dd/d70/d24/d25 0 2024-04-06T12:23:07.412 INFO:tasks.workunit.client.1.smithi195.stdout:8/412: readlink d6/d8/l48 0 2024-04-06T12:23:07.414 INFO:tasks.workunit.client.1.smithi195.stdout:9/470: creat d3/d10/d3b/d50/fa0 x:0 0 0 2024-04-06T12:23:07.415 INFO:tasks.workunit.client.1.smithi195.stdout:2/424: creat d2/d3f/d7d/d7a/f81 x:0 0 0 2024-04-06T12:23:07.415 INFO:tasks.workunit.client.1.smithi195.stdout:0/474: read d4/d53/f87 [54466,24259] 0 2024-04-06T12:23:07.415 INFO:tasks.workunit.client.1.smithi195.stdout:7/353: rename d4/c48 to d4/d24/c74 0 2024-04-06T12:23:07.417 INFO:tasks.workunit.client.1.smithi195.stdout:4/405: mkdir d4/d6/d38/d65/d7a 0 2024-04-06T12:23:07.419 INFO:tasks.workunit.client.1.smithi195.stdout:2/425: write d2/d21/d69/d6b/f6e [758412,27739] 0 2024-04-06T12:23:07.419 INFO:tasks.workunit.client.1.smithi195.stdout:9/471: fsync d3/d10/f9b 0 2024-04-06T12:23:07.419 INFO:tasks.workunit.client.1.smithi195.stdout:6/458: dwrite d8/d21/f5a [0,4194304] 0 2024-04-06T12:23:07.421 INFO:tasks.workunit.client.1.smithi195.stdout:5/452: fsync d0/da/dd/d2e/d6f/f75 0 2024-04-06T12:23:07.423 INFO:tasks.workunit.client.1.smithi195.stdout:5/453: write d0/da/d23/f61 [452442,73077] 0 2024-04-06T12:23:07.423 INFO:tasks.workunit.client.1.smithi195.stdout:3/491: rename d4/d9/d2b/d3b/d5e/l75 to d4/d9/d37/l99 0 2024-04-06T12:23:07.425 INFO:tasks.workunit.client.1.smithi195.stdout:7/354: write d4/d10/d12/f14 [756792,65586] 0 2024-04-06T12:23:07.426 INFO:tasks.workunit.client.1.smithi195.stdout:8/413: creat d6/d8/d52/f8d x:0 0 0 2024-04-06T12:23:07.428 INFO:tasks.workunit.client.1.smithi195.stdout:4/406: mknod d4/d6/d38/d65/c7b 0 2024-04-06T12:23:07.431 INFO:tasks.workunit.client.1.smithi195.stdout:2/426: creat d2/d14/f82 x:0 0 0 2024-04-06T12:23:07.432 INFO:tasks.workunit.client.1.smithi195.stdout:6/459: mkdir d8/d21/d2b/d46/d2f/daf 0 2024-04-06T12:23:07.434 INFO:tasks.workunit.client.1.smithi195.stdout:7/355: dwrite d4/d5d/f42 [0,4194304] 0 2024-04-06T12:23:07.436 INFO:tasks.workunit.client.1.smithi195.stdout:1/414: rename d4/d14/d19/f22 to d4/d14/d17/d3a/f76 0 2024-04-06T12:23:07.438 INFO:tasks.workunit.client.1.smithi195.stdout:5/454: creat d0/da/dd/d2e/fa4 x:0 0 0 2024-04-06T12:23:07.438 INFO:tasks.workunit.client.1.smithi195.stdout:3/492: mkdir d4/d9/d2b/d77/d9a 0 2024-04-06T12:23:07.440 INFO:tasks.workunit.client.1.smithi195.stdout:2/427: dwrite d2/d21/d2c/f32 [0,4194304] 0 2024-04-06T12:23:07.443 INFO:tasks.workunit.client.1.smithi195.stdout:8/414: creat d6/d3a/f8e x:0 0 0 2024-04-06T12:23:07.444 INFO:tasks.workunit.client.1.smithi195.stdout:8/415: dread - d6/dd/d42/f6f zero size 2024-04-06T12:23:07.445 INFO:tasks.workunit.client.1.smithi195.stdout:9/472: unlink d3/c2c 0 2024-04-06T12:23:07.456 INFO:tasks.workunit.client.1.smithi195.stdout:2/428: symlink d2/d21/d5e/d64/l83 0 2024-04-06T12:23:07.457 INFO:tasks.workunit.client.1.smithi195.stdout:9/473: readlink d3/l25 0 2024-04-06T12:23:07.459 INFO:tasks.workunit.client.1.smithi195.stdout:4/407: creat d4/d6/d38/d65/d7a/f7c x:0 0 0 2024-04-06T12:23:07.459 INFO:tasks.workunit.client.1.smithi195.stdout:4/408: dread - d4/f79 zero size 2024-04-06T12:23:07.467 INFO:tasks.workunit.client.1.smithi195.stdout:3/493: mkdir d4/d9/d2b/d9b 0 2024-04-06T12:23:07.468 INFO:tasks.workunit.client.1.smithi195.stdout:3/494: dread - d4/d9/d2b/d3b/d5e/d7e/f7f zero size 2024-04-06T12:23:07.472 INFO:tasks.workunit.client.1.smithi195.stdout:9/474: truncate d3/de/f1c 570782 0 2024-04-06T12:23:07.474 INFO:tasks.workunit.client.1.smithi195.stdout:4/409: rmdir d4/d3e 39 2024-04-06T12:23:07.477 INFO:tasks.workunit.client.1.smithi195.stdout:1/415: creat d4/d14/d17/f77 x:0 0 0 2024-04-06T12:23:07.477 INFO:tasks.workunit.client.1.smithi195.stdout:2/429: mkdir d2/d41/d84 0 2024-04-06T12:23:07.479 INFO:tasks.workunit.client.1.smithi195.stdout:3/495: unlink d4/d9/d37/c74 0 2024-04-06T12:23:07.482 INFO:tasks.workunit.client.1.smithi195.stdout:7/356: truncate d4/d10/d12/f70 1404596 0 2024-04-06T12:23:07.483 INFO:tasks.workunit.client.1.smithi195.stdout:2/430: unlink d2/d21/d69/c46 0 2024-04-06T12:23:07.484 INFO:tasks.workunit.client.1.smithi195.stdout:3/496: creat d4/df/d39/f9c x:0 0 0 2024-04-06T12:23:07.486 INFO:tasks.workunit.client.1.smithi195.stdout:8/416: write d6/d3a/d46/f50 [1373012,114089] 0 2024-04-06T12:23:07.487 INFO:tasks.workunit.client.1.smithi195.stdout:6/460: dwrite d8/d21/d2b/d46/d4a/f5f [0,4194304] 0 2024-04-06T12:23:07.489 INFO:tasks.workunit.client.1.smithi195.stdout:4/410: unlink d4/d6/d38/d1a/d40/d20/c55 0 2024-04-06T12:23:07.490 INFO:tasks.workunit.client.1.smithi195.stdout:8/417: chown d6/dd/d70/d24/c4c 32865900 1 2024-04-06T12:23:07.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/497: rmdir d4/d9/d2b 39 2024-04-06T12:23:07.495 INFO:tasks.workunit.client.1.smithi195.stdout:6/461: mkdir d8/d3d/d3f/db0 0 2024-04-06T12:23:07.499 INFO:tasks.workunit.client.1.smithi195.stdout:2/431: dread d2/d21/d2c/d2d/f5f [0,4194304] 0 2024-04-06T12:23:07.500 INFO:tasks.workunit.client.1.smithi195.stdout:8/418: dwrite d6/dd/d70/d24/d34/d67/f6c [0,4194304] 0 2024-04-06T12:23:07.500 INFO:tasks.workunit.client.1.smithi195.stdout:1/416: dread d4/d14/d17/d3a/f76 [4194304,4194304] 0 2024-04-06T12:23:07.501 INFO:tasks.workunit.client.1.smithi195.stdout:2/432: chown d2/d3f/d7d/l59 10 1 2024-04-06T12:23:07.501 INFO:tasks.workunit.client.1.smithi195.stdout:8/419: chown d6/db/d47/l5f 691 1 2024-04-06T12:23:07.502 INFO:tasks.workunit.client.1.smithi195.stdout:8/420: fdatasync d6/d3a/d46/f89 0 2024-04-06T12:23:07.502 INFO:tasks.workunit.client.1.smithi195.stdout:1/417: readlink d4/d14/l41 0 2024-04-06T12:23:07.503 INFO:tasks.workunit.client.1.smithi195.stdout:2/433: write d2/d3f/d7d/f54 [2183986,129591] 0 2024-04-06T12:23:07.506 INFO:tasks.workunit.client.1.smithi195.stdout:7/357: link d4/d10/d12/c71 d4/d10/d18/d57/c75 0 2024-04-06T12:23:07.506 INFO:tasks.workunit.client.1.smithi195.stdout:2/434: chown d2/d14 2778768 1 2024-04-06T12:23:07.506 INFO:tasks.workunit.client.1.smithi195.stdout:2/435: chown d2/f23 878 1 2024-04-06T12:23:07.506 INFO:tasks.workunit.client.1.smithi195.stdout:6/462: creat d8/d21/d31/d26/fb1 x:0 0 0 2024-04-06T12:23:07.507 INFO:tasks.workunit.client.1.smithi195.stdout:4/411: creat d4/d6/d38/d1a/d40/d57/d64/f7d x:0 0 0 2024-04-06T12:23:07.507 INFO:tasks.workunit.client.1.smithi195.stdout:7/358: write d4/d24/f1f [567947,31132] 0 2024-04-06T12:23:07.508 INFO:tasks.workunit.client.1.smithi195.stdout:0/475: sync 2024-04-06T12:23:07.509 INFO:tasks.workunit.client.1.smithi195.stdout:2/436: dread - d2/d21/d29/f4a zero size 2024-04-06T12:23:07.513 INFO:tasks.workunit.client.1.smithi195.stdout:6/463: read d8/d21/d31/fe [3713560,84502] 0 2024-04-06T12:23:07.515 INFO:tasks.workunit.client.1.smithi195.stdout:2/437: fsync d2/d14/f22 0 2024-04-06T12:23:07.515 INFO:tasks.workunit.client.1.smithi195.stdout:3/498: link d4/df/c23 d4/de/d8e/c9d 0 2024-04-06T12:23:07.518 INFO:tasks.workunit.client.1.smithi195.stdout:9/475: dwrite d3/de/f1c [0,4194304] 0 2024-04-06T12:23:07.519 INFO:tasks.workunit.client.1.smithi195.stdout:0/476: dread d4/f31 [0,4194304] 0 2024-04-06T12:23:07.522 INFO:tasks.workunit.client.1.smithi195.stdout:1/418: dwrite d4/d14/d19/d23/d28/d2f/f33 [4194304,4194304] 0 2024-04-06T12:23:07.524 INFO:tasks.workunit.client.1.smithi195.stdout:6/464: truncate d8/d21/d31/d49/f51 1787512 0 2024-04-06T12:23:07.524 INFO:tasks.workunit.client.1.smithi195.stdout:3/499: fdatasync d4/d9/d2b/f72 0 2024-04-06T12:23:07.525 INFO:tasks.workunit.client.1.smithi195.stdout:4/412: creat d4/f7e x:0 0 0 2024-04-06T12:23:07.527 INFO:tasks.workunit.client.1.smithi195.stdout:6/465: write d8/f10 [5649400,60333] 0 2024-04-06T12:23:07.528 INFO:tasks.workunit.client.1.smithi195.stdout:1/419: dread d4/d14/d19/f1a [0,4194304] 0 2024-04-06T12:23:07.528 INFO:tasks.workunit.client.1.smithi195.stdout:0/477: dread d4/d6/d1a/f86 [0,4194304] 0 2024-04-06T12:23:07.529 INFO:tasks.workunit.client.1.smithi195.stdout:2/438: symlink d2/d3f/d7d/d5d/l85 0 2024-04-06T12:23:07.529 INFO:tasks.workunit.client.1.smithi195.stdout:9/476: mkdir d3/da1 0 2024-04-06T12:23:07.530 INFO:tasks.workunit.client.1.smithi195.stdout:7/359: dread d4/d24/f1a [0,4194304] 0 2024-04-06T12:23:07.533 INFO:tasks.workunit.client.1.smithi195.stdout:6/466: write d8/d21/d31/d49/f51 [1862629,128176] 0 2024-04-06T12:23:07.535 INFO:tasks.workunit.client.1.smithi195.stdout:1/420: chown d4/d14/d17/d24/d2a/d45/f55 88679456 1 2024-04-06T12:23:07.537 INFO:tasks.workunit.client.1.smithi195.stdout:0/478: unlink d4/f2e 0 2024-04-06T12:23:07.537 INFO:tasks.workunit.client.1.smithi195.stdout:1/421: fsync d4/d14/d19/d4e/f52 0 2024-04-06T12:23:07.538 INFO:tasks.workunit.client.1.smithi195.stdout:9/477: mknod d3/de/ca2 0 2024-04-06T12:23:07.539 INFO:tasks.workunit.client.1.smithi195.stdout:7/360: mkdir d4/d16/dd/d22/d76 0 2024-04-06T12:23:07.540 INFO:tasks.workunit.client.1.smithi195.stdout:3/500: dwrite f3 [4194304,4194304] 0 2024-04-06T12:23:07.541 INFO:tasks.workunit.client.1.smithi195.stdout:2/439: dwrite d2/f1e [0,4194304] 0 2024-04-06T12:23:07.543 INFO:tasks.workunit.client.1.smithi195.stdout:2/440: write d2/d21/f28 [231452,86207] 0 2024-04-06T12:23:07.594 INFO:tasks.workunit.client.1.smithi195.stdout:1/422: creat d4/d14/d19/f78 x:0 0 0 2024-04-06T12:23:07.595 INFO:tasks.workunit.client.1.smithi195.stdout:6/467: dread f5 [0,4194304] 0 2024-04-06T12:23:07.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/478: write d3/d10/d3a/f60 [358244,91121] 0 2024-04-06T12:23:07.598 INFO:tasks.workunit.client.1.smithi195.stdout:2/441: symlink d2/d3f/d7d/d5d/l86 0 2024-04-06T12:23:07.600 INFO:tasks.workunit.client.1.smithi195.stdout:1/423: readlink d4/d14/d19/l70 0 2024-04-06T12:23:07.601 INFO:tasks.workunit.client.1.smithi195.stdout:4/413: dread d4/d6/d38/f3f [0,4194304] 0 2024-04-06T12:23:07.603 INFO:tasks.workunit.client.1.smithi195.stdout:6/468: mknod d8/d21/d2b/d46/cb2 0 2024-04-06T12:23:07.603 INFO:tasks.workunit.client.1.smithi195.stdout:3/501: dwrite d4/d9/d2b/f90 [0,4194304] 0 2024-04-06T12:23:07.607 INFO:tasks.workunit.client.1.smithi195.stdout:3/502: read d4/d9/d2b/d3b/f76 [2565790,76164] 0 2024-04-06T12:23:07.609 INFO:tasks.workunit.client.1.smithi195.stdout:1/424: truncate d4/d14/d17/f10 915215 0 2024-04-06T12:23:07.610 INFO:tasks.workunit.client.1.smithi195.stdout:4/414: dwrite d4/d6/d38/f39 [0,4194304] 0 2024-04-06T12:23:07.612 INFO:tasks.workunit.client.1.smithi195.stdout:6/469: chown d8/d21/d31/d6c/d7b/la3 23577 1 2024-04-06T12:23:07.613 INFO:tasks.workunit.client.1.smithi195.stdout:2/442: mknod d2/d21/d2c/c87 0 2024-04-06T12:23:07.614 INFO:tasks.workunit.client.1.smithi195.stdout:2/443: chown d2/d21/d2c/d2d/f76 81941 1 2024-04-06T12:23:07.618 INFO:tasks.workunit.client.1.smithi195.stdout:4/415: dread d4/d6/d38/d1a/d40/f41 [0,4194304] 0 2024-04-06T12:23:07.618 INFO:tasks.workunit.client.1.smithi195.stdout:5/455: sync 2024-04-06T12:23:07.620 INFO:tasks.workunit.client.1.smithi195.stdout:3/503: mkdir d4/de/d8e/d92/d9e 0 2024-04-06T12:23:07.621 INFO:tasks.workunit.client.1.smithi195.stdout:2/444: mknod d2/d3f/c88 0 2024-04-06T12:23:07.622 INFO:tasks.workunit.client.1.smithi195.stdout:2/445: write d2/d21/d2c/d2d/f5c [242497,73528] 0 2024-04-06T12:23:07.625 INFO:tasks.workunit.client.1.smithi195.stdout:4/416: rmdir d4 39 2024-04-06T12:23:07.627 INFO:tasks.workunit.client.1.smithi195.stdout:2/446: fsync d2/d21/d2c/d2d/f76 0 2024-04-06T12:23:07.628 INFO:tasks.workunit.client.1.smithi195.stdout:2/447: dread - d2/f6d zero size 2024-04-06T12:23:07.629 INFO:tasks.workunit.client.1.smithi195.stdout:4/417: truncate d4/d6/d38/f5d 82423 0 2024-04-06T12:23:07.631 INFO:tasks.workunit.client.1.smithi195.stdout:4/418: truncate d4/d6/d38/d1a/d40/d57/d64/f7d 404308 0 2024-04-06T12:23:07.632 INFO:tasks.workunit.client.1.smithi195.stdout:3/504: mkdir d4/d9/d9f 0 2024-04-06T12:23:07.633 INFO:tasks.workunit.client.1.smithi195.stdout:3/505: write d4/d9/d37/f88 [116726,95402] 0 2024-04-06T12:23:07.633 INFO:tasks.workunit.client.1.smithi195.stdout:2/448: creat d2/d3f/f89 x:0 0 0 2024-04-06T12:23:07.634 INFO:tasks.workunit.client.1.smithi195.stdout:9/479: write d3/f43 [924192,95869] 0 2024-04-06T12:23:07.636 INFO:tasks.workunit.client.1.smithi195.stdout:2/449: chown d2/d21/d2c/d2d/f76 1725264496 1 2024-04-06T12:23:07.636 INFO:tasks.workunit.client.1.smithi195.stdout:6/470: dread d8/d21/d31/f11 [0,4194304] 0 2024-04-06T12:23:07.637 INFO:tasks.workunit.client.1.smithi195.stdout:1/425: rmdir d4 39 2024-04-06T12:23:07.638 INFO:tasks.workunit.client.1.smithi195.stdout:6/471: stat d8/d21/d2b/d46/d44/d86/c8d 0 2024-04-06T12:23:07.639 INFO:tasks.workunit.client.1.smithi195.stdout:3/506: mknod d4/d9/d2b/d77/ca0 0 2024-04-06T12:23:07.639 INFO:tasks.workunit.client.1.smithi195.stdout:9/480: dread d3/de/f1c [0,4194304] 0 2024-04-06T12:23:07.642 INFO:tasks.workunit.client.1.smithi195.stdout:6/472: mkdir d8/d3d/d3f/db3 0 2024-04-06T12:23:07.643 INFO:tasks.workunit.client.1.smithi195.stdout:6/473: dread - d8/d3d/d5e/f84 zero size 2024-04-06T12:23:07.644 INFO:tasks.workunit.client.1.smithi195.stdout:3/507: symlink d4/d9/d37/la1 0 2024-04-06T12:23:07.645 INFO:tasks.workunit.client.1.smithi195.stdout:6/474: write d8/d3d/d5e/d72/f79 [819771,94957] 0 2024-04-06T12:23:07.647 INFO:tasks.workunit.client.1.smithi195.stdout:5/456: truncate d0/fe 342313 0 2024-04-06T12:23:07.648 INFO:tasks.workunit.client.1.smithi195.stdout:2/450: dread d2/d21/d69/f52 [0,4194304] 0 2024-04-06T12:23:07.650 INFO:tasks.workunit.client.1.smithi195.stdout:4/419: truncate d4/d6/d38/f51 4885248 0 2024-04-06T12:23:07.651 INFO:tasks.workunit.client.1.smithi195.stdout:6/475: symlink d8/d8e/lb4 0 2024-04-06T12:23:07.654 INFO:tasks.workunit.client.1.smithi195.stdout:1/426: creat d4/d14/d19/d23/f79 x:0 0 0 2024-04-06T12:23:07.655 INFO:tasks.workunit.client.1.smithi195.stdout:2/451: symlink d2/d21/d5e/l8a 0 2024-04-06T12:23:07.656 INFO:tasks.workunit.client.1.smithi195.stdout:9/481: dread d3/d10/d3a/f42 [0,4194304] 0 2024-04-06T12:23:07.659 INFO:tasks.workunit.client.1.smithi195.stdout:3/508: truncate d4/d9/f21 2148417 0 2024-04-06T12:23:07.661 INFO:tasks.workunit.client.1.smithi195.stdout:4/420: chown d4/d6/d38/d1a/l1e 973705 1 2024-04-06T12:23:07.662 INFO:tasks.workunit.client.1.smithi195.stdout:2/452: dwrite d2/d14/f82 [0,4194304] 0 2024-04-06T12:23:07.662 INFO:tasks.workunit.client.1.smithi195.stdout:3/509: write d4/d9/d37/f7d [461457,53293] 0 2024-04-06T12:23:07.662 INFO:tasks.workunit.client.1.smithi195.stdout:6/476: creat d8/d21/d2b/d46/d4a/fb5 x:0 0 0 2024-04-06T12:23:07.664 INFO:tasks.workunit.client.1.smithi195.stdout:2/453: dread d2/d3f/f60 [0,4194304] 0 2024-04-06T12:23:07.670 INFO:tasks.workunit.client.1.smithi195.stdout:1/427: rename d4/d14/d19/f78 to d4/d14/d19/d4e/d60/f7a 0 2024-04-06T12:23:07.672 INFO:tasks.workunit.client.1.smithi195.stdout:5/457: dwrite d0/da/f21 [0,4194304] 0 2024-04-06T12:23:07.672 INFO:tasks.workunit.client.1.smithi195.stdout:1/428: write d4/d14/d19/d23/f79 [336648,42830] 0 2024-04-06T12:23:07.673 INFO:tasks.workunit.client.1.smithi195.stdout:5/458: readlink d0/da/d13/d87/d34/l98 0 2024-04-06T12:23:07.676 INFO:tasks.workunit.client.1.smithi195.stdout:3/510: rmdir d4/d9/d2b/d3b/d5e 39 2024-04-06T12:23:07.676 INFO:tasks.workunit.client.1.smithi195.stdout:4/421: creat d4/d6/d38/d65/f7f x:0 0 0 2024-04-06T12:23:07.677 INFO:tasks.workunit.client.1.smithi195.stdout:2/454: mkdir d2/d3f/d8b 0 2024-04-06T12:23:07.679 INFO:tasks.workunit.client.1.smithi195.stdout:2/455: chown d2/d21/f39 109681309 1 2024-04-06T12:23:07.680 INFO:tasks.workunit.client.1.smithi195.stdout:9/482: unlink d3/d10/d3b/d48/c4e 0 2024-04-06T12:23:07.681 INFO:tasks.workunit.client.1.smithi195.stdout:2/456: stat d2/d21/d5e/d64/l83 0 2024-04-06T12:23:07.682 INFO:tasks.workunit.client.1.smithi195.stdout:5/459: dwrite d0/d35/f6b [0,4194304] 0 2024-04-06T12:23:07.688 INFO:tasks.workunit.client.1.smithi195.stdout:5/460: dread d0/da/d13/d87/d37/f8b [0,4194304] 0 2024-04-06T12:23:07.688 INFO:tasks.workunit.client.1.smithi195.stdout:8/421: sync 2024-04-06T12:23:07.692 INFO:tasks.workunit.client.1.smithi195.stdout:5/461: write d0/da/d13/d87/d34/f7e [1310805,105100] 0 2024-04-06T12:23:07.693 INFO:tasks.workunit.client.1.smithi195.stdout:3/511: dwrite d4/d9/d2b/d3b/d5e/d7e/f7f [0,4194304] 0 2024-04-06T12:23:07.698 INFO:tasks.workunit.client.1.smithi195.stdout:2/457: mknod d2/d21/d2c/d2d/c8c 0 2024-04-06T12:23:07.698 INFO:tasks.workunit.client.1.smithi195.stdout:9/483: getdents d3/da1 0 2024-04-06T12:23:07.699 INFO:tasks.workunit.client.1.smithi195.stdout:1/429: creat d4/d14/f7b x:0 0 0 2024-04-06T12:23:07.700 INFO:tasks.workunit.client.1.smithi195.stdout:3/512: rmdir d4/d53 39 2024-04-06T12:23:07.700 INFO:tasks.workunit.client.1.smithi195.stdout:2/458: chown d2/d21/d2c/d2d/f5c 4 1 2024-04-06T12:23:07.701 INFO:tasks.workunit.client.1.smithi195.stdout:5/462: getdents d0/da/dd/d1c/d5a/d68 0 2024-04-06T12:23:07.704 INFO:tasks.workunit.client.1.smithi195.stdout:9/484: link d3/de/f85 d3/de/fa3 0 2024-04-06T12:23:07.706 INFO:tasks.workunit.client.1.smithi195.stdout:9/485: write d3/d10/d3b/d50/f52 [2227813,82258] 0 2024-04-06T12:23:07.706 INFO:tasks.workunit.client.1.smithi195.stdout:1/430: creat d4/d14/d17/d24/d2a/d45/f7c x:0 0 0 2024-04-06T12:23:07.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/459: mkdir d2/d41/d84/d8d 0 2024-04-06T12:23:07.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/460: mknod d2/d14/c8e 0 2024-04-06T12:23:07.714 INFO:tasks.workunit.client.1.smithi195.stdout:9/486: dwrite d3/d10/d4f/f99 [0,4194304] 0 2024-04-06T12:23:07.715 INFO:tasks.workunit.client.1.smithi195.stdout:9/487: write d3/de/f21 [942670,25541] 0 2024-04-06T12:23:07.715 INFO:tasks.workunit.client.1.smithi195.stdout:1/431: rename d4/d14/d19/f6f to d4/d14/d19/d23/d5d/f7d 0 2024-04-06T12:23:07.717 INFO:tasks.workunit.client.1.smithi195.stdout:2/461: mknod d2/d21/d5e/c8f 0 2024-04-06T12:23:07.718 INFO:tasks.workunit.client.1.smithi195.stdout:2/462: truncate d2/d3f/d7d/d7a/f81 708663 0 2024-04-06T12:23:07.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/463: read d2/f12 [409240,86772] 0 2024-04-06T12:23:07.724 INFO:tasks.workunit.client.1.smithi195.stdout:9/488: mkdir d3/d10/d3b/d48/d5e/da4 0 2024-04-06T12:23:07.724 INFO:tasks.workunit.client.1.smithi195.stdout:1/432: creat d4/d14/d17/d24/d2a/d45/f7e x:0 0 0 2024-04-06T12:23:07.727 INFO:tasks.workunit.client.1.smithi195.stdout:2/464: creat d2/d21/d69/d6b/f90 x:0 0 0 2024-04-06T12:23:07.729 INFO:tasks.workunit.client.1.smithi195.stdout:2/465: read d2/d41/f49 [321949,25137] 0 2024-04-06T12:23:07.730 INFO:tasks.workunit.client.1.smithi195.stdout:9/489: mknod d3/d10/d3b/d50/ca5 0 2024-04-06T12:23:07.730 INFO:tasks.workunit.client.1.smithi195.stdout:4/422: dwrite d4/f79 [0,4194304] 0 2024-04-06T12:23:07.733 INFO:tasks.workunit.client.1.smithi195.stdout:8/422: dread d6/f1c [0,4194304] 0 2024-04-06T12:23:07.733 INFO:tasks.workunit.client.1.smithi195.stdout:9/490: read d3/de/f85 [1304120,31135] 0 2024-04-06T12:23:07.733 INFO:tasks.workunit.client.1.smithi195.stdout:1/433: mknod d4/d14/d17/d24/d2a/d45/c7f 0 2024-04-06T12:23:07.733 INFO:tasks.workunit.client.1.smithi195.stdout:4/423: chown d4/d6/d38/d1a/d40/f41 2 1 2024-04-06T12:23:07.735 INFO:tasks.workunit.client.1.smithi195.stdout:2/466: creat d2/d3f/d7d/d7a/f91 x:0 0 0 2024-04-06T12:23:07.738 INFO:tasks.workunit.client.1.smithi195.stdout:3/513: write d4/df/d39/f5a [660167,14225] 0 2024-04-06T12:23:07.738 INFO:tasks.workunit.client.1.smithi195.stdout:2/467: read d2/f61 [3578795,32324] 0 2024-04-06T12:23:07.738 INFO:tasks.workunit.client.1.smithi195.stdout:4/424: dread d4/d6/d38/d1a/d40/d57/d64/f7d [0,4194304] 0 2024-04-06T12:23:07.739 INFO:tasks.workunit.client.1.smithi195.stdout:1/434: mknod d4/d14/d19/d4e/d57/c80 0 2024-04-06T12:23:07.744 INFO:tasks.workunit.client.1.smithi195.stdout:8/423: link d6/d3a/d46/f7e d6/db/f8f 0 2024-04-06T12:23:07.753 INFO:tasks.workunit.client.1.smithi195.stdout:9/491: creat d3/fa6 x:0 0 0 2024-04-06T12:23:07.754 INFO:tasks.workunit.client.1.smithi195.stdout:8/424: rename d6/d3a/l6a to d6/dd/d70/l90 0 2024-04-06T12:23:07.757 INFO:tasks.workunit.client.1.smithi195.stdout:9/492: fsync d3/f17 0 2024-04-06T12:23:07.762 INFO:tasks.workunit.client.1.smithi195.stdout:2/468: getdents d2/d21/d2c 0 2024-04-06T12:23:07.762 INFO:tasks.workunit.client.1.smithi195.stdout:2/469: chown d2/d3f/d7d/c4c 473224 1 2024-04-06T12:23:07.763 INFO:tasks.workunit.client.1.smithi195.stdout:8/425: creat d6/f91 x:0 0 0 2024-04-06T12:23:07.764 INFO:tasks.workunit.client.1.smithi195.stdout:0/479: sync 2024-04-06T12:23:07.764 INFO:tasks.workunit.client.1.smithi195.stdout:7/361: sync 2024-04-06T12:23:07.765 INFO:tasks.workunit.client.1.smithi195.stdout:9/493: creat d3/fa7 x:0 0 0 2024-04-06T12:23:07.765 INFO:tasks.workunit.client.1.smithi195.stdout:3/514: write d4/de/d8e/f6c [1435710,10237] 0 2024-04-06T12:23:07.765 INFO:tasks.workunit.client.1.smithi195.stdout:2/470: mkdir d2/d21/d2c/d2d/d92 0 2024-04-06T12:23:07.767 INFO:tasks.workunit.client.1.smithi195.stdout:9/494: chown d3/d10/d3b/c41 1 1 2024-04-06T12:23:07.767 INFO:tasks.workunit.client.1.smithi195.stdout:2/471: write d2/f79 [95699,36012] 0 2024-04-06T12:23:07.769 INFO:tasks.workunit.client.1.smithi195.stdout:9/495: fsync d3/d10/d3a/f80 0 2024-04-06T12:23:07.769 INFO:tasks.workunit.client.1.smithi195.stdout:2/472: chown d2/f26 237063745 1 2024-04-06T12:23:07.771 INFO:tasks.workunit.client.1.smithi195.stdout:3/515: creat d4/de/d8e/fa2 x:0 0 0 2024-04-06T12:23:07.771 INFO:tasks.workunit.client.1.smithi195.stdout:0/480: mknod d4/d6/d1a/d73/c9a 0 2024-04-06T12:23:07.773 INFO:tasks.workunit.client.1.smithi195.stdout:7/362: truncate d4/d16/dd/f2a 4290313 0 2024-04-06T12:23:07.775 INFO:tasks.workunit.client.1.smithi195.stdout:4/425: dwrite d4/d6/d38/d1a/d40/d20/d23/f63 [0,4194304] 0 2024-04-06T12:23:07.775 INFO:tasks.workunit.client.1.smithi195.stdout:3/516: dread - d4/d9/f49 zero size 2024-04-06T12:23:07.775 INFO:tasks.workunit.client.1.smithi195.stdout:2/473: truncate d2/d3f/d7d/f68 671191 0 2024-04-06T12:23:07.777 INFO:tasks.workunit.client.1.smithi195.stdout:0/481: creat d4/d65/f9b x:0 0 0 2024-04-06T12:23:07.778 INFO:tasks.workunit.client.1.smithi195.stdout:8/426: rmdir d6 39 2024-04-06T12:23:07.779 INFO:tasks.workunit.client.1.smithi195.stdout:1/435: dwrite d4/d14/d17/d24/f6b [0,4194304] 0 2024-04-06T12:23:07.782 INFO:tasks.workunit.client.1.smithi195.stdout:8/427: fsync d6/dd/d70/d24/f32 0 2024-04-06T12:23:07.783 INFO:tasks.workunit.client.1.smithi195.stdout:9/496: dwrite d3/d10/d3b/d50/f52 [0,4194304] 0 2024-04-06T12:23:07.786 INFO:tasks.workunit.client.1.smithi195.stdout:1/436: write d4/d14/d19/f4d [5121257,2161] 0 2024-04-06T12:23:07.786 INFO:tasks.workunit.client.1.smithi195.stdout:9/497: chown d3/de/f85 4 1 2024-04-06T12:23:07.786 INFO:tasks.workunit.client.1.smithi195.stdout:1/437: fsync f1 0 2024-04-06T12:23:07.789 INFO:tasks.workunit.client.1.smithi195.stdout:0/482: creat d4/d48/d67/d83/d94/f9c x:0 0 0 2024-04-06T12:23:07.793 INFO:tasks.workunit.client.1.smithi195.stdout:7/363: dread d4/d16/dd/f28 [0,4194304] 0 2024-04-06T12:23:07.793 INFO:tasks.workunit.client.1.smithi195.stdout:0/483: write d4/d48/f89 [4703474,26871] 0 2024-04-06T12:23:07.794 INFO:tasks.workunit.client.1.smithi195.stdout:8/428: dread d6/d3a/d46/f50 [0,4194304] 0 2024-04-06T12:23:07.798 INFO:tasks.workunit.client.1.smithi195.stdout:7/364: creat d4/d5d/f77 x:0 0 0 2024-04-06T12:23:07.798 INFO:tasks.workunit.client.1.smithi195.stdout:9/498: dwrite d3/d10/d3a/d5d/f63 [0,4194304] 0 2024-04-06T12:23:07.802 INFO:tasks.workunit.client.1.smithi195.stdout:0/484: unlink d4/d6/f2c 0 2024-04-06T12:23:07.830 INFO:tasks.workunit.client.1.smithi195.stdout:5/463: sync 2024-04-06T12:23:07.831 INFO:tasks.workunit.client.1.smithi195.stdout:6/477: sync 2024-04-06T12:23:07.834 INFO:tasks.workunit.client.1.smithi195.stdout:1/438: truncate d4/d14/d19/f20 3428839 0 2024-04-06T12:23:07.834 INFO:tasks.workunit.client.1.smithi195.stdout:7/365: rmdir d4/d16 39 2024-04-06T12:23:07.836 INFO:tasks.workunit.client.1.smithi195.stdout:1/439: write d4/d14/d17/d24/d2a/f54 [2036279,42040] 0 2024-04-06T12:23:07.838 INFO:tasks.workunit.client.1.smithi195.stdout:5/464: readlink d0/da/d13/l32 0 2024-04-06T12:23:07.840 INFO:tasks.workunit.client.1.smithi195.stdout:0/485: link d4/d48/f5a d4/d48/d67/f9d 0 2024-04-06T12:23:07.841 INFO:tasks.workunit.client.1.smithi195.stdout:6/478: mkdir d8/d21/d31/d6c/db6 0 2024-04-06T12:23:07.842 INFO:tasks.workunit.client.1.smithi195.stdout:7/366: unlink d4/d16/dd/d22/d3f/d54/l5b 0 2024-04-06T12:23:07.845 INFO:tasks.workunit.client.1.smithi195.stdout:5/465: symlink d0/la5 0 2024-04-06T12:23:07.845 INFO:tasks.workunit.client.1.smithi195.stdout:9/499: dwrite d3/d10/f22 [0,4194304] 0 2024-04-06T12:23:07.850 INFO:tasks.workunit.client.1.smithi195.stdout:6/479: dread d8/f14 [0,4194304] 0 2024-04-06T12:23:07.850 INFO:tasks.workunit.client.1.smithi195.stdout:7/367: rename d4/d4a/f65 to d4/d16/dd/f78 0 2024-04-06T12:23:07.852 INFO:tasks.workunit.client.1.smithi195.stdout:8/429: dread d6/dd/d70/d24/f32 [0,4194304] 0 2024-04-06T12:23:07.853 INFO:tasks.workunit.client.1.smithi195.stdout:8/430: chown d6/dd/l1a 395365 1 2024-04-06T12:23:07.853 INFO:tasks.workunit.client.1.smithi195.stdout:5/466: creat d0/da/d13/d87/d37/fa6 x:0 0 0 2024-04-06T12:23:07.855 INFO:tasks.workunit.client.1.smithi195.stdout:7/368: stat d4/d24/f64 0 2024-04-06T12:23:07.855 INFO:tasks.workunit.client.1.smithi195.stdout:0/486: dread d4/d48/d67/f9d [0,4194304] 0 2024-04-06T12:23:07.856 INFO:tasks.workunit.client.1.smithi195.stdout:6/480: symlink d8/d21/d2b/d46/lb7 0 2024-04-06T12:23:07.857 INFO:tasks.workunit.client.1.smithi195.stdout:1/440: truncate d4/d14/d19/f4d 3381954 0 2024-04-06T12:23:07.858 INFO:tasks.workunit.client.1.smithi195.stdout:5/467: mkdir d0/da/d13/d5e/da7 0 2024-04-06T12:23:07.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/369: dread d4/d16/dd/f28 [0,4194304] 0 2024-04-06T12:23:07.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/370: chown d4/la 2014136 1 2024-04-06T12:23:07.860 INFO:tasks.workunit.client.1.smithi195.stdout:0/487: mknod d4/d48/d67/d75/c9e 0 2024-04-06T12:23:07.863 INFO:tasks.workunit.client.1.smithi195.stdout:7/371: creat d4/d16/d11/f79 x:0 0 0 2024-04-06T12:23:07.863 INFO:tasks.workunit.client.1.smithi195.stdout:7/372: stat d4/d5d 0 2024-04-06T12:23:07.879 INFO:tasks.workunit.client.1.smithi195.stdout:5/468: mknod d0/da/d13/d5e/da7/ca8 0 2024-04-06T12:23:07.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/431: write d6/dd/d70/d24/d25/f2a [111691,61086] 0 2024-04-06T12:23:07.882 INFO:tasks.workunit.client.1.smithi195.stdout:1/441: rmdir d4/d14/d19/d4e/d57/d64 0 2024-04-06T12:23:07.882 INFO:tasks.workunit.client.1.smithi195.stdout:5/469: fsync d0/da/dd/d2e/f6c 0 2024-04-06T12:23:07.886 INFO:tasks.workunit.client.1.smithi195.stdout:9/500: dwrite d3/d10/d3a/f42 [0,4194304] 0 2024-04-06T12:23:07.886 INFO:tasks.workunit.client.1.smithi195.stdout:8/432: write d6/dd/d70/d24/d34/f57 [1311525,70785] 0 2024-04-06T12:23:07.887 INFO:tasks.workunit.client.1.smithi195.stdout:7/373: dwrite d4/d10/d12/f2e [0,4194304] 0 2024-04-06T12:23:07.888 INFO:tasks.workunit.client.1.smithi195.stdout:8/433: fdatasync d6/d8/d52/f8d 0 2024-04-06T12:23:07.888 INFO:tasks.workunit.client.1.smithi195.stdout:5/470: read d0/da/d23/f61 [16342,109775] 0 2024-04-06T12:23:07.893 INFO:tasks.workunit.client.1.smithi195.stdout:5/471: chown d0/da/dd/d2e/d6f/f51 46 1 2024-04-06T12:23:07.893 INFO:tasks.workunit.client.1.smithi195.stdout:8/434: mknod d6/d3a/d46/c92 0 2024-04-06T12:23:07.893 INFO:tasks.workunit.client.1.smithi195.stdout:7/374: write d4/d10/d12/f72 [499798,10370] 0 2024-04-06T12:23:07.894 INFO:tasks.workunit.client.1.smithi195.stdout:9/501: link d3/f43 d3/d10/d3a/fa8 0 2024-04-06T12:23:07.895 INFO:tasks.workunit.client.1.smithi195.stdout:8/435: stat d6/db/lc 0 2024-04-06T12:23:07.899 INFO:tasks.workunit.client.1.smithi195.stdout:8/436: chown d6/dd/d70/d24/d25/d49 5218 1 2024-04-06T12:23:07.900 INFO:tasks.workunit.client.1.smithi195.stdout:5/472: creat d0/da/dd/d1c/d5a/d62/fa9 x:0 0 0 2024-04-06T12:23:07.904 INFO:tasks.workunit.client.1.smithi195.stdout:1/442: dwrite d4/d14/d19/f1a [0,4194304] 0 2024-04-06T12:23:07.906 INFO:tasks.workunit.client.1.smithi195.stdout:4/426: sync 2024-04-06T12:23:07.912 INFO:tasks.workunit.client.1.smithi195.stdout:8/437: dwrite d6/dd/d70/d24/f32 [0,4194304] 0 2024-04-06T12:23:07.912 INFO:tasks.workunit.client.1.smithi195.stdout:9/502: truncate d3/d10/d3a/d5d/f65 5200043 0 2024-04-06T12:23:07.914 INFO:tasks.workunit.client.1.smithi195.stdout:0/488: dread d4/d6/d1a/f54 [0,4194304] 0 2024-04-06T12:23:07.914 INFO:tasks.workunit.client.1.smithi195.stdout:9/503: chown d3/da1 1343504 1 2024-04-06T12:23:07.916 INFO:tasks.workunit.client.1.smithi195.stdout:1/443: getdents d4/d14/d17 0 2024-04-06T12:23:07.918 INFO:tasks.workunit.client.1.smithi195.stdout:4/427: write d4/d6/d38/d1a/d40/d57/d64/f7d [1167172,34439] 0 2024-04-06T12:23:07.919 INFO:tasks.workunit.client.1.smithi195.stdout:9/504: truncate d3/d10/d3b/d48/d9c/f91 978701 0 2024-04-06T12:23:07.920 INFO:tasks.workunit.client.1.smithi195.stdout:0/489: mkdir d4/d6/d1a/d9f 0 2024-04-06T12:23:07.921 INFO:tasks.workunit.client.1.smithi195.stdout:1/444: fsync d4/d14/d19/d23/d5d/f7d 0 2024-04-06T12:23:07.923 INFO:tasks.workunit.client.1.smithi195.stdout:0/490: fsync d4/d48/f5a 0 2024-04-06T12:23:07.924 INFO:tasks.workunit.client.1.smithi195.stdout:5/473: dread d0/da/d23/d38/f44 [0,4194304] 0 2024-04-06T12:23:07.927 INFO:tasks.workunit.client.1.smithi195.stdout:9/505: link d3/f43 d3/d10/d4f/fa9 0 2024-04-06T12:23:07.927 INFO:tasks.workunit.client.1.smithi195.stdout:7/375: dread d4/d16/f1c [0,4194304] 0 2024-04-06T12:23:07.929 INFO:tasks.workunit.client.1.smithi195.stdout:9/506: dread - d3/d10/d3a/f92 zero size 2024-04-06T12:23:07.929 INFO:tasks.workunit.client.1.smithi195.stdout:0/491: mknod d4/d6/d2f/ca0 0 2024-04-06T12:23:07.930 INFO:tasks.workunit.client.1.smithi195.stdout:1/445: getdents d4/d14/d19/d23/d28/d2f 0 2024-04-06T12:23:07.931 INFO:tasks.workunit.client.1.smithi195.stdout:9/507: symlink d3/de/laa 0 2024-04-06T12:23:07.932 INFO:tasks.workunit.client.1.smithi195.stdout:8/438: dread d6/dd/d70/d24/d34/d67/f6c [4194304,4194304] 0 2024-04-06T12:23:07.932 INFO:tasks.workunit.client.1.smithi195.stdout:9/508: chown d3/d10/d4f 8 1 2024-04-06T12:23:07.932 INFO:tasks.workunit.client.1.smithi195.stdout:7/376: creat d4/d16/dd/d22/d76/f7a x:0 0 0 2024-04-06T12:23:07.933 INFO:tasks.workunit.client.1.smithi195.stdout:5/474: getdents d0/da/dd/d2e/d6f/d58 0 2024-04-06T12:23:07.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/439: fsync d6/d8/d12/f37 0 2024-04-06T12:23:07.935 INFO:tasks.workunit.client.1.smithi195.stdout:7/377: write d4/d16/f2d [814267,110301] 0 2024-04-06T12:23:07.935 INFO:tasks.workunit.client.1.smithi195.stdout:9/509: truncate d3/d10/d3b/d48/d9c/f91 1531797 0 2024-04-06T12:23:07.936 INFO:tasks.workunit.client.1.smithi195.stdout:7/378: write d4/d10/d12/f61 [4046100,90095] 0 2024-04-06T12:23:07.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/446: rename l0 to d4/d14/d19/d23/l81 0 2024-04-06T12:23:07.942 INFO:tasks.workunit.client.1.smithi195.stdout:8/440: creat d6/dd/d70/d24/d25/f93 x:0 0 0 2024-04-06T12:23:07.945 INFO:tasks.workunit.client.1.smithi195.stdout:0/492: rename d4/d6/d2f/f45 to d4/d48/d67/d75/fa1 0 2024-04-06T12:23:07.948 INFO:tasks.workunit.client.1.smithi195.stdout:1/447: symlink d4/l82 0 2024-04-06T12:23:07.953 INFO:tasks.workunit.client.1.smithi195.stdout:7/379: mknod d4/d10/c7b 0 2024-04-06T12:23:07.954 INFO:tasks.workunit.client.1.smithi195.stdout:7/380: truncate d4/d10/f27 4849532 0 2024-04-06T12:23:07.955 INFO:tasks.workunit.client.1.smithi195.stdout:1/448: unlink d4/d14/d17/d24/d2a/d45/c6a 0 2024-04-06T12:23:07.956 INFO:tasks.workunit.client.1.smithi195.stdout:8/441: mknod d6/d8/d12/d83/c94 0 2024-04-06T12:23:07.957 INFO:tasks.workunit.client.1.smithi195.stdout:5/475: getdents d0/da/dd/d1c 0 2024-04-06T12:23:07.957 INFO:tasks.workunit.client.1.smithi195.stdout:8/442: dread - d6/d8/f58 zero size 2024-04-06T12:23:07.958 INFO:tasks.workunit.client.1.smithi195.stdout:9/510: rename d3/d10/d4f/f57 to d3/d10/d3b/fab 0 2024-04-06T12:23:07.959 INFO:tasks.workunit.client.1.smithi195.stdout:7/381: symlink d4/d16/dd/d22/d3f/l7c 0 2024-04-06T12:23:07.959 INFO:tasks.workunit.client.1.smithi195.stdout:5/476: fdatasync d0/da/dd/f89 0 2024-04-06T12:23:07.961 INFO:tasks.workunit.client.1.smithi195.stdout:0/493: dwrite d4/d6/d58/f8b [0,4194304] 0 2024-04-06T12:23:07.961 INFO:tasks.workunit.client.1.smithi195.stdout:7/382: fsync d4/d10/d18/f53 0 2024-04-06T12:23:07.962 INFO:tasks.workunit.client.1.smithi195.stdout:5/477: chown d0/da/d13/d5e/da7/ca8 11581246 1 2024-04-06T12:23:07.963 INFO:tasks.workunit.client.1.smithi195.stdout:1/449: rename d4/l36 to d4/d14/d17/d24/d2a/d45/l83 0 2024-04-06T12:23:07.968 INFO:tasks.workunit.client.1.smithi195.stdout:9/511: dread d3/d10/f61 [0,4194304] 0 2024-04-06T12:23:07.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/478: creat d0/da/dd/d2e/d6f/d58/d78/faa x:0 0 0 2024-04-06T12:23:07.972 INFO:tasks.workunit.client.1.smithi195.stdout:1/450: creat d4/d14/d19/f84 x:0 0 0 2024-04-06T12:23:07.974 INFO:tasks.workunit.client.1.smithi195.stdout:0/494: dwrite d4/d6/d1a/f3f [0,4194304] 0 2024-04-06T12:23:07.974 INFO:tasks.workunit.client.1.smithi195.stdout:9/512: creat d3/d10/d3b/d48/d5e/fac x:0 0 0 2024-04-06T12:23:07.976 INFO:tasks.workunit.client.1.smithi195.stdout:3/517: sync 2024-04-06T12:23:07.976 INFO:tasks.workunit.client.1.smithi195.stdout:2/474: sync 2024-04-06T12:23:07.978 INFO:tasks.workunit.client.1.smithi195.stdout:2/475: write d2/d21/d2c/d2d/f76 [3063637,30224] 0 2024-04-06T12:23:07.978 INFO:tasks.workunit.client.1.smithi195.stdout:7/383: rename f0 to d4/d10/d18/d33/d6e/f7d 0 2024-04-06T12:23:07.978 INFO:tasks.workunit.client.1.smithi195.stdout:2/476: chown d2/la 82 1 2024-04-06T12:23:07.980 INFO:tasks.workunit.client.1.smithi195.stdout:5/479: fdatasync d0/da/d23/f61 0 2024-04-06T12:23:07.990 INFO:tasks.workunit.client.1.smithi195.stdout:3/518: symlink d4/d9/d2b/d3b/d5e/d7e/la3 0 2024-04-06T12:23:07.991 INFO:tasks.workunit.client.1.smithi195.stdout:3/519: write d4/de/f34 [734083,16454] 0 2024-04-06T12:23:07.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/384: unlink d4/d10/d18/d33/f56 0 2024-04-06T12:23:07.999 INFO:tasks.workunit.client.1.smithi195.stdout:7/385: chown d4/d10/d18/d33/d6e/f7d 3379387 1 2024-04-06T12:23:08.000 INFO:tasks.workunit.client.1.smithi195.stdout:0/495: dread d4/fd [0,4194304] 0 2024-04-06T12:23:08.004 INFO:tasks.workunit.client.1.smithi195.stdout:1/451: write d4/d14/d19/d23/d28/f2b [1094971,20225] 0 2024-04-06T12:23:08.004 INFO:tasks.workunit.client.1.smithi195.stdout:1/452: chown d4/d14/d19/d23/d28/d2f 477215 1 2024-04-06T12:23:08.005 INFO:tasks.workunit.client.1.smithi195.stdout:1/453: dread - d4/d14/d17/d24/f4a zero size 2024-04-06T12:23:08.005 INFO:tasks.workunit.client.1.smithi195.stdout:2/477: link d2/d21/f39 d2/d3f/d7d/d7a/f93 0 2024-04-06T12:23:08.007 INFO:tasks.workunit.client.1.smithi195.stdout:5/480: mkdir d0/da/dd/d2e/d6f/dab 0 2024-04-06T12:23:08.008 INFO:tasks.workunit.client.1.smithi195.stdout:8/443: link d6/dd/d70/d24/d25/f54 d6/d8/f95 0 2024-04-06T12:23:08.008 INFO:tasks.workunit.client.1.smithi195.stdout:5/481: write d0/f30 [360223,2456] 0 2024-04-06T12:23:08.008 INFO:tasks.workunit.client.1.smithi195.stdout:7/386: rmdir d4 39 2024-04-06T12:23:08.009 INFO:tasks.workunit.client.1.smithi195.stdout:6/481: sync 2024-04-06T12:23:08.010 INFO:tasks.workunit.client.1.smithi195.stdout:3/520: unlink d4/de/d8e/l58 0 2024-04-06T12:23:08.011 INFO:tasks.workunit.client.1.smithi195.stdout:2/478: unlink d2/l44 0 2024-04-06T12:23:08.014 INFO:tasks.workunit.client.1.smithi195.stdout:2/479: readlink d2/d21/l4f 0 2024-04-06T12:23:08.014 INFO:tasks.workunit.client.1.smithi195.stdout:0/496: truncate d4/d6/f6b 390778 0 2024-04-06T12:23:08.015 INFO:tasks.workunit.client.1.smithi195.stdout:9/513: dwrite d3/d10/d3a/fa8 [0,4194304] 0 2024-04-06T12:23:08.016 INFO:tasks.workunit.client.1.smithi195.stdout:5/482: creat d0/da/dd/d2e/d6f/d58/d78/fac x:0 0 0 2024-04-06T12:23:08.017 INFO:tasks.workunit.client.1.smithi195.stdout:8/444: mknod d6/dd/d70/d24/d25/d49/c96 0 2024-04-06T12:23:08.020 INFO:tasks.workunit.client.1.smithi195.stdout:6/482: rename d8/d3d/d3f/l74 to d8/d50/d32/lb8 0 2024-04-06T12:23:08.023 INFO:tasks.workunit.client.1.smithi195.stdout:1/454: getdents d4/d14 0 2024-04-06T12:23:08.026 INFO:tasks.workunit.client.1.smithi195.stdout:5/483: symlink d0/da/d23/lad 0 2024-04-06T12:23:08.027 INFO:tasks.workunit.client.1.smithi195.stdout:7/387: dwrite d4/d16/f6a [4194304,4194304] 0 2024-04-06T12:23:08.028 INFO:tasks.workunit.client.1.smithi195.stdout:5/484: chown d0/da/dd/d2e/d6f/f96 628837017 1 2024-04-06T12:23:08.029 INFO:tasks.workunit.client.1.smithi195.stdout:9/514: symlink d3/de/lad 0 2024-04-06T12:23:08.031 INFO:tasks.workunit.client.1.smithi195.stdout:9/515: write d3/d10/d3b/d48/f69 [651883,127454] 0 2024-04-06T12:23:08.034 INFO:tasks.workunit.client.1.smithi195.stdout:6/483: creat d8/d21/d31/d26/fb9 x:0 0 0 2024-04-06T12:23:08.034 INFO:tasks.workunit.client.1.smithi195.stdout:3/521: mkdir d4/de/d8e/d92/d9e/da4 0 2024-04-06T12:23:08.035 INFO:tasks.workunit.client.1.smithi195.stdout:2/480: mkdir d2/d41/d84/d8d/d94 0 2024-04-06T12:23:08.035 INFO:tasks.workunit.client.1.smithi195.stdout:8/445: write d6/dd/d70/d24/d25/d5e/f64 [736074,27225] 0 2024-04-06T12:23:08.037 INFO:tasks.workunit.client.1.smithi195.stdout:6/484: dread f5 [0,4194304] 0 2024-04-06T12:23:08.037 INFO:tasks.workunit.client.1.smithi195.stdout:1/455: rename d4/d14/f7b to d4/d14/d17/f85 0 2024-04-06T12:23:08.038 INFO:tasks.workunit.client.1.smithi195.stdout:8/446: write d6/dd/d70/f3b [2705578,22252] 0 2024-04-06T12:23:08.039 INFO:tasks.workunit.client.1.smithi195.stdout:6/485: chown d8/d21/d2b/f48 68 1 2024-04-06T12:23:08.041 INFO:tasks.workunit.client.1.smithi195.stdout:4/428: sync 2024-04-06T12:23:08.044 INFO:tasks.workunit.client.1.smithi195.stdout:5/485: creat d0/da/dd/d1c/fae x:0 0 0 2024-04-06T12:23:08.046 INFO:tasks.workunit.client.1.smithi195.stdout:0/497: write d4/d48/d67/f6a [1182611,61958] 0 2024-04-06T12:23:08.053 INFO:tasks.workunit.client.1.smithi195.stdout:2/481: write d2/f4 [1322806,90077] 0 2024-04-06T12:23:08.053 INFO:tasks.workunit.client.1.smithi195.stdout:7/388: mkdir d4/d10/d18/d7e 0 2024-04-06T12:23:08.054 INFO:tasks.workunit.client.1.smithi195.stdout:2/482: fsync d2/d21/d69/d6b/f6e 0 2024-04-06T12:23:08.054 INFO:tasks.workunit.client.1.smithi195.stdout:4/429: symlink d4/d6/d38/d1a/d40/d57/d64/l80 0 2024-04-06T12:23:08.055 INFO:tasks.workunit.client.1.smithi195.stdout:9/516: creat d3/da1/fae x:0 0 0 2024-04-06T12:23:08.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/483: chown d2/d21/f28 16903 1 2024-04-06T12:23:08.057 INFO:tasks.workunit.client.1.smithi195.stdout:0/498: symlink d4/d48/d4e/la2 0 2024-04-06T12:23:08.057 INFO:tasks.workunit.client.1.smithi195.stdout:0/499: chown d4/d48/d4e 7660 1 2024-04-06T12:23:08.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/522: symlink d4/d9/d2b/d87/la5 0 2024-04-06T12:23:08.059 INFO:tasks.workunit.client.1.smithi195.stdout:2/484: truncate d2/d3f/d7d/d7a/f81 1021951 0 2024-04-06T12:23:08.059 INFO:tasks.workunit.client.1.smithi195.stdout:8/447: readlink d6/d8/d12/l2d 0 2024-04-06T12:23:08.059 INFO:tasks.workunit.client.1.smithi195.stdout:0/500: write d4/d48/f56 [964288,97583] 0 2024-04-06T12:23:08.060 INFO:tasks.workunit.client.1.smithi195.stdout:7/389: creat d4/d10/d18/d57/f7f x:0 0 0 2024-04-06T12:23:08.061 INFO:tasks.workunit.client.1.smithi195.stdout:5/486: symlink d0/da/d23/d38/d41/d7d/laf 0 2024-04-06T12:23:08.061 INFO:tasks.workunit.client.1.smithi195.stdout:9/517: rmdir d3/d10/d7d 39 2024-04-06T12:23:08.062 INFO:tasks.workunit.client.1.smithi195.stdout:4/430: symlink d4/d6/d38/d65/d7a/l81 0 2024-04-06T12:23:08.063 INFO:tasks.workunit.client.1.smithi195.stdout:4/431: truncate d4/f79 4484410 0 2024-04-06T12:23:08.064 INFO:tasks.workunit.client.1.smithi195.stdout:6/486: rename d8/d21/d2b/d46/c69 to d8/d50/cba 0 2024-04-06T12:23:08.065 INFO:tasks.workunit.client.1.smithi195.stdout:1/456: creat d4/d14/d19/d4e/d60/f86 x:0 0 0 2024-04-06T12:23:08.066 INFO:tasks.workunit.client.1.smithi195.stdout:8/448: rmdir d6/dd/d42 39 2024-04-06T12:23:08.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/449: read - d6/dd/d70/d24/f4e zero size 2024-04-06T12:23:08.068 INFO:tasks.workunit.client.1.smithi195.stdout:0/501: mknod d4/d6/d1a/d73/ca3 0 2024-04-06T12:23:08.069 INFO:tasks.workunit.client.1.smithi195.stdout:5/487: creat d0/d35/fb0 x:0 0 0 2024-04-06T12:23:08.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/518: unlink d3/d10/d3a/d5d/l83 0 2024-04-06T12:23:08.071 INFO:tasks.workunit.client.1.smithi195.stdout:9/519: stat d3/d10/f29 0 2024-04-06T12:23:08.072 INFO:tasks.workunit.client.1.smithi195.stdout:9/520: dread - d3/d10/d3a/d5d/f93 zero size 2024-04-06T12:23:08.073 INFO:tasks.workunit.client.1.smithi195.stdout:7/390: rename d4/d4a to d4/d24/d80 0 2024-04-06T12:23:08.074 INFO:tasks.workunit.client.1.smithi195.stdout:5/488: dwrite d0/da/dd/d2e/f4c [0,4194304] 0 2024-04-06T12:23:08.076 INFO:tasks.workunit.client.1.smithi195.stdout:1/457: write d4/d14/d17/d24/d2a/f54 [3548235,94363] 0 2024-04-06T12:23:08.076 INFO:tasks.workunit.client.1.smithi195.stdout:5/489: write d0/da/dd/d33/f53 [233120,93908] 0 2024-04-06T12:23:08.079 INFO:tasks.workunit.client.1.smithi195.stdout:2/485: mkdir d2/d21/d2c/d2d/d92/d95 0 2024-04-06T12:23:08.079 INFO:tasks.workunit.client.1.smithi195.stdout:8/450: mkdir d6/db/d47/d97 0 2024-04-06T12:23:08.096 INFO:tasks.workunit.client.1.smithi195.stdout:0/502: write d4/d6/d1a/f34 [3503848,10362] 0 2024-04-06T12:23:08.097 INFO:tasks.workunit.client.1.smithi195.stdout:7/391: rmdir d4/d16/dd/d22/d76 39 2024-04-06T12:23:08.097 INFO:tasks.workunit.client.1.smithi195.stdout:3/523: fsync d4/d9/d2b/d3b/d40/f45 0 2024-04-06T12:23:08.099 INFO:tasks.workunit.client.1.smithi195.stdout:5/490: read - d0/da/f3c zero size 2024-04-06T12:23:08.101 INFO:tasks.workunit.client.1.smithi195.stdout:7/392: write d4/d10/f40 [4548553,71869] 0 2024-04-06T12:23:08.102 INFO:tasks.workunit.client.1.smithi195.stdout:1/458: dwrite d4/d14/d19/f68 [0,4194304] 0 2024-04-06T12:23:08.103 INFO:tasks.workunit.client.1.smithi195.stdout:5/491: chown d0/d35/fb0 219409996 1 2024-04-06T12:23:08.103 INFO:tasks.workunit.client.1.smithi195.stdout:6/487: link d8/d3d/d5e/l6f d8/d21/d2b/lbb 0 2024-04-06T12:23:08.104 INFO:tasks.workunit.client.1.smithi195.stdout:0/503: symlink d4/d65/d8f/la4 0 2024-04-06T12:23:08.104 INFO:tasks.workunit.client.1.smithi195.stdout:8/451: readlink d6/d8/d12/l8a 0 2024-04-06T12:23:08.110 INFO:tasks.workunit.client.1.smithi195.stdout:7/393: mknod d4/d10/d12/c81 0 2024-04-06T12:23:08.111 INFO:tasks.workunit.client.1.smithi195.stdout:5/492: rmdir d0/da/d13/d87/d37 39 2024-04-06T12:23:08.115 INFO:tasks.workunit.client.1.smithi195.stdout:8/452: unlink d6/dd/d70/d24/d25/d5e/f64 0 2024-04-06T12:23:08.116 INFO:tasks.workunit.client.1.smithi195.stdout:4/432: dwrite d4/d6/d38/f51 [0,4194304] 0 2024-04-06T12:23:08.116 INFO:tasks.workunit.client.1.smithi195.stdout:5/493: chown d0/f94 6724 1 2024-04-06T12:23:08.118 INFO:tasks.workunit.client.1.smithi195.stdout:7/394: mkdir d4/d5d/d82 0 2024-04-06T12:23:08.127 INFO:tasks.workunit.client.1.smithi195.stdout:2/486: dwrite d2/d3f/f60 [0,4194304] 0 2024-04-06T12:23:08.129 INFO:tasks.workunit.client.1.smithi195.stdout:7/395: write d4/f7 [3066403,937] 0 2024-04-06T12:23:08.130 INFO:tasks.workunit.client.1.smithi195.stdout:5/494: write d0/da/f22 [956807,97010] 0 2024-04-06T12:23:08.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/453: fsync d6/d8/d12/f2f 0 2024-04-06T12:23:08.136 INFO:tasks.workunit.client.1.smithi195.stdout:6/488: dwrite d8/d21/d2b/d46/d4a/fb5 [0,4194304] 0 2024-04-06T12:23:08.136 INFO:tasks.workunit.client.1.smithi195.stdout:3/524: dwrite d4/df/d39/f98 [0,4194304] 0 2024-04-06T12:23:08.138 INFO:tasks.workunit.client.1.smithi195.stdout:1/459: dwrite d4/d14/d19/d4e/d60/f86 [0,4194304] 0 2024-04-06T12:23:08.142 INFO:tasks.workunit.client.1.smithi195.stdout:4/433: creat d4/d6/d38/d1a/d40/d20/d23/f82 x:0 0 0 2024-04-06T12:23:08.142 INFO:tasks.workunit.client.1.smithi195.stdout:0/504: dwrite d4/fd [0,4194304] 0 2024-04-06T12:23:08.143 INFO:tasks.workunit.client.1.smithi195.stdout:5/495: truncate d0/f24 4470258 0 2024-04-06T12:23:08.143 INFO:tasks.workunit.client.1.smithi195.stdout:7/396: mknod d4/d10/d18/d33/d6e/c83 0 2024-04-06T12:23:08.147 INFO:tasks.workunit.client.1.smithi195.stdout:0/505: fdatasync d4/f61 0 2024-04-06T12:23:08.147 INFO:tasks.workunit.client.1.smithi195.stdout:8/454: mkdir d6/d8/d12/d83/d98 0 2024-04-06T12:23:08.148 INFO:tasks.workunit.client.1.smithi195.stdout:3/525: mknod d4/d9/d2b/d3b/d5e/ca6 0 2024-04-06T12:23:08.148 INFO:tasks.workunit.client.1.smithi195.stdout:1/460: symlink d4/d14/d19/d4e/d57/l87 0 2024-04-06T12:23:08.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/496: mknod d0/d52/d91/cb1 0 2024-04-06T12:23:08.156 INFO:tasks.workunit.client.1.smithi195.stdout:2/487: link d2/d3f/d7d/d7a/f91 d2/d41/f96 0 2024-04-06T12:23:08.157 INFO:tasks.workunit.client.1.smithi195.stdout:3/526: mkdir d4/df/d39/da7 0 2024-04-06T12:23:08.158 INFO:tasks.workunit.client.1.smithi195.stdout:1/461: mkdir d4/d14/d19/d88 0 2024-04-06T12:23:08.161 INFO:tasks.workunit.client.1.smithi195.stdout:4/434: link d4/d6/d38/d1a/d40/d20/f61 d4/d6/d38/d65/d7a/f83 0 2024-04-06T12:23:08.162 INFO:tasks.workunit.client.1.smithi195.stdout:6/489: creat d8/d21/d31/fbc x:0 0 0 2024-04-06T12:23:08.163 INFO:tasks.workunit.client.1.smithi195.stdout:2/488: dwrite d2/d3f/f80 [0,4194304] 0 2024-04-06T12:23:08.163 INFO:tasks.workunit.client.1.smithi195.stdout:4/435: chown d4/d6/d38/d1a/d40/f3b 96 1 2024-04-06T12:23:08.163 INFO:tasks.workunit.client.1.smithi195.stdout:6/490: write d8/f19 [1604433,40976] 0 2024-04-06T12:23:08.169 INFO:tasks.workunit.client.1.smithi195.stdout:5/497: creat d0/d35/fb2 x:0 0 0 2024-04-06T12:23:08.169 INFO:tasks.workunit.client.1.smithi195.stdout:1/462: symlink d4/d14/d19/d23/d5d/l89 0 2024-04-06T12:23:08.170 INFO:tasks.workunit.client.1.smithi195.stdout:1/463: read - d4/f1c zero size 2024-04-06T12:23:08.172 INFO:tasks.workunit.client.1.smithi195.stdout:8/455: creat d6/d8/f99 x:0 0 0 2024-04-06T12:23:08.172 INFO:tasks.workunit.client.1.smithi195.stdout:5/498: truncate d0/da/dd/d1c/fae 259106 0 2024-04-06T12:23:08.173 INFO:tasks.workunit.client.1.smithi195.stdout:2/489: dwrite d2/d3f/d7d/f54 [4194304,4194304] 0 2024-04-06T12:23:08.175 INFO:tasks.workunit.client.1.smithi195.stdout:4/436: rename d4/d6/d38/d1a/d40/d20/d23/f63 to d4/d6/d38/d65/f84 0 2024-04-06T12:23:08.175 INFO:tasks.workunit.client.1.smithi195.stdout:5/499: write d0/da/dd/d2e/f70 [780643,31865] 0 2024-04-06T12:23:08.176 INFO:tasks.workunit.client.1.smithi195.stdout:8/456: write d6/dd/d70/d24/f39 [2185105,59628] 0 2024-04-06T12:23:08.179 INFO:tasks.workunit.client.1.smithi195.stdout:5/500: stat d0/da/dd/d2e/f90 0 2024-04-06T12:23:08.180 INFO:tasks.workunit.client.1.smithi195.stdout:8/457: truncate d6/d3a/f8e 70455 0 2024-04-06T12:23:08.181 INFO:tasks.workunit.client.1.smithi195.stdout:1/464: dwrite d4/d14/d17/d24/f27 [0,4194304] 0 2024-04-06T12:23:08.182 INFO:tasks.workunit.client.1.smithi195.stdout:1/465: write d4/d14/d17/f77 [1004145,124100] 0 2024-04-06T12:23:08.184 INFO:tasks.workunit.client.1.smithi195.stdout:4/437: fsync d4/d3e/f52 0 2024-04-06T12:23:08.185 INFO:tasks.workunit.client.1.smithi195.stdout:4/438: chown d4/f5 2680493 1 2024-04-06T12:23:08.190 INFO:tasks.workunit.client.1.smithi195.stdout:6/491: getdents d8/d50/d9c 0 2024-04-06T12:23:08.191 INFO:tasks.workunit.client.1.smithi195.stdout:7/397: truncate d4/d10/d18/d19/f5e 3359092 0 2024-04-06T12:23:08.192 INFO:tasks.workunit.client.1.smithi195.stdout:1/466: creat d4/d14/d19/d23/d28/d2f/f8a x:0 0 0 2024-04-06T12:23:08.198 INFO:tasks.workunit.client.1.smithi195.stdout:3/527: dwrite d4/d9/f18 [4194304,4194304] 0 2024-04-06T12:23:08.201 INFO:tasks.workunit.client.1.smithi195.stdout:5/501: symlink d0/da/d13/d87/lb3 0 2024-04-06T12:23:08.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/492: symlink d8/d50/d9c/lbd 0 2024-04-06T12:23:08.202 INFO:tasks.workunit.client.1.smithi195.stdout:1/467: fdatasync d4/f26 0 2024-04-06T12:23:08.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/528: chown d4/f4e 104 1 2024-04-06T12:23:08.205 INFO:tasks.workunit.client.1.smithi195.stdout:2/490: dread d2/d21/d29/f2b [0,4194304] 0 2024-04-06T12:23:08.205 INFO:tasks.workunit.client.1.smithi195.stdout:1/468: read d4/d14/d17/d24/f27 [1159819,123469] 0 2024-04-06T12:23:08.206 INFO:tasks.workunit.client.1.smithi195.stdout:8/458: getdents d6/d8/d12/d61 0 2024-04-06T12:23:08.206 INFO:tasks.workunit.client.1.smithi195.stdout:2/491: fsync d2/d14/f82 0 2024-04-06T12:23:08.208 INFO:tasks.workunit.client.1.smithi195.stdout:6/493: creat d8/d50/d32/fbe x:0 0 0 2024-04-06T12:23:08.214 INFO:tasks.workunit.client.1.smithi195.stdout:5/502: mknod d0/da/cb4 0 2024-04-06T12:23:08.215 INFO:tasks.workunit.client.1.smithi195.stdout:5/503: dread - d0/da/f3c zero size 2024-04-06T12:23:08.216 INFO:tasks.workunit.client.1.smithi195.stdout:5/504: write d0/da/dd/f89 [1405808,127410] 0 2024-04-06T12:23:08.219 INFO:tasks.workunit.client.1.smithi195.stdout:4/439: mkdir d4/d6d/d85 0 2024-04-06T12:23:08.220 INFO:tasks.workunit.client.1.smithi195.stdout:4/440: chown d4/d6/d38/d1a/d40 63640915 1 2024-04-06T12:23:08.221 INFO:tasks.workunit.client.1.smithi195.stdout:6/494: creat d8/d21/d2b/d46/d44/d86/fbf x:0 0 0 2024-04-06T12:23:08.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/495: chown d8/d3d/d5e/f8f 525616115 1 2024-04-06T12:23:08.222 INFO:tasks.workunit.client.1.smithi195.stdout:4/441: write d4/d6/d38/d1a/f6c [3753332,74971] 0 2024-04-06T12:23:08.222 INFO:tasks.workunit.client.1.smithi195.stdout:3/529: symlink d4/d9/d2b/d77/d9a/la8 0 2024-04-06T12:23:08.224 INFO:tasks.workunit.client.1.smithi195.stdout:3/530: write d4/d9/d2b/d3b/d5e/d7e/f8b [90302,100805] 0 2024-04-06T12:23:08.224 INFO:tasks.workunit.client.1.smithi195.stdout:6/496: truncate d8/d21/d2b/d46/d44/f8c 327179 0 2024-04-06T12:23:08.225 INFO:tasks.workunit.client.1.smithi195.stdout:5/505: symlink d0/d52/lb5 0 2024-04-06T12:23:08.225 INFO:tasks.workunit.client.1.smithi195.stdout:3/531: stat d4/d9/d2b 0 2024-04-06T12:23:08.227 INFO:tasks.workunit.client.1.smithi195.stdout:3/532: write d4/d9/f18 [2365143,2525] 0 2024-04-06T12:23:08.230 INFO:tasks.workunit.client.1.smithi195.stdout:8/459: link d6/dd/d70/d24/d25/d49/c96 d6/d8/d12/d83/c9a 0 2024-04-06T12:23:08.232 INFO:tasks.workunit.client.1.smithi195.stdout:5/506: write d0/da/d13/d87/d37/fa6 [916250,16180] 0 2024-04-06T12:23:08.236 INFO:tasks.workunit.client.1.smithi195.stdout:5/507: dwrite d0/f30 [0,4194304] 0 2024-04-06T12:23:08.240 INFO:tasks.workunit.client.1.smithi195.stdout:3/533: readlink d4/df/l33 0 2024-04-06T12:23:08.240 INFO:tasks.workunit.client.1.smithi195.stdout:3/534: fsync d4/f22 0 2024-04-06T12:23:08.241 INFO:tasks.workunit.client.1.smithi195.stdout:2/492: getdents d2/d21 0 2024-04-06T12:23:08.241 INFO:tasks.workunit.client.1.smithi195.stdout:1/469: truncate d4/d14/d19/d23/f48 3397638 0 2024-04-06T12:23:08.243 INFO:tasks.workunit.client.1.smithi195.stdout:8/460: fdatasync d6/f1c 0 2024-04-06T12:23:08.247 INFO:tasks.workunit.client.1.smithi195.stdout:5/508: symlink d0/da/d23/d38/d41/d7d/lb6 0 2024-04-06T12:23:08.249 INFO:tasks.workunit.client.1.smithi195.stdout:6/497: truncate d8/d21/d31/d26/f34 3858471 0 2024-04-06T12:23:08.251 INFO:tasks.workunit.client.1.smithi195.stdout:4/442: creat d4/d6/d38/f86 x:0 0 0 2024-04-06T12:23:08.253 INFO:tasks.workunit.client.1.smithi195.stdout:8/461: chown d6/d8/f55 10738 1 2024-04-06T12:23:08.253 INFO:tasks.workunit.client.1.smithi195.stdout:2/493: dread d2/f61 [0,4194304] 0 2024-04-06T12:23:08.254 INFO:tasks.workunit.client.1.smithi195.stdout:2/494: write d2/d14/f22 [1200583,16626] 0 2024-04-06T12:23:08.255 INFO:tasks.workunit.client.1.smithi195.stdout:2/495: stat d2/d21/d5e/d64/l83 0 2024-04-06T12:23:08.256 INFO:tasks.workunit.client.1.smithi195.stdout:2/496: fsync d2/d21/d29/f34 0 2024-04-06T12:23:08.258 INFO:tasks.workunit.client.1.smithi195.stdout:3/535: creat d4/d9/d9f/fa9 x:0 0 0 2024-04-06T12:23:08.258 INFO:tasks.workunit.client.1.smithi195.stdout:6/498: symlink d8/d21/d2b/d46/d4a/d4e/lc0 0 2024-04-06T12:23:08.262 INFO:tasks.workunit.client.1.smithi195.stdout:5/509: dwrite d0/da/d23/d38/f88 [0,4194304] 0 2024-04-06T12:23:08.264 INFO:tasks.workunit.client.1.smithi195.stdout:2/497: rename d2/d3f/f89 to d2/d21/d2c/d2d/d92/d95/f97 0 2024-04-06T12:23:08.264 INFO:tasks.workunit.client.1.smithi195.stdout:2/498: stat d2/f1e 0 2024-04-06T12:23:08.265 INFO:tasks.workunit.client.1.smithi195.stdout:2/499: chown d2/d41/d5a/c5b 98 1 2024-04-06T12:23:08.270 INFO:tasks.workunit.client.1.smithi195.stdout:4/443: symlink d4/d6/d38/d1a/l87 0 2024-04-06T12:23:08.270 INFO:tasks.workunit.client.1.smithi195.stdout:1/470: dread d4/d14/d17/d24/d2a/f54 [0,4194304] 0 2024-04-06T12:23:08.270 INFO:tasks.workunit.client.1.smithi195.stdout:6/499: readlink d8/d21/d31/l1e 0 2024-04-06T12:23:08.272 INFO:tasks.workunit.client.1.smithi195.stdout:4/444: fsync d4/d6/d38/f86 0 2024-04-06T12:23:08.272 INFO:tasks.workunit.client.1.smithi195.stdout:6/500: write d8/d50/f39 [282548,66009] 0 2024-04-06T12:23:08.273 INFO:tasks.workunit.client.1.smithi195.stdout:2/500: symlink d2/d3f/l98 0 2024-04-06T12:23:08.281 INFO:tasks.workunit.client.1.smithi195.stdout:8/462: link d6/d8/f35 d6/dd/d42/f9b 0 2024-04-06T12:23:08.282 INFO:tasks.workunit.client.1.smithi195.stdout:5/510: dwrite d0/da/d13/d87/d37/f8b [0,4194304] 0 2024-04-06T12:23:08.282 INFO:tasks.workunit.client.1.smithi195.stdout:1/471: symlink d4/d14/d19/d88/l8b 0 2024-04-06T12:23:08.284 INFO:tasks.workunit.client.1.smithi195.stdout:6/501: mkdir d8/d3d/dc1 0 2024-04-06T12:23:08.287 INFO:tasks.workunit.client.1.smithi195.stdout:6/502: dread - d8/d3d/d5e/f8f zero size 2024-04-06T12:23:08.287 INFO:tasks.workunit.client.1.smithi195.stdout:8/463: creat d6/dd/d70/d24/d25/d5e/f9c x:0 0 0 2024-04-06T12:23:08.287 INFO:tasks.workunit.client.1.smithi195.stdout:5/511: readlink d0/da/dd/l65 0 2024-04-06T12:23:08.290 INFO:tasks.workunit.client.1.smithi195.stdout:4/445: link d4/d6/d38/d1a/f2d d4/f88 0 2024-04-06T12:23:08.291 INFO:tasks.workunit.client.1.smithi195.stdout:2/501: dwrite d2/d14/f18 [4194304,4194304] 0 2024-04-06T12:23:08.292 INFO:tasks.workunit.client.1.smithi195.stdout:5/512: write d0/da/fb [2218243,27337] 0 2024-04-06T12:23:08.293 INFO:tasks.workunit.client.1.smithi195.stdout:2/502: write d2/f6d [529723,60673] 0 2024-04-06T12:23:08.293 INFO:tasks.workunit.client.1.smithi195.stdout:6/503: creat d8/d3d/d5e/d72/fc2 x:0 0 0 2024-04-06T12:23:08.295 INFO:tasks.workunit.client.1.smithi195.stdout:6/504: chown d8/f14 4140202 1 2024-04-06T12:23:08.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/464: mkdir d6/dd/d70/d24/d34/d67/d9d 0 2024-04-06T12:23:08.297 INFO:tasks.workunit.client.1.smithi195.stdout:4/446: stat d4/d6d 0 2024-04-06T12:23:08.297 INFO:tasks.workunit.client.1.smithi195.stdout:8/465: fdatasync d6/f7 0 2024-04-06T12:23:08.298 INFO:tasks.workunit.client.1.smithi195.stdout:6/505: creat d8/d8e/fc3 x:0 0 0 2024-04-06T12:23:08.299 INFO:tasks.workunit.client.1.smithi195.stdout:2/503: symlink d2/d41/d84/l99 0 2024-04-06T12:23:08.300 INFO:tasks.workunit.client.1.smithi195.stdout:5/513: symlink d0/da/d13/d87/lb7 0 2024-04-06T12:23:08.304 INFO:tasks.workunit.client.1.smithi195.stdout:5/514: dread d0/da/f21 [0,4194304] 0 2024-04-06T12:23:08.304 INFO:tasks.workunit.client.1.smithi195.stdout:6/506: unlink d8/d21/d31/l1e 0 2024-04-06T12:23:08.306 INFO:tasks.workunit.client.1.smithi195.stdout:1/472: truncate d4/d14/d19/f1b 3089061 0 2024-04-06T12:23:08.310 INFO:tasks.workunit.client.1.smithi195.stdout:2/504: creat d2/d41/d84/d8d/d94/f9a x:0 0 0 2024-04-06T12:23:08.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/466: creat d6/f9e x:0 0 0 2024-04-06T12:23:08.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/467: chown d6/d3a 40996 1 2024-04-06T12:23:08.314 INFO:tasks.workunit.client.1.smithi195.stdout:8/468: write d6/d3a/d46/f63 [270037,44607] 0 2024-04-06T12:23:08.315 INFO:tasks.workunit.client.1.smithi195.stdout:5/515: dread d0/da/dd/d2e/f90 [0,4194304] 0 2024-04-06T12:23:08.317 INFO:tasks.workunit.client.1.smithi195.stdout:0/506: sync 2024-04-06T12:23:08.318 INFO:tasks.workunit.client.1.smithi195.stdout:9/521: sync 2024-04-06T12:23:08.319 INFO:tasks.workunit.client.1.smithi195.stdout:9/522: fdatasync d3/de/f21 0 2024-04-06T12:23:08.319 INFO:tasks.workunit.client.1.smithi195.stdout:2/505: mkdir d2/d21/d2c/d2d/d92/d95/d9b 0 2024-04-06T12:23:08.321 INFO:tasks.workunit.client.1.smithi195.stdout:2/506: readlink d2/d21/d5e/d64/l6f 0 2024-04-06T12:23:08.322 INFO:tasks.workunit.client.1.smithi195.stdout:4/447: link d4/d6/d38/d1a/l22 d4/d6/d38/d1a/d40/d20/l89 0 2024-04-06T12:23:08.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/469: dwrite d6/f9e [0,4194304] 0 2024-04-06T12:23:08.324 INFO:tasks.workunit.client.1.smithi195.stdout:8/470: dread - d6/dd/d70/d24/d34/d67/f76 zero size 2024-04-06T12:23:08.329 INFO:tasks.workunit.client.1.smithi195.stdout:6/507: link d8/d21/d2b/d46/d4a/d4e/lc0 d8/d8e/lc4 0 2024-04-06T12:23:08.330 INFO:tasks.workunit.client.1.smithi195.stdout:9/523: symlink d3/d10/d3a/d6b/laf 0 2024-04-06T12:23:08.333 INFO:tasks.workunit.client.1.smithi195.stdout:2/507: dwrite d2/d3f/d7d/f54 [4194304,4194304] 0 2024-04-06T12:23:08.333 INFO:tasks.workunit.client.1.smithi195.stdout:4/448: dread d4/f79 [0,4194304] 0 2024-04-06T12:23:08.333 INFO:tasks.workunit.client.1.smithi195.stdout:1/473: getdents d4/d14/d17/d3a 0 2024-04-06T12:23:08.336 INFO:tasks.workunit.client.1.smithi195.stdout:0/507: symlink d4/d48/d77/d97/la5 0 2024-04-06T12:23:08.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/471: truncate d6/d8/d12/f2f 124960 0 2024-04-06T12:23:08.337 INFO:tasks.workunit.client.1.smithi195.stdout:4/449: readlink d4/d3e/l76 0 2024-04-06T12:23:08.337 INFO:tasks.workunit.client.1.smithi195.stdout:2/508: chown d2/d21/f39 0 1 2024-04-06T12:23:08.338 INFO:tasks.workunit.client.1.smithi195.stdout:5/516: dwrite d0/da/dd/d2e/f90 [0,4194304] 0 2024-04-06T12:23:08.341 INFO:tasks.workunit.client.1.smithi195.stdout:1/474: truncate d4/d14/d19/f29 1182980 0 2024-04-06T12:23:08.341 INFO:tasks.workunit.client.1.smithi195.stdout:0/508: symlink d4/d48/la6 0 2024-04-06T12:23:08.342 INFO:tasks.workunit.client.1.smithi195.stdout:2/509: rmdir d2/d21 39 2024-04-06T12:23:08.343 INFO:tasks.workunit.client.1.smithi195.stdout:0/509: readlink d4/d48/d77/d97/la5 0 2024-04-06T12:23:08.344 INFO:tasks.workunit.client.1.smithi195.stdout:8/472: creat d6/dd/d70/d24/d34/f9f x:0 0 0 2024-04-06T12:23:08.344 INFO:tasks.workunit.client.1.smithi195.stdout:7/398: sync 2024-04-06T12:23:08.345 INFO:tasks.workunit.client.1.smithi195.stdout:4/450: creat d4/d6/d38/d1a/d40/d20/f8a x:0 0 0 2024-04-06T12:23:08.346 INFO:tasks.workunit.client.1.smithi195.stdout:9/524: dread d3/d10/d3a/d5d/f63 [0,4194304] 0 2024-04-06T12:23:08.346 INFO:tasks.workunit.client.1.smithi195.stdout:5/517: mkdir d0/da/dd/d1c/d5a/d62/db8 0 2024-04-06T12:23:08.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/508: dwrite d8/d3d/d5e/d72/f79 [0,4194304] 0 2024-04-06T12:23:08.347 INFO:tasks.workunit.client.1.smithi195.stdout:1/475: creat d4/d14/d17/f8c x:0 0 0 2024-04-06T12:23:08.348 INFO:tasks.workunit.client.1.smithi195.stdout:7/399: stat d4/d10/d18/d19/c62 0 2024-04-06T12:23:08.350 INFO:tasks.workunit.client.1.smithi195.stdout:0/510: mkdir d4/d6/d58/da7 0 2024-04-06T12:23:08.350 INFO:tasks.workunit.client.1.smithi195.stdout:5/518: read - d0/da/dd/d2e/d6f/f9d zero size 2024-04-06T12:23:08.351 INFO:tasks.workunit.client.1.smithi195.stdout:7/400: fdatasync d4/d10/f27 0 2024-04-06T12:23:08.351 INFO:tasks.workunit.client.1.smithi195.stdout:1/476: chown d4/f1c 18 1 2024-04-06T12:23:08.351 INFO:tasks.workunit.client.1.smithi195.stdout:9/525: chown d3/d10/d3a/d6b/f7a 46856427 1 2024-04-06T12:23:08.351 INFO:tasks.workunit.client.1.smithi195.stdout:6/509: mkdir d8/d50/d9c/dc5 0 2024-04-06T12:23:08.353 INFO:tasks.workunit.client.1.smithi195.stdout:9/526: dread - d3/d10/d3b/d50/fa0 zero size 2024-04-06T12:23:08.354 INFO:tasks.workunit.client.1.smithi195.stdout:8/473: creat d6/dd/d70/d24/d34/d67/d9d/fa0 x:0 0 0 2024-04-06T12:23:08.355 INFO:tasks.workunit.client.1.smithi195.stdout:7/401: truncate d4/d10/d12/f72 602650 0 2024-04-06T12:23:08.355 INFO:tasks.workunit.client.1.smithi195.stdout:9/527: fsync d3/d10/d3b/d48/d9c/f84 0 2024-04-06T12:23:08.355 INFO:tasks.workunit.client.1.smithi195.stdout:1/477: creat d4/d14/d19/d4e/d60/f8d x:0 0 0 2024-04-06T12:23:08.356 INFO:tasks.workunit.client.1.smithi195.stdout:6/510: mknod d8/d50/cc6 0 2024-04-06T12:23:08.356 INFO:tasks.workunit.client.1.smithi195.stdout:9/528: chown d3/f43 1191 1 2024-04-06T12:23:08.358 INFO:tasks.workunit.client.1.smithi195.stdout:7/402: rmdir d4 39 2024-04-06T12:23:08.360 INFO:tasks.workunit.client.1.smithi195.stdout:5/519: rename d0/da/dd/d2e/d6f/d58/d78 to d0/da/dd/d1c/d5a/d62/d64/d67/db9 0 2024-04-06T12:23:08.361 INFO:tasks.workunit.client.1.smithi195.stdout:8/474: mkdir d6/dd/d70/d24/d34/d67/da1 0 2024-04-06T12:23:08.362 INFO:tasks.workunit.client.1.smithi195.stdout:4/451: read d4/d6/d38/d1a/d40/d20/d23/f3a [240520,28209] 0 2024-04-06T12:23:08.363 INFO:tasks.workunit.client.1.smithi195.stdout:1/478: dread d4/d14/d17/d24/d2a/f54 [0,4194304] 0 2024-04-06T12:23:08.364 INFO:tasks.workunit.client.1.smithi195.stdout:6/511: dwrite d8/f2a [0,4194304] 0 2024-04-06T12:23:08.365 INFO:tasks.workunit.client.1.smithi195.stdout:5/520: rename d0/da/dd/d2e/d6f to d0/da/dd/d2e/d6f/dba 22 2024-04-06T12:23:08.366 INFO:tasks.workunit.client.1.smithi195.stdout:9/529: link d3/l34 d3/d10/d3a/d6b/lb0 0 2024-04-06T12:23:08.367 INFO:tasks.workunit.client.1.smithi195.stdout:8/475: write d6/dd/d70/d24/d34/d67/d9d/fa0 [563547,5984] 0 2024-04-06T12:23:08.368 INFO:tasks.workunit.client.1.smithi195.stdout:5/521: fdatasync d0/da/d4b/f6a 0 2024-04-06T12:23:08.379 INFO:tasks.workunit.client.1.smithi195.stdout:1/479: dread d4/d14/d19/d23/d28/d2f/f33 [0,4194304] 0 2024-04-06T12:23:08.382 INFO:tasks.workunit.client.1.smithi195.stdout:8/476: mkdir d6/dd/d70/d24/d34/d67/da1/da2 0 2024-04-06T12:23:08.386 INFO:tasks.workunit.client.1.smithi195.stdout:1/480: mknod d4/d14/d19/c8e 0 2024-04-06T12:23:08.388 INFO:tasks.workunit.client.1.smithi195.stdout:7/403: getdents d4/d16/dd/d22/d3f/d54 0 2024-04-06T12:23:08.390 INFO:tasks.workunit.client.1.smithi195.stdout:1/481: mkdir d4/d14/d19/d4e/d8f 0 2024-04-06T12:23:08.393 INFO:tasks.workunit.client.1.smithi195.stdout:2/510: dwrite d2/d3f/d7d/d7a/f91 [0,4194304] 0 2024-04-06T12:23:08.393 INFO:tasks.workunit.client.1.smithi195.stdout:6/512: getdents d8/d50 0 2024-04-06T12:23:08.394 INFO:tasks.workunit.client.1.smithi195.stdout:6/513: write d8/d21/d31/fac [381028,112633] 0 2024-04-06T12:23:08.394 INFO:tasks.workunit.client.1.smithi195.stdout:1/482: mknod d4/c90 0 2024-04-06T12:23:08.397 INFO:tasks.workunit.client.1.smithi195.stdout:2/511: write d2/d21/d2c/d2d/f57 [897778,119220] 0 2024-04-06T12:23:08.397 INFO:tasks.workunit.client.1.smithi195.stdout:6/514: readlink d8/d21/d31/l29 0 2024-04-06T12:23:08.398 INFO:tasks.workunit.client.1.smithi195.stdout:2/512: write d2/d21/d29/f34 [2094642,130288] 0 2024-04-06T12:23:08.402 INFO:tasks.workunit.client.1.smithi195.stdout:2/513: rmdir d2/d41 39 2024-04-06T12:23:08.403 INFO:tasks.workunit.client.1.smithi195.stdout:9/530: write d3/d10/f2f [1171814,52690] 0 2024-04-06T12:23:08.405 INFO:tasks.workunit.client.1.smithi195.stdout:4/452: truncate d4/d6/d38/d1a/d40/d57/d64/f7d 338519 0 2024-04-06T12:23:08.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/483: dwrite d4/d14/d17/f10 [0,4194304] 0 2024-04-06T12:23:08.411 INFO:tasks.workunit.client.1.smithi195.stdout:4/453: mknod d4/d6d/d85/c8b 0 2024-04-06T12:23:08.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/515: dwrite d8/f14 [0,4194304] 0 2024-04-06T12:23:08.418 INFO:tasks.workunit.client.1.smithi195.stdout:2/514: dwrite d2/d21/d69/f62 [0,4194304] 0 2024-04-06T12:23:08.420 INFO:tasks.workunit.client.1.smithi195.stdout:8/477: dwrite d6/d8/f95 [0,4194304] 0 2024-04-06T12:23:08.420 INFO:tasks.workunit.client.1.smithi195.stdout:1/484: mknod d4/d14/d19/d4e/d71/c91 0 2024-04-06T12:23:08.422 INFO:tasks.workunit.client.1.smithi195.stdout:1/485: truncate f1 8854691 0 2024-04-06T12:23:08.425 INFO:tasks.workunit.client.1.smithi195.stdout:1/486: fsync d4/d14/d19/d23/d28/d2f/f3f 0 2024-04-06T12:23:08.425 INFO:tasks.workunit.client.1.smithi195.stdout:8/478: truncate d6/dd/d70/d24/f4e 248616 0 2024-04-06T12:23:08.426 INFO:tasks.workunit.client.1.smithi195.stdout:6/516: creat d8/d21/fc7 x:0 0 0 2024-04-06T12:23:08.433 INFO:tasks.workunit.client.1.smithi195.stdout:8/479: creat d6/dd/d70/d24/d34/fa3 x:0 0 0 2024-04-06T12:23:08.434 INFO:tasks.workunit.client.1.smithi195.stdout:3/536: sync 2024-04-06T12:23:08.434 INFO:tasks.workunit.client.1.smithi195.stdout:6/517: rename d8/d21/d2b/d46/d4a to d8/d21/d31/d26/dc8 0 2024-04-06T12:23:08.435 INFO:tasks.workunit.client.1.smithi195.stdout:1/487: creat d4/d14/d19/d4e/d8f/f92 x:0 0 0 2024-04-06T12:23:08.437 INFO:tasks.workunit.client.1.smithi195.stdout:1/488: read - d4/d14/d17/d24/d2a/d45/f7e zero size 2024-04-06T12:23:08.437 INFO:tasks.workunit.client.1.smithi195.stdout:3/537: creat d4/de/d8e/d92/faa x:0 0 0 2024-04-06T12:23:08.439 INFO:tasks.workunit.client.1.smithi195.stdout:8/480: rmdir d6/d8/d12/d83/d98 0 2024-04-06T12:23:08.441 INFO:tasks.workunit.client.1.smithi195.stdout:1/489: rmdir d4/d14/d19/d4e/d60 39 2024-04-06T12:23:08.442 INFO:tasks.workunit.client.1.smithi195.stdout:6/518: dread d8/d50/d32/f57 [0,4194304] 0 2024-04-06T12:23:08.443 INFO:tasks.workunit.client.1.smithi195.stdout:3/538: truncate d4/d9/d2b/d3b/d40/f4a 2317047 0 2024-04-06T12:23:08.443 INFO:tasks.workunit.client.1.smithi195.stdout:6/519: truncate d8/d8e/fa6 141815 0 2024-04-06T12:23:08.444 INFO:tasks.workunit.client.1.smithi195.stdout:8/481: mkdir d6/dd/d70/d24/d34/d67/da1/da2/da4 0 2024-04-06T12:23:08.445 INFO:tasks.workunit.client.1.smithi195.stdout:1/490: symlink d4/d14/d19/d4e/l93 0 2024-04-06T12:23:08.445 INFO:tasks.workunit.client.1.smithi195.stdout:8/482: write d6/f1c [2076029,67770] 0 2024-04-06T12:23:08.446 INFO:tasks.workunit.client.1.smithi195.stdout:3/539: mkdir d4/d9/d2b/d3b/d5e/dab 0 2024-04-06T12:23:08.447 INFO:tasks.workunit.client.1.smithi195.stdout:8/483: dread - d6/d3a/d46/f7e zero size 2024-04-06T12:23:08.451 INFO:tasks.workunit.client.1.smithi195.stdout:8/484: dread - d6/dd/d70/d24/d25/f93 zero size 2024-04-06T12:23:08.451 INFO:tasks.workunit.client.1.smithi195.stdout:1/491: read - d4/d14/d19/d4e/d60/f8d zero size 2024-04-06T12:23:08.452 INFO:tasks.workunit.client.1.smithi195.stdout:9/531: dread d3/d10/d3b/d48/d9c/f38 [0,4194304] 0 2024-04-06T12:23:08.455 INFO:tasks.workunit.client.1.smithi195.stdout:6/520: dwrite d8/d21/d2b/d46/d44/f7d [0,4194304] 0 2024-04-06T12:23:08.458 INFO:tasks.workunit.client.1.smithi195.stdout:2/515: dwrite d2/d21/f39 [4194304,4194304] 0 2024-04-06T12:23:08.458 INFO:tasks.workunit.client.1.smithi195.stdout:1/492: truncate d4/d14/d17/d24/f4a 428766 0 2024-04-06T12:23:08.458 INFO:tasks.workunit.client.1.smithi195.stdout:8/485: mkdir d6/dd/d70/d24/d25/da5 0 2024-04-06T12:23:08.461 INFO:tasks.workunit.client.1.smithi195.stdout:6/521: read - d8/d21/d31/d26/dc8/d4e/f6e zero size 2024-04-06T12:23:08.461 INFO:tasks.workunit.client.1.smithi195.stdout:9/532: rename d3/d10/d3a/d5d/f63 to d3/de/fb1 0 2024-04-06T12:23:08.461 INFO:tasks.workunit.client.1.smithi195.stdout:2/516: read d2/f6d [239,13066] 0 2024-04-06T12:23:08.463 INFO:tasks.workunit.client.1.smithi195.stdout:3/540: write d4/f2f [667490,41054] 0 2024-04-06T12:23:08.463 INFO:tasks.workunit.client.1.smithi195.stdout:1/493: chown d4/d14/c3e 402352023 1 2024-04-06T12:23:08.464 INFO:tasks.workunit.client.1.smithi195.stdout:3/541: fdatasync d4/df/f8f 0 2024-04-06T12:23:08.465 INFO:tasks.workunit.client.1.smithi195.stdout:6/522: creat d8/d21/d2b/fc9 x:0 0 0 2024-04-06T12:23:08.467 INFO:tasks.workunit.client.1.smithi195.stdout:6/523: dread d8/d21/f5a [4194304,4194304] 0 2024-04-06T12:23:08.468 INFO:tasks.workunit.client.1.smithi195.stdout:8/486: creat d6/d3a/d46/fa6 x:0 0 0 2024-04-06T12:23:08.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/487: stat d6/db/f60 0 2024-04-06T12:23:08.471 INFO:tasks.workunit.client.1.smithi195.stdout:9/533: truncate d3/de/f85 463570 0 2024-04-06T12:23:08.472 INFO:tasks.workunit.client.1.smithi195.stdout:1/494: creat d4/d14/d17/d24/f94 x:0 0 0 2024-04-06T12:23:08.474 INFO:tasks.workunit.client.1.smithi195.stdout:3/542: creat d4/de/d8e/d92/d9e/fac x:0 0 0 2024-04-06T12:23:08.475 INFO:tasks.workunit.client.1.smithi195.stdout:8/488: mknod d6/d8/d12/ca7 0 2024-04-06T12:23:08.475 INFO:tasks.workunit.client.1.smithi195.stdout:2/517: mknod d2/d41/d84/d8d/c9c 0 2024-04-06T12:23:08.477 INFO:tasks.workunit.client.1.smithi195.stdout:6/524: chown d8/d21/d31/d6c/d7b/c87 1258679938 1 2024-04-06T12:23:08.477 INFO:tasks.workunit.client.1.smithi195.stdout:3/543: chown d4/de/f34 247835 1 2024-04-06T12:23:08.481 INFO:tasks.workunit.client.1.smithi195.stdout:9/534: dwrite d3/d10/f46 [0,4194304] 0 2024-04-06T12:23:08.481 INFO:tasks.workunit.client.1.smithi195.stdout:2/518: creat d2/d21/d2c/f9d x:0 0 0 2024-04-06T12:23:08.481 INFO:tasks.workunit.client.1.smithi195.stdout:6/525: unlink d8/d21/d31/l29 0 2024-04-06T12:23:08.485 INFO:tasks.workunit.client.1.smithi195.stdout:1/495: dwrite d4/d14/d19/d4e/d60/f8d [0,4194304] 0 2024-04-06T12:23:08.485 INFO:tasks.workunit.client.1.smithi195.stdout:2/519: symlink d2/d3f/d7d/d5d/l9e 0 2024-04-06T12:23:08.493 INFO:tasks.workunit.client.1.smithi195.stdout:2/520: mknod d2/c9f 0 2024-04-06T12:23:08.500 INFO:tasks.workunit.client.1.smithi195.stdout:3/544: write d4/f12 [1323132,76831] 0 2024-04-06T12:23:08.504 INFO:tasks.workunit.client.1.smithi195.stdout:0/511: sync 2024-04-06T12:23:08.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/535: dwrite d3/da1/fae [0,4194304] 0 2024-04-06T12:23:08.506 INFO:tasks.workunit.client.1.smithi195.stdout:8/489: dread d6/dd/d70/d24/d34/f57 [0,4194304] 0 2024-04-06T12:23:08.507 INFO:tasks.workunit.client.1.smithi195.stdout:1/496: dwrite d4/d14/d19/d4e/f52 [0,4194304] 0 2024-04-06T12:23:08.508 INFO:tasks.workunit.client.1.smithi195.stdout:0/512: fsync d4/d6/f5f 0 2024-04-06T12:23:08.509 INFO:tasks.workunit.client.1.smithi195.stdout:2/521: dread d2/d3f/d7d/f68 [0,4194304] 0 2024-04-06T12:23:08.513 INFO:tasks.workunit.client.1.smithi195.stdout:1/497: creat d4/d14/d17/d3a/f95 x:0 0 0 2024-04-06T12:23:08.516 INFO:tasks.workunit.client.1.smithi195.stdout:8/490: dread d6/dd/d70/d24/f4e [0,4194304] 0 2024-04-06T12:23:08.516 INFO:tasks.workunit.client.1.smithi195.stdout:6/526: dread d8/d21/d2b/d46/f83 [0,4194304] 0 2024-04-06T12:23:08.517 INFO:tasks.workunit.client.1.smithi195.stdout:9/536: chown d3/d10/f11 0 1 2024-04-06T12:23:08.517 INFO:tasks.workunit.client.1.smithi195.stdout:8/491: stat d6/dd/d42 0 2024-04-06T12:23:08.519 INFO:tasks.workunit.client.1.smithi195.stdout:2/522: creat d2/d3f/d7d/fa0 x:0 0 0 2024-04-06T12:23:08.520 INFO:tasks.workunit.client.1.smithi195.stdout:6/527: mknod d8/d50/d32/cca 0 2024-04-06T12:23:08.523 INFO:tasks.workunit.client.1.smithi195.stdout:8/492: rename d6/ca to d6/db/d47/d97/ca8 0 2024-04-06T12:23:08.525 INFO:tasks.workunit.client.1.smithi195.stdout:2/523: mknod d2/d21/d5e/ca1 0 2024-04-06T12:23:08.527 INFO:tasks.workunit.client.1.smithi195.stdout:9/537: getdents d3/d10/d3b/d48 0 2024-04-06T12:23:08.528 INFO:tasks.workunit.client.1.smithi195.stdout:1/498: dread d4/d14/d19/f1b [0,4194304] 0 2024-04-06T12:23:08.529 INFO:tasks.workunit.client.1.smithi195.stdout:1/499: stat d4/d14/d19/d4e/d60 0 2024-04-06T12:23:08.531 INFO:tasks.workunit.client.1.smithi195.stdout:9/538: unlink d3/d10/d3b/d50/fa0 0 2024-04-06T12:23:08.533 INFO:tasks.workunit.client.1.smithi195.stdout:3/545: dread d4/d9/f2a [0,4194304] 0 2024-04-06T12:23:08.536 INFO:tasks.workunit.client.1.smithi195.stdout:1/500: rmdir d4/d14/d17/d24/d2a/d45 39 2024-04-06T12:23:08.536 INFO:tasks.workunit.client.1.smithi195.stdout:0/513: dwrite d4/d6/d2f/f44 [0,4194304] 0 2024-04-06T12:23:08.540 INFO:tasks.workunit.client.1.smithi195.stdout:0/514: rmdir d4/d48/d77 39 2024-04-06T12:23:08.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/546: truncate d4/d9/d37/f3a 430457 0 2024-04-06T12:23:08.542 INFO:tasks.workunit.client.1.smithi195.stdout:0/515: read - d4/d6/d1a/d73/f92 zero size 2024-04-06T12:23:08.543 INFO:tasks.workunit.client.1.smithi195.stdout:3/547: read - d4/d9/d2b/f42 zero size 2024-04-06T12:23:08.543 INFO:tasks.workunit.client.1.smithi195.stdout:1/501: dwrite d4/d14/d19/f68 [0,4194304] 0 2024-04-06T12:23:08.543 INFO:tasks.workunit.client.1.smithi195.stdout:9/539: write d3/de/fa3 [592620,98303] 0 2024-04-06T12:23:08.548 INFO:tasks.workunit.client.1.smithi195.stdout:9/540: symlink d3/d10/d3b/d48/d5e/lb2 0 2024-04-06T12:23:08.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/516: symlink d4/d6/d1a/d9f/la8 0 2024-04-06T12:23:08.549 INFO:tasks.workunit.client.1.smithi195.stdout:3/548: mknod d4/df/d39/da7/cad 0 2024-04-06T12:23:08.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/517: fsync d4/d48/d67/f6a 0 2024-04-06T12:23:08.552 INFO:tasks.workunit.client.1.smithi195.stdout:2/524: dread d2/d21/d29/f3e [0,4194304] 0 2024-04-06T12:23:08.552 INFO:tasks.workunit.client.1.smithi195.stdout:9/541: mknod d3/d10/d3b/d48/d5e/cb3 0 2024-04-06T12:23:08.553 INFO:tasks.workunit.client.1.smithi195.stdout:2/525: readlink d2/d21/l7f 0 2024-04-06T12:23:08.553 INFO:tasks.workunit.client.1.smithi195.stdout:3/549: rmdir d4/de/d8e/d92 39 2024-04-06T12:23:08.556 INFO:tasks.workunit.client.1.smithi195.stdout:9/542: creat d3/da1/fb4 x:0 0 0 2024-04-06T12:23:08.557 INFO:tasks.workunit.client.1.smithi195.stdout:2/526: write d2/d21/d29/f3e [547889,124805] 0 2024-04-06T12:23:08.559 INFO:tasks.workunit.client.1.smithi195.stdout:2/527: write d2/d14/f1d [1949872,74680] 0 2024-04-06T12:23:08.561 INFO:tasks.workunit.client.1.smithi195.stdout:3/550: dwrite d4/d9/d2b/f36 [0,4194304] 0 2024-04-06T12:23:08.562 INFO:tasks.workunit.client.1.smithi195.stdout:2/528: rmdir d2/d21/d5e/d64 39 2024-04-06T12:23:08.564 INFO:tasks.workunit.client.1.smithi195.stdout:3/551: mknod d4/de/cae 0 2024-04-06T12:23:08.565 INFO:tasks.workunit.client.1.smithi195.stdout:2/529: write d2/d21/d69/f62 [2262095,49476] 0 2024-04-06T12:23:08.566 INFO:tasks.workunit.client.1.smithi195.stdout:2/530: write d2/f7e [54024,127885] 0 2024-04-06T12:23:08.568 INFO:tasks.workunit.client.1.smithi195.stdout:2/531: read d2/d3f/d7d/f54 [5412033,16688] 0 2024-04-06T12:23:08.569 INFO:tasks.workunit.client.1.smithi195.stdout:3/552: mkdir d4/de/d8e/daf 0 2024-04-06T12:23:08.570 INFO:tasks.workunit.client.1.smithi195.stdout:3/553: dread - d4/d9/d2b/f72 zero size 2024-04-06T12:23:08.574 INFO:tasks.workunit.client.1.smithi195.stdout:2/532: mknod d2/d21/d2c/d2d/d92/d95/d9b/ca2 0 2024-04-06T12:23:08.574 INFO:tasks.workunit.client.1.smithi195.stdout:0/518: write d4/d65/f66 [2018542,19023] 0 2024-04-06T12:23:08.576 INFO:tasks.workunit.client.1.smithi195.stdout:5/522: sync 2024-04-06T12:23:08.577 INFO:tasks.workunit.client.1.smithi195.stdout:0/519: dread d4/d6/f6b [0,4194304] 0 2024-04-06T12:23:08.577 INFO:tasks.workunit.client.1.smithi195.stdout:2/533: mknod d2/d41/d84/d8d/d94/ca3 0 2024-04-06T12:23:08.581 INFO:tasks.workunit.client.1.smithi195.stdout:5/523: dread d0/da/d13/f15 [0,4194304] 0 2024-04-06T12:23:08.581 INFO:tasks.workunit.client.1.smithi195.stdout:9/543: dread d3/de/f1c [0,4194304] 0 2024-04-06T12:23:08.582 INFO:tasks.workunit.client.1.smithi195.stdout:0/520: mkdir d4/d53/d81/da9 0 2024-04-06T12:23:08.583 INFO:tasks.workunit.client.1.smithi195.stdout:1/502: dread d4/d14/d19/f1d [0,4194304] 0 2024-04-06T12:23:08.585 INFO:tasks.workunit.client.1.smithi195.stdout:9/544: mknod d3/d10/d4f/cb5 0 2024-04-06T12:23:08.585 INFO:tasks.workunit.client.1.smithi195.stdout:0/521: fsync d4/d6/d1a/f54 0 2024-04-06T12:23:08.586 INFO:tasks.workunit.client.1.smithi195.stdout:2/534: write d2/f23 [397513,76299] 0 2024-04-06T12:23:08.587 INFO:tasks.workunit.client.1.smithi195.stdout:5/524: write d0/f6 [207381,47533] 0 2024-04-06T12:23:08.588 INFO:tasks.workunit.client.1.smithi195.stdout:1/503: symlink d4/d14/l96 0 2024-04-06T12:23:08.591 INFO:tasks.workunit.client.1.smithi195.stdout:3/554: dwrite d4/d9/d2b/f42 [0,4194304] 0 2024-04-06T12:23:08.591 INFO:tasks.workunit.client.1.smithi195.stdout:9/545: symlink d3/d10/d3b/d50/lb6 0 2024-04-06T12:23:08.592 INFO:tasks.workunit.client.1.smithi195.stdout:5/525: write d0/da/d13/d87/d37/fa6 [1873957,29070] 0 2024-04-06T12:23:08.594 INFO:tasks.workunit.client.1.smithi195.stdout:9/546: write d3/d10/f9b [7356501,108204] 0 2024-04-06T12:23:08.600 INFO:tasks.workunit.client.1.smithi195.stdout:2/535: dwrite d2/d41/f96 [0,4194304] 0 2024-04-06T12:23:08.602 INFO:tasks.workunit.client.1.smithi195.stdout:1/504: rename d4/d14/d19/d23/d5d/l89 to d4/d14/d19/d4e/d8f/l97 0 2024-04-06T12:23:08.603 INFO:tasks.workunit.client.1.smithi195.stdout:9/547: mknod d3/d10/d3b/d48/d9c/cb7 0 2024-04-06T12:23:08.606 INFO:tasks.workunit.client.1.smithi195.stdout:1/505: creat d4/d14/d17/f98 x:0 0 0 2024-04-06T12:23:08.608 INFO:tasks.workunit.client.1.smithi195.stdout:0/522: dwrite d4/d6/d2f/f3e [0,4194304] 0 2024-04-06T12:23:08.609 INFO:tasks.workunit.client.1.smithi195.stdout:9/548: creat d3/d10/d3a/d5d/fb8 x:0 0 0 2024-04-06T12:23:08.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/526: write d0/da/f3c [598457,21163] 0 2024-04-06T12:23:08.612 INFO:tasks.workunit.client.1.smithi195.stdout:2/536: dwrite d2/d21/d2c/f32 [0,4194304] 0 2024-04-06T12:23:08.614 INFO:tasks.workunit.client.1.smithi195.stdout:0/523: rmdir d4 39 2024-04-06T12:23:08.618 INFO:tasks.workunit.client.1.smithi195.stdout:5/527: dwrite d0/da/dd/d2e/f90 [0,4194304] 0 2024-04-06T12:23:08.620 INFO:tasks.workunit.client.1.smithi195.stdout:2/537: creat d2/d3f/fa4 x:0 0 0 2024-04-06T12:23:08.623 INFO:tasks.workunit.client.1.smithi195.stdout:9/549: mkdir d3/db9 0 2024-04-06T12:23:08.629 INFO:tasks.workunit.client.1.smithi195.stdout:5/528: symlink d0/da/d13/lbb 0 2024-04-06T12:23:08.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/524: rename d4/d6/d1a/f54 to d4/d48/d67/faa 0 2024-04-06T12:23:08.632 INFO:tasks.workunit.client.1.smithi195.stdout:2/538: dwrite d2/d3f/d7d/f73 [0,4194304] 0 2024-04-06T12:23:08.634 INFO:tasks.workunit.client.1.smithi195.stdout:9/550: mkdir d3/dba 0 2024-04-06T12:23:08.635 INFO:tasks.workunit.client.1.smithi195.stdout:2/539: mknod d2/d41/d84/d8d/d94/ca5 0 2024-04-06T12:23:08.637 INFO:tasks.workunit.client.1.smithi195.stdout:5/529: mknod d0/da/d23/d7a/cbc 0 2024-04-06T12:23:08.638 INFO:tasks.workunit.client.1.smithi195.stdout:2/540: mknod d2/d3f/d7d/d7a/ca6 0 2024-04-06T12:23:08.639 INFO:tasks.workunit.client.1.smithi195.stdout:9/551: creat d3/dba/fbb x:0 0 0 2024-04-06T12:23:08.642 INFO:tasks.workunit.client.1.smithi195.stdout:0/525: dwrite d4/d6/d2f/f4a [0,4194304] 0 2024-04-06T12:23:08.642 INFO:tasks.workunit.client.1.smithi195.stdout:5/530: creat d0/da/d13/d87/fbd x:0 0 0 2024-04-06T12:23:08.644 INFO:tasks.workunit.client.1.smithi195.stdout:9/552: mkdir d3/db9/dbc 0 2024-04-06T12:23:08.647 INFO:tasks.workunit.client.1.smithi195.stdout:9/553: mknod d3/d10/d3a/cbd 0 2024-04-06T12:23:08.647 INFO:tasks.workunit.client.1.smithi195.stdout:2/541: dwrite d2/d21/d2c/f32 [0,4194304] 0 2024-04-06T12:23:08.661 INFO:tasks.workunit.client.1.smithi195.stdout:4/454: sync 2024-04-06T12:23:08.661 INFO:tasks.workunit.client.1.smithi195.stdout:7/404: sync 2024-04-06T12:23:08.677 INFO:tasks.workunit.client.1.smithi195.stdout:4/455: truncate d4/f12 5185014 0 2024-04-06T12:23:08.680 INFO:tasks.workunit.client.1.smithi195.stdout:9/554: dwrite d3/d10/d3b/d48/f49 [0,4194304] 0 2024-04-06T12:23:08.680 INFO:tasks.workunit.client.1.smithi195.stdout:2/542: write d2/d41/f49 [985099,8593] 0 2024-04-06T12:23:08.684 INFO:tasks.workunit.client.1.smithi195.stdout:4/456: stat d4/d6/d38/d1a/c3d 0 2024-04-06T12:23:08.685 INFO:tasks.workunit.client.1.smithi195.stdout:1/506: dwrite d4/d14/d19/d23/d28/f50 [0,4194304] 0 2024-04-06T12:23:08.686 INFO:tasks.workunit.client.1.smithi195.stdout:1/507: chown d4/d14/d19/d23/f79 164275 1 2024-04-06T12:23:08.688 INFO:tasks.workunit.client.1.smithi195.stdout:9/555: symlink d3/da1/lbe 0 2024-04-06T12:23:08.691 INFO:tasks.workunit.client.1.smithi195.stdout:1/508: write d4/d14/d17/f42 [9209446,13305] 0 2024-04-06T12:23:08.695 INFO:tasks.workunit.client.1.smithi195.stdout:2/543: rename d2/d21/d2c/d2d/c33 to d2/d3f/d7d/ca7 0 2024-04-06T12:23:08.696 INFO:tasks.workunit.client.1.smithi195.stdout:1/509: fsync d4/d14/d19/d4e/d60/f7a 0 2024-04-06T12:23:08.701 INFO:tasks.workunit.client.1.smithi195.stdout:2/544: dread d2/d3f/f42 [0,4194304] 0 2024-04-06T12:23:08.702 INFO:tasks.workunit.client.1.smithi195.stdout:1/510: rename d4/d14/d19 to d4/d14/d17/d24/d99 0 2024-04-06T12:23:08.703 INFO:tasks.workunit.client.1.smithi195.stdout:4/457: dread d4/d6/d38/d1a/d40/f15 [0,4194304] 0 2024-04-06T12:23:08.705 INFO:tasks.workunit.client.1.smithi195.stdout:1/511: rmdir d4/d14/d17/d24/d99/d88 39 2024-04-06T12:23:08.706 INFO:tasks.workunit.client.1.smithi195.stdout:5/531: dread d0/da/dd/d1c/f2d [0,4194304] 0 2024-04-06T12:23:08.708 INFO:tasks.workunit.client.1.smithi195.stdout:2/545: link d2/d21/d2c/d2d/f57 d2/d41/d5a/fa8 0 2024-04-06T12:23:08.712 INFO:tasks.workunit.client.1.smithi195.stdout:4/458: mkdir d4/d8c 0 2024-04-06T12:23:08.713 INFO:tasks.workunit.client.1.smithi195.stdout:1/512: dwrite f1 [0,4194304] 0 2024-04-06T12:23:08.717 INFO:tasks.workunit.client.1.smithi195.stdout:7/405: dread d4/d16/f6a [0,4194304] 0 2024-04-06T12:23:08.717 INFO:tasks.workunit.client.1.smithi195.stdout:4/459: chown d4/d6/d38/d1a/l1e 847 1 2024-04-06T12:23:08.718 INFO:tasks.workunit.client.1.smithi195.stdout:1/513: fdatasync d4/d14/d17/d24/d99/d4e/d8f/f92 0 2024-04-06T12:23:08.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/546: dwrite d2/d21/d2c/f38 [0,4194304] 0 2024-04-06T12:23:08.725 INFO:tasks.workunit.client.1.smithi195.stdout:1/514: write d4/d14/d17/d24/d99/d4e/d60/f8d [2396126,40000] 0 2024-04-06T12:23:08.725 INFO:tasks.workunit.client.1.smithi195.stdout:2/547: read d2/d3f/d7d/d7a/f93 [3514967,121574] 0 2024-04-06T12:23:08.725 INFO:tasks.workunit.client.1.smithi195.stdout:4/460: write d4/d6/d38/d1a/d40/f15 [197080,26578] 0 2024-04-06T12:23:08.728 INFO:tasks.workunit.client.1.smithi195.stdout:5/532: dwrite d0/da/d13/d87/d34/f4d [0,4194304] 0 2024-04-06T12:23:08.729 INFO:tasks.workunit.client.1.smithi195.stdout:4/461: write d4/f62 [388443,2527] 0 2024-04-06T12:23:08.731 INFO:tasks.workunit.client.1.smithi195.stdout:4/462: read d4/f79 [3510707,24746] 0 2024-04-06T12:23:08.731 INFO:tasks.workunit.client.1.smithi195.stdout:1/515: read - d4/d14/d17/d24/d2a/d45/f7c zero size 2024-04-06T12:23:08.732 INFO:tasks.workunit.client.1.smithi195.stdout:2/548: unlink d2/c17 0 2024-04-06T12:23:08.733 INFO:tasks.workunit.client.1.smithi195.stdout:5/533: rmdir d0/da/d23/d7a 39 2024-04-06T12:23:08.734 INFO:tasks.workunit.client.1.smithi195.stdout:2/549: chown d2/d41/l66 1082804172 1 2024-04-06T12:23:08.735 INFO:tasks.workunit.client.1.smithi195.stdout:5/534: chown d0/da/d4b/d4e 181 1 2024-04-06T12:23:08.735 INFO:tasks.workunit.client.1.smithi195.stdout:7/406: link d4/d16/dd/d22/d3f/l4c d4/d10/d18/l84 0 2024-04-06T12:23:08.736 INFO:tasks.workunit.client.1.smithi195.stdout:2/550: dread - d2/d41/d84/d8d/d94/f9a zero size 2024-04-06T12:23:08.737 INFO:tasks.workunit.client.1.smithi195.stdout:2/551: readlink d2/d14/l19 0 2024-04-06T12:23:08.740 INFO:tasks.workunit.client.1.smithi195.stdout:7/407: unlink d4/d10/d12/f61 0 2024-04-06T12:23:08.741 INFO:tasks.workunit.client.1.smithi195.stdout:7/408: write d4/d10/d12/f2e [1347736,17720] 0 2024-04-06T12:23:08.742 INFO:tasks.workunit.client.1.smithi195.stdout:4/463: write d4/d6/d38/d1a/d40/d20/f61 [2103004,126119] 0 2024-04-06T12:23:08.744 INFO:tasks.workunit.client.1.smithi195.stdout:5/535: rmdir d0/da/d23/d7a 39 2024-04-06T12:23:08.749 INFO:tasks.workunit.client.1.smithi195.stdout:1/516: rename d4/d14/d17/d24/d2a/d45/f7c to d4/d14/d17/d24/d2a/f9a 0 2024-04-06T12:23:08.750 INFO:tasks.workunit.client.1.smithi195.stdout:7/409: stat d4/d10/d18/d57/l6d 0 2024-04-06T12:23:08.751 INFO:tasks.workunit.client.1.smithi195.stdout:7/410: fdatasync d4/d10/d12/f2e 0 2024-04-06T12:23:08.753 INFO:tasks.workunit.client.1.smithi195.stdout:2/552: dread d2/d3f/f60 [0,4194304] 0 2024-04-06T12:23:08.754 INFO:tasks.workunit.client.1.smithi195.stdout:4/464: creat d4/d3e/f8d x:0 0 0 2024-04-06T12:23:08.758 INFO:tasks.workunit.client.1.smithi195.stdout:5/536: rmdir d0/da/d23/d38/d41/d7d 39 2024-04-06T12:23:08.759 INFO:tasks.workunit.client.1.smithi195.stdout:4/465: dwrite d4/d3e/f78 [0,4194304] 0 2024-04-06T12:23:08.786 INFO:tasks.workunit.client.1.smithi195.stdout:6/528: sync 2024-04-06T12:23:08.787 INFO:tasks.workunit.client.1.smithi195.stdout:8/493: sync 2024-04-06T12:23:08.787 INFO:tasks.workunit.client.1.smithi195.stdout:3/555: sync 2024-04-06T12:23:08.794 INFO:tasks.workunit.client.1.smithi195.stdout:4/466: fsync d4/d6/d38/d1a/f24 0 2024-04-06T12:23:08.796 INFO:tasks.workunit.client.1.smithi195.stdout:4/467: dread d4/d6/d38/f5d [0,4194304] 0 2024-04-06T12:23:08.796 INFO:tasks.workunit.client.1.smithi195.stdout:8/494: write d6/d8/f58 [1041863,83860] 0 2024-04-06T12:23:08.796 INFO:tasks.workunit.client.1.smithi195.stdout:5/537: creat d0/da/dd/d2e/d6f/dab/fbe x:0 0 0 2024-04-06T12:23:08.799 INFO:tasks.workunit.client.1.smithi195.stdout:3/556: chown d4/d9/d2b/d3b/c62 30062359 1 2024-04-06T12:23:08.800 INFO:tasks.workunit.client.1.smithi195.stdout:1/517: rename d4/d14/d17/d24/d99/c51 to d4/d14/d17/d24/d2a/c9b 0 2024-04-06T12:23:08.802 INFO:tasks.workunit.client.1.smithi195.stdout:4/468: symlink d4/d6/d38/d1a/d40/d57/l8e 0 2024-04-06T12:23:08.803 INFO:tasks.workunit.client.1.smithi195.stdout:8/495: dwrite d6/dd/d70/d24/d25/f93 [0,4194304] 0 2024-04-06T12:23:08.804 INFO:tasks.workunit.client.1.smithi195.stdout:4/469: chown d4/d6/d38/d65/f7f 639 1 2024-04-06T12:23:08.805 INFO:tasks.workunit.client.1.smithi195.stdout:4/470: write d4/d6/d38/f86 [531449,66438] 0 2024-04-06T12:23:08.807 INFO:tasks.workunit.client.1.smithi195.stdout:2/553: creat d2/d21/d2c/d2d/d92/d95/fa9 x:0 0 0 2024-04-06T12:23:08.813 INFO:tasks.workunit.client.1.smithi195.stdout:4/471: rmdir d4/d6/d38/d1a/d40/d57/d64 39 2024-04-06T12:23:08.815 INFO:tasks.workunit.client.1.smithi195.stdout:2/554: rename d2/d14/f82 to d2/d14/faa 0 2024-04-06T12:23:08.817 INFO:tasks.workunit.client.1.smithi195.stdout:1/518: unlink d4/d14/f1f 0 2024-04-06T12:23:08.819 INFO:tasks.workunit.client.1.smithi195.stdout:8/496: creat d6/dd/d70/d24/d25/d7c/fa9 x:0 0 0 2024-04-06T12:23:08.819 INFO:tasks.workunit.client.1.smithi195.stdout:8/497: readlink d6/dd/d70/d24/d53/l59 0 2024-04-06T12:23:08.822 INFO:tasks.workunit.client.1.smithi195.stdout:4/472: unlink d4/d6/d38/d1a/d40/d57/l73 0 2024-04-06T12:23:08.824 INFO:tasks.workunit.client.1.smithi195.stdout:6/529: rename d8/d21/d31/d26/dc8/fb5 to d8/fcb 0 2024-04-06T12:23:08.825 INFO:tasks.workunit.client.1.smithi195.stdout:5/538: write d0/da/d23/d38/f44 [3000387,41203] 0 2024-04-06T12:23:08.827 INFO:tasks.workunit.client.1.smithi195.stdout:3/557: write d4/de/f46 [4585134,105988] 0 2024-04-06T12:23:08.828 INFO:tasks.workunit.client.1.smithi195.stdout:3/558: truncate d4/d9/f68 1645160 0 2024-04-06T12:23:08.830 INFO:tasks.workunit.client.1.smithi195.stdout:2/555: rmdir d2/d21/d5e 39 2024-04-06T12:23:08.834 INFO:tasks.workunit.client.1.smithi195.stdout:5/539: write d0/da/dd/d2e/d6f/f96 [2343683,32746] 0 2024-04-06T12:23:08.835 INFO:tasks.workunit.client.1.smithi195.stdout:5/540: write d0/da/f22 [3781204,18692] 0 2024-04-06T12:23:08.841 INFO:tasks.workunit.client.1.smithi195.stdout:6/530: truncate d8/d21/d2b/d46/d2f/f53 2399666 0 2024-04-06T12:23:08.844 INFO:tasks.workunit.client.1.smithi195.stdout:4/473: getdents d4 0 2024-04-06T12:23:08.846 INFO:tasks.workunit.client.1.smithi195.stdout:8/498: rename d6/dd/d70/d24/d25/d5e to d6/d8/daa 0 2024-04-06T12:23:08.849 INFO:tasks.workunit.client.1.smithi195.stdout:2/556: rmdir d2/d3f/d8b 0 2024-04-06T12:23:08.852 INFO:tasks.workunit.client.1.smithi195.stdout:3/559: rename d4/d9/fd to d4/d9/fb0 0 2024-04-06T12:23:08.853 INFO:tasks.workunit.client.1.smithi195.stdout:4/474: chown d4/d6/d38/c4f 10778481 1 2024-04-06T12:23:08.854 INFO:tasks.workunit.client.1.smithi195.stdout:8/499: rmdir d6/db/d47/d97 39 2024-04-06T12:23:08.855 INFO:tasks.workunit.client.1.smithi195.stdout:8/500: chown d6/d3a/d46/f7e 507 1 2024-04-06T12:23:08.857 INFO:tasks.workunit.client.1.smithi195.stdout:8/501: chown d6/dd/d70/d24/d34/d67 52 1 2024-04-06T12:23:08.858 INFO:tasks.workunit.client.1.smithi195.stdout:8/502: readlink d6/d8/d12/l3c 0 2024-04-06T12:23:08.859 INFO:tasks.workunit.client.1.smithi195.stdout:3/560: creat d4/df/d39/fb1 x:0 0 0 2024-04-06T12:23:08.860 INFO:tasks.workunit.client.1.smithi195.stdout:5/541: dwrite d0/da/d13/d87/f31 [0,4194304] 0 2024-04-06T12:23:08.861 INFO:tasks.workunit.client.1.smithi195.stdout:2/557: stat d2/d21/d5e/d64/l83 0 2024-04-06T12:23:08.862 INFO:tasks.workunit.client.1.smithi195.stdout:6/531: truncate d8/d21/d2b/f48 915459 0 2024-04-06T12:23:08.863 INFO:tasks.workunit.client.1.smithi195.stdout:6/532: chown d8/d3d/d5e/f8f 2 1 2024-04-06T12:23:08.864 INFO:tasks.workunit.client.1.smithi195.stdout:4/475: symlink d4/d6/d38/l8f 0 2024-04-06T12:23:08.865 INFO:tasks.workunit.client.1.smithi195.stdout:8/503: mkdir d6/d8/daa/dab 0 2024-04-06T12:23:08.870 INFO:tasks.workunit.client.1.smithi195.stdout:3/561: symlink d4/de/d8e/daf/lb2 0 2024-04-06T12:23:08.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/504: creat d6/d8/d12/d61/fac x:0 0 0 2024-04-06T12:23:08.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/562: creat d4/d9/d2b/d77/d9a/fb3 x:0 0 0 2024-04-06T12:23:08.880 INFO:tasks.workunit.client.1.smithi195.stdout:4/476: link d4/d6/c10 d4/d6/c90 0 2024-04-06T12:23:08.881 INFO:tasks.workunit.client.1.smithi195.stdout:2/558: getdents d2/d21/d2c 0 2024-04-06T12:23:08.883 INFO:tasks.workunit.client.1.smithi195.stdout:8/505: creat d6/d8/daa/dab/fad x:0 0 0 2024-04-06T12:23:08.883 INFO:tasks.workunit.client.1.smithi195.stdout:8/506: readlink d6/l1b 0 2024-04-06T12:23:08.884 INFO:tasks.workunit.client.1.smithi195.stdout:3/563: creat d4/d9/d2b/d3b/d5e/d7e/fb4 x:0 0 0 2024-04-06T12:23:08.885 INFO:tasks.workunit.client.1.smithi195.stdout:5/542: truncate d0/da/dd/d33/f53 8885 0 2024-04-06T12:23:08.889 INFO:tasks.workunit.client.1.smithi195.stdout:8/507: rmdir d6/d3a/d46 39 2024-04-06T12:23:08.890 INFO:tasks.workunit.client.1.smithi195.stdout:6/533: link d8/d21/d2b/f48 d8/d21/d31/d6c/d7b/fcc 0 2024-04-06T12:23:08.891 INFO:tasks.workunit.client.1.smithi195.stdout:5/543: dwrite d0/da/dd/d1c/d5a/d62/d64/f8a [0,4194304] 0 2024-04-06T12:23:08.892 INFO:tasks.workunit.client.1.smithi195.stdout:5/544: read d0/da/d13/f15 [1046168,103837] 0 2024-04-06T12:23:08.896 INFO:tasks.workunit.client.1.smithi195.stdout:3/564: mknod d4/de/d8e/cb5 0 2024-04-06T12:23:08.897 INFO:tasks.workunit.client.1.smithi195.stdout:8/508: symlink d6/dd/d70/d24/d34/d67/d9d/lae 0 2024-04-06T12:23:08.899 INFO:tasks.workunit.client.1.smithi195.stdout:6/534: symlink d8/d21/d2b/lcd 0 2024-04-06T12:23:08.906 INFO:tasks.workunit.client.1.smithi195.stdout:2/559: link d2/d3f/d7d/l59 d2/d21/d69/lab 0 2024-04-06T12:23:08.909 INFO:tasks.workunit.client.1.smithi195.stdout:8/509: unlink d6/dd/d70/d24/d34/c3f 0 2024-04-06T12:23:08.911 INFO:tasks.workunit.client.1.smithi195.stdout:2/560: chown d2/d21/d29/c70 13 1 2024-04-06T12:23:08.912 INFO:tasks.workunit.client.1.smithi195.stdout:3/565: link d4/d9/d2b/d3b/d40/f56 d4/d9/d2b/d3b/d5e/d7e/fb6 0 2024-04-06T12:23:08.913 INFO:tasks.workunit.client.1.smithi195.stdout:5/545: getdents d0/da/dd/d2e/d6f/d58 0 2024-04-06T12:23:08.913 INFO:tasks.workunit.client.1.smithi195.stdout:0/526: sync 2024-04-06T12:23:08.913 INFO:tasks.workunit.client.1.smithi195.stdout:9/556: sync 2024-04-06T12:23:08.914 INFO:tasks.workunit.client.1.smithi195.stdout:4/477: truncate d4/f5 4830752 0 2024-04-06T12:23:08.914 INFO:tasks.workunit.client.1.smithi195.stdout:8/510: readlink d6/dd/d70/d24/d25/l56 0 2024-04-06T12:23:08.916 INFO:tasks.workunit.client.1.smithi195.stdout:6/535: rmdir d8/d3d/d3f/db0 0 2024-04-06T12:23:08.918 INFO:tasks.workunit.client.1.smithi195.stdout:2/561: mkdir d2/d41/d84/d8d/d94/dac 0 2024-04-06T12:23:08.919 INFO:tasks.workunit.client.1.smithi195.stdout:6/536: write d8/d3d/d5e/f77 [2023062,70203] 0 2024-04-06T12:23:08.921 INFO:tasks.workunit.client.1.smithi195.stdout:0/527: creat d4/d48/d67/d83/fab x:0 0 0 2024-04-06T12:23:08.922 INFO:tasks.workunit.client.1.smithi195.stdout:9/557: creat d3/d10/d3a/d6b/fbf x:0 0 0 2024-04-06T12:23:08.923 INFO:tasks.workunit.client.1.smithi195.stdout:0/528: chown d4/d6/d58/c5d 12798 1 2024-04-06T12:23:08.924 INFO:tasks.workunit.client.1.smithi195.stdout:5/546: truncate d0/da/dd/d2e/d6f/f51 801001 0 2024-04-06T12:23:08.925 INFO:tasks.workunit.client.1.smithi195.stdout:3/566: dread d4/d9/d2b/d3b/d40/f56 [0,4194304] 0 2024-04-06T12:23:08.926 INFO:tasks.workunit.client.1.smithi195.stdout:6/537: dwrite d8/f19 [4194304,4194304] 0 2024-04-06T12:23:08.927 INFO:tasks.workunit.client.1.smithi195.stdout:8/511: rename d6/dd/d70/d24/d53/l59 to d6/d8/d12/d83/laf 0 2024-04-06T12:23:08.928 INFO:tasks.workunit.client.1.smithi195.stdout:8/512: fsync d6/dd/d70/f3b 0 2024-04-06T12:23:08.947 INFO:tasks.workunit.client.1.smithi195.stdout:2/562: creat d2/d3f/fad x:0 0 0 2024-04-06T12:23:08.947 INFO:tasks.workunit.client.1.smithi195.stdout:3/567: symlink d4/d9/d2b/d77/d9a/lb7 0 2024-04-06T12:23:08.948 INFO:tasks.workunit.client.1.smithi195.stdout:8/513: truncate d6/d8/f55 1029581 0 2024-04-06T12:23:08.949 INFO:tasks.workunit.client.1.smithi195.stdout:6/538: write d8/d3d/f81 [2911013,31144] 0 2024-04-06T12:23:08.949 INFO:tasks.workunit.client.1.smithi195.stdout:4/478: rename d4/d6/d38/d1a/d40/d20/c54 to d4/d6/d38/d1a/d40/d57/d64/c91 0 2024-04-06T12:23:08.949 INFO:tasks.workunit.client.1.smithi195.stdout:3/568: stat d4/d9/d2b/f72 0 2024-04-06T12:23:08.950 INFO:tasks.workunit.client.1.smithi195.stdout:5/547: dwrite d0/da/dd/f89 [0,4194304] 0 2024-04-06T12:23:08.952 INFO:tasks.workunit.client.1.smithi195.stdout:4/479: chown d4/d6/d38/d1a/d40/f41 1 1 2024-04-06T12:23:08.955 INFO:tasks.workunit.client.1.smithi195.stdout:2/563: mkdir d2/d3f/d7d/dae 0 2024-04-06T12:23:08.956 INFO:tasks.workunit.client.1.smithi195.stdout:9/558: getdents d3/d10/d3b/d48 0 2024-04-06T12:23:08.957 INFO:tasks.workunit.client.1.smithi195.stdout:6/539: mkdir d8/d50/d9c/dce 0 2024-04-06T12:23:08.958 INFO:tasks.workunit.client.1.smithi195.stdout:2/564: write d2/f61 [3758344,38935] 0 2024-04-06T12:23:08.959 INFO:tasks.workunit.client.1.smithi195.stdout:8/514: mkdir d6/d8/d52/db0 0 2024-04-06T12:23:08.960 INFO:tasks.workunit.client.1.smithi195.stdout:3/569: unlink d4/d53/l59 0 2024-04-06T12:23:08.962 INFO:tasks.workunit.client.1.smithi195.stdout:5/548: dwrite d0/da/d13/d87/fbd [0,4194304] 0 2024-04-06T12:23:08.964 INFO:tasks.workunit.client.1.smithi195.stdout:6/540: write d8/d21/fc7 [808010,59279] 0 2024-04-06T12:23:08.968 INFO:tasks.workunit.client.1.smithi195.stdout:3/570: fsync d4/f25 0 2024-04-06T12:23:08.969 INFO:tasks.workunit.client.1.smithi195.stdout:5/549: chown d0/da/dd/d1c/d5a/d62/d64 7241990 1 2024-04-06T12:23:08.971 INFO:tasks.workunit.client.1.smithi195.stdout:4/480: dread d4/d6/d38/f1d [0,4194304] 0 2024-04-06T12:23:08.974 INFO:tasks.workunit.client.1.smithi195.stdout:9/559: dwrite d3/d10/d3a/d5d/fb8 [0,4194304] 0 2024-04-06T12:23:08.975 INFO:tasks.workunit.client.1.smithi195.stdout:8/515: dwrite d6/db/f60 [0,4194304] 0 2024-04-06T12:23:08.976 INFO:tasks.workunit.client.1.smithi195.stdout:6/541: mkdir d8/d21/d31/d26/dcf 0 2024-04-06T12:23:08.978 INFO:tasks.workunit.client.1.smithi195.stdout:6/542: write d8/d3d/d5e/f77 [3054620,52172] 0 2024-04-06T12:23:08.980 INFO:tasks.workunit.client.1.smithi195.stdout:5/550: mknod d0/da/d4b/cbf 0 2024-04-06T12:23:08.980 INFO:tasks.workunit.client.1.smithi195.stdout:3/571: mkdir d4/d9/d2b/d87/db8 0 2024-04-06T12:23:08.980 INFO:tasks.workunit.client.1.smithi195.stdout:5/551: truncate d0/f94 323980 0 2024-04-06T12:23:08.981 INFO:tasks.workunit.client.1.smithi195.stdout:4/481: symlink d4/l92 0 2024-04-06T12:23:08.984 INFO:tasks.workunit.client.1.smithi195.stdout:9/560: creat d3/dba/fc0 x:0 0 0 2024-04-06T12:23:08.986 INFO:tasks.workunit.client.1.smithi195.stdout:8/516: rmdir d6/dd/d70/d24/d34 39 2024-04-06T12:23:08.988 INFO:tasks.workunit.client.1.smithi195.stdout:5/552: dwrite d0/d35/f5f [4194304,4194304] 0 2024-04-06T12:23:08.990 INFO:tasks.workunit.client.1.smithi195.stdout:3/572: mkdir d4/d9/d37/db9 0 2024-04-06T12:23:08.993 INFO:tasks.workunit.client.1.smithi195.stdout:5/553: dread d0/d35/f5f [4194304,4194304] 0 2024-04-06T12:23:08.995 INFO:tasks.workunit.client.1.smithi195.stdout:5/554: write d0/da/dd/d2e/d6f/f96 [5241526,117118] 0 2024-04-06T12:23:08.996 INFO:tasks.workunit.client.1.smithi195.stdout:8/517: readlink d6/dd/d70/d24/d25/d49/l75 0 2024-04-06T12:23:09.004 INFO:tasks.workunit.client.1.smithi195.stdout:3/573: creat d4/d9/d2b/d77/fba x:0 0 0 2024-04-06T12:23:09.007 INFO:tasks.workunit.client.1.smithi195.stdout:3/574: write d4/d53/f60 [284576,90020] 0 2024-04-06T12:23:09.007 INFO:tasks.workunit.client.1.smithi195.stdout:5/555: dwrite d0/da/d13/d87/fbd [0,4194304] 0 2024-04-06T12:23:09.009 INFO:tasks.workunit.client.1.smithi195.stdout:6/543: creat d8/d21/fd0 x:0 0 0 2024-04-06T12:23:09.010 INFO:tasks.workunit.client.1.smithi195.stdout:9/561: creat d3/fc1 x:0 0 0 2024-04-06T12:23:09.011 INFO:tasks.workunit.client.1.smithi195.stdout:6/544: truncate d8/d21/d31/f11 2203243 0 2024-04-06T12:23:09.012 INFO:tasks.workunit.client.1.smithi195.stdout:5/556: dread d0/da/dd/d2e/f70 [0,4194304] 0 2024-04-06T12:23:09.020 INFO:tasks.workunit.client.1.smithi195.stdout:5/557: dwrite d0/da/dd/d1c/d5a/d62/d64/d67/db9/fac [0,4194304] 0 2024-04-06T12:23:09.021 INFO:tasks.workunit.client.1.smithi195.stdout:9/562: chown d3/d10/d3b/d48/d9c/c8e 896063 1 2024-04-06T12:23:09.022 INFO:tasks.workunit.client.1.smithi195.stdout:8/518: write d6/d8/d12/f2f [353407,120411] 0 2024-04-06T12:23:09.024 INFO:tasks.workunit.client.1.smithi195.stdout:3/575: unlink d4/df/c23 0 2024-04-06T12:23:09.025 INFO:tasks.workunit.client.1.smithi195.stdout:6/545: mknod d8/d21/d31/d26/dcf/cd1 0 2024-04-06T12:23:09.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:07.573390+0000 mgr.smithi195.ausetj (mgr.24375) 54 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 810 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 7.5 MiB/s rd, 87 MiB/s wr, 213 op/s 2024-04-06T12:23:09.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/519: mkdir d6/d8/daa/dab/db1 0 2024-04-06T12:23:09.028 INFO:tasks.workunit.client.1.smithi195.stdout:4/482: write d4/d6/d38/f3f [2060447,113873] 0 2024-04-06T12:23:09.031 INFO:tasks.workunit.client.1.smithi195.stdout:5/558: rename d0/da/dd/d2e/d6f/f75 to d0/da/dd/d2e/d6f/d58/d97/fc0 0 2024-04-06T12:23:09.033 INFO:tasks.workunit.client.1.smithi195.stdout:5/559: fsync d0/da/dd/d2e/f4c 0 2024-04-06T12:23:09.033 INFO:tasks.workunit.client.1.smithi195.stdout:6/546: dwrite d8/d21/fd0 [0,4194304] 0 2024-04-06T12:23:09.035 INFO:tasks.workunit.client.1.smithi195.stdout:4/483: chown d4/c17 41 1 2024-04-06T12:23:09.037 INFO:tasks.workunit.client.1.smithi195.stdout:4/484: fsync d4/d6/d38/d1a/d40/d20/f8a 0 2024-04-06T12:23:09.039 INFO:tasks.workunit.client.1.smithi195.stdout:9/563: dwrite d3/f17 [0,4194304] 0 2024-04-06T12:23:09.044 INFO:tasks.workunit.client.1.smithi195.stdout:4/485: write d4/f7e [365901,77671] 0 2024-04-06T12:23:09.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:07.573390+0000 mgr.smithi195.ausetj (mgr.24375) 54 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 810 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 7.5 MiB/s rd, 87 MiB/s wr, 213 op/s 2024-04-06T12:23:09.049 INFO:tasks.workunit.client.1.smithi195.stdout:5/560: symlink d0/da/dd/d1c/d5a/d62/db8/lc1 0 2024-04-06T12:23:09.052 INFO:tasks.workunit.client.1.smithi195.stdout:9/564: mkdir d3/d10/d3a/d6b/dc2 0 2024-04-06T12:23:09.054 INFO:tasks.workunit.client.1.smithi195.stdout:6/547: creat d8/d3d/fd2 x:0 0 0 2024-04-06T12:23:09.056 INFO:tasks.workunit.client.1.smithi195.stdout:4/486: dwrite d4/d6/d38/d1a/d40/d20/f60 [0,4194304] 0 2024-04-06T12:23:09.058 INFO:tasks.workunit.client.1.smithi195.stdout:5/561: rmdir d0/da/dd/d1c/d5a/d62 39 2024-04-06T12:23:09.060 INFO:tasks.workunit.client.1.smithi195.stdout:6/548: write d8/d3d/d3f/f76 [245870,100006] 0 2024-04-06T12:23:09.061 INFO:tasks.workunit.client.1.smithi195.stdout:8/520: dwrite d6/dd/d70/d24/d53/f68 [4194304,4194304] 0 2024-04-06T12:23:09.063 INFO:tasks.workunit.client.1.smithi195.stdout:3/576: dwrite d4/d9/d2b/d3b/f4c [0,4194304] 0 2024-04-06T12:23:09.065 INFO:tasks.workunit.client.1.smithi195.stdout:8/521: dread - d6/d8/d12/f37 zero size 2024-04-06T12:23:09.067 INFO:tasks.workunit.client.1.smithi195.stdout:4/487: rmdir d4/d6/d38/d1a/d40/d57 39 2024-04-06T12:23:09.069 INFO:tasks.workunit.client.1.smithi195.stdout:9/565: dwrite d3/da1/fb4 [0,4194304] 0 2024-04-06T12:23:09.077 INFO:tasks.workunit.client.1.smithi195.stdout:3/577: unlink d4/de/c14 0 2024-04-06T12:23:09.077 INFO:tasks.workunit.client.1.smithi195.stdout:6/549: rename d8/d50/d9c/dc5 to d8/d3d/d5e/dd3 0 2024-04-06T12:23:09.077 INFO:tasks.workunit.client.1.smithi195.stdout:8/522: fdatasync d6/dd/d70/d24/d34/fa3 0 2024-04-06T12:23:09.077 INFO:tasks.workunit.client.1.smithi195.stdout:9/566: mknod d3/db9/dbc/cc3 0 2024-04-06T12:23:09.077 INFO:tasks.workunit.client.1.smithi195.stdout:4/488: truncate d4/f5e 482984 0 2024-04-06T12:23:09.078 INFO:tasks.workunit.client.1.smithi195.stdout:8/523: chown d6/d8/d12/d61/fac 97315 1 2024-04-06T12:23:09.082 INFO:tasks.workunit.client.1.smithi195.stdout:9/567: creat d3/db9/dbc/fc4 x:0 0 0 2024-04-06T12:23:09.084 INFO:tasks.workunit.client.1.smithi195.stdout:3/578: mkdir d4/de/d8e/dbb 0 2024-04-06T12:23:09.085 INFO:tasks.workunit.client.1.smithi195.stdout:6/550: dwrite d8/f1a [0,4194304] 0 2024-04-06T12:23:09.086 INFO:tasks.workunit.client.1.smithi195.stdout:3/579: fsync d4/d9/d37/f97 0 2024-04-06T12:23:09.087 INFO:tasks.workunit.client.1.smithi195.stdout:8/524: mkdir d6/d3a/d46/db2 0 2024-04-06T12:23:09.087 INFO:tasks.workunit.client.1.smithi195.stdout:5/562: dwrite d0/da/f21 [0,4194304] 0 2024-04-06T12:23:09.090 INFO:tasks.workunit.client.1.smithi195.stdout:1/519: sync 2024-04-06T12:23:09.090 INFO:tasks.workunit.client.1.smithi195.stdout:7/411: sync 2024-04-06T12:23:09.090 INFO:tasks.workunit.client.1.smithi195.stdout:6/551: symlink d8/d50/ld4 0 2024-04-06T12:23:09.091 INFO:tasks.workunit.client.1.smithi195.stdout:1/520: fsync d4/d14/d17/d24/d99/d4e/d60/f8d 0 2024-04-06T12:23:09.094 INFO:tasks.workunit.client.1.smithi195.stdout:5/563: mkdir d0/da/d13/d87/d37/dc2 0 2024-04-06T12:23:09.095 INFO:tasks.workunit.client.1.smithi195.stdout:3/580: symlink d4/d9/lbc 0 2024-04-06T12:23:09.102 INFO:tasks.workunit.client.1.smithi195.stdout:3/581: dwrite d4/d9/d2b/d77/fba [0,4194304] 0 2024-04-06T12:23:09.105 INFO:tasks.workunit.client.1.smithi195.stdout:4/489: dread d4/d6/d38/f2c [0,4194304] 0 2024-04-06T12:23:09.106 INFO:tasks.workunit.client.1.smithi195.stdout:5/564: unlink d0/f3 0 2024-04-06T12:23:09.106 INFO:tasks.workunit.client.1.smithi195.stdout:4/490: stat d4/d6/d38/d65/l68 0 2024-04-06T12:23:09.107 INFO:tasks.workunit.client.1.smithi195.stdout:7/412: dread d4/d24/f1f [0,4194304] 0 2024-04-06T12:23:09.108 INFO:tasks.workunit.client.1.smithi195.stdout:7/413: fsync d4/d16/dd/d22/d3f/d54/f5f 0 2024-04-06T12:23:09.109 INFO:tasks.workunit.client.1.smithi195.stdout:6/552: unlink d8/d50/d32/c66 0 2024-04-06T12:23:09.114 INFO:tasks.workunit.client.1.smithi195.stdout:8/525: write d6/d8/d12/f37 [629455,127678] 0 2024-04-06T12:23:09.118 INFO:tasks.workunit.client.1.smithi195.stdout:6/553: read d8/d50/f39 [16257,115158] 0 2024-04-06T12:23:09.119 INFO:tasks.workunit.client.1.smithi195.stdout:3/582: symlink d4/d9/d2b/d3b/d5e/dab/lbd 0 2024-04-06T12:23:09.120 INFO:tasks.workunit.client.1.smithi195.stdout:8/526: symlink d6/dd/d70/d24/d34/d67/d9d/lb3 0 2024-04-06T12:23:09.120 INFO:tasks.workunit.client.1.smithi195.stdout:5/565: rmdir d0/da/dd/d1c/d5a/d62/d64/d67 39 2024-04-06T12:23:09.123 INFO:tasks.workunit.client.1.smithi195.stdout:7/414: mknod d4/c85 0 2024-04-06T12:23:09.123 INFO:tasks.workunit.client.1.smithi195.stdout:7/415: readlink d4/d16/d11/l41 0 2024-04-06T12:23:09.124 INFO:tasks.workunit.client.1.smithi195.stdout:5/566: dread d0/da/dd/d1c/f2d [0,4194304] 0 2024-04-06T12:23:09.125 INFO:tasks.workunit.client.1.smithi195.stdout:5/567: write d0/d35/f6b [3039165,109926] 0 2024-04-06T12:23:09.125 INFO:tasks.workunit.client.1.smithi195.stdout:6/554: dread - d8/d50/d9c/faa zero size 2024-04-06T12:23:09.126 INFO:tasks.workunit.client.1.smithi195.stdout:3/583: truncate d4/d9/d2b/d3b/f6b 139605 0 2024-04-06T12:23:09.127 INFO:tasks.workunit.client.1.smithi195.stdout:5/568: write d0/da/dd/d2e/d6f/f9d [543828,41441] 0 2024-04-06T12:23:09.128 INFO:tasks.workunit.client.1.smithi195.stdout:8/527: creat d6/dd/d70/d24/d25/d7c/fb4 x:0 0 0 2024-04-06T12:23:09.129 INFO:tasks.workunit.client.1.smithi195.stdout:5/569: fdatasync d0/da/f3c 0 2024-04-06T12:23:09.129 INFO:tasks.workunit.client.1.smithi195.stdout:3/584: write d4/d53/f54 [379177,44521] 0 2024-04-06T12:23:09.130 INFO:tasks.workunit.client.1.smithi195.stdout:8/528: dread - d6/d3a/d46/fa6 zero size 2024-04-06T12:23:09.131 INFO:tasks.workunit.client.1.smithi195.stdout:1/521: truncate d4/d14/d17/d24/d99/d23/d28/d2f/f33 6977415 0 2024-04-06T12:23:09.133 INFO:tasks.workunit.client.1.smithi195.stdout:1/522: truncate d4/d14/d17/d24/d99/d4e/d8f/f92 445449 0 2024-04-06T12:23:09.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/491: rename d4/d6/d38/d1a/d40/d57/l6f to d4/l93 0 2024-04-06T12:23:09.137 INFO:tasks.workunit.client.1.smithi195.stdout:7/416: symlink d4/d10/d18/d7e/l86 0 2024-04-06T12:23:09.138 INFO:tasks.workunit.client.1.smithi195.stdout:7/417: write d4/d16/f2d [267351,99368] 0 2024-04-06T12:23:09.139 INFO:tasks.workunit.client.1.smithi195.stdout:8/529: mkdir d6/dd/d70/d24/d34/d67/d9d/db5 0 2024-04-06T12:23:09.139 INFO:tasks.workunit.client.1.smithi195.stdout:7/418: chown d4/d16/l6 363759594 1 2024-04-06T12:23:09.143 INFO:tasks.workunit.client.1.smithi195.stdout:1/523: creat d4/d14/d17/d24/d99/d23/d28/d2f/f9c x:0 0 0 2024-04-06T12:23:09.145 INFO:tasks.workunit.client.1.smithi195.stdout:1/524: write d4/d14/d17/d24/d99/d23/d28/f50 [1793849,98007] 0 2024-04-06T12:23:09.147 INFO:tasks.workunit.client.1.smithi195.stdout:3/585: symlink d4/d9/d2b/d87/db8/lbe 0 2024-04-06T12:23:09.149 INFO:tasks.workunit.client.1.smithi195.stdout:7/419: dread d4/f7 [0,4194304] 0 2024-04-06T12:23:09.149 INFO:tasks.workunit.client.1.smithi195.stdout:0/529: sync 2024-04-06T12:23:09.149 INFO:tasks.workunit.client.1.smithi195.stdout:2/565: sync 2024-04-06T12:23:09.150 INFO:tasks.workunit.client.1.smithi195.stdout:0/530: readlink d4/l1e 0 2024-04-06T12:23:09.150 INFO:tasks.workunit.client.1.smithi195.stdout:6/555: creat d8/d3d/fd5 x:0 0 0 2024-04-06T12:23:09.150 INFO:tasks.workunit.client.1.smithi195.stdout:7/420: dread - d4/d16/d11/f79 zero size 2024-04-06T12:23:09.151 INFO:tasks.workunit.client.1.smithi195.stdout:2/566: write d2/d3f/fad [289711,62417] 0 2024-04-06T12:23:09.153 INFO:tasks.workunit.client.1.smithi195.stdout:2/567: dread - d2/d14/f4e zero size 2024-04-06T12:23:09.154 INFO:tasks.workunit.client.1.smithi195.stdout:5/570: creat d0/da/d23/d38/fc3 x:0 0 0 2024-04-06T12:23:09.155 INFO:tasks.workunit.client.1.smithi195.stdout:5/571: stat d0/da/dd/d2e/f4c 0 2024-04-06T12:23:09.162 INFO:tasks.workunit.client.1.smithi195.stdout:2/568: symlink d2/d14/laf 0 2024-04-06T12:23:09.167 INFO:tasks.workunit.client.1.smithi195.stdout:5/572: creat d0/da/dd/d1c/d5a/d62/fc4 x:0 0 0 2024-04-06T12:23:09.167 INFO:tasks.workunit.client.1.smithi195.stdout:4/492: dwrite d4/d6/d38/f28 [0,4194304] 0 2024-04-06T12:23:09.168 INFO:tasks.workunit.client.1.smithi195.stdout:8/530: creat d6/fb6 x:0 0 0 2024-04-06T12:23:09.169 INFO:tasks.workunit.client.1.smithi195.stdout:8/531: stat d6/dd/f38 0 2024-04-06T12:23:09.169 INFO:tasks.workunit.client.1.smithi195.stdout:0/531: creat d4/d48/d77/d97/fac x:0 0 0 2024-04-06T12:23:09.170 INFO:tasks.workunit.client.1.smithi195.stdout:8/532: chown d6/db/l22 28 1 2024-04-06T12:23:09.171 INFO:tasks.workunit.client.1.smithi195.stdout:6/556: fsync d8/d21/d2b/f48 0 2024-04-06T12:23:09.171 INFO:tasks.workunit.client.1.smithi195.stdout:8/533: dread - d6/d8/f99 zero size 2024-04-06T12:23:09.171 INFO:tasks.workunit.client.1.smithi195.stdout:7/421: mknod d4/d10/d12/d6f/c87 0 2024-04-06T12:23:09.172 INFO:tasks.workunit.client.1.smithi195.stdout:7/422: fdatasync d4/d16/f3e 0 2024-04-06T12:23:09.174 INFO:tasks.workunit.client.1.smithi195.stdout:3/586: rename d4/d9/d2b/d77/c8c to d4/de/d8e/dbb/cbf 0 2024-04-06T12:23:09.180 INFO:tasks.workunit.client.1.smithi195.stdout:3/587: dwrite d4/d9/d2b/f42 [0,4194304] 0 2024-04-06T12:23:09.181 INFO:tasks.workunit.client.1.smithi195.stdout:2/569: symlink d2/d21/lb0 0 2024-04-06T12:23:09.181 INFO:tasks.workunit.client.1.smithi195.stdout:3/588: dread - d4/d9/f49 zero size 2024-04-06T12:23:09.182 INFO:tasks.workunit.client.1.smithi195.stdout:1/525: getdents d4/d14/d17/d24/d99/d23/d5d 0 2024-04-06T12:23:09.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/570: dread d2/d3f/d7d/d7a/f81 [0,4194304] 0 2024-04-06T12:23:09.184 INFO:tasks.workunit.client.1.smithi195.stdout:2/571: chown d2/d3f/d7d/d5d/f7c 58647 1 2024-04-06T12:23:09.185 INFO:tasks.workunit.client.1.smithi195.stdout:7/423: readlink d4/d10/d18/l84 0 2024-04-06T12:23:09.187 INFO:tasks.workunit.client.1.smithi195.stdout:9/568: sync 2024-04-06T12:23:09.189 INFO:tasks.workunit.client.1.smithi195.stdout:5/573: rename d0/da/dd/d2e/d6f/d58/d97 to d0/da/d23/d7a/dc5 0 2024-04-06T12:23:09.194 INFO:tasks.workunit.client.1.smithi195.stdout:2/572: unlink d2/d21/d5e/l75 0 2024-04-06T12:23:09.194 INFO:tasks.workunit.client.1.smithi195.stdout:1/526: readlink d4/d14/d17/d24/d99/d23/l81 0 2024-04-06T12:23:09.195 INFO:tasks.workunit.client.1.smithi195.stdout:8/534: getdents d6/dd/d70/d24/d34/d67/da1/da2/da4 0 2024-04-06T12:23:09.196 INFO:tasks.workunit.client.1.smithi195.stdout:6/557: write f5 [1195720,64819] 0 2024-04-06T12:23:09.197 INFO:tasks.workunit.client.1.smithi195.stdout:4/493: dwrite d4/d6/d38/d1a/d40/d20/d23/f31 [0,4194304] 0 2024-04-06T12:23:09.199 INFO:tasks.workunit.client.1.smithi195.stdout:9/569: rmdir d3/dba 39 2024-04-06T12:23:09.201 INFO:tasks.workunit.client.1.smithi195.stdout:7/424: rename d4/d10/c7b to d4/d16/dd/c88 0 2024-04-06T12:23:09.202 INFO:tasks.workunit.client.1.smithi195.stdout:1/527: truncate d4/d14/d17/d24/f4a 573428 0 2024-04-06T12:23:09.202 INFO:tasks.workunit.client.1.smithi195.stdout:5/574: creat d0/da/d23/d7a/dc5/fc6 x:0 0 0 2024-04-06T12:23:09.203 INFO:tasks.workunit.client.1.smithi195.stdout:9/570: write d3/f17 [4015121,49172] 0 2024-04-06T12:23:09.204 INFO:tasks.workunit.client.1.smithi195.stdout:4/494: dread - d4/d6/d38/d1a/d40/d20/f8a zero size 2024-04-06T12:23:09.208 INFO:tasks.workunit.client.1.smithi195.stdout:7/425: read d4/d16/d11/f59 [5563921,101114] 0 2024-04-06T12:23:09.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/532: link d4/d6/l80 d4/d48/lad 0 2024-04-06T12:23:09.211 INFO:tasks.workunit.client.1.smithi195.stdout:8/535: dwrite d6/f91 [0,4194304] 0 2024-04-06T12:23:09.212 INFO:tasks.workunit.client.1.smithi195.stdout:6/558: dwrite d8/d21/d2b/f54 [0,4194304] 0 2024-04-06T12:23:09.213 INFO:tasks.workunit.client.1.smithi195.stdout:7/426: dread d4/d24/f1f [0,4194304] 0 2024-04-06T12:23:09.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/533: chown d4/d48/d67/d75/f7d 8385 1 2024-04-06T12:23:09.220 INFO:tasks.workunit.client.1.smithi195.stdout:9/571: chown d3/c44 0 1 2024-04-06T12:23:09.225 INFO:tasks.workunit.client.1.smithi195.stdout:0/534: chown d4/d6/d1a/d73/f92 118400 1 2024-04-06T12:23:09.225 INFO:tasks.workunit.client.1.smithi195.stdout:2/573: rmdir d2/d3f/d7d/dae 0 2024-04-06T12:23:09.225 INFO:tasks.workunit.client.1.smithi195.stdout:3/589: truncate d4/d9/d2b/d3b/d40/f55 911440 0 2024-04-06T12:23:09.225 INFO:tasks.workunit.client.1.smithi195.stdout:2/574: dread - d2/d21/d29/f4b zero size 2024-04-06T12:23:09.225 INFO:tasks.workunit.client.1.smithi195.stdout:1/528: fdatasync d4/d14/d17/d24/d99/d23/d28/d2f/f33 0 2024-04-06T12:23:09.225 INFO:tasks.workunit.client.1.smithi195.stdout:0/535: write d4/d6/d1a/f37 [1408013,91662] 0 2024-04-06T12:23:09.226 INFO:tasks.workunit.client.1.smithi195.stdout:6/559: fdatasync d8/d21/f5a 0 2024-04-06T12:23:09.226 INFO:tasks.workunit.client.1.smithi195.stdout:9/572: dread d3/d10/d3b/d48/d9c/f91 [0,4194304] 0 2024-04-06T12:23:09.227 INFO:tasks.workunit.client.1.smithi195.stdout:2/575: chown d2/d21/d2c/d2d/f5f 391249673 1 2024-04-06T12:23:09.227 INFO:tasks.workunit.client.1.smithi195.stdout:8/536: symlink d6/dd/d70/d24/d25/d49/lb7 0 2024-04-06T12:23:09.228 INFO:tasks.workunit.client.1.smithi195.stdout:4/495: creat d4/d3e/f94 x:0 0 0 2024-04-06T12:23:09.231 INFO:tasks.workunit.client.1.smithi195.stdout:8/537: dread - d6/dd/d70/d24/d34/d67/f86 zero size 2024-04-06T12:23:09.232 INFO:tasks.workunit.client.1.smithi195.stdout:8/538: chown d6/dd/d70/d24/c3e 22620434 1 2024-04-06T12:23:09.233 INFO:tasks.workunit.client.1.smithi195.stdout:6/560: dread d8/d21/fd0 [0,4194304] 0 2024-04-06T12:23:09.235 INFO:tasks.workunit.client.1.smithi195.stdout:8/539: truncate d6/d8/d12/d61/f81 393670 0 2024-04-06T12:23:09.236 INFO:tasks.workunit.client.1.smithi195.stdout:8/540: chown d6/d8/d12 107 1 2024-04-06T12:23:09.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/590: dwrite d4/de/d8e/d92/d9e/fac [0,4194304] 0 2024-04-06T12:23:09.240 INFO:tasks.workunit.client.1.smithi195.stdout:3/591: read d4/f69 [55408,61675] 0 2024-04-06T12:23:09.242 INFO:tasks.workunit.client.1.smithi195.stdout:3/592: write d4/f22 [1574174,21803] 0 2024-04-06T12:23:09.242 INFO:tasks.workunit.client.1.smithi195.stdout:7/427: mknod d4/d16/dd/d22/d76/c89 0 2024-04-06T12:23:09.246 INFO:tasks.workunit.client.1.smithi195.stdout:2/576: write d2/d3f/d7d/f54 [2063950,33891] 0 2024-04-06T12:23:09.252 INFO:tasks.workunit.client.1.smithi195.stdout:5/575: rename d0/da/d23/d38/d41/d7d/f8d to d0/da/dd/d1c/d5a/d62/d64/fc7 0 2024-04-06T12:23:09.253 INFO:tasks.workunit.client.1.smithi195.stdout:4/496: mknod d4/d6/d38/d1a/c95 0 2024-04-06T12:23:09.254 INFO:tasks.workunit.client.1.smithi195.stdout:6/561: mknod d8/d21/d2b/d46/d7f/cd6 0 2024-04-06T12:23:09.255 INFO:tasks.workunit.client.1.smithi195.stdout:5/576: write d0/da/d13/d87/f3f [389354,109672] 0 2024-04-06T12:23:09.256 INFO:tasks.workunit.client.1.smithi195.stdout:1/529: creat d4/d14/d17/d24/d99/f9d x:0 0 0 2024-04-06T12:23:09.257 INFO:tasks.workunit.client.1.smithi195.stdout:2/577: creat d2/d14/fb1 x:0 0 0 2024-04-06T12:23:09.258 INFO:tasks.workunit.client.1.smithi195.stdout:9/573: rmdir d3/d10/d3b/d48/d5e/da4 0 2024-04-06T12:23:09.258 INFO:tasks.workunit.client.1.smithi195.stdout:3/593: dwrite d4/d9/fa [0,4194304] 0 2024-04-06T12:23:09.259 INFO:tasks.workunit.client.1.smithi195.stdout:8/541: dread d6/dd/f38 [0,4194304] 0 2024-04-06T12:23:09.259 INFO:tasks.workunit.client.1.smithi195.stdout:5/577: chown d0/da/dd/f3b 119 1 2024-04-06T12:23:09.260 INFO:tasks.workunit.client.1.smithi195.stdout:3/594: dread - d4/de/f84 zero size 2024-04-06T12:23:09.261 INFO:tasks.workunit.client.1.smithi195.stdout:7/428: rename d4/d16/d11/f79 to d4/d10/d18/d7e/f8a 0 2024-04-06T12:23:09.263 INFO:tasks.workunit.client.1.smithi195.stdout:8/542: fdatasync d6/dd/d70/d24/d25/d7c/fa9 0 2024-04-06T12:23:09.264 INFO:tasks.workunit.client.1.smithi195.stdout:0/536: getdents d4/d65 0 2024-04-06T12:23:09.265 INFO:tasks.workunit.client.1.smithi195.stdout:8/543: stat d6/dd/d70/d24/c3e 0 2024-04-06T12:23:09.266 INFO:tasks.workunit.client.1.smithi195.stdout:2/578: mkdir d2/d41/d84/db2 0 2024-04-06T12:23:09.269 INFO:tasks.workunit.client.1.smithi195.stdout:5/578: creat d0/d52/d91/fc8 x:0 0 0 2024-04-06T12:23:09.270 INFO:tasks.workunit.client.1.smithi195.stdout:9/574: dwrite d3/d10/d3a/d6b/fbf [0,4194304] 0 2024-04-06T12:23:09.271 INFO:tasks.workunit.client.1.smithi195.stdout:5/579: dread - d0/da/d23/d7a/dc5/fc6 zero size 2024-04-06T12:23:09.273 INFO:tasks.workunit.client.1.smithi195.stdout:3/595: symlink d4/de/d8e/d92/lc0 0 2024-04-06T12:23:09.274 INFO:tasks.workunit.client.1.smithi195.stdout:7/429: write d4/f7 [3974218,33643] 0 2024-04-06T12:23:09.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/544: dread d6/dd/d70/d24/d53/f68 [4194304,4194304] 0 2024-04-06T12:23:09.276 INFO:tasks.workunit.client.1.smithi195.stdout:0/537: symlink d4/d6/d58/lae 0 2024-04-06T12:23:09.277 INFO:tasks.workunit.client.1.smithi195.stdout:8/545: write d6/dd/d70/d24/d34/d67/f88 [749940,12751] 0 2024-04-06T12:23:09.281 INFO:tasks.workunit.client.1.smithi195.stdout:4/497: mkdir d4/d8c/d96 0 2024-04-06T12:23:09.283 INFO:tasks.workunit.client.1.smithi195.stdout:5/580: readlink d0/da/l1b 0 2024-04-06T12:23:09.284 INFO:tasks.workunit.client.1.smithi195.stdout:8/546: dwrite d6/f91 [0,4194304] 0 2024-04-06T12:23:09.287 INFO:tasks.workunit.client.1.smithi195.stdout:3/596: symlink d4/de/d8e/dbb/lc1 0 2024-04-06T12:23:09.288 INFO:tasks.workunit.client.1.smithi195.stdout:3/597: fdatasync d4/df/d39/f98 0 2024-04-06T12:23:09.290 INFO:tasks.workunit.client.1.smithi195.stdout:1/530: link d4/d14/d17/d24/d99/d4e/d71/c91 d4/d14/d17/c9e 0 2024-04-06T12:23:09.295 INFO:tasks.workunit.client.1.smithi195.stdout:6/562: getdents d8/d3d 0 2024-04-06T12:23:09.296 INFO:tasks.workunit.client.1.smithi195.stdout:9/575: truncate d3/d10/d4f/fa9 992969 0 2024-04-06T12:23:09.300 INFO:tasks.workunit.client.1.smithi195.stdout:1/531: creat d4/d14/d17/d3a/f9f x:0 0 0 2024-04-06T12:23:09.301 INFO:tasks.workunit.client.1.smithi195.stdout:4/498: dwrite d4/d6/d38/d65/f84 [0,4194304] 0 2024-04-06T12:23:09.303 INFO:tasks.workunit.client.1.smithi195.stdout:7/430: rmdir d4/d67 0 2024-04-06T12:23:09.307 INFO:tasks.workunit.client.1.smithi195.stdout:6/563: unlink d8/d21/d2b/d46/f65 0 2024-04-06T12:23:09.309 INFO:tasks.workunit.client.1.smithi195.stdout:3/598: symlink d4/d9/d2b/lc2 0 2024-04-06T12:23:09.310 INFO:tasks.workunit.client.1.smithi195.stdout:9/576: read d3/d10/d3b/d48/d9c/f91 [392967,16831] 0 2024-04-06T12:23:09.311 INFO:tasks.workunit.client.1.smithi195.stdout:2/579: getdents d2/d21/d69/d6b 0 2024-04-06T12:23:09.312 INFO:tasks.workunit.client.1.smithi195.stdout:5/581: truncate d0/da/dd/d2e/d6f/f51 541434 0 2024-04-06T12:23:09.313 INFO:tasks.workunit.client.1.smithi195.stdout:1/532: write d4/d14/d17/d24/d99/f1d [1761600,15750] 0 2024-04-06T12:23:09.315 INFO:tasks.workunit.client.1.smithi195.stdout:6/564: readlink d8/d50/d32/lb8 0 2024-04-06T12:23:09.316 INFO:tasks.workunit.client.1.smithi195.stdout:3/599: mknod d4/d9/d9f/cc3 0 2024-04-06T12:23:09.317 INFO:tasks.workunit.client.1.smithi195.stdout:9/577: readlink d3/l70 0 2024-04-06T12:23:09.319 INFO:tasks.workunit.client.1.smithi195.stdout:8/547: getdents d6/dd/d70/d24/d34/d67/da1 0 2024-04-06T12:23:09.320 INFO:tasks.workunit.client.1.smithi195.stdout:4/499: creat d4/d8c/d96/f97 x:0 0 0 2024-04-06T12:23:09.321 INFO:tasks.workunit.client.1.smithi195.stdout:7/431: mknod d4/d10/d12/c8b 0 2024-04-06T12:23:09.323 INFO:tasks.workunit.client.1.smithi195.stdout:7/432: readlink d4/d16/dd/d22/d3f/l4c 0 2024-04-06T12:23:09.323 INFO:tasks.workunit.client.1.smithi195.stdout:1/533: truncate d4/f26 197409 0 2024-04-06T12:23:09.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/600: unlink d4/d9/d2b/d77/d9a/la8 0 2024-04-06T12:23:09.326 INFO:tasks.workunit.client.1.smithi195.stdout:1/534: write d4/d14/d17/d24/d99/d23/f79 [1206558,2658] 0 2024-04-06T12:23:09.327 INFO:tasks.workunit.client.1.smithi195.stdout:8/548: dwrite d6/dd/d70/d24/d34/d67/d9d/fa0 [0,4194304] 0 2024-04-06T12:23:09.328 INFO:tasks.workunit.client.1.smithi195.stdout:8/549: fsync d6/dd/d70/d24/d34/d67/f76 0 2024-04-06T12:23:09.328 INFO:tasks.workunit.client.1.smithi195.stdout:1/535: chown d4/d14/d17/d24/d99/c8e 8859886 1 2024-04-06T12:23:09.330 INFO:tasks.workunit.client.1.smithi195.stdout:3/601: chown d4/df/d39/f9c 611685 1 2024-04-06T12:23:09.331 INFO:tasks.workunit.client.1.smithi195.stdout:1/536: write d4/d14/d17/d24/d99/f1d [3397523,32922] 0 2024-04-06T12:23:09.331 INFO:tasks.workunit.client.1.smithi195.stdout:3/602: write d4/d9/fa [1225229,25645] 0 2024-04-06T12:23:09.334 INFO:tasks.workunit.client.1.smithi195.stdout:4/500: creat d4/d3e/f98 x:0 0 0 2024-04-06T12:23:09.339 INFO:tasks.workunit.client.1.smithi195.stdout:8/550: mknod d6/dd/d70/cb8 0 2024-04-06T12:23:09.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/565: link d8/d8e/la1 d8/d21/d31/d26/ld7 0 2024-04-06T12:23:09.341 INFO:tasks.workunit.client.1.smithi195.stdout:4/501: creat d4/d8c/f99 x:0 0 0 2024-04-06T12:23:09.342 INFO:tasks.workunit.client.1.smithi195.stdout:2/580: dwrite d2/f6d [0,4194304] 0 2024-04-06T12:23:09.343 INFO:tasks.workunit.client.1.smithi195.stdout:8/551: chown d6/d8/d12/ca7 53 1 2024-04-06T12:23:09.343 INFO:tasks.workunit.client.1.smithi195.stdout:5/582: getdents d0/da/dd/d1c/d5a/d62 0 2024-04-06T12:23:09.344 INFO:tasks.workunit.client.1.smithi195.stdout:1/537: dwrite d4/d14/d17/d24/d99/d4e/d60/f7a [0,4194304] 0 2024-04-06T12:23:09.344 INFO:tasks.workunit.client.1.smithi195.stdout:6/566: chown d8/f1a 111920 1 2024-04-06T12:23:09.346 INFO:tasks.workunit.client.1.smithi195.stdout:3/603: mkdir d4/dc4 0 2024-04-06T12:23:09.346 INFO:tasks.workunit.client.1.smithi195.stdout:7/433: link d4/d16/l36 d4/d10/d18/d19/d63/l8c 0 2024-04-06T12:23:09.346 INFO:tasks.workunit.client.1.smithi195.stdout:2/581: readlink d2/d3f/d7d/d5d/l9e 0 2024-04-06T12:23:09.349 INFO:tasks.workunit.client.1.smithi195.stdout:6/567: write d8/d21/d2b/fc9 [518382,71811] 0 2024-04-06T12:23:09.350 INFO:tasks.workunit.client.1.smithi195.stdout:2/582: dread - d2/d41/d84/d8d/d94/f9a zero size 2024-04-06T12:23:09.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/568: chown d8/d21/d31/d26/f78 0 1 2024-04-06T12:23:09.405 INFO:tasks.workunit.client.1.smithi195.stdout:9/578: sync 2024-04-06T12:23:09.405 INFO:tasks.workunit.client.1.smithi195.stdout:0/538: sync 2024-04-06T12:23:09.405 INFO:tasks.workunit.client.1.smithi195.stdout:8/552: mknod d6/d3a/d46/cb9 0 2024-04-06T12:23:09.406 INFO:tasks.workunit.client.1.smithi195.stdout:7/434: fsync d4/d10/d18/d33/d6e/f7d 0 2024-04-06T12:23:09.406 INFO:tasks.workunit.client.1.smithi195.stdout:9/579: write d3/d10/f30 [2899126,62687] 0 2024-04-06T12:23:09.408 INFO:tasks.workunit.client.1.smithi195.stdout:6/569: mkdir d8/d21/d31/d49/dd8 0 2024-04-06T12:23:09.409 INFO:tasks.workunit.client.1.smithi195.stdout:9/580: stat d3/d10/d3b/d48/d5e/fac 0 2024-04-06T12:23:09.411 INFO:tasks.workunit.client.1.smithi195.stdout:9/581: write d3/d10/d3a/f80 [2532015,93716] 0 2024-04-06T12:23:09.413 INFO:tasks.workunit.client.1.smithi195.stdout:3/604: link d4/de/f96 d4/de/fc5 0 2024-04-06T12:23:09.414 INFO:tasks.workunit.client.1.smithi195.stdout:0/539: dwrite d4/d65/f9b [0,4194304] 0 2024-04-06T12:23:09.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/582: dread d3/d10/d3b/d48/d9c/f75 [0,4194304] 0 2024-04-06T12:23:09.422 INFO:tasks.workunit.client.1.smithi195.stdout:1/538: creat d4/d14/fa0 x:0 0 0 2024-04-06T12:23:09.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/539: chown d4/d14/d17/d24/d99 409668 1 2024-04-06T12:23:09.427 INFO:tasks.workunit.client.1.smithi195.stdout:6/570: dread d8/d21/d2b/d46/d44/f7d [0,4194304] 0 2024-04-06T12:23:09.428 INFO:tasks.workunit.client.1.smithi195.stdout:8/553: dwrite d6/dd/d70/d24/d25/f54 [4194304,4194304] 0 2024-04-06T12:23:09.430 INFO:tasks.workunit.client.1.smithi195.stdout:1/540: read d4/d14/d17/d24/d99/f29 [636932,55074] 0 2024-04-06T12:23:09.430 INFO:tasks.workunit.client.1.smithi195.stdout:0/540: symlink d4/d48/d4e/laf 0 2024-04-06T12:23:09.431 INFO:tasks.workunit.client.1.smithi195.stdout:8/554: write d6/d8/d12/f37 [56587,83766] 0 2024-04-06T12:23:09.433 INFO:tasks.workunit.client.1.smithi195.stdout:2/583: rmdir d2/d41/d84/d8d/d94/dac 0 2024-04-06T12:23:09.434 INFO:tasks.workunit.client.1.smithi195.stdout:9/583: dread d3/d10/d3b/d48/d9c/f8c [0,4194304] 0 2024-04-06T12:23:09.434 INFO:tasks.workunit.client.1.smithi195.stdout:0/541: write d4/d53/f7a [788049,34187] 0 2024-04-06T12:23:09.435 INFO:tasks.workunit.client.1.smithi195.stdout:7/435: symlink d4/d16/d6b/l8d 0 2024-04-06T12:23:09.436 INFO:tasks.workunit.client.1.smithi195.stdout:1/541: chown d4/d14/d17/d24/d99/f5f 6120108 1 2024-04-06T12:23:09.438 INFO:tasks.workunit.client.1.smithi195.stdout:2/584: truncate d2/d41/f49 3163998 0 2024-04-06T12:23:09.446 INFO:tasks.workunit.client.1.smithi195.stdout:1/542: dread d4/d14/d17/d24/d2a/d45/f55 [0,4194304] 0 2024-04-06T12:23:09.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/583: sync 2024-04-06T12:23:09.485 INFO:tasks.workunit.client.1.smithi195.stdout:5/584: dwrite d0/da/dd/d33/f83 [0,4194304] 0 2024-04-06T12:23:09.581 INFO:tasks.workunit.client.1.smithi195.stdout:6/571: rename d8/d50/d9c/lbd to d8/d21/d2b/d46/d7f/ld9 0 2024-04-06T12:23:09.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/572: dread d8/d21/fc7 [0,4194304] 0 2024-04-06T12:23:09.640 INFO:tasks.workunit.client.1.smithi195.stdout:9/584: stat d3/d10/d3a/d5d/f65 0 2024-04-06T12:23:09.643 INFO:tasks.workunit.client.1.smithi195.stdout:7/436: mknod d4/d16/d6b/c8e 0 2024-04-06T12:23:09.647 INFO:tasks.workunit.client.1.smithi195.stdout:0/542: creat d4/d48/d77/d97/fb0 x:0 0 0 2024-04-06T12:23:09.657 INFO:tasks.workunit.client.1.smithi195.stdout:5/585: creat d0/da/dd/d1c/d5a/d62/fc9 x:0 0 0 2024-04-06T12:23:09.661 INFO:tasks.workunit.client.1.smithi195.stdout:6/573: symlink d8/d21/d2b/d46/d2f/lda 0 2024-04-06T12:23:09.667 INFO:tasks.workunit.client.1.smithi195.stdout:9/585: rmdir d3 39 2024-04-06T12:23:09.673 INFO:tasks.workunit.client.1.smithi195.stdout:3/605: getdents d4/d9 0 2024-04-06T12:23:09.674 INFO:tasks.workunit.client.1.smithi195.stdout:0/543: creat d4/d65/fb1 x:0 0 0 2024-04-06T12:23:09.675 INFO:tasks.workunit.client.1.smithi195.stdout:0/544: chown d4/d48/d4e/c6d 75015 1 2024-04-06T12:23:09.683 INFO:tasks.workunit.client.1.smithi195.stdout:5/586: rename d0/da/d23/d38/d41/d7d/laf to d0/da/d4b/d4e/lca 0 2024-04-06T12:23:09.685 INFO:tasks.workunit.client.1.smithi195.stdout:6/574: symlink d8/d3d/d3f/ldb 0 2024-04-06T12:23:09.687 INFO:tasks.workunit.client.1.smithi195.stdout:9/586: stat d3/d10/c1a 0 2024-04-06T12:23:09.697 INFO:tasks.workunit.client.1.smithi195.stdout:0/545: creat d4/d6/d1a/fb2 x:0 0 0 2024-04-06T12:23:09.699 INFO:tasks.workunit.client.1.smithi195.stdout:5/587: rmdir d0/da/d13/d87 39 2024-04-06T12:23:09.700 INFO:tasks.workunit.client.1.smithi195.stdout:0/546: dread d4/d53/f7a [0,4194304] 0 2024-04-06T12:23:09.700 INFO:tasks.workunit.client.1.smithi195.stdout:6/575: fdatasync d8/d21/d2b/d46/d44/f7d 0 2024-04-06T12:23:09.703 INFO:tasks.workunit.client.1.smithi195.stdout:9/587: symlink d3/d10/d3b/d50/lc5 0 2024-04-06T12:23:09.704 INFO:tasks.workunit.client.1.smithi195.stdout:8/555: getdents d6/dd/d70/d24/d25/d7c 0 2024-04-06T12:23:09.706 INFO:tasks.workunit.client.1.smithi195.stdout:3/606: link d4/d9/f18 d4/d9/d2b/d3b/d5e/d7e/fc6 0 2024-04-06T12:23:09.709 INFO:tasks.workunit.client.1.smithi195.stdout:3/607: dread - d4/d9/d37/f97 zero size 2024-04-06T12:23:09.710 INFO:tasks.workunit.client.1.smithi195.stdout:3/608: write d4/d9/f41 [145452,36618] 0 2024-04-06T12:23:09.711 INFO:tasks.workunit.client.1.smithi195.stdout:5/588: dread d0/f24 [0,4194304] 0 2024-04-06T12:23:09.712 INFO:tasks.workunit.client.1.smithi195.stdout:0/547: dread d4/d48/d67/faa [0,4194304] 0 2024-04-06T12:23:09.713 INFO:tasks.workunit.client.1.smithi195.stdout:5/589: write d0/da/dd/d2e/fa4 [906729,1789] 0 2024-04-06T12:23:09.722 INFO:tasks.workunit.client.1.smithi195.stdout:5/590: stat d0/da/dd/d2e/d6f/f51 0 2024-04-06T12:23:09.727 INFO:tasks.workunit.client.1.smithi195.stdout:6/576: getdents d8/d3d/d5e 0 2024-04-06T12:23:09.727 INFO:tasks.workunit.client.1.smithi195.stdout:0/548: dwrite d4/d53/f87 [0,4194304] 0 2024-04-06T12:23:09.730 INFO:tasks.workunit.client.1.smithi195.stdout:9/588: rename d3/dba to d3/dc6 0 2024-04-06T12:23:09.733 INFO:tasks.workunit.client.1.smithi195.stdout:0/549: dwrite d4/d48/d67/f9d [0,4194304] 0 2024-04-06T12:23:09.735 INFO:tasks.workunit.client.1.smithi195.stdout:6/577: mknod d8/d21/d2b/d46/d7f/cdc 0 2024-04-06T12:23:09.741 INFO:tasks.workunit.client.1.smithi195.stdout:6/578: creat d8/d3d/d5e/d72/fdd x:0 0 0 2024-04-06T12:23:09.743 INFO:tasks.workunit.client.1.smithi195.stdout:5/591: dwrite d0/da/dd/d1c/d5a/d62/f43 [0,4194304] 0 2024-04-06T12:23:09.746 INFO:tasks.workunit.client.1.smithi195.stdout:5/592: fdatasync d0/da/fb 0 2024-04-06T12:23:09.753 INFO:tasks.workunit.client.1.smithi195.stdout:6/579: rename d8/d21/d31/d26/l28 to d8/d21/d31/d70/lde 0 2024-04-06T12:23:09.757 INFO:tasks.workunit.client.1.smithi195.stdout:6/580: write d8/f23 [803287,69990] 0 2024-04-06T12:23:09.759 INFO:tasks.workunit.client.1.smithi195.stdout:5/593: link d0/da/d13/f15 d0/da/d23/fcb 0 2024-04-06T12:23:09.765 INFO:tasks.workunit.client.1.smithi195.stdout:5/594: mknod d0/da/dd/d2e/d6f/ccc 0 2024-04-06T12:23:09.766 INFO:tasks.workunit.client.1.smithi195.stdout:6/581: link d8/d3d/d5e/la8 d8/d21/d31/d49/dd8/ldf 0 2024-04-06T12:23:09.770 INFO:tasks.workunit.client.1.smithi195.stdout:6/582: mkdir d8/d3d/d5e/de0 0 2024-04-06T12:23:09.770 INFO:tasks.workunit.client.1.smithi195.stdout:6/583: dread - d8/d21/d2b/d46/d44/d86/fbf zero size 2024-04-06T12:23:09.771 INFO:tasks.workunit.client.1.smithi195.stdout:5/595: creat d0/da/d13/d87/d37/fcd x:0 0 0 2024-04-06T12:23:09.772 INFO:tasks.workunit.client.1.smithi195.stdout:6/584: rename d8/d8e/fc3 to d8/d21/d31/d49/dd8/fe1 0 2024-04-06T12:23:09.773 INFO:tasks.workunit.client.1.smithi195.stdout:6/585: stat d8/d3d/d5e/f84 0 2024-04-06T12:23:09.773 INFO:tasks.workunit.client.1.smithi195.stdout:6/586: chown d8/d21/d31/c73 0 1 2024-04-06T12:23:09.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/596: mkdir d0/da/d23/d7a/dc5/dce 0 2024-04-06T12:23:09.778 INFO:tasks.workunit.client.1.smithi195.stdout:5/597: creat d0/da/dd/d1c/d5a/d62/d64/d67/db9/fcf x:0 0 0 2024-04-06T12:23:09.779 INFO:tasks.workunit.client.1.smithi195.stdout:5/598: readlink d0/l3e 0 2024-04-06T12:23:09.783 INFO:tasks.workunit.client.1.smithi195.stdout:2/585: unlink d2/d21/f24 0 2024-04-06T12:23:09.784 INFO:tasks.workunit.client.1.smithi195.stdout:5/599: dwrite d0/d35/f6b [4194304,4194304] 0 2024-04-06T12:23:09.785 INFO:tasks.workunit.client.1.smithi195.stdout:4/502: creat d4/d6/f9a x:0 0 0 2024-04-06T12:23:09.786 INFO:tasks.workunit.client.1.smithi195.stdout:5/600: dread d0/da/dd/d1c/fae [0,4194304] 0 2024-04-06T12:23:09.788 INFO:tasks.workunit.client.1.smithi195.stdout:2/586: mknod d2/d21/cb3 0 2024-04-06T12:23:09.792 INFO:tasks.workunit.client.1.smithi195.stdout:4/503: symlink d4/d6/d38/d1a/d40/l9b 0 2024-04-06T12:23:09.794 INFO:tasks.workunit.client.1.smithi195.stdout:5/601: dwrite d0/da/d23/f45 [0,4194304] 0 2024-04-06T12:23:09.795 INFO:tasks.workunit.client.1.smithi195.stdout:2/587: dread d2/f12 [0,4194304] 0 2024-04-06T12:23:09.795 INFO:tasks.workunit.client.1.smithi195.stdout:1/543: write d4/d14/d17/d24/d99/d23/f48 [1755331,81889] 0 2024-04-06T12:23:09.796 INFO:tasks.workunit.client.1.smithi195.stdout:2/588: readlink d2/d41/l66 0 2024-04-06T12:23:09.797 INFO:tasks.workunit.client.1.smithi195.stdout:5/602: chown d0/da/d13/d87/d37/fa6 98454 1 2024-04-06T12:23:09.797 INFO:tasks.workunit.client.1.smithi195.stdout:1/544: chown d4/d14/d17/d24/d99/f5f 4320 1 2024-04-06T12:23:09.800 INFO:tasks.workunit.client.1.smithi195.stdout:7/437: truncate d4/d5d/f42 3151873 0 2024-04-06T12:23:09.801 INFO:tasks.workunit.client.1.smithi195.stdout:1/545: dread - d4/d14/d17/d24/d99/d23/d28/d2f/f9c zero size 2024-04-06T12:23:09.802 INFO:tasks.workunit.client.1.smithi195.stdout:4/504: dread d4/d6/d38/f28 [0,4194304] 0 2024-04-06T12:23:09.803 INFO:tasks.workunit.client.1.smithi195.stdout:5/603: rename d0/f24 to d0/da/d4b/fd0 0 2024-04-06T12:23:09.804 INFO:tasks.workunit.client.1.smithi195.stdout:5/604: dread - d0/da/dd/d1c/d5a/d62/fc4 zero size 2024-04-06T12:23:09.805 INFO:tasks.workunit.client.1.smithi195.stdout:7/438: creat d4/d16/dd/d22/d76/f8f x:0 0 0 2024-04-06T12:23:09.806 INFO:tasks.workunit.client.1.smithi195.stdout:4/505: readlink d4/d3e/l56 0 2024-04-06T12:23:09.806 INFO:tasks.workunit.client.1.smithi195.stdout:5/605: chown d0/da/dd/d1c/d5a/d62/db8/lc1 1 1 2024-04-06T12:23:09.812 INFO:tasks.workunit.client.1.smithi195.stdout:1/546: getdents d4/d14 0 2024-04-06T12:23:09.814 INFO:tasks.workunit.client.1.smithi195.stdout:1/547: chown d4/d14/fd 339258 1 2024-04-06T12:23:09.815 INFO:tasks.workunit.client.1.smithi195.stdout:8/556: truncate d6/d8/daa/f82 2536886 0 2024-04-06T12:23:09.815 INFO:tasks.workunit.client.1.smithi195.stdout:5/606: dwrite d0/da/d23/d7a/dc5/fc0 [0,4194304] 0 2024-04-06T12:23:09.818 INFO:tasks.workunit.client.1.smithi195.stdout:9/589: unlink d3/d10/d3b/f47 0 2024-04-06T12:23:09.820 INFO:tasks.workunit.client.1.smithi195.stdout:8/557: symlink d6/d8/d52/lba 0 2024-04-06T12:23:09.822 INFO:tasks.workunit.client.1.smithi195.stdout:7/439: dwrite d4/d16/f1c [4194304,4194304] 0 2024-04-06T12:23:09.823 INFO:tasks.workunit.client.1.smithi195.stdout:1/548: mknod d4/d14/d17/d24/d99/d88/ca1 0 2024-04-06T12:23:09.824 INFO:tasks.workunit.client.1.smithi195.stdout:5/607: creat d0/da/dd/d2e/fd1 x:0 0 0 2024-04-06T12:23:09.825 INFO:tasks.workunit.client.1.smithi195.stdout:3/609: dwrite d4/f69 [0,4194304] 0 2024-04-06T12:23:09.826 INFO:tasks.workunit.client.1.smithi195.stdout:5/608: read - d0/d52/d91/fc8 zero size 2024-04-06T12:23:09.826 INFO:tasks.workunit.client.1.smithi195.stdout:9/590: unlink d3/de/l13 0 2024-04-06T12:23:09.829 INFO:tasks.workunit.client.1.smithi195.stdout:8/558: creat d6/d8/d12/d83/fbb x:0 0 0 2024-04-06T12:23:09.831 INFO:tasks.workunit.client.1.smithi195.stdout:7/440: creat d4/d16/dd/d22/d3f/d54/f90 x:0 0 0 2024-04-06T12:23:09.832 INFO:tasks.workunit.client.1.smithi195.stdout:0/550: write d4/d6/d1a/f72 [2939222,31667] 0 2024-04-06T12:23:09.834 INFO:tasks.workunit.client.1.smithi195.stdout:3/610: creat d4/d53/fc7 x:0 0 0 2024-04-06T12:23:09.838 INFO:tasks.workunit.client.1.smithi195.stdout:5/609: dwrite d0/da/d13/d87/d37/fa6 [0,4194304] 0 2024-04-06T12:23:09.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/591: creat d3/d10/d3b/d48/fc7 x:0 0 0 2024-04-06T12:23:09.842 INFO:tasks.workunit.client.1.smithi195.stdout:0/551: dwrite d4/f5 [4194304,4194304] 0 2024-04-06T12:23:09.844 INFO:tasks.workunit.client.1.smithi195.stdout:8/559: creat d6/dd/d42/fbc x:0 0 0 2024-04-06T12:23:09.844 INFO:tasks.workunit.client.1.smithi195.stdout:1/549: mknod d4/d14/d17/d24/d2a/d5a/ca2 0 2024-04-06T12:23:09.848 INFO:tasks.workunit.client.1.smithi195.stdout:1/550: chown d4/l6 34536 1 2024-04-06T12:23:09.848 INFO:tasks.workunit.client.1.smithi195.stdout:5/610: dwrite d0/f30 [0,4194304] 0 2024-04-06T12:23:09.849 INFO:tasks.workunit.client.1.smithi195.stdout:7/441: symlink d4/d10/d18/d7e/l91 0 2024-04-06T12:23:09.851 INFO:tasks.workunit.client.1.smithi195.stdout:3/611: mkdir d4/de/dc8 0 2024-04-06T12:23:09.852 INFO:tasks.workunit.client.1.smithi195.stdout:7/442: chown d4/d24/f64 3784151 1 2024-04-06T12:23:09.855 INFO:tasks.workunit.client.1.smithi195.stdout:9/592: dwrite d3/d10/f9b [4194304,4194304] 0 2024-04-06T12:23:09.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/587: sync 2024-04-06T12:23:09.857 INFO:tasks.workunit.client.1.smithi195.stdout:0/552: symlink d4/d48/d67/d75/lb3 0 2024-04-06T12:23:09.857 INFO:tasks.workunit.client.1.smithi195.stdout:0/553: stat d4/d6/f6b 0 2024-04-06T12:23:09.859 INFO:tasks.workunit.client.1.smithi195.stdout:6/588: fsync d8/d21/d2b/d46/d2f/f8b 0 2024-04-06T12:23:09.860 INFO:tasks.workunit.client.1.smithi195.stdout:8/560: mkdir d6/dd/d70/d24/d34/d67/da1/dbd 0 2024-04-06T12:23:09.862 INFO:tasks.workunit.client.1.smithi195.stdout:4/506: rmdir d4/d6/d38/d1a/d40 39 2024-04-06T12:23:09.868 INFO:tasks.workunit.client.1.smithi195.stdout:0/554: write d4/f32 [1671391,101887] 0 2024-04-06T12:23:09.869 INFO:tasks.workunit.client.1.smithi195.stdout:6/589: symlink d8/d21/d2b/le2 0 2024-04-06T12:23:09.871 INFO:tasks.workunit.client.1.smithi195.stdout:5/611: symlink d0/da/dd/d1c/d5a/ld2 0 2024-04-06T12:23:09.877 INFO:tasks.workunit.client.1.smithi195.stdout:7/443: fdatasync d4/d10/d18/d19/f5e 0 2024-04-06T12:23:09.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/612: truncate d4/d9/f1e 1880767 0 2024-04-06T12:23:09.880 INFO:tasks.workunit.client.1.smithi195.stdout:7/444: dread d4/d10/d12/f72 [0,4194304] 0 2024-04-06T12:23:09.881 INFO:tasks.workunit.client.1.smithi195.stdout:7/445: write d4/d5d/f60 [977948,105591] 0 2024-04-06T12:23:09.883 INFO:tasks.workunit.client.1.smithi195.stdout:0/555: symlink d4/d65/lb4 0 2024-04-06T12:23:09.884 INFO:tasks.workunit.client.1.smithi195.stdout:6/590: creat d8/d21/d31/d26/fe3 x:0 0 0 2024-04-06T12:23:09.889 INFO:tasks.workunit.client.1.smithi195.stdout:8/561: mknod d6/dd/d70/d24/d34/d67/da1/dbd/cbe 0 2024-04-06T12:23:09.891 INFO:tasks.workunit.client.1.smithi195.stdout:8/562: truncate d6/d8/d12/d83/fbb 1011337 0 2024-04-06T12:23:09.891 INFO:tasks.workunit.client.1.smithi195.stdout:5/612: creat d0/da/d23/d38/d41/d7d/fd3 x:0 0 0 2024-04-06T12:23:09.892 INFO:tasks.workunit.client.1.smithi195.stdout:2/589: truncate d2/f61 4309523 0 2024-04-06T12:23:09.893 INFO:tasks.workunit.client.1.smithi195.stdout:2/590: readlink d2/d3f/d7d/d5d/l85 0 2024-04-06T12:23:09.893 INFO:tasks.workunit.client.1.smithi195.stdout:4/507: creat d4/d6/d38/d1a/d40/d20/f9c x:0 0 0 2024-04-06T12:23:09.894 INFO:tasks.workunit.client.1.smithi195.stdout:2/591: fdatasync d2/d21/d2c/d2d/d92/d95/fa9 0 2024-04-06T12:23:09.896 INFO:tasks.workunit.client.1.smithi195.stdout:3/613: dread d4/f25 [0,4194304] 0 2024-04-06T12:23:09.901 INFO:tasks.workunit.client.1.smithi195.stdout:6/591: unlink d8/d21/d31/d26/f36 0 2024-04-06T12:23:09.902 INFO:tasks.workunit.client.1.smithi195.stdout:5/613: read d0/da/d13/f15 [1232464,108270] 0 2024-04-06T12:23:09.904 INFO:tasks.workunit.client.1.smithi195.stdout:8/563: symlink d6/dd/d70/d24/d34/d67/da1/da2/lbf 0 2024-04-06T12:23:09.905 INFO:tasks.workunit.client.1.smithi195.stdout:4/508: unlink d4/d6/d38/d65/d7a/f83 0 2024-04-06T12:23:09.907 INFO:tasks.workunit.client.1.smithi195.stdout:2/592: rmdir d2/d41 39 2024-04-06T12:23:09.907 INFO:tasks.workunit.client.1.smithi195.stdout:4/509: chown d4/d6/d38/d1a/d40/d20/d23 7 1 2024-04-06T12:23:09.909 INFO:tasks.workunit.client.1.smithi195.stdout:5/614: dwrite d0/da/d13/d87/d34/f4d [4194304,4194304] 0 2024-04-06T12:23:09.909 INFO:tasks.workunit.client.1.smithi195.stdout:3/614: symlink d4/de/d8e/dbb/lc9 0 2024-04-06T12:23:09.914 INFO:tasks.workunit.client.1.smithi195.stdout:6/592: chown d8/d21/d31/d49/dd8/ldf 2 1 2024-04-06T12:23:09.914 INFO:tasks.workunit.client.1.smithi195.stdout:6/593: readlink d8/d3d/l9a 0 2024-04-06T12:23:09.921 INFO:tasks.workunit.client.1.smithi195.stdout:2/593: mknod d2/d21/d2c/d2d/cb4 0 2024-04-06T12:23:09.921 INFO:tasks.workunit.client.1.smithi195.stdout:2/594: dread - d2/d21/d2c/d2d/d92/d95/f97 zero size 2024-04-06T12:23:09.923 INFO:tasks.workunit.client.1.smithi195.stdout:2/595: chown d2/d21/d2c/d2d/d92/d95/f97 2025384 1 2024-04-06T12:23:09.923 INFO:tasks.workunit.client.1.smithi195.stdout:0/556: link d4/d6/d1a/l1c d4/lb5 0 2024-04-06T12:23:09.927 INFO:tasks.workunit.client.1.smithi195.stdout:6/594: mkdir d8/d21/d31/d26/dcf/de4 0 2024-04-06T12:23:09.927 INFO:tasks.workunit.client.1.smithi195.stdout:1/551: write d4/d14/f18 [273040,110257] 0 2024-04-06T12:23:09.928 INFO:tasks.workunit.client.1.smithi195.stdout:6/595: dread - d8/d3d/d5e/d72/fc2 zero size 2024-04-06T12:23:09.929 INFO:tasks.workunit.client.1.smithi195.stdout:8/564: creat d6/dd/d70/d24/d34/d67/da1/da2/da4/fc0 x:0 0 0 2024-04-06T12:23:09.929 INFO:tasks.workunit.client.1.smithi195.stdout:1/552: fsync d4/d14/d17/d24/d99/f68 0 2024-04-06T12:23:09.932 INFO:tasks.workunit.client.1.smithi195.stdout:5/615: rename d0/da/d13/d87/d37 to d0/da/d23/dd4 0 2024-04-06T12:23:09.933 INFO:tasks.workunit.client.1.smithi195.stdout:5/616: stat d0/da/dd/d2e/l84 0 2024-04-06T12:23:09.938 INFO:tasks.workunit.client.1.smithi195.stdout:1/553: creat d4/d14/d17/d24/d99/d23/d5d/fa3 x:0 0 0 2024-04-06T12:23:09.942 INFO:tasks.workunit.client.1.smithi195.stdout:2/596: rename d2/d21/d2c/d2d/d92/d95/fa9 to d2/d21/d29/fb5 0 2024-04-06T12:23:09.944 INFO:tasks.workunit.client.1.smithi195.stdout:9/593: dwrite d3/d10/d4f/fa9 [0,4194304] 0 2024-04-06T12:23:09.946 INFO:tasks.workunit.client.1.smithi195.stdout:8/565: dread d6/d3a/f4d [0,4194304] 0 2024-04-06T12:23:09.946 INFO:tasks.workunit.client.1.smithi195.stdout:2/597: write d2/d21/d69/d6b/f90 [307020,74106] 0 2024-04-06T12:23:09.950 INFO:tasks.workunit.client.1.smithi195.stdout:9/594: dread d3/d10/d3b/d48/d5e/f88 [0,4194304] 0 2024-04-06T12:23:09.950 INFO:tasks.workunit.client.1.smithi195.stdout:1/554: dwrite d4/d14/d17/d24/d99/d4e/d60/f86 [0,4194304] 0 2024-04-06T12:23:09.952 INFO:tasks.workunit.client.1.smithi195.stdout:1/555: stat d4/d14/d17/d24/d99/f84 0 2024-04-06T12:23:09.956 INFO:tasks.workunit.client.1.smithi195.stdout:6/596: rename d8/d21/d2b/d46/d7f/ld9 to d8/d3d/d5e/dd3/le5 0 2024-04-06T12:23:09.956 INFO:tasks.workunit.client.1.smithi195.stdout:5/617: rename d0/da/dd/d1c/d5a/d62/d64/d67/db9 to d0/da/dd/d1c/d5a/d62/d64/d67/db9/dd5 22 2024-04-06T12:23:09.958 INFO:tasks.workunit.client.1.smithi195.stdout:2/598: mkdir d2/d41/d84/d8d/d94/db6 0 2024-04-06T12:23:09.960 INFO:tasks.workunit.client.1.smithi195.stdout:9/595: dwrite d3/dc6/fbb [0,4194304] 0 2024-04-06T12:23:09.962 INFO:tasks.workunit.client.1.smithi195.stdout:9/596: chown d3/d10/d3b/d48/d9c/f8c 389158 1 2024-04-06T12:23:09.964 INFO:tasks.workunit.client.1.smithi195.stdout:1/556: unlink d4/d14/d17/d24/d99/d23/d28/d2f/f8a 0 2024-04-06T12:23:09.965 INFO:tasks.workunit.client.1.smithi195.stdout:1/557: truncate d4/d14/d17/f85 3286 0 2024-04-06T12:23:09.971 INFO:tasks.workunit.client.1.smithi195.stdout:2/599: chown d2/d21/f39 5251 1 2024-04-06T12:23:09.973 INFO:tasks.workunit.client.1.smithi195.stdout:2/600: write d2/d21/d2c/f9d [838667,31644] 0 2024-04-06T12:23:09.974 INFO:tasks.workunit.client.1.smithi195.stdout:9/597: dread d3/d10/d3b/d48/d5e/f88 [0,4194304] 0 2024-04-06T12:23:09.975 INFO:tasks.workunit.client.1.smithi195.stdout:9/598: readlink d3/d10/d3b/d50/lb6 0 2024-04-06T12:23:09.976 INFO:tasks.workunit.client.1.smithi195.stdout:1/558: mkdir d4/d14/d17/d24/d99/d23/d28/d2f/da4 0 2024-04-06T12:23:09.976 INFO:tasks.workunit.client.1.smithi195.stdout:9/599: stat d3/d10/d3b/d48/f69 0 2024-04-06T12:23:09.978 INFO:tasks.workunit.client.1.smithi195.stdout:3/615: write d4/df/d39/f98 [1891707,49877] 0 2024-04-06T12:23:09.978 INFO:tasks.workunit.client.1.smithi195.stdout:7/446: sync 2024-04-06T12:23:09.980 INFO:tasks.workunit.client.1.smithi195.stdout:3/616: chown d4/d9/d2b/d77/ca0 244 1 2024-04-06T12:23:09.980 INFO:tasks.workunit.client.1.smithi195.stdout:8/566: getdents d6/dd/d70/d24/d34/d67/da1/dbd 0 2024-04-06T12:23:09.982 INFO:tasks.workunit.client.1.smithi195.stdout:8/567: readlink d6/db/d47/l5f 0 2024-04-06T12:23:09.984 INFO:tasks.workunit.client.1.smithi195.stdout:1/559: dwrite d4/d14/d17/d24/d99/d4e/d60/f86 [4194304,4194304] 0 2024-04-06T12:23:09.984 INFO:tasks.workunit.client.1.smithi195.stdout:5/618: rename d0/da/dd/f89 to d0/da/dd/d1c/d5a/d62/d64/fd6 0 2024-04-06T12:23:09.984 INFO:tasks.workunit.client.1.smithi195.stdout:8/568: dread d6/d3a/f8e [0,4194304] 0 2024-04-06T12:23:09.986 INFO:tasks.workunit.client.1.smithi195.stdout:9/600: unlink d3/d10/d3a/d6b/lb0 0 2024-04-06T12:23:09.987 INFO:tasks.workunit.client.1.smithi195.stdout:1/560: write d4/d14/fa0 [262137,94383] 0 2024-04-06T12:23:09.988 INFO:tasks.workunit.client.1.smithi195.stdout:5/619: write d0/da/dd/d1c/d5a/d62/d64/f8a [4049560,116633] 0 2024-04-06T12:23:09.992 INFO:tasks.workunit.client.1.smithi195.stdout:2/601: rename d2/d21/d69/f63 to d2/d41/d84/fb7 0 2024-04-06T12:23:09.996 INFO:tasks.workunit.client.1.smithi195.stdout:6/597: write d8/d21/d31/fe [6030414,89170] 0 2024-04-06T12:23:09.997 INFO:tasks.workunit.client.1.smithi195.stdout:9/601: truncate d3/d10/d3a/f3e 4904459 0 2024-04-06T12:23:09.999 INFO:tasks.workunit.client.1.smithi195.stdout:3/617: rename d4/f7 to d4/d9/d2b/d3b/d5e/d7e/fca 0 2024-04-06T12:23:10.000 INFO:tasks.workunit.client.1.smithi195.stdout:8/569: link d6/d8/daa/dab/fad d6/d8/d52/fc1 0 2024-04-06T12:23:10.001 INFO:tasks.workunit.client.1.smithi195.stdout:8/570: chown d6/f9e 3 1 2024-04-06T12:23:10.001 INFO:tasks.workunit.client.1.smithi195.stdout:7/447: getdents d4/d10/d18/d19/d63 0 2024-04-06T12:23:10.002 INFO:tasks.workunit.client.1.smithi195.stdout:4/510: write d4/d6/d38/d1a/d40/d20/f61 [198579,56969] 0 2024-04-06T12:23:10.002 INFO:tasks.workunit.client.1.smithi195.stdout:6/598: mknod d8/d21/d31/d26/ce6 0 2024-04-06T12:23:10.003 INFO:tasks.workunit.client.1.smithi195.stdout:4/511: dread - d4/d3e/f94 zero size 2024-04-06T12:23:10.003 INFO:tasks.workunit.client.1.smithi195.stdout:5/620: mkdir d0/da/dd/d1c/d5a/d68/dd7 0 2024-04-06T12:23:10.008 INFO:tasks.workunit.client.1.smithi195.stdout:4/512: stat d4/d6/d38/d1a/d40 0 2024-04-06T12:23:10.008 INFO:tasks.workunit.client.1.smithi195.stdout:1/561: rename d4/d14/d17/d24/d99/d88/ca1 to d4/d14/ca5 0 2024-04-06T12:23:10.009 INFO:tasks.workunit.client.1.smithi195.stdout:3/618: symlink d4/d9/d2b/d3b/d5e/d7e/lcb 0 2024-04-06T12:23:10.011 INFO:tasks.workunit.client.1.smithi195.stdout:3/619: read d4/de/f96 [242620,126107] 0 2024-04-06T12:23:10.020 INFO:tasks.workunit.client.1.smithi195.stdout:2/602: rename d2/l2a to d2/d3f/d7d/d5d/lb8 0 2024-04-06T12:23:10.023 INFO:tasks.workunit.client.1.smithi195.stdout:0/557: sync 2024-04-06T12:23:10.023 INFO:tasks.workunit.client.1.smithi195.stdout:7/448: mknod d4/d10/d18/c92 0 2024-04-06T12:23:10.024 INFO:tasks.workunit.client.1.smithi195.stdout:0/558: chown d4/d6/d1a/f37 2 1 2024-04-06T12:23:10.024 INFO:tasks.workunit.client.1.smithi195.stdout:6/599: symlink d8/d21/le7 0 2024-04-06T12:23:10.026 INFO:tasks.workunit.client.1.smithi195.stdout:6/600: truncate d8/d21/d2b/d46/d44/f8c 428132 0 2024-04-06T12:23:10.027 INFO:tasks.workunit.client.1.smithi195.stdout:3/620: read - d4/df/f57 zero size 2024-04-06T12:23:10.028 INFO:tasks.workunit.client.1.smithi195.stdout:9/602: creat d3/d10/fc8 x:0 0 0 2024-04-06T12:23:10.033 INFO:tasks.workunit.client.1.smithi195.stdout:6/601: dwrite d8/d21/d2b/d46/d44/f8c [0,4194304] 0 2024-04-06T12:23:10.034 INFO:tasks.workunit.client.1.smithi195.stdout:6/602: read d8/d21/d2b/f54 [52419,56246] 0 2024-04-06T12:23:10.035 INFO:tasks.workunit.client.1.smithi195.stdout:3/621: stat d4/d9/l3d 0 2024-04-06T12:23:10.036 INFO:tasks.workunit.client.1.smithi195.stdout:6/603: truncate d8/d21/d2b/d46/d44/d86/fbf 962492 0 2024-04-06T12:23:10.037 INFO:tasks.workunit.client.1.smithi195.stdout:1/562: readlink d4/d14/d17/l3c 0 2024-04-06T12:23:10.037 INFO:tasks.workunit.client.1.smithi195.stdout:4/513: symlink d4/d6d/l9d 0 2024-04-06T12:23:10.038 INFO:tasks.workunit.client.1.smithi195.stdout:1/563: fdatasync d4/d14/d17/f77 0 2024-04-06T12:23:10.038 INFO:tasks.workunit.client.1.smithi195.stdout:9/603: rmdir d3/db9/dbc 39 2024-04-06T12:23:10.042 INFO:tasks.workunit.client.1.smithi195.stdout:0/559: symlink d4/d6/d58/da7/lb6 0 2024-04-06T12:23:10.043 INFO:tasks.workunit.client.1.smithi195.stdout:5/621: link d0/da/d13/c95 d0/da/dd/d2e/d6f/d58/cd8 0 2024-04-06T12:23:10.043 INFO:tasks.workunit.client.1.smithi195.stdout:5/622: chown d0/da/d23/fcb 425826521 1 2024-04-06T12:23:10.048 INFO:tasks.workunit.client.1.smithi195.stdout:1/564: creat d4/d14/d17/d24/d99/d23/d5d/fa6 x:0 0 0 2024-04-06T12:23:10.049 INFO:tasks.workunit.client.1.smithi195.stdout:8/571: dwrite d6/d3a/f45 [0,4194304] 0 2024-04-06T12:23:10.053 INFO:tasks.workunit.client.1.smithi195.stdout:0/560: rename d4/d65 to d4/d48/d77/d97/db7 0 2024-04-06T12:23:10.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/603: write d2/d21/d2c/d2d/f57 [50468,7883] 0 2024-04-06T12:23:10.061 INFO:tasks.workunit.client.1.smithi195.stdout:9/604: dread d3/de/f21 [0,4194304] 0 2024-04-06T12:23:10.063 INFO:tasks.workunit.client.1.smithi195.stdout:7/449: link d4/d16/l3a d4/d16/dd/d22/l93 0 2024-04-06T12:23:10.065 INFO:tasks.workunit.client.1.smithi195.stdout:1/565: rename d4/d14/d17/d24/d2a/d45/f7e to d4/d14/d17/d24/d99/d4e/d8f/fa7 0 2024-04-06T12:23:10.067 INFO:tasks.workunit.client.1.smithi195.stdout:3/622: link d4/de/fc5 d4/de/d8e/d92/d9e/da4/fcc 0 2024-04-06T12:23:10.067 INFO:tasks.workunit.client.1.smithi195.stdout:9/605: dwrite d3/d10/d4f/fa9 [0,4194304] 0 2024-04-06T12:23:10.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/606: dread - d3/d10/d3a/f90 zero size 2024-04-06T12:23:10.070 INFO:tasks.workunit.client.1.smithi195.stdout:6/604: link d8/f2a d8/d21/d2b/d46/d44/fe8 0 2024-04-06T12:23:10.078 INFO:tasks.workunit.client.1.smithi195.stdout:3/623: fdatasync d4/d9/d2b/d3b/d40/f67 0 2024-04-06T12:23:10.082 INFO:tasks.workunit.client.1.smithi195.stdout:1/566: rename d4/d14/d17/d24/d99/d23/d28/d2f to d4/d14/d17/d3a/da8 0 2024-04-06T12:23:10.083 INFO:tasks.workunit.client.1.smithi195.stdout:0/561: write d4/d6/f6b [626926,26800] 0 2024-04-06T12:23:10.084 INFO:tasks.workunit.client.1.smithi195.stdout:4/514: getdents d4/d6/d38/d1a/d40/d20/d23 0 2024-04-06T12:23:10.085 INFO:tasks.workunit.client.1.smithi195.stdout:1/567: dread d4/d14/d17/d24/f4a [0,4194304] 0 2024-04-06T12:23:10.085 INFO:tasks.workunit.client.1.smithi195.stdout:6/605: creat d8/d21/d2b/fe9 x:0 0 0 2024-04-06T12:23:10.086 INFO:tasks.workunit.client.1.smithi195.stdout:4/515: fsync d4/d6/d38/d1a/d40/d20/f8a 0 2024-04-06T12:23:10.088 INFO:tasks.workunit.client.1.smithi195.stdout:6/606: read d8/d21/d2b/d46/f83 [3227789,355] 0 2024-04-06T12:23:10.090 INFO:tasks.workunit.client.1.smithi195.stdout:2/604: creat d2/d41/fb9 x:0 0 0 2024-04-06T12:23:10.093 INFO:tasks.workunit.client.1.smithi195.stdout:0/562: mknod d4/d48/d67/d83/cb8 0 2024-04-06T12:23:10.094 INFO:tasks.workunit.client.1.smithi195.stdout:8/572: link d6/d8/f26 d6/d3a/d46/db2/fc2 0 2024-04-06T12:23:10.095 INFO:tasks.workunit.client.1.smithi195.stdout:7/450: write d4/d5d/f4e [455918,62302] 0 2024-04-06T12:23:10.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/516: readlink d4/d6/d38/d1a/d40/d20/l89 0 2024-04-06T12:23:10.139 INFO:tasks.workunit.client.1.smithi195.stdout:1/568: mknod d4/d14/d17/d24/d99/d23/d28/ca9 0 2024-04-06T12:23:10.140 INFO:tasks.workunit.client.1.smithi195.stdout:0/563: creat d4/d6/d1a/d73/fb9 x:0 0 0 2024-04-06T12:23:10.141 INFO:tasks.workunit.client.1.smithi195.stdout:9/607: dwrite d3/d10/d3b/d48/f6f [0,4194304] 0 2024-04-06T12:23:10.173 INFO:tasks.workunit.client.1.smithi195.stdout:5/623: sync 2024-04-06T12:23:10.173 INFO:tasks.workunit.client.1.smithi195.stdout:3/624: getdents d4/d9/d37 0 2024-04-06T12:23:10.177 INFO:tasks.workunit.client.1.smithi195.stdout:1/569: mkdir d4/d14/d17/d24/d2a/d5a/daa 0 2024-04-06T12:23:10.177 INFO:tasks.workunit.client.1.smithi195.stdout:3/625: readlink d4/l17 0 2024-04-06T12:23:10.179 INFO:tasks.workunit.client.1.smithi195.stdout:2/605: dwrite d2/d3f/f42 [0,4194304] 0 2024-04-06T12:23:10.179 INFO:tasks.workunit.client.1.smithi195.stdout:9/608: rename d3/d10/f9b to d3/d10/d3a/d5d/fc9 0 2024-04-06T12:23:10.182 INFO:tasks.workunit.client.1.smithi195.stdout:3/626: write d4/d9/d2b/d77/fba [5166369,46180] 0 2024-04-06T12:23:10.183 INFO:tasks.workunit.client.1.smithi195.stdout:8/573: dread d6/dd/d70/d24/f39 [0,4194304] 0 2024-04-06T12:23:10.183 INFO:tasks.workunit.client.1.smithi195.stdout:5/624: dread d0/da/dd/d2e/d6f/f9d [0,4194304] 0 2024-04-06T12:23:10.183 INFO:tasks.workunit.client.1.smithi195.stdout:1/570: creat d4/d14/d17/d24/fab x:0 0 0 2024-04-06T12:23:10.184 INFO:tasks.workunit.client.1.smithi195.stdout:4/517: link d4/c43 d4/d8c/d96/c9e 0 2024-04-06T12:23:10.184 INFO:tasks.workunit.client.1.smithi195.stdout:0/564: truncate d4/d6/d2f/d49/f52 1406900 0 2024-04-06T12:23:10.187 INFO:tasks.workunit.client.1.smithi195.stdout:9/609: write d3/d10/d3b/d48/f49 [5004263,20605] 0 2024-04-06T12:23:10.188 INFO:tasks.workunit.client.1.smithi195.stdout:0/565: readlink d4/d48/d77/d97/db7/lb4 0 2024-04-06T12:23:10.188 INFO:tasks.workunit.client.1.smithi195.stdout:5/625: symlink d0/da/dd/d2e/d6f/d58/ld9 0 2024-04-06T12:23:10.191 INFO:tasks.workunit.client.1.smithi195.stdout:8/574: creat d6/dd/d70/d24/d34/d67/da1/da2/da4/fc3 x:0 0 0 2024-04-06T12:23:10.191 INFO:tasks.workunit.client.1.smithi195.stdout:4/518: write d4/d6/d38/f28 [5099008,39982] 0 2024-04-06T12:23:10.192 INFO:tasks.workunit.client.1.smithi195.stdout:2/606: rename d2/d3f/d7d/ca7 to d2/d41/d5a/cba 0 2024-04-06T12:23:10.192 INFO:tasks.workunit.client.1.smithi195.stdout:0/566: dread - d4/d48/d77/d97/db7/f8d zero size 2024-04-06T12:23:10.193 INFO:tasks.workunit.client.1.smithi195.stdout:1/571: mknod d4/d14/d17/d3a/da8/da4/cac 0 2024-04-06T12:23:10.195 INFO:tasks.workunit.client.1.smithi195.stdout:3/627: dwrite d4/df/f6f [0,4194304] 0 2024-04-06T12:23:10.196 INFO:tasks.workunit.client.1.smithi195.stdout:9/610: symlink d3/d10/lca 0 2024-04-06T12:23:10.198 INFO:tasks.workunit.client.1.smithi195.stdout:7/451: sync 2024-04-06T12:23:10.198 INFO:tasks.workunit.client.1.smithi195.stdout:6/607: sync 2024-04-06T12:23:10.198 INFO:tasks.workunit.client.1.smithi195.stdout:2/607: mkdir d2/d41/d84/d8d/d94/dbb 0 2024-04-06T12:23:10.200 INFO:tasks.workunit.client.1.smithi195.stdout:0/567: chown d4/d6/d1a/l1c 2 1 2024-04-06T12:23:10.201 INFO:tasks.workunit.client.1.smithi195.stdout:8/575: write d6/dd/d70/d24/d34/d67/f86 [103974,35677] 0 2024-04-06T12:23:10.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/628: read - d4/de/d8e/fa2 zero size 2024-04-06T12:23:10.204 INFO:tasks.workunit.client.1.smithi195.stdout:6/608: write d8/d21/d2b/d46/d44/f8c [2160784,70724] 0 2024-04-06T12:23:10.205 INFO:tasks.workunit.client.1.smithi195.stdout:5/626: dwrite d0/da/d4b/f6a [4194304,4194304] 0 2024-04-06T12:23:10.206 INFO:tasks.workunit.client.1.smithi195.stdout:7/452: chown d4/d16/dd/d22/l93 87827 1 2024-04-06T12:23:10.206 INFO:tasks.workunit.client.1.smithi195.stdout:3/629: fdatasync d4/d9/d37/f88 0 2024-04-06T12:23:10.212 INFO:tasks.workunit.client.1.smithi195.stdout:6/609: chown d8/d21/d31/f11 8366689 1 2024-04-06T12:23:10.213 INFO:tasks.workunit.client.1.smithi195.stdout:6/610: readlink d8/la9 0 2024-04-06T12:23:10.213 INFO:tasks.workunit.client.1.smithi195.stdout:3/630: chown d4/d9/d2b/d77/d9a/lb7 1189 1 2024-04-06T12:23:10.213 INFO:tasks.workunit.client.1.smithi195.stdout:4/519: dread d4/d6/d38/f51 [0,4194304] 0 2024-04-06T12:23:10.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/568: link d4/d48/d4e/la2 d4/d6/d1a/lba 0 2024-04-06T12:23:10.218 INFO:tasks.workunit.client.1.smithi195.stdout:1/572: dread d4/d14/fd [0,4194304] 0 2024-04-06T12:23:10.221 INFO:tasks.workunit.client.1.smithi195.stdout:6/611: mknod d8/d3d/d5e/dd3/cea 0 2024-04-06T12:23:10.221 INFO:tasks.workunit.client.1.smithi195.stdout:3/631: fsync d4/df/d39/f8a 0 2024-04-06T12:23:10.225 INFO:tasks.workunit.client.1.smithi195.stdout:8/576: rename d6/d8/l21 to d6/dd/d70/d24/d34/d67/da1/da2/lc4 0 2024-04-06T12:23:10.226 INFO:tasks.workunit.client.1.smithi195.stdout:8/577: dread - d6/dd/d70/d24/d25/d7c/fb4 zero size 2024-04-06T12:23:10.229 INFO:tasks.workunit.client.1.smithi195.stdout:8/578: write d6/d3a/d46/fa6 [548771,82791] 0 2024-04-06T12:23:10.232 INFO:tasks.workunit.client.1.smithi195.stdout:5/627: rename d0/da/dd/d33/f83 to d0/da/dd/d1c/d5a/d62/fda 0 2024-04-06T12:23:10.236 INFO:tasks.workunit.client.1.smithi195.stdout:9/611: dwrite d3/d10/d3b/d48/d9c/f8c [0,4194304] 0 2024-04-06T12:23:10.236 INFO:tasks.workunit.client.1.smithi195.stdout:1/573: dread d4/d14/d17/d24/d99/d23/d28/f50 [0,4194304] 0 2024-04-06T12:23:10.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/632: symlink d4/d9/d2b/d9b/lcd 0 2024-04-06T12:23:10.239 INFO:tasks.workunit.client.1.smithi195.stdout:2/608: dwrite d2/d3f/d7d/f68 [0,4194304] 0 2024-04-06T12:23:10.242 INFO:tasks.workunit.client.1.smithi195.stdout:0/569: write d4/d6/d1a/f47 [947587,61048] 0 2024-04-06T12:23:10.244 INFO:tasks.workunit.client.1.smithi195.stdout:7/453: rename d4/d10/d18/d7e/f8a to d4/d10/d18/d33/d6e/f94 0 2024-04-06T12:23:10.245 INFO:tasks.workunit.client.1.smithi195.stdout:3/633: write d4/d9/f41 [144004,27681] 0 2024-04-06T12:23:10.245 INFO:tasks.workunit.client.1.smithi195.stdout:0/570: readlink d4/l1e 0 2024-04-06T12:23:10.248 INFO:tasks.workunit.client.1.smithi195.stdout:2/609: readlink d2/d21/d5e/d64/l6f 0 2024-04-06T12:23:10.248 INFO:tasks.workunit.client.1.smithi195.stdout:4/520: dwrite d4/d6/d38/d1a/f2d [0,4194304] 0 2024-04-06T12:23:10.249 INFO:tasks.workunit.client.1.smithi195.stdout:9/612: creat d3/d10/d3b/d48/fcb x:0 0 0 2024-04-06T12:23:10.250 INFO:tasks.workunit.client.1.smithi195.stdout:5/628: creat d0/da/dd/d1c/d5a/d62/d64/d67/db9/fdb x:0 0 0 2024-04-06T12:23:10.252 INFO:tasks.workunit.client.1.smithi195.stdout:7/454: read - d4/d16/dd/d22/d76/f7a zero size 2024-04-06T12:23:10.254 INFO:tasks.workunit.client.1.smithi195.stdout:8/579: rename d6/dd/d70/d24/d34/d67/da1/da2/lbf to d6/dd/d70/d24/d25/d49/lc5 0 2024-04-06T12:23:10.256 INFO:tasks.workunit.client.1.smithi195.stdout:9/613: dread - d3/d10/d3b/d50/f8d zero size 2024-04-06T12:23:10.258 INFO:tasks.workunit.client.1.smithi195.stdout:2/610: creat d2/d41/d84/fbc x:0 0 0 2024-04-06T12:23:10.259 INFO:tasks.workunit.client.1.smithi195.stdout:6/612: dwrite d8/d21/d31/d26/dc8/f55 [0,4194304] 0 2024-04-06T12:23:10.261 INFO:tasks.workunit.client.1.smithi195.stdout:9/614: readlink d3/d10/d3b/d50/lb6 0 2024-04-06T12:23:10.262 INFO:tasks.workunit.client.1.smithi195.stdout:0/571: creat d4/d6/d58/da7/fbb x:0 0 0 2024-04-06T12:23:10.264 INFO:tasks.workunit.client.1.smithi195.stdout:7/455: rmdir d4/d5d 39 2024-04-06T12:23:10.264 INFO:tasks.workunit.client.1.smithi195.stdout:5/629: creat d0/d52/d91/fdc x:0 0 0 2024-04-06T12:23:10.268 INFO:tasks.workunit.client.1.smithi195.stdout:5/630: chown d0/la0 2 1 2024-04-06T12:23:10.269 INFO:tasks.workunit.client.1.smithi195.stdout:0/572: stat d4/d41/f99 0 2024-04-06T12:23:10.270 INFO:tasks.workunit.client.1.smithi195.stdout:6/613: mknod d8/ceb 0 2024-04-06T12:23:10.274 INFO:tasks.workunit.client.1.smithi195.stdout:9/615: fsync d3/d10/d3b/fab 0 2024-04-06T12:23:10.274 INFO:tasks.workunit.client.1.smithi195.stdout:4/521: dwrite d4/d3e/f8d [0,4194304] 0 2024-04-06T12:23:10.275 INFO:tasks.workunit.client.1.smithi195.stdout:7/456: dread d4/d24/f49 [0,4194304] 0 2024-04-06T12:23:10.280 INFO:tasks.workunit.client.1.smithi195.stdout:3/634: dwrite d4/d9/d2b/f6a [4194304,4194304] 0 2024-04-06T12:23:10.284 INFO:tasks.workunit.client.1.smithi195.stdout:8/580: dwrite d6/d8/f95 [0,4194304] 0 2024-04-06T12:23:10.285 INFO:tasks.workunit.client.1.smithi195.stdout:5/631: rename d0/da/d13/f1f to d0/da/d23/d7a/fdd 0 2024-04-06T12:23:10.287 INFO:tasks.workunit.client.1.smithi195.stdout:9/616: read d3/d10/d3b/d48/f69 [47024,98875] 0 2024-04-06T12:23:10.288 INFO:tasks.workunit.client.1.smithi195.stdout:1/574: dwrite d4/d14/f34 [0,4194304] 0 2024-04-06T12:23:10.291 INFO:tasks.workunit.client.1.smithi195.stdout:4/522: creat d4/f9f x:0 0 0 2024-04-06T12:23:10.294 INFO:tasks.workunit.client.1.smithi195.stdout:6/614: write d8/d21/d2b/d46/f83 [3677136,48106] 0 2024-04-06T12:23:10.294 INFO:tasks.workunit.client.1.smithi195.stdout:3/635: readlink d4/d9/d2b/d3b/d5e/dab/lbd 0 2024-04-06T12:23:10.300 INFO:tasks.workunit.client.1.smithi195.stdout:2/611: dwrite d2/d3f/f80 [0,4194304] 0 2024-04-06T12:23:10.301 INFO:tasks.workunit.client.1.smithi195.stdout:6/615: dread - d8/d3d/d5e/f84 zero size 2024-04-06T12:23:10.305 INFO:tasks.workunit.client.1.smithi195.stdout:8/581: mkdir d6/dd/d70/d24/d34/d67/da1/da2/dc6 0 2024-04-06T12:23:10.306 INFO:tasks.workunit.client.1.smithi195.stdout:5/632: symlink d0/da/d13/lde 0 2024-04-06T12:23:10.308 INFO:tasks.workunit.client.1.smithi195.stdout:0/573: dwrite d4/d6/d58/f70 [0,4194304] 0 2024-04-06T12:23:10.309 INFO:tasks.workunit.client.1.smithi195.stdout:2/612: readlink d2/d21/d2c/l37 0 2024-04-06T12:23:10.310 INFO:tasks.workunit.client.1.smithi195.stdout:8/582: stat d6/db/d47/l5f 0 2024-04-06T12:23:10.314 INFO:tasks.workunit.client.1.smithi195.stdout:7/457: dread d4/d10/f27 [0,4194304] 0 2024-04-06T12:23:10.315 INFO:tasks.workunit.client.1.smithi195.stdout:2/613: write d2/d41/f49 [3809997,126596] 0 2024-04-06T12:23:10.316 INFO:tasks.workunit.client.1.smithi195.stdout:0/574: unlink d4/d48/la6 0 2024-04-06T12:23:10.318 INFO:tasks.workunit.client.1.smithi195.stdout:9/617: dwrite d3/d10/d3b/d48/fcb [0,4194304] 0 2024-04-06T12:23:10.319 INFO:tasks.workunit.client.1.smithi195.stdout:7/458: write d4/d16/f73 [776487,83296] 0 2024-04-06T12:23:10.322 INFO:tasks.workunit.client.1.smithi195.stdout:6/616: symlink d8/d3d/d5e/lec 0 2024-04-06T12:23:10.327 INFO:tasks.workunit.client.1.smithi195.stdout:1/575: link d4/d14/d17/d3a/f95 d4/d14/d17/d24/d2a/d5a/daa/fad 0 2024-04-06T12:23:10.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/633: dread d0/da/d23/f61 [0,4194304] 0 2024-04-06T12:23:10.327 INFO:tasks.workunit.client.1.smithi195.stdout:0/575: mkdir d4/dbc 0 2024-04-06T12:23:10.330 INFO:tasks.workunit.client.1.smithi195.stdout:0/576: write d4/d41/f99 [670705,23702] 0 2024-04-06T12:23:10.330 INFO:tasks.workunit.client.1.smithi195.stdout:9/618: dwrite d3/dc6/fbb [0,4194304] 0 2024-04-06T12:23:10.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/583: link d6/f31 d6/dd/d70/d24/d34/d67/da1/da2/da4/fc7 0 2024-04-06T12:23:10.333 INFO:tasks.workunit.client.1.smithi195.stdout:3/636: dread d4/df/d39/f8a [0,4194304] 0 2024-04-06T12:23:10.334 INFO:tasks.workunit.client.1.smithi195.stdout:2/614: link d2/d3f/d7d/d7a/f91 d2/d41/d5a/fbd 0 2024-04-06T12:23:10.335 INFO:tasks.workunit.client.1.smithi195.stdout:8/584: readlink d6/d8/d12/l3c 0 2024-04-06T12:23:10.335 INFO:tasks.workunit.client.1.smithi195.stdout:1/576: fsync d4/d14/d17/d24/d99/f20 0 2024-04-06T12:23:10.336 INFO:tasks.workunit.client.1.smithi195.stdout:8/585: stat d6/d3a/d46/fa6 0 2024-04-06T12:23:10.336 INFO:tasks.workunit.client.1.smithi195.stdout:9/619: creat d3/da1/fcc x:0 0 0 2024-04-06T12:23:10.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/577: symlink d4/d53/lbd 0 2024-04-06T12:23:10.340 INFO:tasks.workunit.client.1.smithi195.stdout:7/459: dread d4/d24/f64 [0,4194304] 0 2024-04-06T12:23:10.340 INFO:tasks.workunit.client.1.smithi195.stdout:0/578: write d4/d48/d67/f9d [1301163,2724] 0 2024-04-06T12:23:10.341 INFO:tasks.workunit.client.1.smithi195.stdout:2/615: mknod d2/d3f/cbe 0 2024-04-06T12:23:10.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/637: unlink d4/d9/d2b/f72 0 2024-04-06T12:23:10.345 INFO:tasks.workunit.client.1.smithi195.stdout:1/577: creat d4/d14/d17/d3a/da8/fae x:0 0 0 2024-04-06T12:23:10.345 INFO:tasks.workunit.client.1.smithi195.stdout:5/634: creat d0/da/d23/d38/fdf x:0 0 0 2024-04-06T12:23:10.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/617: dwrite d8/d50/f6a [0,4194304] 0 2024-04-06T12:23:10.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/579: readlink d4/d6/lf 0 2024-04-06T12:23:10.348 INFO:tasks.workunit.client.1.smithi195.stdout:0/580: stat d4/d48/c5c 0 2024-04-06T12:23:10.348 INFO:tasks.workunit.client.1.smithi195.stdout:2/616: unlink d2/d14/c8e 0 2024-04-06T12:23:10.348 INFO:tasks.workunit.client.1.smithi195.stdout:9/620: mknod d3/d10/ccd 0 2024-04-06T12:23:10.351 INFO:tasks.workunit.client.1.smithi195.stdout:3/638: creat d4/d9/d2b/d3b/d5e/d7e/fce x:0 0 0 2024-04-06T12:23:10.351 INFO:tasks.workunit.client.1.smithi195.stdout:8/586: mkdir d6/dd/d70/d24/d25/da5/dc8 0 2024-04-06T12:23:10.352 INFO:tasks.workunit.client.1.smithi195.stdout:8/587: chown d6/dd/f38 2077771 1 2024-04-06T12:23:10.352 INFO:tasks.workunit.client.1.smithi195.stdout:1/578: mknod d4/d14/d17/caf 0 2024-04-06T12:23:10.353 INFO:tasks.workunit.client.1.smithi195.stdout:8/588: stat d6/db/lc 0 2024-04-06T12:23:10.355 INFO:tasks.workunit.client.1.smithi195.stdout:7/460: rename d4/c8 to d4/d5d/c95 0 2024-04-06T12:23:10.356 INFO:tasks.workunit.client.1.smithi195.stdout:5/635: unlink d0/da/dd/d2e/d6f/f9d 0 2024-04-06T12:23:10.358 INFO:tasks.workunit.client.1.smithi195.stdout:6/618: write d8/d21/d31/d49/dd8/fe1 [394191,5301] 0 2024-04-06T12:23:10.359 INFO:tasks.workunit.client.1.smithi195.stdout:3/639: mkdir d4/d9/dcf 0 2024-04-06T12:23:10.361 INFO:tasks.workunit.client.1.smithi195.stdout:8/589: dwrite d6/d3a/d46/fa6 [0,4194304] 0 2024-04-06T12:23:10.362 INFO:tasks.workunit.client.1.smithi195.stdout:2/617: rename d2/d21/d2c/f9d to d2/d21/d69/d6b/fbf 0 2024-04-06T12:23:10.362 INFO:tasks.workunit.client.1.smithi195.stdout:6/619: write d8/d21/d2b/d46/f83 [4580531,96691] 0 2024-04-06T12:23:10.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/581: creat d4/dbc/fbe x:0 0 0 2024-04-06T12:23:10.369 INFO:tasks.workunit.client.1.smithi195.stdout:2/618: chown d2/d21 20 1 2024-04-06T12:23:10.369 INFO:tasks.workunit.client.1.smithi195.stdout:1/579: link d4/d14/d17/d24/d99/f5f d4/d14/d17/d24/d99/d4e/d57/fb0 0 2024-04-06T12:23:10.369 INFO:tasks.workunit.client.1.smithi195.stdout:8/590: read - d6/dd/d42/f6f zero size 2024-04-06T12:23:10.369 INFO:tasks.workunit.client.1.smithi195.stdout:3/640: creat d4/df/d39/fd0 x:0 0 0 2024-04-06T12:23:10.371 INFO:tasks.workunit.client.1.smithi195.stdout:9/621: link d3/d10/d3a/c74 d3/db9/cce 0 2024-04-06T12:23:10.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/580: dread - d4/f1c zero size 2024-04-06T12:23:10.373 INFO:tasks.workunit.client.1.smithi195.stdout:7/461: truncate d4/d5d/f42 208564 0 2024-04-06T12:23:10.373 INFO:tasks.workunit.client.1.smithi195.stdout:6/620: write d8/d50/d82/fa0 [480081,16934] 0 2024-04-06T12:23:10.374 INFO:tasks.workunit.client.1.smithi195.stdout:0/582: write d4/d53/d81/f88 [969861,12037] 0 2024-04-06T12:23:10.375 INFO:tasks.workunit.client.1.smithi195.stdout:3/641: unlink d4/d9/c5f 0 2024-04-06T12:23:10.375 INFO:tasks.workunit.client.1.smithi195.stdout:5/636: dwrite d0/da/dd/d1c/d5a/d62/d64/d67/db9/faa [0,4194304] 0 2024-04-06T12:23:10.377 INFO:tasks.workunit.client.1.smithi195.stdout:9/622: write d3/de/f21 [430722,24663] 0 2024-04-06T12:23:10.383 INFO:tasks.workunit.client.1.smithi195.stdout:2/619: getdents d2/d41/d5a 0 2024-04-06T12:23:10.386 INFO:tasks.workunit.client.1.smithi195.stdout:8/591: creat d6/dd/d70/d24/d25/da5/dc8/fc9 x:0 0 0 2024-04-06T12:23:10.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/642: creat d4/d9/d2b/d77/d9a/fd1 x:0 0 0 2024-04-06T12:23:10.389 INFO:tasks.workunit.client.1.smithi195.stdout:6/621: dwrite d8/d3d/d5e/d72/fdd [0,4194304] 0 2024-04-06T12:23:10.389 INFO:tasks.workunit.client.1.smithi195.stdout:7/462: creat d4/f96 x:0 0 0 2024-04-06T12:23:10.391 INFO:tasks.workunit.client.1.smithi195.stdout:9/623: rename d3/d10/d3b/f77 to d3/d10/d3b/d48/fcf 0 2024-04-06T12:23:10.391 INFO:tasks.workunit.client.1.smithi195.stdout:7/463: write d4/d16/dd/d22/d76/f7a [350794,24872] 0 2024-04-06T12:23:10.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/523: sync 2024-04-06T12:23:10.393 INFO:tasks.workunit.client.1.smithi195.stdout:2/620: creat d2/d3f/fc0 x:0 0 0 2024-04-06T12:23:10.394 INFO:tasks.workunit.client.1.smithi195.stdout:2/621: stat d2/d14/faa 0 2024-04-06T12:23:10.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/592: stat d6/d8/d12/d83/c9a 0 2024-04-06T12:23:10.395 INFO:tasks.workunit.client.1.smithi195.stdout:3/643: creat d4/df/d39/fd2 x:0 0 0 2024-04-06T12:23:10.396 INFO:tasks.workunit.client.1.smithi195.stdout:2/622: chown d2/d41/d84 20 1 2024-04-06T12:23:10.398 INFO:tasks.workunit.client.1.smithi195.stdout:3/644: chown d4/d9/d2b/d3b/d40 0 1 2024-04-06T12:23:10.400 INFO:tasks.workunit.client.1.smithi195.stdout:9/624: fsync d3/d10/d3b/d48/f4b 0 2024-04-06T12:23:10.401 INFO:tasks.workunit.client.1.smithi195.stdout:5/637: creat d0/da/dd/fe0 x:0 0 0 2024-04-06T12:23:10.403 INFO:tasks.workunit.client.1.smithi195.stdout:1/581: link d4/d14/d17/d3a/f9f d4/d14/d17/d24/d99/d23/d28/fb1 0 2024-04-06T12:23:10.406 INFO:tasks.workunit.client.1.smithi195.stdout:8/593: symlink d6/dd/d70/d24/d25/da5/lca 0 2024-04-06T12:23:10.406 INFO:tasks.workunit.client.1.smithi195.stdout:4/524: dwrite d4/d6/d38/d1a/f3c [0,4194304] 0 2024-04-06T12:23:10.408 INFO:tasks.workunit.client.1.smithi195.stdout:6/622: dwrite d8/d21/d31/f11 [0,4194304] 0 2024-04-06T12:23:10.410 INFO:tasks.workunit.client.1.smithi195.stdout:0/583: dread d4/d6/f42 [0,4194304] 0 2024-04-06T12:23:10.410 INFO:tasks.workunit.client.1.smithi195.stdout:3/645: creat d4/d9/d2b/d87/fd3 x:0 0 0 2024-04-06T12:23:10.410 INFO:tasks.workunit.client.1.smithi195.stdout:1/582: write d4/d14/d17/d24/d99/f4c [942594,94318] 0 2024-04-06T12:23:10.412 INFO:tasks.workunit.client.1.smithi195.stdout:2/623: symlink d2/d21/d29/lc1 0 2024-04-06T12:23:10.417 INFO:tasks.workunit.client.1.smithi195.stdout:8/594: dread d6/db/d47/f77 [0,4194304] 0 2024-04-06T12:23:10.419 INFO:tasks.workunit.client.1.smithi195.stdout:3/646: unlink d4/d9/f1e 0 2024-04-06T12:23:10.422 INFO:tasks.workunit.client.1.smithi195.stdout:5/638: dwrite d0/da/dd/d1c/d5a/d62/d64/d67/db9/fcf [0,4194304] 0 2024-04-06T12:23:10.422 INFO:tasks.workunit.client.1.smithi195.stdout:0/584: rename d4/d48/d4e/f5b to d4/d53/fbf 0 2024-04-06T12:23:10.423 INFO:tasks.workunit.client.1.smithi195.stdout:4/525: dwrite d4/d6/d38/d1a/d40/d20/f60 [0,4194304] 0 2024-04-06T12:23:10.424 INFO:tasks.workunit.client.1.smithi195.stdout:6/623: mkdir d8/d21/d31/d6c/ded 0 2024-04-06T12:23:10.425 INFO:tasks.workunit.client.1.smithi195.stdout:5/639: dread - d0/da/dd/d2e/fd1 zero size 2024-04-06T12:23:10.428 INFO:tasks.workunit.client.1.smithi195.stdout:5/640: dread - d0/da/dd/d1c/d5a/d62/f76 zero size 2024-04-06T12:23:10.429 INFO:tasks.workunit.client.1.smithi195.stdout:8/595: mkdir d6/dd/d70/d24/d25/da5/dc8/dcb 0 2024-04-06T12:23:10.432 INFO:tasks.workunit.client.1.smithi195.stdout:3/647: creat d4/d9/d2b/d9b/fd4 x:0 0 0 2024-04-06T12:23:10.433 INFO:tasks.workunit.client.1.smithi195.stdout:0/585: dwrite d4/d48/d67/d83/fab [0,4194304] 0 2024-04-06T12:23:10.440 INFO:tasks.workunit.client.1.smithi195.stdout:3/648: dwrite d4/df/d39/fd0 [0,4194304] 0 2024-04-06T12:23:10.441 INFO:tasks.workunit.client.1.smithi195.stdout:1/583: rename d4/d14/d17/d24/d99/d23 to d4/d14/d17/d3a/da8/da4/db2 0 2024-04-06T12:23:10.441 INFO:tasks.workunit.client.1.smithi195.stdout:4/526: rmdir d4/d6/d38/d1a/d40/d57/d64 39 2024-04-06T12:23:10.443 INFO:tasks.workunit.client.1.smithi195.stdout:3/649: read - d4/df/f57 zero size 2024-04-06T12:23:10.444 INFO:tasks.workunit.client.1.smithi195.stdout:3/650: chown d4/d9/d2b/d3b/d40 1753 1 2024-04-06T12:23:10.448 INFO:tasks.workunit.client.1.smithi195.stdout:5/641: truncate d0/da/d13/f15 676337 0 2024-04-06T12:23:10.449 INFO:tasks.workunit.client.1.smithi195.stdout:8/596: mknod d6/dd/d70/d24/d34/d67/da1/ccc 0 2024-04-06T12:23:10.451 INFO:tasks.workunit.client.1.smithi195.stdout:5/642: truncate d0/da/dd/d1c/d5a/d62/d64/d67/db9/f81 671510 0 2024-04-06T12:23:10.451 INFO:tasks.workunit.client.1.smithi195.stdout:0/586: mknod d4/d6/d2f/d49/cc0 0 2024-04-06T12:23:10.453 INFO:tasks.workunit.client.1.smithi195.stdout:5/643: truncate d0/da/dd/d2e/fa4 1532124 0 2024-04-06T12:23:10.453 INFO:tasks.workunit.client.1.smithi195.stdout:4/527: fdatasync d4/f4e 0 2024-04-06T12:23:10.454 INFO:tasks.workunit.client.1.smithi195.stdout:4/528: fdatasync d4/d3e/f94 0 2024-04-06T12:23:10.454 INFO:tasks.workunit.client.1.smithi195.stdout:5/644: readlink d0/da/d13/d87/lb7 0 2024-04-06T12:23:10.455 INFO:tasks.workunit.client.1.smithi195.stdout:6/624: rename d8/d21/d2b/d46/d44/c91 to d8/d21/d31/d49/cee 0 2024-04-06T12:23:10.455 INFO:tasks.workunit.client.1.smithi195.stdout:1/584: mkdir d4/d14/d17/d3a/da8/da4/db2/d5d/db3 0 2024-04-06T12:23:10.456 INFO:tasks.workunit.client.1.smithi195.stdout:6/625: readlink d8/d21/le7 0 2024-04-06T12:23:10.456 INFO:tasks.workunit.client.1.smithi195.stdout:4/529: write d4/d3e/f78 [4577685,89114] 0 2024-04-06T12:23:10.458 INFO:tasks.workunit.client.1.smithi195.stdout:5/645: write d0/da/dd/d1c/d5a/d62/d64/d67/db9/fdb [338649,95485] 0 2024-04-06T12:23:10.459 INFO:tasks.workunit.client.1.smithi195.stdout:1/585: read d4/d14/d17/d3a/da8/da4/db2/d5d/f7d [31577,98716] 0 2024-04-06T12:23:10.459 INFO:tasks.workunit.client.1.smithi195.stdout:0/587: mknod d4/d48/d67/cc1 0 2024-04-06T12:23:10.461 INFO:tasks.workunit.client.1.smithi195.stdout:0/588: dread - d4/d6/d1a/d73/f92 zero size 2024-04-06T12:23:10.462 INFO:tasks.workunit.client.1.smithi195.stdout:8/597: rename d6/f9e to d6/dd/d42/fcd 0 2024-04-06T12:23:10.463 INFO:tasks.workunit.client.1.smithi195.stdout:6/626: mknod d8/d21/d31/d49/dd8/cef 0 2024-04-06T12:23:10.464 INFO:tasks.workunit.client.1.smithi195.stdout:5/646: fdatasync d0/da/d23/d7a/dc5/fc0 0 2024-04-06T12:23:10.464 INFO:tasks.workunit.client.1.smithi195.stdout:5/647: chown d0/d35/l72 0 1 2024-04-06T12:23:10.465 INFO:tasks.workunit.client.1.smithi195.stdout:5/648: readlink d0/da/dd/d1c/d5a/d62/db8/lc1 0 2024-04-06T12:23:10.467 INFO:tasks.workunit.client.1.smithi195.stdout:3/651: link d4/d9/d9f/cc3 d4/d9/dcf/cd5 0 2024-04-06T12:23:10.469 INFO:tasks.workunit.client.1.smithi195.stdout:4/530: symlink d4/d6/d38/d1a/d40/d57/la0 0 2024-04-06T12:23:10.470 INFO:tasks.workunit.client.1.smithi195.stdout:6/627: mknod d8/d21/d2b/cf0 0 2024-04-06T12:23:10.470 INFO:tasks.workunit.client.1.smithi195.stdout:6/628: write d8/f14 [1060900,98746] 0 2024-04-06T12:23:10.471 INFO:tasks.workunit.client.1.smithi195.stdout:1/586: symlink d4/d14/d17/d24/d2a/d5a/daa/lb4 0 2024-04-06T12:23:10.472 INFO:tasks.workunit.client.1.smithi195.stdout:5/649: fsync d0/da/d23/d38/f60 0 2024-04-06T12:23:10.474 INFO:tasks.workunit.client.1.smithi195.stdout:8/598: chown d6/db/d47/d97/ca8 23 1 2024-04-06T12:23:10.475 INFO:tasks.workunit.client.1.smithi195.stdout:8/599: truncate d6/d8/daa/f9c 646348 0 2024-04-06T12:23:10.477 INFO:tasks.workunit.client.1.smithi195.stdout:6/629: rmdir d8/d21/d31/d26 39 2024-04-06T12:23:10.478 INFO:tasks.workunit.client.1.smithi195.stdout:6/630: chown d8/d3d/d3f/ldb 465481 1 2024-04-06T12:23:10.480 INFO:tasks.workunit.client.1.smithi195.stdout:5/650: symlink d0/da/d13/d87/d34/le1 0 2024-04-06T12:23:10.481 INFO:tasks.workunit.client.1.smithi195.stdout:4/531: mknod d4/d6/d38/d1a/d40/d57/ca1 0 2024-04-06T12:23:10.481 INFO:tasks.workunit.client.1.smithi195.stdout:9/625: dread d3/d10/d3b/d48/f4b [0,4194304] 0 2024-04-06T12:23:10.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/600: mkdir d6/dd/d42/dce 0 2024-04-06T12:23:10.484 INFO:tasks.workunit.client.1.smithi195.stdout:5/651: symlink d0/da/d23/d7a/dc5/le2 0 2024-04-06T12:23:10.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/626: rmdir d3/d10/d3b/d50 39 2024-04-06T12:23:10.490 INFO:tasks.workunit.client.1.smithi195.stdout:5/652: dwrite d0/da/d13/d87/fbd [0,4194304] 0 2024-04-06T12:23:10.492 INFO:tasks.workunit.client.1.smithi195.stdout:6/631: rename d8/d21/d2b/f48 to d8/d3d/d3f/ff1 0 2024-04-06T12:23:10.492 INFO:tasks.workunit.client.1.smithi195.stdout:5/653: dread d0/da/d23/f61 [0,4194304] 0 2024-04-06T12:23:10.493 INFO:tasks.workunit.client.1.smithi195.stdout:5/654: read - d0/da/f9f zero size 2024-04-06T12:23:10.500 INFO:tasks.workunit.client.1.smithi195.stdout:3/652: write d4/df/d39/f47 [1836807,106054] 0 2024-04-06T12:23:10.539 INFO:tasks.workunit.client.1.smithi195.stdout:7/464: sync 2024-04-06T12:23:10.542 INFO:tasks.workunit.client.1.smithi195.stdout:4/532: link d4/d6/d38/d1a/f3c d4/d6/d38/d1a/d40/d57/fa2 0 2024-04-06T12:23:10.542 INFO:tasks.workunit.client.1.smithi195.stdout:0/589: write d4/f31 [1326050,32007] 0 2024-04-06T12:23:10.544 INFO:tasks.workunit.client.1.smithi195.stdout:8/601: write d6/d8/f35 [1276178,41816] 0 2024-04-06T12:23:10.545 INFO:tasks.workunit.client.1.smithi195.stdout:6/632: truncate d8/d21/fd0 3304432 0 2024-04-06T12:23:10.545 INFO:tasks.workunit.client.1.smithi195.stdout:3/653: dread d4/d9/f41 [0,4194304] 0 2024-04-06T12:23:10.546 INFO:tasks.workunit.client.1.smithi195.stdout:4/533: write d4/d6/d38/d65/f7f [657822,59670] 0 2024-04-06T12:23:10.547 INFO:tasks.workunit.client.1.smithi195.stdout:0/590: chown d4/d6/d2f/l3c 3590 1 2024-04-06T12:23:10.548 INFO:tasks.workunit.client.1.smithi195.stdout:6/633: symlink d8/d21/d31/d49/lf2 0 2024-04-06T12:23:10.549 INFO:tasks.workunit.client.1.smithi195.stdout:8/602: chown d6/dd/d70/d24/d34/d67/da1/ccc 0 1 2024-04-06T12:23:10.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/591: creat d4/dbc/fc2 x:0 0 0 2024-04-06T12:23:10.550 INFO:tasks.workunit.client.1.smithi195.stdout:6/634: dread - d8/d3d/d3f/f52 zero size 2024-04-06T12:23:10.550 INFO:tasks.workunit.client.1.smithi195.stdout:3/654: creat d4/d9/dcf/fd6 x:0 0 0 2024-04-06T12:23:10.552 INFO:tasks.workunit.client.1.smithi195.stdout:4/534: rename d4/d6/d38/d1a/d40/f3b to d4/d6/d38/d65/fa3 0 2024-04-06T12:23:10.552 INFO:tasks.workunit.client.1.smithi195.stdout:0/592: write d4/d6/d1a/d73/fb9 [708241,67939] 0 2024-04-06T12:23:10.554 INFO:tasks.workunit.client.1.smithi195.stdout:3/655: write d4/d9/d2b/f38 [6653625,24779] 0 2024-04-06T12:23:10.555 INFO:tasks.workunit.client.1.smithi195.stdout:6/635: creat d8/d21/d31/d6c/ded/ff3 x:0 0 0 2024-04-06T12:23:10.559 INFO:tasks.workunit.client.1.smithi195.stdout:6/636: unlink d8/fcb 0 2024-04-06T12:23:10.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/593: rename d4/d48/d67/l68 to d4/d48/d67/lc3 0 2024-04-06T12:23:10.564 INFO:tasks.workunit.client.1.smithi195.stdout:7/465: dread d4/d5d/f3b [0,4194304] 0 2024-04-06T12:23:10.565 INFO:tasks.workunit.client.1.smithi195.stdout:0/594: chown d4/d6/d58/lae 3595237 1 2024-04-06T12:23:10.566 INFO:tasks.workunit.client.1.smithi195.stdout:4/535: dread d4/d6/d38/d1a/d40/f15 [0,4194304] 0 2024-04-06T12:23:10.568 INFO:tasks.workunit.client.1.smithi195.stdout:6/637: dread d8/d21/d31/f11 [0,4194304] 0 2024-04-06T12:23:10.568 INFO:tasks.workunit.client.1.smithi195.stdout:8/603: dread d6/dd/d70/d24/d34/f6d [0,4194304] 0 2024-04-06T12:23:10.568 INFO:tasks.workunit.client.1.smithi195.stdout:0/595: read d4/fd [1911961,97514] 0 2024-04-06T12:23:10.573 INFO:tasks.workunit.client.1.smithi195.stdout:4/536: rename d4/d6/d38/d1a to d4/d6/d38/d1a/d40/d57/d64/da4 22 2024-04-06T12:23:10.574 INFO:tasks.workunit.client.1.smithi195.stdout:7/466: write d4/d10/d18/d19/f43 [4309140,56217] 0 2024-04-06T12:23:10.575 INFO:tasks.workunit.client.1.smithi195.stdout:8/604: truncate d6/d8/daa/f82 3419249 0 2024-04-06T12:23:10.576 INFO:tasks.workunit.client.1.smithi195.stdout:3/656: dwrite d4/df/d39/f98 [0,4194304] 0 2024-04-06T12:23:10.577 INFO:tasks.workunit.client.1.smithi195.stdout:8/605: write d6/d8/f55 [1932920,58340] 0 2024-04-06T12:23:10.580 INFO:tasks.workunit.client.1.smithi195.stdout:0/596: link d4/f64 d4/d6/d58/fc4 0 2024-04-06T12:23:10.581 INFO:tasks.workunit.client.1.smithi195.stdout:8/606: write d6/dd/d70/d24/d34/f9f [345939,27962] 0 2024-04-06T12:23:10.582 INFO:tasks.workunit.client.1.smithi195.stdout:0/597: fsync d4/d48/d77/d97/db7/f9b 0 2024-04-06T12:23:10.588 INFO:tasks.workunit.client.1.smithi195.stdout:7/467: dread d4/d16/dd/d22/d3f/f68 [0,4194304] 0 2024-04-06T12:23:10.588 INFO:tasks.workunit.client.1.smithi195.stdout:7/468: readlink d4/d10/d18/d57/l6d 0 2024-04-06T12:23:10.630 INFO:tasks.workunit.client.1.smithi195.stdout:2/624: sync 2024-04-06T12:23:10.638 INFO:tasks.workunit.client.1.smithi195.stdout:2/625: dread d2/f6d [0,4194304] 0 2024-04-06T12:23:10.676 INFO:tasks.workunit.client.1.smithi195.stdout:5/655: sync 2024-04-06T12:23:10.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/587: sync 2024-04-06T12:23:10.677 INFO:tasks.workunit.client.1.smithi195.stdout:9/627: sync 2024-04-06T12:23:10.713 INFO:tasks.workunit.client.1.smithi195.stdout:6/638: getdents d8 0 2024-04-06T12:23:10.715 INFO:tasks.workunit.client.1.smithi195.stdout:3/657: symlink d4/df/d39/ld7 0 2024-04-06T12:23:10.717 INFO:tasks.workunit.client.1.smithi195.stdout:8/607: mknod d6/d8/daa/dab/ccf 0 2024-04-06T12:23:10.719 INFO:tasks.workunit.client.1.smithi195.stdout:6/639: dread d8/d50/d32/f57 [0,4194304] 0 2024-04-06T12:23:10.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/469: creat d4/d16/dd/d22/d76/f97 x:0 0 0 2024-04-06T12:23:10.721 INFO:tasks.workunit.client.1.smithi195.stdout:2/626: symlink d2/d21/d2c/lc2 0 2024-04-06T12:23:10.723 INFO:tasks.workunit.client.1.smithi195.stdout:9/628: rmdir d3/d10 39 2024-04-06T12:23:10.725 INFO:tasks.workunit.client.1.smithi195.stdout:5/656: symlink d0/da/d23/dd4/le3 0 2024-04-06T12:23:10.727 INFO:tasks.workunit.client.1.smithi195.stdout:2/627: dwrite d2/d3f/d7d/fa0 [0,4194304] 0 2024-04-06T12:23:10.727 INFO:tasks.workunit.client.1.smithi195.stdout:1/588: creat d4/d14/d17/d24/d2a/d5a/daa/fb5 x:0 0 0 2024-04-06T12:23:10.734 INFO:tasks.workunit.client.1.smithi195.stdout:8/608: symlink d6/d8/d12/ld0 0 2024-04-06T12:23:10.736 INFO:tasks.workunit.client.1.smithi195.stdout:7/470: rmdir d4/d24 39 2024-04-06T12:23:10.738 INFO:tasks.workunit.client.1.smithi195.stdout:6/640: creat d8/d50/d9c/ff4 x:0 0 0 2024-04-06T12:23:10.739 INFO:tasks.workunit.client.1.smithi195.stdout:9/629: stat d3/d10/d3a/d5d/fb8 0 2024-04-06T12:23:10.744 INFO:tasks.workunit.client.1.smithi195.stdout:5/657: symlink d0/da/d23/dd4/le4 0 2024-04-06T12:23:10.744 INFO:tasks.workunit.client.1.smithi195.stdout:9/630: dread - d3/d10/d3b/d48/d5e/fac zero size 2024-04-06T12:23:10.746 INFO:tasks.workunit.client.1.smithi195.stdout:1/589: rename d4/c90 to d4/d14/d17/cb6 0 2024-04-06T12:23:10.748 INFO:tasks.workunit.client.1.smithi195.stdout:3/658: write d4/d9/f21 [3036482,92729] 0 2024-04-06T12:23:10.748 INFO:tasks.workunit.client.1.smithi195.stdout:0/598: write d4/d48/d77/f7e [632825,17365] 0 2024-04-06T12:23:10.748 INFO:tasks.workunit.client.1.smithi195.stdout:8/609: truncate d6/dd/f69 2146411 0 2024-04-06T12:23:10.749 INFO:tasks.workunit.client.1.smithi195.stdout:7/471: rmdir d4/d10/d12/d6f 39 2024-04-06T12:23:10.750 INFO:tasks.workunit.client.1.smithi195.stdout:1/590: read d4/d14/f34 [1424851,9019] 0 2024-04-06T12:23:10.756 INFO:tasks.workunit.client.1.smithi195.stdout:0/599: mknod d4/d48/d67/d75/cc5 0 2024-04-06T12:23:10.756 INFO:tasks.workunit.client.1.smithi195.stdout:2/628: dread d2/d41/d5a/fbd [0,4194304] 0 2024-04-06T12:23:10.756 INFO:tasks.workunit.client.1.smithi195.stdout:4/537: sync 2024-04-06T12:23:10.757 INFO:tasks.workunit.client.1.smithi195.stdout:9/631: dwrite d3/d10/f46 [4194304,4194304] 0 2024-04-06T12:23:10.757 INFO:tasks.workunit.client.1.smithi195.stdout:1/591: truncate d4/d14/d17/f8c 885759 0 2024-04-06T12:23:10.758 INFO:tasks.workunit.client.1.smithi195.stdout:7/472: dread d4/d10/d12/f14 [8388608,4194304] 0 2024-04-06T12:23:10.758 INFO:tasks.workunit.client.1.smithi195.stdout:6/641: rename d8/d3d/d3f/l42 to d8/d21/lf5 0 2024-04-06T12:23:10.760 INFO:tasks.workunit.client.1.smithi195.stdout:6/642: dread - d8/d50/d32/fbe zero size 2024-04-06T12:23:10.761 INFO:tasks.workunit.client.1.smithi195.stdout:3/659: dread d4/df/d39/f8a [0,4194304] 0 2024-04-06T12:23:10.761 INFO:tasks.workunit.client.1.smithi195.stdout:0/600: mkdir d4/d6/d58/da7/dc6 0 2024-04-06T12:23:10.763 INFO:tasks.workunit.client.1.smithi195.stdout:0/601: write d4/d6/d1a/d73/f92 [218811,3033] 0 2024-04-06T12:23:10.763 INFO:tasks.workunit.client.1.smithi195.stdout:8/610: creat d6/d3a/fd1 x:0 0 0 2024-04-06T12:23:10.765 INFO:tasks.workunit.client.1.smithi195.stdout:4/538: fdatasync d4/d6/d38/d1a/d40/f15 0 2024-04-06T12:23:10.768 INFO:tasks.workunit.client.1.smithi195.stdout:1/592: unlink d4/d14/d17/c9e 0 2024-04-06T12:23:10.771 INFO:tasks.workunit.client.1.smithi195.stdout:8/611: chown d6/d8/d12/d83/laf 120255 1 2024-04-06T12:23:10.771 INFO:tasks.workunit.client.1.smithi195.stdout:0/602: rmdir d4/d48/d77/d97/db7 39 2024-04-06T12:23:10.772 INFO:tasks.workunit.client.1.smithi195.stdout:8/612: dread - d6/fb6 zero size 2024-04-06T12:23:10.773 INFO:tasks.workunit.client.1.smithi195.stdout:0/603: fsync d4/d48/d67/d83/fab 0 2024-04-06T12:23:10.774 INFO:tasks.workunit.client.1.smithi195.stdout:6/643: dread d8/d21/d2b/d46/f83 [0,4194304] 0 2024-04-06T12:23:10.778 INFO:tasks.workunit.client.1.smithi195.stdout:5/658: rename d0/da/d13/d87/f31 to d0/da/dd/fe5 0 2024-04-06T12:23:10.782 INFO:tasks.workunit.client.1.smithi195.stdout:2/629: write d2/f61 [1189698,50344] 0 2024-04-06T12:23:10.783 INFO:tasks.workunit.client.1.smithi195.stdout:9/632: write d3/d10/d3b/d48/d9c/f68 [845446,108539] 0 2024-04-06T12:23:10.785 INFO:tasks.workunit.client.1.smithi195.stdout:7/473: write d4/d24/f64 [1559006,16382] 0 2024-04-06T12:23:10.788 INFO:tasks.workunit.client.1.smithi195.stdout:8/613: write d6/db/d47/f51 [3295697,82056] 0 2024-04-06T12:23:10.790 INFO:tasks.workunit.client.1.smithi195.stdout:4/539: link d4/d6/d38/d1a/l1e d4/d6/d38/d65/la5 0 2024-04-06T12:23:10.794 INFO:tasks.workunit.client.1.smithi195.stdout:8/614: write d6/d8/f58 [949230,95941] 0 2024-04-06T12:23:10.794 INFO:tasks.workunit.client.1.smithi195.stdout:6/644: creat d8/d21/d2b/d46/d2f/daf/ff6 x:0 0 0 2024-04-06T12:23:10.798 INFO:tasks.workunit.client.1.smithi195.stdout:3/660: dwrite d4/de/f96 [0,4194304] 0 2024-04-06T12:23:10.798 INFO:tasks.workunit.client.1.smithi195.stdout:6/645: write f5 [1726206,84700] 0 2024-04-06T12:23:10.800 INFO:tasks.workunit.client.1.smithi195.stdout:1/593: getdents d4/d14/d17/d24/d2a/d45 0 2024-04-06T12:23:10.801 INFO:tasks.workunit.client.1.smithi195.stdout:5/659: creat d0/da/dd/fe6 x:0 0 0 2024-04-06T12:23:10.803 INFO:tasks.workunit.client.1.smithi195.stdout:8/615: creat d6/d8/d52/fd2 x:0 0 0 2024-04-06T12:23:10.805 INFO:tasks.workunit.client.1.smithi195.stdout:7/474: rename d4/d16/f3e to d4/d10/d12/d6f/f98 0 2024-04-06T12:23:10.806 INFO:tasks.workunit.client.1.smithi195.stdout:2/630: dwrite d2/d21/d69/d6b/fbf [0,4194304] 0 2024-04-06T12:23:10.806 INFO:tasks.workunit.client.1.smithi195.stdout:9/633: dread d3/da1/fb4 [0,4194304] 0 2024-04-06T12:23:10.807 INFO:tasks.workunit.client.1.smithi195.stdout:2/631: readlink d2/d21/lb0 0 2024-04-06T12:23:10.808 INFO:tasks.workunit.client.1.smithi195.stdout:6/646: mkdir d8/d21/d2b/d46/d44/df7 0 2024-04-06T12:23:10.808 INFO:tasks.workunit.client.1.smithi195.stdout:9/634: chown d3/da1/fae 143860256 1 2024-04-06T12:23:10.809 INFO:tasks.workunit.client.1.smithi195.stdout:1/594: write d4/d14/d17/d3a/da8/f3f [1872012,109479] 0 2024-04-06T12:23:10.810 INFO:tasks.workunit.client.1.smithi195.stdout:3/661: creat d4/d9/d2b/d3b/d5e/fd8 x:0 0 0 2024-04-06T12:23:10.811 INFO:tasks.workunit.client.1.smithi195.stdout:6/647: chown d8/d3d/c94 1000160 1 2024-04-06T12:23:10.814 INFO:tasks.workunit.client.1.smithi195.stdout:8/616: mkdir d6/dd/dd3 0 2024-04-06T12:23:10.817 INFO:tasks.workunit.client.1.smithi195.stdout:3/662: truncate d4/f4e 1280006 0 2024-04-06T12:23:10.821 INFO:tasks.workunit.client.1.smithi195.stdout:1/595: symlink d4/d14/d17/d24/d99/d4e/d60/lb7 0 2024-04-06T12:23:10.821 INFO:tasks.workunit.client.1.smithi195.stdout:2/632: dread d2/d21/d29/f2b [0,4194304] 0 2024-04-06T12:23:10.821 INFO:tasks.workunit.client.1.smithi195.stdout:6/648: dread d8/d21/d2b/d46/d44/d86/fbf [0,4194304] 0 2024-04-06T12:23:10.823 INFO:tasks.workunit.client.1.smithi195.stdout:8/617: symlink d6/dd/d70/d24/d34/d67/d9d/ld4 0 2024-04-06T12:23:10.825 INFO:tasks.workunit.client.1.smithi195.stdout:4/540: dread d4/d6/d38/d1a/d40/d20/f61 [0,4194304] 0 2024-04-06T12:23:10.825 INFO:tasks.workunit.client.1.smithi195.stdout:3/663: mknod d4/d9/d2b/d87/db8/cd9 0 2024-04-06T12:23:10.826 INFO:tasks.workunit.client.1.smithi195.stdout:1/596: mkdir d4/d14/d17/d3a/da8/db8 0 2024-04-06T12:23:10.827 INFO:tasks.workunit.client.1.smithi195.stdout:5/660: dread d0/f6 [0,4194304] 0 2024-04-06T12:23:10.828 INFO:tasks.workunit.client.1.smithi195.stdout:9/635: dwrite d3/f64 [0,4194304] 0 2024-04-06T12:23:10.829 INFO:tasks.workunit.client.1.smithi195.stdout:7/475: dwrite d4/d16/fe [0,4194304] 0 2024-04-06T12:23:10.831 INFO:tasks.workunit.client.1.smithi195.stdout:3/664: fsync d4/df/d39/f8a 0 2024-04-06T12:23:10.836 INFO:tasks.workunit.client.1.smithi195.stdout:4/541: mkdir d4/d6d/da6 0 2024-04-06T12:23:10.836 INFO:tasks.workunit.client.1.smithi195.stdout:6/649: write d8/d21/d2b/d46/d44/d86/fbf [1677585,38097] 0 2024-04-06T12:23:10.837 INFO:tasks.workunit.client.1.smithi195.stdout:1/597: unlink d4/d14/d17/d24/d99/f1b 0 2024-04-06T12:23:10.838 INFO:tasks.workunit.client.1.smithi195.stdout:5/661: symlink d0/le7 0 2024-04-06T12:23:10.840 INFO:tasks.workunit.client.1.smithi195.stdout:7/476: creat d4/d16/dd/d22/d3f/f99 x:0 0 0 2024-04-06T12:23:10.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/636: mkdir d3/d10/d7d/dd0 0 2024-04-06T12:23:10.844 INFO:tasks.workunit.client.1.smithi195.stdout:1/598: dread - d4/d14/d17/d3a/f95 zero size 2024-04-06T12:23:10.844 INFO:tasks.workunit.client.1.smithi195.stdout:4/542: write d4/d3e/f78 [1295599,3761] 0 2024-04-06T12:23:10.846 INFO:tasks.workunit.client.1.smithi195.stdout:7/477: chown d4/d10/d12/d6f/f98 58720103 1 2024-04-06T12:23:10.847 INFO:tasks.workunit.client.1.smithi195.stdout:2/633: dwrite d2/d14/f18 [4194304,4194304] 0 2024-04-06T12:23:10.848 INFO:tasks.workunit.client.1.smithi195.stdout:8/618: dwrite d6/dd/f14 [0,4194304] 0 2024-04-06T12:23:10.848 INFO:tasks.workunit.client.1.smithi195.stdout:0/604: sync 2024-04-06T12:23:10.850 INFO:tasks.workunit.client.1.smithi195.stdout:9/637: symlink d3/ld1 0 2024-04-06T12:23:10.852 INFO:tasks.workunit.client.1.smithi195.stdout:4/543: readlink d4/d6/d38/d1a/d40/l4d 0 2024-04-06T12:23:10.854 INFO:tasks.workunit.client.1.smithi195.stdout:1/599: creat d4/d14/d17/fb9 x:0 0 0 2024-04-06T12:23:10.856 INFO:tasks.workunit.client.1.smithi195.stdout:7/478: dread d4/d10/d12/d6f/f98 [0,4194304] 0 2024-04-06T12:23:10.857 INFO:tasks.workunit.client.1.smithi195.stdout:0/605: mknod d4/d53/d81/cc7 0 2024-04-06T12:23:10.858 INFO:tasks.workunit.client.1.smithi195.stdout:9/638: rmdir d3/db9 39 2024-04-06T12:23:10.859 INFO:tasks.workunit.client.1.smithi195.stdout:1/600: write d4/d14/d17/f8c [1518863,109610] 0 2024-04-06T12:23:10.859 INFO:tasks.workunit.client.1.smithi195.stdout:2/634: symlink d2/d21/d29/lc3 0 2024-04-06T12:23:10.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/479: write d4/d16/f73 [524467,108771] 0 2024-04-06T12:23:10.861 INFO:tasks.workunit.client.1.smithi195.stdout:5/662: dwrite d0/da/d13/d87/d34/f4d [0,4194304] 0 2024-04-06T12:23:10.865 INFO:tasks.workunit.client.1.smithi195.stdout:8/619: mknod d6/dd/d70/d24/d34/d67/da1/da2/dc6/cd5 0 2024-04-06T12:23:10.865 INFO:tasks.workunit.client.1.smithi195.stdout:9/639: chown d3/d10/d3b/d48/d9c/f75 1 1 2024-04-06T12:23:10.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/606: chown d4/d6/c19 926671275 1 2024-04-06T12:23:10.865 INFO:tasks.workunit.client.1.smithi195.stdout:3/665: dread d4/d9/d2b/f36 [0,4194304] 0 2024-04-06T12:23:10.866 INFO:tasks.workunit.client.1.smithi195.stdout:2/635: creat d2/d41/d5a/fc4 x:0 0 0 2024-04-06T12:23:10.868 INFO:tasks.workunit.client.1.smithi195.stdout:5/663: fsync d0/da/d23/d38/f60 0 2024-04-06T12:23:10.868 INFO:tasks.workunit.client.1.smithi195.stdout:1/601: write d4/d14/d17/d24/d99/f84 [423352,70447] 0 2024-04-06T12:23:10.868 INFO:tasks.workunit.client.1.smithi195.stdout:7/480: symlink d4/d16/dd/l9a 0 2024-04-06T12:23:10.870 INFO:tasks.workunit.client.1.smithi195.stdout:0/607: creat d4/fc8 x:0 0 0 2024-04-06T12:23:10.872 INFO:tasks.workunit.client.1.smithi195.stdout:8/620: creat d6/dd/d42/fd6 x:0 0 0 2024-04-06T12:23:10.873 INFO:tasks.workunit.client.1.smithi195.stdout:0/608: fsync d4/d48/d67/d83/fab 0 2024-04-06T12:23:10.874 INFO:tasks.workunit.client.1.smithi195.stdout:4/544: dwrite d4/d6/d38/d65/d7a/f7c [0,4194304] 0 2024-04-06T12:23:10.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/602: mknod d4/cba 0 2024-04-06T12:23:10.876 INFO:tasks.workunit.client.1.smithi195.stdout:7/481: symlink d4/d10/d18/d33/l9b 0 2024-04-06T12:23:10.881 INFO:tasks.workunit.client.1.smithi195.stdout:9/640: dread d3/f64 [0,4194304] 0 2024-04-06T12:23:10.885 INFO:tasks.workunit.client.1.smithi195.stdout:0/609: chown d4/d6/d1a/f86 14 1 2024-04-06T12:23:10.885 INFO:tasks.workunit.client.1.smithi195.stdout:5/664: link d0/da/d23/d38/fc3 d0/da/d23/dd4/dc2/fe8 0 2024-04-06T12:23:10.886 INFO:tasks.workunit.client.1.smithi195.stdout:2/636: getdents d2/d41/d5a 0 2024-04-06T12:23:10.889 INFO:tasks.workunit.client.1.smithi195.stdout:1/603: unlink d4/d14/f3d 0 2024-04-06T12:23:10.889 INFO:tasks.workunit.client.1.smithi195.stdout:0/610: write d4/d6/d1a/f34 [2235524,12953] 0 2024-04-06T12:23:10.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/545: mkdir d4/d6/d38/d1a/da7 0 2024-04-06T12:23:10.889 INFO:tasks.workunit.client.1.smithi195.stdout:2/637: write d2/f1e [5151860,90176] 0 2024-04-06T12:23:10.891 INFO:tasks.workunit.client.1.smithi195.stdout:9/641: rename d3/d10/d3b/d48/d5e/l76 to d3/d10/d7d/dd0/ld2 0 2024-04-06T12:23:10.891 INFO:tasks.workunit.client.1.smithi195.stdout:2/638: readlink d2/d21/d2c/l37 0 2024-04-06T12:23:10.892 INFO:tasks.workunit.client.1.smithi195.stdout:8/621: write d6/dd/d70/d24/d34/f57 [4068889,119227] 0 2024-04-06T12:23:10.894 INFO:tasks.workunit.client.1.smithi195.stdout:8/622: write d6/dd/d70/d24/f32 [3324856,121792] 0 2024-04-06T12:23:10.897 INFO:tasks.workunit.client.1.smithi195.stdout:0/611: dread - d4/d6/d58/f63 zero size 2024-04-06T12:23:10.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/604: stat d4/d14/d17/d24/d2a/d5a/daa 0 2024-04-06T12:23:10.902 INFO:tasks.workunit.client.1.smithi195.stdout:0/612: chown d4/d6/d58/f8b 41 1 2024-04-06T12:23:10.903 INFO:tasks.workunit.client.1.smithi195.stdout:5/665: write d0/da/d23/d38/f60 [399442,127016] 0 2024-04-06T12:23:10.905 INFO:tasks.workunit.client.1.smithi195.stdout:7/482: dread d4/d16/dd/f28 [0,4194304] 0 2024-04-06T12:23:10.905 INFO:tasks.workunit.client.1.smithi195.stdout:4/546: dwrite d4/d6/d38/d1a/d40/d20/f8a [0,4194304] 0 2024-04-06T12:23:10.907 INFO:tasks.workunit.client.1.smithi195.stdout:0/613: rename d4/d6/d58/f63 to d4/d53/fc9 0 2024-04-06T12:23:10.910 INFO:tasks.workunit.client.1.smithi195.stdout:9/642: truncate d3/da1/fae 621009 0 2024-04-06T12:23:10.910 INFO:tasks.workunit.client.1.smithi195.stdout:8/623: getdents d6/db/d47/d4b 0 2024-04-06T12:23:10.910 INFO:tasks.workunit.client.1.smithi195.stdout:9/643: chown d3/dc6 58655982 1 2024-04-06T12:23:10.911 INFO:tasks.workunit.client.1.smithi195.stdout:7/483: creat d4/d24/d80/f9c x:0 0 0 2024-04-06T12:23:10.914 INFO:tasks.workunit.client.1.smithi195.stdout:8/624: chown d6/d8/d12/c6e 1658227 1 2024-04-06T12:23:10.914 INFO:tasks.workunit.client.1.smithi195.stdout:4/547: rename d4/c43 to d4/d6/d38/d65/d7a/ca8 0 2024-04-06T12:23:10.915 INFO:tasks.workunit.client.1.smithi195.stdout:7/484: write d4/d10/f27 [4551538,23205] 0 2024-04-06T12:23:10.915 INFO:tasks.workunit.client.1.smithi195.stdout:1/605: dwrite d4/d14/d17/f8c [0,4194304] 0 2024-04-06T12:23:10.917 INFO:tasks.workunit.client.1.smithi195.stdout:0/614: creat d4/d48/d77/d97/fca x:0 0 0 2024-04-06T12:23:10.919 INFO:tasks.workunit.client.1.smithi195.stdout:2/639: dread d2/d3f/f42 [0,4194304] 0 2024-04-06T12:23:10.921 INFO:tasks.workunit.client.1.smithi195.stdout:0/615: truncate d4/f4d 4423052 0 2024-04-06T12:23:10.923 INFO:tasks.workunit.client.1.smithi195.stdout:1/606: creat d4/d14/d17/d24/fbb x:0 0 0 2024-04-06T12:23:10.924 INFO:tasks.workunit.client.1.smithi195.stdout:5/666: dread d0/da/dd/f3b [0,4194304] 0 2024-04-06T12:23:10.925 INFO:tasks.workunit.client.1.smithi195.stdout:4/548: write d4/d8c/d96/f97 [432026,76280] 0 2024-04-06T12:23:10.929 INFO:tasks.workunit.client.1.smithi195.stdout:0/616: symlink d4/d53/lcb 0 2024-04-06T12:23:10.932 INFO:tasks.workunit.client.1.smithi195.stdout:0/617: readlink d4/d53/lbd 0 2024-04-06T12:23:10.932 INFO:tasks.workunit.client.1.smithi195.stdout:7/485: dread d4/d16/d11/f59 [0,4194304] 0 2024-04-06T12:23:10.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/486: chown d4/d24/f1f 585905 1 2024-04-06T12:23:10.935 INFO:tasks.workunit.client.1.smithi195.stdout:1/607: unlink d4/d14/d17/d24/d99/d4e/d71/l73 0 2024-04-06T12:23:10.937 INFO:tasks.workunit.client.1.smithi195.stdout:9/644: truncate d3/f43 3907477 0 2024-04-06T12:23:10.939 INFO:tasks.workunit.client.1.smithi195.stdout:5/667: dread d0/da/dd/d1c/d5a/d62/d64/d67/db9/fcf [0,4194304] 0 2024-04-06T12:23:10.940 INFO:tasks.workunit.client.1.smithi195.stdout:4/549: dwrite d4/d3e/f94 [0,4194304] 0 2024-04-06T12:23:10.940 INFO:tasks.workunit.client.1.smithi195.stdout:8/625: dread d6/f31 [0,4194304] 0 2024-04-06T12:23:10.941 INFO:tasks.workunit.client.1.smithi195.stdout:6/650: sync 2024-04-06T12:23:10.941 INFO:tasks.workunit.client.1.smithi195.stdout:2/640: getdents d2/d41/d84/d8d 0 2024-04-06T12:23:10.942 INFO:tasks.workunit.client.1.smithi195.stdout:5/668: write d0/da/f22 [5040239,108518] 0 2024-04-06T12:23:10.942 INFO:tasks.workunit.client.1.smithi195.stdout:7/487: unlink d4/d24/c4f 0 2024-04-06T12:23:10.944 INFO:tasks.workunit.client.1.smithi195.stdout:5/669: fsync d0/da/d13/d87/f57 0 2024-04-06T12:23:10.944 INFO:tasks.workunit.client.1.smithi195.stdout:7/488: chown d4/d10/d18/d7e/l86 31143012 1 2024-04-06T12:23:10.945 INFO:tasks.workunit.client.1.smithi195.stdout:1/608: unlink d4/d14/d17/f30 0 2024-04-06T12:23:10.949 INFO:tasks.workunit.client.1.smithi195.stdout:0/618: fdatasync d4/d6/f27 0 2024-04-06T12:23:10.954 INFO:tasks.workunit.client.1.smithi195.stdout:6/651: creat d8/d3d/d3f/ff8 x:0 0 0 2024-04-06T12:23:10.955 INFO:tasks.workunit.client.1.smithi195.stdout:2/641: rename d2/ld to d2/d41/d84/db2/lc5 0 2024-04-06T12:23:10.957 INFO:tasks.workunit.client.1.smithi195.stdout:0/619: dwrite d4/d48/d77/f85 [0,4194304] 0 2024-04-06T12:23:10.957 INFO:tasks.workunit.client.1.smithi195.stdout:5/670: creat d0/da/dd/d2e/d6f/dab/fe9 x:0 0 0 2024-04-06T12:23:10.958 INFO:tasks.workunit.client.1.smithi195.stdout:7/489: creat d4/d16/dd/d22/d3f/d54/f9d x:0 0 0 2024-04-06T12:23:10.959 INFO:tasks.workunit.client.1.smithi195.stdout:9/645: mkdir d3/dd3 0 2024-04-06T12:23:10.961 INFO:tasks.workunit.client.1.smithi195.stdout:9/646: chown d3/d10/d3b/d48/d5e 1 1 2024-04-06T12:23:10.962 INFO:tasks.workunit.client.1.smithi195.stdout:4/550: fsync d4/f5 0 2024-04-06T12:23:10.964 INFO:tasks.workunit.client.1.smithi195.stdout:0/620: dwrite d4/f21 [0,4194304] 0 2024-04-06T12:23:10.965 INFO:tasks.workunit.client.1.smithi195.stdout:0/621: stat d4/d48/d77/d97/la5 0 2024-04-06T12:23:10.966 INFO:tasks.workunit.client.1.smithi195.stdout:8/626: rename d6/dd/dd3 to d6/dd/d70/d24/d34/d67/d9d/dd7 0 2024-04-06T12:23:10.967 INFO:tasks.workunit.client.1.smithi195.stdout:8/627: read d6/d8/d12/d61/f81 [160031,112479] 0 2024-04-06T12:23:10.969 INFO:tasks.workunit.client.1.smithi195.stdout:5/671: rmdir d0/da/dd/d1c/d5a/d62/db8 39 2024-04-06T12:23:10.974 INFO:tasks.workunit.client.1.smithi195.stdout:4/551: read d4/f4a [725370,107583] 0 2024-04-06T12:23:10.976 INFO:tasks.workunit.client.1.smithi195.stdout:0/622: unlink d4/f61 0 2024-04-06T12:23:10.983 INFO:tasks.workunit.client.1.smithi195.stdout:4/552: mknod d4/d6d/d85/ca9 0 2024-04-06T12:23:10.984 INFO:tasks.workunit.client.1.smithi195.stdout:0/623: dwrite d4/d41/f71 [0,4194304] 0 2024-04-06T12:23:10.984 INFO:tasks.workunit.client.1.smithi195.stdout:3/666: sync 2024-04-06T12:23:10.985 INFO:tasks.workunit.client.1.smithi195.stdout:2/642: creat d2/d21/fc6 x:0 0 0 2024-04-06T12:23:10.985 INFO:tasks.workunit.client.1.smithi195.stdout:7/490: write d4/d16/dd/f28 [3994383,70694] 0 2024-04-06T12:23:10.986 INFO:tasks.workunit.client.1.smithi195.stdout:8/628: symlink d6/db/d47/ld8 0 2024-04-06T12:23:10.987 INFO:tasks.workunit.client.1.smithi195.stdout:5/672: mknod d0/da/dd/d1c/d5a/d68/dd7/cea 0 2024-04-06T12:23:10.988 INFO:tasks.workunit.client.1.smithi195.stdout:6/652: dwrite d8/d50/d32/f3a [0,4194304] 0 2024-04-06T12:23:10.989 INFO:tasks.workunit.client.1.smithi195.stdout:3/667: chown d4/d9/f68 3 1 2024-04-06T12:23:10.990 INFO:tasks.workunit.client.1.smithi195.stdout:1/609: rename d4/d14/d17/d24/d99/d4e/d57/fb0 to d4/d14/d17/d24/d2a/fbc 0 2024-04-06T12:23:10.990 INFO:tasks.workunit.client.1.smithi195.stdout:7/491: chown d4/d16/dd/d22/f2b 96616606 1 2024-04-06T12:23:10.991 INFO:tasks.workunit.client.1.smithi195.stdout:5/673: chown d0/da/d4b/cbf 180383 1 2024-04-06T12:23:10.991 INFO:tasks.workunit.client.1.smithi195.stdout:8/629: chown d6/db/d47/l5c 892567075 1 2024-04-06T12:23:10.992 INFO:tasks.workunit.client.1.smithi195.stdout:6/653: read - d8/d21/d31/d6c/ded/ff3 zero size 2024-04-06T12:23:10.993 INFO:tasks.workunit.client.1.smithi195.stdout:5/674: fsync d0/da/f3c 0 2024-04-06T12:23:10.994 INFO:tasks.workunit.client.1.smithi195.stdout:0/624: symlink d4/d6/d2f/lcc 0 2024-04-06T12:23:10.998 INFO:tasks.workunit.client.1.smithi195.stdout:9/647: getdents d3/d10/d3b/d48 0 2024-04-06T12:23:10.999 INFO:tasks.workunit.client.1.smithi195.stdout:3/668: creat d4/d53/fda x:0 0 0 2024-04-06T12:23:10.999 INFO:tasks.workunit.client.1.smithi195.stdout:5/675: readlink d0/da/d13/d87/l7b 0 2024-04-06T12:23:10.999 INFO:tasks.workunit.client.1.smithi195.stdout:7/492: creat d4/d10/d18/d19/f9e x:0 0 0 2024-04-06T12:23:11.000 INFO:tasks.workunit.client.1.smithi195.stdout:7/493: truncate d4/d16/dd/d22/d76/f8f 12330 0 2024-04-06T12:23:11.000 INFO:tasks.workunit.client.1.smithi195.stdout:0/625: symlink d4/d48/d67/d75/lcd 0 2024-04-06T12:23:11.001 INFO:tasks.workunit.client.1.smithi195.stdout:9/648: mknod d3/dc6/cd4 0 2024-04-06T12:23:11.004 INFO:tasks.workunit.client.1.smithi195.stdout:3/669: creat d4/de/d8e/d92/d9e/fdb x:0 0 0 2024-04-06T12:23:11.005 INFO:tasks.workunit.client.1.smithi195.stdout:8/630: creat d6/d3a/d46/db2/fd9 x:0 0 0 2024-04-06T12:23:11.006 INFO:tasks.workunit.client.1.smithi195.stdout:8/631: dread - d6/d8/d12/d61/fac zero size 2024-04-06T12:23:11.008 INFO:tasks.workunit.client.1.smithi195.stdout:7/494: rmdir d4/d10/d12 39 2024-04-06T12:23:11.017 INFO:tasks.workunit.client.1.smithi195.stdout:9/649: fsync d3/d10/d3b/d48/f4b 0 2024-04-06T12:23:11.018 INFO:tasks.workunit.client.1.smithi195.stdout:2/643: getdents d2/d21/d2c 0 2024-04-06T12:23:11.018 INFO:tasks.workunit.client.1.smithi195.stdout:5/676: write d0/da/d13/f15 [693506,123767] 0 2024-04-06T12:23:11.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/632: unlink d6/f7 0 2024-04-06T12:23:11.018 INFO:tasks.workunit.client.1.smithi195.stdout:4/553: dread d4/d6/d38/f39 [0,4194304] 0 2024-04-06T12:23:11.019 INFO:tasks.workunit.client.1.smithi195.stdout:6/654: rename d8/f23 to d8/d21/d31/d6c/ff9 0 2024-04-06T12:23:11.023 INFO:tasks.workunit.client.1.smithi195.stdout:8/633: read d6/dd/d42/fcd [3756637,71940] 0 2024-04-06T12:23:11.023 INFO:tasks.workunit.client.1.smithi195.stdout:1/610: dread d4/d14/d17/d3a/da8/da4/db2/f48 [0,4194304] 0 2024-04-06T12:23:11.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:09.574027+0000 mgr.smithi195.ausetj (mgr.24375) 55 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 41 MiB/s rd, 175 MiB/s wr, 390 op/s 2024-04-06T12:23:11.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:09.574027+0000 mgr.smithi195.ausetj (mgr.24375) 55 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 41 MiB/s rd, 175 MiB/s wr, 390 op/s 2024-04-06T12:23:11.051 INFO:tasks.workunit.client.1.smithi195.stdout:0/626: rmdir d4/d48/d77/d97/db7 39 2024-04-06T12:23:11.051 INFO:tasks.workunit.client.1.smithi195.stdout:9/650: rmdir d3/d10/d4f 39 2024-04-06T12:23:11.052 INFO:tasks.workunit.client.1.smithi195.stdout:5/677: creat d0/da/d23/d7a/feb x:0 0 0 2024-04-06T12:23:11.053 INFO:tasks.workunit.client.1.smithi195.stdout:7/495: dwrite d4/d10/d18/d19/f9e [0,4194304] 0 2024-04-06T12:23:11.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/554: write d4/d6/d38/d65/fa3 [1146686,100197] 0 2024-04-06T12:23:11.059 INFO:tasks.workunit.client.1.smithi195.stdout:9/651: truncate d3/d10/d3a/f60 1052231 0 2024-04-06T12:23:11.065 INFO:tasks.workunit.client.1.smithi195.stdout:6/655: stat d8/d3d/d5e/dd3 0 2024-04-06T12:23:11.065 INFO:tasks.workunit.client.1.smithi195.stdout:7/496: truncate d4/d10/d18/d57/f7f 353171 0 2024-04-06T12:23:11.067 INFO:tasks.workunit.client.1.smithi195.stdout:3/670: dread d4/f69 [0,4194304] 0 2024-04-06T12:23:11.069 INFO:tasks.workunit.client.1.smithi195.stdout:4/555: creat d4/faa x:0 0 0 2024-04-06T12:23:11.069 INFO:tasks.workunit.client.1.smithi195.stdout:8/634: dwrite d6/dd/d70/d24/d34/d67/f88 [0,4194304] 0 2024-04-06T12:23:11.069 INFO:tasks.workunit.client.1.smithi195.stdout:9/652: read d3/d10/d3b/d48/d5e/f82 [189709,109669] 0 2024-04-06T12:23:11.072 INFO:tasks.workunit.client.1.smithi195.stdout:6/656: creat d8/d3d/d5e/ffa x:0 0 0 2024-04-06T12:23:11.072 INFO:tasks.workunit.client.1.smithi195.stdout:1/611: dwrite d4/d14/d17/d24/d99/d4e/d60/f7a [4194304,4194304] 0 2024-04-06T12:23:11.073 INFO:tasks.workunit.client.1.smithi195.stdout:5/678: dwrite d0/da/d13/d87/f3f [0,4194304] 0 2024-04-06T12:23:11.074 INFO:tasks.workunit.client.1.smithi195.stdout:3/671: chown d4/df/d39/f8a 1 1 2024-04-06T12:23:11.074 INFO:tasks.workunit.client.1.smithi195.stdout:4/556: creat d4/d6/fab x:0 0 0 2024-04-06T12:23:11.075 INFO:tasks.workunit.client.1.smithi195.stdout:6/657: stat d8/d3d/f81 0 2024-04-06T12:23:11.076 INFO:tasks.workunit.client.1.smithi195.stdout:6/658: readlink d8/d3d/d5e/la8 0 2024-04-06T12:23:11.076 INFO:tasks.workunit.client.1.smithi195.stdout:7/497: write d4/d10/d12/d6f/f98 [1289729,11273] 0 2024-04-06T12:23:11.077 INFO:tasks.workunit.client.1.smithi195.stdout:8/635: mkdir d6/d8/daa/dda 0 2024-04-06T12:23:11.082 INFO:tasks.workunit.client.1.smithi195.stdout:1/612: rmdir d4/d14/d17/d24/d99/d4e/d57 39 2024-04-06T12:23:11.082 INFO:tasks.workunit.client.1.smithi195.stdout:8/636: write d6/db/d47/f77 [193081,66421] 0 2024-04-06T12:23:11.083 INFO:tasks.workunit.client.1.smithi195.stdout:6/659: symlink d8/d21/d31/lfb 0 2024-04-06T12:23:11.086 INFO:tasks.workunit.client.1.smithi195.stdout:3/672: creat d4/de/d8e/d92/fdc x:0 0 0 2024-04-06T12:23:11.086 INFO:tasks.workunit.client.1.smithi195.stdout:1/613: readlink d4/d14/d17/d24/d99/d88/l8b 0 2024-04-06T12:23:11.087 INFO:tasks.workunit.client.1.smithi195.stdout:3/673: chown d4/d9/d37/f7d 699199 1 2024-04-06T12:23:11.089 INFO:tasks.workunit.client.1.smithi195.stdout:3/674: dread - d4/de/d8e/d92/fdc zero size 2024-04-06T12:23:11.090 INFO:tasks.workunit.client.1.smithi195.stdout:1/614: mknod d4/d14/d17/d3a/da8/da4/db2/d5d/cbd 0 2024-04-06T12:23:11.091 INFO:tasks.workunit.client.1.smithi195.stdout:7/498: rename d4/d10/d18/d57/c75 to d4/d10/d18/d19/d63/c9f 0 2024-04-06T12:23:11.092 INFO:tasks.workunit.client.1.smithi195.stdout:8/637: mkdir d6/d8/daa/dda/ddb 0 2024-04-06T12:23:11.092 INFO:tasks.workunit.client.1.smithi195.stdout:7/499: read - d4/d10/d18/d19/f50 zero size 2024-04-06T12:23:11.093 INFO:tasks.workunit.client.1.smithi195.stdout:5/679: getdents d0/da/dd/d1c/d5a/d62/d64 0 2024-04-06T12:23:11.093 INFO:tasks.workunit.client.1.smithi195.stdout:3/675: mknod d4/d9/cdd 0 2024-04-06T12:23:11.095 INFO:tasks.workunit.client.1.smithi195.stdout:4/557: getdents d4/d6/d38 0 2024-04-06T12:23:11.095 INFO:tasks.workunit.client.1.smithi195.stdout:5/680: mknod d0/da/d4b/d4e/cec 0 2024-04-06T12:23:11.097 INFO:tasks.workunit.client.1.smithi195.stdout:6/660: link d8/d50/d32/f3a d8/d21/d31/ffc 0 2024-04-06T12:23:11.097 INFO:tasks.workunit.client.1.smithi195.stdout:7/500: mkdir d4/d10/d18/da0 0 2024-04-06T12:23:11.098 INFO:tasks.workunit.client.1.smithi195.stdout:4/558: rmdir d4/d6/d38/d65/d7a 39 2024-04-06T12:23:11.099 INFO:tasks.workunit.client.1.smithi195.stdout:5/681: creat d0/da/d4b/fed x:0 0 0 2024-04-06T12:23:11.101 INFO:tasks.workunit.client.1.smithi195.stdout:4/559: creat d4/d3e/fac x:0 0 0 2024-04-06T12:23:11.102 INFO:tasks.workunit.client.1.smithi195.stdout:3/676: link d4/de/c1c d4/df/cde 0 2024-04-06T12:23:11.103 INFO:tasks.workunit.client.1.smithi195.stdout:5/682: symlink d0/da/dd/d2e/d6f/dab/lee 0 2024-04-06T12:23:11.105 INFO:tasks.workunit.client.1.smithi195.stdout:3/677: creat d4/d9/d2b/d3b/d5e/d7e/fdf x:0 0 0 2024-04-06T12:23:11.106 INFO:tasks.workunit.client.1.smithi195.stdout:6/661: getdents d8/d21/d31/d6c/ded 0 2024-04-06T12:23:11.110 INFO:tasks.workunit.client.1.smithi195.stdout:5/683: dwrite d0/da/dd/fe0 [0,4194304] 0 2024-04-06T12:23:11.110 INFO:tasks.workunit.client.1.smithi195.stdout:6/662: mkdir d8/d50/d82/dfd 0 2024-04-06T12:23:11.112 INFO:tasks.workunit.client.1.smithi195.stdout:3/678: mknod d4/d9/d2b/d3b/ce0 0 2024-04-06T12:23:11.115 INFO:tasks.workunit.client.1.smithi195.stdout:5/684: rmdir d0/da/d23/dd4 39 2024-04-06T12:23:11.118 INFO:tasks.workunit.client.1.smithi195.stdout:6/663: rename d8/d3d/d3f to d8/d3d/d5e/dd3/dfe 0 2024-04-06T12:23:11.118 INFO:tasks.workunit.client.1.smithi195.stdout:6/664: chown d8/d21/d2b/fc9 1991 1 2024-04-06T12:23:11.119 INFO:tasks.workunit.client.1.smithi195.stdout:3/679: write d4/d9/fb0 [2104539,74155] 0 2024-04-06T12:23:11.120 INFO:tasks.workunit.client.1.smithi195.stdout:4/560: link d4/d6/d38/d65/d7a/l81 d4/lad 0 2024-04-06T12:23:11.120 INFO:tasks.workunit.client.1.smithi195.stdout:3/680: dread - d4/d53/fda zero size 2024-04-06T12:23:11.121 INFO:tasks.workunit.client.1.smithi195.stdout:4/561: dread - d4/f9f zero size 2024-04-06T12:23:11.121 INFO:tasks.workunit.client.1.smithi195.stdout:3/681: fdatasync d4/df/d39/f8a 0 2024-04-06T12:23:11.124 INFO:tasks.workunit.client.1.smithi195.stdout:5/685: mknod d0/da/d23/dd4/dc2/cef 0 2024-04-06T12:23:11.126 INFO:tasks.workunit.client.1.smithi195.stdout:6/665: stat d8/d21/d31/d26/dc8/d4e/lc0 0 2024-04-06T12:23:11.126 INFO:tasks.workunit.client.1.smithi195.stdout:4/562: truncate d4/d6/d38/d1a/d40/d57/fa2 4787843 0 2024-04-06T12:23:11.131 INFO:tasks.workunit.client.1.smithi195.stdout:7/501: dwrite d4/f20 [0,4194304] 0 2024-04-06T12:23:11.131 INFO:tasks.workunit.client.1.smithi195.stdout:7/502: write d4/d10/d12/f2e [1161102,40186] 0 2024-04-06T12:23:11.133 INFO:tasks.workunit.client.1.smithi195.stdout:5/686: write d0/da/d23/d38/fc3 [661941,34102] 0 2024-04-06T12:23:11.134 INFO:tasks.workunit.client.1.smithi195.stdout:4/563: mkdir d4/d6d/da6/dae 0 2024-04-06T12:23:11.134 INFO:tasks.workunit.client.1.smithi195.stdout:5/687: chown d0/da/f3c 196 1 2024-04-06T12:23:11.136 INFO:tasks.workunit.client.1.smithi195.stdout:5/688: readlink d0/da/dd/d2e/d6f/d58/l73 0 2024-04-06T12:23:11.142 INFO:tasks.workunit.client.1.smithi195.stdout:4/564: link d4/d6/d38/d1a/d40/l4d d4/d6/d38/d1a/d40/d20/laf 0 2024-04-06T12:23:11.142 INFO:tasks.workunit.client.1.smithi195.stdout:6/666: dread d8/d21/d2b/f62 [0,4194304] 0 2024-04-06T12:23:11.144 INFO:tasks.workunit.client.1.smithi195.stdout:5/689: dwrite d0/da/d23/f45 [0,4194304] 0 2024-04-06T12:23:11.146 INFO:tasks.workunit.client.1.smithi195.stdout:5/690: write d0/da/d23/dd4/fa6 [3548720,87918] 0 2024-04-06T12:23:11.146 INFO:tasks.workunit.client.1.smithi195.stdout:4/565: symlink d4/d6/d38/d1a/d40/d57/lb0 0 2024-04-06T12:23:11.148 INFO:tasks.workunit.client.1.smithi195.stdout:5/691: readlink d0/da/dd/d1c/d5a/ld2 0 2024-04-06T12:23:11.149 INFO:tasks.workunit.client.1.smithi195.stdout:6/667: rename d8/d21/d31/d6c/f7c to d8/d21/d2b/d46/d44/d86/fff 0 2024-04-06T12:23:11.151 INFO:tasks.workunit.client.1.smithi195.stdout:5/692: truncate d0/da/d23/d38/fdf 393405 0 2024-04-06T12:23:11.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/693: stat d0/da/dd/c2b 0 2024-04-06T12:23:11.153 INFO:tasks.workunit.client.1.smithi195.stdout:3/682: dread d4/df/d39/fd0 [0,4194304] 0 2024-04-06T12:23:11.155 INFO:tasks.workunit.client.1.smithi195.stdout:5/694: write d0/d35/f6b [8182987,74326] 0 2024-04-06T12:23:11.156 INFO:tasks.workunit.client.1.smithi195.stdout:3/683: write d4/df/f8f [462393,72901] 0 2024-04-06T12:23:11.158 INFO:tasks.workunit.client.1.smithi195.stdout:5/695: write d0/da/dd/d1c/d5a/d62/fa9 [485717,118982] 0 2024-04-06T12:23:11.158 INFO:tasks.workunit.client.1.smithi195.stdout:7/503: dread d4/d16/f47 [0,4194304] 0 2024-04-06T12:23:11.159 INFO:tasks.workunit.client.1.smithi195.stdout:3/684: write d4/d9/d2b/d3b/d5e/d7e/fce [250782,1347] 0 2024-04-06T12:23:11.161 INFO:tasks.workunit.client.1.smithi195.stdout:2/644: sync 2024-04-06T12:23:11.162 INFO:tasks.workunit.client.1.smithi195.stdout:5/696: symlink d0/d52/lf0 0 2024-04-06T12:23:11.165 INFO:tasks.workunit.client.1.smithi195.stdout:5/697: symlink d0/d35/lf1 0 2024-04-06T12:23:11.166 INFO:tasks.workunit.client.1.smithi195.stdout:7/504: link d4/d10/d12/d6f/c87 d4/d5d/d82/ca1 0 2024-04-06T12:23:11.168 INFO:tasks.workunit.client.1.smithi195.stdout:4/566: dwrite d4/f12 [0,4194304] 0 2024-04-06T12:23:11.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/668: dwrite d8/d50/d32/f3a [4194304,4194304] 0 2024-04-06T12:23:11.170 INFO:tasks.workunit.client.1.smithi195.stdout:2/645: rename d2/d21/d29/c70 to d2/d21/d2c/d2d/d92/d95/cc7 0 2024-04-06T12:23:11.174 INFO:tasks.workunit.client.1.smithi195.stdout:4/567: mknod d4/d6/cb1 0 2024-04-06T12:23:11.174 INFO:tasks.workunit.client.1.smithi195.stdout:7/505: creat d4/d10/d18/d7e/fa2 x:0 0 0 2024-04-06T12:23:11.176 INFO:tasks.workunit.client.1.smithi195.stdout:4/568: stat d4/d6/d38/d1a/d40/f41 0 2024-04-06T12:23:11.177 INFO:tasks.workunit.client.1.smithi195.stdout:7/506: mkdir d4/d10/d18/d7e/da3 0 2024-04-06T12:23:11.177 INFO:tasks.workunit.client.1.smithi195.stdout:5/698: getdents d0/da/dd/d1c/d5a/d62/d64/d9b 0 2024-04-06T12:23:11.178 INFO:tasks.workunit.client.1.smithi195.stdout:6/669: mknod d8/d21/d31/d49/c100 0 2024-04-06T12:23:11.179 INFO:tasks.workunit.client.1.smithi195.stdout:4/569: write d4/d8c/f99 [981259,75030] 0 2024-04-06T12:23:11.180 INFO:tasks.workunit.client.1.smithi195.stdout:7/507: chown d4/d5d/f3b 165806325 1 2024-04-06T12:23:11.181 INFO:tasks.workunit.client.1.smithi195.stdout:4/570: stat d4/d6/c69 0 2024-04-06T12:23:11.184 INFO:tasks.workunit.client.1.smithi195.stdout:6/670: creat d8/d21/d2b/d46/d44/d86/f101 x:0 0 0 2024-04-06T12:23:11.184 INFO:tasks.workunit.client.1.smithi195.stdout:7/508: chown d4/d10/d18/d19/f43 38942153 1 2024-04-06T12:23:11.184 INFO:tasks.workunit.client.1.smithi195.stdout:4/571: chown d4/d6/f9a 30531 1 2024-04-06T12:23:11.185 INFO:tasks.workunit.client.1.smithi195.stdout:5/699: truncate d0/da/fb 3392845 0 2024-04-06T12:23:11.185 INFO:tasks.workunit.client.1.smithi195.stdout:2/646: dwrite d2/d21/d2c/d2d/f30 [0,4194304] 0 2024-04-06T12:23:11.188 INFO:tasks.workunit.client.1.smithi195.stdout:5/700: chown d0/da/dd/d1c/d5a/d62/l48 154804 1 2024-04-06T12:23:11.189 INFO:tasks.workunit.client.1.smithi195.stdout:4/572: unlink d4/d6/c34 0 2024-04-06T12:23:11.193 INFO:tasks.workunit.client.1.smithi195.stdout:5/701: mknod d0/da/d23/cf2 0 2024-04-06T12:23:11.196 INFO:tasks.workunit.client.1.smithi195.stdout:4/573: creat d4/d6/d38/d1a/d40/d57/d64/fb2 x:0 0 0 2024-04-06T12:23:11.197 INFO:tasks.workunit.client.1.smithi195.stdout:5/702: chown d0/da/dd/c2b 10644 1 2024-04-06T12:23:11.198 INFO:tasks.workunit.client.1.smithi195.stdout:7/509: dwrite d4/d5d/f60 [0,4194304] 0 2024-04-06T12:23:11.198 INFO:tasks.workunit.client.1.smithi195.stdout:2/647: dwrite d2/d21/d2c/d2d/f5f [0,4194304] 0 2024-04-06T12:23:11.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/671: dread d8/f2a [0,4194304] 0 2024-04-06T12:23:11.202 INFO:tasks.workunit.client.1.smithi195.stdout:4/574: creat d4/d6d/da6/fb3 x:0 0 0 2024-04-06T12:23:11.205 INFO:tasks.workunit.client.1.smithi195.stdout:7/510: symlink d4/d24/d80/la4 0 2024-04-06T12:23:11.205 INFO:tasks.workunit.client.1.smithi195.stdout:2/648: mknod d2/d3f/d7d/d7a/cc8 0 2024-04-06T12:23:11.206 INFO:tasks.workunit.client.1.smithi195.stdout:5/703: chown d0/da/dd/d1c/f20 10174266 1 2024-04-06T12:23:11.206 INFO:tasks.workunit.client.1.smithi195.stdout:2/649: fdatasync d2/d41/d5a/fa8 0 2024-04-06T12:23:11.207 INFO:tasks.workunit.client.1.smithi195.stdout:4/575: creat d4/d6d/da6/dae/fb4 x:0 0 0 2024-04-06T12:23:11.210 INFO:tasks.workunit.client.1.smithi195.stdout:4/576: chown d4/d6d/d85/ca9 6425507 1 2024-04-06T12:23:11.212 INFO:tasks.workunit.client.1.smithi195.stdout:5/704: mkdir d0/da/dd/d2e/d6f/dab/df3 0 2024-04-06T12:23:11.212 INFO:tasks.workunit.client.1.smithi195.stdout:6/672: dwrite d8/d3d/d5e/ffa [0,4194304] 0 2024-04-06T12:23:11.216 INFO:tasks.workunit.client.1.smithi195.stdout:6/673: symlink d8/d21/d2b/d46/d2f/daf/l102 0 2024-04-06T12:23:11.218 INFO:tasks.workunit.client.1.smithi195.stdout:7/511: rename d4/d10/d18/d7e to d4/d10/d12/da5 0 2024-04-06T12:23:11.220 INFO:tasks.workunit.client.1.smithi195.stdout:7/512: readlink d4/d10/d18/d57/l6d 0 2024-04-06T12:23:11.220 INFO:tasks.workunit.client.1.smithi195.stdout:4/577: dwrite d4/d6/d38/f39 [0,4194304] 0 2024-04-06T12:23:11.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/674: link d8/d21/d2b/d46/d2f/f8b d8/d50/d82/dfd/f103 0 2024-04-06T12:23:11.225 INFO:tasks.workunit.client.1.smithi195.stdout:4/578: unlink d4/d6/d38/d65/l68 0 2024-04-06T12:23:11.226 INFO:tasks.workunit.client.1.smithi195.stdout:6/675: symlink d8/d50/d9c/l104 0 2024-04-06T12:23:11.227 INFO:tasks.workunit.client.1.smithi195.stdout:7/513: read d4/d10/d12/f70 [523029,22581] 0 2024-04-06T12:23:11.231 INFO:tasks.workunit.client.1.smithi195.stdout:6/676: fsync d8/d21/d2b/d46/d2f/f53 0 2024-04-06T12:23:11.235 INFO:tasks.workunit.client.1.smithi195.stdout:6/677: write d8/d21/d31/fbc [8355,20885] 0 2024-04-06T12:23:11.235 INFO:tasks.workunit.client.1.smithi195.stdout:7/514: getdents d4/d10/d18/d33/d6e 0 2024-04-06T12:23:11.236 INFO:tasks.workunit.client.1.smithi195.stdout:4/579: dwrite d4/d6/d38/d1a/d40/d57/d64/fb2 [0,4194304] 0 2024-04-06T12:23:11.239 INFO:tasks.workunit.client.1.smithi195.stdout:6/678: mkdir d8/d3d/dc1/d105 0 2024-04-06T12:23:11.246 INFO:tasks.workunit.client.1.smithi195.stdout:4/580: dwrite d4/d6/fab [0,4194304] 0 2024-04-06T12:23:11.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/679: dwrite d8/d3d/d5e/ffa [0,4194304] 0 2024-04-06T12:23:11.250 INFO:tasks.workunit.client.1.smithi195.stdout:2/650: dread d2/d21/d29/f3e [0,4194304] 0 2024-04-06T12:23:11.252 INFO:tasks.workunit.client.1.smithi195.stdout:4/581: stat d4/d6/d38/l2b 0 2024-04-06T12:23:11.254 INFO:tasks.workunit.client.1.smithi195.stdout:7/515: truncate d4/d10/d12/f2e 3399861 0 2024-04-06T12:23:11.255 INFO:tasks.workunit.client.1.smithi195.stdout:2/651: read d2/fb [1422685,43710] 0 2024-04-06T12:23:11.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/680: rename d8/d21/d31/l9b to d8/d21/d31/d26/dcf/de4/l106 0 2024-04-06T12:23:11.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/582: symlink d4/d8c/d96/lb5 0 2024-04-06T12:23:11.261 INFO:tasks.workunit.client.1.smithi195.stdout:7/516: unlink c2 0 2024-04-06T12:23:11.261 INFO:tasks.workunit.client.1.smithi195.stdout:2/652: dwrite d2/f61 [0,4194304] 0 2024-04-06T12:23:11.265 INFO:tasks.workunit.client.1.smithi195.stdout:6/681: rename d8/d21/d31/d26/ce6 to d8/d50/d82/c107 0 2024-04-06T12:23:11.266 INFO:tasks.workunit.client.1.smithi195.stdout:2/653: mkdir d2/d21/d2c/dc9 0 2024-04-06T12:23:11.268 INFO:tasks.workunit.client.1.smithi195.stdout:6/682: symlink d8/d3d/dc1/l108 0 2024-04-06T12:23:11.269 INFO:tasks.workunit.client.1.smithi195.stdout:4/583: creat d4/d6/d38/d1a/d40/fb6 x:0 0 0 2024-04-06T12:23:11.270 INFO:tasks.workunit.client.1.smithi195.stdout:6/683: stat d8/d50/d32/f3a 0 2024-04-06T12:23:11.270 INFO:tasks.workunit.client.1.smithi195.stdout:2/654: mknod d2/d21/d69/cca 0 2024-04-06T12:23:11.271 INFO:tasks.workunit.client.1.smithi195.stdout:7/517: dwrite d4/d16/f73 [0,4194304] 0 2024-04-06T12:23:11.272 INFO:tasks.workunit.client.1.smithi195.stdout:2/655: write d2/d14/f18 [87008,66182] 0 2024-04-06T12:23:11.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/518: chown d4/d5d/f77 20315 1 2024-04-06T12:23:11.273 INFO:tasks.workunit.client.1.smithi195.stdout:4/584: mknod d4/d6/d38/d65/cb7 0 2024-04-06T12:23:11.273 INFO:tasks.workunit.client.1.smithi195.stdout:2/656: dread - d2/d21/d29/f72 zero size 2024-04-06T12:23:11.274 INFO:tasks.workunit.client.1.smithi195.stdout:6/684: symlink d8/d21/d31/d26/dcf/de4/l109 0 2024-04-06T12:23:11.293 INFO:tasks.workunit.client.1.smithi195.stdout:0/627: sync 2024-04-06T12:23:11.315 INFO:tasks.workunit.client.1.smithi195.stdout:0/628: chown d4/l51 5772 1 2024-04-06T12:23:11.315 INFO:tasks.workunit.client.1.smithi195.stdout:6/685: dread - d8/d3d/d5e/d72/fc2 zero size 2024-04-06T12:23:11.316 INFO:tasks.workunit.client.1.smithi195.stdout:2/657: creat d2/d3f/fcb x:0 0 0 2024-04-06T12:23:11.317 INFO:tasks.workunit.client.1.smithi195.stdout:4/585: readlink d4/d6/d38/d1a/d40/d20/laf 0 2024-04-06T12:23:11.318 INFO:tasks.workunit.client.1.smithi195.stdout:0/629: truncate d4/d48/d77/d97/fac 501645 0 2024-04-06T12:23:11.321 INFO:tasks.workunit.client.1.smithi195.stdout:0/630: chown d4/d48/f5a 0 1 2024-04-06T12:23:11.323 INFO:tasks.workunit.client.1.smithi195.stdout:7/519: dwrite d4/d16/dd/d22/d3f/d54/f5f [0,4194304] 0 2024-04-06T12:23:11.324 INFO:tasks.workunit.client.1.smithi195.stdout:7/520: stat d4/d5d/f77 0 2024-04-06T12:23:11.325 INFO:tasks.workunit.client.1.smithi195.stdout:6/686: link d8/d21/d31/d26/dc8/d4e/f6e d8/d3d/d5e/dd3/dfe/f10a 0 2024-04-06T12:23:11.327 INFO:tasks.workunit.client.1.smithi195.stdout:2/658: truncate d2/d14/f18 5444772 0 2024-04-06T12:23:11.327 INFO:tasks.workunit.client.1.smithi195.stdout:4/586: dwrite d4/f62 [0,4194304] 0 2024-04-06T12:23:11.328 INFO:tasks.workunit.client.1.smithi195.stdout:0/631: dread d4/f59 [0,4194304] 0 2024-04-06T12:23:11.332 INFO:tasks.workunit.client.1.smithi195.stdout:6/687: creat d8/d21/d31/d26/dcf/de4/f10b x:0 0 0 2024-04-06T12:23:11.333 INFO:tasks.workunit.client.1.smithi195.stdout:4/587: write d4/d6/d38/d1a/d40/d20/f8a [3805286,59692] 0 2024-04-06T12:23:11.334 INFO:tasks.workunit.client.1.smithi195.stdout:6/688: dread - d8/d3d/d5e/f8f zero size 2024-04-06T12:23:11.334 INFO:tasks.workunit.client.1.smithi195.stdout:0/632: mkdir d4/dbc/dce 0 2024-04-06T12:23:11.339 INFO:tasks.workunit.client.1.smithi195.stdout:0/633: mkdir d4/d48/d67/d75/dcf 0 2024-04-06T12:23:11.339 INFO:tasks.workunit.client.1.smithi195.stdout:6/689: fdatasync d8/d21/d31/d6c/ff9 0 2024-04-06T12:23:11.340 INFO:tasks.workunit.client.1.smithi195.stdout:4/588: mknod d4/d6/d38/d65/d7a/cb8 0 2024-04-06T12:23:11.342 INFO:tasks.workunit.client.1.smithi195.stdout:2/659: write d2/f61 [5897401,124346] 0 2024-04-06T12:23:11.342 INFO:tasks.workunit.client.1.smithi195.stdout:7/521: dwrite d4/d10/d18/d57/f7f [0,4194304] 0 2024-04-06T12:23:11.343 INFO:tasks.workunit.client.1.smithi195.stdout:0/634: symlink d4/d6/d58/ld0 0 2024-04-06T12:23:11.345 INFO:tasks.workunit.client.1.smithi195.stdout:4/589: symlink d4/d6/d38/d1a/da7/lb9 0 2024-04-06T12:23:11.345 INFO:tasks.workunit.client.1.smithi195.stdout:6/690: truncate d8/d50/d32/fbe 326791 0 2024-04-06T12:23:11.345 INFO:tasks.workunit.client.1.smithi195.stdout:7/522: chown d4/d24/f1a 593695 1 2024-04-06T12:23:11.346 INFO:tasks.workunit.client.1.smithi195.stdout:2/660: mknod d2/d3f/ccc 0 2024-04-06T12:23:11.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/635: mkdir d4/d53/dd1 0 2024-04-06T12:23:11.347 INFO:tasks.workunit.client.1.smithi195.stdout:2/661: stat d2/d21/d69 0 2024-04-06T12:23:11.348 INFO:tasks.workunit.client.1.smithi195.stdout:7/523: chown d4/d16/dd/f78 6076599 1 2024-04-06T12:23:11.350 INFO:tasks.workunit.client.1.smithi195.stdout:6/691: rename d8/d50 to d8/d3d/d5e/d72/d10c 0 2024-04-06T12:23:11.352 INFO:tasks.workunit.client.1.smithi195.stdout:2/662: creat d2/d41/d5a/fcd x:0 0 0 2024-04-06T12:23:11.355 INFO:tasks.workunit.client.1.smithi195.stdout:7/524: unlink d4/l4b 0 2024-04-06T12:23:11.356 INFO:tasks.workunit.client.1.smithi195.stdout:7/525: write d4/d10/d18/d33/d6e/f7d [3915780,57545] 0 2024-04-06T12:23:11.357 INFO:tasks.workunit.client.1.smithi195.stdout:0/636: unlink d4/d48/d77/d97/fb0 0 2024-04-06T12:23:11.360 INFO:tasks.workunit.client.1.smithi195.stdout:2/663: mkdir d2/d41/d84/d8d/dce 0 2024-04-06T12:23:11.360 INFO:tasks.workunit.client.1.smithi195.stdout:0/637: read d4/d6/d2f/f44 [90653,6611] 0 2024-04-06T12:23:11.364 INFO:tasks.workunit.client.1.smithi195.stdout:7/526: dwrite d4/f96 [0,4194304] 0 2024-04-06T12:23:11.368 INFO:tasks.workunit.client.1.smithi195.stdout:7/527: creat d4/d5d/fa6 x:0 0 0 2024-04-06T12:23:11.370 INFO:tasks.workunit.client.1.smithi195.stdout:0/638: dwrite d4/f21 [8388608,4194304] 0 2024-04-06T12:23:11.371 INFO:tasks.workunit.client.1.smithi195.stdout:6/692: rename d8/d21/d31/d26/c89 to d8/d21/d31/d6c/ded/c10d 0 2024-04-06T12:23:11.372 INFO:tasks.workunit.client.1.smithi195.stdout:2/664: link d2/d14/f31 d2/d3f/d7d/fcf 0 2024-04-06T12:23:11.373 INFO:tasks.workunit.client.1.smithi195.stdout:0/639: dread - d4/d53/fc9 zero size 2024-04-06T12:23:11.374 INFO:tasks.workunit.client.1.smithi195.stdout:0/640: fdatasync d4/f32 0 2024-04-06T12:23:11.375 INFO:tasks.workunit.client.1.smithi195.stdout:2/665: symlink d2/d41/d84/d8d/d94/ld0 0 2024-04-06T12:23:11.375 INFO:tasks.workunit.client.1.smithi195.stdout:0/641: write d4/d48/d77/d97/fca [188945,22252] 0 2024-04-06T12:23:11.378 INFO:tasks.workunit.client.1.smithi195.stdout:0/642: read d4/d48/d77/f7e [850851,32332] 0 2024-04-06T12:23:11.380 INFO:tasks.workunit.client.1.smithi195.stdout:2/666: unlink d2/fe 0 2024-04-06T12:23:11.380 INFO:tasks.workunit.client.1.smithi195.stdout:7/528: getdents d4/d16/dd/d22 0 2024-04-06T12:23:11.383 INFO:tasks.workunit.client.1.smithi195.stdout:7/529: mknod d4/d16/d6b/ca7 0 2024-04-06T12:23:11.385 INFO:tasks.workunit.client.1.smithi195.stdout:7/530: creat d4/d24/d80/fa8 x:0 0 0 2024-04-06T12:23:11.386 INFO:tasks.workunit.client.1.smithi195.stdout:6/693: dread d8/f10 [0,4194304] 0 2024-04-06T12:23:11.389 INFO:tasks.workunit.client.1.smithi195.stdout:6/694: fdatasync d8/d3d/d5e/d72/f79 0 2024-04-06T12:23:11.442 INFO:tasks.workunit.client.1.smithi195.stdout:1/615: sync 2024-04-06T12:23:11.443 INFO:tasks.workunit.client.1.smithi195.stdout:8/638: sync 2024-04-06T12:23:11.443 INFO:tasks.workunit.client.1.smithi195.stdout:9/653: sync 2024-04-06T12:23:11.447 INFO:tasks.workunit.client.1.smithi195.stdout:0/643: truncate d4/d6/d58/f8b 938447 0 2024-04-06T12:23:11.450 INFO:tasks.workunit.client.1.smithi195.stdout:6/695: write d8/d21/d2b/fe9 [592979,35833] 0 2024-04-06T12:23:11.450 INFO:tasks.workunit.client.1.smithi195.stdout:9/654: creat d3/da1/fd5 x:0 0 0 2024-04-06T12:23:11.450 INFO:tasks.workunit.client.1.smithi195.stdout:0/644: chown d4/d6/d1a/fb2 517685218 1 2024-04-06T12:23:11.450 INFO:tasks.workunit.client.1.smithi195.stdout:7/531: dwrite d4/d10/d18/d57/f7f [0,4194304] 0 2024-04-06T12:23:11.451 INFO:tasks.workunit.client.1.smithi195.stdout:8/639: creat d6/dd/d70/d24/d53/fdc x:0 0 0 2024-04-06T12:23:11.458 INFO:tasks.workunit.client.1.smithi195.stdout:0/645: dwrite d4/d6/f42 [0,4194304] 0 2024-04-06T12:23:11.458 INFO:tasks.workunit.client.1.smithi195.stdout:7/532: rename d4/d5d to d4/d16/dd/d22/d3f/d54/da9 0 2024-04-06T12:23:11.464 INFO:tasks.workunit.client.1.smithi195.stdout:7/533: rename d4/d16/dd/d22/f2b to d4/d16/dd/d22/d3f/faa 0 2024-04-06T12:23:11.464 INFO:tasks.workunit.client.1.smithi195.stdout:1/616: write d4/d14/d17/d24/d2a/d5a/daa/fad [597625,19694] 0 2024-04-06T12:23:11.466 INFO:tasks.workunit.client.1.smithi195.stdout:1/617: stat d4/d14/d17/d24/d2a/fbc 0 2024-04-06T12:23:11.466 INFO:tasks.workunit.client.1.smithi195.stdout:6/696: link d8/d21/d31/l17 d8/d3d/l10e 0 2024-04-06T12:23:11.468 INFO:tasks.workunit.client.1.smithi195.stdout:7/534: mknod d4/d10/d18/d33/d6e/cab 0 2024-04-06T12:23:11.469 INFO:tasks.workunit.client.1.smithi195.stdout:1/618: fsync d4/d14/d17/d24/d2a/f54 0 2024-04-06T12:23:11.469 INFO:tasks.workunit.client.1.smithi195.stdout:6/697: mknod d8/d3d/c10f 0 2024-04-06T12:23:11.470 INFO:tasks.workunit.client.1.smithi195.stdout:7/535: rmdir d4/d10/d18/d19/d63 39 2024-04-06T12:23:11.471 INFO:tasks.workunit.client.1.smithi195.stdout:7/536: chown d4/c9 3731 1 2024-04-06T12:23:11.472 INFO:tasks.workunit.client.1.smithi195.stdout:6/698: mkdir d8/d3d/d5e/d72/d10c/d9c/d110 0 2024-04-06T12:23:11.478 INFO:tasks.workunit.client.1.smithi195.stdout:1/619: dwrite d4/d14/f18 [0,4194304] 0 2024-04-06T12:23:11.479 INFO:tasks.workunit.client.1.smithi195.stdout:7/537: creat d4/d16/dd/d22/d76/fac x:0 0 0 2024-04-06T12:23:11.483 INFO:tasks.workunit.client.1.smithi195.stdout:6/699: dwrite d8/d21/d31/d6c/ff9 [0,4194304] 0 2024-04-06T12:23:11.485 INFO:tasks.workunit.client.1.smithi195.stdout:1/620: mkdir d4/d14/d17/d24/d99/d4e/d8f/dbe 0 2024-04-06T12:23:11.485 INFO:tasks.workunit.client.1.smithi195.stdout:6/700: chown d8/d21/d31/d6c/db6 32351581 1 2024-04-06T12:23:11.490 INFO:tasks.workunit.client.1.smithi195.stdout:7/538: dwrite d4/f20 [4194304,4194304] 0 2024-04-06T12:23:11.494 INFO:tasks.workunit.client.1.smithi195.stdout:7/539: symlink d4/d10/d12/d6f/lad 0 2024-04-06T12:23:11.495 INFO:tasks.workunit.client.1.smithi195.stdout:6/701: link d8/d21/d2b/d46/d44/l9e d8/d21/d31/d26/dcf/l111 0 2024-04-06T12:23:11.495 INFO:tasks.workunit.client.1.smithi195.stdout:7/540: readlink d4/lb 0 2024-04-06T12:23:11.498 INFO:tasks.workunit.client.1.smithi195.stdout:1/621: dwrite d4/d14/d17/d3a/da8/da4/db2/d28/f50 [0,4194304] 0 2024-04-06T12:23:11.498 INFO:tasks.workunit.client.1.smithi195.stdout:6/702: rmdir d8/d21/d31/d6c/d7b 39 2024-04-06T12:23:11.500 INFO:tasks.workunit.client.1.smithi195.stdout:1/622: stat d4/d14/d17/d24/d99/d4e/d71 0 2024-04-06T12:23:11.504 INFO:tasks.workunit.client.1.smithi195.stdout:6/703: truncate d8/d3d/d5e/d72/d10c/d9c/faa 637130 0 2024-04-06T12:23:11.505 INFO:tasks.workunit.client.1.smithi195.stdout:1/623: dread d4/d14/d17/d24/d99/d4e/d8f/f92 [0,4194304] 0 2024-04-06T12:23:11.507 INFO:tasks.workunit.client.1.smithi195.stdout:6/704: creat d8/d3d/d5e/d72/d10c/d32/f112 x:0 0 0 2024-04-06T12:23:11.507 INFO:tasks.workunit.client.1.smithi195.stdout:1/624: mkdir d4/d14/d17/d24/d99/d88/dbf 0 2024-04-06T12:23:11.508 INFO:tasks.workunit.client.1.smithi195.stdout:6/705: write d8/d3d/fd2 [222254,65813] 0 2024-04-06T12:23:11.509 INFO:tasks.workunit.client.1.smithi195.stdout:6/706: read d8/d21/d31/d26/dc8/f59 [461444,11773] 0 2024-04-06T12:23:11.512 INFO:tasks.workunit.client.1.smithi195.stdout:3/685: sync 2024-04-06T12:23:11.512 INFO:tasks.workunit.client.1.smithi195.stdout:6/707: mknod d8/d21/d2b/d46/d7f/c113 0 2024-04-06T12:23:11.513 INFO:tasks.workunit.client.1.smithi195.stdout:7/541: write d4/d16/dd/d22/d3f/d54/da9/f42 [353189,43851] 0 2024-04-06T12:23:11.513 INFO:tasks.workunit.client.1.smithi195.stdout:1/625: symlink d4/d14/lc0 0 2024-04-06T12:23:11.514 INFO:tasks.workunit.client.1.smithi195.stdout:3/686: chown d4/l5 4100011 1 2024-04-06T12:23:11.516 INFO:tasks.workunit.client.1.smithi195.stdout:1/626: mkdir d4/d14/d17/dc1 0 2024-04-06T12:23:11.516 INFO:tasks.workunit.client.1.smithi195.stdout:3/687: fdatasync d4/d9/d2b/d3b/d5e/d7e/fce 0 2024-04-06T12:23:11.516 INFO:tasks.workunit.client.1.smithi195.stdout:7/542: symlink d4/d16/d11/lae 0 2024-04-06T12:23:11.518 INFO:tasks.workunit.client.1.smithi195.stdout:3/688: chown d4/d9/c3f 27 1 2024-04-06T12:23:11.521 INFO:tasks.workunit.client.1.smithi195.stdout:7/543: creat d4/d10/d18/d19/faf x:0 0 0 2024-04-06T12:23:11.521 INFO:tasks.workunit.client.1.smithi195.stdout:1/627: mkdir d4/d14/d17/d24/d99/d4e/d8f/dbe/dc2 0 2024-04-06T12:23:11.521 INFO:tasks.workunit.client.1.smithi195.stdout:6/708: dwrite d8/d21/d31/d26/fb1 [0,4194304] 0 2024-04-06T12:23:11.522 INFO:tasks.workunit.client.1.smithi195.stdout:3/689: stat d4/d9/dcf/cd5 0 2024-04-06T12:23:11.523 INFO:tasks.workunit.client.1.smithi195.stdout:3/690: stat d4/l5 0 2024-04-06T12:23:11.523 INFO:tasks.workunit.client.1.smithi195.stdout:6/709: stat d8/d3d/d5e/lec 0 2024-04-06T12:23:11.523 INFO:tasks.workunit.client.1.smithi195.stdout:1/628: chown d4/d14/d17/d24/d99/d4e 4908 1 2024-04-06T12:23:11.524 INFO:tasks.workunit.client.1.smithi195.stdout:3/691: fsync d4/d9/dcf/fd6 0 2024-04-06T12:23:11.526 INFO:tasks.workunit.client.1.smithi195.stdout:3/692: chown d4/d9/d37/f7d 218821 1 2024-04-06T12:23:11.527 INFO:tasks.workunit.client.1.smithi195.stdout:1/629: write d4/d14/d17/d24/d99/d4e/d60/f86 [5483334,83283] 0 2024-04-06T12:23:11.528 INFO:tasks.workunit.client.1.smithi195.stdout:7/544: rename d4/d24/c74 to d4/d10/cb0 0 2024-04-06T12:23:11.529 INFO:tasks.workunit.client.1.smithi195.stdout:7/545: chown d4/d10/d12/f72 1 1 2024-04-06T12:23:11.530 INFO:tasks.workunit.client.1.smithi195.stdout:6/710: creat d8/d21/d31/f114 x:0 0 0 2024-04-06T12:23:11.533 INFO:tasks.workunit.client.1.smithi195.stdout:6/711: read d8/d21/d2b/d46/d44/f56 [3824373,63083] 0 2024-04-06T12:23:11.535 INFO:tasks.workunit.client.1.smithi195.stdout:6/712: chown d8/d3d/d5e/lec 569140 1 2024-04-06T12:23:11.535 INFO:tasks.workunit.client.1.smithi195.stdout:1/630: rename d4/d14/d17/d24/d99/d4e/d57/l87 to d4/d14/d17/d24/d99/d88/dbf/lc3 0 2024-04-06T12:23:11.538 INFO:tasks.workunit.client.1.smithi195.stdout:6/713: mknod d8/d21/d31/d26/dcf/de4/c115 0 2024-04-06T12:23:11.539 INFO:tasks.workunit.client.1.smithi195.stdout:1/631: mkdir d4/d14/d17/d24/d99/d4e/d60/dc4 0 2024-04-06T12:23:11.541 INFO:tasks.workunit.client.1.smithi195.stdout:7/546: dread d4/d10/d12/f14 [0,4194304] 0 2024-04-06T12:23:11.543 INFO:tasks.workunit.client.1.smithi195.stdout:3/693: dread d4/de/d8e/f6c [0,4194304] 0 2024-04-06T12:23:11.544 INFO:tasks.workunit.client.1.smithi195.stdout:7/547: chown d4/d16/dd/d22/d3f/d54/da9/f60 68554 1 2024-04-06T12:23:11.545 INFO:tasks.workunit.client.1.smithi195.stdout:3/694: chown d4/de/fc5 678679760 1 2024-04-06T12:23:11.546 INFO:tasks.workunit.client.1.smithi195.stdout:6/714: dwrite d8/d21/d2b/f43 [0,4194304] 0 2024-04-06T12:23:11.548 INFO:tasks.workunit.client.1.smithi195.stdout:7/548: creat d4/d10/d12/fb1 x:0 0 0 2024-04-06T12:23:11.548 INFO:tasks.workunit.client.1.smithi195.stdout:3/695: write d4/d9/d2b/d3b/d5e/d7e/fb6 [950340,91500] 0 2024-04-06T12:23:11.549 INFO:tasks.workunit.client.1.smithi195.stdout:6/715: dread d8/d3d/fd2 [0,4194304] 0 2024-04-06T12:23:11.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/549: creat d4/d16/d11/fb2 x:0 0 0 2024-04-06T12:23:11.551 INFO:tasks.workunit.client.1.smithi195.stdout:1/632: link d4/d14/d17/d24/d99/d88/dbf/lc3 d4/d14/d17/dc1/lc5 0 2024-04-06T12:23:11.553 INFO:tasks.workunit.client.1.smithi195.stdout:6/716: mkdir d8/d21/d2b/d46/d44/d86/d116 0 2024-04-06T12:23:11.554 INFO:tasks.workunit.client.1.smithi195.stdout:3/696: symlink d4/de/d8e/d92/d9e/da4/le1 0 2024-04-06T12:23:11.555 INFO:tasks.workunit.client.1.smithi195.stdout:6/717: read d8/d3d/d5e/d72/d10c/d32/f57 [2157337,57821] 0 2024-04-06T12:23:11.556 INFO:tasks.workunit.client.1.smithi195.stdout:7/550: unlink d4/d10/d12/c23 0 2024-04-06T12:23:11.558 INFO:tasks.workunit.client.1.smithi195.stdout:5/705: sync 2024-04-06T12:23:11.558 INFO:tasks.workunit.client.1.smithi195.stdout:4/590: sync 2024-04-06T12:23:11.559 INFO:tasks.workunit.client.1.smithi195.stdout:6/718: symlink d8/d21/d31/d6c/ded/l117 0 2024-04-06T12:23:11.559 INFO:tasks.workunit.client.1.smithi195.stdout:3/697: mkdir d4/d9/d2b/d3b/d40/de2 0 2024-04-06T12:23:11.560 INFO:tasks.workunit.client.1.smithi195.stdout:4/591: write d4/d6/d38/f39 [488356,35464] 0 2024-04-06T12:23:11.561 INFO:tasks.workunit.client.1.smithi195.stdout:5/706: write d0/da/dd/d1c/f20 [4410288,118968] 0 2024-04-06T12:23:11.561 INFO:tasks.workunit.client.1.smithi195.stdout:2/667: sync 2024-04-06T12:23:11.562 INFO:tasks.workunit.client.1.smithi195.stdout:7/551: unlink d4/d16/dd/d22/d3f/d54/da9/f60 0 2024-04-06T12:23:11.563 INFO:tasks.workunit.client.1.smithi195.stdout:3/698: symlink d4/d9/d9f/le3 0 2024-04-06T12:23:11.564 INFO:tasks.workunit.client.1.smithi195.stdout:5/707: chown d0/da/dd/d2e/d6f/dab/fbe 9346 1 2024-04-06T12:23:11.565 INFO:tasks.workunit.client.1.smithi195.stdout:4/592: symlink d4/d6/d38/d65/d7a/lba 0 2024-04-06T12:23:11.567 INFO:tasks.workunit.client.1.smithi195.stdout:4/593: readlink d4/d6/d38/d1a/l70 0 2024-04-06T12:23:11.570 INFO:tasks.workunit.client.1.smithi195.stdout:6/719: dwrite d8/d21/d2b/d46/d44/f56 [0,4194304] 0 2024-04-06T12:23:11.575 INFO:tasks.workunit.client.1.smithi195.stdout:6/720: mknod d8/d21/d2b/c118 0 2024-04-06T12:23:11.577 INFO:tasks.workunit.client.1.smithi195.stdout:7/552: link d4/d10/d12/c44 d4/d16/dd/d22/d3f/d54/cb3 0 2024-04-06T12:23:11.577 INFO:tasks.workunit.client.1.smithi195.stdout:8/640: sync 2024-04-06T12:23:11.578 INFO:tasks.workunit.client.1.smithi195.stdout:9/655: sync 2024-04-06T12:23:11.578 INFO:tasks.workunit.client.1.smithi195.stdout:0/646: sync 2024-04-06T12:23:11.581 INFO:tasks.workunit.client.1.smithi195.stdout:3/699: write d4/f4e [2168306,124733] 0 2024-04-06T12:23:11.581 INFO:tasks.workunit.client.1.smithi195.stdout:4/594: truncate d4/d6/d38/d1a/d40/d57/d64/f7d 552590 0 2024-04-06T12:23:11.583 INFO:tasks.workunit.client.1.smithi195.stdout:6/721: unlink d8/d3d/d5e/d72/d10c/f6a 0 2024-04-06T12:23:11.584 INFO:tasks.workunit.client.1.smithi195.stdout:1/633: dwrite d4/d14/fd [0,4194304] 0 2024-04-06T12:23:11.585 INFO:tasks.workunit.client.1.smithi195.stdout:8/641: fsync d6/dd/d42/fcd 0 2024-04-06T12:23:11.587 INFO:tasks.workunit.client.1.smithi195.stdout:9/656: write d3/d10/d3b/d50/f86 [1027679,49732] 0 2024-04-06T12:23:11.587 INFO:tasks.workunit.client.1.smithi195.stdout:5/708: dread d0/da/dd/d2e/f90 [0,4194304] 0 2024-04-06T12:23:11.589 INFO:tasks.workunit.client.1.smithi195.stdout:0/647: getdents d4/d53/dd1 0 2024-04-06T12:23:11.589 INFO:tasks.workunit.client.1.smithi195.stdout:3/700: mkdir d4/de/d8e/d92/d9e/de4 0 2024-04-06T12:23:11.591 INFO:tasks.workunit.client.1.smithi195.stdout:8/642: chown d6/d8/f55 127 1 2024-04-06T12:23:11.594 INFO:tasks.workunit.client.1.smithi195.stdout:0/648: fsync d4/d6/d58/da7/fbb 0 2024-04-06T12:23:11.595 INFO:tasks.workunit.client.1.smithi195.stdout:4/595: rename d4/d6/d38/d1a/l1e to d4/d6d/d85/lbb 0 2024-04-06T12:23:11.595 INFO:tasks.workunit.client.1.smithi195.stdout:3/701: fdatasync d4/d9/d2b/d77/d9a/fd1 0 2024-04-06T12:23:11.596 INFO:tasks.workunit.client.1.smithi195.stdout:2/668: dwrite d2/d3f/d7d/fcf [4194304,4194304] 0 2024-04-06T12:23:11.597 INFO:tasks.workunit.client.1.smithi195.stdout:9/657: mknod d3/db9/dbc/cd6 0 2024-04-06T12:23:11.599 INFO:tasks.workunit.client.1.smithi195.stdout:5/709: creat d0/da/d13/ff4 x:0 0 0 2024-04-06T12:23:11.602 INFO:tasks.workunit.client.1.smithi195.stdout:9/658: stat d3/d10/d3b/d50 0 2024-04-06T12:23:11.602 INFO:tasks.workunit.client.1.smithi195.stdout:1/634: rename d4/d14/d17/d24/d99/d4e/d60/f86 to d4/d14/d17/dc1/fc6 0 2024-04-06T12:23:11.602 INFO:tasks.workunit.client.1.smithi195.stdout:2/669: dread - d2/d14/f4e zero size 2024-04-06T12:23:11.604 INFO:tasks.workunit.client.1.smithi195.stdout:3/702: creat d4/de/fe5 x:0 0 0 2024-04-06T12:23:11.604 INFO:tasks.workunit.client.1.smithi195.stdout:1/635: chown d4/d14 72164330 1 2024-04-06T12:23:11.604 INFO:tasks.workunit.client.1.smithi195.stdout:6/722: dwrite d8/d21/d31/fe [4194304,4194304] 0 2024-04-06T12:23:11.604 INFO:tasks.workunit.client.1.smithi195.stdout:0/649: symlink d4/d48/d4e/ld2 0 2024-04-06T12:23:11.606 INFO:tasks.workunit.client.1.smithi195.stdout:0/650: fdatasync d4/fc8 0 2024-04-06T12:23:11.606 INFO:tasks.workunit.client.1.smithi195.stdout:5/710: write d0/da/f3c [67162,68269] 0 2024-04-06T12:23:11.608 INFO:tasks.workunit.client.1.smithi195.stdout:0/651: readlink d4/d6/d2f/l3c 0 2024-04-06T12:23:11.608 INFO:tasks.workunit.client.1.smithi195.stdout:4/596: write d4/f79 [1878809,90974] 0 2024-04-06T12:23:11.610 INFO:tasks.workunit.client.1.smithi195.stdout:0/652: chown d4/d6/d2f/l50 826109 1 2024-04-06T12:23:11.614 INFO:tasks.workunit.client.1.smithi195.stdout:8/643: rename d6/d8/daa/dab/fad to d6/dd/d70/d24/d34/d67/da1/fdd 0 2024-04-06T12:23:11.615 INFO:tasks.workunit.client.1.smithi195.stdout:3/703: dread - d4/df/d39/fb1 zero size 2024-04-06T12:23:11.616 INFO:tasks.workunit.client.1.smithi195.stdout:6/723: symlink d8/d21/d31/d6c/ded/l119 0 2024-04-06T12:23:11.616 INFO:tasks.workunit.client.1.smithi195.stdout:2/670: dread d2/d3f/d7d/d7a/f81 [0,4194304] 0 2024-04-06T12:23:11.618 INFO:tasks.workunit.client.1.smithi195.stdout:0/653: fdatasync d4/d48/d67/d75/fa1 0 2024-04-06T12:23:11.619 INFO:tasks.workunit.client.1.smithi195.stdout:4/597: rename d4/d6/d38/d1a/d40/d20/d23/f3a to d4/d6/fbc 0 2024-04-06T12:23:11.619 INFO:tasks.workunit.client.1.smithi195.stdout:5/711: write d0/da/dd/d1c/d5a/d62/d64/d67/db9/fcf [437000,23495] 0 2024-04-06T12:23:11.621 INFO:tasks.workunit.client.1.smithi195.stdout:6/724: chown d8/d21/d31/fac 6531727 1 2024-04-06T12:23:11.621 INFO:tasks.workunit.client.1.smithi195.stdout:1/636: link d4/d14/d17/d3a/da8/da4/db2/d5d/fa3 d4/d14/d17/d24/d99/d4e/d8f/dbe/dc2/fc7 0 2024-04-06T12:23:11.621 INFO:tasks.workunit.client.1.smithi195.stdout:9/659: rename d3/c56 to d3/cd7 0 2024-04-06T12:23:11.622 INFO:tasks.workunit.client.1.smithi195.stdout:2/671: mknod d2/d3f/d7d/d7a/cd1 0 2024-04-06T12:23:11.623 INFO:tasks.workunit.client.1.smithi195.stdout:0/654: write d4/f21 [13578719,26015] 0 2024-04-06T12:23:11.625 INFO:tasks.workunit.client.1.smithi195.stdout:0/655: chown d4/d48/d67/d75 495 1 2024-04-06T12:23:11.692 INFO:tasks.workunit.client.1.smithi195.stdout:3/704: dwrite d4/de/f84 [0,4194304] 0 2024-04-06T12:23:11.695 INFO:tasks.workunit.client.1.smithi195.stdout:3/705: mknod d4/d9/d37/ce6 0 2024-04-06T12:23:11.696 INFO:tasks.workunit.client.1.smithi195.stdout:1/637: creat d4/d14/d17/d3a/da8/db8/fc8 x:0 0 0 2024-04-06T12:23:11.696 INFO:tasks.workunit.client.1.smithi195.stdout:4/598: link d4/d6/d38/d1a/l87 d4/d6d/da6/lbd 0 2024-04-06T12:23:11.696 INFO:tasks.workunit.client.1.smithi195.stdout:2/672: symlink d2/d41/d84/d8d/dce/ld2 0 2024-04-06T12:23:11.699 INFO:tasks.workunit.client.1.smithi195.stdout:6/725: getdents d8/d21/d31/d26/dc8 0 2024-04-06T12:23:11.701 INFO:tasks.workunit.client.1.smithi195.stdout:3/706: mknod d4/d9/d2b/d3b/d5e/ce7 0 2024-04-06T12:23:11.702 INFO:tasks.workunit.client.1.smithi195.stdout:4/599: readlink d4/d6/d38/d65/d7a/l81 0 2024-04-06T12:23:11.703 INFO:tasks.workunit.client.1.smithi195.stdout:2/673: write d2/d21/d2c/d2d/f76 [4125584,12715] 0 2024-04-06T12:23:11.703 INFO:tasks.workunit.client.1.smithi195.stdout:0/656: dwrite d4/d6/d1a/f37 [0,4194304] 0 2024-04-06T12:23:11.704 INFO:tasks.workunit.client.1.smithi195.stdout:8/644: dread d6/dd/d70/d24/d34/d67/f6c [0,4194304] 0 2024-04-06T12:23:11.708 INFO:tasks.workunit.client.1.smithi195.stdout:3/707: chown d4/d9/d2b/d3b/d5e/l7a 3 1 2024-04-06T12:23:11.713 INFO:tasks.workunit.client.1.smithi195.stdout:4/600: mknod d4/d6d/cbe 0 2024-04-06T12:23:11.713 INFO:tasks.workunit.client.1.smithi195.stdout:1/638: link d4/d14/d17/f98 d4/d14/d17/d24/d99/d4e/d8f/dbe/fc9 0 2024-04-06T12:23:11.713 INFO:tasks.workunit.client.1.smithi195.stdout:2/674: mknod d2/d41/d84/d8d/d94/cd3 0 2024-04-06T12:23:11.714 INFO:tasks.workunit.client.1.smithi195.stdout:6/726: truncate d8/d21/d31/d26/dc8/f59 1406346 0 2024-04-06T12:23:11.714 INFO:tasks.workunit.client.1.smithi195.stdout:4/601: creat d4/d8c/fbf x:0 0 0 2024-04-06T12:23:11.715 INFO:tasks.workunit.client.1.smithi195.stdout:8/645: truncate d6/dd/d70/d24/d34/d67/f76 321300 0 2024-04-06T12:23:11.717 INFO:tasks.workunit.client.1.smithi195.stdout:2/675: dread - d2/d21/f74 zero size 2024-04-06T12:23:11.717 INFO:tasks.workunit.client.1.smithi195.stdout:3/708: truncate d4/d9/f18 3478379 0 2024-04-06T12:23:11.720 INFO:tasks.workunit.client.1.smithi195.stdout:6/727: mknod d8/d21/d31/c11a 0 2024-04-06T12:23:11.721 INFO:tasks.workunit.client.1.smithi195.stdout:4/602: read d4/d6/d38/d1a/d40/f15 [3879422,7867] 0 2024-04-06T12:23:11.721 INFO:tasks.workunit.client.1.smithi195.stdout:0/657: dwrite d4/d6/d58/da7/fbb [0,4194304] 0 2024-04-06T12:23:11.724 INFO:tasks.workunit.client.1.smithi195.stdout:3/709: mkdir d4/de/d8e/dbb/de8 0 2024-04-06T12:23:11.726 INFO:tasks.workunit.client.1.smithi195.stdout:1/639: dwrite d4/fa [0,4194304] 0 2024-04-06T12:23:11.726 INFO:tasks.workunit.client.1.smithi195.stdout:0/658: dread d4/d48/d77/d97/fac [0,4194304] 0 2024-04-06T12:23:11.726 INFO:tasks.workunit.client.1.smithi195.stdout:2/676: mknod d2/d21/d2c/d2d/d92/d95/cd4 0 2024-04-06T12:23:11.729 INFO:tasks.workunit.client.1.smithi195.stdout:7/553: sync 2024-04-06T12:23:11.729 INFO:tasks.workunit.client.1.smithi195.stdout:2/677: fdatasync d2/d21/d69/d6b/f6e 0 2024-04-06T12:23:11.730 INFO:tasks.workunit.client.1.smithi195.stdout:6/728: rmdir d8/d21/d2b/d46 39 2024-04-06T12:23:11.730 INFO:tasks.workunit.client.1.smithi195.stdout:1/640: dread - d4/d14/d17/d24/d2a/d5a/daa/fb5 zero size 2024-04-06T12:23:11.732 INFO:tasks.workunit.client.1.smithi195.stdout:4/603: dwrite d4/f62 [0,4194304] 0 2024-04-06T12:23:11.734 INFO:tasks.workunit.client.1.smithi195.stdout:1/641: chown d4/d14/d17/d3a/da8/db8/fc8 14 1 2024-04-06T12:23:11.735 INFO:tasks.workunit.client.1.smithi195.stdout:4/604: chown d4/d3e/f98 40017 1 2024-04-06T12:23:11.736 INFO:tasks.workunit.client.1.smithi195.stdout:4/605: write d4/f62 [2676934,31771] 0 2024-04-06T12:23:11.744 INFO:tasks.workunit.client.1.smithi195.stdout:2/678: rename d2/d21/d69/d6b/f90 to d2/d21/d2c/d2d/d92/d95/d9b/fd5 0 2024-04-06T12:23:11.747 INFO:tasks.workunit.client.1.smithi195.stdout:4/606: creat d4/d8c/fc0 x:0 0 0 2024-04-06T12:23:11.747 INFO:tasks.workunit.client.1.smithi195.stdout:1/642: symlink d4/d14/d17/d24/d2a/d5a/daa/lca 0 2024-04-06T12:23:11.753 INFO:tasks.workunit.client.1.smithi195.stdout:1/643: readlink d4/d14/d17/d24/d99/d4e/l72 0 2024-04-06T12:23:11.754 INFO:tasks.workunit.client.1.smithi195.stdout:6/729: getdents d8/d21/d31/d6c/d7b 0 2024-04-06T12:23:11.754 INFO:tasks.workunit.client.1.smithi195.stdout:8/646: dwrite d6/db/f8f [0,4194304] 0 2024-04-06T12:23:11.755 INFO:tasks.workunit.client.1.smithi195.stdout:4/607: symlink d4/d6/d38/d1a/d40/lc1 0 2024-04-06T12:23:11.756 INFO:tasks.workunit.client.1.smithi195.stdout:0/659: write d4/d6/f1d [355453,102637] 0 2024-04-06T12:23:11.756 INFO:tasks.workunit.client.1.smithi195.stdout:7/554: write d4/d24/f49 [955493,17097] 0 2024-04-06T12:23:11.757 INFO:tasks.workunit.client.1.smithi195.stdout:3/710: write d4/d9/d2b/f42 [437589,78241] 0 2024-04-06T12:23:11.762 INFO:tasks.workunit.client.1.smithi195.stdout:2/679: dwrite d2/f65 [0,4194304] 0 2024-04-06T12:23:11.765 INFO:tasks.workunit.client.1.smithi195.stdout:7/555: fsync d4/d10/d12/f72 0 2024-04-06T12:23:11.767 INFO:tasks.workunit.client.1.smithi195.stdout:0/660: mkdir d4/d6/d2f/dd3 0 2024-04-06T12:23:11.768 INFO:tasks.workunit.client.1.smithi195.stdout:7/556: stat d4/d16/dd 0 2024-04-06T12:23:11.771 INFO:tasks.workunit.client.1.smithi195.stdout:2/680: fdatasync d2/d21/d29/f3e 0 2024-04-06T12:23:11.771 INFO:tasks.workunit.client.1.smithi195.stdout:1/644: mknod d4/d14/d17/d24/d99/d4e/d60/dc4/ccb 0 2024-04-06T12:23:11.773 INFO:tasks.workunit.client.1.smithi195.stdout:8/647: write d6/d8/f26 [3220933,112542] 0 2024-04-06T12:23:11.777 INFO:tasks.workunit.client.1.smithi195.stdout:6/730: dwrite d8/d21/d31/d26/fb1 [4194304,4194304] 0 2024-04-06T12:23:11.777 INFO:tasks.workunit.client.1.smithi195.stdout:0/661: chown d4/d48/d77/d97/db7/fb1 30 1 2024-04-06T12:23:11.778 INFO:tasks.workunit.client.1.smithi195.stdout:2/681: write d2/d41/d5a/fc4 [767954,120420] 0 2024-04-06T12:23:11.779 INFO:tasks.workunit.client.1.smithi195.stdout:3/711: dwrite d4/d9/d37/f97 [0,4194304] 0 2024-04-06T12:23:11.779 INFO:tasks.workunit.client.1.smithi195.stdout:8/648: chown d6/db/d47/l5c 52093 1 2024-04-06T12:23:11.780 INFO:tasks.workunit.client.1.smithi195.stdout:1/645: dread - d4/d14/d17/d24/d99/d4e/d8f/dbe/fc9 zero size 2024-04-06T12:23:11.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/712: rmdir d4/d9/d2b/d77 39 2024-04-06T12:23:11.789 INFO:tasks.workunit.client.1.smithi195.stdout:3/713: write d4/d53/f60 [255691,89949] 0 2024-04-06T12:23:11.789 INFO:tasks.workunit.client.1.smithi195.stdout:1/646: creat d4/d14/d17/d3a/da8/fcc x:0 0 0 2024-04-06T12:23:11.790 INFO:tasks.workunit.client.1.smithi195.stdout:4/608: dread d4/d3e/f78 [0,4194304] 0 2024-04-06T12:23:11.790 INFO:tasks.workunit.client.1.smithi195.stdout:0/662: rmdir d4/d6/d2f/dd3 0 2024-04-06T12:23:11.792 INFO:tasks.workunit.client.1.smithi195.stdout:4/609: chown d4/d6/d38/d1a/d40/l4d 286610991 1 2024-04-06T12:23:11.793 INFO:tasks.workunit.client.1.smithi195.stdout:6/731: rename d8/d21/d2b/d46/d2f to d8/d21/d31/d6c/d7b/d11b 0 2024-04-06T12:23:11.795 INFO:tasks.workunit.client.1.smithi195.stdout:6/732: fsync d8/d21/d31/d6c/ded/ff3 0 2024-04-06T12:23:11.797 INFO:tasks.workunit.client.1.smithi195.stdout:8/649: rename d6/dd/d70/d24/d25/d7c/fb4 to d6/dd/d70/d24/d25/da5/dc8/fde 0 2024-04-06T12:23:11.797 INFO:tasks.workunit.client.1.smithi195.stdout:0/663: symlink d4/dbc/dce/ld4 0 2024-04-06T12:23:11.797 INFO:tasks.workunit.client.1.smithi195.stdout:2/682: dread d2/f6d [0,4194304] 0 2024-04-06T12:23:11.799 INFO:tasks.workunit.client.1.smithi195.stdout:4/610: symlink d4/d6/d38/d1a/d40/d57/d64/lc2 0 2024-04-06T12:23:11.800 INFO:tasks.workunit.client.1.smithi195.stdout:6/733: symlink d8/d21/d2b/d46/d44/d86/l11c 0 2024-04-06T12:23:11.800 INFO:tasks.workunit.client.1.smithi195.stdout:3/714: getdents d4/d9/dcf 0 2024-04-06T12:23:11.802 INFO:tasks.workunit.client.1.smithi195.stdout:4/611: truncate d4/d6d/da6/dae/fb4 929079 0 2024-04-06T12:23:11.802 INFO:tasks.workunit.client.1.smithi195.stdout:0/664: chown d4/d6/c4b 4344318 1 2024-04-06T12:23:11.802 INFO:tasks.workunit.client.1.smithi195.stdout:2/683: dread d2/f6d [0,4194304] 0 2024-04-06T12:23:11.803 INFO:tasks.workunit.client.1.smithi195.stdout:4/612: stat d4/d6/d38/f1d 0 2024-04-06T12:23:11.804 INFO:tasks.workunit.client.1.smithi195.stdout:1/647: write d4/d14/d17/d24/d99/d4e/d8f/dbe/dc2/fc7 [440698,43636] 0 2024-04-06T12:23:11.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/734: chown d8/f2a 2323 1 2024-04-06T12:23:11.808 INFO:tasks.workunit.client.1.smithi195.stdout:6/735: write d8/d3d/d5e/d72/d10c/d9c/ff4 [60535,120285] 0 2024-04-06T12:23:11.809 INFO:tasks.workunit.client.1.smithi195.stdout:4/613: symlink d4/d6/lc3 0 2024-04-06T12:23:11.809 INFO:tasks.workunit.client.1.smithi195.stdout:3/715: dwrite d4/de/fc5 [0,4194304] 0 2024-04-06T12:23:11.813 INFO:tasks.workunit.client.1.smithi195.stdout:4/614: stat d4/d6/d38/d65/d7a/l81 0 2024-04-06T12:23:11.814 INFO:tasks.workunit.client.1.smithi195.stdout:0/665: getdents d4/d6 0 2024-04-06T12:23:11.814 INFO:tasks.workunit.client.1.smithi195.stdout:3/716: readlink d4/df/l33 0 2024-04-06T12:23:11.815 INFO:tasks.workunit.client.1.smithi195.stdout:8/650: truncate d6/d3a/f45 3317773 0 2024-04-06T12:23:11.817 INFO:tasks.workunit.client.1.smithi195.stdout:6/736: fsync d8/d21/d31/d49/f51 0 2024-04-06T12:23:11.818 INFO:tasks.workunit.client.1.smithi195.stdout:0/666: mkdir d4/dd5 0 2024-04-06T12:23:11.820 INFO:tasks.workunit.client.1.smithi195.stdout:8/651: write d6/dd/d70/d24/f32 [1193381,69682] 0 2024-04-06T12:23:11.821 INFO:tasks.workunit.client.1.smithi195.stdout:4/615: creat d4/d6/d38/d1a/da7/fc4 x:0 0 0 2024-04-06T12:23:11.822 INFO:tasks.workunit.client.1.smithi195.stdout:3/717: creat d4/d9/d2b/fe9 x:0 0 0 2024-04-06T12:23:11.822 INFO:tasks.workunit.client.1.smithi195.stdout:0/667: rmdir d4/d53/d81 39 2024-04-06T12:23:11.822 INFO:tasks.workunit.client.1.smithi195.stdout:2/684: dwrite d2/d21/f28 [0,4194304] 0 2024-04-06T12:23:11.823 INFO:tasks.workunit.client.1.smithi195.stdout:1/648: dwrite d4/d14/d17/d24/d99/f1a [0,4194304] 0 2024-04-06T12:23:11.829 INFO:tasks.workunit.client.1.smithi195.stdout:1/649: write d4/d14/d17/d3a/da8/da4/db2/d28/f50 [5206228,85349] 0 2024-04-06T12:23:11.830 INFO:tasks.workunit.client.1.smithi195.stdout:4/616: unlink d4/d3e/l56 0 2024-04-06T12:23:11.831 INFO:tasks.workunit.client.1.smithi195.stdout:3/718: mknod d4/d9/dcf/cea 0 2024-04-06T12:23:11.832 INFO:tasks.workunit.client.1.smithi195.stdout:4/617: fdatasync d4/d3e/fac 0 2024-04-06T12:23:11.832 INFO:tasks.workunit.client.1.smithi195.stdout:0/668: creat d4/d6/d2f/fd6 x:0 0 0 2024-04-06T12:23:11.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/652: mknod d6/dd/d70/d24/d34/d67/da1/da2/cdf 0 2024-04-06T12:23:11.834 INFO:tasks.workunit.client.1.smithi195.stdout:6/737: mknod d8/d3d/d5e/d72/d10c/d9c/d110/c11d 0 2024-04-06T12:23:11.835 INFO:tasks.workunit.client.1.smithi195.stdout:1/650: truncate d4/d14/d17/d24/d99/f4c 1225515 0 2024-04-06T12:23:11.835 INFO:tasks.workunit.client.1.smithi195.stdout:3/719: mknod d4/d9/d2b/d9b/ceb 0 2024-04-06T12:23:11.837 INFO:tasks.workunit.client.1.smithi195.stdout:4/618: chown d4/d6/d38/d65/d7a/ca8 3073198 1 2024-04-06T12:23:11.838 INFO:tasks.workunit.client.1.smithi195.stdout:6/738: readlink d8/d21/d31/l1b 0 2024-04-06T12:23:11.839 INFO:tasks.workunit.client.1.smithi195.stdout:8/653: rename d6/db/f8f to d6/d8/daa/fe0 0 2024-04-06T12:23:11.840 INFO:tasks.workunit.client.1.smithi195.stdout:4/619: write d4/d3e/f98 [259340,37495] 0 2024-04-06T12:23:11.844 INFO:tasks.workunit.client.1.smithi195.stdout:5/712: sync 2024-04-06T12:23:11.844 INFO:tasks.workunit.client.1.smithi195.stdout:9/660: sync 2024-04-06T12:23:11.844 INFO:tasks.workunit.client.1.smithi195.stdout:7/557: sync 2024-04-06T12:23:11.844 INFO:tasks.workunit.client.1.smithi195.stdout:4/620: chown d4/d6/fab 12165739 1 2024-04-06T12:23:11.845 INFO:tasks.workunit.client.1.smithi195.stdout:8/654: write d6/d3a/d46/f71 [1491340,118069] 0 2024-04-06T12:23:11.847 INFO:tasks.workunit.client.1.smithi195.stdout:0/669: dwrite d4/d6/d1a/f86 [0,4194304] 0 2024-04-06T12:23:11.848 INFO:tasks.workunit.client.1.smithi195.stdout:8/655: fdatasync d6/db/d47/f77 0 2024-04-06T12:23:11.852 INFO:tasks.workunit.client.1.smithi195.stdout:7/558: unlink d4/d24/f64 0 2024-04-06T12:23:11.853 INFO:tasks.workunit.client.1.smithi195.stdout:7/559: stat d4/d16/dd/d22/d3f/d54/da9 0 2024-04-06T12:23:11.855 INFO:tasks.workunit.client.1.smithi195.stdout:2/685: truncate d2/d3f/d7d/fa0 2456029 0 2024-04-06T12:23:11.856 INFO:tasks.workunit.client.1.smithi195.stdout:4/621: unlink d4/d6/d38/d1a/d40/d20/d23/f31 0 2024-04-06T12:23:11.857 INFO:tasks.workunit.client.1.smithi195.stdout:9/661: dwrite d3/d10/d3b/d48/d9c/f84 [0,4194304] 0 2024-04-06T12:23:11.858 INFO:tasks.workunit.client.1.smithi195.stdout:5/713: mknod d0/da/dd/d1c/d5a/d62/d64/d67/cf5 0 2024-04-06T12:23:11.861 INFO:tasks.workunit.client.1.smithi195.stdout:8/656: creat d6/d8/daa/fe1 x:0 0 0 2024-04-06T12:23:11.861 INFO:tasks.workunit.client.1.smithi195.stdout:2/686: read d2/d41/d5a/fc4 [672037,116246] 0 2024-04-06T12:23:11.861 INFO:tasks.workunit.client.1.smithi195.stdout:4/622: read d4/d8c/d96/f97 [443168,102993] 0 2024-04-06T12:23:11.863 INFO:tasks.workunit.client.1.smithi195.stdout:6/739: getdents d8/d21/d2b/d46/d44 0 2024-04-06T12:23:11.868 INFO:tasks.workunit.client.1.smithi195.stdout:1/651: dread d4/d14/d17/d3a/f76 [4194304,4194304] 0 2024-04-06T12:23:11.868 INFO:tasks.workunit.client.1.smithi195.stdout:3/720: dwrite d4/d9/d2b/f32 [0,4194304] 0 2024-04-06T12:23:11.873 INFO:tasks.workunit.client.1.smithi195.stdout:0/670: getdents d4/d53/d81/da9 0 2024-04-06T12:23:11.874 INFO:tasks.workunit.client.1.smithi195.stdout:5/714: dwrite d0/da/d23/d38/f44 [0,4194304] 0 2024-04-06T12:23:11.879 INFO:tasks.workunit.client.1.smithi195.stdout:9/662: mkdir d3/db9/dd8 0 2024-04-06T12:23:11.880 INFO:tasks.workunit.client.1.smithi195.stdout:1/652: mknod d4/d14/d17/dc1/ccd 0 2024-04-06T12:23:11.883 INFO:tasks.workunit.client.1.smithi195.stdout:0/671: creat d4/d6/d58/da7/fd7 x:0 0 0 2024-04-06T12:23:11.884 INFO:tasks.workunit.client.1.smithi195.stdout:0/672: fdatasync d4/d48/d77/d97/db7/f9b 0 2024-04-06T12:23:11.887 INFO:tasks.workunit.client.1.smithi195.stdout:8/657: creat d6/dd/d70/d24/d25/fe2 x:0 0 0 2024-04-06T12:23:11.888 INFO:tasks.workunit.client.1.smithi195.stdout:9/663: mknod d3/d10/d3b/d50/cd9 0 2024-04-06T12:23:11.889 INFO:tasks.workunit.client.1.smithi195.stdout:8/658: write d6/d3a/d46/f71 [730545,89102] 0 2024-04-06T12:23:11.891 INFO:tasks.workunit.client.1.smithi195.stdout:1/653: creat d4/d14/d17/d24/d99/d4e/d8f/dbe/fce x:0 0 0 2024-04-06T12:23:11.893 INFO:tasks.workunit.client.1.smithi195.stdout:0/673: dwrite d4/d6/d1a/f72 [0,4194304] 0 2024-04-06T12:23:11.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/721: link d4/df/f8f d4/de/d8e/fec 0 2024-04-06T12:23:11.894 INFO:tasks.workunit.client.1.smithi195.stdout:1/654: write d4/d14/d17/d24/f27 [928600,120168] 0 2024-04-06T12:23:11.895 INFO:tasks.workunit.client.1.smithi195.stdout:0/674: dread - d4/d6/f5f zero size 2024-04-06T12:23:11.895 INFO:tasks.workunit.client.1.smithi195.stdout:3/722: chown d4/d9/dcf/fd6 9 1 2024-04-06T12:23:11.895 INFO:tasks.workunit.client.1.smithi195.stdout:7/560: dread d4/f34 [0,4194304] 0 2024-04-06T12:23:11.896 INFO:tasks.workunit.client.1.smithi195.stdout:9/664: symlink d3/d10/d3a/d6b/lda 0 2024-04-06T12:23:11.899 INFO:tasks.workunit.client.1.smithi195.stdout:6/740: getdents d8/d3d/d5e/d72 0 2024-04-06T12:23:11.900 INFO:tasks.workunit.client.1.smithi195.stdout:6/741: chown d8/d21/d31/d49/c100 14435 1 2024-04-06T12:23:11.901 INFO:tasks.workunit.client.1.smithi195.stdout:5/715: rename d0/c26 to d0/da/d23/d38/d41/cf6 0 2024-04-06T12:23:11.902 INFO:tasks.workunit.client.1.smithi195.stdout:2/687: truncate d2/d14/f31 5456290 0 2024-04-06T12:23:11.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/623: dread d4/d3e/f52 [0,4194304] 0 2024-04-06T12:23:11.903 INFO:tasks.workunit.client.1.smithi195.stdout:2/688: write d2/d14/f22 [2900716,50184] 0 2024-04-06T12:23:11.904 INFO:tasks.workunit.client.1.smithi195.stdout:4/624: chown d4/d6/d38/d65/fa3 7999022 1 2024-04-06T12:23:11.904 INFO:tasks.workunit.client.1.smithi195.stdout:2/689: write d2/d3f/d7d/f73 [4026056,76160] 0 2024-04-06T12:23:11.905 INFO:tasks.workunit.client.1.smithi195.stdout:0/675: symlink d4/d6/d58/da7/ld8 0 2024-04-06T12:23:11.908 INFO:tasks.workunit.client.1.smithi195.stdout:0/676: fsync d4/d6/f6b 0 2024-04-06T12:23:11.908 INFO:tasks.workunit.client.1.smithi195.stdout:3/723: creat d4/d9/d2b/d3b/d5e/dab/fed x:0 0 0 2024-04-06T12:23:11.908 INFO:tasks.workunit.client.1.smithi195.stdout:7/561: creat d4/d16/dd/d22/d3f/d54/fb4 x:0 0 0 2024-04-06T12:23:11.910 INFO:tasks.workunit.client.1.smithi195.stdout:5/716: unlink d0/da/d23/f45 0 2024-04-06T12:23:11.911 INFO:tasks.workunit.client.1.smithi195.stdout:0/677: chown d4/d6/d1a/f47 467841 1 2024-04-06T12:23:11.913 INFO:tasks.workunit.client.1.smithi195.stdout:6/742: read d8/d21/d2b/d46/d44/d86/fff [531350,95770] 0 2024-04-06T12:23:11.913 INFO:tasks.workunit.client.1.smithi195.stdout:1/655: symlink d4/d14/d17/d3a/da8/da4/db2/d28/lcf 0 2024-04-06T12:23:11.913 INFO:tasks.workunit.client.1.smithi195.stdout:9/665: rmdir d3/d10/d4f 39 2024-04-06T12:23:11.914 INFO:tasks.workunit.client.1.smithi195.stdout:6/743: fdatasync d8/d3d/d5e/dd3/dfe/f76 0 2024-04-06T12:23:11.917 INFO:tasks.workunit.client.1.smithi195.stdout:2/690: rename d2/d3f/d7d/d7a/f93 to d2/d21/d2c/d2d/d92/fd6 0 2024-04-06T12:23:11.917 INFO:tasks.workunit.client.1.smithi195.stdout:4/625: dread d4/f4a [0,4194304] 0 2024-04-06T12:23:11.918 INFO:tasks.workunit.client.1.smithi195.stdout:2/691: stat d2/d21/d2c/d2d/f30 0 2024-04-06T12:23:11.918 INFO:tasks.workunit.client.1.smithi195.stdout:4/626: chown d4/d6/d38/f2c 0 1 2024-04-06T12:23:11.921 INFO:tasks.workunit.client.1.smithi195.stdout:3/724: symlink d4/d9/d2b/d3b/d5e/lee 0 2024-04-06T12:23:11.927 INFO:tasks.workunit.client.1.smithi195.stdout:6/744: creat d8/d3d/d5e/d72/d10c/d82/f11e x:0 0 0 2024-04-06T12:23:11.927 INFO:tasks.workunit.client.1.smithi195.stdout:8/659: getdents d6/dd/d70/d24/d34/d67/da1/da2 0 2024-04-06T12:23:11.928 INFO:tasks.workunit.client.1.smithi195.stdout:9/666: rename d3/d10/d3b/d48/d5e/c9d to d3/d10/d3b/d50/cdb 0 2024-04-06T12:23:11.929 INFO:tasks.workunit.client.1.smithi195.stdout:6/745: write d8/d21/d31/fbc [273303,105954] 0 2024-04-06T12:23:11.930 INFO:tasks.workunit.client.1.smithi195.stdout:5/717: dwrite d0/f6 [0,4194304] 0 2024-04-06T12:23:11.930 INFO:tasks.workunit.client.1.smithi195.stdout:7/562: dread d4/d10/d18/d19/f43 [0,4194304] 0 2024-04-06T12:23:11.935 INFO:tasks.workunit.client.1.smithi195.stdout:2/692: symlink d2/d21/ld7 0 2024-04-06T12:23:11.936 INFO:tasks.workunit.client.1.smithi195.stdout:5/718: write d0/da/d23/d38/f60 [2140144,61764] 0 2024-04-06T12:23:11.936 INFO:tasks.workunit.client.1.smithi195.stdout:7/563: truncate d4/d16/d11/fb2 1046114 0 2024-04-06T12:23:11.938 INFO:tasks.workunit.client.1.smithi195.stdout:3/725: mkdir d4/d9/d2b/d77/d9a/def 0 2024-04-06T12:23:11.939 INFO:tasks.workunit.client.1.smithi195.stdout:2/693: read d2/d21/d2c/d2d/f57 [949344,59188] 0 2024-04-06T12:23:11.939 INFO:tasks.workunit.client.1.smithi195.stdout:6/746: mknod d8/d21/d31/d6c/d7b/c11f 0 2024-04-06T12:23:11.939 INFO:tasks.workunit.client.1.smithi195.stdout:5/719: chown d0/da/dd/d2e/d6f 6 1 2024-04-06T12:23:11.944 INFO:tasks.workunit.client.1.smithi195.stdout:4/627: dwrite d4/d6/fbc [0,4194304] 0 2024-04-06T12:23:11.945 INFO:tasks.workunit.client.1.smithi195.stdout:6/747: write d8/d3d/d5e/f8f [526828,119373] 0 2024-04-06T12:23:11.945 INFO:tasks.workunit.client.1.smithi195.stdout:2/694: symlink d2/d41/d84/d8d/ld8 0 2024-04-06T12:23:11.949 INFO:tasks.workunit.client.1.smithi195.stdout:5/720: creat d0/da/dd/d1c/d5a/d62/db8/ff7 x:0 0 0 2024-04-06T12:23:11.951 INFO:tasks.workunit.client.1.smithi195.stdout:6/748: creat d8/d21/d31/d6c/ded/f120 x:0 0 0 2024-04-06T12:23:11.951 INFO:tasks.workunit.client.1.smithi195.stdout:9/667: dwrite d3/de/fb1 [0,4194304] 0 2024-04-06T12:23:11.952 INFO:tasks.workunit.client.1.smithi195.stdout:4/628: write d4/d6/d38/d65/f84 [1807707,17545] 0 2024-04-06T12:23:11.954 INFO:tasks.workunit.client.1.smithi195.stdout:2/695: mkdir d2/d21/d2c/d2d/d92/d95/d9b/dd9 0 2024-04-06T12:23:11.957 INFO:tasks.workunit.client.1.smithi195.stdout:3/726: dwrite d4/d9/d37/f7d [0,4194304] 0 2024-04-06T12:23:11.957 INFO:tasks.workunit.client.1.smithi195.stdout:8/660: dread d6/dd/d70/d24/f32 [0,4194304] 0 2024-04-06T12:23:11.957 INFO:tasks.workunit.client.1.smithi195.stdout:7/564: truncate d4/f7 1079408 0 2024-04-06T12:23:11.959 INFO:tasks.workunit.client.1.smithi195.stdout:9/668: readlink d3/d10/d3b/l4c 0 2024-04-06T12:23:11.959 INFO:tasks.workunit.client.1.smithi195.stdout:4/629: unlink d4/d6/cb1 0 2024-04-06T12:23:11.961 INFO:tasks.workunit.client.1.smithi195.stdout:6/749: creat d8/d3d/d5e/dd3/dfe/f121 x:0 0 0 2024-04-06T12:23:11.963 INFO:tasks.workunit.client.1.smithi195.stdout:9/669: chown d3/de/c26 18 1 2024-04-06T12:23:11.964 INFO:tasks.workunit.client.1.smithi195.stdout:2/696: mknod d2/d41/d84/d8d/d94/cda 0 2024-04-06T12:23:11.969 INFO:tasks.workunit.client.1.smithi195.stdout:7/565: symlink d4/d16/dd/d22/d3f/d54/lb5 0 2024-04-06T12:23:11.969 INFO:tasks.workunit.client.1.smithi195.stdout:6/750: fdatasync d8/d3d/d5e/d72/fc2 0 2024-04-06T12:23:11.976 INFO:tasks.workunit.client.1.smithi195.stdout:5/721: dread d0/da/d23/dd4/f8b [0,4194304] 0 2024-04-06T12:23:11.976 INFO:tasks.workunit.client.1.smithi195.stdout:4/630: dread d4/f62 [0,4194304] 0 2024-04-06T12:23:11.977 INFO:tasks.workunit.client.1.smithi195.stdout:8/661: dwrite d6/dd/d42/fcd [0,4194304] 0 2024-04-06T12:23:11.978 INFO:tasks.workunit.client.1.smithi195.stdout:8/662: fsync d6/d3a/f4d 0 2024-04-06T12:23:11.981 INFO:tasks.workunit.client.1.smithi195.stdout:7/566: dread d4/d16/f1b [0,4194304] 0 2024-04-06T12:23:11.986 INFO:tasks.workunit.client.1.smithi195.stdout:2/697: dread d2/f61 [0,4194304] 0 2024-04-06T12:23:11.987 INFO:tasks.workunit.client.1.smithi195.stdout:8/663: unlink d6/d8/d12/ca7 0 2024-04-06T12:23:11.987 INFO:tasks.workunit.client.1.smithi195.stdout:7/567: dread d4/d10/d12/f14 [4194304,4194304] 0 2024-04-06T12:23:11.988 INFO:tasks.workunit.client.1.smithi195.stdout:4/631: mkdir d4/d6/d38/d65/dc5 0 2024-04-06T12:23:11.991 INFO:tasks.workunit.client.1.smithi195.stdout:6/751: rename d8/d21/d31/d6c/d7b/d11b/f53 to d8/d21/d31/d6c/f122 0 2024-04-06T12:23:11.991 INFO:tasks.workunit.client.1.smithi195.stdout:7/568: fdatasync d4/d24/d80/f9c 0 2024-04-06T12:23:11.992 INFO:tasks.workunit.client.1.smithi195.stdout:8/664: mkdir d6/d8/d52/de3 0 2024-04-06T12:23:11.993 INFO:tasks.workunit.client.1.smithi195.stdout:2/698: dread d2/d21/d69/d6b/f6e [0,4194304] 0 2024-04-06T12:23:11.995 INFO:tasks.workunit.client.1.smithi195.stdout:4/632: mkdir d4/d8c/d96/dc6 0 2024-04-06T12:23:11.997 INFO:tasks.workunit.client.1.smithi195.stdout:5/722: getdents d0/da/d23/d7a 0 2024-04-06T12:23:12.000 INFO:tasks.workunit.client.1.smithi195.stdout:8/665: fsync d6/dd/d70/d24/d53/f68 0 2024-04-06T12:23:12.001 INFO:tasks.workunit.client.1.smithi195.stdout:3/727: dread d4/d9/d2b/d3b/d5e/d7e/f7f [0,4194304] 0 2024-04-06T12:23:12.003 INFO:tasks.workunit.client.1.smithi195.stdout:9/670: dread d3/de/f1c [0,4194304] 0 2024-04-06T12:23:12.004 INFO:tasks.workunit.client.1.smithi195.stdout:6/752: dwrite d8/d21/d31/d26/dc8/f55 [0,4194304] 0 2024-04-06T12:23:12.004 INFO:tasks.workunit.client.1.smithi195.stdout:5/723: mknod d0/da/dd/d1c/d5a/d62/d64/cf8 0 2024-04-06T12:23:12.004 INFO:tasks.workunit.client.1.smithi195.stdout:2/699: dwrite d2/d21/d29/f34 [0,4194304] 0 2024-04-06T12:23:12.006 INFO:tasks.workunit.client.1.smithi195.stdout:7/569: rename d4/d10/d18/d19/d63/c9f to d4/d24/d80/cb6 0 2024-04-06T12:23:12.009 INFO:tasks.workunit.client.1.smithi195.stdout:6/753: write d8/d3d/fd5 [430599,46077] 0 2024-04-06T12:23:12.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/666: fsync d6/d8/d52/fc1 0 2024-04-06T12:23:12.011 INFO:tasks.workunit.client.1.smithi195.stdout:3/728: fsync d4/f69 0 2024-04-06T12:23:12.013 INFO:tasks.workunit.client.1.smithi195.stdout:2/700: fsync d2/d3f/f60 0 2024-04-06T12:23:12.014 INFO:tasks.workunit.client.1.smithi195.stdout:9/671: symlink d3/d10/d7d/dd0/ldc 0 2024-04-06T12:23:12.014 INFO:tasks.workunit.client.1.smithi195.stdout:4/633: rename d4/d3e/l76 to d4/d6/d38/d1a/d40/d20/lc7 0 2024-04-06T12:23:12.022 INFO:tasks.workunit.client.1.smithi195.stdout:9/672: chown d3/d10 1460106 1 2024-04-06T12:23:12.026 INFO:tasks.workunit.client.1.smithi195.stdout:5/724: dwrite d0/da/dd/fe0 [0,4194304] 0 2024-04-06T12:23:12.027 INFO:tasks.workunit.client.1.smithi195.stdout:4/634: dread d4/d3e/f52 [4194304,4194304] 0 2024-04-06T12:23:12.028 INFO:tasks.workunit.client.1.smithi195.stdout:4/635: fdatasync d4/d8c/fc0 0 2024-04-06T12:23:12.030 INFO:tasks.workunit.client.1.smithi195.stdout:8/667: dwrite d6/dd/d42/f9b [0,4194304] 0 2024-04-06T12:23:12.037 INFO:tasks.workunit.client.1.smithi195.stdout:8/668: dread d6/d8/f35 [0,4194304] 0 2024-04-06T12:23:12.039 INFO:tasks.workunit.client.1.smithi195.stdout:8/669: truncate d6/dd/d70/d24/d34/d67/da1/da2/da4/fc0 163451 0 2024-04-06T12:23:12.041 INFO:tasks.workunit.client.1.smithi195.stdout:3/729: mkdir d4/de/d8e/d92/d9e/df0 0 2024-04-06T12:23:12.045 INFO:tasks.workunit.client.1.smithi195.stdout:2/701: rename d2/d21/d29/f2b to d2/d41/d84/fdb 0 2024-04-06T12:23:12.047 INFO:tasks.workunit.client.1.smithi195.stdout:5/725: rmdir d0/da/dd/d1c/d5a/d62 39 2024-04-06T12:23:12.054 INFO:tasks.workunit.client.1.smithi195.stdout:8/670: unlink d6/d8/f99 0 2024-04-06T12:23:12.055 INFO:tasks.workunit.client.1.smithi195.stdout:7/570: mknod d4/d10/d12/da5/da3/cb7 0 2024-04-06T12:23:12.057 INFO:tasks.workunit.client.1.smithi195.stdout:7/571: truncate d4/d10/d18/d33/d6e/f94 284387 0 2024-04-06T12:23:12.058 INFO:tasks.workunit.client.1.smithi195.stdout:8/671: dread d6/d8/f35 [0,4194304] 0 2024-04-06T12:23:12.058 INFO:tasks.workunit.client.1.smithi195.stdout:7/572: fsync d4/d16/d11/f59 0 2024-04-06T12:23:12.059 INFO:tasks.workunit.client.1.smithi195.stdout:8/672: dread - d6/d3a/fd1 zero size 2024-04-06T12:23:12.059 INFO:tasks.workunit.client.1.smithi195.stdout:9/673: rename d3/d10/l40 to d3/d10/d4f/ldd 0 2024-04-06T12:23:12.060 INFO:tasks.workunit.client.1.smithi195.stdout:5/726: creat d0/da/dd/d33/ff9 x:0 0 0 2024-04-06T12:23:12.061 INFO:tasks.workunit.client.1.smithi195.stdout:9/674: fdatasync d3/d10/d3b/d48/d5e/fac 0 2024-04-06T12:23:12.063 INFO:tasks.workunit.client.1.smithi195.stdout:3/730: symlink d4/de/d8e/dbb/de8/lf1 0 2024-04-06T12:23:12.064 INFO:tasks.workunit.client.1.smithi195.stdout:2/702: mkdir d2/ddc 0 2024-04-06T12:23:12.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/731: write d4/df/f6f [4806680,38539] 0 2024-04-06T12:23:12.065 INFO:tasks.workunit.client.1.smithi195.stdout:8/673: creat d6/d8/d52/fe4 x:0 0 0 2024-04-06T12:23:12.065 INFO:tasks.workunit.client.1.smithi195.stdout:2/703: read - d2/d14/fb1 zero size 2024-04-06T12:23:12.067 INFO:tasks.workunit.client.1.smithi195.stdout:7/573: rename d4/d16/dd/f28 to d4/d16/dd/d22/d76/fb8 0 2024-04-06T12:23:12.068 INFO:tasks.workunit.client.1.smithi195.stdout:8/674: chown d6/dd/d70/cb8 6944 1 2024-04-06T12:23:12.068 INFO:tasks.workunit.client.1.smithi195.stdout:2/704: write d2/d21/d29/f4b [55483,23860] 0 2024-04-06T12:23:12.068 INFO:tasks.workunit.client.1.smithi195.stdout:5/727: dwrite d0/da/d23/d38/f60 [0,4194304] 0 2024-04-06T12:23:12.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/675: unlink d3/fa6 0 2024-04-06T12:23:12.074 INFO:tasks.workunit.client.1.smithi195.stdout:3/732: creat d4/d9/d37/ff2 x:0 0 0 2024-04-06T12:23:12.074 INFO:tasks.workunit.client.1.smithi195.stdout:2/705: dread d2/d21/d2c/d2d/d92/d95/d9b/fd5 [0,4194304] 0 2024-04-06T12:23:12.075 INFO:tasks.workunit.client.1.smithi195.stdout:4/636: getdents d4/d8c 0 2024-04-06T12:23:12.082 INFO:tasks.workunit.client.1.smithi195.stdout:2/706: mkdir d2/d41/d5a/ddd 0 2024-04-06T12:23:12.083 INFO:tasks.workunit.client.1.smithi195.stdout:7/574: dwrite d4/d16/d11/f59 [0,4194304] 0 2024-04-06T12:23:12.084 INFO:tasks.workunit.client.1.smithi195.stdout:2/707: write d2/d21/d69/d6b/fbf [499171,27926] 0 2024-04-06T12:23:12.085 INFO:tasks.workunit.client.1.smithi195.stdout:4/637: rename d4/d6/d38/f51 to d4/d8c/d96/dc6/fc8 0 2024-04-06T12:23:12.087 INFO:tasks.workunit.client.1.smithi195.stdout:8/675: mknod d6/d8/ce5 0 2024-04-06T12:23:12.088 INFO:tasks.workunit.client.1.smithi195.stdout:4/638: read d4/d6/d38/d1a/d40/d20/f61 [4244520,7065] 0 2024-04-06T12:23:12.090 INFO:tasks.workunit.client.1.smithi195.stdout:2/708: read d2/d21/d2c/d2d/f76 [3569593,123004] 0 2024-04-06T12:23:12.099 INFO:tasks.workunit.client.1.smithi195.stdout:2/709: dwrite d2/d41/f49 [0,4194304] 0 2024-04-06T12:23:12.099 INFO:tasks.workunit.client.1.smithi195.stdout:9/676: creat d3/fde x:0 0 0 2024-04-06T12:23:12.100 INFO:tasks.workunit.client.1.smithi195.stdout:4/639: mkdir d4/d8c/d96/dc9 0 2024-04-06T12:23:12.101 INFO:tasks.workunit.client.1.smithi195.stdout:7/575: dwrite d4/d16/f47 [4194304,4194304] 0 2024-04-06T12:23:12.101 INFO:tasks.workunit.client.1.smithi195.stdout:2/710: chown d2/d41/d84/d8d/d94/db6 31054 1 2024-04-06T12:23:12.104 INFO:tasks.workunit.client.1.smithi195.stdout:0/678: sync 2024-04-06T12:23:12.104 INFO:tasks.workunit.client.1.smithi195.stdout:1/656: sync 2024-04-06T12:23:12.108 INFO:tasks.workunit.client.1.smithi195.stdout:9/677: unlink d3/d10/d3a/f45 0 2024-04-06T12:23:12.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/640: chown d4/d6/d38/d1a/l87 0 1 2024-04-06T12:23:12.114 INFO:tasks.workunit.client.1.smithi195.stdout:9/678: mkdir d3/de/ddf 0 2024-04-06T12:23:12.115 INFO:tasks.workunit.client.1.smithi195.stdout:0/679: symlink d4/dd5/ld9 0 2024-04-06T12:23:12.115 INFO:tasks.workunit.client.1.smithi195.stdout:4/641: stat d4/d6/d38/d1a/l30 0 2024-04-06T12:23:12.117 INFO:tasks.workunit.client.1.smithi195.stdout:8/676: dwrite d6/db/f66 [0,4194304] 0 2024-04-06T12:23:12.124 INFO:tasks.workunit.client.1.smithi195.stdout:5/728: dread d0/da/dd/d2e/f59 [0,4194304] 0 2024-04-06T12:23:12.124 INFO:tasks.workunit.client.1.smithi195.stdout:1/657: truncate d4/d14/d17/f53 3246549 0 2024-04-06T12:23:12.126 INFO:tasks.workunit.client.1.smithi195.stdout:2/711: getdents d2/d21/d5e/d64 0 2024-04-06T12:23:12.128 INFO:tasks.workunit.client.1.smithi195.stdout:4/642: chown d4/f5e 1 1 2024-04-06T12:23:12.130 INFO:tasks.workunit.client.1.smithi195.stdout:3/733: dread d4/df/d39/f98 [0,4194304] 0 2024-04-06T12:23:12.132 INFO:tasks.workunit.client.1.smithi195.stdout:0/680: dwrite d4/fc8 [0,4194304] 0 2024-04-06T12:23:12.133 INFO:tasks.workunit.client.1.smithi195.stdout:9/679: read d3/d10/f2f [47515,123056] 0 2024-04-06T12:23:12.133 INFO:tasks.workunit.client.1.smithi195.stdout:5/729: mknod d0/da/d13/d87/cfa 0 2024-04-06T12:23:12.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/677: dread d6/d8/f35 [0,4194304] 0 2024-04-06T12:23:12.134 INFO:tasks.workunit.client.1.smithi195.stdout:4/643: fdatasync d4/d3e/f78 0 2024-04-06T12:23:12.135 INFO:tasks.workunit.client.1.smithi195.stdout:2/712: creat d2/d21/d2c/d2d/fde x:0 0 0 2024-04-06T12:23:12.135 INFO:tasks.workunit.client.1.smithi195.stdout:1/658: mkdir d4/d14/d17/d3a/da8/db8/dd0 0 2024-04-06T12:23:12.137 INFO:tasks.workunit.client.1.smithi195.stdout:1/659: chown d4/d14/d17/d3a/da8/da4/db2/d5d/fa6 88415323 1 2024-04-06T12:23:12.138 INFO:tasks.workunit.client.1.smithi195.stdout:2/713: dread d2/d21/d2c/d2d/d92/d95/d9b/fd5 [0,4194304] 0 2024-04-06T12:23:12.138 INFO:tasks.workunit.client.1.smithi195.stdout:3/734: rmdir d4/d9/d2b/d3b/d5e 39 2024-04-06T12:23:12.141 INFO:tasks.workunit.client.1.smithi195.stdout:0/681: creat d4/d6/d2f/fda x:0 0 0 2024-04-06T12:23:12.141 INFO:tasks.workunit.client.1.smithi195.stdout:7/576: dread d4/d10/d18/d19/f9e [0,4194304] 0 2024-04-06T12:23:12.142 INFO:tasks.workunit.client.1.smithi195.stdout:0/682: chown d4/d6/lf 4 1 2024-04-06T12:23:12.142 INFO:tasks.workunit.client.1.smithi195.stdout:5/730: mkdir d0/da/d23/dd4/dc2/dfb 0 2024-04-06T12:23:12.145 INFO:tasks.workunit.client.1.smithi195.stdout:4/644: rename d4/d6/d38/d1a/d40/l9b to d4/d6/d38/d65/d7a/lca 0 2024-04-06T12:23:12.146 INFO:tasks.workunit.client.1.smithi195.stdout:2/714: mknod d2/d41/d84/d8d/d94/cdf 0 2024-04-06T12:23:12.147 INFO:tasks.workunit.client.1.smithi195.stdout:1/660: symlink d4/d14/d17/d24/d99/d88/dbf/ld1 0 2024-04-06T12:23:12.148 INFO:tasks.workunit.client.1.smithi195.stdout:3/735: truncate d4/d9/d37/f3a 793357 0 2024-04-06T12:23:12.151 INFO:tasks.workunit.client.1.smithi195.stdout:0/683: chown d4/d6/d58/fc4 681820 1 2024-04-06T12:23:12.152 INFO:tasks.workunit.client.1.smithi195.stdout:7/577: rmdir d4/d16/dd/d22/d3f 39 2024-04-06T12:23:12.155 INFO:tasks.workunit.client.1.smithi195.stdout:5/731: dwrite d0/da/d13/d87/f57 [0,4194304] 0 2024-04-06T12:23:12.155 INFO:tasks.workunit.client.1.smithi195.stdout:2/715: write d2/d41/d84/fb7 [205159,129673] 0 2024-04-06T12:23:12.157 INFO:tasks.workunit.client.1.smithi195.stdout:1/661: fsync d4/d14/d17/d24/d99/f29 0 2024-04-06T12:23:12.157 INFO:tasks.workunit.client.1.smithi195.stdout:0/684: creat d4/d48/d67/d83/fdb x:0 0 0 2024-04-06T12:23:12.161 INFO:tasks.workunit.client.1.smithi195.stdout:3/736: mknod d4/d9/d2b/d3b/d40/de2/cf3 0 2024-04-06T12:23:12.162 INFO:tasks.workunit.client.1.smithi195.stdout:4/645: dwrite d4/d6d/da6/dae/fb4 [0,4194304] 0 2024-04-06T12:23:12.163 INFO:tasks.workunit.client.1.smithi195.stdout:7/578: truncate d4/d10/d18/d19/f50 511093 0 2024-04-06T12:23:12.164 INFO:tasks.workunit.client.1.smithi195.stdout:2/716: mkdir d2/d41/d84/d8d/de0 0 2024-04-06T12:23:12.165 INFO:tasks.workunit.client.1.smithi195.stdout:0/685: fsync d4/d6/d1a/d73/fb9 0 2024-04-06T12:23:12.166 INFO:tasks.workunit.client.1.smithi195.stdout:5/732: rename d0/da/d23/c29 to d0/da/d23/dd4/cfc 0 2024-04-06T12:23:12.171 INFO:tasks.workunit.client.1.smithi195.stdout:9/680: dwrite d3/d10/d3b/d48/f69 [0,4194304] 0 2024-04-06T12:23:12.171 INFO:tasks.workunit.client.1.smithi195.stdout:7/579: write d4/d16/dd/f2a [2421933,69691] 0 2024-04-06T12:23:12.171 INFO:tasks.workunit.client.1.smithi195.stdout:0/686: dread - d4/d48/d67/d83/fdb zero size 2024-04-06T12:23:12.172 INFO:tasks.workunit.client.1.smithi195.stdout:4/646: mknod d4/d8c/d96/ccb 0 2024-04-06T12:23:12.175 INFO:tasks.workunit.client.1.smithi195.stdout:1/662: symlink d4/d14/d17/d24/d99/d4e/d60/dc4/ld2 0 2024-04-06T12:23:12.178 INFO:tasks.workunit.client.1.smithi195.stdout:9/681: creat d3/de/fe0 x:0 0 0 2024-04-06T12:23:12.180 INFO:tasks.workunit.client.1.smithi195.stdout:2/717: creat d2/d21/d5e/fe1 x:0 0 0 2024-04-06T12:23:12.181 INFO:tasks.workunit.client.1.smithi195.stdout:1/663: creat d4/d14/d17/d3a/da8/fd3 x:0 0 0 2024-04-06T12:23:12.181 INFO:tasks.workunit.client.1.smithi195.stdout:3/737: dread d4/d9/d2b/d3b/d40/f55 [0,4194304] 0 2024-04-06T12:23:12.181 INFO:tasks.workunit.client.1.smithi195.stdout:5/733: symlink d0/da/dd/d2e/d6f/dab/df3/lfd 0 2024-04-06T12:23:12.210 INFO:tasks.workunit.client.1.smithi195.stdout:6/754: sync 2024-04-06T12:23:12.223 INFO:tasks.workunit.client.1.smithi195.stdout:7/580: symlink d4/d10/d18/lb9 0 2024-04-06T12:23:12.223 INFO:tasks.workunit.client.1.smithi195.stdout:9/682: unlink d3/d10/d3b/d50/ca5 0 2024-04-06T12:23:12.226 INFO:tasks.workunit.client.1.smithi195.stdout:5/734: write d0/da/dd/d2e/f6c [5525139,49924] 0 2024-04-06T12:23:12.227 INFO:tasks.workunit.client.1.smithi195.stdout:7/581: symlink d4/d10/lba 0 2024-04-06T12:23:12.227 INFO:tasks.workunit.client.1.smithi195.stdout:1/664: read d4/d14/d17/d24/d2a/d5a/daa/fad [347665,71012] 0 2024-04-06T12:23:12.228 INFO:tasks.workunit.client.1.smithi195.stdout:2/718: getdents d2/d21/d69/d6b 0 2024-04-06T12:23:12.229 INFO:tasks.workunit.client.1.smithi195.stdout:6/755: symlink d8/d3d/d5e/de0/l123 0 2024-04-06T12:23:12.231 INFO:tasks.workunit.client.1.smithi195.stdout:9/683: creat d3/d10/d7d/dd0/fe1 x:0 0 0 2024-04-06T12:23:12.231 INFO:tasks.workunit.client.1.smithi195.stdout:1/665: chown d4/d14/d17/f8c 53 1 2024-04-06T12:23:12.232 INFO:tasks.workunit.client.1.smithi195.stdout:6/756: chown d8/d21/d31/d49/c100 263997085 1 2024-04-06T12:23:12.232 INFO:tasks.workunit.client.1.smithi195.stdout:3/738: creat d4/d9/d2b/d3b/d40/ff4 x:0 0 0 2024-04-06T12:23:12.232 INFO:tasks.workunit.client.1.smithi195.stdout:5/735: mkdir d0/da/d23/dd4/dfe 0 2024-04-06T12:23:12.235 INFO:tasks.workunit.client.1.smithi195.stdout:6/757: fsync d8/d21/d2b/d46/d44/f56 0 2024-04-06T12:23:12.235 INFO:tasks.workunit.client.1.smithi195.stdout:0/687: dread d4/d41/f69 [0,4194304] 0 2024-04-06T12:23:12.236 INFO:tasks.workunit.client.1.smithi195.stdout:7/582: write d4/d16/dd/d22/d3f/d54/f90 [26814,82959] 0 2024-04-06T12:23:12.238 INFO:tasks.workunit.client.1.smithi195.stdout:6/758: fsync d8/d21/d31/d6c/ded/ff3 0 2024-04-06T12:23:12.243 INFO:tasks.workunit.client.1.smithi195.stdout:1/666: dwrite d4/d14/d17/d3a/f76 [4194304,4194304] 0 2024-04-06T12:23:12.246 INFO:tasks.workunit.client.1.smithi195.stdout:7/583: dread d4/d16/dd/d22/d76/fb8 [0,4194304] 0 2024-04-06T12:23:12.247 INFO:tasks.workunit.client.1.smithi195.stdout:0/688: rmdir d4/d41/d93 0 2024-04-06T12:23:12.249 INFO:tasks.workunit.client.1.smithi195.stdout:6/759: mkdir d8/d3d/d5e/d72/d10c/d9c/dce/d124 0 2024-04-06T12:23:12.252 INFO:tasks.workunit.client.1.smithi195.stdout:5/736: getdents d0/da/d23/d38 0 2024-04-06T12:23:12.256 INFO:tasks.workunit.client.1.smithi195.stdout:2/719: truncate d2/d14/f1d 3589059 0 2024-04-06T12:23:12.256 INFO:tasks.workunit.client.1.smithi195.stdout:0/689: dwrite d4/d53/f87 [0,4194304] 0 2024-04-06T12:23:12.256 INFO:tasks.workunit.client.1.smithi195.stdout:5/737: dread - d0/da/dd/d2e/d6f/dab/fe9 zero size 2024-04-06T12:23:12.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/760: dread d8/d21/d31/fac [0,4194304] 0 2024-04-06T12:23:12.258 INFO:tasks.workunit.client.1.smithi195.stdout:0/690: stat d4/d6/f27 0 2024-04-06T12:23:12.259 INFO:tasks.workunit.client.1.smithi195.stdout:2/720: fsync d2/d41/d5a/fcd 0 2024-04-06T12:23:12.260 INFO:tasks.workunit.client.1.smithi195.stdout:3/739: dread d4/de/f84 [0,4194304] 0 2024-04-06T12:23:12.261 INFO:tasks.workunit.client.1.smithi195.stdout:7/584: unlink d4/d16/dd/c88 0 2024-04-06T12:23:12.263 INFO:tasks.workunit.client.1.smithi195.stdout:6/761: write d8/d3d/fd2 [832288,17205] 0 2024-04-06T12:23:12.264 INFO:tasks.workunit.client.1.smithi195.stdout:5/738: mknod d0/da/d13/d5e/d93/cff 0 2024-04-06T12:23:12.267 INFO:tasks.workunit.client.1.smithi195.stdout:9/684: dwrite d3/d10/d3b/d48/f4b [0,4194304] 0 2024-04-06T12:23:12.267 INFO:tasks.workunit.client.1.smithi195.stdout:0/691: truncate d4/d48/d67/faa 4648253 0 2024-04-06T12:23:12.269 INFO:tasks.workunit.client.1.smithi195.stdout:2/721: creat d2/d41/d5a/ddd/fe2 x:0 0 0 2024-04-06T12:23:12.270 INFO:tasks.workunit.client.1.smithi195.stdout:7/585: rename d4/d10/d18/l1d to d4/d10/d12/da5/lbb 0 2024-04-06T12:23:12.270 INFO:tasks.workunit.client.1.smithi195.stdout:1/667: truncate d4/d14/d17/d3a/da8/da4/db2/d5d/fa3 141949 0 2024-04-06T12:23:12.272 INFO:tasks.workunit.client.1.smithi195.stdout:2/722: chown d2/d21/f28 607 1 2024-04-06T12:23:12.272 INFO:tasks.workunit.client.1.smithi195.stdout:5/739: fsync d0/da/d23/f61 0 2024-04-06T12:23:12.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/586: write d4/d16/f1c [3085536,95905] 0 2024-04-06T12:23:12.274 INFO:tasks.workunit.client.1.smithi195.stdout:3/740: dwrite d4/f69 [0,4194304] 0 2024-04-06T12:23:12.275 INFO:tasks.workunit.client.1.smithi195.stdout:2/723: write d2/d3f/d7d/f73 [5222304,83852] 0 2024-04-06T12:23:12.275 INFO:tasks.workunit.client.1.smithi195.stdout:9/685: unlink d3/da1/lbe 0 2024-04-06T12:23:12.278 INFO:tasks.workunit.client.1.smithi195.stdout:6/762: symlink d8/d21/d2b/d46/d7f/l125 0 2024-04-06T12:23:12.283 INFO:tasks.workunit.client.1.smithi195.stdout:0/692: truncate d4/d6/d2f/d49/f52 674292 0 2024-04-06T12:23:12.283 INFO:tasks.workunit.client.1.smithi195.stdout:8/678: sync 2024-04-06T12:23:12.285 INFO:tasks.workunit.client.1.smithi195.stdout:8/679: write d6/d3a/d46/f8b [805741,77601] 0 2024-04-06T12:23:12.287 INFO:tasks.workunit.client.1.smithi195.stdout:8/680: truncate d6/d8/d12/f2f 809432 0 2024-04-06T12:23:12.287 INFO:tasks.workunit.client.1.smithi195.stdout:3/741: symlink d4/de/d8e/dbb/de8/lf5 0 2024-04-06T12:23:12.289 INFO:tasks.workunit.client.1.smithi195.stdout:2/724: mknod d2/d21/d2c/ce3 0 2024-04-06T12:23:12.290 INFO:tasks.workunit.client.1.smithi195.stdout:8/681: write d6/dd/d70/d24/d34/d67/da1/da2/da4/fc3 [183273,75549] 0 2024-04-06T12:23:12.293 INFO:tasks.workunit.client.1.smithi195.stdout:7/587: rename d4/d10/d12/f72 to d4/d10/d18/d33/d6e/fbc 0 2024-04-06T12:23:12.295 INFO:tasks.workunit.client.1.smithi195.stdout:0/693: symlink d4/d48/d77/d97/db7/ldc 0 2024-04-06T12:23:12.300 INFO:tasks.workunit.client.1.smithi195.stdout:0/694: mknod d4/dbc/dce/cdd 0 2024-04-06T12:23:12.301 INFO:tasks.workunit.client.1.smithi195.stdout:0/695: write d4/d48/d67/d83/fab [777552,65183] 0 2024-04-06T12:23:12.302 INFO:tasks.workunit.client.1.smithi195.stdout:0/696: fsync d4/d6/f6b 0 2024-04-06T12:23:12.303 INFO:tasks.workunit.client.1.smithi195.stdout:2/725: creat d2/ddc/fe4 x:0 0 0 2024-04-06T12:23:12.305 INFO:tasks.workunit.client.1.smithi195.stdout:7/588: link d4/d10/d12/da5/fa2 d4/d16/d11/fbd 0 2024-04-06T12:23:12.307 INFO:tasks.workunit.client.1.smithi195.stdout:1/668: dread d4/d14/d17/d3a/da8/da4/db2/d5d/fa3 [0,4194304] 0 2024-04-06T12:23:12.309 INFO:tasks.workunit.client.1.smithi195.stdout:2/726: mknod d2/d21/d2c/d2d/d92/d95/ce5 0 2024-04-06T12:23:12.309 INFO:tasks.workunit.client.1.smithi195.stdout:9/686: write d3/d10/d3b/d50/f8a [552595,88559] 0 2024-04-06T12:23:12.310 INFO:tasks.workunit.client.1.smithi195.stdout:2/727: stat d2/d3f/f42 0 2024-04-06T12:23:12.310 INFO:tasks.workunit.client.1.smithi195.stdout:7/589: dread d4/d16/dd/d22/d3f/d54/da9/f42 [0,4194304] 0 2024-04-06T12:23:12.312 INFO:tasks.workunit.client.1.smithi195.stdout:5/740: dread d0/da/d23/dd4/fa6 [0,4194304] 0 2024-04-06T12:23:12.314 INFO:tasks.workunit.client.1.smithi195.stdout:1/669: rmdir d4/d14/d17/d24 39 2024-04-06T12:23:12.317 INFO:tasks.workunit.client.1.smithi195.stdout:6/763: rename d8/d21/d31/d70/lde to d8/d21/d31/d6c/l126 0 2024-04-06T12:23:12.319 INFO:tasks.workunit.client.1.smithi195.stdout:4/647: sync 2024-04-06T12:23:12.320 INFO:tasks.workunit.client.1.smithi195.stdout:7/590: rmdir d4/d16/dd 39 2024-04-06T12:23:12.321 INFO:tasks.workunit.client.1.smithi195.stdout:2/728: truncate d2/f1c 5938701 0 2024-04-06T12:23:12.322 INFO:tasks.workunit.client.1.smithi195.stdout:0/697: dread d4/d6/d1a/d73/f74 [0,4194304] 0 2024-04-06T12:23:12.324 INFO:tasks.workunit.client.1.smithi195.stdout:3/742: rename d4/d9/d2b/d77/l7b to d4/de/d8e/d92/d9e/de4/lf6 0 2024-04-06T12:23:12.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/698: read d4/d41/f99 [161562,122593] 0 2024-04-06T12:23:12.325 INFO:tasks.workunit.client.1.smithi195.stdout:9/687: truncate d3/d10/d3a/d5d/f65 5825288 0 2024-04-06T12:23:12.332 INFO:tasks.workunit.client.1.smithi195.stdout:8/682: rename d6/d8 to d6/dd/d70/d24/d34/d67/da1/dbd/de6 0 2024-04-06T12:23:12.335 INFO:tasks.workunit.client.1.smithi195.stdout:3/743: creat d4/d9/d37/ff7 x:0 0 0 2024-04-06T12:23:12.335 INFO:tasks.workunit.client.1.smithi195.stdout:0/699: symlink d4/d6/d58/da7/lde 0 2024-04-06T12:23:12.337 INFO:tasks.workunit.client.1.smithi195.stdout:9/688: dread d3/d10/d3a/d6b/fbf [0,4194304] 0 2024-04-06T12:23:12.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/700: chown d4/d6/d58 1498 1 2024-04-06T12:23:12.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/683: dread - d6/dd/d70/d24/d34/d67/da1/dbd/de6/d52/f8d zero size 2024-04-06T12:23:12.338 INFO:tasks.workunit.client.1.smithi195.stdout:7/591: mkdir d4/d16/dd/d22/d3f/dbe 0 2024-04-06T12:23:12.339 INFO:tasks.workunit.client.1.smithi195.stdout:2/729: symlink d2/d21/d29/le6 0 2024-04-06T12:23:12.339 INFO:tasks.workunit.client.1.smithi195.stdout:8/684: write d6/dd/d70/d24/d25/f93 [2169765,110176] 0 2024-04-06T12:23:12.344 INFO:tasks.workunit.client.1.smithi195.stdout:5/741: rename d0/da/d23/dd4/dc2/cef to d0/da/d4b/c100 0 2024-04-06T12:23:12.346 INFO:tasks.workunit.client.1.smithi195.stdout:3/744: rmdir d4/de/d8e/d92/d9e 39 2024-04-06T12:23:12.347 INFO:tasks.workunit.client.1.smithi195.stdout:4/648: getdents d4/d8c 0 2024-04-06T12:23:12.349 INFO:tasks.workunit.client.1.smithi195.stdout:9/689: fsync d3/f24 0 2024-04-06T12:23:12.353 INFO:tasks.workunit.client.1.smithi195.stdout:7/592: symlink d4/d10/d18/d33/d6e/lbf 0 2024-04-06T12:23:12.353 INFO:tasks.workunit.client.1.smithi195.stdout:1/670: dwrite d4/d14/d17/d24/d99/f4d [0,4194304] 0 2024-04-06T12:23:12.355 INFO:tasks.workunit.client.1.smithi195.stdout:6/764: getdents d8/d3d/d5e/d72/d10c 0 2024-04-06T12:23:12.357 INFO:tasks.workunit.client.1.smithi195.stdout:5/742: rename d0/da/d13/d87/d34 to d0/da/dd/d1c/d5a/d68/dd7/d101 0 2024-04-06T12:23:12.359 INFO:tasks.workunit.client.1.smithi195.stdout:2/730: mkdir d2/d21/d29/de7 0 2024-04-06T12:23:12.365 INFO:tasks.workunit.client.1.smithi195.stdout:6/765: rename d8/d21/d2b/d46/d44/d86/cad to d8/d3d/d5e/d72/d10c/d9c/c127 0 2024-04-06T12:23:12.367 INFO:tasks.workunit.client.1.smithi195.stdout:9/690: unlink d3/d10/fc8 0 2024-04-06T12:23:12.367 INFO:tasks.workunit.client.1.smithi195.stdout:6/766: fsync d8/d3d/d5e/d72/d10c/d82/f11e 0 2024-04-06T12:23:12.367 INFO:tasks.workunit.client.1.smithi195.stdout:8/685: creat d6/db/d47/fe7 x:0 0 0 2024-04-06T12:23:12.368 INFO:tasks.workunit.client.1.smithi195.stdout:7/593: symlink d4/d10/d18/d19/lc0 0 2024-04-06T12:23:12.368 INFO:tasks.workunit.client.1.smithi195.stdout:1/671: mkdir d4/d14/d17/dd4 0 2024-04-06T12:23:12.371 INFO:tasks.workunit.client.1.smithi195.stdout:3/745: creat d4/d9/d2b/ff8 x:0 0 0 2024-04-06T12:23:12.371 INFO:tasks.workunit.client.1.smithi195.stdout:7/594: readlink d4/d16/dd/d22/d3f/d54/lb5 0 2024-04-06T12:23:12.372 INFO:tasks.workunit.client.1.smithi195.stdout:0/701: getdents d4/d6/d58 0 2024-04-06T12:23:12.374 INFO:tasks.workunit.client.1.smithi195.stdout:1/672: write d4/d14/d17/d24/d99/d4e/f52 [4119866,68256] 0 2024-04-06T12:23:12.374 INFO:tasks.workunit.client.1.smithi195.stdout:4/649: getdents d4/d6/d38/d1a/d40/d20 0 2024-04-06T12:23:12.377 INFO:tasks.workunit.client.1.smithi195.stdout:6/767: creat d8/d21/d31/d6c/db6/f128 x:0 0 0 2024-04-06T12:23:12.378 INFO:tasks.workunit.client.1.smithi195.stdout:8/686: write d6/dd/d70/d24/d34/d67/f6c [5825318,94417] 0 2024-04-06T12:23:12.380 INFO:tasks.workunit.client.1.smithi195.stdout:5/743: dread d0/d35/f5f [4194304,4194304] 0 2024-04-06T12:23:12.380 INFO:tasks.workunit.client.1.smithi195.stdout:7/595: symlink d4/d16/dd/d22/d3f/d54/lc1 0 2024-04-06T12:23:12.381 INFO:tasks.workunit.client.1.smithi195.stdout:1/673: unlink d4/l1e 0 2024-04-06T12:23:12.387 INFO:tasks.workunit.client.1.smithi195.stdout:0/702: creat d4/d48/fdf x:0 0 0 2024-04-06T12:23:12.387 INFO:tasks.workunit.client.1.smithi195.stdout:8/687: write d6/d3a/d46/f50 [1216940,55229] 0 2024-04-06T12:23:12.388 INFO:tasks.workunit.client.1.smithi195.stdout:3/746: dwrite d4/d53/fc7 [0,4194304] 0 2024-04-06T12:23:12.388 INFO:tasks.workunit.client.1.smithi195.stdout:4/650: truncate d4/f16 4592431 0 2024-04-06T12:23:12.390 INFO:tasks.workunit.client.1.smithi195.stdout:1/674: dread - d4/d14/d17/d3a/da8/da4/db2/d5d/fa6 zero size 2024-04-06T12:23:12.390 INFO:tasks.workunit.client.1.smithi195.stdout:9/691: dread d3/d10/d3b/d48/f69 [0,4194304] 0 2024-04-06T12:23:12.391 INFO:tasks.workunit.client.1.smithi195.stdout:6/768: creat d8/d3d/d5e/d72/d10c/d32/f129 x:0 0 0 2024-04-06T12:23:12.392 INFO:tasks.workunit.client.1.smithi195.stdout:2/731: dread d2/d14/f1d [0,4194304] 0 2024-04-06T12:23:12.396 INFO:tasks.workunit.client.1.smithi195.stdout:4/651: write d4/d6/d38/d65/f84 [1145755,119967] 0 2024-04-06T12:23:12.396 INFO:tasks.workunit.client.1.smithi195.stdout:7/596: rename d4/d16/dd/d22/d3f/d54/da9/d82 to d4/d10/d18/d19/d63/dc2 0 2024-04-06T12:23:12.399 INFO:tasks.workunit.client.1.smithi195.stdout:5/744: dwrite d0/da/d23/d38/f88 [0,4194304] 0 2024-04-06T12:23:12.402 INFO:tasks.workunit.client.1.smithi195.stdout:3/747: creat d4/de/dc8/ff9 x:0 0 0 2024-04-06T12:23:12.402 INFO:tasks.workunit.client.1.smithi195.stdout:9/692: symlink d3/de/ddf/le2 0 2024-04-06T12:23:12.408 INFO:tasks.workunit.client.1.smithi195.stdout:8/688: rename d6/dd/d70/d24/d34/d67/da1/dbd/de6 to d6/dd/d70/d24/d25/da5/dc8/de8 0 2024-04-06T12:23:12.408 INFO:tasks.workunit.client.1.smithi195.stdout:2/732: mkdir d2/d3f/d7d/de8 0 2024-04-06T12:23:12.410 INFO:tasks.workunit.client.1.smithi195.stdout:2/733: readlink d2/d14/laf 0 2024-04-06T12:23:12.411 INFO:tasks.workunit.client.1.smithi195.stdout:8/689: stat d6/dd/d70/d24/d34/fa3 0 2024-04-06T12:23:12.413 INFO:tasks.workunit.client.1.smithi195.stdout:4/652: rename d4/d6/lc3 to d4/d8c/d96/dc9/lcc 0 2024-04-06T12:23:12.414 INFO:tasks.workunit.client.1.smithi195.stdout:6/769: dwrite d8/f1a [0,4194304] 0 2024-04-06T12:23:12.419 INFO:tasks.workunit.client.1.smithi195.stdout:0/703: truncate d4/fd 2256462 0 2024-04-06T12:23:12.421 INFO:tasks.workunit.client.1.smithi195.stdout:3/748: creat d4/de/d8e/d92/d9e/df0/ffa x:0 0 0 2024-04-06T12:23:12.422 INFO:tasks.workunit.client.1.smithi195.stdout:7/597: dwrite d4/d16/dd/d22/d3f/d54/f9d [0,4194304] 0 2024-04-06T12:23:12.423 INFO:tasks.workunit.client.1.smithi195.stdout:4/653: symlink d4/d6/d38/d65/d7a/lcd 0 2024-04-06T12:23:12.424 INFO:tasks.workunit.client.1.smithi195.stdout:9/693: dread d3/de/f1c [0,4194304] 0 2024-04-06T12:23:12.426 INFO:tasks.workunit.client.1.smithi195.stdout:5/745: getdents d0/da/dd/d1c/d5a/d62 0 2024-04-06T12:23:12.431 INFO:tasks.workunit.client.1.smithi195.stdout:6/770: mkdir d8/d3d/d5e/dd3/dfe/d12a 0 2024-04-06T12:23:12.431 INFO:tasks.workunit.client.1.smithi195.stdout:3/749: symlink d4/de/lfb 0 2024-04-06T12:23:12.431 INFO:tasks.workunit.client.1.smithi195.stdout:6/771: chown d8/d21/d31/d6c/db6 907 1 2024-04-06T12:23:12.433 INFO:tasks.workunit.client.1.smithi195.stdout:8/690: dwrite d6/db/f60 [4194304,4194304] 0 2024-04-06T12:23:12.433 INFO:tasks.workunit.client.1.smithi195.stdout:5/746: fsync d0/da/d23/dd4/dc2/fe8 0 2024-04-06T12:23:12.436 INFO:tasks.workunit.client.1.smithi195.stdout:5/747: write d0/da/d23/d7a/dc5/fc6 [223241,72214] 0 2024-04-06T12:23:12.436 INFO:tasks.workunit.client.1.smithi195.stdout:3/750: symlink d4/df/lfc 0 2024-04-06T12:23:12.437 INFO:tasks.workunit.client.1.smithi195.stdout:7/598: dread d4/d10/d18/d33/d6e/fbc [0,4194304] 0 2024-04-06T12:23:12.437 INFO:tasks.workunit.client.1.smithi195.stdout:5/748: chown d0/da/d23/d38/f44 52582129 1 2024-04-06T12:23:12.439 INFO:tasks.workunit.client.1.smithi195.stdout:3/751: write d4/de/d8e/d92/d9e/df0/ffa [6956,10325] 0 2024-04-06T12:23:12.440 INFO:tasks.workunit.client.1.smithi195.stdout:2/734: dread d2/d21/d2c/f38 [0,4194304] 0 2024-04-06T12:23:12.444 INFO:tasks.workunit.client.1.smithi195.stdout:8/691: creat d6/dd/d70/d24/d25/d49/fe9 x:0 0 0 2024-04-06T12:23:12.447 INFO:tasks.workunit.client.1.smithi195.stdout:5/749: unlink d0/da/d13/l32 0 2024-04-06T12:23:12.448 INFO:tasks.workunit.client.1.smithi195.stdout:3/752: chown d4/de/d8e/c9d 3603969 1 2024-04-06T12:23:12.450 INFO:tasks.workunit.client.1.smithi195.stdout:5/750: write d0/da/d23/d38/d41/d7d/fd3 [568653,102702] 0 2024-04-06T12:23:12.450 INFO:tasks.workunit.client.1.smithi195.stdout:8/692: symlink d6/dd/d70/d24/d34/d67/da1/da2/dc6/lea 0 2024-04-06T12:23:12.451 INFO:tasks.workunit.client.1.smithi195.stdout:4/654: getdents d4/d6/d38/d65/d7a 0 2024-04-06T12:23:12.452 INFO:tasks.workunit.client.1.smithi195.stdout:7/599: dwrite d4/d10/f3c [0,4194304] 0 2024-04-06T12:23:12.455 INFO:tasks.workunit.client.1.smithi195.stdout:3/753: mkdir d4/d9/d2b/d3b/d5e/dfd 0 2024-04-06T12:23:12.455 INFO:tasks.workunit.client.1.smithi195.stdout:4/655: chown d4/d6/d38/d1a/da7 28 1 2024-04-06T12:23:12.457 INFO:tasks.workunit.client.1.smithi195.stdout:5/751: creat d0/da/dd/d1c/f102 x:0 0 0 2024-04-06T12:23:12.457 INFO:tasks.workunit.client.1.smithi195.stdout:4/656: stat d4/d6d/d85 0 2024-04-06T12:23:12.459 INFO:tasks.workunit.client.1.smithi195.stdout:0/704: truncate d4/d6/d2f/f3e 2848011 0 2024-04-06T12:23:12.461 INFO:tasks.workunit.client.1.smithi195.stdout:3/754: symlink d4/dc4/lfe 0 2024-04-06T12:23:12.464 INFO:tasks.workunit.client.1.smithi195.stdout:2/735: dwrite d2/f12 [0,4194304] 0 2024-04-06T12:23:12.468 INFO:tasks.workunit.client.1.smithi195.stdout:4/657: creat d4/d6/d38/d1a/fce x:0 0 0 2024-04-06T12:23:12.469 INFO:tasks.workunit.client.1.smithi195.stdout:0/705: write d4/d48/d67/faa [4754318,128243] 0 2024-04-06T12:23:12.471 INFO:tasks.workunit.client.1.smithi195.stdout:2/736: chown d2/d41/d5a/ddd/fe2 0 1 2024-04-06T12:23:12.471 INFO:tasks.workunit.client.1.smithi195.stdout:3/755: write d4/d9/d2b/d87/fd3 [645950,8392] 0 2024-04-06T12:23:12.472 INFO:tasks.workunit.client.1.smithi195.stdout:9/694: dwrite d3/de/f14 [4194304,4194304] 0 2024-04-06T12:23:12.472 INFO:tasks.workunit.client.1.smithi195.stdout:8/693: dwrite d6/dd/d70/d24/d34/f6d [0,4194304] 0 2024-04-06T12:23:12.475 INFO:tasks.workunit.client.1.smithi195.stdout:9/695: chown d3/db9/dbc 708021 1 2024-04-06T12:23:12.475 INFO:tasks.workunit.client.1.smithi195.stdout:7/600: truncate d4/d16/f1c 4538404 0 2024-04-06T12:23:12.476 INFO:tasks.workunit.client.1.smithi195.stdout:2/737: write d2/d3f/fc0 [923710,50247] 0 2024-04-06T12:23:12.478 INFO:tasks.workunit.client.1.smithi195.stdout:3/756: write d4/d9/d37/ff2 [953720,41884] 0 2024-04-06T12:23:12.480 INFO:tasks.workunit.client.1.smithi195.stdout:8/694: creat d6/dd/d42/feb x:0 0 0 2024-04-06T12:23:12.485 INFO:tasks.workunit.client.1.smithi195.stdout:0/706: read d4/d6/d2f/d49/f52 [387667,99967] 0 2024-04-06T12:23:12.485 INFO:tasks.workunit.client.1.smithi195.stdout:4/658: creat d4/d6/d38/d1a/d40/d57/d64/fcf x:0 0 0 2024-04-06T12:23:12.485 INFO:tasks.workunit.client.1.smithi195.stdout:2/738: creat d2/d21/d69/fe9 x:0 0 0 2024-04-06T12:23:12.485 INFO:tasks.workunit.client.1.smithi195.stdout:3/757: creat d4/de/d8e/dbb/fff x:0 0 0 2024-04-06T12:23:12.487 INFO:tasks.workunit.client.1.smithi195.stdout:2/739: write d2/d3f/d7d/f54 [6697663,82900] 0 2024-04-06T12:23:12.487 INFO:tasks.workunit.client.1.smithi195.stdout:5/752: link d0/da/dd/d1c/d5a/d62/d64/d67/db9/fcf d0/da/dd/d2e/d6f/f103 0 2024-04-06T12:23:12.488 INFO:tasks.workunit.client.1.smithi195.stdout:7/601: unlink d4/d10/d18/d19/d63/l8c 0 2024-04-06T12:23:12.489 INFO:tasks.workunit.client.1.smithi195.stdout:9/696: truncate d3/d10/f89 170636 0 2024-04-06T12:23:12.491 INFO:tasks.workunit.client.1.smithi195.stdout:4/659: symlink d4/d6/d38/d1a/d40/d20/d23/ld0 0 2024-04-06T12:23:12.493 INFO:tasks.workunit.client.1.smithi195.stdout:8/695: truncate d6/dd/d70/d24/d53/f68 3239627 0 2024-04-06T12:23:12.496 INFO:tasks.workunit.client.1.smithi195.stdout:5/753: creat d0/da/dd/d2e/d6f/d58/f104 x:0 0 0 2024-04-06T12:23:12.496 INFO:tasks.workunit.client.1.smithi195.stdout:3/758: dwrite d4/d53/fda [0,4194304] 0 2024-04-06T12:23:12.497 INFO:tasks.workunit.client.1.smithi195.stdout:9/697: read d3/d10/f61 [1305841,6154] 0 2024-04-06T12:23:12.499 INFO:tasks.workunit.client.1.smithi195.stdout:8/696: write d6/dd/d70/d24/d25/da5/dc8/fc9 [573455,99160] 0 2024-04-06T12:23:12.501 INFO:tasks.workunit.client.1.smithi195.stdout:4/660: chown d4/d6/c90 191048670 1 2024-04-06T12:23:12.502 INFO:tasks.workunit.client.1.smithi195.stdout:7/602: rename d4/d10/d18/d33/d6e/f94 to d4/d24/fc3 0 2024-04-06T12:23:12.503 INFO:tasks.workunit.client.1.smithi195.stdout:0/707: dread d4/d6/d1a/f86 [0,4194304] 0 2024-04-06T12:23:12.503 INFO:tasks.workunit.client.1.smithi195.stdout:5/754: mkdir d0/da/dd/d33/d105 0 2024-04-06T12:23:12.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/698: fdatasync d3/d10/f22 0 2024-04-06T12:23:12.506 INFO:tasks.workunit.client.1.smithi195.stdout:2/740: creat d2/d41/fea x:0 0 0 2024-04-06T12:23:12.510 INFO:tasks.workunit.client.1.smithi195.stdout:8/697: rename d6/db/d47 to d6/dd/d70/d24/d34/d67/dec 0 2024-04-06T12:23:12.511 INFO:tasks.workunit.client.1.smithi195.stdout:7/603: write d4/d16/f1b [3578943,107334] 0 2024-04-06T12:23:12.512 INFO:tasks.workunit.client.1.smithi195.stdout:8/698: fdatasync d6/dd/d70/d24/d34/d67/dec/f77 0 2024-04-06T12:23:12.513 INFO:tasks.workunit.client.1.smithi195.stdout:7/604: write d4/d16/d11/fb2 [1036511,15551] 0 2024-04-06T12:23:12.514 INFO:tasks.workunit.client.1.smithi195.stdout:0/708: creat d4/d6/d1a/d9f/fe0 x:0 0 0 2024-04-06T12:23:12.515 INFO:tasks.workunit.client.1.smithi195.stdout:7/605: write d4/d10/d18/f53 [57093,30175] 0 2024-04-06T12:23:12.516 INFO:tasks.workunit.client.1.smithi195.stdout:9/699: read d3/de/f7b [793041,97597] 0 2024-04-06T12:23:12.517 INFO:tasks.workunit.client.1.smithi195.stdout:7/606: chown d4/d16/dd/d22/d3f/d54/f5f 464 1 2024-04-06T12:23:12.518 INFO:tasks.workunit.client.1.smithi195.stdout:3/759: creat d4/f100 x:0 0 0 2024-04-06T12:23:12.520 INFO:tasks.workunit.client.1.smithi195.stdout:1/675: sync 2024-04-06T12:23:12.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/755: rename d0/da/dd/d2e/d6f/dab to d0/da/d23/dd4/d106 0 2024-04-06T12:23:12.521 INFO:tasks.workunit.client.1.smithi195.stdout:5/756: fsync d0/da/dd/d2e/d6f/f4f 0 2024-04-06T12:23:12.522 INFO:tasks.workunit.client.1.smithi195.stdout:5/757: chown d0/da/d23/d38/d41/d7d/fd3 0 1 2024-04-06T12:23:12.523 INFO:tasks.workunit.client.1.smithi195.stdout:8/699: symlink d6/dd/d70/d24/d34/led 0 2024-04-06T12:23:12.525 INFO:tasks.workunit.client.1.smithi195.stdout:0/709: rmdir d4/d53/d81 39 2024-04-06T12:23:12.526 INFO:tasks.workunit.client.1.smithi195.stdout:2/741: getdents d2/d41/d84/d8d/d94/db6 0 2024-04-06T12:23:12.527 INFO:tasks.workunit.client.1.smithi195.stdout:2/742: write d2/d41/fb9 [957537,58620] 0 2024-04-06T12:23:12.528 INFO:tasks.workunit.client.1.smithi195.stdout:7/607: chown d4/d10/d18/d19/d63/dc2/ca1 358764 1 2024-04-06T12:23:12.528 INFO:tasks.workunit.client.1.smithi195.stdout:2/743: chown d2/d21/d2c/d2d/c8c 739 1 2024-04-06T12:23:12.529 INFO:tasks.workunit.client.1.smithi195.stdout:1/676: symlink d4/d14/d17/d3a/da8/ld5 0 2024-04-06T12:23:12.530 INFO:tasks.workunit.client.1.smithi195.stdout:1/677: chown d4/d14/d17/d3a/da8/db8/dd0 105615 1 2024-04-06T12:23:12.531 INFO:tasks.workunit.client.1.smithi195.stdout:5/758: mkdir d0/da/d23/d38/d107 0 2024-04-06T12:23:12.533 INFO:tasks.workunit.client.1.smithi195.stdout:5/759: write d0/da/d23/dd4/fcd [511204,123324] 0 2024-04-06T12:23:12.533 INFO:tasks.workunit.client.1.smithi195.stdout:9/700: symlink d3/db9/le3 0 2024-04-06T12:23:12.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/710: chown d4/d53/d81/f88 507 1 2024-04-06T12:23:12.534 INFO:tasks.workunit.client.1.smithi195.stdout:2/744: unlink d2/d14/f4e 0 2024-04-06T12:23:12.535 INFO:tasks.workunit.client.1.smithi195.stdout:5/760: chown d0/da/dd/f3b 14254 1 2024-04-06T12:23:12.536 INFO:tasks.workunit.client.1.smithi195.stdout:7/608: rename d4/d24/fc3 to d4/d10/d12/da5/da3/fc4 0 2024-04-06T12:23:12.536 INFO:tasks.workunit.client.1.smithi195.stdout:4/661: link d4/d6/d38/c5a d4/d6/d38/d1a/d40/cd1 0 2024-04-06T12:23:12.539 INFO:tasks.workunit.client.1.smithi195.stdout:9/701: dread d3/de/f7b [0,4194304] 0 2024-04-06T12:23:12.540 INFO:tasks.workunit.client.1.smithi195.stdout:0/711: mknod d4/d6/ce1 0 2024-04-06T12:23:12.540 INFO:tasks.workunit.client.1.smithi195.stdout:8/700: link d6/db/c5d d6/dd/d70/d24/d34/d67/dec/d4b/cee 0 2024-04-06T12:23:12.541 INFO:tasks.workunit.client.1.smithi195.stdout:9/702: chown d3 1328 1 2024-04-06T12:23:12.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/760: link d4/d9/l4f d4/df/d39/da7/l101 0 2024-04-06T12:23:12.541 INFO:tasks.workunit.client.1.smithi195.stdout:2/745: truncate d2/d41/d84/d8d/d94/f9a 952738 0 2024-04-06T12:23:12.543 INFO:tasks.workunit.client.1.smithi195.stdout:4/662: truncate d4/d6/d38/d1a/da7/fc4 278963 0 2024-04-06T12:23:12.543 INFO:tasks.workunit.client.1.smithi195.stdout:0/712: mkdir d4/dbc/de2 0 2024-04-06T12:23:12.545 INFO:tasks.workunit.client.1.smithi195.stdout:7/609: dread d4/d24/f49 [0,4194304] 0 2024-04-06T12:23:12.545 INFO:tasks.workunit.client.1.smithi195.stdout:2/746: mkdir d2/ddc/deb 0 2024-04-06T12:23:12.545 INFO:tasks.workunit.client.1.smithi195.stdout:1/678: dread d4/d14/d17/f42 [8388608,4194304] 0 2024-04-06T12:23:12.546 INFO:tasks.workunit.client.1.smithi195.stdout:0/713: stat d4/d53/dd1 0 2024-04-06T12:23:12.547 INFO:tasks.workunit.client.1.smithi195.stdout:9/703: creat d3/d10/d4f/fe4 x:0 0 0 2024-04-06T12:23:12.548 INFO:tasks.workunit.client.1.smithi195.stdout:4/663: read d4/d6/d38/f2c [722715,2783] 0 2024-04-06T12:23:12.549 INFO:tasks.workunit.client.1.smithi195.stdout:8/701: mknod d6/dd/d70/d24/d25/da5/dc8/de8/d52/db0/cef 0 2024-04-06T12:23:12.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/714: stat d4/d48/d77/d97/db7/l96 0 2024-04-06T12:23:12.551 INFO:tasks.workunit.client.1.smithi195.stdout:7/610: write d4/d16/dd/d22/d3f/d54/da9/fa6 [956777,10507] 0 2024-04-06T12:23:12.552 INFO:tasks.workunit.client.1.smithi195.stdout:5/761: dwrite d0/da/d23/dd4/d106/fbe [0,4194304] 0 2024-04-06T12:23:12.554 INFO:tasks.workunit.client.1.smithi195.stdout:1/679: truncate d4/d14/d17/d3a/da8/fcc 919123 0 2024-04-06T12:23:12.554 INFO:tasks.workunit.client.1.smithi195.stdout:5/762: dread - d0/d35/fb0 zero size 2024-04-06T12:23:12.557 INFO:tasks.workunit.client.1.smithi195.stdout:5/763: dread d0/da/d23/dd4/fa6 [0,4194304] 0 2024-04-06T12:23:12.558 INFO:tasks.workunit.client.1.smithi195.stdout:5/764: read d0/da/dd/d2e/d6f/f51 [83183,128472] 0 2024-04-06T12:23:12.559 INFO:tasks.workunit.client.1.smithi195.stdout:5/765: write d0/da/d13/d87/f57 [3365556,37486] 0 2024-04-06T12:23:12.579 INFO:tasks.workunit.client.1.smithi195.stdout:6/772: sync 2024-04-06T12:23:12.580 INFO:tasks.workunit.client.1.smithi195.stdout:6/773: dread - d8/d21/d31/d6c/db6/f128 zero size 2024-04-06T12:23:12.608 INFO:tasks.workunit.client.1.smithi195.stdout:2/747: symlink d2/d41/d5a/ddd/lec 0 2024-04-06T12:23:12.610 INFO:tasks.workunit.client.1.smithi195.stdout:4/664: creat d4/d6/fd2 x:0 0 0 2024-04-06T12:23:12.612 INFO:tasks.workunit.client.1.smithi195.stdout:1/680: chown d4/d14/l41 390243905 1 2024-04-06T12:23:12.617 INFO:tasks.workunit.client.1.smithi195.stdout:9/704: symlink d3/d10/d7d/dd0/le5 0 2024-04-06T12:23:12.618 INFO:tasks.workunit.client.1.smithi195.stdout:1/681: dwrite d4/d14/d17/d3a/da8/da4/db2/d28/f50 [0,4194304] 0 2024-04-06T12:23:12.618 INFO:tasks.workunit.client.1.smithi195.stdout:3/761: link d4/d9/d2b/f32 d4/de/d8e/d92/d9e/df0/f102 0 2024-04-06T12:23:12.619 INFO:tasks.workunit.client.1.smithi195.stdout:3/762: readlink d4/df/lfc 0 2024-04-06T12:23:12.620 INFO:tasks.workunit.client.1.smithi195.stdout:2/748: rename d2/d21/lb0 to d2/d3f/d7d/d7a/led 0 2024-04-06T12:23:12.620 INFO:tasks.workunit.client.1.smithi195.stdout:3/763: write d4/f4e [2697274,98462] 0 2024-04-06T12:23:12.622 INFO:tasks.workunit.client.1.smithi195.stdout:4/665: write d4/f7e [1384126,10395] 0 2024-04-06T12:23:12.625 INFO:tasks.workunit.client.1.smithi195.stdout:0/715: symlink d4/d48/d77/d97/le3 0 2024-04-06T12:23:12.625 INFO:tasks.workunit.client.1.smithi195.stdout:8/702: getdents d6/dd/d70/d24/d34/d67/d9d/db5 0 2024-04-06T12:23:12.625 INFO:tasks.workunit.client.1.smithi195.stdout:3/764: write d4/d9/d2b/d9b/fd4 [700967,127819] 0 2024-04-06T12:23:12.628 INFO:tasks.workunit.client.1.smithi195.stdout:6/774: truncate d8/d21/d2b/d46/d44/f7d 3809153 0 2024-04-06T12:23:12.628 INFO:tasks.workunit.client.1.smithi195.stdout:8/703: write d6/dd/d70/d24/d34/d67/d9d/fa0 [1404985,7759] 0 2024-04-06T12:23:12.629 INFO:tasks.workunit.client.1.smithi195.stdout:1/682: mknod d4/d14/d17/d3a/da8/da4/cd6 0 2024-04-06T12:23:12.632 INFO:tasks.workunit.client.1.smithi195.stdout:2/749: symlink d2/d14/lee 0 2024-04-06T12:23:12.634 INFO:tasks.workunit.client.1.smithi195.stdout:7/611: creat d4/d16/dd/d22/fc5 x:0 0 0 2024-04-06T12:23:12.634 INFO:tasks.workunit.client.1.smithi195.stdout:2/750: read d2/d21/d29/f4b [18877,95809] 0 2024-04-06T12:23:12.635 INFO:tasks.workunit.client.1.smithi195.stdout:7/612: dread - d4/d16/dd/d22/d3f/f99 zero size 2024-04-06T12:23:12.636 INFO:tasks.workunit.client.1.smithi195.stdout:0/716: rmdir d4/d6/d1a/d73 39 2024-04-06T12:23:12.638 INFO:tasks.workunit.client.1.smithi195.stdout:7/613: read d4/d16/dd/d22/d3f/faa [3930357,56757] 0 2024-04-06T12:23:12.638 INFO:tasks.workunit.client.1.smithi195.stdout:0/717: fdatasync d4/d6/d1a/f3f 0 2024-04-06T12:23:12.638 INFO:tasks.workunit.client.1.smithi195.stdout:7/614: chown d4/f96 117237148 1 2024-04-06T12:23:12.638 INFO:tasks.workunit.client.1.smithi195.stdout:3/765: creat d4/de/dc8/f103 x:0 0 0 2024-04-06T12:23:12.638 INFO:tasks.workunit.client.1.smithi195.stdout:7/615: stat d4/d10/d12/da5/da3/fc4 0 2024-04-06T12:23:12.639 INFO:tasks.workunit.client.1.smithi195.stdout:7/616: truncate d4/d24/f49 1041176 0 2024-04-06T12:23:12.640 INFO:tasks.workunit.client.1.smithi195.stdout:9/705: link d3/d10/d3b/d48/fc7 d3/dd3/fe6 0 2024-04-06T12:23:12.640 INFO:tasks.workunit.client.1.smithi195.stdout:7/617: dread - d4/d16/dd/f78 zero size 2024-04-06T12:23:12.640 INFO:tasks.workunit.client.1.smithi195.stdout:9/706: chown d3/d10/d3b/d48 522496 1 2024-04-06T12:23:12.641 INFO:tasks.workunit.client.1.smithi195.stdout:6/775: symlink d8/d3d/d5e/d72/d10c/d82/l12b 0 2024-04-06T12:23:12.643 INFO:tasks.workunit.client.1.smithi195.stdout:5/766: rename d0/da/d23/d38/l9a to d0/da/dd/d1c/l108 0 2024-04-06T12:23:12.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/718: mknod d4/d6/ce4 0 2024-04-06T12:23:12.650 INFO:tasks.workunit.client.1.smithi195.stdout:7/618: dread d4/f96 [0,4194304] 0 2024-04-06T12:23:12.654 INFO:tasks.workunit.client.1.smithi195.stdout:6/776: creat d8/d3d/d5e/d72/d10c/f12c x:0 0 0 2024-04-06T12:23:12.657 INFO:tasks.workunit.client.1.smithi195.stdout:8/704: rename d6/f31 to d6/dd/d70/d24/d25/da5/dc8/dcb/ff0 0 2024-04-06T12:23:12.658 INFO:tasks.workunit.client.1.smithi195.stdout:4/666: truncate d4/d3e/f94 655507 0 2024-04-06T12:23:12.659 INFO:tasks.workunit.client.1.smithi195.stdout:4/667: chown d4/d8c/d96/c9e 11963457 1 2024-04-06T12:23:12.660 INFO:tasks.workunit.client.1.smithi195.stdout:2/751: symlink d2/ddc/deb/lef 0 2024-04-06T12:23:12.663 INFO:tasks.workunit.client.1.smithi195.stdout:7/619: creat d4/d16/d11/fc6 x:0 0 0 2024-04-06T12:23:12.665 INFO:tasks.workunit.client.1.smithi195.stdout:7/620: write d4/d10/d18/d57/f7f [3204348,129891] 0 2024-04-06T12:23:12.666 INFO:tasks.workunit.client.1.smithi195.stdout:9/707: unlink d3/d10/l28 0 2024-04-06T12:23:12.667 INFO:tasks.workunit.client.1.smithi195.stdout:9/708: chown d3/db9/dbc 1849 1 2024-04-06T12:23:12.667 INFO:tasks.workunit.client.1.smithi195.stdout:6/777: mknod d8/d3d/d5e/dd3/dfe/c12d 0 2024-04-06T12:23:12.667 INFO:tasks.workunit.client.1.smithi195.stdout:3/766: dwrite d4/d9/d2b/f32 [0,4194304] 0 2024-04-06T12:23:12.668 INFO:tasks.workunit.client.1.smithi195.stdout:8/705: rmdir d6/dd/d70/d24/d34/d67/da1/da2 39 2024-04-06T12:23:12.672 INFO:tasks.workunit.client.1.smithi195.stdout:5/767: write d0/da/dd/d1c/d5a/d62/fda [1250500,27518] 0 2024-04-06T12:23:12.672 INFO:tasks.workunit.client.1.smithi195.stdout:2/752: creat d2/d41/d84/d8d/dce/ff0 x:0 0 0 2024-04-06T12:23:12.673 INFO:tasks.workunit.client.1.smithi195.stdout:0/719: mknod d4/d48/d77/d97/ce5 0 2024-04-06T12:23:12.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/683: getdents d4/d14/d17/d3a/da8/da4 0 2024-04-06T12:23:12.677 INFO:tasks.workunit.client.1.smithi195.stdout:9/709: rmdir d3/da1 39 2024-04-06T12:23:12.679 INFO:tasks.workunit.client.1.smithi195.stdout:3/767: unlink d4/de/f96 0 2024-04-06T12:23:12.679 INFO:tasks.workunit.client.1.smithi195.stdout:6/778: dwrite d8/d21/d31/d26/fb9 [0,4194304] 0 2024-04-06T12:23:12.680 INFO:tasks.workunit.client.1.smithi195.stdout:0/720: write d4/d48/f56 [1127162,107559] 0 2024-04-06T12:23:12.681 INFO:tasks.workunit.client.1.smithi195.stdout:5/768: unlink d0/d52/l5b 0 2024-04-06T12:23:12.684 INFO:tasks.workunit.client.1.smithi195.stdout:0/721: write d4/d48/fdf [529722,37392] 0 2024-04-06T12:23:12.684 INFO:tasks.workunit.client.1.smithi195.stdout:3/768: write d4/de/d8e/d92/d9e/df0/f102 [2471175,64794] 0 2024-04-06T12:23:12.685 INFO:tasks.workunit.client.1.smithi195.stdout:5/769: chown d0/da/d23/dd4/dc2/dfb 15 1 2024-04-06T12:23:12.687 INFO:tasks.workunit.client.1.smithi195.stdout:2/753: symlink d2/d41/d84/db2/lf1 0 2024-04-06T12:23:12.688 INFO:tasks.workunit.client.1.smithi195.stdout:0/722: truncate d4/d6/d1a/f86 4526746 0 2024-04-06T12:23:12.688 INFO:tasks.workunit.client.1.smithi195.stdout:7/621: mknod d4/d16/cc7 0 2024-04-06T12:23:12.699 INFO:tasks.workunit.client.1.smithi195.stdout:5/770: rmdir d0/da/dd/d1c/d5a/d62 39 2024-04-06T12:23:12.700 INFO:tasks.workunit.client.1.smithi195.stdout:2/754: mknod d2/d41/d5a/ddd/cf2 0 2024-04-06T12:23:12.701 INFO:tasks.workunit.client.1.smithi195.stdout:7/622: creat d4/d16/d11/fc8 x:0 0 0 2024-04-06T12:23:12.703 INFO:tasks.workunit.client.1.smithi195.stdout:7/623: chown d4/d10/d18/d33/d6e/lbf 0 1 2024-04-06T12:23:12.703 INFO:tasks.workunit.client.1.smithi195.stdout:0/723: rename d4/d6/d1a/l3a to d4/d6/d1a/d9f/le6 0 2024-04-06T12:23:12.703 INFO:tasks.workunit.client.1.smithi195.stdout:1/684: symlink d4/d14/d17/d3a/da8/da4/db2/d28/ld7 0 2024-04-06T12:23:12.707 INFO:tasks.workunit.client.1.smithi195.stdout:6/779: dread d8/d21/d2b/f54 [0,4194304] 0 2024-04-06T12:23:12.707 INFO:tasks.workunit.client.1.smithi195.stdout:8/706: rmdir d6/dd/d70/d24/d34/d67/d9d/db5 0 2024-04-06T12:23:12.709 INFO:tasks.workunit.client.1.smithi195.stdout:2/755: dwrite d2/d21/d29/f72 [0,4194304] 0 2024-04-06T12:23:12.712 INFO:tasks.workunit.client.1.smithi195.stdout:4/668: link d4/d6/d38/d1a/d40/d20/c42 d4/d6/d38/d65/d7a/cd3 0 2024-04-06T12:23:12.713 INFO:tasks.workunit.client.1.smithi195.stdout:8/707: write d6/dd/d70/d24/d34/d67/f86 [551156,122939] 0 2024-04-06T12:23:12.714 INFO:tasks.workunit.client.1.smithi195.stdout:3/769: dwrite d4/f24 [0,4194304] 0 2024-04-06T12:23:12.715 INFO:tasks.workunit.client.1.smithi195.stdout:8/708: dread - d6/dd/d70/d24/d34/d67/dec/fe7 zero size 2024-04-06T12:23:12.716 INFO:tasks.workunit.client.1.smithi195.stdout:5/771: creat d0/da/dd/d2e/f109 x:0 0 0 2024-04-06T12:23:12.719 INFO:tasks.workunit.client.1.smithi195.stdout:8/709: chown d6/dd/d70/d24/d25/da5/dc8/fde 146912541 1 2024-04-06T12:23:12.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/624: creat d4/d24/d80/fc9 x:0 0 0 2024-04-06T12:23:12.719 INFO:tasks.workunit.client.1.smithi195.stdout:8/710: stat d6/dd/d70/d24/d34/d67/dec/d4b/c80 0 2024-04-06T12:23:12.721 INFO:tasks.workunit.client.1.smithi195.stdout:8/711: read - d6/dd/d70/d24/d34/d67/da1/fdd zero size 2024-04-06T12:23:12.724 INFO:tasks.workunit.client.1.smithi195.stdout:1/685: fdatasync d4/d14/d17/d24/d99/d4e/d57/f66 0 2024-04-06T12:23:12.724 INFO:tasks.workunit.client.1.smithi195.stdout:6/780: mknod d8/d21/d31/d49/dd8/c12e 0 2024-04-06T12:23:12.727 INFO:tasks.workunit.client.1.smithi195.stdout:5/772: read d0/da/d23/d38/fc3 [36864,99277] 0 2024-04-06T12:23:12.728 INFO:tasks.workunit.client.1.smithi195.stdout:5/773: stat d0/da/d4b 0 2024-04-06T12:23:12.728 INFO:tasks.workunit.client.1.smithi195.stdout:7/625: symlink d4/d16/dd/d22/d76/lca 0 2024-04-06T12:23:12.730 INFO:tasks.workunit.client.1.smithi195.stdout:9/710: getdents d3/d10/d3b/d48/d9c 0 2024-04-06T12:23:12.731 INFO:tasks.workunit.client.1.smithi195.stdout:4/669: write d4/f79 [4066332,114806] 0 2024-04-06T12:23:12.733 INFO:tasks.workunit.client.1.smithi195.stdout:6/781: write d8/d21/d2b/d46/f83 [836575,65955] 0 2024-04-06T12:23:12.736 INFO:tasks.workunit.client.1.smithi195.stdout:8/712: creat d6/dd/d70/d24/d34/d67/da1/da2/dc6/ff1 x:0 0 0 2024-04-06T12:23:12.736 INFO:tasks.workunit.client.1.smithi195.stdout:7/626: dwrite d4/d16/dd/d22/d76/f97 [0,4194304] 0 2024-04-06T12:23:12.737 INFO:tasks.workunit.client.1.smithi195.stdout:8/713: write d6/dd/d42/fcd [2120641,66013] 0 2024-04-06T12:23:12.739 INFO:tasks.workunit.client.1.smithi195.stdout:1/686: symlink d4/d14/d17/dd4/ld8 0 2024-04-06T12:23:12.743 INFO:tasks.workunit.client.1.smithi195.stdout:5/774: mknod d0/da/d23/c10a 0 2024-04-06T12:23:12.743 INFO:tasks.workunit.client.1.smithi195.stdout:0/724: getdents d4/d6/d1a 0 2024-04-06T12:23:12.744 INFO:tasks.workunit.client.1.smithi195.stdout:6/782: creat d8/d21/d31/d26/dc8/f12f x:0 0 0 2024-04-06T12:23:12.745 INFO:tasks.workunit.client.1.smithi195.stdout:5/775: write d0/da/dd/d2e/f4c [3888742,74943] 0 2024-04-06T12:23:12.747 INFO:tasks.workunit.client.1.smithi195.stdout:7/627: symlink d4/d10/d18/d19/d63/lcb 0 2024-04-06T12:23:12.747 INFO:tasks.workunit.client.1.smithi195.stdout:6/783: truncate d8/d21/d31/d6c/ded/f120 898278 0 2024-04-06T12:23:12.748 INFO:tasks.workunit.client.1.smithi195.stdout:2/756: link d2/d21/c4d d2/d21/d5e/d64/cf3 0 2024-04-06T12:23:12.752 INFO:tasks.workunit.client.1.smithi195.stdout:8/714: symlink d6/dd/d70/d24/d25/da5/dc8/de8/d52/lf2 0 2024-04-06T12:23:12.754 INFO:tasks.workunit.client.1.smithi195.stdout:1/687: symlink d4/d14/d17/d24/d99/d4e/d8f/ld9 0 2024-04-06T12:23:12.754 INFO:tasks.workunit.client.1.smithi195.stdout:7/628: write d4/d16/f2d [1231148,129564] 0 2024-04-06T12:23:12.755 INFO:tasks.workunit.client.1.smithi195.stdout:4/670: getdents d4/d6/d38/d65/dc5 0 2024-04-06T12:23:12.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/715: truncate d6/dd/d70/d24/d25/da5/dc8/fc9 1056609 0 2024-04-06T12:23:12.758 INFO:tasks.workunit.client.1.smithi195.stdout:0/725: creat d4/d48/d4e/fe7 x:0 0 0 2024-04-06T12:23:12.760 INFO:tasks.workunit.client.1.smithi195.stdout:9/711: symlink d3/d10/d7d/dd0/le7 0 2024-04-06T12:23:12.760 INFO:tasks.workunit.client.1.smithi195.stdout:5/776: unlink d0/da/d23/dd4/fcd 0 2024-04-06T12:23:12.761 INFO:tasks.workunit.client.1.smithi195.stdout:9/712: chown d3 1817 1 2024-04-06T12:23:12.761 INFO:tasks.workunit.client.1.smithi195.stdout:6/784: dread - d8/d3d/d5e/dd3/dfe/f60 zero size 2024-04-06T12:23:12.763 INFO:tasks.workunit.client.1.smithi195.stdout:8/716: chown d6/dd/d70/c79 0 1 2024-04-06T12:23:12.765 INFO:tasks.workunit.client.1.smithi195.stdout:3/770: rename d4/de/lfb to d4/de/d8e/d92/l104 0 2024-04-06T12:23:12.765 INFO:tasks.workunit.client.1.smithi195.stdout:5/777: read d0/da/dd/d2e/f6c [653894,62511] 0 2024-04-06T12:23:12.767 INFO:tasks.workunit.client.1.smithi195.stdout:6/785: mknod d8/d21/d2b/d46/c130 0 2024-04-06T12:23:12.767 INFO:tasks.workunit.client.1.smithi195.stdout:8/717: chown d6/dd/d70/d24/d25/f54 3247738 1 2024-04-06T12:23:12.767 INFO:tasks.workunit.client.1.smithi195.stdout:2/757: creat d2/d21/d5e/ff4 x:0 0 0 2024-04-06T12:23:12.772 INFO:tasks.workunit.client.1.smithi195.stdout:5/778: chown d0/da/d23/dd4/fa6 26758 1 2024-04-06T12:23:12.773 INFO:tasks.workunit.client.1.smithi195.stdout:4/671: dwrite d4/d6/d38/d1a/d40/f15 [4194304,4194304] 0 2024-04-06T12:23:12.773 INFO:tasks.workunit.client.1.smithi195.stdout:3/771: symlink d4/de/d8e/d92/d9e/l105 0 2024-04-06T12:23:12.777 INFO:tasks.workunit.client.1.smithi195.stdout:6/786: symlink d8/d21/d31/d6c/d7b/d11b/l131 0 2024-04-06T12:23:12.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/629: dread d4/d16/dd/d22/d3f/faa [0,4194304] 0 2024-04-06T12:23:12.780 INFO:tasks.workunit.client.1.smithi195.stdout:3/772: mkdir d4/d9/d2b/d87/d106 0 2024-04-06T12:23:12.782 INFO:tasks.workunit.client.1.smithi195.stdout:8/718: mknod d6/dd/d70/d24/d25/da5/dc8/de8/d52/db0/cf3 0 2024-04-06T12:23:12.783 INFO:tasks.workunit.client.1.smithi195.stdout:6/787: chown d8/d21/d31/d26/dc8/d4e/f6e 486373290 1 2024-04-06T12:23:12.784 INFO:tasks.workunit.client.1.smithi195.stdout:2/758: dread d2/f12 [0,4194304] 0 2024-04-06T12:23:12.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/773: chown d4/df/d39/f82 20486116 1 2024-04-06T12:23:12.787 INFO:tasks.workunit.client.1.smithi195.stdout:4/672: rename d4/d6/d38/d1a/d40/d57/f59 to d4/d6/d38/d1a/da7/fd4 0 2024-04-06T12:23:12.789 INFO:tasks.workunit.client.1.smithi195.stdout:7/630: mknod d4/d16/dd/d22/d76/ccc 0 2024-04-06T12:23:12.790 INFO:tasks.workunit.client.1.smithi195.stdout:9/713: write d3/d10/d3a/d5d/f65 [2370142,90790] 0 2024-04-06T12:23:12.790 INFO:tasks.workunit.client.1.smithi195.stdout:5/779: dwrite d0/da/dd/d2e/fd1 [0,4194304] 0 2024-04-06T12:23:12.794 INFO:tasks.workunit.client.1.smithi195.stdout:8/719: creat d6/dd/d70/d24/d25/da5/dc8/de8/d12/d83/ff4 x:0 0 0 2024-04-06T12:23:12.794 INFO:tasks.workunit.client.1.smithi195.stdout:3/774: write d4/d53/f54 [1121994,53012] 0 2024-04-06T12:23:12.795 INFO:tasks.workunit.client.1.smithi195.stdout:6/788: truncate d8/d21/d31/d26/dc8/f12f 725659 0 2024-04-06T12:23:12.795 INFO:tasks.workunit.client.1.smithi195.stdout:2/759: rename d2/d21/d5e/d64/l6f to d2/d14/lf5 0 2024-04-06T12:23:12.795 INFO:tasks.workunit.client.1.smithi195.stdout:1/688: dread d4/d14/d17/f42 [4194304,4194304] 0 2024-04-06T12:23:12.799 INFO:tasks.workunit.client.1.smithi195.stdout:8/720: readlink d6/dd/d70/d24/d34/led 0 2024-04-06T12:23:12.799 INFO:tasks.workunit.client.1.smithi195.stdout:3/775: dread - d4/de/d8e/d92/faa zero size 2024-04-06T12:23:12.800 INFO:tasks.workunit.client.1.smithi195.stdout:9/714: symlink d3/da1/le8 0 2024-04-06T12:23:12.800 INFO:tasks.workunit.client.1.smithi195.stdout:4/673: mknod d4/d6/d38/d65/dc5/cd5 0 2024-04-06T12:23:12.801 INFO:tasks.workunit.client.1.smithi195.stdout:1/689: chown d4/d14/d17/d24/d99/c4b 17 1 2024-04-06T12:23:12.803 INFO:tasks.workunit.client.1.smithi195.stdout:2/760: mkdir d2/d21/d29/de7/df6 0 2024-04-06T12:23:12.804 INFO:tasks.workunit.client.1.smithi195.stdout:3/776: symlink d4/d9/d2b/d9b/l107 0 2024-04-06T12:23:12.808 INFO:tasks.workunit.client.1.smithi195.stdout:2/761: chown d2/d3f/d7d/c4c 1334 1 2024-04-06T12:23:12.810 INFO:tasks.workunit.client.1.smithi195.stdout:6/789: truncate d8/d21/d31/d6c/d7b/d11b/daf/ff6 229142 0 2024-04-06T12:23:12.812 INFO:tasks.workunit.client.1.smithi195.stdout:7/631: dread d4/d10/d18/d19/f43 [0,4194304] 0 2024-04-06T12:23:12.815 INFO:tasks.workunit.client.1.smithi195.stdout:5/780: dread d0/da/dd/d1c/d5a/d62/d64/d67/db9/fac [0,4194304] 0 2024-04-06T12:23:12.880 INFO:tasks.workunit.client.1.smithi195.stdout:0/726: sync 2024-04-06T12:23:12.907 INFO:tasks.workunit.client.1.smithi195.stdout:9/715: creat d3/d10/d3b/d48/d5e/fe9 x:0 0 0 2024-04-06T12:23:12.908 INFO:tasks.workunit.client.1.smithi195.stdout:1/690: mkdir d4/d14/d17/d24/d99/d4e/d60/dc4/dda 0 2024-04-06T12:23:12.931 INFO:tasks.workunit.client.1.smithi195.stdout:2/762: creat d2/ddc/deb/ff7 x:0 0 0 2024-04-06T12:23:12.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/632: symlink d4/d10/d12/da5/da3/lcd 0 2024-04-06T12:23:12.936 INFO:tasks.workunit.client.1.smithi195.stdout:5/781: creat d0/da/d4b/d4e/f10b x:0 0 0 2024-04-06T12:23:12.937 INFO:tasks.workunit.client.1.smithi195.stdout:4/674: write d4/d6/d38/d1a/f2d [2648336,42833] 0 2024-04-06T12:23:12.941 INFO:tasks.workunit.client.1.smithi195.stdout:7/633: dread d4/d16/dd/d22/d3f/d54/f9d [0,4194304] 0 2024-04-06T12:23:12.946 INFO:tasks.workunit.client.1.smithi195.stdout:9/716: dwrite d3/dc6/fc0 [0,4194304] 0 2024-04-06T12:23:12.948 INFO:tasks.workunit.client.1.smithi195.stdout:0/727: unlink d4/d6/d2f/d49/l57 0 2024-04-06T12:23:12.950 INFO:tasks.workunit.client.1.smithi195.stdout:4/675: symlink d4/d6/d38/d65/d7a/ld6 0 2024-04-06T12:23:12.950 INFO:tasks.workunit.client.1.smithi195.stdout:8/721: truncate d6/dd/d70/d24/d34/d67/dec/f51 1248495 0 2024-04-06T12:23:12.952 INFO:tasks.workunit.client.1.smithi195.stdout:5/782: dread d0/f6 [0,4194304] 0 2024-04-06T12:23:12.953 INFO:tasks.workunit.client.1.smithi195.stdout:6/790: rmdir d8/d3d/d5e/d72/d10c/d9c/dce 39 2024-04-06T12:23:12.955 INFO:tasks.workunit.client.1.smithi195.stdout:9/717: stat d3/f2a 0 2024-04-06T12:23:12.955 INFO:tasks.workunit.client.1.smithi195.stdout:3/777: getdents d4/de/d8e/d92/d9e/de4 0 2024-04-06T12:23:12.959 INFO:tasks.workunit.client.1.smithi195.stdout:1/691: link d4/c5e d4/d14/d17/d24/d99/cdb 0 2024-04-06T12:23:12.961 INFO:tasks.workunit.client.1.smithi195.stdout:0/728: dwrite d4/d6/f27 [0,4194304] 0 2024-04-06T12:23:12.961 INFO:tasks.workunit.client.1.smithi195.stdout:5/783: creat d0/da/d23/dd4/d106/f10c x:0 0 0 2024-04-06T12:23:12.963 INFO:tasks.workunit.client.1.smithi195.stdout:2/763: dwrite d2/f13 [0,4194304] 0 2024-04-06T12:23:12.965 INFO:tasks.workunit.client.1.smithi195.stdout:2/764: fsync d2/d3f/d7d/f54 0 2024-04-06T12:23:12.966 INFO:tasks.workunit.client.1.smithi195.stdout:2/765: truncate d2/d41/d84/d8d/dce/ff0 622855 0 2024-04-06T12:23:12.967 INFO:tasks.workunit.client.1.smithi195.stdout:8/722: mkdir d6/dd/d70/d24/d34/d67/d9d/dd7/df5 0 2024-04-06T12:23:12.968 INFO:tasks.workunit.client.1.smithi195.stdout:2/766: write d2/ddc/deb/ff7 [267623,116060] 0 2024-04-06T12:23:12.971 INFO:tasks.workunit.client.1.smithi195.stdout:1/692: unlink f1 0 2024-04-06T12:23:12.973 INFO:tasks.workunit.client.1.smithi195.stdout:9/718: rename d3/d10/d3b/d48/d5e/f88 to d3/d10/d4f/fea 0 2024-04-06T12:23:12.978 INFO:tasks.workunit.client.1.smithi195.stdout:6/791: unlink d8/d3d/d5e/d72/d10c/d82/f11e 0 2024-04-06T12:23:12.979 INFO:tasks.workunit.client.1.smithi195.stdout:5/784: symlink d0/da/dd/d1c/d5a/d62/d64/l10d 0 2024-04-06T12:23:12.980 INFO:tasks.workunit.client.1.smithi195.stdout:3/778: mkdir d4/d9/d37/db9/d108 0 2024-04-06T12:23:12.982 INFO:tasks.workunit.client.1.smithi195.stdout:9/719: dwrite d3/da1/fd5 [0,4194304] 0 2024-04-06T12:23:12.984 INFO:tasks.workunit.client.1.smithi195.stdout:1/693: rmdir d4/d14/d17/d24/d99/d88/dbf 39 2024-04-06T12:23:12.990 INFO:tasks.workunit.client.1.smithi195.stdout:0/729: rmdir d4/d53/dd1 0 2024-04-06T12:23:12.991 INFO:tasks.workunit.client.1.smithi195.stdout:9/720: creat d3/d10/d3b/d48/d5e/feb x:0 0 0 2024-04-06T12:23:12.992 INFO:tasks.workunit.client.1.smithi195.stdout:4/676: dread d4/d6/d38/d1a/f24 [0,4194304] 0 2024-04-06T12:23:12.993 INFO:tasks.workunit.client.1.smithi195.stdout:1/694: dread d4/d14/d17/d24/d2a/fbc [0,4194304] 0 2024-04-06T12:23:12.995 INFO:tasks.workunit.client.1.smithi195.stdout:8/723: getdents d6/dd/d70/d24/d25/d7c 0 2024-04-06T12:23:12.995 INFO:tasks.workunit.client.1.smithi195.stdout:3/779: creat d4/de/d8e/d92/f109 x:0 0 0 2024-04-06T12:23:12.996 INFO:tasks.workunit.client.1.smithi195.stdout:0/730: mknod d4/d48/d77/ce8 0 2024-04-06T12:23:12.998 INFO:tasks.workunit.client.1.smithi195.stdout:5/785: dwrite d0/da/f22 [0,4194304] 0 2024-04-06T12:23:13.000 INFO:tasks.workunit.client.1.smithi195.stdout:8/724: stat d6/dd/d70/d24/d25/da5/dc8/de8 0 2024-04-06T12:23:13.003 INFO:tasks.workunit.client.1.smithi195.stdout:2/767: write d2/f1c [6110360,78288] 0 2024-04-06T12:23:13.004 INFO:tasks.workunit.client.1.smithi195.stdout:7/634: sync 2024-04-06T12:23:13.008 INFO:tasks.workunit.client.1.smithi195.stdout:8/725: dread - d6/dd/d70/d24/d34/d67/dec/fe7 zero size 2024-04-06T12:23:13.009 INFO:tasks.workunit.client.1.smithi195.stdout:2/768: creat d2/d21/d2c/ff8 x:0 0 0 2024-04-06T12:23:13.009 INFO:tasks.workunit.client.1.smithi195.stdout:6/792: dread d8/d21/d31/ffc [4194304,4194304] 0 2024-04-06T12:23:13.011 INFO:tasks.workunit.client.1.smithi195.stdout:4/677: creat d4/d6/d38/d1a/fd7 x:0 0 0 2024-04-06T12:23:13.012 INFO:tasks.workunit.client.1.smithi195.stdout:0/731: mkdir d4/d48/d67/d75/de9 0 2024-04-06T12:23:13.014 INFO:tasks.workunit.client.1.smithi195.stdout:1/695: write d4/f26 [1168310,24994] 0 2024-04-06T12:23:13.016 INFO:tasks.workunit.client.1.smithi195.stdout:3/780: dwrite d4/d9/d2b/d3b/d5e/d7e/fdf [0,4194304] 0 2024-04-06T12:23:13.018 INFO:tasks.workunit.client.1.smithi195.stdout:5/786: dwrite d0/da/d13/ff4 [0,4194304] 0 2024-04-06T12:23:13.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:11.574420+0000 mgr.smithi195.ausetj (mgr.24375) 56 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 164 MiB/s wr, 296 op/s 2024-04-06T12:23:13.031 INFO:tasks.workunit.client.1.smithi195.stdout:7/635: creat d4/d10/d18/d19/fce x:0 0 0 2024-04-06T12:23:13.032 INFO:tasks.workunit.client.1.smithi195.stdout:1/696: unlink d4/d14/d17/f98 0 2024-04-06T12:23:13.032 INFO:tasks.workunit.client.1.smithi195.stdout:3/781: rmdir d4/d9/dcf 39 2024-04-06T12:23:13.033 INFO:tasks.workunit.client.1.smithi195.stdout:2/769: rmdir d2/d41/d84/d8d/de0 0 2024-04-06T12:23:13.036 INFO:tasks.workunit.client.1.smithi195.stdout:9/721: dwrite d3/dd3/fe6 [0,4194304] 0 2024-04-06T12:23:13.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/770: write d2/d41/d5a/ddd/fe2 [899329,4537] 0 2024-04-06T12:23:13.042 INFO:tasks.workunit.client.1.smithi195.stdout:5/787: dwrite d0/da/d23/dd4/dc2/fe8 [0,4194304] 0 2024-04-06T12:23:13.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:11.574420+0000 mgr.smithi195.ausetj (mgr.24375) 56 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 164 MiB/s wr, 296 op/s 2024-04-06T12:23:13.055 INFO:tasks.workunit.client.1.smithi195.stdout:1/697: creat d4/d14/d17/dc1/fdc x:0 0 0 2024-04-06T12:23:13.059 INFO:tasks.workunit.client.1.smithi195.stdout:9/722: symlink d3/d10/d3a/lec 0 2024-04-06T12:23:13.059 INFO:tasks.workunit.client.1.smithi195.stdout:4/678: dread d4/f88 [0,4194304] 0 2024-04-06T12:23:13.059 INFO:tasks.workunit.client.1.smithi195.stdout:2/771: rmdir d2/d14 39 2024-04-06T12:23:13.060 INFO:tasks.workunit.client.1.smithi195.stdout:3/782: truncate d4/d9/d2b/d3b/d40/f45 257015 0 2024-04-06T12:23:13.062 INFO:tasks.workunit.client.1.smithi195.stdout:4/679: read d4/d6/d38/f86 [299601,102224] 0 2024-04-06T12:23:13.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/698: dwrite d4/fa [0,4194304] 0 2024-04-06T12:23:13.062 INFO:tasks.workunit.client.1.smithi195.stdout:5/788: mknod d0/da/d23/dd4/d106/c10e 0 2024-04-06T12:23:13.062 INFO:tasks.workunit.client.1.smithi195.stdout:2/772: chown d2/d41/d84/d8d/dce/ld2 421679 1 2024-04-06T12:23:13.067 INFO:tasks.workunit.client.1.smithi195.stdout:7/636: dread d4/d10/d18/d57/f7f [0,4194304] 0 2024-04-06T12:23:13.068 INFO:tasks.workunit.client.1.smithi195.stdout:0/732: getdents d4/d48/d77 0 2024-04-06T12:23:13.069 INFO:tasks.workunit.client.1.smithi195.stdout:8/726: getdents d6/dd/d70/d24/d25/da5/dc8/de8/daa/dda 0 2024-04-06T12:23:13.071 INFO:tasks.workunit.client.1.smithi195.stdout:8/727: dread - d6/dd/d42/feb zero size 2024-04-06T12:23:13.074 INFO:tasks.workunit.client.1.smithi195.stdout:9/723: unlink d3/f64 0 2024-04-06T12:23:13.076 INFO:tasks.workunit.client.1.smithi195.stdout:5/789: symlink d0/da/dd/d1c/l10f 0 2024-04-06T12:23:13.076 INFO:tasks.workunit.client.1.smithi195.stdout:7/637: dread d4/d10/f27 [0,4194304] 0 2024-04-06T12:23:13.081 INFO:tasks.workunit.client.1.smithi195.stdout:3/783: mknod d4/d9/d2b/d3b/c10a 0 2024-04-06T12:23:13.082 INFO:tasks.workunit.client.1.smithi195.stdout:2/773: write d2/d14/f18 [5558343,89264] 0 2024-04-06T12:23:13.083 INFO:tasks.workunit.client.1.smithi195.stdout:8/728: mkdir d6/dd/d70/d24/d25/da5/dc8/de8/daa/dda/df6 0 2024-04-06T12:23:13.085 INFO:tasks.workunit.client.1.smithi195.stdout:9/724: read d3/d10/f35 [4021827,108550] 0 2024-04-06T12:23:13.086 INFO:tasks.workunit.client.1.smithi195.stdout:5/790: rmdir d0/da/d4b 39 2024-04-06T12:23:13.088 INFO:tasks.workunit.client.1.smithi195.stdout:7/638: dread d4/d10/f40 [0,4194304] 0 2024-04-06T12:23:13.089 INFO:tasks.workunit.client.1.smithi195.stdout:3/784: read - d4/de/dc8/f103 zero size 2024-04-06T12:23:13.090 INFO:tasks.workunit.client.1.smithi195.stdout:2/774: creat d2/d41/d84/d8d/d94/ff9 x:0 0 0 2024-04-06T12:23:13.090 INFO:tasks.workunit.client.1.smithi195.stdout:2/775: fdatasync d2/f13 0 2024-04-06T12:23:13.091 INFO:tasks.workunit.client.1.smithi195.stdout:2/776: chown d2/d21/d29/fb5 1613 1 2024-04-06T12:23:13.097 INFO:tasks.workunit.client.1.smithi195.stdout:4/680: rename d4/d8c/d96/f97 to d4/d6/d38/d65/fd8 0 2024-04-06T12:23:13.099 INFO:tasks.workunit.client.1.smithi195.stdout:3/785: dread - d4/df/d39/f9c zero size 2024-04-06T12:23:13.100 INFO:tasks.workunit.client.1.smithi195.stdout:3/786: readlink d4/d9/d2b/d3b/d5e/d7e/lcb 0 2024-04-06T12:23:13.100 INFO:tasks.workunit.client.1.smithi195.stdout:3/787: chown d4/de/d8e/d92/lc0 1 1 2024-04-06T12:23:13.102 INFO:tasks.workunit.client.1.smithi195.stdout:3/788: chown d4/d9/d2b/d3b/d5e/fd8 151946854 1 2024-04-06T12:23:13.102 INFO:tasks.workunit.client.1.smithi195.stdout:9/725: dread d3/f17 [0,4194304] 0 2024-04-06T12:23:13.107 INFO:tasks.workunit.client.1.smithi195.stdout:0/733: rename d4/d48/f89 to d4/d6/d58/da7/dc6/fea 0 2024-04-06T12:23:13.108 INFO:tasks.workunit.client.1.smithi195.stdout:4/681: creat d4/d6/d38/d1a/d40/d20/fd9 x:0 0 0 2024-04-06T12:23:13.112 INFO:tasks.workunit.client.1.smithi195.stdout:3/789: creat d4/df/f10b x:0 0 0 2024-04-06T12:23:13.115 INFO:tasks.workunit.client.1.smithi195.stdout:7/639: creat d4/fcf x:0 0 0 2024-04-06T12:23:13.117 INFO:tasks.workunit.client.1.smithi195.stdout:7/640: chown d4/d24/f49 1480 1 2024-04-06T12:23:13.119 INFO:tasks.workunit.client.1.smithi195.stdout:4/682: dread d4/d6/d38/d1a/d40/d20/f8a [0,4194304] 0 2024-04-06T12:23:13.121 INFO:tasks.workunit.client.1.smithi195.stdout:3/790: rmdir d4/de/d8e 39 2024-04-06T12:23:13.121 INFO:tasks.workunit.client.1.smithi195.stdout:4/683: read d4/d6/d38/f39 [2880334,57593] 0 2024-04-06T12:23:13.124 INFO:tasks.workunit.client.1.smithi195.stdout:0/734: dread d4/d41/f71 [0,4194304] 0 2024-04-06T12:23:13.124 INFO:tasks.workunit.client.1.smithi195.stdout:4/684: write d4/d6/d38/d1a/d40/f15 [7994308,73619] 0 2024-04-06T12:23:13.124 INFO:tasks.workunit.client.1.smithi195.stdout:0/735: stat d4/d6/f1d 0 2024-04-06T12:23:13.131 INFO:tasks.workunit.client.1.smithi195.stdout:2/777: getdents d2/d21/d69 0 2024-04-06T12:23:13.132 INFO:tasks.workunit.client.1.smithi195.stdout:8/729: dwrite d6/dd/d70/d24/d34/d67/da1/fdd [0,4194304] 0 2024-04-06T12:23:13.132 INFO:tasks.workunit.client.1.smithi195.stdout:5/791: dwrite d0/da/d23/f61 [0,4194304] 0 2024-04-06T12:23:13.134 INFO:tasks.workunit.client.1.smithi195.stdout:1/699: symlink d4/d14/d17/d24/d99/d4e/d8f/dbe/dc2/ldd 0 2024-04-06T12:23:13.138 INFO:tasks.workunit.client.1.smithi195.stdout:2/778: chown d2/d41/d84/d8d/d94/db6 2169128 1 2024-04-06T12:23:13.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/793: sync 2024-04-06T12:23:13.139 INFO:tasks.workunit.client.1.smithi195.stdout:9/726: write d3/d10/f29 [104359,112713] 0 2024-04-06T12:23:13.142 INFO:tasks.workunit.client.1.smithi195.stdout:3/791: rename d4/d9/d2b/d87/d106 to d4/de/d8e/d92/d9e/da4/d10c 0 2024-04-06T12:23:13.142 INFO:tasks.workunit.client.1.smithi195.stdout:3/792: fdatasync d4/d9/d37/f97 0 2024-04-06T12:23:13.143 INFO:tasks.workunit.client.1.smithi195.stdout:3/793: fdatasync f3 0 2024-04-06T12:23:13.143 INFO:tasks.workunit.client.1.smithi195.stdout:3/794: chown d4/d53 104 1 2024-04-06T12:23:13.149 INFO:tasks.workunit.client.1.smithi195.stdout:8/730: creat d6/dd/d70/d24/d25/d7c/ff7 x:0 0 0 2024-04-06T12:23:13.153 INFO:tasks.workunit.client.1.smithi195.stdout:5/792: creat d0/da/dd/d1c/d5a/d68/dd7/d101/f110 x:0 0 0 2024-04-06T12:23:13.155 INFO:tasks.workunit.client.1.smithi195.stdout:5/793: dread - d0/d52/d91/fdc zero size 2024-04-06T12:23:13.156 INFO:tasks.workunit.client.1.smithi195.stdout:0/736: dwrite d4/f3d [0,4194304] 0 2024-04-06T12:23:13.156 INFO:tasks.workunit.client.1.smithi195.stdout:6/794: dread - d8/d3d/d5e/d72/d10c/d32/f112 zero size 2024-04-06T12:23:13.159 INFO:tasks.workunit.client.1.smithi195.stdout:4/685: creat d4/fda x:0 0 0 2024-04-06T12:23:13.160 INFO:tasks.workunit.client.1.smithi195.stdout:8/731: symlink d6/dd/d70/d24/d25/da5/dc8/dcb/lf8 0 2024-04-06T12:23:13.161 INFO:tasks.workunit.client.1.smithi195.stdout:7/641: link d4/d10/d18/d19/lc0 d4/ld0 0 2024-04-06T12:23:13.162 INFO:tasks.workunit.client.1.smithi195.stdout:2/779: getdents d2/d3f/d7d/de8 0 2024-04-06T12:23:13.169 INFO:tasks.workunit.client.1.smithi195.stdout:4/686: rmdir d4/d6/d38/d1a/da7 39 2024-04-06T12:23:13.170 INFO:tasks.workunit.client.1.smithi195.stdout:8/732: rmdir d6/dd 39 2024-04-06T12:23:13.170 INFO:tasks.workunit.client.1.smithi195.stdout:4/687: write d4/d6/d38/d1a/fd7 [1044407,125089] 0 2024-04-06T12:23:13.171 INFO:tasks.workunit.client.1.smithi195.stdout:7/642: rmdir d4/d16/dd/d22/d3f 39 2024-04-06T12:23:13.171 INFO:tasks.workunit.client.1.smithi195.stdout:9/727: write d3/d10/d3b/d48/d9c/f75 [216030,28557] 0 2024-04-06T12:23:13.174 INFO:tasks.workunit.client.1.smithi195.stdout:0/737: unlink d4/d6/c60 0 2024-04-06T12:23:13.177 INFO:tasks.workunit.client.1.smithi195.stdout:2/780: creat d2/d21/d2c/d2d/d92/d95/d9b/dd9/ffa x:0 0 0 2024-04-06T12:23:13.179 INFO:tasks.workunit.client.1.smithi195.stdout:5/794: rename d0/da/d23/c10a to d0/da/dd/d1c/d5a/c111 0 2024-04-06T12:23:13.182 INFO:tasks.workunit.client.1.smithi195.stdout:1/700: dwrite d4/d14/d17/d24/d2a/fbc [0,4194304] 0 2024-04-06T12:23:13.186 INFO:tasks.workunit.client.1.smithi195.stdout:8/733: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/ff1 [347408,10005] 0 2024-04-06T12:23:13.189 INFO:tasks.workunit.client.1.smithi195.stdout:4/688: dwrite d4/d8c/fbf [0,4194304] 0 2024-04-06T12:23:13.189 INFO:tasks.workunit.client.1.smithi195.stdout:0/738: write d4/d48/d67/d83/fdb [328404,30014] 0 2024-04-06T12:23:13.189 INFO:tasks.workunit.client.1.smithi195.stdout:3/795: dread f3 [4194304,4194304] 0 2024-04-06T12:23:13.189 INFO:tasks.workunit.client.1.smithi195.stdout:9/728: link d3/d10/d3b/d48/d9c/f75 d3/dd3/fed 0 2024-04-06T12:23:13.195 INFO:tasks.workunit.client.1.smithi195.stdout:2/781: creat d2/d21/d29/ffb x:0 0 0 2024-04-06T12:23:13.197 INFO:tasks.workunit.client.1.smithi195.stdout:7/643: dread d4/d16/d11/f59 [4194304,4194304] 0 2024-04-06T12:23:13.199 INFO:tasks.workunit.client.1.smithi195.stdout:6/795: dwrite d8/d21/d2b/d46/f4c [0,4194304] 0 2024-04-06T12:23:13.199 INFO:tasks.workunit.client.1.smithi195.stdout:5/795: truncate d0/da/dd/d1c/d5a/d62/fc9 254108 0 2024-04-06T12:23:13.200 INFO:tasks.workunit.client.1.smithi195.stdout:9/729: read d3/d10/d3a/d5d/f65 [5765109,87307] 0 2024-04-06T12:23:13.201 INFO:tasks.workunit.client.1.smithi195.stdout:4/689: rmdir d4/d6d/da6 39 2024-04-06T12:23:13.201 INFO:tasks.workunit.client.1.smithi195.stdout:3/796: mknod d4/dc4/c10d 0 2024-04-06T12:23:13.203 INFO:tasks.workunit.client.1.smithi195.stdout:1/701: creat d4/d14/d17/d24/d2a/fde x:0 0 0 2024-04-06T12:23:13.206 INFO:tasks.workunit.client.1.smithi195.stdout:8/734: creat d6/dd/d70/d24/d25/da5/dc8/de8/d12/d61/ff9 x:0 0 0 2024-04-06T12:23:13.209 INFO:tasks.workunit.client.1.smithi195.stdout:3/797: dwrite d4/de/dc8/ff9 [0,4194304] 0 2024-04-06T12:23:13.209 INFO:tasks.workunit.client.1.smithi195.stdout:6/796: rmdir d8/d21/d2b/d46/d44/d86 39 2024-04-06T12:23:13.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/739: mknod d4/d48/d67/d75/de9/ceb 0 2024-04-06T12:23:13.211 INFO:tasks.workunit.client.1.smithi195.stdout:3/798: chown d4/d9/d2b/f36 178061 1 2024-04-06T12:23:13.212 INFO:tasks.workunit.client.1.smithi195.stdout:0/740: chown d4/d6/d58/lae 13412 1 2024-04-06T12:23:13.213 INFO:tasks.workunit.client.1.smithi195.stdout:2/782: creat d2/d21/d2c/dc9/ffc x:0 0 0 2024-04-06T12:23:13.214 INFO:tasks.workunit.client.1.smithi195.stdout:2/783: dread - d2/d21/f74 zero size 2024-04-06T12:23:13.215 INFO:tasks.workunit.client.1.smithi195.stdout:2/784: chown d2/f1c 484 1 2024-04-06T12:23:13.218 INFO:tasks.workunit.client.1.smithi195.stdout:8/735: rmdir d6/dd/d70/d24/d34/d67/da1 39 2024-04-06T12:23:13.219 INFO:tasks.workunit.client.1.smithi195.stdout:6/797: rename d8/d21/d2b/d46/d44/fe8 to d8/d21/d31/d49/dd8/f132 0 2024-04-06T12:23:13.219 INFO:tasks.workunit.client.1.smithi195.stdout:6/798: dread - d8/d3d/d5e/f84 zero size 2024-04-06T12:23:13.222 INFO:tasks.workunit.client.1.smithi195.stdout:5/796: creat d0/da/d23/f112 x:0 0 0 2024-04-06T12:23:13.223 INFO:tasks.workunit.client.1.smithi195.stdout:5/797: readlink d0/d35/l72 0 2024-04-06T12:23:13.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/785: unlink d2/d21/d2c/d2d/d92/d95/cd4 0 2024-04-06T12:23:13.226 INFO:tasks.workunit.client.1.smithi195.stdout:4/690: link d4/d3e/f8d d4/d6d/fdb 0 2024-04-06T12:23:13.228 INFO:tasks.workunit.client.1.smithi195.stdout:1/702: creat d4/d14/d17/d3a/da8/da4/db2/fdf x:0 0 0 2024-04-06T12:23:13.231 INFO:tasks.workunit.client.1.smithi195.stdout:9/730: dwrite d3/d10/d4f/f5a [0,4194304] 0 2024-04-06T12:23:13.234 INFO:tasks.workunit.client.1.smithi195.stdout:7/644: getdents d4/d16/d11 0 2024-04-06T12:23:13.235 INFO:tasks.workunit.client.1.smithi195.stdout:2/786: dwrite d2/d21/d2c/d2d/f57 [0,4194304] 0 2024-04-06T12:23:13.238 INFO:tasks.workunit.client.1.smithi195.stdout:4/691: symlink d4/d6/d38/d1a/d40/d20/d23/ldc 0 2024-04-06T12:23:13.243 INFO:tasks.workunit.client.1.smithi195.stdout:0/741: dread d4/d6/d58/da7/fbb [0,4194304] 0 2024-04-06T12:23:13.244 INFO:tasks.workunit.client.1.smithi195.stdout:9/731: unlink d3/d10/d3a/d5d/c79 0 2024-04-06T12:23:13.246 INFO:tasks.workunit.client.1.smithi195.stdout:2/787: mkdir d2/ddc/dfd 0 2024-04-06T12:23:13.249 INFO:tasks.workunit.client.1.smithi195.stdout:3/799: dwrite d4/d9/d2b/d3b/d40/f4a [0,4194304] 0 2024-04-06T12:23:13.250 INFO:tasks.workunit.client.1.smithi195.stdout:7/645: write d4/d16/dd/d22/d3f/d54/f5f [4167888,56543] 0 2024-04-06T12:23:13.250 INFO:tasks.workunit.client.1.smithi195.stdout:4/692: mknod d4/d6/d38/cdd 0 2024-04-06T12:23:13.250 INFO:tasks.workunit.client.1.smithi195.stdout:6/799: creat d8/d21/d31/d6c/f133 x:0 0 0 2024-04-06T12:23:13.250 INFO:tasks.workunit.client.1.smithi195.stdout:4/693: write d4/d3e/fac [637027,17345] 0 2024-04-06T12:23:13.252 INFO:tasks.workunit.client.1.smithi195.stdout:1/703: rename d4/d14/l96 to d4/d14/d17/d3a/le0 0 2024-04-06T12:23:13.253 INFO:tasks.workunit.client.1.smithi195.stdout:1/704: read - d4/d14/d17/d3a/da8/f9c zero size 2024-04-06T12:23:13.254 INFO:tasks.workunit.client.1.smithi195.stdout:8/736: getdents d6/dd/d70/d24/d34/d67/dec/d4b 0 2024-04-06T12:23:13.255 INFO:tasks.workunit.client.1.smithi195.stdout:8/737: truncate d6/dd/d42/f9b 4325685 0 2024-04-06T12:23:13.256 INFO:tasks.workunit.client.1.smithi195.stdout:2/788: mkdir d2/d41/d84/db2/dfe 0 2024-04-06T12:23:13.257 INFO:tasks.workunit.client.1.smithi195.stdout:7/646: mknod d4/d10/d18/d57/cd1 0 2024-04-06T12:23:13.258 INFO:tasks.workunit.client.1.smithi195.stdout:6/800: chown d8/ca 48112 1 2024-04-06T12:23:13.258 INFO:tasks.workunit.client.1.smithi195.stdout:4/694: creat d4/d6/fde x:0 0 0 2024-04-06T12:23:13.259 INFO:tasks.workunit.client.1.smithi195.stdout:0/742: chown d4/d6/d1a/d73/f74 5252 1 2024-04-06T12:23:13.261 INFO:tasks.workunit.client.1.smithi195.stdout:2/789: creat d2/d41/d5a/fff x:0 0 0 2024-04-06T12:23:13.262 INFO:tasks.workunit.client.1.smithi195.stdout:8/738: mkdir d6/dd/d70/d24/d34/d67/dec/d4b/dfa 0 2024-04-06T12:23:13.264 INFO:tasks.workunit.client.1.smithi195.stdout:4/695: read d4/d6/d38/f86 [194028,105391] 0 2024-04-06T12:23:13.264 INFO:tasks.workunit.client.1.smithi195.stdout:1/705: symlink d4/d14/d17/d3a/da8/db8/dd0/le1 0 2024-04-06T12:23:13.267 INFO:tasks.workunit.client.1.smithi195.stdout:2/790: symlink d2/d21/d2c/l100 0 2024-04-06T12:23:13.268 INFO:tasks.workunit.client.1.smithi195.stdout:5/798: truncate d0/da/d13/ff4 2643344 0 2024-04-06T12:23:13.269 INFO:tasks.workunit.client.1.smithi195.stdout:7/647: mkdir d4/d10/dd2 0 2024-04-06T12:23:13.271 INFO:tasks.workunit.client.1.smithi195.stdout:6/801: dwrite d8/d3d/d5e/d72/d10c/d32/f3a [0,4194304] 0 2024-04-06T12:23:13.275 INFO:tasks.workunit.client.1.smithi195.stdout:4/696: mknod d4/d6/d38/d1a/d40/d57/d64/cdf 0 2024-04-06T12:23:13.277 INFO:tasks.workunit.client.1.smithi195.stdout:2/791: mkdir d2/ddc/d101 0 2024-04-06T12:23:13.277 INFO:tasks.workunit.client.1.smithi195.stdout:5/799: dread d0/da/d23/d38/fc3 [0,4194304] 0 2024-04-06T12:23:13.279 INFO:tasks.workunit.client.1.smithi195.stdout:9/732: getdents d3/de/ddf 0 2024-04-06T12:23:13.279 INFO:tasks.workunit.client.1.smithi195.stdout:2/792: stat d2/ddc/dfd 0 2024-04-06T12:23:13.280 INFO:tasks.workunit.client.1.smithi195.stdout:3/800: dread d4/f69 [0,4194304] 0 2024-04-06T12:23:13.282 INFO:tasks.workunit.client.1.smithi195.stdout:8/739: creat d6/dd/d70/d24/d34/d67/d9d/dd7/df5/ffb x:0 0 0 2024-04-06T12:23:13.282 INFO:tasks.workunit.client.1.smithi195.stdout:5/800: readlink d0/da/dd/d2e/l84 0 2024-04-06T12:23:13.282 INFO:tasks.workunit.client.1.smithi195.stdout:7/648: dwrite d4/d16/d11/fb2 [0,4194304] 0 2024-04-06T12:23:13.283 INFO:tasks.workunit.client.1.smithi195.stdout:2/793: chown d2/d21/fc6 1 1 2024-04-06T12:23:13.284 INFO:tasks.workunit.client.1.smithi195.stdout:9/733: fsync d3/d10/d3b/d48/f4a 0 2024-04-06T12:23:13.285 INFO:tasks.workunit.client.1.smithi195.stdout:4/697: truncate d4/d6/d38/d1a/f2d 5570186 0 2024-04-06T12:23:13.292 INFO:tasks.workunit.client.1.smithi195.stdout:3/801: truncate d4/de/d8e/d92/f109 390608 0 2024-04-06T12:23:13.292 INFO:tasks.workunit.client.1.smithi195.stdout:9/734: mkdir d3/d10/d7d/dee 0 2024-04-06T12:23:13.295 INFO:tasks.workunit.client.1.smithi195.stdout:0/743: dwrite d4/d6/d1a/d73/f74 [0,4194304] 0 2024-04-06T12:23:13.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/740: dread d6/dd/d70/d24/d25/da5/dc8/de8/f55 [0,4194304] 0 2024-04-06T12:23:13.300 INFO:tasks.workunit.client.1.smithi195.stdout:1/706: dwrite d4/d14/d17/d3a/da8/f33 [4194304,4194304] 0 2024-04-06T12:23:13.303 INFO:tasks.workunit.client.1.smithi195.stdout:0/744: truncate d4/d48/f5a 4897266 0 2024-04-06T12:23:13.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/649: dread d4/d10/f27 [0,4194304] 0 2024-04-06T12:23:13.306 INFO:tasks.workunit.client.1.smithi195.stdout:6/802: dread d8/f2a [0,4194304] 0 2024-04-06T12:23:13.310 INFO:tasks.workunit.client.1.smithi195.stdout:8/741: readlink d6/dd/d70/d24/d25/da5/dc8/de8/d12/d83/laf 0 2024-04-06T12:23:13.312 INFO:tasks.workunit.client.1.smithi195.stdout:0/745: write d4/d48/d77/d97/db7/fb1 [100038,107779] 0 2024-04-06T12:23:13.314 INFO:tasks.workunit.client.1.smithi195.stdout:5/801: dwrite d0/da/d23/dd4/f49 [0,4194304] 0 2024-04-06T12:23:13.314 INFO:tasks.workunit.client.1.smithi195.stdout:1/707: fdatasync d4/d14/d17/d24/d99/d4e/d8f/dbe/fc9 0 2024-04-06T12:23:13.315 INFO:tasks.workunit.client.1.smithi195.stdout:7/650: mknod d4/d16/dd/d22/d3f/d54/cd3 0 2024-04-06T12:23:13.319 INFO:tasks.workunit.client.1.smithi195.stdout:4/698: dwrite d4/d3e/f8d [0,4194304] 0 2024-04-06T12:23:13.322 INFO:tasks.workunit.client.1.smithi195.stdout:6/803: creat d8/d3d/d5e/d72/d10c/d9c/d110/f134 x:0 0 0 2024-04-06T12:23:13.322 INFO:tasks.workunit.client.1.smithi195.stdout:5/802: chown d0/da/dd/d1c/l10f 12186 1 2024-04-06T12:23:13.322 INFO:tasks.workunit.client.1.smithi195.stdout:7/651: rmdir d4/d16/d6b 39 2024-04-06T12:23:13.322 INFO:tasks.workunit.client.1.smithi195.stdout:3/802: dwrite d4/d9/d2b/d3b/d5e/d7e/fc6 [0,4194304] 0 2024-04-06T12:23:13.326 INFO:tasks.workunit.client.1.smithi195.stdout:9/735: dread d3/d10/d3a/d5d/fc9 [0,4194304] 0 2024-04-06T12:23:13.327 INFO:tasks.workunit.client.1.smithi195.stdout:8/742: creat d6/dd/d70/d24/d34/d67/ffc x:0 0 0 2024-04-06T12:23:13.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/736: chown d3/dd3/fe6 6375 1 2024-04-06T12:23:13.331 INFO:tasks.workunit.client.1.smithi195.stdout:1/708: dread d4/d14/d17/d3a/da8/da4/db2/d5d/fa3 [0,4194304] 0 2024-04-06T12:23:13.334 INFO:tasks.workunit.client.1.smithi195.stdout:1/709: write d4/d14/d17/dc1/fdc [114640,101898] 0 2024-04-06T12:23:13.334 INFO:tasks.workunit.client.1.smithi195.stdout:5/803: creat d0/da/f113 x:0 0 0 2024-04-06T12:23:13.335 INFO:tasks.workunit.client.1.smithi195.stdout:6/804: unlink d8/d21/d31/d6c/ff9 0 2024-04-06T12:23:13.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/743: creat d6/dd/d70/d24/d25/da5/dc8/de8/daa/dab/ffd x:0 0 0 2024-04-06T12:23:13.338 INFO:tasks.workunit.client.1.smithi195.stdout:9/737: truncate d3/d10/d3a/f6d 289877 0 2024-04-06T12:23:13.339 INFO:tasks.workunit.client.1.smithi195.stdout:1/710: readlink d4/d14/d17/d24/d2a/d5a/daa/lb4 0 2024-04-06T12:23:13.340 INFO:tasks.workunit.client.1.smithi195.stdout:5/804: mkdir d0/da/d23/d38/d107/d114 0 2024-04-06T12:23:13.342 INFO:tasks.workunit.client.1.smithi195.stdout:4/699: getdents d4/d6/d38/d1a/d40/d57/d64 0 2024-04-06T12:23:13.342 INFO:tasks.workunit.client.1.smithi195.stdout:5/805: chown d0/da/d13 536 1 2024-04-06T12:23:13.343 INFO:tasks.workunit.client.1.smithi195.stdout:9/738: symlink d3/d10/d4f/lef 0 2024-04-06T12:23:13.346 INFO:tasks.workunit.client.1.smithi195.stdout:7/652: dread d4/d16/f47 [4194304,4194304] 0 2024-04-06T12:23:13.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/805: rename d8/d21/f5a to d8/d21/d2b/d46/d44/f135 0 2024-04-06T12:23:13.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/746: truncate d4/d6/d2f/f4a 131288 0 2024-04-06T12:23:13.348 INFO:tasks.workunit.client.1.smithi195.stdout:0/747: stat d4/dbc/dce 0 2024-04-06T12:23:13.349 INFO:tasks.workunit.client.1.smithi195.stdout:9/739: truncate d3/f2a 423612 0 2024-04-06T12:23:13.350 INFO:tasks.workunit.client.1.smithi195.stdout:9/740: chown d3/de/f51 223355016 1 2024-04-06T12:23:13.352 INFO:tasks.workunit.client.1.smithi195.stdout:7/653: dread d4/d10/d12/f39 [4194304,4194304] 0 2024-04-06T12:23:13.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/806: mknod d8/d21/d31/d49/c136 0 2024-04-06T12:23:13.353 INFO:tasks.workunit.client.1.smithi195.stdout:4/700: rmdir d4/d6/d38/d1a/da7 39 2024-04-06T12:23:13.354 INFO:tasks.workunit.client.1.smithi195.stdout:8/744: getdents d6/dd/d70/d24/d34/d67/d9d 0 2024-04-06T12:23:13.355 INFO:tasks.workunit.client.1.smithi195.stdout:5/806: mknod d0/da/d23/d7a/dc5/dce/c115 0 2024-04-06T12:23:13.359 INFO:tasks.workunit.client.1.smithi195.stdout:3/803: dread d4/df/d39/f98 [0,4194304] 0 2024-04-06T12:23:13.360 INFO:tasks.workunit.client.1.smithi195.stdout:5/807: fdatasync d0/da/d23/dd4/d106/fe9 0 2024-04-06T12:23:13.361 INFO:tasks.workunit.client.1.smithi195.stdout:6/807: dwrite f5 [0,4194304] 0 2024-04-06T12:23:13.362 INFO:tasks.workunit.client.1.smithi195.stdout:3/804: chown d4/d9/d2b/d87/fd3 28380732 1 2024-04-06T12:23:13.363 INFO:tasks.workunit.client.1.smithi195.stdout:7/654: unlink d4/d10/d12/f39 0 2024-04-06T12:23:13.364 INFO:tasks.workunit.client.1.smithi195.stdout:7/655: truncate d4/d10/d12/fb1 262628 0 2024-04-06T12:23:13.366 INFO:tasks.workunit.client.1.smithi195.stdout:8/745: creat d6/dd/d70/ffe x:0 0 0 2024-04-06T12:23:13.366 INFO:tasks.workunit.client.1.smithi195.stdout:5/808: read d0/fe [3186492,28140] 0 2024-04-06T12:23:13.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/748: rename d4/d48/d67/faa to d4/d6/d58/da7/fec 0 2024-04-06T12:23:13.367 INFO:tasks.workunit.client.1.smithi195.stdout:5/809: chown d0/da/d23/dd4/dc2/dfb 6 1 2024-04-06T12:23:13.368 INFO:tasks.workunit.client.1.smithi195.stdout:7/656: write d4/d10/d18/d33/d6e/f7d [394909,43998] 0 2024-04-06T12:23:13.371 INFO:tasks.workunit.client.1.smithi195.stdout:8/746: truncate d6/dd/d70/d24/d25/da5/dc8/de8/d52/f8d 237039 0 2024-04-06T12:23:13.371 INFO:tasks.workunit.client.1.smithi195.stdout:1/711: truncate d4/d14/d17/d24/d99/d4e/d60/f7a 3170238 0 2024-04-06T12:23:13.374 INFO:tasks.workunit.client.1.smithi195.stdout:4/701: mknod d4/ce0 0 2024-04-06T12:23:13.376 INFO:tasks.workunit.client.1.smithi195.stdout:7/657: rmdir d4/d10/d18/d19 39 2024-04-06T12:23:13.377 INFO:tasks.workunit.client.1.smithi195.stdout:4/702: dread d4/d3e/fac [0,4194304] 0 2024-04-06T12:23:13.377 INFO:tasks.workunit.client.1.smithi195.stdout:9/741: link d3/dd3/fed d3/d10/d7d/dee/ff0 0 2024-04-06T12:23:13.378 INFO:tasks.workunit.client.1.smithi195.stdout:7/658: stat d4/d16/dd/d22/d3f/d54/da9/f4e 0 2024-04-06T12:23:13.379 INFO:tasks.workunit.client.1.smithi195.stdout:4/703: truncate d4/d6/f9a 286120 0 2024-04-06T12:23:13.379 INFO:tasks.workunit.client.1.smithi195.stdout:6/808: mknod d8/d21/d31/d6c/c137 0 2024-04-06T12:23:13.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/712: rename d4/d14/d17/d24/d2a/f9a to d4/d14/d17/d3a/da8/db8/fe2 0 2024-04-06T12:23:13.384 INFO:tasks.workunit.client.1.smithi195.stdout:0/749: creat d4/d48/d67/d75/dcf/fed x:0 0 0 2024-04-06T12:23:13.387 INFO:tasks.workunit.client.1.smithi195.stdout:9/742: unlink d3/d10/d4f/f99 0 2024-04-06T12:23:13.390 INFO:tasks.workunit.client.1.smithi195.stdout:4/704: mknod d4/d8c/ce1 0 2024-04-06T12:23:13.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/705: chown d4/d6/d38/f2c 29722 1 2024-04-06T12:23:13.392 INFO:tasks.workunit.client.1.smithi195.stdout:5/810: link d0/d35/f6b d0/da/dd/d2e/f116 0 2024-04-06T12:23:13.395 INFO:tasks.workunit.client.1.smithi195.stdout:6/809: unlink d8/d21/d2b/l75 0 2024-04-06T12:23:13.398 INFO:tasks.workunit.client.1.smithi195.stdout:4/706: dwrite d4/d6/d38/d1a/d40/d20/f9c [0,4194304] 0 2024-04-06T12:23:13.399 INFO:tasks.workunit.client.1.smithi195.stdout:0/750: fsync d4/f59 0 2024-04-06T12:23:13.401 INFO:tasks.workunit.client.1.smithi195.stdout:0/751: write d4/d48/d77/d97/db7/f66 [1617208,78148] 0 2024-04-06T12:23:13.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/747: link d6/dd/d70/d24/d25/da5/dc8/de8/f95 d6/dd/d70/d24/d34/d67/d9d/dd7/fff 0 2024-04-06T12:23:13.403 INFO:tasks.workunit.client.1.smithi195.stdout:9/743: dread d3/d10/d3b/d48/f4b [0,4194304] 0 2024-04-06T12:23:13.409 INFO:tasks.workunit.client.1.smithi195.stdout:3/805: getdents d4/d9/d2b/d87 0 2024-04-06T12:23:13.409 INFO:tasks.workunit.client.1.smithi195.stdout:0/752: read d4/d48/d77/d97/db7/f66 [2644256,57238] 0 2024-04-06T12:23:13.410 INFO:tasks.workunit.client.1.smithi195.stdout:8/748: dwrite d6/dd/d70/d24/d53/fdc [0,4194304] 0 2024-04-06T12:23:13.414 INFO:tasks.workunit.client.1.smithi195.stdout:2/794: sync 2024-04-06T12:23:13.415 INFO:tasks.workunit.client.1.smithi195.stdout:5/811: dwrite d0/da/d23/d38/f60 [0,4194304] 0 2024-04-06T12:23:13.417 INFO:tasks.workunit.client.1.smithi195.stdout:1/713: write d4/d14/d17/d3a/f9f [14983,75960] 0 2024-04-06T12:23:13.426 INFO:tasks.workunit.client.1.smithi195.stdout:6/810: write d8/d3d/d5e/dd3/dfe/f10a [974777,24436] 0 2024-04-06T12:23:13.426 INFO:tasks.workunit.client.1.smithi195.stdout:4/707: truncate d4/f4e 4283633 0 2024-04-06T12:23:13.429 INFO:tasks.workunit.client.1.smithi195.stdout:3/806: rename d4/d53/c66 to d4/d9/d2b/d9b/c10e 0 2024-04-06T12:23:13.433 INFO:tasks.workunit.client.1.smithi195.stdout:9/744: mkdir d3/d10/d7d/dee/df1 0 2024-04-06T12:23:13.434 INFO:tasks.workunit.client.1.smithi195.stdout:8/749: symlink d6/dd/d70/d24/d34/d67/dec/l100 0 2024-04-06T12:23:13.436 INFO:tasks.workunit.client.1.smithi195.stdout:2/795: mknod d2/d3f/d7d/c102 0 2024-04-06T12:23:13.437 INFO:tasks.workunit.client.1.smithi195.stdout:5/812: creat d0/da/d4b/f117 x:0 0 0 2024-04-06T12:23:13.437 INFO:tasks.workunit.client.1.smithi195.stdout:7/659: getdents d4/d10/d18/d19/d63/dc2 0 2024-04-06T12:23:13.438 INFO:tasks.workunit.client.1.smithi195.stdout:5/813: dread - d0/da/d23/d7a/feb zero size 2024-04-06T12:23:13.438 INFO:tasks.workunit.client.1.smithi195.stdout:7/660: chown d4/d10/d12/c8b 2071 1 2024-04-06T12:23:13.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/745: mknod d3/d10/d3a/d6b/cf2 0 2024-04-06T12:23:13.445 INFO:tasks.workunit.client.1.smithi195.stdout:2/796: unlink d2/d41/d5a/cba 0 2024-04-06T12:23:13.445 INFO:tasks.workunit.client.1.smithi195.stdout:1/714: creat d4/d14/d17/d24/d2a/fe3 x:0 0 0 2024-04-06T12:23:13.446 INFO:tasks.workunit.client.1.smithi195.stdout:0/753: getdents d4/d48/d77/d97/db7/d8f 0 2024-04-06T12:23:13.447 INFO:tasks.workunit.client.1.smithi195.stdout:7/661: dread d4/d10/d18/d19/f5e [0,4194304] 0 2024-04-06T12:23:13.449 INFO:tasks.workunit.client.1.smithi195.stdout:4/708: rename d4/d6/d38/d1a/d40/fb6 to d4/d6/d38/d1a/d40/d57/fe2 0 2024-04-06T12:23:13.451 INFO:tasks.workunit.client.1.smithi195.stdout:9/746: mknod d3/d10/d3b/d48/d5e/cf3 0 2024-04-06T12:23:13.454 INFO:tasks.workunit.client.1.smithi195.stdout:6/811: getdents d8/d21/d31/d49 0 2024-04-06T12:23:13.458 INFO:tasks.workunit.client.1.smithi195.stdout:7/662: dwrite d4/d10/f3c [4194304,4194304] 0 2024-04-06T12:23:13.458 INFO:tasks.workunit.client.1.smithi195.stdout:8/750: dread d6/dd/d70/d24/d34/d67/f6c [0,4194304] 0 2024-04-06T12:23:13.458 INFO:tasks.workunit.client.1.smithi195.stdout:0/754: rmdir d4/d48/d67/d83/d94 39 2024-04-06T12:23:13.458 INFO:tasks.workunit.client.1.smithi195.stdout:3/807: write d4/d9/d37/f3a [1679466,50946] 0 2024-04-06T12:23:13.458 INFO:tasks.workunit.client.1.smithi195.stdout:1/715: dread d4/d14/d17/d24/d99/d4e/d8f/f92 [0,4194304] 0 2024-04-06T12:23:13.463 INFO:tasks.workunit.client.1.smithi195.stdout:3/808: readlink d4/d9/d2b/d3b/d5e/lee 0 2024-04-06T12:23:13.463 INFO:tasks.workunit.client.1.smithi195.stdout:8/751: rmdir d6/d3a 39 2024-04-06T12:23:13.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/663: mknod d4/d16/dd/d22/d3f/d54/da9/cd4 0 2024-04-06T12:23:13.467 INFO:tasks.workunit.client.1.smithi195.stdout:3/809: fdatasync d4/de/d8e/d92/d9e/fdb 0 2024-04-06T12:23:13.467 INFO:tasks.workunit.client.1.smithi195.stdout:5/814: rename d0/da/d13/d87/l46 to d0/d35/l118 0 2024-04-06T12:23:13.471 INFO:tasks.workunit.client.1.smithi195.stdout:0/755: dwrite d4/d6/f42 [4194304,4194304] 0 2024-04-06T12:23:13.472 INFO:tasks.workunit.client.1.smithi195.stdout:4/709: creat d4/d6d/da6/dae/fe3 x:0 0 0 2024-04-06T12:23:13.472 INFO:tasks.workunit.client.1.smithi195.stdout:3/810: read d4/df/f6f [74208,3690] 0 2024-04-06T12:23:13.474 INFO:tasks.workunit.client.1.smithi195.stdout:6/812: mknod d8/d21/d2b/d46/d44/df7/c138 0 2024-04-06T12:23:13.474 INFO:tasks.workunit.client.1.smithi195.stdout:9/747: dwrite d3/d10/d3b/d48/d5e/f82 [0,4194304] 0 2024-04-06T12:23:13.475 INFO:tasks.workunit.client.1.smithi195.stdout:0/756: stat d4/d6/d58/f70 0 2024-04-06T12:23:13.476 INFO:tasks.workunit.client.1.smithi195.stdout:2/797: getdents d2/d3f 0 2024-04-06T12:23:13.476 INFO:tasks.workunit.client.1.smithi195.stdout:1/716: dread d4/d14/d17/d24/d2a/fbc [0,4194304] 0 2024-04-06T12:23:13.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/815: write d0/da/dd/d1c/d5a/d62/d64/d67/db9/f81 [1293247,49284] 0 2024-04-06T12:23:13.479 INFO:tasks.workunit.client.1.smithi195.stdout:7/664: fdatasync d4/d16/dd/d22/d3f/d54/f9d 0 2024-04-06T12:23:13.479 INFO:tasks.workunit.client.1.smithi195.stdout:0/757: mknod d4/dbc/cee 0 2024-04-06T12:23:13.485 INFO:tasks.workunit.client.1.smithi195.stdout:9/748: readlink d3/d10/d3b/l98 0 2024-04-06T12:23:13.486 INFO:tasks.workunit.client.1.smithi195.stdout:1/717: fsync d4/d14/d17/d24/d99/d4e/d8f/fa7 0 2024-04-06T12:23:13.487 INFO:tasks.workunit.client.1.smithi195.stdout:0/758: symlink d4/d48/d67/d75/de9/lef 0 2024-04-06T12:23:13.487 INFO:tasks.workunit.client.1.smithi195.stdout:3/811: truncate d4/de/f84 4329107 0 2024-04-06T12:23:13.490 INFO:tasks.workunit.client.1.smithi195.stdout:7/665: rename d4/d10/d18/l84 to d4/d10/d12/da5/da3/ld5 0 2024-04-06T12:23:13.491 INFO:tasks.workunit.client.1.smithi195.stdout:0/759: readlink d4/d6/d1a/lba 0 2024-04-06T12:23:13.492 INFO:tasks.workunit.client.1.smithi195.stdout:8/752: truncate d6/dd/d42/f9b 3684435 0 2024-04-06T12:23:13.492 INFO:tasks.workunit.client.1.smithi195.stdout:3/812: truncate d4/d53/f60 644899 0 2024-04-06T12:23:13.492 INFO:tasks.workunit.client.1.smithi195.stdout:6/813: dwrite d8/d21/d2b/d46/d44/f8c [0,4194304] 0 2024-04-06T12:23:13.494 INFO:tasks.workunit.client.1.smithi195.stdout:1/718: chown d4/d14/d17/d3a/da8/da4/db2/d28/c38 8696555 1 2024-04-06T12:23:13.495 INFO:tasks.workunit.client.1.smithi195.stdout:3/813: chown d4/de/d8e/d92 141573607 1 2024-04-06T12:23:13.497 INFO:tasks.workunit.client.1.smithi195.stdout:0/760: symlink d4/d6/d58/da7/dc6/lf0 0 2024-04-06T12:23:13.497 INFO:tasks.workunit.client.1.smithi195.stdout:5/816: write d0/da/dd/d33/f7c [835651,24825] 0 2024-04-06T12:23:13.498 INFO:tasks.workunit.client.1.smithi195.stdout:2/798: dwrite d2/f4 [0,4194304] 0 2024-04-06T12:23:13.505 INFO:tasks.workunit.client.1.smithi195.stdout:0/761: symlink d4/d48/d67/d83/lf1 0 2024-04-06T12:23:13.506 INFO:tasks.workunit.client.1.smithi195.stdout:1/719: truncate d4/d14/d17/d3a/da8/fcc 1762966 0 2024-04-06T12:23:13.509 INFO:tasks.workunit.client.1.smithi195.stdout:2/799: creat d2/d21/d2c/d2d/d92/d95/d9b/f103 x:0 0 0 2024-04-06T12:23:13.510 INFO:tasks.workunit.client.1.smithi195.stdout:0/762: fdatasync d4/d53/fbf 0 2024-04-06T12:23:13.512 INFO:tasks.workunit.client.1.smithi195.stdout:5/817: rename d0/da/dd/d1c/d5a/d68/dd7/d101/l98 to d0/da/dd/l119 0 2024-04-06T12:23:13.513 INFO:tasks.workunit.client.1.smithi195.stdout:0/763: readlink d4/d6/d2f/l50 0 2024-04-06T12:23:13.513 INFO:tasks.workunit.client.1.smithi195.stdout:8/753: dwrite d6/dd/d70/d24/d25/da5/dc8/de8/f26 [0,4194304] 0 2024-04-06T12:23:13.517 INFO:tasks.workunit.client.1.smithi195.stdout:5/818: mkdir d0/d52/d91/d11a 0 2024-04-06T12:23:13.520 INFO:tasks.workunit.client.1.smithi195.stdout:7/666: dread d4/d16/dd/d22/d3f/faa [0,4194304] 0 2024-04-06T12:23:13.523 INFO:tasks.workunit.client.1.smithi195.stdout:1/720: dwrite d4/d14/d17/d24/f6b [0,4194304] 0 2024-04-06T12:23:13.524 INFO:tasks.workunit.client.1.smithi195.stdout:6/814: truncate d8/d3d/d5e/d72/d10c/d32/f3a 6754786 0 2024-04-06T12:23:13.524 INFO:tasks.workunit.client.1.smithi195.stdout:0/764: creat d4/d48/ff2 x:0 0 0 2024-04-06T12:23:13.525 INFO:tasks.workunit.client.1.smithi195.stdout:5/819: mkdir d0/da/d23/dd4/dc2/d11b 0 2024-04-06T12:23:13.531 INFO:tasks.workunit.client.1.smithi195.stdout:7/667: creat d4/d10/d18/d57/fd6 x:0 0 0 2024-04-06T12:23:13.531 INFO:tasks.workunit.client.1.smithi195.stdout:0/765: write d4/d48/d77/d97/db7/f8d [801479,30760] 0 2024-04-06T12:23:13.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/766: truncate d4/d6/d58/da7/fbb 4979870 0 2024-04-06T12:23:13.534 INFO:tasks.workunit.client.1.smithi195.stdout:6/815: creat d8/d3d/d5e/d72/d10c/d9c/d110/f139 x:0 0 0 2024-04-06T12:23:13.534 INFO:tasks.workunit.client.1.smithi195.stdout:0/767: chown d4/l6f 1495 1 2024-04-06T12:23:13.536 INFO:tasks.workunit.client.1.smithi195.stdout:0/768: chown d4/d6/d1a/l3b 293528 1 2024-04-06T12:23:13.541 INFO:tasks.workunit.client.1.smithi195.stdout:1/721: mkdir d4/d14/d17/d3a/da8/da4/db2/d5d/db3/de4 0 2024-04-06T12:23:13.541 INFO:tasks.workunit.client.1.smithi195.stdout:2/800: truncate d2/d41/d84/d8d/d94/f9a 267221 0 2024-04-06T12:23:13.543 INFO:tasks.workunit.client.1.smithi195.stdout:6/816: mkdir d8/d21/d31/d49/dd8/d13a 0 2024-04-06T12:23:13.543 INFO:tasks.workunit.client.1.smithi195.stdout:5/820: truncate d0/da/dd/d1c/d5a/d62/f76 461449 0 2024-04-06T12:23:13.547 INFO:tasks.workunit.client.1.smithi195.stdout:8/754: dwrite d6/dd/d70/d24/d25/f78 [0,4194304] 0 2024-04-06T12:23:13.549 INFO:tasks.workunit.client.1.smithi195.stdout:3/814: dread d4/df/f6f [0,4194304] 0 2024-04-06T12:23:13.551 INFO:tasks.workunit.client.1.smithi195.stdout:5/821: mkdir d0/da/dd/d1c/d11c 0 2024-04-06T12:23:13.552 INFO:tasks.workunit.client.1.smithi195.stdout:2/801: symlink d2/d21/d2c/d2d/d92/d95/d9b/dd9/l104 0 2024-04-06T12:23:13.555 INFO:tasks.workunit.client.1.smithi195.stdout:3/815: symlink d4/d9/d2b/d77/d9a/l10f 0 2024-04-06T12:23:13.558 INFO:tasks.workunit.client.1.smithi195.stdout:6/817: creat d8/d21/f13b x:0 0 0 2024-04-06T12:23:13.558 INFO:tasks.workunit.client.1.smithi195.stdout:1/722: write d4/f11 [6353254,12002] 0 2024-04-06T12:23:13.560 INFO:tasks.workunit.client.1.smithi195.stdout:7/668: dwrite d4/d10/f27 [4194304,4194304] 0 2024-04-06T12:23:13.560 INFO:tasks.workunit.client.1.smithi195.stdout:5/822: rmdir d0/da/dd/d1c/d5a/d68 39 2024-04-06T12:23:13.560 INFO:tasks.workunit.client.1.smithi195.stdout:3/816: fsync d4/de/d8e/d92/faa 0 2024-04-06T12:23:13.562 INFO:tasks.workunit.client.1.smithi195.stdout:2/802: mkdir d2/d21/d5e/d105 0 2024-04-06T12:23:13.565 INFO:tasks.workunit.client.1.smithi195.stdout:7/669: chown d4/d16/d11/fb2 400 1 2024-04-06T12:23:13.565 INFO:tasks.workunit.client.1.smithi195.stdout:0/769: dwrite d4/d53/fc9 [0,4194304] 0 2024-04-06T12:23:13.567 INFO:tasks.workunit.client.1.smithi195.stdout:8/755: rename d6/dd/d70/d24/d25/da5/dc8 to d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101 0 2024-04-06T12:23:13.569 INFO:tasks.workunit.client.1.smithi195.stdout:7/670: write d4/d10/d18/d33/d6e/f7d [2831163,79384] 0 2024-04-06T12:23:13.575 INFO:tasks.workunit.client.1.smithi195.stdout:0/770: creat d4/dbc/ff3 x:0 0 0 2024-04-06T12:23:13.575 INFO:tasks.workunit.client.1.smithi195.stdout:2/803: rename d2/d41/d84/d8d/c9c to d2/d41/d84/d8d/c106 0 2024-04-06T12:23:13.577 INFO:tasks.workunit.client.1.smithi195.stdout:6/818: unlink d8/d21/d2b/d46/d44/d86/f101 0 2024-04-06T12:23:13.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/823: dwrite d0/da/d23/fcb [0,4194304] 0 2024-04-06T12:23:13.578 INFO:tasks.workunit.client.1.smithi195.stdout:3/817: creat d4/d9/dcf/f110 x:0 0 0 2024-04-06T12:23:13.579 INFO:tasks.workunit.client.1.smithi195.stdout:3/818: stat d4/d9/cc 0 2024-04-06T12:23:13.580 INFO:tasks.workunit.client.1.smithi195.stdout:7/671: unlink d4/d10/f3c 0 2024-04-06T12:23:13.580 INFO:tasks.workunit.client.1.smithi195.stdout:4/710: sync 2024-04-06T12:23:13.580 INFO:tasks.workunit.client.1.smithi195.stdout:1/723: mkdir d4/d14/d17/d24/d99/d4e/de5 0 2024-04-06T12:23:13.581 INFO:tasks.workunit.client.1.smithi195.stdout:3/819: fdatasync f3 0 2024-04-06T12:23:13.583 INFO:tasks.workunit.client.1.smithi195.stdout:0/771: creat d4/dd5/ff4 x:0 0 0 2024-04-06T12:23:13.583 INFO:tasks.workunit.client.1.smithi195.stdout:6/819: symlink d8/d3d/d5e/dd3/l13c 0 2024-04-06T12:23:13.584 INFO:tasks.workunit.client.1.smithi195.stdout:3/820: fsync d4/df/f10b 0 2024-04-06T12:23:13.585 INFO:tasks.workunit.client.1.smithi195.stdout:2/804: rename d2/d21/d2c/lc2 to d2/d21/d2c/dc9/l107 0 2024-04-06T12:23:13.586 INFO:tasks.workunit.client.1.smithi195.stdout:8/756: link d6/dd/d70/d24/d34/d67/dec/f77 d6/dd/d70/d24/d34/d67/da1/da2/f102 0 2024-04-06T12:23:13.587 INFO:tasks.workunit.client.1.smithi195.stdout:4/711: readlink d4/d6/d38/d1a/d40/d57/d64/lc2 0 2024-04-06T12:23:13.587 INFO:tasks.workunit.client.1.smithi195.stdout:7/672: creat d4/d16/dd/d22/d76/fd7 x:0 0 0 2024-04-06T12:23:13.590 INFO:tasks.workunit.client.1.smithi195.stdout:5/824: rename d0/da/d23/dd4/d106/lee to d0/da/d23/d7a/dc5/dce/l11d 0 2024-04-06T12:23:13.590 INFO:tasks.workunit.client.1.smithi195.stdout:3/821: mknod d4/d9/d37/c111 0 2024-04-06T12:23:13.591 INFO:tasks.workunit.client.1.smithi195.stdout:8/757: mkdir d6/db/d103 0 2024-04-06T12:23:13.591 INFO:tasks.workunit.client.1.smithi195.stdout:1/724: getdents d4/d14/d17/d3a/da8/da4/db2/d5d/db3/de4 0 2024-04-06T12:23:13.592 INFO:tasks.workunit.client.1.smithi195.stdout:7/673: mkdir d4/d10/d18/d33/dd8 0 2024-04-06T12:23:13.592 INFO:tasks.workunit.client.1.smithi195.stdout:5/825: write d0/da/d23/dd4/f49 [1357122,40686] 0 2024-04-06T12:23:13.593 INFO:tasks.workunit.client.1.smithi195.stdout:2/805: mknod d2/d21/d2c/d2d/d92/d95/d9b/dd9/c108 0 2024-04-06T12:23:13.595 INFO:tasks.workunit.client.1.smithi195.stdout:6/820: rename d8/d21/d31/d26/dc8/f12f to d8/d21/d31/d6c/db6/f13d 0 2024-04-06T12:23:13.595 INFO:tasks.workunit.client.1.smithi195.stdout:7/674: dread - d4/fcf zero size 2024-04-06T12:23:13.597 INFO:tasks.workunit.client.1.smithi195.stdout:5/826: write d0/da/dd/fe0 [2475117,19823] 0 2024-04-06T12:23:13.597 INFO:tasks.workunit.client.1.smithi195.stdout:1/725: creat d4/fe6 x:0 0 0 2024-04-06T12:23:13.600 INFO:tasks.workunit.client.1.smithi195.stdout:3/822: mkdir d4/df/d39/d112 0 2024-04-06T12:23:13.600 INFO:tasks.workunit.client.1.smithi195.stdout:4/712: dwrite d4/d6/d38/d1a/d40/d20/d23/f82 [0,4194304] 0 2024-04-06T12:23:13.601 INFO:tasks.workunit.client.1.smithi195.stdout:7/675: stat d4/d16/dd/d22/d3f/d54/da9/f42 0 2024-04-06T12:23:13.601 INFO:tasks.workunit.client.1.smithi195.stdout:2/806: creat d2/ddc/f109 x:0 0 0 2024-04-06T12:23:13.604 INFO:tasks.workunit.client.1.smithi195.stdout:6/821: mkdir d8/d21/d2b/d46/d13e 0 2024-04-06T12:23:13.608 INFO:tasks.workunit.client.1.smithi195.stdout:5/827: chown d0/da/dd/d1c/d5a/d62/d64/d67/c79 11 1 2024-04-06T12:23:13.608 INFO:tasks.workunit.client.1.smithi195.stdout:2/807: truncate d2/d21/d29/ffb 655848 0 2024-04-06T12:23:13.608 INFO:tasks.workunit.client.1.smithi195.stdout:3/823: truncate d4/de/d8e/d92/d9e/fac 5233281 0 2024-04-06T12:23:13.608 INFO:tasks.workunit.client.1.smithi195.stdout:1/726: rename d4/d14/d17/d24/d2a/c2c to d4/d14/d17/d3a/da8/da4/ce7 0 2024-04-06T12:23:13.609 INFO:tasks.workunit.client.1.smithi195.stdout:7/676: creat d4/d10/d12/d6f/fd9 x:0 0 0 2024-04-06T12:23:13.610 INFO:tasks.workunit.client.1.smithi195.stdout:4/713: fdatasync d4/d6/d38/d65/fd8 0 2024-04-06T12:23:13.612 INFO:tasks.workunit.client.1.smithi195.stdout:6/822: mkdir d8/d21/d31/d26/d13f 0 2024-04-06T12:23:13.612 INFO:tasks.workunit.client.1.smithi195.stdout:9/749: sync 2024-04-06T12:23:13.613 INFO:tasks.workunit.client.1.smithi195.stdout:5/828: mknod d0/da/d23/d7a/dc5/dce/c11e 0 2024-04-06T12:23:13.613 INFO:tasks.workunit.client.1.smithi195.stdout:4/714: readlink d4/d6/d38/d1a/d40/d57/lb0 0 2024-04-06T12:23:13.614 INFO:tasks.workunit.client.1.smithi195.stdout:2/808: mkdir d2/d21/d2c/d2d/d92/d95/d10a 0 2024-04-06T12:23:13.617 INFO:tasks.workunit.client.1.smithi195.stdout:9/750: mknod d3/d10/d7d/cf4 0 2024-04-06T12:23:13.617 INFO:tasks.workunit.client.1.smithi195.stdout:2/809: stat d2/d21/d5e/c8f 0 2024-04-06T12:23:13.618 INFO:tasks.workunit.client.1.smithi195.stdout:4/715: readlink d4/d6/d38/d65/d7a/lba 0 2024-04-06T12:23:13.621 INFO:tasks.workunit.client.1.smithi195.stdout:8/758: dread d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/f82 [0,4194304] 0 2024-04-06T12:23:13.621 INFO:tasks.workunit.client.1.smithi195.stdout:9/751: fsync d3/d10/d3b/d48/d9c/f68 0 2024-04-06T12:23:13.621 INFO:tasks.workunit.client.1.smithi195.stdout:7/677: dwrite d4/d16/dd/d22/d76/f8f [0,4194304] 0 2024-04-06T12:23:13.623 INFO:tasks.workunit.client.1.smithi195.stdout:4/716: unlink d4/d6/fde 0 2024-04-06T12:23:13.623 INFO:tasks.workunit.client.1.smithi195.stdout:8/759: chown d6/db/c27 2733 1 2024-04-06T12:23:13.627 INFO:tasks.workunit.client.1.smithi195.stdout:9/752: chown d3/d10/d3b/d48/d9c/f75 92275854 1 2024-04-06T12:23:13.629 INFO:tasks.workunit.client.1.smithi195.stdout:5/829: getdents d0/da/d13/d5e/da7 0 2024-04-06T12:23:13.630 INFO:tasks.workunit.client.1.smithi195.stdout:9/753: symlink d3/dc6/lf5 0 2024-04-06T12:23:13.631 INFO:tasks.workunit.client.1.smithi195.stdout:8/760: truncate d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d83/ff4 37926 0 2024-04-06T12:23:13.632 INFO:tasks.workunit.client.1.smithi195.stdout:4/717: dread d4/d6/d38/d65/fd8 [0,4194304] 0 2024-04-06T12:23:13.635 INFO:tasks.workunit.client.1.smithi195.stdout:9/754: write d3/d10/d3b/d48/d9c/f8c [1192757,83613] 0 2024-04-06T12:23:13.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/761: symlink d6/dd/d70/d24/d34/d67/dec/d4b/dfa/l104 0 2024-04-06T12:23:13.639 INFO:tasks.workunit.client.1.smithi195.stdout:6/823: dwrite d8/d21/d2b/d46/d44/f135 [0,4194304] 0 2024-04-06T12:23:13.641 INFO:tasks.workunit.client.1.smithi195.stdout:5/830: truncate d0/da/d23/d38/f60 1362278 0 2024-04-06T12:23:13.642 INFO:tasks.workunit.client.1.smithi195.stdout:4/718: dread d4/f7e [0,4194304] 0 2024-04-06T12:23:13.643 INFO:tasks.workunit.client.1.smithi195.stdout:8/762: unlink d6/dd/d70/d24/d34/d67/da1/da2/da4/fc7 0 2024-04-06T12:23:13.644 INFO:tasks.workunit.client.1.smithi195.stdout:9/755: link d3/de/ca2 d3/d10/d3a/d5d/cf6 0 2024-04-06T12:23:13.646 INFO:tasks.workunit.client.1.smithi195.stdout:9/756: write d3/d10/d3b/d48/d5e/fe9 [942495,1437] 0 2024-04-06T12:23:13.647 INFO:tasks.workunit.client.1.smithi195.stdout:6/824: creat d8/d21/d31/d6c/f140 x:0 0 0 2024-04-06T12:23:13.661 INFO:tasks.workunit.client.1.smithi195.stdout:8/763: symlink d6/dd/d70/l105 0 2024-04-06T12:23:13.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/831: dwrite d0/da/dd/d1c/f20 [0,4194304] 0 2024-04-06T12:23:13.663 INFO:tasks.workunit.client.1.smithi195.stdout:4/719: link d4/f62 d4/d6/d38/d1a/d40/d57/fe4 0 2024-04-06T12:23:13.663 INFO:tasks.workunit.client.1.smithi195.stdout:6/825: truncate d8/d21/d31/f114 257940 0 2024-04-06T12:23:13.664 INFO:tasks.workunit.client.1.smithi195.stdout:9/757: fdatasync d3/d10/d4f/fea 0 2024-04-06T12:23:13.665 INFO:tasks.workunit.client.1.smithi195.stdout:9/758: chown d3/d10/d3b/f81 2 1 2024-04-06T12:23:13.666 INFO:tasks.workunit.client.1.smithi195.stdout:6/826: dread d8/d3d/d5e/d72/d10c/d9c/faa [0,4194304] 0 2024-04-06T12:23:13.668 INFO:tasks.workunit.client.1.smithi195.stdout:4/720: unlink d4/d6/fbc 0 2024-04-06T12:23:13.668 INFO:tasks.workunit.client.1.smithi195.stdout:5/832: symlink d0/da/dd/d33/d105/l11f 0 2024-04-06T12:23:13.670 INFO:tasks.workunit.client.1.smithi195.stdout:5/833: dread - d0/d35/fb0 zero size 2024-04-06T12:23:13.674 INFO:tasks.workunit.client.1.smithi195.stdout:6/827: dwrite d8/d3d/d5e/dd3/dfe/f76 [0,4194304] 0 2024-04-06T12:23:13.676 INFO:tasks.workunit.client.1.smithi195.stdout:6/828: chown d8/d3d/c10f 13 1 2024-04-06T12:23:13.678 INFO:tasks.workunit.client.1.smithi195.stdout:8/764: dwrite d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/fde [0,4194304] 0 2024-04-06T12:23:13.680 INFO:tasks.workunit.client.1.smithi195.stdout:9/759: creat d3/d10/d3b/ff7 x:0 0 0 2024-04-06T12:23:13.684 INFO:tasks.workunit.client.1.smithi195.stdout:6/829: symlink d8/d3d/d5e/dd3/dfe/l141 0 2024-04-06T12:23:13.687 INFO:tasks.workunit.client.1.smithi195.stdout:9/760: unlink d3/f24 0 2024-04-06T12:23:13.688 INFO:tasks.workunit.client.1.smithi195.stdout:8/765: dread d6/d3a/d46/db2/fc2 [0,4194304] 0 2024-04-06T12:23:13.690 INFO:tasks.workunit.client.1.smithi195.stdout:5/834: write d0/da/dd/d2e/f59 [2654101,40372] 0 2024-04-06T12:23:13.694 INFO:tasks.workunit.client.1.smithi195.stdout:6/830: dwrite d8/d21/d31/d6c/ded/f120 [0,4194304] 0 2024-04-06T12:23:13.696 INFO:tasks.workunit.client.1.smithi195.stdout:9/761: truncate d3/d10/d3b/d48/d9c/f91 1170197 0 2024-04-06T12:23:13.698 INFO:tasks.workunit.client.1.smithi195.stdout:6/831: mknod d8/d21/d2b/d46/d13e/c142 0 2024-04-06T12:23:13.699 INFO:tasks.workunit.client.1.smithi195.stdout:5/835: creat d0/da/d23/d38/d41/f120 x:0 0 0 2024-04-06T12:23:13.702 INFO:tasks.workunit.client.1.smithi195.stdout:6/832: rename d8/d3d/c94 to d8/d21/d31/d6c/d7b/c143 0 2024-04-06T12:23:13.703 INFO:tasks.workunit.client.1.smithi195.stdout:6/833: dread - d8/d3d/d5e/d72/d10c/d9c/d110/f139 zero size 2024-04-06T12:23:13.703 INFO:tasks.workunit.client.1.smithi195.stdout:6/834: readlink d8/d3d/d5e/la5 0 2024-04-06T12:23:13.704 INFO:tasks.workunit.client.1.smithi195.stdout:5/836: mkdir d0/da/dd/d1c/d5a/d62/d121 0 2024-04-06T12:23:13.704 INFO:tasks.workunit.client.1.smithi195.stdout:8/766: write d6/dd/d70/d24/f4e [1206916,127593] 0 2024-04-06T12:23:13.706 INFO:tasks.workunit.client.1.smithi195.stdout:6/835: creat d8/d21/d31/d26/dc8/d4e/f144 x:0 0 0 2024-04-06T12:23:13.707 INFO:tasks.workunit.client.1.smithi195.stdout:5/837: mknod d0/da/d23/dd4/dc2/d11b/c122 0 2024-04-06T12:23:13.708 INFO:tasks.workunit.client.1.smithi195.stdout:6/836: mknod d8/d3d/dc1/c145 0 2024-04-06T12:23:13.708 INFO:tasks.workunit.client.1.smithi195.stdout:5/838: chown d0/da/dd/d1c/d5a/d62 15205243 1 2024-04-06T12:23:13.709 INFO:tasks.workunit.client.1.smithi195.stdout:6/837: write d8/d3d/f81 [3189747,108074] 0 2024-04-06T12:23:13.713 INFO:tasks.workunit.client.1.smithi195.stdout:6/838: rename d8/c1c to d8/d21/d31/d26/dcf/c146 0 2024-04-06T12:23:13.715 INFO:tasks.workunit.client.1.smithi195.stdout:5/839: dwrite d0/da/dd/d1c/d5a/d62/d64/d67/db9/fdb [0,4194304] 0 2024-04-06T12:23:13.717 INFO:tasks.workunit.client.1.smithi195.stdout:5/840: fdatasync d0/f6 0 2024-04-06T12:23:13.719 INFO:tasks.workunit.client.1.smithi195.stdout:5/841: symlink d0/da/d13/d5e/l123 0 2024-04-06T12:23:13.722 INFO:tasks.workunit.client.1.smithi195.stdout:5/842: symlink d0/da/dd/d1c/d5a/d62/d64/l124 0 2024-04-06T12:23:13.726 INFO:tasks.workunit.client.1.smithi195.stdout:6/839: dread - d8/d3d/d5e/dd3/dfe/f121 zero size 2024-04-06T12:23:13.729 INFO:tasks.workunit.client.1.smithi195.stdout:5/843: getdents d0/da/dd/d1c/d5a/d62/d64/d67 0 2024-04-06T12:23:13.731 INFO:tasks.workunit.client.1.smithi195.stdout:6/840: creat d8/d21/d2b/d46/d44/d86/f147 x:0 0 0 2024-04-06T12:23:13.732 INFO:tasks.workunit.client.1.smithi195.stdout:6/841: read d8/d21/d2b/d46/d44/d86/fff [268013,81362] 0 2024-04-06T12:23:13.734 INFO:tasks.workunit.client.1.smithi195.stdout:6/842: symlink d8/l148 0 2024-04-06T12:23:13.737 INFO:tasks.workunit.client.1.smithi195.stdout:6/843: creat d8/d3d/dc1/f149 x:0 0 0 2024-04-06T12:23:13.739 INFO:tasks.workunit.client.1.smithi195.stdout:6/844: mkdir d8/d3d/d5e/d72/d14a 0 2024-04-06T12:23:13.740 INFO:tasks.workunit.client.1.smithi195.stdout:6/845: chown d8/d21/d31/d26/dc8/c80 10978 1 2024-04-06T12:23:13.741 INFO:tasks.workunit.client.1.smithi195.stdout:6/846: chown d8/f19 6537 1 2024-04-06T12:23:13.754 INFO:tasks.workunit.client.1.smithi195.stdout:0/772: sync 2024-04-06T12:23:13.775 INFO:tasks.workunit.client.1.smithi195.stdout:0/773: rename d4/d6/c19 to d4/d48/d77/d97/db7/cf5 0 2024-04-06T12:23:13.778 INFO:tasks.workunit.client.1.smithi195.stdout:6/847: rename d8/d3d/d5e/d72/d10c/d9c/c127 to d8/d3d/d5e/d72/d10c/d9c/dce/d124/c14b 0 2024-04-06T12:23:13.825 INFO:tasks.workunit.client.1.smithi195.stdout:6/848: dread d8/d21/d31/d6c/d7b/d11b/daf/ff6 [0,4194304] 0 2024-04-06T12:23:13.825 INFO:tasks.workunit.client.1.smithi195.stdout:0/774: dwrite d4/dbc/ff3 [0,4194304] 0 2024-04-06T12:23:13.826 INFO:tasks.workunit.client.1.smithi195.stdout:5/844: dread d0/da/d23/dd4/fa6 [0,4194304] 0 2024-04-06T12:23:13.827 INFO:tasks.workunit.client.1.smithi195.stdout:5/845: truncate d0/da/f9f 410056 0 2024-04-06T12:23:13.831 INFO:tasks.workunit.client.1.smithi195.stdout:6/849: dread d8/d21/d2b/d46/d44/d86/fff [0,4194304] 0 2024-04-06T12:23:13.833 INFO:tasks.workunit.client.1.smithi195.stdout:0/775: rename d4/d48/d77/d97/db7/cf5 to d4/d48/d77/d97/cf6 0 2024-04-06T12:23:13.833 INFO:tasks.workunit.client.1.smithi195.stdout:6/850: fdatasync d8/d3d/d5e/dd3/dfe/f60 0 2024-04-06T12:23:13.840 INFO:tasks.workunit.client.1.smithi195.stdout:1/727: sync 2024-04-06T12:23:13.840 INFO:tasks.workunit.client.1.smithi195.stdout:3/824: sync 2024-04-06T12:23:13.850 INFO:tasks.workunit.client.1.smithi195.stdout:1/728: unlink d4/d14/fd 0 2024-04-06T12:23:13.851 INFO:tasks.workunit.client.1.smithi195.stdout:6/851: write d8/d21/d2b/d46/d44/d86/fff [799225,118140] 0 2024-04-06T12:23:13.853 INFO:tasks.workunit.client.1.smithi195.stdout:5/846: rename d0/da/d13/d87/l7b to d0/da/d23/l125 0 2024-04-06T12:23:13.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/847: stat d0/da/d23/dd4/dc2/fe8 0 2024-04-06T12:23:13.854 INFO:tasks.workunit.client.1.smithi195.stdout:0/776: creat d4/d6/d1a/d73/ff7 x:0 0 0 2024-04-06T12:23:13.857 INFO:tasks.workunit.client.1.smithi195.stdout:1/729: rename d4/d14/d17/d3a/da8/da4/cd6 to d4/d14/d17/d24/d99/d4e/d8f/ce8 0 2024-04-06T12:23:13.897 INFO:tasks.workunit.client.1.smithi195.stdout:6/852: mkdir d8/d14c 0 2024-04-06T12:23:13.897 INFO:tasks.workunit.client.1.smithi195.stdout:1/730: creat d4/d14/d17/d3a/da8/fe9 x:0 0 0 2024-04-06T12:23:13.899 INFO:tasks.workunit.client.1.smithi195.stdout:6/853: creat d8/d21/d31/d26/dc8/d4e/f14d x:0 0 0 2024-04-06T12:23:13.900 INFO:tasks.workunit.client.1.smithi195.stdout:1/731: unlink d4/d14/d17/d3a/da8/da4/db2/d28/c38 0 2024-04-06T12:23:13.902 INFO:tasks.workunit.client.1.smithi195.stdout:1/732: unlink d4/d14/d17/d3a/da8/da4/db2/d28/f2b 0 2024-04-06T12:23:13.905 INFO:tasks.workunit.client.1.smithi195.stdout:1/733: symlink d4/d14/d17/d24/d99/d4e/d60/lea 0 2024-04-06T12:23:13.952 INFO:tasks.workunit.client.1.smithi195.stdout:7/678: sync 2024-04-06T12:23:13.953 INFO:tasks.workunit.client.1.smithi195.stdout:2/810: sync 2024-04-06T12:23:13.954 INFO:tasks.workunit.client.1.smithi195.stdout:2/811: stat d2/d3f/fc0 0 2024-04-06T12:23:13.954 INFO:tasks.workunit.client.1.smithi195.stdout:6/854: truncate d8/f1a 1928313 0 2024-04-06T12:23:13.956 INFO:tasks.workunit.client.1.smithi195.stdout:1/734: truncate d4/d14/d17/d3a/da8/da4/db2/fdf 538904 0 2024-04-06T12:23:13.956 INFO:tasks.workunit.client.1.smithi195.stdout:2/812: fdatasync d2/d41/d5a/fbd 0 2024-04-06T12:23:13.959 INFO:tasks.workunit.client.1.smithi195.stdout:1/735: truncate d4/d14/d17/f85 441289 0 2024-04-06T12:23:13.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/813: rename d2/f26 to d2/d21/d2c/d2d/d92/f10b 0 2024-04-06T12:23:13.961 INFO:tasks.workunit.client.1.smithi195.stdout:6/855: dwrite d8/d21/d2b/fe9 [0,4194304] 0 2024-04-06T12:23:13.965 INFO:tasks.workunit.client.1.smithi195.stdout:2/814: mknod d2/d21/d2c/d2d/c10c 0 2024-04-06T12:23:13.965 INFO:tasks.workunit.client.1.smithi195.stdout:2/815: stat d2/d3f/d7d/d7a/f91 0 2024-04-06T12:23:13.966 INFO:tasks.workunit.client.1.smithi195.stdout:6/856: creat d8/d21/d31/d26/dcf/de4/f14e x:0 0 0 2024-04-06T12:23:13.968 INFO:tasks.workunit.client.1.smithi195.stdout:6/857: read d8/d21/d31/d6c/db6/f13d [500977,81696] 0 2024-04-06T12:23:13.968 INFO:tasks.workunit.client.1.smithi195.stdout:1/736: read d4/d14/d17/d24/f27 [446418,84611] 0 2024-04-06T12:23:13.970 INFO:tasks.workunit.client.1.smithi195.stdout:2/816: symlink d2/d3f/d7d/l10d 0 2024-04-06T12:23:13.971 INFO:tasks.workunit.client.1.smithi195.stdout:7/679: dwrite d4/d10/d12/f2e [0,4194304] 0 2024-04-06T12:23:13.974 INFO:tasks.workunit.client.1.smithi195.stdout:6/858: creat d8/d21/d2b/d46/d13e/f14f x:0 0 0 2024-04-06T12:23:13.975 INFO:tasks.workunit.client.1.smithi195.stdout:7/680: unlink d4/d10/d18/d19/f5e 0 2024-04-06T12:23:13.976 INFO:tasks.workunit.client.1.smithi195.stdout:6/859: stat d8/d21/d31/d6c/d7b/d11b/daf 0 2024-04-06T12:23:13.976 INFO:tasks.workunit.client.1.smithi195.stdout:1/737: mkdir d4/d14/d17/d24/d99/d88/deb 0 2024-04-06T12:23:13.977 INFO:tasks.workunit.client.1.smithi195.stdout:2/817: creat d2/d41/d84/d8d/d94/dbb/f10e x:0 0 0 2024-04-06T12:23:13.979 INFO:tasks.workunit.client.1.smithi195.stdout:6/860: mknod d8/d21/d31/d26/dcf/c150 0 2024-04-06T12:23:13.980 INFO:tasks.workunit.client.1.smithi195.stdout:2/818: write d2/ddc/f109 [143280,50820] 0 2024-04-06T12:23:13.984 INFO:tasks.workunit.client.1.smithi195.stdout:6/861: truncate d8/d21/d2b/d46/d13e/f14f 57248 0 2024-04-06T12:23:13.985 INFO:tasks.workunit.client.1.smithi195.stdout:1/738: rename d4/d14/d17/d24/d99/d4e/d60/dc4 to d4/d14/d17/d24/d99/d88/dec 0 2024-04-06T12:23:13.985 INFO:tasks.workunit.client.1.smithi195.stdout:7/681: dwrite d4/d16/f6a [4194304,4194304] 0 2024-04-06T12:23:13.987 INFO:tasks.workunit.client.1.smithi195.stdout:6/862: creat d8/d3d/d5e/de0/f151 x:0 0 0 2024-04-06T12:23:13.987 INFO:tasks.workunit.client.1.smithi195.stdout:2/819: mkdir d2/d21/d29/de7/df6/d10f 0 2024-04-06T12:23:13.990 INFO:tasks.workunit.client.1.smithi195.stdout:2/820: stat d2/d21/d2c/d2d/d92/d95/d9b 0 2024-04-06T12:23:13.990 INFO:tasks.workunit.client.1.smithi195.stdout:6/863: read d8/d3d/f68 [242256,36767] 0 2024-04-06T12:23:13.991 INFO:tasks.workunit.client.1.smithi195.stdout:6/864: chown d8/d3d/d5e/de0/f151 2 1 2024-04-06T12:23:13.992 INFO:tasks.workunit.client.1.smithi195.stdout:1/739: getdents d4/d14/d17/d24/d99/d88/dec 0 2024-04-06T12:23:13.993 INFO:tasks.workunit.client.1.smithi195.stdout:6/865: dread - d8/d21/d31/d6c/f133 zero size 2024-04-06T12:23:14.019 INFO:tasks.workunit.client.1.smithi195.stdout:1/740: creat d4/d14/d17/d24/d2a/d5a/daa/fed x:0 0 0 2024-04-06T12:23:14.019 INFO:tasks.workunit.client.1.smithi195.stdout:1/741: stat d4/d14/d17/dd4/ld8 0 2024-04-06T12:23:14.020 INFO:tasks.workunit.client.1.smithi195.stdout:6/866: mkdir d8/d21/d31/d26/d152 0 2024-04-06T12:23:14.022 INFO:tasks.workunit.client.1.smithi195.stdout:1/742: write d4/d14/d17/d3a/da8/db8/fe2 [524630,123006] 0 2024-04-06T12:23:14.022 INFO:tasks.workunit.client.1.smithi195.stdout:6/867: mknod d8/d3d/d5e/d72/d10c/d82/c153 0 2024-04-06T12:23:14.025 INFO:tasks.workunit.client.1.smithi195.stdout:6/868: symlink d8/d21/d31/d70/l154 0 2024-04-06T12:23:14.026 INFO:tasks.workunit.client.1.smithi195.stdout:1/743: fsync d4/d14/d17/d24/d99/d4e/d8f/dbe/fce 0 2024-04-06T12:23:14.027 INFO:tasks.workunit.client.1.smithi195.stdout:2/821: dread d2/d21/d29/f34 [0,4194304] 0 2024-04-06T12:23:14.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/744: dread - d4/d14/d17/d24/d99/d4e/d8f/dbe/fce zero size 2024-04-06T12:23:14.030 INFO:tasks.workunit.client.1.smithi195.stdout:6/869: rename d8/d21/d31/l1b to d8/d21/d2b/l155 0 2024-04-06T12:23:14.038 INFO:tasks.workunit.client.1.smithi195.stdout:6/870: fdatasync d8/d3d/d5e/d72/d10c/d32/fbe 0 2024-04-06T12:23:14.038 INFO:tasks.workunit.client.1.smithi195.stdout:6/871: chown d8/d3d/d5e/f8f 20 1 2024-04-06T12:23:14.041 INFO:tasks.workunit.client.1.smithi195.stdout:6/872: dread d8/d21/d2b/d46/d44/f135 [0,4194304] 0 2024-04-06T12:23:14.055 INFO:tasks.workunit.client.1.smithi195.stdout:1/745: creat d4/d14/d17/d24/d99/d88/fee x:0 0 0 2024-04-06T12:23:14.056 INFO:tasks.workunit.client.1.smithi195.stdout:6/873: chown d8/ceb 52 1 2024-04-06T12:23:14.057 INFO:tasks.workunit.client.1.smithi195.stdout:6/874: write d8/d3d/d5e/d72/d10c/d32/f112 [132976,22338] 0 2024-04-06T12:23:14.063 INFO:tasks.workunit.client.1.smithi195.stdout:6/875: dwrite d8/d3d/d5e/ffa [0,4194304] 0 2024-04-06T12:23:14.064 INFO:tasks.workunit.client.1.smithi195.stdout:6/876: write d8/d3d/fd2 [92325,5269] 0 2024-04-06T12:23:14.065 INFO:tasks.workunit.client.1.smithi195.stdout:9/762: sync 2024-04-06T12:23:14.066 INFO:tasks.workunit.client.1.smithi195.stdout:4/721: sync 2024-04-06T12:23:14.066 INFO:tasks.workunit.client.1.smithi195.stdout:4/722: fsync d4/d3e/f78 0 2024-04-06T12:23:14.070 INFO:tasks.workunit.client.1.smithi195.stdout:4/723: chown d4/d3e/fac 7 1 2024-04-06T12:23:14.071 INFO:tasks.workunit.client.1.smithi195.stdout:9/763: creat d3/ff8 x:0 0 0 2024-04-06T12:23:14.071 INFO:tasks.workunit.client.1.smithi195.stdout:4/724: read d4/f4e [3869492,116065] 0 2024-04-06T12:23:14.071 INFO:tasks.workunit.client.1.smithi195.stdout:6/877: dwrite d8/d3d/d5e/d72/f79 [0,4194304] 0 2024-04-06T12:23:14.079 INFO:tasks.workunit.client.1.smithi195.stdout:4/725: dwrite d4/d8c/d96/dc6/fc8 [0,4194304] 0 2024-04-06T12:23:14.081 INFO:tasks.workunit.client.1.smithi195.stdout:4/726: dread d4/d6/d38/d65/fd8 [0,4194304] 0 2024-04-06T12:23:14.081 INFO:tasks.workunit.client.1.smithi195.stdout:6/878: link d8/d21/d31/d26/fb9 d8/d21/d2b/d46/d44/df7/f156 0 2024-04-06T12:23:14.085 INFO:tasks.workunit.client.1.smithi195.stdout:4/727: fdatasync d4/d6/d38/d1a/d40/d20/f9c 0 2024-04-06T12:23:14.086 INFO:tasks.workunit.client.1.smithi195.stdout:4/728: chown d4/d6/d38/d65/dc5/cd5 232287 1 2024-04-06T12:23:14.090 INFO:tasks.workunit.client.1.smithi195.stdout:2/822: truncate d2/d21/d2c/d2d/f5f 1687454 0 2024-04-06T12:23:14.094 INFO:tasks.workunit.client.1.smithi195.stdout:2/823: creat d2/d3f/d7d/f110 x:0 0 0 2024-04-06T12:23:14.096 INFO:tasks.workunit.client.1.smithi195.stdout:9/764: write d3/d10/d3a/f6d [270963,119812] 0 2024-04-06T12:23:14.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/729: link d4/d6/d38/d1a/c66 d4/ce5 0 2024-04-06T12:23:14.098 INFO:tasks.workunit.client.1.smithi195.stdout:8/767: sync 2024-04-06T12:23:14.098 INFO:tasks.workunit.client.1.smithi195.stdout:5/848: sync 2024-04-06T12:23:14.098 INFO:tasks.workunit.client.1.smithi195.stdout:0/777: sync 2024-04-06T12:23:14.098 INFO:tasks.workunit.client.1.smithi195.stdout:3/825: sync 2024-04-06T12:23:14.100 INFO:tasks.workunit.client.1.smithi195.stdout:1/746: dwrite d4/d14/d17/d24/d99/d4e/d57/f66 [0,4194304] 0 2024-04-06T12:23:14.100 INFO:tasks.workunit.client.1.smithi195.stdout:4/730: fdatasync d4/d8c/fbf 0 2024-04-06T12:23:14.107 INFO:tasks.workunit.client.1.smithi195.stdout:0/778: write d4/d6/d1a/f37 [2735130,18397] 0 2024-04-06T12:23:14.107 INFO:tasks.workunit.client.1.smithi195.stdout:1/747: creat d4/d14/d17/d24/fef x:0 0 0 2024-04-06T12:23:14.109 INFO:tasks.workunit.client.1.smithi195.stdout:3/826: chown d4/d9/d2b/d3b/c62 395038708 1 2024-04-06T12:23:14.113 INFO:tasks.workunit.client.1.smithi195.stdout:6/879: dwrite d8/d3d/d5e/d72/d10c/d9c/faa [0,4194304] 0 2024-04-06T12:23:14.114 INFO:tasks.workunit.client.1.smithi195.stdout:8/768: chown d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/l48 224863976 1 2024-04-06T12:23:14.114 INFO:tasks.workunit.client.1.smithi195.stdout:0/779: mknod d4/d6/d2f/cf8 0 2024-04-06T12:23:14.115 INFO:tasks.workunit.client.1.smithi195.stdout:1/748: write d4/d14/d17/d3a/da8/db8/fe2 [1038317,85744] 0 2024-04-06T12:23:14.116 INFO:tasks.workunit.client.1.smithi195.stdout:5/849: rename d0/da/dd/d1c/d5a/d62/d64/d67/db9 to d0/d126 0 2024-04-06T12:23:14.119 INFO:tasks.workunit.client.1.smithi195.stdout:8/769: unlink d6/d3a/l87 0 2024-04-06T12:23:14.119 INFO:tasks.workunit.client.1.smithi195.stdout:5/850: readlink d0/da/d13/l19 0 2024-04-06T12:23:14.121 INFO:tasks.workunit.client.1.smithi195.stdout:1/749: mkdir d4/df0 0 2024-04-06T12:23:14.121 INFO:tasks.workunit.client.1.smithi195.stdout:2/824: dwrite d2/d3f/d7d/f3d [0,4194304] 0 2024-04-06T12:23:14.122 INFO:tasks.workunit.client.1.smithi195.stdout:9/765: dread d3/de/f58 [0,4194304] 0 2024-04-06T12:23:14.123 INFO:tasks.workunit.client.1.smithi195.stdout:0/780: mknod d4/d6/d1a/cf9 0 2024-04-06T12:23:14.126 INFO:tasks.workunit.client.1.smithi195.stdout:6/880: fsync d8/d3d/d5e/d72/d10c/d82/dfd/f103 0 2024-04-06T12:23:14.127 INFO:tasks.workunit.client.1.smithi195.stdout:3/827: dwrite d4/f4e [0,4194304] 0 2024-04-06T12:23:14.129 INFO:tasks.workunit.client.1.smithi195.stdout:1/750: mkdir d4/df0/df1 0 2024-04-06T12:23:14.130 INFO:tasks.workunit.client.1.smithi195.stdout:2/825: creat d2/d41/d84/d8d/d94/db6/f111 x:0 0 0 2024-04-06T12:23:14.131 INFO:tasks.workunit.client.1.smithi195.stdout:5/851: mkdir d0/da/d23/d127 0 2024-04-06T12:23:14.136 INFO:tasks.workunit.client.1.smithi195.stdout:3/828: fsync d4/df/f6f 0 2024-04-06T12:23:14.136 INFO:tasks.workunit.client.1.smithi195.stdout:8/770: dread d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/f58 [0,4194304] 0 2024-04-06T12:23:14.136 INFO:tasks.workunit.client.1.smithi195.stdout:1/751: dread d4/d14/d17/d3a/da8/da4/db2/d28/fb1 [0,4194304] 0 2024-04-06T12:23:14.139 INFO:tasks.workunit.client.1.smithi195.stdout:0/781: dwrite d4/d6/d1a/f37 [0,4194304] 0 2024-04-06T12:23:14.139 INFO:tasks.workunit.client.1.smithi195.stdout:9/766: creat d3/d10/d7d/dee/df1/ff9 x:0 0 0 2024-04-06T12:23:14.141 INFO:tasks.workunit.client.1.smithi195.stdout:5/852: mknod d0/da/d23/d38/d107/c128 0 2024-04-06T12:23:14.144 INFO:tasks.workunit.client.1.smithi195.stdout:0/782: write d4/d6/f6b [1208550,41523] 0 2024-04-06T12:23:14.144 INFO:tasks.workunit.client.1.smithi195.stdout:5/853: truncate d0/da/dd/fe6 771109 0 2024-04-06T12:23:14.144 INFO:tasks.workunit.client.1.smithi195.stdout:2/826: truncate d2/d21/d69/f62 3842600 0 2024-04-06T12:23:14.147 INFO:tasks.workunit.client.1.smithi195.stdout:8/771: symlink d6/d3a/d46/db2/l106 0 2024-04-06T12:23:14.149 INFO:tasks.workunit.client.1.smithi195.stdout:3/829: fdatasync d4/d9/d2b/d3b/d5e/d7e/f8b 0 2024-04-06T12:23:14.150 INFO:tasks.workunit.client.1.smithi195.stdout:9/767: mknod d3/da1/cfa 0 2024-04-06T12:23:14.152 INFO:tasks.workunit.client.1.smithi195.stdout:2/827: mknod d2/d3f/c112 0 2024-04-06T12:23:14.153 INFO:tasks.workunit.client.1.smithi195.stdout:2/828: truncate d2/f1e 6222623 0 2024-04-06T12:23:14.155 INFO:tasks.workunit.client.1.smithi195.stdout:6/881: write d8/d3d/d5e/d72/d10c/f39 [1097056,7257] 0 2024-04-06T12:23:14.155 INFO:tasks.workunit.client.1.smithi195.stdout:1/752: getdents d4/df0/df1 0 2024-04-06T12:23:14.157 INFO:tasks.workunit.client.1.smithi195.stdout:8/772: creat d6/dd/d70/d24/d34/d67/da1/da2/dc6/f107 x:0 0 0 2024-04-06T12:23:14.159 INFO:tasks.workunit.client.1.smithi195.stdout:3/830: creat d4/de/dc8/f113 x:0 0 0 2024-04-06T12:23:14.165 INFO:tasks.workunit.client.1.smithi195.stdout:8/773: dwrite d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/f8d [0,4194304] 0 2024-04-06T12:23:14.166 INFO:tasks.workunit.client.1.smithi195.stdout:3/831: dwrite d4/d9/d2b/d3b/d5e/d7e/fb6 [0,4194304] 0 2024-04-06T12:23:14.169 INFO:tasks.workunit.client.1.smithi195.stdout:0/783: fsync d4/d6/d1a/f86 0 2024-04-06T12:23:14.172 INFO:tasks.workunit.client.1.smithi195.stdout:5/854: link d0/da/dd/d2e/d6f/f51 d0/d52/d91/f129 0 2024-04-06T12:23:14.173 INFO:tasks.workunit.client.1.smithi195.stdout:1/753: creat d4/d14/d17/d24/d99/d88/dec/dda/ff2 x:0 0 0 2024-04-06T12:23:14.174 INFO:tasks.workunit.client.1.smithi195.stdout:8/774: dread d6/dd/d70/d24/d34/d67/f6c [0,4194304] 0 2024-04-06T12:23:14.176 INFO:tasks.workunit.client.1.smithi195.stdout:9/768: creat d3/d10/ffb x:0 0 0 2024-04-06T12:23:14.177 INFO:tasks.workunit.client.1.smithi195.stdout:8/775: readlink d6/db/lc 0 2024-04-06T12:23:14.178 INFO:tasks.workunit.client.1.smithi195.stdout:2/829: creat d2/d21/d29/f113 x:0 0 0 2024-04-06T12:23:14.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/855: read d0/da/d23/dd4/d106/fbe [309835,96048] 0 2024-04-06T12:23:14.180 INFO:tasks.workunit.client.1.smithi195.stdout:7/682: sync 2024-04-06T12:23:14.181 INFO:tasks.workunit.client.1.smithi195.stdout:0/784: dwrite d4/d6/d2f/fd6 [0,4194304] 0 2024-04-06T12:23:14.181 INFO:tasks.workunit.client.1.smithi195.stdout:3/832: creat d4/d9/d2b/d3b/d5e/dfd/f114 x:0 0 0 2024-04-06T12:23:14.182 INFO:tasks.workunit.client.1.smithi195.stdout:1/754: creat d4/d14/d17/d3a/da8/ff3 x:0 0 0 2024-04-06T12:23:14.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/830: read d2/d21/d29/ffb [443951,77412] 0 2024-04-06T12:23:14.185 INFO:tasks.workunit.client.1.smithi195.stdout:9/769: write d3/d10/d3a/d6b/fbf [5234821,566] 0 2024-04-06T12:23:14.185 INFO:tasks.workunit.client.1.smithi195.stdout:3/833: dread - d4/de/d8e/d92/faa zero size 2024-04-06T12:23:14.185 INFO:tasks.workunit.client.1.smithi195.stdout:0/785: chown d4/d6/d1a/c2b 96972 1 2024-04-06T12:23:14.186 INFO:tasks.workunit.client.1.smithi195.stdout:7/683: creat d4/d16/dd/d22/d76/fda x:0 0 0 2024-04-06T12:23:14.187 INFO:tasks.workunit.client.1.smithi195.stdout:8/776: symlink d6/dd/d42/dce/l108 0 2024-04-06T12:23:14.188 INFO:tasks.workunit.client.1.smithi195.stdout:1/755: rmdir d4/d14/d17/d24/d99/d4e/d8f 39 2024-04-06T12:23:14.189 INFO:tasks.workunit.client.1.smithi195.stdout:9/770: rmdir d3/dd3 39 2024-04-06T12:23:14.191 INFO:tasks.workunit.client.1.smithi195.stdout:7/684: creat d4/d24/fdb x:0 0 0 2024-04-06T12:23:14.193 INFO:tasks.workunit.client.1.smithi195.stdout:5/856: rmdir d0/da/d23/d38/d107/d114 0 2024-04-06T12:23:14.194 INFO:tasks.workunit.client.1.smithi195.stdout:2/831: dwrite d2/d21/d5e/ff4 [0,4194304] 0 2024-04-06T12:23:14.199 INFO:tasks.workunit.client.1.smithi195.stdout:9/771: rmdir d3/d10/d7d/dee 39 2024-04-06T12:23:14.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/882: truncate d8/d3d/d5e/dd3/dfe/f76 97819 0 2024-04-06T12:23:14.204 INFO:tasks.workunit.client.1.smithi195.stdout:5/857: chown d0/da/dd/d1c/d5a/d62/db8/lc1 7478 1 2024-04-06T12:23:14.205 INFO:tasks.workunit.client.1.smithi195.stdout:8/777: truncate d6/dd/f69 2479873 0 2024-04-06T12:23:14.214 INFO:tasks.workunit.client.1.smithi195.stdout:9/772: truncate d3/fa7 72212 0 2024-04-06T12:23:14.214 INFO:tasks.workunit.client.1.smithi195.stdout:3/834: write d4/df/d39/f5a [643090,64296] 0 2024-04-06T12:23:14.215 INFO:tasks.workunit.client.1.smithi195.stdout:3/835: dread - d4/d9/f49 zero size 2024-04-06T12:23:14.216 INFO:tasks.workunit.client.1.smithi195.stdout:1/756: creat d4/d14/d17/d24/d99/d88/ff4 x:0 0 0 2024-04-06T12:23:14.223 INFO:tasks.workunit.client.1.smithi195.stdout:6/883: mkdir d8/d21/d31/d157 0 2024-04-06T12:23:14.224 INFO:tasks.workunit.client.1.smithi195.stdout:0/786: write d4/d6/d58/da7/dc6/fea [4260198,30826] 0 2024-04-06T12:23:14.225 INFO:tasks.workunit.client.1.smithi195.stdout:2/832: creat d2/d3f/d7d/f114 x:0 0 0 2024-04-06T12:23:14.226 INFO:tasks.workunit.client.1.smithi195.stdout:9/773: creat d3/d10/d3b/d48/d5e/ffc x:0 0 0 2024-04-06T12:23:14.227 INFO:tasks.workunit.client.1.smithi195.stdout:1/757: write d4/d14/d17/d24/d2a/fde [27156,108768] 0 2024-04-06T12:23:14.227 INFO:tasks.workunit.client.1.smithi195.stdout:3/836: creat d4/d9/dcf/f115 x:0 0 0 2024-04-06T12:23:14.228 INFO:tasks.workunit.client.1.smithi195.stdout:7/685: link d4/d10/cb0 d4/d16/d11/cdc 0 2024-04-06T12:23:14.228 INFO:tasks.workunit.client.1.smithi195.stdout:6/884: read - d8/d3d/d5e/dd3/dfe/ff8 zero size 2024-04-06T12:23:14.232 INFO:tasks.workunit.client.1.smithi195.stdout:2/833: read d2/d21/d29/f3e [1970936,101124] 0 2024-04-06T12:23:14.232 INFO:tasks.workunit.client.1.smithi195.stdout:9/774: read d3/de/fa3 [186630,23197] 0 2024-04-06T12:23:14.232 INFO:tasks.workunit.client.1.smithi195.stdout:0/787: write d4/d48/d67/d75/dcf/fed [61790,119339] 0 2024-04-06T12:23:14.232 INFO:tasks.workunit.client.1.smithi195.stdout:7/686: chown d4/d24/d80/la4 0 1 2024-04-06T12:23:14.232 INFO:tasks.workunit.client.1.smithi195.stdout:8/778: dwrite d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/f26 [4194304,4194304] 0 2024-04-06T12:23:14.234 INFO:tasks.workunit.client.1.smithi195.stdout:8/779: dread - d6/dd/d70/ffe zero size 2024-04-06T12:23:14.234 INFO:tasks.workunit.client.1.smithi195.stdout:6/885: rmdir d8/d3d/d5e 39 2024-04-06T12:23:14.236 INFO:tasks.workunit.client.1.smithi195.stdout:2/834: write d2/d21/d2c/d2d/f57 [1002323,73353] 0 2024-04-06T12:23:14.237 INFO:tasks.workunit.client.1.smithi195.stdout:6/886: chown d8/d21/d31/d49/c100 5321 1 2024-04-06T12:23:14.238 INFO:tasks.workunit.client.1.smithi195.stdout:1/758: rmdir d4/d14/d17/d24/d2a/d45 39 2024-04-06T12:23:14.244 INFO:tasks.workunit.client.1.smithi195.stdout:0/788: write d4/d6/d1a/d73/f92 [1246203,33183] 0 2024-04-06T12:23:14.247 INFO:tasks.workunit.client.1.smithi195.stdout:6/887: creat d8/d21/d31/d49/dd8/f158 x:0 0 0 2024-04-06T12:23:14.251 INFO:tasks.workunit.client.1.smithi195.stdout:8/780: mkdir d6/dd/d70/d24/d34/d67/d109 0 2024-04-06T12:23:14.252 INFO:tasks.workunit.client.1.smithi195.stdout:6/888: dread - d8/d3d/d5e/de0/f151 zero size 2024-04-06T12:23:14.254 INFO:tasks.workunit.client.1.smithi195.stdout:0/789: mknod d4/d6/d1a/d73/cfa 0 2024-04-06T12:23:14.255 INFO:tasks.workunit.client.1.smithi195.stdout:3/837: getdents d4/dc4 0 2024-04-06T12:23:14.255 INFO:tasks.workunit.client.1.smithi195.stdout:4/731: sync 2024-04-06T12:23:14.256 INFO:tasks.workunit.client.1.smithi195.stdout:7/687: truncate d4/d10/f27 7577533 0 2024-04-06T12:23:14.256 INFO:tasks.workunit.client.1.smithi195.stdout:6/889: write d8/d21/d2b/d46/d44/f56 [2019296,58360] 0 2024-04-06T12:23:14.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/790: chown d4/d6/c4b 40488710 1 2024-04-06T12:23:14.258 INFO:tasks.workunit.client.1.smithi195.stdout:2/835: rename d2/d41/d84/d8d/d94/f9a to d2/d3f/d7d/f115 0 2024-04-06T12:23:14.262 INFO:tasks.workunit.client.1.smithi195.stdout:4/732: chown d4/d6/d38/d1a/d40/cd1 59891 1 2024-04-06T12:23:14.262 INFO:tasks.workunit.client.1.smithi195.stdout:9/775: dwrite d3/d10/d3b/f55 [0,4194304] 0 2024-04-06T12:23:14.262 INFO:tasks.workunit.client.1.smithi195.stdout:2/836: dread - d2/d41/d5a/fcd zero size 2024-04-06T12:23:14.263 INFO:tasks.workunit.client.1.smithi195.stdout:3/838: symlink d4/de/d8e/d92/d9e/l116 0 2024-04-06T12:23:14.264 INFO:tasks.workunit.client.1.smithi195.stdout:7/688: rmdir d4/d16/dd 39 2024-04-06T12:23:14.265 INFO:tasks.workunit.client.1.smithi195.stdout:1/759: rename d4/d14/d17/f77 to d4/d14/d17/dc1/ff5 0 2024-04-06T12:23:14.266 INFO:tasks.workunit.client.1.smithi195.stdout:7/689: chown d4/d10/d18/d19/fce 3 1 2024-04-06T12:23:14.267 INFO:tasks.workunit.client.1.smithi195.stdout:6/890: mknod d8/d21/d2b/d46/c159 0 2024-04-06T12:23:14.267 INFO:tasks.workunit.client.1.smithi195.stdout:8/781: dread d6/dd/d70/d24/d34/d67/d9d/dd7/fff [0,4194304] 0 2024-04-06T12:23:14.269 INFO:tasks.workunit.client.1.smithi195.stdout:1/760: write d4/d14/d17/d24/d99/d88/dec/dda/ff2 [428300,15179] 0 2024-04-06T12:23:14.269 INFO:tasks.workunit.client.1.smithi195.stdout:9/776: symlink d3/de/ddf/lfd 0 2024-04-06T12:23:14.274 INFO:tasks.workunit.client.1.smithi195.stdout:4/733: dread d4/d6/d38/d65/f7f [0,4194304] 0 2024-04-06T12:23:14.274 INFO:tasks.workunit.client.1.smithi195.stdout:4/734: fsync d4/f5e 0 2024-04-06T12:23:14.274 INFO:tasks.workunit.client.1.smithi195.stdout:0/791: truncate d4/d6/d58/f8b 1566120 0 2024-04-06T12:23:14.274 INFO:tasks.workunit.client.1.smithi195.stdout:2/837: fsync d2/d21/d29/fb5 0 2024-04-06T12:23:14.275 INFO:tasks.workunit.client.1.smithi195.stdout:4/735: readlink d4/d6/d38/d1a/d40/d57/lb0 0 2024-04-06T12:23:14.275 INFO:tasks.workunit.client.1.smithi195.stdout:7/690: fsync d4/d16/dd/d22/d3f/d54/fb4 0 2024-04-06T12:23:14.275 INFO:tasks.workunit.client.1.smithi195.stdout:0/792: write d4/d6/d1a/f3f [606110,126917] 0 2024-04-06T12:23:14.279 INFO:tasks.workunit.client.1.smithi195.stdout:6/891: mkdir d8/d21/d31/d26/d13f/d15a 0 2024-04-06T12:23:14.280 INFO:tasks.workunit.client.1.smithi195.stdout:2/838: stat d2/d3f/d7d/fa0 0 2024-04-06T12:23:14.281 INFO:tasks.workunit.client.1.smithi195.stdout:5/858: sync 2024-04-06T12:23:14.284 INFO:tasks.workunit.client.1.smithi195.stdout:7/691: unlink d4/d16/dd/d22/d3f/d54/da9/fa6 0 2024-04-06T12:23:14.284 INFO:tasks.workunit.client.1.smithi195.stdout:8/782: creat d6/d3a/f10a x:0 0 0 2024-04-06T12:23:14.285 INFO:tasks.workunit.client.1.smithi195.stdout:5/859: write d0/da/d23/d7a/dc5/fc0 [3122689,82578] 0 2024-04-06T12:23:14.285 INFO:tasks.workunit.client.1.smithi195.stdout:1/761: creat d4/d14/d17/d3a/da8/da4/db2/ff6 x:0 0 0 2024-04-06T12:23:14.287 INFO:tasks.workunit.client.1.smithi195.stdout:9/777: rename d3/d10/f30 to d3/db9/dd8/ffe 0 2024-04-06T12:23:14.290 INFO:tasks.workunit.client.1.smithi195.stdout:7/692: rmdir d4/d10/d12/da5/da3 39 2024-04-06T12:23:14.291 INFO:tasks.workunit.client.1.smithi195.stdout:3/839: link d4/de/d8e/d92/l104 d4/d9/d2b/l117 0 2024-04-06T12:23:14.293 INFO:tasks.workunit.client.1.smithi195.stdout:6/892: dwrite d8/d3d/d5e/dd3/dfe/f52 [0,4194304] 0 2024-04-06T12:23:14.293 INFO:tasks.workunit.client.1.smithi195.stdout:2/839: rename d2/d21/d29/lc1 to d2/d41/d84/d8d/d94/dbb/l116 0 2024-04-06T12:23:14.294 INFO:tasks.workunit.client.1.smithi195.stdout:7/693: write d4/d10/d18/f53 [1108165,19855] 0 2024-04-06T12:23:14.295 INFO:tasks.workunit.client.1.smithi195.stdout:5/860: mknod d0/da/d23/d38/d41/d7d/c12a 0 2024-04-06T12:23:14.296 INFO:tasks.workunit.client.1.smithi195.stdout:2/840: write d2/d21/f74 [463770,124060] 0 2024-04-06T12:23:14.297 INFO:tasks.workunit.client.1.smithi195.stdout:0/793: getdents d4/d53/d81 0 2024-04-06T12:23:14.297 INFO:tasks.workunit.client.1.smithi195.stdout:6/893: rename d8 to d8/d21/d31/d49/dd8/d13a/d15b 22 2024-04-06T12:23:14.298 INFO:tasks.workunit.client.1.smithi195.stdout:9/778: mknod d3/d10/d4f/cff 0 2024-04-06T12:23:14.298 INFO:tasks.workunit.client.1.smithi195.stdout:4/736: dread d4/f79 [0,4194304] 0 2024-04-06T12:23:14.300 INFO:tasks.workunit.client.1.smithi195.stdout:8/783: unlink d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/ce5 0 2024-04-06T12:23:14.301 INFO:tasks.workunit.client.1.smithi195.stdout:4/737: fsync d4/d3e/f78 0 2024-04-06T12:23:14.302 INFO:tasks.workunit.client.1.smithi195.stdout:7/694: truncate d4/d16/dd/d22/d76/f7a 411628 0 2024-04-06T12:23:14.302 INFO:tasks.workunit.client.1.smithi195.stdout:0/794: read d4/d48/d77/f85 [3086561,24520] 0 2024-04-06T12:23:14.302 INFO:tasks.workunit.client.1.smithi195.stdout:2/841: truncate d2/d41/d5a/fff 403078 0 2024-04-06T12:23:14.304 INFO:tasks.workunit.client.1.smithi195.stdout:3/840: truncate d4/df/d39/f9c 126140 0 2024-04-06T12:23:14.305 INFO:tasks.workunit.client.1.smithi195.stdout:9/779: truncate d3/d10/d7d/dd0/fe1 36908 0 2024-04-06T12:23:14.306 INFO:tasks.workunit.client.1.smithi195.stdout:1/762: dread d4/d14/d17/d3a/da8/f33 [0,4194304] 0 2024-04-06T12:23:14.307 INFO:tasks.workunit.client.1.smithi195.stdout:6/894: creat d8/d21/d2b/d46/d44/df7/f15c x:0 0 0 2024-04-06T12:23:14.310 INFO:tasks.workunit.client.1.smithi195.stdout:6/895: write d8/d21/d2b/d46/f4c [4100965,98428] 0 2024-04-06T12:23:14.310 INFO:tasks.workunit.client.1.smithi195.stdout:0/795: unlink d4/d6/ce1 0 2024-04-06T12:23:14.311 INFO:tasks.workunit.client.1.smithi195.stdout:4/738: dwrite d4/f5e [0,4194304] 0 2024-04-06T12:23:14.312 INFO:tasks.workunit.client.1.smithi195.stdout:4/739: fdatasync d4/faa 0 2024-04-06T12:23:14.312 INFO:tasks.workunit.client.1.smithi195.stdout:7/695: stat d4/d16/dd/d22/d3f/f68 0 2024-04-06T12:23:14.323 INFO:tasks.workunit.client.1.smithi195.stdout:8/784: unlink d6/dd/d70/d24/d34/d67/ffc 0 2024-04-06T12:23:14.324 INFO:tasks.workunit.client.1.smithi195.stdout:9/780: unlink d3/d10/d3b/d48/l96 0 2024-04-06T12:23:14.326 INFO:tasks.workunit.client.1.smithi195.stdout:6/896: symlink d8/d3d/d5e/d72/l15d 0 2024-04-06T12:23:14.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/861: creat d0/da/d13/d87/f12b x:0 0 0 2024-04-06T12:23:14.330 INFO:tasks.workunit.client.1.smithi195.stdout:9/781: read d3/d10/f89 [118544,39026] 0 2024-04-06T12:23:14.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/782: write d3/d10/f29 [1114910,69829] 0 2024-04-06T12:23:14.332 INFO:tasks.workunit.client.1.smithi195.stdout:7/696: creat d4/d10/d18/d19/d63/fdd x:0 0 0 2024-04-06T12:23:14.333 INFO:tasks.workunit.client.1.smithi195.stdout:9/783: chown d3/d10/d3a/d5d/fb8 26 1 2024-04-06T12:23:14.334 INFO:tasks.workunit.client.1.smithi195.stdout:6/897: readlink d8/d21/d31/l17 0 2024-04-06T12:23:14.335 INFO:tasks.workunit.client.1.smithi195.stdout:7/697: dread d4/d16/dd/d22/d3f/d54/f90 [0,4194304] 0 2024-04-06T12:23:14.336 INFO:tasks.workunit.client.1.smithi195.stdout:8/785: unlink d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/fe1 0 2024-04-06T12:23:14.338 INFO:tasks.workunit.client.1.smithi195.stdout:2/842: write d2/d14/f31 [4343344,113547] 0 2024-04-06T12:23:14.340 INFO:tasks.workunit.client.1.smithi195.stdout:4/740: mknod d4/d6/d38/d1a/d40/d57/ce6 0 2024-04-06T12:23:14.340 INFO:tasks.workunit.client.1.smithi195.stdout:4/741: stat d4/d8c/d96/dc9 0 2024-04-06T12:23:14.341 INFO:tasks.workunit.client.1.smithi195.stdout:4/742: write d4/d3e/f98 [897639,40818] 0 2024-04-06T12:23:14.342 INFO:tasks.workunit.client.1.smithi195.stdout:9/784: chown d3/d10/f11 1216218 1 2024-04-06T12:23:14.343 INFO:tasks.workunit.client.1.smithi195.stdout:4/743: chown d4/d6/d38/d1a/fd7 11088525 1 2024-04-06T12:23:14.343 INFO:tasks.workunit.client.1.smithi195.stdout:3/841: truncate d4/f24 188865 0 2024-04-06T12:23:14.345 INFO:tasks.workunit.client.1.smithi195.stdout:8/786: chown d6/dd/d70/d24/d34/d67/dec/d4b/cee 46 1 2024-04-06T12:23:14.346 INFO:tasks.workunit.client.1.smithi195.stdout:5/862: truncate d0/d52/d91/f129 80988 0 2024-04-06T12:23:14.347 INFO:tasks.workunit.client.1.smithi195.stdout:5/863: stat d0/da/dd/d2e/c80 0 2024-04-06T12:23:14.374 INFO:tasks.workunit.client.1.smithi195.stdout:1/763: sync 2024-04-06T12:23:14.410 INFO:tasks.workunit.client.1.smithi195.stdout:9/785: rename d3/d10/d3b/d50/f8a to d3/db9/dbc/f100 0 2024-04-06T12:23:14.413 INFO:tasks.workunit.client.1.smithi195.stdout:7/698: symlink d4/d10/lde 0 2024-04-06T12:23:14.415 INFO:tasks.workunit.client.1.smithi195.stdout:7/699: truncate d4/d16/dd/d22/fc5 109773 0 2024-04-06T12:23:14.416 INFO:tasks.workunit.client.1.smithi195.stdout:0/796: getdents d4/d48/d4e 0 2024-04-06T12:23:14.419 INFO:tasks.workunit.client.1.smithi195.stdout:4/744: symlink d4/d6/d38/d1a/d40/d57/d64/le7 0 2024-04-06T12:23:14.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/842: creat d4/d9/d2b/d3b/d40/de2/f118 x:0 0 0 2024-04-06T12:23:14.424 INFO:tasks.workunit.client.1.smithi195.stdout:8/787: creat d6/dd/d70/d24/d34/d67/d9d/f10b x:0 0 0 2024-04-06T12:23:14.430 INFO:tasks.workunit.client.1.smithi195.stdout:1/764: mknod d4/d14/d17/d3a/da8/da4/db2/d5d/cf7 0 2024-04-06T12:23:14.430 INFO:tasks.workunit.client.1.smithi195.stdout:5/864: dwrite d0/da/dd/d1c/d5a/d62/d64/fd6 [0,4194304] 0 2024-04-06T12:23:14.435 INFO:tasks.workunit.client.1.smithi195.stdout:9/786: fsync d3/d10/f2f 0 2024-04-06T12:23:14.444 INFO:tasks.workunit.client.1.smithi195.stdout:8/788: rename d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d83/ff4 to d6/dd/d70/d24/d53/f10c 0 2024-04-06T12:23:14.444 INFO:tasks.workunit.client.1.smithi195.stdout:3/843: read d4/de/fc5 [2944775,13253] 0 2024-04-06T12:23:14.444 INFO:tasks.workunit.client.1.smithi195.stdout:8/789: stat d6/db/l22 0 2024-04-06T12:23:14.445 INFO:tasks.workunit.client.1.smithi195.stdout:5/865: creat d0/d52/d91/f12c x:0 0 0 2024-04-06T12:23:14.446 INFO:tasks.workunit.client.1.smithi195.stdout:8/790: write d6/dd/d42/fcd [1450020,4682] 0 2024-04-06T12:23:14.447 INFO:tasks.workunit.client.1.smithi195.stdout:8/791: write d6/dd/d70/ffe [723575,61158] 0 2024-04-06T12:23:14.451 INFO:tasks.workunit.client.1.smithi195.stdout:9/787: symlink d3/d10/d3b/d50/l101 0 2024-04-06T12:23:14.451 INFO:tasks.workunit.client.1.smithi195.stdout:5/866: dread d0/da/dd/d2e/fa4 [0,4194304] 0 2024-04-06T12:23:14.454 INFO:tasks.workunit.client.1.smithi195.stdout:0/797: creat d4/d6/d1a/ffb x:0 0 0 2024-04-06T12:23:14.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/798: chown d4/d6/d1a/f34 5574 1 2024-04-06T12:23:14.456 INFO:tasks.workunit.client.1.smithi195.stdout:1/765: mknod d4/d14/d17/d3a/da8/da4/db2/d5d/db3/de4/cf8 0 2024-04-06T12:23:14.458 INFO:tasks.workunit.client.1.smithi195.stdout:2/843: getdents d2/d41/d84/d8d/d94/db6 0 2024-04-06T12:23:14.459 INFO:tasks.workunit.client.1.smithi195.stdout:2/844: stat d2/f65 0 2024-04-06T12:23:14.462 INFO:tasks.workunit.client.1.smithi195.stdout:1/766: dwrite d4/f11 [0,4194304] 0 2024-04-06T12:23:14.462 INFO:tasks.workunit.client.1.smithi195.stdout:0/799: rmdir d4/d6/d1a/d73 39 2024-04-06T12:23:14.468 INFO:tasks.workunit.client.1.smithi195.stdout:3/844: dread d4/de/f84 [0,4194304] 0 2024-04-06T12:23:14.469 INFO:tasks.workunit.client.1.smithi195.stdout:2/845: creat d2/d3f/d7d/d7a/f117 x:0 0 0 2024-04-06T12:23:14.469 INFO:tasks.workunit.client.1.smithi195.stdout:7/700: rmdir d4/d10/d18/d33/d6e 39 2024-04-06T12:23:14.471 INFO:tasks.workunit.client.1.smithi195.stdout:1/767: mknod d4/d14/d17/d3a/da8/db8/cf9 0 2024-04-06T12:23:14.474 INFO:tasks.workunit.client.1.smithi195.stdout:3/845: unlink d4/d9/d2b/c80 0 2024-04-06T12:23:14.478 INFO:tasks.workunit.client.1.smithi195.stdout:0/800: creat d4/d53/ffc x:0 0 0 2024-04-06T12:23:14.482 INFO:tasks.workunit.client.1.smithi195.stdout:1/768: creat d4/d14/d17/d24/d99/d88/ffa x:0 0 0 2024-04-06T12:23:14.483 INFO:tasks.workunit.client.1.smithi195.stdout:1/769: write d4/d14/d17/d3a/da8/fe9 [409778,93101] 0 2024-04-06T12:23:14.496 INFO:tasks.workunit.client.1.smithi195.stdout:1/770: creat d4/d14/d17/d24/d99/d4e/d60/ffb x:0 0 0 2024-04-06T12:23:14.499 INFO:tasks.workunit.client.1.smithi195.stdout:3/846: getdents d4/de 0 2024-04-06T12:23:14.504 INFO:tasks.workunit.client.1.smithi195.stdout:3/847: rename d4/d9/c3f to d4/d9/d2b/d87/c119 0 2024-04-06T12:23:14.504 INFO:tasks.workunit.client.1.smithi195.stdout:3/848: chown d4/d9/d2b/d3b/d5e/dfd 599338894 1 2024-04-06T12:23:14.505 INFO:tasks.workunit.client.1.smithi195.stdout:1/771: mkdir d4/d14/d17/d24/d99/d4e/d8f/dfc 0 2024-04-06T12:23:14.507 INFO:tasks.workunit.client.1.smithi195.stdout:1/772: fsync d4/d14/d17/d3a/da8/da4/db2/f48 0 2024-04-06T12:23:14.509 INFO:tasks.workunit.client.1.smithi195.stdout:1/773: write d4/d14/d17/d24/d2a/d5a/daa/fb5 [512940,62402] 0 2024-04-06T12:23:14.513 INFO:tasks.workunit.client.1.smithi195.stdout:1/774: creat d4/d14/d17/d24/d99/d4e/d8f/dfc/ffd x:0 0 0 2024-04-06T12:23:14.513 INFO:tasks.workunit.client.1.smithi195.stdout:1/775: fdatasync d4/d14/d17/d24/d99/d88/ff4 0 2024-04-06T12:23:14.516 INFO:tasks.workunit.client.1.smithi195.stdout:8/792: sync 2024-04-06T12:23:14.516 INFO:tasks.workunit.client.1.smithi195.stdout:1/776: mkdir d4/d14/d17/d24/d99/d88/dfe 0 2024-04-06T12:23:14.518 INFO:tasks.workunit.client.1.smithi195.stdout:1/777: chown d4/d14/d17/d24/d99/d88/dec/ccb 3539557 1 2024-04-06T12:23:14.519 INFO:tasks.workunit.client.1.smithi195.stdout:1/778: write d4/d14/d17/d24/d99/d88/ff4 [781981,127208] 0 2024-04-06T12:23:14.519 INFO:tasks.workunit.client.1.smithi195.stdout:8/793: rmdir d6/dd/d70/d24/d34/d67/da1/da2 39 2024-04-06T12:23:14.521 INFO:tasks.workunit.client.1.smithi195.stdout:3/849: dread d4/df/f28 [0,4194304] 0 2024-04-06T12:23:14.524 INFO:tasks.workunit.client.1.smithi195.stdout:1/779: creat d4/d14/d17/d3a/da8/da4/db2/d5d/db3/fff x:0 0 0 2024-04-06T12:23:14.526 INFO:tasks.workunit.client.1.smithi195.stdout:3/850: rename d4/df/d39/fd0 to d4/d9/d2b/d3b/d5e/d7e/f11a 0 2024-04-06T12:23:14.527 INFO:tasks.workunit.client.1.smithi195.stdout:8/794: dwrite d6/dd/d70/d24/d25/fe2 [0,4194304] 0 2024-04-06T12:23:14.529 INFO:tasks.workunit.client.1.smithi195.stdout:6/898: truncate d8/d3d/fd2 51036 0 2024-04-06T12:23:14.531 INFO:tasks.workunit.client.1.smithi195.stdout:6/899: chown d8/d21/d31/d26/fb1 91 1 2024-04-06T12:23:14.532 INFO:tasks.workunit.client.1.smithi195.stdout:3/851: truncate d4/d9/f68 735214 0 2024-04-06T12:23:14.534 INFO:tasks.workunit.client.1.smithi195.stdout:6/900: chown d8/d3d/d5e/d72/l15d 0 1 2024-04-06T12:23:14.534 INFO:tasks.workunit.client.1.smithi195.stdout:1/780: dwrite d4/d14/d17/d3a/da8/fae [0,4194304] 0 2024-04-06T12:23:14.539 INFO:tasks.workunit.client.1.smithi195.stdout:3/852: creat d4/d9/d2b/d87/f11b x:0 0 0 2024-04-06T12:23:14.540 INFO:tasks.workunit.client.1.smithi195.stdout:3/853: fsync d4/d9/f21 0 2024-04-06T12:23:14.540 INFO:tasks.workunit.client.1.smithi195.stdout:6/901: creat d8/d3d/d5e/de0/f15e x:0 0 0 2024-04-06T12:23:14.541 INFO:tasks.workunit.client.1.smithi195.stdout:6/902: dread - d8/d21/d31/d26/dc8/d4e/f14d zero size 2024-04-06T12:23:14.543 INFO:tasks.workunit.client.1.smithi195.stdout:1/781: rename d4/d14/d17/d24/fab to d4/d14/d17/d3a/da8/db8/dd0/f100 0 2024-04-06T12:23:14.545 INFO:tasks.workunit.client.1.smithi195.stdout:3/854: write d4/d9/d2b/d3b/d5e/d7e/f7f [2912947,29786] 0 2024-04-06T12:23:14.546 INFO:tasks.workunit.client.1.smithi195.stdout:3/855: chown d4/f25 30421 1 2024-04-06T12:23:14.548 INFO:tasks.workunit.client.1.smithi195.stdout:1/782: dread d4/d14/d17/d24/d99/f29 [0,4194304] 0 2024-04-06T12:23:14.551 INFO:tasks.workunit.client.1.smithi195.stdout:6/903: link d8/d3d/d5e/la5 d8/d21/d31/d26/d13f/l15f 0 2024-04-06T12:23:14.552 INFO:tasks.workunit.client.1.smithi195.stdout:3/856: dwrite d4/d9/d2b/d3b/d5e/dfd/f114 [0,4194304] 0 2024-04-06T12:23:14.555 INFO:tasks.workunit.client.1.smithi195.stdout:1/783: symlink d4/d14/d17/d24/d99/d4e/de5/l101 0 2024-04-06T12:23:14.559 INFO:tasks.workunit.client.1.smithi195.stdout:1/784: truncate d4/d14/d17/d3a/da8/fe9 568927 0 2024-04-06T12:23:14.561 INFO:tasks.workunit.client.1.smithi195.stdout:6/904: dwrite d8/d3d/d5e/d72/d10c/d9c/d110/f139 [0,4194304] 0 2024-04-06T12:23:14.561 INFO:tasks.workunit.client.1.smithi195.stdout:3/857: dwrite d4/d9/f18 [0,4194304] 0 2024-04-06T12:23:14.564 INFO:tasks.workunit.client.1.smithi195.stdout:1/785: creat d4/d14/d17/d24/d2a/d5a/daa/f102 x:0 0 0 2024-04-06T12:23:14.566 INFO:tasks.workunit.client.1.smithi195.stdout:3/858: write d4/d9/d2b/ff8 [79578,674] 0 2024-04-06T12:23:14.571 INFO:tasks.workunit.client.1.smithi195.stdout:6/905: dwrite d8/d21/d2b/d46/d44/f8c [0,4194304] 0 2024-04-06T12:23:14.573 INFO:tasks.workunit.client.1.smithi195.stdout:6/906: chown d8/d21/d31/d26/dc8/f55 1 1 2024-04-06T12:23:14.575 INFO:tasks.workunit.client.1.smithi195.stdout:2/846: symlink d2/d3f/l118 0 2024-04-06T12:23:14.575 INFO:tasks.workunit.client.1.smithi195.stdout:3/859: mknod d4/d9/d37/db9/d108/c11c 0 2024-04-06T12:23:14.578 INFO:tasks.workunit.client.1.smithi195.stdout:6/907: mkdir d8/d3d/d5e/d72/d10c/d9c/dce/d160 0 2024-04-06T12:23:14.579 INFO:tasks.workunit.client.1.smithi195.stdout:2/847: rmdir d2/d14 39 2024-04-06T12:23:14.579 INFO:tasks.workunit.client.1.smithi195.stdout:3/860: truncate d4/d9/d2b/d77/fba 5804786 0 2024-04-06T12:23:14.582 INFO:tasks.workunit.client.1.smithi195.stdout:0/801: write d4/d6/d2f/f3e [1746109,116944] 0 2024-04-06T12:23:14.583 INFO:tasks.workunit.client.1.smithi195.stdout:9/788: dwrite d3/da1/fae [0,4194304] 0 2024-04-06T12:23:14.586 INFO:tasks.workunit.client.1.smithi195.stdout:4/745: creat d4/fe8 x:0 0 0 2024-04-06T12:23:14.588 INFO:tasks.workunit.client.1.smithi195.stdout:8/795: creat d6/f10d x:0 0 0 2024-04-06T12:23:14.588 INFO:tasks.workunit.client.1.smithi195.stdout:0/802: readlink d4/l8e 0 2024-04-06T12:23:14.591 INFO:tasks.workunit.client.1.smithi195.stdout:2/848: dwrite d2/d3f/fad [0,4194304] 0 2024-04-06T12:23:14.592 INFO:tasks.workunit.client.1.smithi195.stdout:8/796: write d6/dd/d70/d24/d25/f93 [3914359,3997] 0 2024-04-06T12:23:14.593 INFO:tasks.workunit.client.1.smithi195.stdout:1/786: dread d4/d14/d17/d24/d2a/d45/f55 [0,4194304] 0 2024-04-06T12:23:14.595 INFO:tasks.workunit.client.1.smithi195.stdout:3/861: creat d4/df/d39/f11d x:0 0 0 2024-04-06T12:23:14.596 INFO:tasks.workunit.client.1.smithi195.stdout:9/789: mkdir d3/de/d102 0 2024-04-06T12:23:14.597 INFO:tasks.workunit.client.1.smithi195.stdout:6/908: getdents d8/d21/d31/d6c/ded 0 2024-04-06T12:23:14.598 INFO:tasks.workunit.client.1.smithi195.stdout:0/803: mkdir d4/d48/d4e/dfd 0 2024-04-06T12:23:14.599 INFO:tasks.workunit.client.1.smithi195.stdout:4/746: truncate d4/d6/d38/d1a/d40/d20/f6e 646483 0 2024-04-06T12:23:14.600 INFO:tasks.workunit.client.1.smithi195.stdout:7/701: mknod d4/d16/dd/d22/cdf 0 2024-04-06T12:23:14.601 INFO:tasks.workunit.client.1.smithi195.stdout:4/747: chown d4/f7e 3958 1 2024-04-06T12:23:14.601 INFO:tasks.workunit.client.1.smithi195.stdout:2/849: mkdir d2/d41/d84/d8d/d94/db6/d119 0 2024-04-06T12:23:14.601 INFO:tasks.workunit.client.1.smithi195.stdout:4/748: fdatasync d4/fe8 0 2024-04-06T12:23:14.603 INFO:tasks.workunit.client.1.smithi195.stdout:4/749: write d4/d6/d38/d1a/d40/f32 [4381082,39488] 0 2024-04-06T12:23:14.605 INFO:tasks.workunit.client.1.smithi195.stdout:9/790: rename d3/d10/d3b to d3/db9/dbc/d103 0 2024-04-06T12:23:14.608 INFO:tasks.workunit.client.1.smithi195.stdout:2/850: symlink d2/ddc/l11a 0 2024-04-06T12:23:14.609 INFO:tasks.workunit.client.1.smithi195.stdout:1/787: mknod d4/d14/d17/d24/d99/d88/dbf/c103 0 2024-04-06T12:23:14.612 INFO:tasks.workunit.client.1.smithi195.stdout:4/750: creat d4/d6/d38/d65/d7a/fe9 x:0 0 0 2024-04-06T12:23:14.613 INFO:tasks.workunit.client.1.smithi195.stdout:6/909: mkdir d8/d21/d2b/d46/d44/d86/d116/d161 0 2024-04-06T12:23:14.616 INFO:tasks.workunit.client.1.smithi195.stdout:3/862: rename d4/d9/d37/ff2 to d4/d9/d2b/d77/d9a/def/f11e 0 2024-04-06T12:23:14.620 INFO:tasks.workunit.client.1.smithi195.stdout:1/788: symlink d4/d14/d17/d24/d99/d4e/d60/l104 0 2024-04-06T12:23:14.621 INFO:tasks.workunit.client.1.smithi195.stdout:6/910: dwrite d8/d21/d31/d26/dcf/de4/f10b [0,4194304] 0 2024-04-06T12:23:14.622 INFO:tasks.workunit.client.1.smithi195.stdout:1/789: write d4/d14/d17/d24/d99/f4c [2018355,123633] 0 2024-04-06T12:23:14.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/751: unlink d4/d6/d38/d1a/f24 0 2024-04-06T12:23:14.629 INFO:tasks.workunit.client.1.smithi195.stdout:2/851: rename d2/d21/d2c/d2d/d92/d95/f97 to d2/d21/d2c/d2d/f11b 0 2024-04-06T12:23:14.630 INFO:tasks.workunit.client.1.smithi195.stdout:5/867: mkdir d0/da/dd/d2e/d12d 0 2024-04-06T12:23:14.630 INFO:tasks.workunit.client.1.smithi195.stdout:2/852: fsync d2/f61 0 2024-04-06T12:23:14.631 INFO:tasks.workunit.client.1.smithi195.stdout:2/853: write d2/f65 [4434791,125997] 0 2024-04-06T12:23:14.631 INFO:tasks.workunit.client.1.smithi195.stdout:8/797: getdents d6/dd/d70/d24/d25/d49 0 2024-04-06T12:23:14.636 INFO:tasks.workunit.client.1.smithi195.stdout:4/752: mknod d4/d6/d38/d65/dc5/cea 0 2024-04-06T12:23:14.637 INFO:tasks.workunit.client.1.smithi195.stdout:7/702: getdents d4/d10/d18/d19 0 2024-04-06T12:23:14.640 INFO:tasks.workunit.client.1.smithi195.stdout:2/854: dwrite d2/d21/d69/d6b/fbf [0,4194304] 0 2024-04-06T12:23:14.645 INFO:tasks.workunit.client.1.smithi195.stdout:1/790: unlink d4/d14/d17/d3a/da8/da4/ce7 0 2024-04-06T12:23:14.647 INFO:tasks.workunit.client.1.smithi195.stdout:6/911: dread d8/f14 [0,4194304] 0 2024-04-06T12:23:14.648 INFO:tasks.workunit.client.1.smithi195.stdout:9/791: rename d3/d10/d7d/dd0/ld2 to d3/d10/d7d/dee/df1/l104 0 2024-04-06T12:23:14.649 INFO:tasks.workunit.client.1.smithi195.stdout:9/792: readlink d3/d10/d3a/d6b/lda 0 2024-04-06T12:23:14.650 INFO:tasks.workunit.client.1.smithi195.stdout:7/703: truncate d4/d16/f1b 1117488 0 2024-04-06T12:23:14.651 INFO:tasks.workunit.client.1.smithi195.stdout:7/704: write d4/d10/d18/d19/f50 [638158,7252] 0 2024-04-06T12:23:14.651 INFO:tasks.workunit.client.1.smithi195.stdout:5/868: creat d0/da/dd/d1c/d5a/d68/f12e x:0 0 0 2024-04-06T12:23:14.653 INFO:tasks.workunit.client.1.smithi195.stdout:7/705: write d4/d16/f2d [2279922,71529] 0 2024-04-06T12:23:14.653 INFO:tasks.workunit.client.1.smithi195.stdout:2/855: rmdir d2/d21/d69/d6b 39 2024-04-06T12:23:14.654 INFO:tasks.workunit.client.1.smithi195.stdout:2/856: write d2/d3f/d7d/f3d [1538038,18528] 0 2024-04-06T12:23:14.656 INFO:tasks.workunit.client.1.smithi195.stdout:1/791: symlink d4/d14/d17/d24/d2a/d5a/daa/l105 0 2024-04-06T12:23:14.657 INFO:tasks.workunit.client.1.smithi195.stdout:2/857: write d2/d21/d29/f3e [3651928,32491] 0 2024-04-06T12:23:14.659 INFO:tasks.workunit.client.1.smithi195.stdout:0/804: sync 2024-04-06T12:23:14.659 INFO:tasks.workunit.client.1.smithi195.stdout:2/858: stat d2/d21/d2c/d2d/d92/d95/ce5 0 2024-04-06T12:23:14.659 INFO:tasks.workunit.client.1.smithi195.stdout:7/706: dread d4/d16/f47 [4194304,4194304] 0 2024-04-06T12:23:14.659 INFO:tasks.workunit.client.1.smithi195.stdout:3/863: rename d4/d9/d37/f88 to d4/df/d39/d112/f11f 0 2024-04-06T12:23:14.660 INFO:tasks.workunit.client.1.smithi195.stdout:2/859: chown d2/d41/d5a/fff 89 1 2024-04-06T12:23:14.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/869: creat d0/da/d23/d38/d107/f12f x:0 0 0 2024-04-06T12:23:14.664 INFO:tasks.workunit.client.1.smithi195.stdout:5/870: chown d0/da/cb4 650 1 2024-04-06T12:23:14.665 INFO:tasks.workunit.client.1.smithi195.stdout:5/871: readlink d0/da/d13/d5e/l123 0 2024-04-06T12:23:14.670 INFO:tasks.workunit.client.1.smithi195.stdout:6/912: dread d8/d21/d2b/f43 [0,4194304] 0 2024-04-06T12:23:14.671 INFO:tasks.workunit.client.1.smithi195.stdout:4/753: creat d4/d6/d38/d1a/feb x:0 0 0 2024-04-06T12:23:14.674 INFO:tasks.workunit.client.1.smithi195.stdout:3/864: rmdir d4/de/dc8 39 2024-04-06T12:23:14.677 INFO:tasks.workunit.client.1.smithi195.stdout:9/793: mkdir d3/d10/d7d/d105 0 2024-04-06T12:23:14.678 INFO:tasks.workunit.client.1.smithi195.stdout:3/865: chown d4/d9/d2b/d87/db8/cd9 857267 1 2024-04-06T12:23:14.678 INFO:tasks.workunit.client.1.smithi195.stdout:2/860: creat d2/d21/d2c/f11c x:0 0 0 2024-04-06T12:23:14.680 INFO:tasks.workunit.client.1.smithi195.stdout:0/805: dwrite d4/d6/d58/da7/fec [4194304,4194304] 0 2024-04-06T12:23:14.682 INFO:tasks.workunit.client.1.smithi195.stdout:4/754: dwrite d4/d6/d38/d1a/d40/d57/d64/fcf [0,4194304] 0 2024-04-06T12:23:14.687 INFO:tasks.workunit.client.1.smithi195.stdout:6/913: creat d8/d21/d31/d26/dcf/f162 x:0 0 0 2024-04-06T12:23:14.688 INFO:tasks.workunit.client.1.smithi195.stdout:7/707: creat d4/d10/d12/da5/da3/fe0 x:0 0 0 2024-04-06T12:23:14.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/914: dwrite d8/d21/d31/d26/dcf/de4/f14e [0,4194304] 0 2024-04-06T12:23:14.698 INFO:tasks.workunit.client.1.smithi195.stdout:9/794: dread d3/d10/f35 [0,4194304] 0 2024-04-06T12:23:14.700 INFO:tasks.workunit.client.1.smithi195.stdout:2/861: dwrite d2/d14/f31 [0,4194304] 0 2024-04-06T12:23:14.703 INFO:tasks.workunit.client.1.smithi195.stdout:3/866: rename d4/d9/d2b/d3b/f76 to d4/d9/d2b/d77/d9a/f120 0 2024-04-06T12:23:14.704 INFO:tasks.workunit.client.1.smithi195.stdout:8/798: getdents d6/dd/d70/d24/d34/d67/da1/da2/dc6 0 2024-04-06T12:23:14.710 INFO:tasks.workunit.client.1.smithi195.stdout:5/872: link d0/da/f9f d0/da/f130 0 2024-04-06T12:23:14.712 INFO:tasks.workunit.client.1.smithi195.stdout:6/915: unlink d8/d21/d2b/d46/d13e/f14f 0 2024-04-06T12:23:14.714 INFO:tasks.workunit.client.1.smithi195.stdout:6/916: write d8/d21/d31/d26/dc8/f55 [3269106,130009] 0 2024-04-06T12:23:14.714 INFO:tasks.workunit.client.1.smithi195.stdout:0/806: truncate d4/d6/d1a/d73/fb9 1776578 0 2024-04-06T12:23:14.715 INFO:tasks.workunit.client.1.smithi195.stdout:1/792: write d4/d14/d17/d24/d99/d4e/d8f/f92 [1203573,4555] 0 2024-04-06T12:23:14.718 INFO:tasks.workunit.client.1.smithi195.stdout:8/799: symlink d6/dd/d70/l10e 0 2024-04-06T12:23:14.718 INFO:tasks.workunit.client.1.smithi195.stdout:6/917: dread d8/d21/d31/d6c/db6/f13d [0,4194304] 0 2024-04-06T12:23:14.720 INFO:tasks.workunit.client.1.smithi195.stdout:3/867: rename d4/d9/d2b/d3b/d5e/dfd to d4/d9/d37/db9/d121 0 2024-04-06T12:23:14.721 INFO:tasks.workunit.client.1.smithi195.stdout:8/800: dread d6/dd/d70/ffe [0,4194304] 0 2024-04-06T12:23:14.725 INFO:tasks.workunit.client.1.smithi195.stdout:9/795: mknod d3/d10/d7d/d105/c106 0 2024-04-06T12:23:14.728 INFO:tasks.workunit.client.1.smithi195.stdout:1/793: creat d4/d14/d17/d3a/f106 x:0 0 0 2024-04-06T12:23:14.731 INFO:tasks.workunit.client.1.smithi195.stdout:9/796: dwrite d3/db9/dbc/d103/d48/d9c/f68 [0,4194304] 0 2024-04-06T12:23:14.737 INFO:tasks.workunit.client.1.smithi195.stdout:2/862: creat d2/d21/d69/f11d x:0 0 0 2024-04-06T12:23:14.738 INFO:tasks.workunit.client.1.smithi195.stdout:0/807: symlink d4/d53/lfe 0 2024-04-06T12:23:14.741 INFO:tasks.workunit.client.1.smithi195.stdout:7/708: write d4/f7 [696192,57739] 0 2024-04-06T12:23:14.742 INFO:tasks.workunit.client.1.smithi195.stdout:4/755: fsync d4/d6/d38/d1a/d40/d57/d64/fcf 0 2024-04-06T12:23:14.749 INFO:tasks.workunit.client.1.smithi195.stdout:5/873: creat d0/da/d23/f131 x:0 0 0 2024-04-06T12:23:14.751 INFO:tasks.workunit.client.1.smithi195.stdout:0/808: mkdir d4/d48/d67/d75/de9/dff 0 2024-04-06T12:23:14.751 INFO:tasks.workunit.client.1.smithi195.stdout:2/863: dwrite d2/d21/d2c/ff8 [0,4194304] 0 2024-04-06T12:23:14.754 INFO:tasks.workunit.client.1.smithi195.stdout:1/794: unlink d4/d14/l21 0 2024-04-06T12:23:14.754 INFO:tasks.workunit.client.1.smithi195.stdout:4/756: dwrite d4/d3e/f8d [0,4194304] 0 2024-04-06T12:23:14.754 INFO:tasks.workunit.client.1.smithi195.stdout:0/809: write d4/d53/fc9 [4910227,70819] 0 2024-04-06T12:23:14.758 INFO:tasks.workunit.client.1.smithi195.stdout:6/918: creat d8/f163 x:0 0 0 2024-04-06T12:23:14.758 INFO:tasks.workunit.client.1.smithi195.stdout:7/709: dread d4/d10/f40 [0,4194304] 0 2024-04-06T12:23:14.759 INFO:tasks.workunit.client.1.smithi195.stdout:5/874: write d0/da/dd/d1c/d5a/d62/d64/fd6 [1548355,5852] 0 2024-04-06T12:23:14.759 INFO:tasks.workunit.client.1.smithi195.stdout:0/810: chown d4/d6/d2f/d49/cc0 1 1 2024-04-06T12:23:14.760 INFO:tasks.workunit.client.1.smithi195.stdout:4/757: read d4/d6/d38/d1a/d40/f41 [161668,54301] 0 2024-04-06T12:23:14.764 INFO:tasks.workunit.client.1.smithi195.stdout:4/758: write d4/fda [193939,115943] 0 2024-04-06T12:23:14.765 INFO:tasks.workunit.client.1.smithi195.stdout:5/875: write d0/da/dd/d1c/d5a/d62/fc9 [428435,35897] 0 2024-04-06T12:23:14.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/919: write d8/d21/d2b/d46/d44/f56 [1725446,58825] 0 2024-04-06T12:23:14.768 INFO:tasks.workunit.client.1.smithi195.stdout:9/797: getdents d3/d10/d7d 0 2024-04-06T12:23:14.770 INFO:tasks.workunit.client.1.smithi195.stdout:1/795: dread d4/d14/d17/d24/f43 [0,4194304] 0 2024-04-06T12:23:14.774 INFO:tasks.workunit.client.1.smithi195.stdout:8/801: dwrite d6/dd/d70/d24/d34/d67/da1/da2/f102 [0,4194304] 0 2024-04-06T12:23:14.774 INFO:tasks.workunit.client.1.smithi195.stdout:4/759: mkdir d4/d6d/da6/dae/dec 0 2024-04-06T12:23:14.775 INFO:tasks.workunit.client.1.smithi195.stdout:7/710: link d4/d10/d18/d19/c31 d4/d16/dd/d22/d3f/ce1 0 2024-04-06T12:23:14.779 INFO:tasks.workunit.client.1.smithi195.stdout:9/798: mknod d3/db9/dd8/c107 0 2024-04-06T12:23:14.782 INFO:tasks.workunit.client.1.smithi195.stdout:3/868: dwrite d4/df/d39/f9c [0,4194304] 0 2024-04-06T12:23:14.789 INFO:tasks.workunit.client.1.smithi195.stdout:2/864: dwrite d2/d3f/d7d/d7a/f81 [0,4194304] 0 2024-04-06T12:23:14.790 INFO:tasks.workunit.client.1.smithi195.stdout:2/865: write d2/d41/fea [472766,73974] 0 2024-04-06T12:23:14.793 INFO:tasks.workunit.client.1.smithi195.stdout:2/866: dread - d2/d3f/d7d/d7a/f117 zero size 2024-04-06T12:23:14.795 INFO:tasks.workunit.client.1.smithi195.stdout:2/867: read - d2/d21/fc6 zero size 2024-04-06T12:23:14.799 INFO:tasks.workunit.client.1.smithi195.stdout:5/876: creat d0/da/dd/d2e/d6f/f132 x:0 0 0 2024-04-06T12:23:14.800 INFO:tasks.workunit.client.1.smithi195.stdout:4/760: mkdir d4/d6/d38/d1a/d40/ded 0 2024-04-06T12:23:14.803 INFO:tasks.workunit.client.1.smithi195.stdout:4/761: chown d4/l92 465838373 1 2024-04-06T12:23:14.804 INFO:tasks.workunit.client.1.smithi195.stdout:9/799: rename d3/db9/dd8/c107 to d3/db9/c108 0 2024-04-06T12:23:14.812 INFO:tasks.workunit.client.1.smithi195.stdout:1/796: dwrite d4/d14/d17/d24/d99/f20 [0,4194304] 0 2024-04-06T12:23:14.814 INFO:tasks.workunit.client.1.smithi195.stdout:6/920: dwrite d8/d21/d31/d6c/d7b/d11b/daf/ff6 [0,4194304] 0 2024-04-06T12:23:14.814 INFO:tasks.workunit.client.1.smithi195.stdout:0/811: dread d4/d6/f42 [0,4194304] 0 2024-04-06T12:23:14.817 INFO:tasks.workunit.client.1.smithi195.stdout:7/711: dwrite d4/d16/dd/d22/d3f/d54/f90 [0,4194304] 0 2024-04-06T12:23:14.819 INFO:tasks.workunit.client.1.smithi195.stdout:7/712: stat d4/d10/l15 0 2024-04-06T12:23:14.819 INFO:tasks.workunit.client.1.smithi195.stdout:5/877: dwrite d0/da/dd/fe0 [0,4194304] 0 2024-04-06T12:23:14.920 INFO:tasks.workunit.client.1.smithi195.stdout:8/802: link d6/dd/d70/d24/d53/f10c d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/f10f 0 2024-04-06T12:23:14.926 INFO:tasks.workunit.client.1.smithi195.stdout:9/800: creat d3/db9/dbc/d103/d48/d9c/f109 x:0 0 0 2024-04-06T12:23:14.928 INFO:tasks.workunit.client.1.smithi195.stdout:9/801: chown d3/db9/dbc/d103/d48/d9c/f109 6625155 1 2024-04-06T12:23:14.929 INFO:tasks.workunit.client.1.smithi195.stdout:2/868: dwrite d2/d21/d2c/d2d/f5c [0,4194304] 0 2024-04-06T12:23:14.929 INFO:tasks.workunit.client.1.smithi195.stdout:2/869: dread - d2/d21/d2c/f11c zero size 2024-04-06T12:23:14.936 INFO:tasks.workunit.client.1.smithi195.stdout:9/802: dread d3/d10/d3a/d5d/fc9 [0,4194304] 0 2024-04-06T12:23:14.937 INFO:tasks.workunit.client.1.smithi195.stdout:9/803: stat d3/db9/dbc/d103/f81 0 2024-04-06T12:23:14.938 INFO:tasks.workunit.client.1.smithi195.stdout:9/804: readlink d3/d10/d3a/lec 0 2024-04-06T12:23:14.943 INFO:tasks.workunit.client.1.smithi195.stdout:9/805: dwrite d3/db9/dbc/d103/d48/f6f [0,4194304] 0 2024-04-06T12:23:14.949 INFO:tasks.workunit.client.1.smithi195.stdout:6/921: truncate d8/d3d/f68 1074166 0 2024-04-06T12:23:14.949 INFO:tasks.workunit.client.1.smithi195.stdout:6/922: fdatasync d8/d3d/d5e/f8f 0 2024-04-06T12:23:14.951 INFO:tasks.workunit.client.1.smithi195.stdout:5/878: mknod d0/d35/c133 0 2024-04-06T12:23:14.952 INFO:tasks.workunit.client.1.smithi195.stdout:3/869: getdents d4/d9/d37/db9/d108 0 2024-04-06T12:23:14.953 INFO:tasks.workunit.client.1.smithi195.stdout:4/762: creat d4/d6d/da6/dae/dec/fee x:0 0 0 2024-04-06T12:23:14.954 INFO:tasks.workunit.client.1.smithi195.stdout:0/812: write d4/f64 [1187105,71973] 0 2024-04-06T12:23:14.956 INFO:tasks.workunit.client.1.smithi195.stdout:7/713: dread d4/d16/dd/d22/d3f/faa [0,4194304] 0 2024-04-06T12:23:14.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/870: chown d2/d21/d5e/d64/cf3 183 1 2024-04-06T12:23:14.957 INFO:tasks.workunit.client.1.smithi195.stdout:1/797: readlink d4/d14/d17/d24/d99/d88/dec/ld2 0 2024-04-06T12:23:14.957 INFO:tasks.workunit.client.1.smithi195.stdout:9/806: chown d3/ld1 687829175 1 2024-04-06T12:23:14.959 INFO:tasks.workunit.client.1.smithi195.stdout:0/813: truncate d4/d6/d1a/d73/f92 1400621 0 2024-04-06T12:23:14.959 INFO:tasks.workunit.client.1.smithi195.stdout:8/803: unlink d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/l6b 0 2024-04-06T12:23:14.961 INFO:tasks.workunit.client.1.smithi195.stdout:3/870: rmdir d4/d9/d2b/d77/d9a/def 39 2024-04-06T12:23:14.961 INFO:tasks.workunit.client.1.smithi195.stdout:8/804: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/f26 [378991,19203] 0 2024-04-06T12:23:14.962 INFO:tasks.workunit.client.1.smithi195.stdout:8/805: dread - d6/dd/d70/d24/d25/d7c/ff7 zero size 2024-04-06T12:23:14.964 INFO:tasks.workunit.client.1.smithi195.stdout:5/879: mknod d0/da/dd/d1c/d5a/d62/d64/d9b/c134 0 2024-04-06T12:23:14.965 INFO:tasks.workunit.client.1.smithi195.stdout:5/880: write d0/da/f3c [987412,38007] 0 2024-04-06T12:23:14.966 INFO:tasks.workunit.client.1.smithi195.stdout:4/763: creat d4/d6/d38/d1a/d40/ded/fef x:0 0 0 2024-04-06T12:23:14.969 INFO:tasks.workunit.client.1.smithi195.stdout:6/923: rename d8/d21/d2b/d46/d44/d86/c8d to d8/c164 0 2024-04-06T12:23:14.970 INFO:tasks.workunit.client.1.smithi195.stdout:1/798: symlink d4/d14/d17/d24/d99/d4e/l107 0 2024-04-06T12:23:14.974 INFO:tasks.workunit.client.1.smithi195.stdout:8/806: mkdir d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/dda/d110 0 2024-04-06T12:23:14.975 INFO:tasks.workunit.client.1.smithi195.stdout:6/924: dwrite d8/d3d/dc1/f149 [0,4194304] 0 2024-04-06T12:23:14.976 INFO:tasks.workunit.client.1.smithi195.stdout:8/807: fsync d6/dd/d70/d24/d25/f78 0 2024-04-06T12:23:14.976 INFO:tasks.workunit.client.1.smithi195.stdout:5/881: symlink d0/da/dd/d1c/d5a/d62/d64/d67/l135 0 2024-04-06T12:23:14.977 INFO:tasks.workunit.client.1.smithi195.stdout:2/871: write d2/d21/d69/f62 [652157,38501] 0 2024-04-06T12:23:14.978 INFO:tasks.workunit.client.1.smithi195.stdout:8/808: stat d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/dcb 0 2024-04-06T12:23:14.979 INFO:tasks.workunit.client.1.smithi195.stdout:8/809: chown d6/dd/d70/d24/d34/d67/dec/l5f 1972 1 2024-04-06T12:23:14.981 INFO:tasks.workunit.client.1.smithi195.stdout:8/810: write d6/dd/d70/d24/d34/d67/f76 [768335,58555] 0 2024-04-06T12:23:14.981 INFO:tasks.workunit.client.1.smithi195.stdout:7/714: rename d4/d10/d12/d6f/lad to d4/d16/dd/d22/d3f/le2 0 2024-04-06T12:23:14.981 INFO:tasks.workunit.client.1.smithi195.stdout:9/807: write d3/db9/dbc/d103/d48/d9c/f91 [147028,87477] 0 2024-04-06T12:23:14.984 INFO:tasks.workunit.client.1.smithi195.stdout:3/871: creat d4/de/d8e/dbb/f122 x:0 0 0 2024-04-06T12:23:14.984 INFO:tasks.workunit.client.1.smithi195.stdout:3/872: chown d4/de/d8e 12540888 1 2024-04-06T12:23:14.988 INFO:tasks.workunit.client.1.smithi195.stdout:4/764: link d4/d6/d38/d1a/fd7 d4/d6d/da6/dae/dec/ff0 0 2024-04-06T12:23:14.990 INFO:tasks.workunit.client.1.smithi195.stdout:0/814: rename d4/d48/c5e to d4/d48/d77/c100 0 2024-04-06T12:23:14.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/715: symlink d4/d10/d12/da5/da3/le3 0 2024-04-06T12:23:14.993 INFO:tasks.workunit.client.1.smithi195.stdout:8/811: creat d6/dd/d70/d24/d34/d67/da1/da2/f111 x:0 0 0 2024-04-06T12:23:14.994 INFO:tasks.workunit.client.1.smithi195.stdout:8/812: chown d6 88 1 2024-04-06T12:23:14.997 INFO:tasks.workunit.client.1.smithi195.stdout:4/765: fsync d4/d6/d38/d1a/d40/d57/fe4 0 2024-04-06T12:23:15.000 INFO:tasks.workunit.client.1.smithi195.stdout:5/882: write d0/da/f9f [1156196,10608] 0 2024-04-06T12:23:15.003 INFO:tasks.workunit.client.1.smithi195.stdout:7/716: rename d4/d16/dd/d22/d3f/d54/cd3 to d4/d16/dd/d22/d3f/d54/ce4 0 2024-04-06T12:23:15.003 INFO:tasks.workunit.client.1.smithi195.stdout:2/872: creat d2/d21/d69/f11e x:0 0 0 2024-04-06T12:23:15.004 INFO:tasks.workunit.client.1.smithi195.stdout:7/717: write d4/d10/d18/d57/fd6 [577135,18021] 0 2024-04-06T12:23:15.005 INFO:tasks.workunit.client.1.smithi195.stdout:1/799: getdents d4/d14/d17/d3a/da8/da4/db2 0 2024-04-06T12:23:15.005 INFO:tasks.workunit.client.1.smithi195.stdout:9/808: write d3/d10/d3a/f8f [872088,35570] 0 2024-04-06T12:23:15.006 INFO:tasks.workunit.client.1.smithi195.stdout:7/718: stat d4/d10/lba 0 2024-04-06T12:23:15.007 INFO:tasks.workunit.client.1.smithi195.stdout:0/815: dread d4/d48/d67/d83/fab [0,4194304] 0 2024-04-06T12:23:15.008 INFO:tasks.workunit.client.1.smithi195.stdout:6/925: rename d8/d3d/d5e/d72/d10c/cba to d8/d21/d31/d26/dcf/c165 0 2024-04-06T12:23:15.009 INFO:tasks.workunit.client.1.smithi195.stdout:9/809: chown d3/d10/d3a/d5d/fc9 906 1 2024-04-06T12:23:15.009 INFO:tasks.workunit.client.1.smithi195.stdout:5/883: unlink d0/da/dd/d2e/c80 0 2024-04-06T12:23:15.011 INFO:tasks.workunit.client.1.smithi195.stdout:4/766: fdatasync d4/f2e 0 2024-04-06T12:23:15.012 INFO:tasks.workunit.client.1.smithi195.stdout:2/873: creat d2/d21/d2c/d2d/d92/d95/d9b/dd9/f11f x:0 0 0 2024-04-06T12:23:15.014 INFO:tasks.workunit.client.1.smithi195.stdout:1/800: dwrite d4/d14/d17/d3a/f76 [0,4194304] 0 2024-04-06T12:23:15.016 INFO:tasks.workunit.client.1.smithi195.stdout:1/801: truncate d4/d14/d17/d24/d99/f5f 4937820 0 2024-04-06T12:23:15.017 INFO:tasks.workunit.client.1.smithi195.stdout:9/810: creat d3/d10/d3a/f10a x:0 0 0 2024-04-06T12:23:15.020 INFO:tasks.workunit.client.1.smithi195.stdout:7/719: mknod d4/d10/dd2/ce5 0 2024-04-06T12:23:15.022 INFO:tasks.workunit.client.1.smithi195.stdout:2/874: unlink d2/d41/d5a/ddd/fe2 0 2024-04-06T12:23:15.022 INFO:tasks.workunit.client.1.smithi195.stdout:7/720: chown d4/d16/dd/d22/cdf 2265234 1 2024-04-06T12:23:15.024 INFO:tasks.workunit.client.1.smithi195.stdout:1/802: dwrite d4/f26 [0,4194304] 0 2024-04-06T12:23:15.025 INFO:tasks.workunit.client.1.smithi195.stdout:4/767: mkdir d4/d6/d38/d65/dc5/df1 0 2024-04-06T12:23:15.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:13.575686+0000 mgr.smithi195.ausetj (mgr.24375) 57 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 164 MiB/s wr, 296 op/s 2024-04-06T12:23:15.026 INFO:tasks.workunit.client.1.smithi195.stdout:9/811: symlink d3/db9/dbc/d103/d50/l10b 0 2024-04-06T12:23:15.028 INFO:tasks.workunit.client.1.smithi195.stdout:6/926: creat d8/d3d/d5e/d72/d10c/d9c/dce/f166 x:0 0 0 2024-04-06T12:23:15.030 INFO:tasks.workunit.client.1.smithi195.stdout:2/875: rename d2/c71 to d2/d21/d29/c120 0 2024-04-06T12:23:15.032 INFO:tasks.workunit.client.1.smithi195.stdout:0/816: dwrite d4/d41/f69 [0,4194304] 0 2024-04-06T12:23:15.035 INFO:tasks.workunit.client.1.smithi195.stdout:0/817: fdatasync d4/d6/f6b 0 2024-04-06T12:23:15.038 INFO:tasks.workunit.client.1.smithi195.stdout:1/803: rename d4/d14/d17/d3a/da8/da4/db2/c40 to d4/d14/d17/d24/d99/d4e/de5/c108 0 2024-04-06T12:23:15.046 INFO:tasks.workunit.client.1.smithi195.stdout:4/768: dwrite d4/d3e/f78 [4194304,4194304] 0 2024-04-06T12:23:15.046 INFO:tasks.workunit.client.1.smithi195.stdout:2/876: creat d2/d41/d84/db2/f121 x:0 0 0 2024-04-06T12:23:15.047 INFO:tasks.workunit.client.1.smithi195.stdout:7/721: getdents d4/d16/d6b 0 2024-04-06T12:23:15.047 INFO:tasks.workunit.client.1.smithi195.stdout:6/927: chown d8/d21/d31/d6c/d7b/c143 24311 1 2024-04-06T12:23:15.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:13.575686+0000 mgr.smithi195.ausetj (mgr.24375) 57 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 164 MiB/s wr, 296 op/s 2024-04-06T12:23:15.049 INFO:tasks.workunit.client.1.smithi195.stdout:7/722: write d4/fcf [1007681,42794] 0 2024-04-06T12:23:15.049 INFO:tasks.workunit.client.1.smithi195.stdout:2/877: write d2/d21/d29/f3e [4082503,106677] 0 2024-04-06T12:23:15.051 INFO:tasks.workunit.client.1.smithi195.stdout:6/928: chown d8/d3d/d5e/d72/d10c/f12c 503 1 2024-04-06T12:23:15.052 INFO:tasks.workunit.client.1.smithi195.stdout:7/723: chown d4/d16/dd/d22/d3f/d54/da9 15591 1 2024-04-06T12:23:15.053 INFO:tasks.workunit.client.1.smithi195.stdout:7/724: write d4/d16/dd/d22/d76/f8f [125691,130541] 0 2024-04-06T12:23:15.055 INFO:tasks.workunit.client.1.smithi195.stdout:0/818: mkdir d4/d48/d4e/dfd/d101 0 2024-04-06T12:23:15.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/878: creat d2/d21/d2c/dc9/f122 x:0 0 0 2024-04-06T12:23:15.056 INFO:tasks.workunit.client.1.smithi195.stdout:0/819: stat d4/d48/d67/d83/cb8 0 2024-04-06T12:23:15.057 INFO:tasks.workunit.client.1.smithi195.stdout:0/820: readlink d4/d6/d58/da7/lde 0 2024-04-06T12:23:15.058 INFO:tasks.workunit.client.1.smithi195.stdout:7/725: unlink d4/d10/d18/l45 0 2024-04-06T12:23:15.060 INFO:tasks.workunit.client.1.smithi195.stdout:6/929: symlink d8/d21/l167 0 2024-04-06T12:23:15.062 INFO:tasks.workunit.client.1.smithi195.stdout:9/812: dread d3/de/f21 [0,4194304] 0 2024-04-06T12:23:15.062 INFO:tasks.workunit.client.1.smithi195.stdout:0/821: unlink d4/d6/d2f/cf8 0 2024-04-06T12:23:15.064 INFO:tasks.workunit.client.1.smithi195.stdout:6/930: mkdir d8/d21/d2b/d46/d168 0 2024-04-06T12:23:15.066 INFO:tasks.workunit.client.1.smithi195.stdout:4/769: rename d4/d6/d38/c48 to d4/d6d/cf2 0 2024-04-06T12:23:15.079 INFO:tasks.workunit.client.1.smithi195.stdout:0/822: dread d4/f32 [0,4194304] 0 2024-04-06T12:23:15.081 INFO:tasks.workunit.client.1.smithi195.stdout:9/813: dread d3/db9/dbc/d103/d48/fc7 [0,4194304] 0 2024-04-06T12:23:15.082 INFO:tasks.workunit.client.1.smithi195.stdout:0/823: creat d4/d6/d1a/d9f/f102 x:0 0 0 2024-04-06T12:23:15.082 INFO:tasks.workunit.client.1.smithi195.stdout:9/814: chown d3/d10/d7d/dd0 80148108 1 2024-04-06T12:23:15.084 INFO:tasks.workunit.client.1.smithi195.stdout:6/931: dread d8/d3d/d5e/d72/d10c/d32/f3a [0,4194304] 0 2024-04-06T12:23:15.089 INFO:tasks.workunit.client.1.smithi195.stdout:6/932: link d8/d21/d2b/d46/d44/df7/f156 d8/d21/d31/d26/dcf/de4/f169 0 2024-04-06T12:23:15.092 INFO:tasks.workunit.client.1.smithi195.stdout:6/933: mkdir d8/d21/d31/d26/d13f/d15a/d16a 0 2024-04-06T12:23:15.092 INFO:tasks.workunit.client.1.smithi195.stdout:6/934: readlink d8/d21/d31/d49/dd8/ldf 0 2024-04-06T12:23:15.094 INFO:tasks.workunit.client.1.smithi195.stdout:6/935: read d8/d3d/d5e/ffa [4033862,25185] 0 2024-04-06T12:23:15.099 INFO:tasks.workunit.client.1.smithi195.stdout:2/879: truncate d2/d21/d69/d6b/fbf 347775 0 2024-04-06T12:23:15.100 INFO:tasks.workunit.client.1.smithi195.stdout:9/815: write d3/f43 [3635572,108082] 0 2024-04-06T12:23:15.103 INFO:tasks.workunit.client.1.smithi195.stdout:4/770: rename d4/d6/d38/d1a/d40/d20/d23/f82 to d4/ff3 0 2024-04-06T12:23:15.104 INFO:tasks.workunit.client.1.smithi195.stdout:1/804: dwrite d4/d14/d17/d3a/da8/da4/db2/d28/fb1 [0,4194304] 0 2024-04-06T12:23:15.104 INFO:tasks.workunit.client.1.smithi195.stdout:9/816: rename d3/db9/dd8 to d3/db9/dd8/d10c 22 2024-04-06T12:23:15.106 INFO:tasks.workunit.client.1.smithi195.stdout:0/824: dwrite d4/d48/d67/d75/f78 [0,4194304] 0 2024-04-06T12:23:15.107 INFO:tasks.workunit.client.1.smithi195.stdout:6/936: getdents d8/d21/d31/d26/dcf/de4 0 2024-04-06T12:23:15.112 INFO:tasks.workunit.client.1.smithi195.stdout:2/880: dwrite d2/d3f/d7d/fa0 [0,4194304] 0 2024-04-06T12:23:15.118 INFO:tasks.workunit.client.1.smithi195.stdout:6/937: rename d8/d21/d31/c11a to d8/d21/d31/d49/dd8/d13a/c16b 0 2024-04-06T12:23:15.124 INFO:tasks.workunit.client.1.smithi195.stdout:1/805: unlink d4/d14/d17/d3a/da8/da4/db2/d5d/fa3 0 2024-04-06T12:23:15.127 INFO:tasks.workunit.client.1.smithi195.stdout:9/817: rmdir d3/d10/d3a/d6b/dc2 0 2024-04-06T12:23:15.128 INFO:tasks.workunit.client.1.smithi195.stdout:4/771: getdents d4/d6 0 2024-04-06T12:23:15.129 INFO:tasks.workunit.client.1.smithi195.stdout:2/881: unlink d2/d21/d2c/dc9/l107 0 2024-04-06T12:23:15.132 INFO:tasks.workunit.client.1.smithi195.stdout:4/772: truncate d4/d8c/fc0 274488 0 2024-04-06T12:23:15.132 INFO:tasks.workunit.client.1.smithi195.stdout:0/825: dwrite d4/d41/f99 [0,4194304] 0 2024-04-06T12:23:15.133 INFO:tasks.workunit.client.1.smithi195.stdout:6/938: link d8/d3d/d5e/d72/d10c/cc6 d8/d3d/d5e/de0/c16c 0 2024-04-06T12:23:15.135 INFO:tasks.workunit.client.1.smithi195.stdout:9/818: rename d3/de/fe0 to d3/db9/f10d 0 2024-04-06T12:23:15.136 INFO:tasks.workunit.client.1.smithi195.stdout:0/826: mknod d4/dbc/dce/c103 0 2024-04-06T12:23:15.136 INFO:tasks.workunit.client.1.smithi195.stdout:3/873: sync 2024-04-06T12:23:15.137 INFO:tasks.workunit.client.1.smithi195.stdout:0/827: stat d4/d6/d2f/ca0 0 2024-04-06T12:23:15.139 INFO:tasks.workunit.client.1.smithi195.stdout:2/882: getdents d2/d41 0 2024-04-06T12:23:15.140 INFO:tasks.workunit.client.1.smithi195.stdout:0/828: stat d4/d48/c98 0 2024-04-06T12:23:15.140 INFO:tasks.workunit.client.1.smithi195.stdout:4/773: creat d4/d6/d38/d65/d7a/ff4 x:0 0 0 2024-04-06T12:23:15.141 INFO:tasks.workunit.client.1.smithi195.stdout:1/806: dread d4/d14/d17/d24/d99/d4e/d60/f7a [0,4194304] 0 2024-04-06T12:23:15.149 INFO:tasks.workunit.client.1.smithi195.stdout:6/939: dwrite d8/d3d/d5e/d72/d10c/f39 [0,4194304] 0 2024-04-06T12:23:15.149 INFO:tasks.workunit.client.1.smithi195.stdout:0/829: mknod d4/d48/d67/c104 0 2024-04-06T12:23:15.157 INFO:tasks.workunit.client.1.smithi195.stdout:6/940: read d8/d3d/d5e/d72/d10c/f39 [478561,65585] 0 2024-04-06T12:23:15.158 INFO:tasks.workunit.client.1.smithi195.stdout:2/883: dwrite d2/d3f/d7d/fa0 [0,4194304] 0 2024-04-06T12:23:15.158 INFO:tasks.workunit.client.1.smithi195.stdout:9/819: link d3/l25 d3/l10e 0 2024-04-06T12:23:15.158 INFO:tasks.workunit.client.1.smithi195.stdout:3/874: dwrite d4/df/d39/d112/f11f [0,4194304] 0 2024-04-06T12:23:15.162 INFO:tasks.workunit.client.1.smithi195.stdout:9/820: rmdir d3/d10/d3a/d6b 39 2024-04-06T12:23:15.163 INFO:tasks.workunit.client.1.smithi195.stdout:3/875: symlink d4/df/d39/d112/l123 0 2024-04-06T12:23:15.165 INFO:tasks.workunit.client.1.smithi195.stdout:6/941: symlink d8/d3d/dc1/l16d 0 2024-04-06T12:23:15.169 INFO:tasks.workunit.client.1.smithi195.stdout:6/942: write d8/d21/d31/d6c/db6/f128 [352286,124606] 0 2024-04-06T12:23:15.171 INFO:tasks.workunit.client.1.smithi195.stdout:3/876: creat d4/d9/d2b/d77/d9a/def/f124 x:0 0 0 2024-04-06T12:23:15.174 INFO:tasks.workunit.client.1.smithi195.stdout:1/807: dread d4/d14/d17/dc1/fc6 [4194304,4194304] 0 2024-04-06T12:23:15.174 INFO:tasks.workunit.client.1.smithi195.stdout:0/830: write d4/d6/d2f/f8a [689420,103398] 0 2024-04-06T12:23:15.175 INFO:tasks.workunit.client.1.smithi195.stdout:9/821: dwrite d3/d10/f46 [4194304,4194304] 0 2024-04-06T12:23:15.178 INFO:tasks.workunit.client.1.smithi195.stdout:1/808: read d4/d14/d17/dc1/fdc [216145,38910] 0 2024-04-06T12:23:15.183 INFO:tasks.workunit.client.1.smithi195.stdout:0/831: creat d4/d53/d81/da9/f105 x:0 0 0 2024-04-06T12:23:15.185 INFO:tasks.workunit.client.1.smithi195.stdout:4/774: dread d4/f79 [0,4194304] 0 2024-04-06T12:23:15.185 INFO:tasks.workunit.client.1.smithi195.stdout:3/877: getdents d4/d9/d2b/d3b/d40/de2 0 2024-04-06T12:23:15.186 INFO:tasks.workunit.client.1.smithi195.stdout:0/832: mknod d4/dd5/c106 0 2024-04-06T12:23:15.188 INFO:tasks.workunit.client.1.smithi195.stdout:0/833: creat d4/d53/d81/f107 x:0 0 0 2024-04-06T12:23:15.189 INFO:tasks.workunit.client.1.smithi195.stdout:1/809: link d4/d14/d17/d24/d99/f1d d4/d14/d17/d24/d2a/f109 0 2024-04-06T12:23:15.190 INFO:tasks.workunit.client.1.smithi195.stdout:0/834: dread - d4/d6/d1a/ffb zero size 2024-04-06T12:23:15.190 INFO:tasks.workunit.client.1.smithi195.stdout:6/943: dread d8/d21/d31/d49/dd8/f132 [0,4194304] 0 2024-04-06T12:23:15.192 INFO:tasks.workunit.client.1.smithi195.stdout:4/775: link d4/d6/d38/d65/f84 d4/d6d/d85/ff5 0 2024-04-06T12:23:15.193 INFO:tasks.workunit.client.1.smithi195.stdout:3/878: link d4/d9/d2b/d77/fba d4/de/d8e/d92/d9e/de4/f125 0 2024-04-06T12:23:15.195 INFO:tasks.workunit.client.1.smithi195.stdout:0/835: mknod d4/d48/d67/d83/c108 0 2024-04-06T12:23:15.195 INFO:tasks.workunit.client.1.smithi195.stdout:6/944: getdents d8/d21/d31/d157 0 2024-04-06T12:23:15.196 INFO:tasks.workunit.client.1.smithi195.stdout:4/776: mknod d4/d6/d38/d1a/d40/d20/cf6 0 2024-04-06T12:23:15.196 INFO:tasks.workunit.client.1.smithi195.stdout:6/945: fsync d8/d3d/d5e/de0/f151 0 2024-04-06T12:23:15.198 INFO:tasks.workunit.client.1.smithi195.stdout:3/879: fsync d4/de/dc8/f103 0 2024-04-06T12:23:15.201 INFO:tasks.workunit.client.1.smithi195.stdout:2/884: dread d2/d3f/f42 [0,4194304] 0 2024-04-06T12:23:15.201 INFO:tasks.workunit.client.1.smithi195.stdout:0/836: dread d4/d53/d81/f88 [0,4194304] 0 2024-04-06T12:23:15.202 INFO:tasks.workunit.client.1.smithi195.stdout:1/810: rename d4/d14/d17/d24/d99/d88/dfe to d4/d14/d17/d24/d2a/d10a 0 2024-04-06T12:23:15.203 INFO:tasks.workunit.client.1.smithi195.stdout:1/811: chown d4/d14/d17/d24/d2a 79153 1 2024-04-06T12:23:15.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/880: creat d4/d9/d2b/d3b/d5e/dab/f126 x:0 0 0 2024-04-06T12:23:15.208 INFO:tasks.workunit.client.1.smithi195.stdout:0/837: creat d4/d6/f109 x:0 0 0 2024-04-06T12:23:15.209 INFO:tasks.workunit.client.1.smithi195.stdout:1/812: mknod d4/d14/d17/d3a/c10b 0 2024-04-06T12:23:15.209 INFO:tasks.workunit.client.1.smithi195.stdout:9/822: dread d3/de/f1c [0,4194304] 0 2024-04-06T12:23:15.210 INFO:tasks.workunit.client.1.smithi195.stdout:4/777: dwrite d4/d6/d38/f3f [0,4194304] 0 2024-04-06T12:23:15.211 INFO:tasks.workunit.client.1.smithi195.stdout:0/838: mknod d4/c10a 0 2024-04-06T12:23:15.212 INFO:tasks.workunit.client.1.smithi195.stdout:6/946: write d8/d21/d2b/fc9 [583362,11930] 0 2024-04-06T12:23:15.213 INFO:tasks.workunit.client.1.smithi195.stdout:3/881: fdatasync d4/de/f34 0 2024-04-06T12:23:15.215 INFO:tasks.workunit.client.1.smithi195.stdout:9/823: creat d3/db9/dbc/f10f x:0 0 0 2024-04-06T12:23:15.216 INFO:tasks.workunit.client.1.smithi195.stdout:4/778: dread d4/d6/d38/d1a/d40/d57/d64/f7d [0,4194304] 0 2024-04-06T12:23:15.217 INFO:tasks.workunit.client.1.smithi195.stdout:4/779: stat d4/d3e/f8d 0 2024-04-06T12:23:15.218 INFO:tasks.workunit.client.1.smithi195.stdout:4/780: fdatasync d4/d6/fab 0 2024-04-06T12:23:15.219 INFO:tasks.workunit.client.1.smithi195.stdout:0/839: creat d4/d48/d77/f10b x:0 0 0 2024-04-06T12:23:15.222 INFO:tasks.workunit.client.1.smithi195.stdout:1/813: truncate d4/d14/d17/d24/d99/d4e/d60/f7a 4112515 0 2024-04-06T12:23:15.228 INFO:tasks.workunit.client.1.smithi195.stdout:2/885: dwrite d2/d21/d29/f4a [0,4194304] 0 2024-04-06T12:23:15.229 INFO:tasks.workunit.client.1.smithi195.stdout:9/824: mkdir d3/d10/d7d/d105/d110 0 2024-04-06T12:23:15.230 INFO:tasks.workunit.client.1.smithi195.stdout:4/781: dwrite d4/d3e/f8d [0,4194304] 0 2024-04-06T12:23:15.230 INFO:tasks.workunit.client.1.smithi195.stdout:0/840: rmdir d4/d48/d77/d97 39 2024-04-06T12:23:15.233 INFO:tasks.workunit.client.1.smithi195.stdout:6/947: write d8/d8e/fa6 [181516,128840] 0 2024-04-06T12:23:15.233 INFO:tasks.workunit.client.1.smithi195.stdout:2/886: rename d2/ddc/dfd to d2/d41/d84/d8d/d94/db6/d123 0 2024-04-06T12:23:15.234 INFO:tasks.workunit.client.1.smithi195.stdout:6/948: readlink d8/l148 0 2024-04-06T12:23:15.234 INFO:tasks.workunit.client.1.smithi195.stdout:9/825: rmdir d3/db9/dbc/d103 39 2024-04-06T12:23:15.236 INFO:tasks.workunit.client.1.smithi195.stdout:4/782: mkdir d4/d8c/d96/dc6/df7 0 2024-04-06T12:23:15.238 INFO:tasks.workunit.client.1.smithi195.stdout:0/841: mkdir d4/dbc/de2/d10c 0 2024-04-06T12:23:15.238 INFO:tasks.workunit.client.1.smithi195.stdout:4/783: truncate d4/fda 970217 0 2024-04-06T12:23:15.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/882: dwrite d4/de/d8e/d92/d9e/de4/f125 [0,4194304] 0 2024-04-06T12:23:15.240 INFO:tasks.workunit.client.1.smithi195.stdout:2/887: mkdir d2/d21/d2c/d2d/d92/d95/d124 0 2024-04-06T12:23:15.243 INFO:tasks.workunit.client.1.smithi195.stdout:3/883: mkdir d4/d9/d37/db9/d121/d127 0 2024-04-06T12:23:15.243 INFO:tasks.workunit.client.1.smithi195.stdout:2/888: mknod d2/d3f/d7d/d7a/c125 0 2024-04-06T12:23:15.245 INFO:tasks.workunit.client.1.smithi195.stdout:2/889: write d2/f4 [4897348,93022] 0 2024-04-06T12:23:15.248 INFO:tasks.workunit.client.1.smithi195.stdout:4/784: dwrite d4/d6/d38/d1a/d40/d20/f8a [0,4194304] 0 2024-04-06T12:23:15.248 INFO:tasks.workunit.client.1.smithi195.stdout:9/826: rename d3/de to d3/db9/dbc/d103/d111 0 2024-04-06T12:23:15.250 INFO:tasks.workunit.client.1.smithi195.stdout:9/827: write d3/db9/dbc/d103/d50/f86 [1527412,103679] 0 2024-04-06T12:23:15.252 INFO:tasks.workunit.client.1.smithi195.stdout:3/884: rename d4/d9/lbc to d4/de/dc8/l128 0 2024-04-06T12:23:15.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/828: write d3/d10/d3a/f60 [1988467,127780] 0 2024-04-06T12:23:15.254 INFO:tasks.workunit.client.1.smithi195.stdout:4/785: rmdir d4/d6d/da6/dae 39 2024-04-06T12:23:15.308 INFO:tasks.workunit.client.1.smithi195.stdout:8/813: sync 2024-04-06T12:23:15.312 INFO:tasks.workunit.client.1.smithi195.stdout:2/890: truncate d2/d21/d2c/d2d/f5c 1317461 0 2024-04-06T12:23:15.312 INFO:tasks.workunit.client.1.smithi195.stdout:9/829: getdents d3/db9/dbc/d103/d111/d102 0 2024-04-06T12:23:15.314 INFO:tasks.workunit.client.1.smithi195.stdout:8/814: fdatasync d6/dd/d70/f3b 0 2024-04-06T12:23:15.315 INFO:tasks.workunit.client.1.smithi195.stdout:2/891: creat d2/d41/d84/d8d/f126 x:0 0 0 2024-04-06T12:23:15.316 INFO:tasks.workunit.client.1.smithi195.stdout:9/830: creat d3/d10/d7d/dee/f112 x:0 0 0 2024-04-06T12:23:15.316 INFO:tasks.workunit.client.1.smithi195.stdout:2/892: write d2/d41/d5a/fa8 [901634,97688] 0 2024-04-06T12:23:15.317 INFO:tasks.workunit.client.1.smithi195.stdout:9/831: chown d3/db9/dd8 115 1 2024-04-06T12:23:15.319 INFO:tasks.workunit.client.1.smithi195.stdout:3/885: write d4/d9/d2b/d3b/d40/f71 [1105200,76418] 0 2024-04-06T12:23:15.320 INFO:tasks.workunit.client.1.smithi195.stdout:2/893: creat d2/d21/d29/de7/df6/f127 x:0 0 0 2024-04-06T12:23:15.321 INFO:tasks.workunit.client.1.smithi195.stdout:2/894: stat d2/d3f/l98 0 2024-04-06T12:23:15.322 INFO:tasks.workunit.client.1.smithi195.stdout:9/832: creat d3/d10/d3a/d5d/f113 x:0 0 0 2024-04-06T12:23:15.323 INFO:tasks.workunit.client.1.smithi195.stdout:3/886: write d4/df/f57 [315704,35651] 0 2024-04-06T12:23:15.324 INFO:tasks.workunit.client.1.smithi195.stdout:2/895: dread d2/d21/d29/ffb [0,4194304] 0 2024-04-06T12:23:15.325 INFO:tasks.workunit.client.1.smithi195.stdout:9/833: creat d3/db9/dd8/f114 x:0 0 0 2024-04-06T12:23:15.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/834: symlink d3/db9/dd8/l115 0 2024-04-06T12:23:15.330 INFO:tasks.workunit.client.1.smithi195.stdout:9/835: mkdir d3/d10/d3a/d5d/d116 0 2024-04-06T12:23:15.332 INFO:tasks.workunit.client.1.smithi195.stdout:9/836: symlink d3/d10/l117 0 2024-04-06T12:23:15.335 INFO:tasks.workunit.client.1.smithi195.stdout:3/887: dread d4/d9/f21 [0,4194304] 0 2024-04-06T12:23:15.337 INFO:tasks.workunit.client.1.smithi195.stdout:2/896: dwrite d2/d21/d2c/d2d/f5f [0,4194304] 0 2024-04-06T12:23:15.337 INFO:tasks.workunit.client.1.smithi195.stdout:3/888: chown d4/de/d8e/fec 8 1 2024-04-06T12:23:15.340 INFO:tasks.workunit.client.1.smithi195.stdout:2/897: write d2/d21/d29/f3e [4579378,90866] 0 2024-04-06T12:23:15.342 INFO:tasks.workunit.client.1.smithi195.stdout:9/837: dwrite d3/db9/dbc/d103/d48/d5e/f82 [0,4194304] 0 2024-04-06T12:23:15.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/889: creat d4/de/d8e/d92/d9e/f129 x:0 0 0 2024-04-06T12:23:15.345 INFO:tasks.workunit.client.1.smithi195.stdout:9/838: readlink d3/d10/l2b 0 2024-04-06T12:23:15.349 INFO:tasks.workunit.client.1.smithi195.stdout:3/890: mknod d4/d9/d2b/d3b/d5e/d7e/c12a 0 2024-04-06T12:23:15.350 INFO:tasks.workunit.client.1.smithi195.stdout:2/898: dwrite d2/d14/fb1 [0,4194304] 0 2024-04-06T12:23:15.353 INFO:tasks.workunit.client.1.smithi195.stdout:9/839: dread d3/db9/dbc/d103/d48/fc7 [0,4194304] 0 2024-04-06T12:23:15.356 INFO:tasks.workunit.client.1.smithi195.stdout:3/891: rename d4/d9/d2b/d9b/fd4 to d4/d9/d37/db9/d108/f12b 0 2024-04-06T12:23:15.360 INFO:tasks.workunit.client.1.smithi195.stdout:3/892: unlink d4/d9/d2b/d9b/lcd 0 2024-04-06T12:23:15.360 INFO:tasks.workunit.client.1.smithi195.stdout:2/899: dread d2/d3f/d7d/f73 [4194304,4194304] 0 2024-04-06T12:23:15.361 INFO:tasks.workunit.client.1.smithi195.stdout:3/893: fsync d4/df/d39/f8a 0 2024-04-06T12:23:15.363 INFO:tasks.workunit.client.1.smithi195.stdout:9/840: dwrite d3/db9/dbc/d103/d48/f49 [0,4194304] 0 2024-04-06T12:23:15.364 INFO:tasks.workunit.client.1.smithi195.stdout:9/841: chown d3/d10/f29 26028 1 2024-04-06T12:23:15.365 INFO:tasks.workunit.client.1.smithi195.stdout:7/726: sync 2024-04-06T12:23:15.365 INFO:tasks.workunit.client.1.smithi195.stdout:5/884: sync 2024-04-06T12:23:15.369 INFO:tasks.workunit.client.1.smithi195.stdout:7/727: fdatasync d4/d16/dd/d22/d3f/d54/fb4 0 2024-04-06T12:23:15.369 INFO:tasks.workunit.client.1.smithi195.stdout:9/842: write d3/db9/dbc/d103/d111/f1c [1803562,43195] 0 2024-04-06T12:23:15.374 INFO:tasks.workunit.client.1.smithi195.stdout:3/894: dwrite d4/d9/d2b/d3b/d5e/dab/f126 [0,4194304] 0 2024-04-06T12:23:15.376 INFO:tasks.workunit.client.1.smithi195.stdout:2/900: dread d2/d21/f28 [0,4194304] 0 2024-04-06T12:23:15.378 INFO:tasks.workunit.client.1.smithi195.stdout:3/895: mkdir d4/d12c 0 2024-04-06T12:23:15.379 INFO:tasks.workunit.client.1.smithi195.stdout:9/843: rename d3/d10/d3a/fa8 to d3/db9/dbc/d103/d111/d102/f118 0 2024-04-06T12:23:15.379 INFO:tasks.workunit.client.1.smithi195.stdout:5/885: link d0/da/dd/d1c/d5a/d62/d64/cf8 d0/da/dd/d2e/d6f/d58/c136 0 2024-04-06T12:23:15.382 INFO:tasks.workunit.client.1.smithi195.stdout:2/901: mknod d2/d21/d5e/d64/c128 0 2024-04-06T12:23:15.385 INFO:tasks.workunit.client.1.smithi195.stdout:2/902: creat d2/d21/d2c/d2d/d92/d95/d9b/dd9/f129 x:0 0 0 2024-04-06T12:23:15.386 INFO:tasks.workunit.client.1.smithi195.stdout:7/728: getdents d4/d10/d18/d19/d63 0 2024-04-06T12:23:15.387 INFO:tasks.workunit.client.1.smithi195.stdout:9/844: mknod d3/d10/d3a/d5d/d116/c119 0 2024-04-06T12:23:15.388 INFO:tasks.workunit.client.1.smithi195.stdout:7/729: stat d4/d10/d18/d57/f7f 0 2024-04-06T12:23:15.391 INFO:tasks.workunit.client.1.smithi195.stdout:5/886: dwrite d0/da/d23/d38/f44 [0,4194304] 0 2024-04-06T12:23:15.391 INFO:tasks.workunit.client.1.smithi195.stdout:7/730: chown d4/d16/dd/d22/d3f/d54/lc1 3955 1 2024-04-06T12:23:15.391 INFO:tasks.workunit.client.1.smithi195.stdout:9/845: readlink d3/l71 0 2024-04-06T12:23:15.392 INFO:tasks.workunit.client.1.smithi195.stdout:3/896: write d4/d53/f61 [3987496,71321] 0 2024-04-06T12:23:15.395 INFO:tasks.workunit.client.1.smithi195.stdout:9/846: write d3/d10/f2f [2403615,84470] 0 2024-04-06T12:23:15.397 INFO:tasks.workunit.client.1.smithi195.stdout:2/903: dwrite d2/d21/d5e/ff4 [4194304,4194304] 0 2024-04-06T12:23:15.398 INFO:tasks.workunit.client.1.smithi195.stdout:3/897: write d4/de/d8e/d92/d9e/fdb [152529,82971] 0 2024-04-06T12:23:15.399 INFO:tasks.workunit.client.1.smithi195.stdout:2/904: write d2/f12 [3020766,37181] 0 2024-04-06T12:23:15.401 INFO:tasks.workunit.client.1.smithi195.stdout:9/847: truncate d3/d10/f89 411993 0 2024-04-06T12:23:15.403 INFO:tasks.workunit.client.1.smithi195.stdout:9/848: read d3/db9/dbc/d103/d111/f85 [21037,54989] 0 2024-04-06T12:23:15.414 INFO:tasks.workunit.client.1.smithi195.stdout:5/887: truncate d0/da/d23/d38/f85 898418 0 2024-04-06T12:23:15.414 INFO:tasks.workunit.client.1.smithi195.stdout:5/888: fdatasync d0/da/d4b/fed 0 2024-04-06T12:23:15.415 INFO:tasks.workunit.client.1.smithi195.stdout:7/731: rename d4/d10/dd2 to d4/d10/de6 0 2024-04-06T12:23:15.415 INFO:tasks.workunit.client.1.smithi195.stdout:3/898: symlink d4/de/d8e/d92/d9e/l12d 0 2024-04-06T12:23:15.416 INFO:tasks.workunit.client.1.smithi195.stdout:7/732: read d4/d10/d18/f53 [668442,56887] 0 2024-04-06T12:23:15.417 INFO:tasks.workunit.client.1.smithi195.stdout:2/905: mkdir d2/d21/d5e/d105/d12a 0 2024-04-06T12:23:15.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/733: readlink d4/d16/dd/d22/d3f/d54/lc1 0 2024-04-06T12:23:15.420 INFO:tasks.workunit.client.1.smithi195.stdout:9/849: rename d3/l70 to d3/db9/dd8/l11a 0 2024-04-06T12:23:15.420 INFO:tasks.workunit.client.1.smithi195.stdout:5/889: truncate d0/da/dd/d33/f53 993446 0 2024-04-06T12:23:15.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/850: truncate d3/f43 4559702 0 2024-04-06T12:23:15.422 INFO:tasks.workunit.client.1.smithi195.stdout:5/890: fdatasync d0/da/d23/d38/d107/f12f 0 2024-04-06T12:23:15.423 INFO:tasks.workunit.client.1.smithi195.stdout:3/899: unlink d4/d9/d2b/d3b/c65 0 2024-04-06T12:23:15.424 INFO:tasks.workunit.client.1.smithi195.stdout:7/734: truncate d4/f34 5100013 0 2024-04-06T12:23:15.424 INFO:tasks.workunit.client.1.smithi195.stdout:2/906: dwrite d2/d3f/d7d/f68 [0,4194304] 0 2024-04-06T12:23:15.425 INFO:tasks.workunit.client.1.smithi195.stdout:6/949: sync 2024-04-06T12:23:15.425 INFO:tasks.workunit.client.1.smithi195.stdout:0/842: sync 2024-04-06T12:23:15.425 INFO:tasks.workunit.client.1.smithi195.stdout:1/814: sync 2024-04-06T12:23:15.426 INFO:tasks.workunit.client.1.smithi195.stdout:4/786: sync 2024-04-06T12:23:15.428 INFO:tasks.workunit.client.1.smithi195.stdout:3/900: write d4/d9/d2b/d3b/d40/ff4 [1020660,103147] 0 2024-04-06T12:23:15.429 INFO:tasks.workunit.client.1.smithi195.stdout:7/735: truncate d4/d16/d11/fc8 511280 0 2024-04-06T12:23:15.429 INFO:tasks.workunit.client.1.smithi195.stdout:5/891: mknod d0/da/d23/dd4/dc2/d11b/c137 0 2024-04-06T12:23:15.430 INFO:tasks.workunit.client.1.smithi195.stdout:9/851: link d3/db9/dbc/d103/c97 d3/dd3/c11b 0 2024-04-06T12:23:15.433 INFO:tasks.workunit.client.1.smithi195.stdout:1/815: dread - d4/d14/d17/d24/f94 zero size 2024-04-06T12:23:15.434 INFO:tasks.workunit.client.1.smithi195.stdout:0/843: truncate d4/d6/d1a/fb2 994848 0 2024-04-06T12:23:15.436 INFO:tasks.workunit.client.1.smithi195.stdout:9/852: truncate d3/d10/d4f/f5a 5022803 0 2024-04-06T12:23:15.437 INFO:tasks.workunit.client.1.smithi195.stdout:2/907: dread d2/d21/d29/f4b [0,4194304] 0 2024-04-06T12:23:15.438 INFO:tasks.workunit.client.1.smithi195.stdout:7/736: getdents d4/d10/d18/d19/d63/dc2 0 2024-04-06T12:23:15.443 INFO:tasks.workunit.client.1.smithi195.stdout:4/787: dwrite d4/f9f [0,4194304] 0 2024-04-06T12:23:15.443 INFO:tasks.workunit.client.1.smithi195.stdout:7/737: chown d4/d16/d11/lae 85859416 1 2024-04-06T12:23:15.445 INFO:tasks.workunit.client.1.smithi195.stdout:5/892: rename d0/da/dd/d1c/d5a/c111 to d0/da/d23/dd4/d106/df3/c138 0 2024-04-06T12:23:15.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/950: dwrite d8/d21/d31/d6c/ded/ff3 [0,4194304] 0 2024-04-06T12:23:15.448 INFO:tasks.workunit.client.1.smithi195.stdout:7/738: fsync d4/d10/d12/f2e 0 2024-04-06T12:23:15.449 INFO:tasks.workunit.client.1.smithi195.stdout:1/816: symlink d4/df0/df1/l10c 0 2024-04-06T12:23:15.467 INFO:tasks.workunit.client.1.smithi195.stdout:9/853: dread d3/d10/d3a/d5d/f65 [0,4194304] 0 2024-04-06T12:23:15.467 INFO:tasks.workunit.client.1.smithi195.stdout:3/901: dwrite d4/d9/d2b/d77/d9a/f120 [0,4194304] 0 2024-04-06T12:23:15.468 INFO:tasks.workunit.client.1.smithi195.stdout:2/908: rename d2/d21/d2c/d2d/d92/d95/d9b/dd9/c108 to d2/d21/d69/d6b/c12b 0 2024-04-06T12:23:15.468 INFO:tasks.workunit.client.1.smithi195.stdout:0/844: dwrite d4/d6/d1a/f47 [0,4194304] 0 2024-04-06T12:23:15.469 INFO:tasks.workunit.client.1.smithi195.stdout:6/951: chown d8/d3d/d5e/dd3/dfe/l141 500094502 1 2024-04-06T12:23:15.472 INFO:tasks.workunit.client.1.smithi195.stdout:2/909: dread - d2/d21/d69/f11e zero size 2024-04-06T12:23:15.472 INFO:tasks.workunit.client.1.smithi195.stdout:0/845: fdatasync d4/d6/d58/fc4 0 2024-04-06T12:23:15.474 INFO:tasks.workunit.client.1.smithi195.stdout:6/952: chown d8/d21/d31/d26/dcf/f162 19 1 2024-04-06T12:23:15.475 INFO:tasks.workunit.client.1.smithi195.stdout:3/902: write d4/de/f46 [2092426,51622] 0 2024-04-06T12:23:15.476 INFO:tasks.workunit.client.1.smithi195.stdout:1/817: symlink d4/d14/d17/d3a/da8/da4/db2/d28/l10d 0 2024-04-06T12:23:15.477 INFO:tasks.workunit.client.1.smithi195.stdout:6/953: chown d8/d8e/fa6 119058 1 2024-04-06T12:23:15.478 INFO:tasks.workunit.client.1.smithi195.stdout:3/903: chown d4/f100 137966 1 2024-04-06T12:23:15.478 INFO:tasks.workunit.client.1.smithi195.stdout:2/910: unlink d2/d3f/c88 0 2024-04-06T12:23:15.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/893: dwrite d0/f94 [0,4194304] 0 2024-04-06T12:23:15.480 INFO:tasks.workunit.client.1.smithi195.stdout:0/846: creat d4/d48/d67/d75/dcf/f10d x:0 0 0 2024-04-06T12:23:15.482 INFO:tasks.workunit.client.1.smithi195.stdout:0/847: chown d4/d48/d67 13305 1 2024-04-06T12:23:15.483 INFO:tasks.workunit.client.1.smithi195.stdout:6/954: stat d8/d21/d31/d26/d13f/l15f 0 2024-04-06T12:23:15.485 INFO:tasks.workunit.client.1.smithi195.stdout:3/904: creat d4/d9/d2b/d3b/d40/de2/f12e x:0 0 0 2024-04-06T12:23:15.490 INFO:tasks.workunit.client.1.smithi195.stdout:2/911: dwrite d2/d21/d29/f3e [0,4194304] 0 2024-04-06T12:23:15.490 INFO:tasks.workunit.client.1.smithi195.stdout:0/848: mknod d4/d48/d4e/dfd/d101/c10e 0 2024-04-06T12:23:15.491 INFO:tasks.workunit.client.1.smithi195.stdout:8/815: sync 2024-04-06T12:23:15.494 INFO:tasks.workunit.client.1.smithi195.stdout:6/955: getdents d8/d21/d2b 0 2024-04-06T12:23:15.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/849: creat d4/dbc/de2/f10f x:0 0 0 2024-04-06T12:23:15.502 INFO:tasks.workunit.client.1.smithi195.stdout:7/739: dread d4/d16/dd/f2a [0,4194304] 0 2024-04-06T12:23:15.502 INFO:tasks.workunit.client.1.smithi195.stdout:2/912: getdents d2/d21/d5e/d64 0 2024-04-06T12:23:15.507 INFO:tasks.workunit.client.1.smithi195.stdout:2/913: mkdir d2/d21/d69/d12c 0 2024-04-06T12:23:15.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/905: truncate d4/de/f46 2349670 0 2024-04-06T12:23:15.512 INFO:tasks.workunit.client.1.smithi195.stdout:8/816: write d6/dd/d42/fbc [983363,38194] 0 2024-04-06T12:23:15.518 INFO:tasks.workunit.client.1.smithi195.stdout:2/914: write d2/d21/d69/f11d [150959,125338] 0 2024-04-06T12:23:15.520 INFO:tasks.workunit.client.1.smithi195.stdout:6/956: dwrite d8/d3d/d5e/d72/d10c/f39 [0,4194304] 0 2024-04-06T12:23:15.522 INFO:tasks.workunit.client.1.smithi195.stdout:1/818: dwrite d4/d14/d17/d24/f94 [0,4194304] 0 2024-04-06T12:23:15.523 INFO:tasks.workunit.client.1.smithi195.stdout:7/740: dwrite d4/d16/dd/d22/d3f/d54/f90 [0,4194304] 0 2024-04-06T12:23:15.524 INFO:tasks.workunit.client.1.smithi195.stdout:0/850: dread d4/d48/d67/d75/fa1 [0,4194304] 0 2024-04-06T12:23:15.526 INFO:tasks.workunit.client.1.smithi195.stdout:4/788: sync 2024-04-06T12:23:15.529 INFO:tasks.workunit.client.1.smithi195.stdout:3/906: rename d4/df/lfc to d4/de/d8e/d92/d9e/l12f 0 2024-04-06T12:23:15.529 INFO:tasks.workunit.client.1.smithi195.stdout:5/894: dwrite d0/da/dd/d33/f53 [0,4194304] 0 2024-04-06T12:23:15.533 INFO:tasks.workunit.client.1.smithi195.stdout:8/817: dread d6/d3a/d46/f8b [0,4194304] 0 2024-04-06T12:23:15.538 INFO:tasks.workunit.client.1.smithi195.stdout:6/957: dwrite d8/d3d/d5e/dd3/dfe/f52 [0,4194304] 0 2024-04-06T12:23:15.540 INFO:tasks.workunit.client.1.smithi195.stdout:2/915: truncate d2/f13 1971266 0 2024-04-06T12:23:15.541 INFO:tasks.workunit.client.1.smithi195.stdout:2/916: dread - d2/d41/d84/d8d/f126 zero size 2024-04-06T12:23:15.542 INFO:tasks.workunit.client.1.smithi195.stdout:0/851: creat d4/d48/d67/f110 x:0 0 0 2024-04-06T12:23:15.542 INFO:tasks.workunit.client.1.smithi195.stdout:7/741: getdents d4/d10/d18/d33/dd8 0 2024-04-06T12:23:15.542 INFO:tasks.workunit.client.1.smithi195.stdout:6/958: read d8/d3d/d5e/d72/fdd [233660,21188] 0 2024-04-06T12:23:15.544 INFO:tasks.workunit.client.1.smithi195.stdout:0/852: truncate d4/d6/d2f/fd6 4710278 0 2024-04-06T12:23:15.544 INFO:tasks.workunit.client.1.smithi195.stdout:8/818: creat d6/dd/d70/d24/d34/d67/dec/d97/f112 x:0 0 0 2024-04-06T12:23:15.545 INFO:tasks.workunit.client.1.smithi195.stdout:6/959: write d8/d3d/d5e/d72/d10c/d32/fbe [300162,71849] 0 2024-04-06T12:23:15.547 INFO:tasks.workunit.client.1.smithi195.stdout:7/742: mknod d4/d24/d80/ce7 0 2024-04-06T12:23:15.547 INFO:tasks.workunit.client.1.smithi195.stdout:6/960: read - d8/d3d/d5e/d72/fc2 zero size 2024-04-06T12:23:15.551 INFO:tasks.workunit.client.1.smithi195.stdout:5/895: getdents d0 0 2024-04-06T12:23:15.552 INFO:tasks.workunit.client.1.smithi195.stdout:0/853: symlink d4/d48/d67/d83/l111 0 2024-04-06T12:23:15.553 INFO:tasks.workunit.client.1.smithi195.stdout:2/917: getdents d2/d21/d2c/d2d/d92/d95 0 2024-04-06T12:23:15.555 INFO:tasks.workunit.client.1.smithi195.stdout:0/854: creat d4/dbc/f112 x:0 0 0 2024-04-06T12:23:15.555 INFO:tasks.workunit.client.1.smithi195.stdout:8/819: dread d6/dd/d70/d24/d34/d67/f86 [0,4194304] 0 2024-04-06T12:23:15.557 INFO:tasks.workunit.client.1.smithi195.stdout:6/961: dread d8/d3d/d5e/dd3/dfe/f52 [0,4194304] 0 2024-04-06T12:23:15.558 INFO:tasks.workunit.client.1.smithi195.stdout:7/743: dwrite d4/d10/d12/da5/da3/fe0 [0,4194304] 0 2024-04-06T12:23:15.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/819: write d4/d14/d17/d24/d2a/f109 [4333780,127408] 0 2024-04-06T12:23:15.564 INFO:tasks.workunit.client.1.smithi195.stdout:6/962: truncate d8/d21/d31/f114 724599 0 2024-04-06T12:23:15.565 INFO:tasks.workunit.client.1.smithi195.stdout:0/855: creat d4/dbc/de2/d10c/f113 x:0 0 0 2024-04-06T12:23:15.566 INFO:tasks.workunit.client.1.smithi195.stdout:2/918: creat d2/d21/d2c/d2d/d92/d95/d124/f12d x:0 0 0 2024-04-06T12:23:15.567 INFO:tasks.workunit.client.1.smithi195.stdout:1/820: readlink d4/d14/d17/d24/l2e 0 2024-04-06T12:23:15.567 INFO:tasks.workunit.client.1.smithi195.stdout:8/820: creat d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d83/f113 x:0 0 0 2024-04-06T12:23:15.568 INFO:tasks.workunit.client.1.smithi195.stdout:7/744: mknod d4/ce8 0 2024-04-06T12:23:15.569 INFO:tasks.workunit.client.1.smithi195.stdout:4/789: dwrite d4/d6/d38/d1a/fd7 [0,4194304] 0 2024-04-06T12:23:15.571 INFO:tasks.workunit.client.1.smithi195.stdout:5/896: truncate d0/da/dd/d2e/d6f/f4f 191242 0 2024-04-06T12:23:15.576 INFO:tasks.workunit.client.1.smithi195.stdout:4/790: mkdir d4/d8c/d96/dc9/df8 0 2024-04-06T12:23:15.579 INFO:tasks.workunit.client.1.smithi195.stdout:1/821: dwrite d4/d14/d17/d3a/da8/da4/db2/d28/fb1 [0,4194304] 0 2024-04-06T12:23:15.581 INFO:tasks.workunit.client.1.smithi195.stdout:5/897: rmdir d0/da/dd/d33 39 2024-04-06T12:23:15.583 INFO:tasks.workunit.client.1.smithi195.stdout:6/963: link d8/d3d/d5e/f8f d8/d3d/d5e/de0/f16e 0 2024-04-06T12:23:15.583 INFO:tasks.workunit.client.1.smithi195.stdout:5/898: chown d0/da/d23/lad 755044 1 2024-04-06T12:23:15.586 INFO:tasks.workunit.client.1.smithi195.stdout:6/964: write d8/d3d/d5e/d72/d10c/d32/f129 [583326,71711] 0 2024-04-06T12:23:15.586 INFO:tasks.workunit.client.1.smithi195.stdout:5/899: fdatasync d0/da/dd/d1c/d5a/d68/dd7/d101/f4d 0 2024-04-06T12:23:15.586 INFO:tasks.workunit.client.1.smithi195.stdout:7/745: getdents d4/d16/dd/d22/d3f/dbe 0 2024-04-06T12:23:15.589 INFO:tasks.workunit.client.1.smithi195.stdout:7/746: dread - d4/d16/dd/f78 zero size 2024-04-06T12:23:15.589 INFO:tasks.workunit.client.1.smithi195.stdout:2/919: dwrite d2/d21/d2c/f32 [0,4194304] 0 2024-04-06T12:23:15.590 INFO:tasks.workunit.client.1.smithi195.stdout:4/791: creat d4/d6d/ff9 x:0 0 0 2024-04-06T12:23:15.591 INFO:tasks.workunit.client.1.smithi195.stdout:9/854: sync 2024-04-06T12:23:15.592 INFO:tasks.workunit.client.1.smithi195.stdout:9/855: truncate d3/ff8 86305 0 2024-04-06T12:23:15.593 INFO:tasks.workunit.client.1.smithi195.stdout:6/965: rename d8/l5d to d8/d21/d31/d26/l16f 0 2024-04-06T12:23:15.597 INFO:tasks.workunit.client.1.smithi195.stdout:4/792: fsync d4/f4e 0 2024-04-06T12:23:15.598 INFO:tasks.workunit.client.1.smithi195.stdout:8/821: truncate d6/dd/d70/d24/d25/f54 1597539 0 2024-04-06T12:23:15.599 INFO:tasks.workunit.client.1.smithi195.stdout:7/747: symlink d4/d16/dd/d22/d3f/le9 0 2024-04-06T12:23:15.600 INFO:tasks.workunit.client.1.smithi195.stdout:2/920: mknod d2/d21/d29/de7/df6/c12e 0 2024-04-06T12:23:15.601 INFO:tasks.workunit.client.1.smithi195.stdout:6/966: dwrite d8/d3d/d5e/d72/d10c/d32/f129 [0,4194304] 0 2024-04-06T12:23:15.606 INFO:tasks.workunit.client.1.smithi195.stdout:7/748: write d4/d10/d18/d33/d6e/f7d [3780294,116832] 0 2024-04-06T12:23:15.606 INFO:tasks.workunit.client.1.smithi195.stdout:2/921: unlink d2/d21/d69/f11d 0 2024-04-06T12:23:15.607 INFO:tasks.workunit.client.1.smithi195.stdout:8/822: symlink d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d61/l114 0 2024-04-06T12:23:15.608 INFO:tasks.workunit.client.1.smithi195.stdout:8/823: fsync d6/dd/d42/f6f 0 2024-04-06T12:23:15.609 INFO:tasks.workunit.client.1.smithi195.stdout:6/967: creat d8/d3d/d5e/d72/d14a/f170 x:0 0 0 2024-04-06T12:23:15.611 INFO:tasks.workunit.client.1.smithi195.stdout:7/749: symlink d4/d10/lea 0 2024-04-06T12:23:15.614 INFO:tasks.workunit.client.1.smithi195.stdout:8/824: symlink d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/dda/df6/l115 0 2024-04-06T12:23:15.615 INFO:tasks.workunit.client.1.smithi195.stdout:7/750: creat d4/d16/dd/feb x:0 0 0 2024-04-06T12:23:15.617 INFO:tasks.workunit.client.1.smithi195.stdout:6/968: truncate d8/d21/d31/d26/f78 241417 0 2024-04-06T12:23:15.618 INFO:tasks.workunit.client.1.smithi195.stdout:8/825: fsync d6/d3a/d46/f63 0 2024-04-06T12:23:15.620 INFO:tasks.workunit.client.1.smithi195.stdout:7/751: symlink d4/d10/d18/d19/lec 0 2024-04-06T12:23:15.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/900: dwrite d0/da/dd/d1c/d5a/d62/d64/f8a [0,4194304] 0 2024-04-06T12:23:15.624 INFO:tasks.workunit.client.1.smithi195.stdout:7/752: dread d4/d16/d11/fc8 [0,4194304] 0 2024-04-06T12:23:15.625 INFO:tasks.workunit.client.1.smithi195.stdout:1/822: dread d4/d14/d17/d24/d2a/f54 [0,4194304] 0 2024-04-06T12:23:15.625 INFO:tasks.workunit.client.1.smithi195.stdout:5/901: stat d0/d35/f5f 0 2024-04-06T12:23:15.625 INFO:tasks.workunit.client.1.smithi195.stdout:8/826: creat d6/dd/d70/f116 x:0 0 0 2024-04-06T12:23:15.626 INFO:tasks.workunit.client.1.smithi195.stdout:6/969: getdents d8/d14c 0 2024-04-06T12:23:15.626 INFO:tasks.workunit.client.1.smithi195.stdout:4/793: write d4/d6/d38/d1a/d40/d57/d64/f7d [236569,120017] 0 2024-04-06T12:23:15.631 INFO:tasks.workunit.client.1.smithi195.stdout:2/922: write d2/d21/d2c/d2d/f5c [752400,44915] 0 2024-04-06T12:23:15.631 INFO:tasks.workunit.client.1.smithi195.stdout:7/753: symlink d4/led 0 2024-04-06T12:23:15.633 INFO:tasks.workunit.client.1.smithi195.stdout:4/794: fsync d4/d6/d38/d1a/d40/d20/f8a 0 2024-04-06T12:23:15.634 INFO:tasks.workunit.client.1.smithi195.stdout:2/923: read d2/d14/fb1 [3254625,71244] 0 2024-04-06T12:23:15.635 INFO:tasks.workunit.client.1.smithi195.stdout:5/902: truncate d0/da/dd/d2e/d6f/d58/f104 321096 0 2024-04-06T12:23:15.635 INFO:tasks.workunit.client.1.smithi195.stdout:8/827: creat d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d61/f117 x:0 0 0 2024-04-06T12:23:15.637 INFO:tasks.workunit.client.1.smithi195.stdout:9/856: dwrite d3/db9/dbc/d103/d48/d9c/f38 [4194304,4194304] 0 2024-04-06T12:23:15.637 INFO:tasks.workunit.client.1.smithi195.stdout:6/970: creat d8/d21/d31/d26/d13f/d15a/d16a/f171 x:0 0 0 2024-04-06T12:23:15.638 INFO:tasks.workunit.client.1.smithi195.stdout:4/795: stat d4/d6/d38/d1a/d40/d57/fe4 0 2024-04-06T12:23:15.639 INFO:tasks.workunit.client.1.smithi195.stdout:7/754: read - d4/d16/dd/d22/d76/fac zero size 2024-04-06T12:23:15.640 INFO:tasks.workunit.client.1.smithi195.stdout:5/903: dread - d0/da/d13/d87/f12b zero size 2024-04-06T12:23:15.642 INFO:tasks.workunit.client.1.smithi195.stdout:1/823: rename d4/d14/d17/d24/f4a to d4/d14/d17/d24/d2a/d5a/daa/f10e 0 2024-04-06T12:23:15.642 INFO:tasks.workunit.client.1.smithi195.stdout:2/924: mkdir d2/d41/d5a/d12f 0 2024-04-06T12:23:15.645 INFO:tasks.workunit.client.1.smithi195.stdout:8/828: truncate d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/f10f 836797 0 2024-04-06T12:23:15.646 INFO:tasks.workunit.client.1.smithi195.stdout:4/796: rmdir d4/d6/d38/d65/d7a 39 2024-04-06T12:23:15.648 INFO:tasks.workunit.client.1.smithi195.stdout:7/755: creat d4/d16/dd/d22/d3f/fee x:0 0 0 2024-04-06T12:23:15.649 INFO:tasks.workunit.client.1.smithi195.stdout:5/904: read d0/da/d23/d38/fdf [263246,124622] 0 2024-04-06T12:23:15.651 INFO:tasks.workunit.client.1.smithi195.stdout:1/824: creat d4/d14/d17/d24/d99/d4e/d8f/f10f x:0 0 0 2024-04-06T12:23:15.652 INFO:tasks.workunit.client.1.smithi195.stdout:3/907: sync 2024-04-06T12:23:15.654 INFO:tasks.workunit.client.1.smithi195.stdout:6/971: link d8/d3d/d5e/dd3/dfe/f121 d8/d21/d2b/d46/d13e/f172 0 2024-04-06T12:23:15.656 INFO:tasks.workunit.client.1.smithi195.stdout:8/829: dwrite d6/fb6 [0,4194304] 0 2024-04-06T12:23:15.656 INFO:tasks.workunit.client.1.smithi195.stdout:5/905: write d0/da/d13/d87/f12b [142492,45444] 0 2024-04-06T12:23:15.656 INFO:tasks.workunit.client.1.smithi195.stdout:7/756: rmdir d4/d16/dd/d22/d76 39 2024-04-06T12:23:15.659 INFO:tasks.workunit.client.1.smithi195.stdout:6/972: chown d8/d3d/d5e/f77 2863426 1 2024-04-06T12:23:15.690 INFO:tasks.workunit.client.1.smithi195.stdout:2/925: dwrite d2/d21/f28 [0,4194304] 0 2024-04-06T12:23:15.692 INFO:tasks.workunit.client.1.smithi195.stdout:9/857: dread d3/f43 [0,4194304] 0 2024-04-06T12:23:15.692 INFO:tasks.workunit.client.1.smithi195.stdout:2/926: chown d2/d41/d84/d8d/d94/cda 114698 1 2024-04-06T12:23:15.694 INFO:tasks.workunit.client.1.smithi195.stdout:8/830: rename d6/d3a to d6/dd/d70/d118 0 2024-04-06T12:23:15.697 INFO:tasks.workunit.client.1.smithi195.stdout:6/973: fsync d8/d21/d2b/f54 0 2024-04-06T12:23:15.697 INFO:tasks.workunit.client.1.smithi195.stdout:8/831: chown d6/db/c27 1 1 2024-04-06T12:23:15.697 INFO:tasks.workunit.client.1.smithi195.stdout:5/906: mkdir d0/da/dd/d2e/d6f/d58/d139 0 2024-04-06T12:23:15.699 INFO:tasks.workunit.client.1.smithi195.stdout:7/757: dwrite d4/d16/dd/d22/d76/fd7 [0,4194304] 0 2024-04-06T12:23:15.699 INFO:tasks.workunit.client.1.smithi195.stdout:1/825: creat d4/d14/d17/d24/d99/f110 x:0 0 0 2024-04-06T12:23:15.700 INFO:tasks.workunit.client.1.smithi195.stdout:8/832: read d6/db/f66 [2377329,101540] 0 2024-04-06T12:23:15.702 INFO:tasks.workunit.client.1.smithi195.stdout:4/797: link d4/d6/d38/l8f d4/d6d/lfa 0 2024-04-06T12:23:15.703 INFO:tasks.workunit.client.1.smithi195.stdout:9/858: creat d3/db9/dbc/d103/d50/f11c x:0 0 0 2024-04-06T12:23:15.704 INFO:tasks.workunit.client.1.smithi195.stdout:2/927: mkdir d2/d21/d2c/d2d/d92/d95/d130 0 2024-04-06T12:23:15.706 INFO:tasks.workunit.client.1.smithi195.stdout:4/798: write d4/f5e [3696253,6442] 0 2024-04-06T12:23:15.710 INFO:tasks.workunit.client.1.smithi195.stdout:6/974: rename d8/d3d/d5e/d72/fdd to d8/d21/d31/d6c/d7b/d11b/f173 0 2024-04-06T12:23:15.710 INFO:tasks.workunit.client.1.smithi195.stdout:1/826: mkdir d4/d14/d17/d24/d2a/d45/d111 0 2024-04-06T12:23:15.712 INFO:tasks.workunit.client.1.smithi195.stdout:2/928: mkdir d2/d21/d2c/d2d/d92/d131 0 2024-04-06T12:23:15.715 INFO:tasks.workunit.client.1.smithi195.stdout:9/859: dwrite d3/d10/d3a/f8f [0,4194304] 0 2024-04-06T12:23:15.716 INFO:tasks.workunit.client.1.smithi195.stdout:2/929: read d2/d14/f1d [1661040,18704] 0 2024-04-06T12:23:15.717 INFO:tasks.workunit.client.1.smithi195.stdout:7/758: rename d4/d10/d12/d6f/f98 to d4/d10/d18/da0/fef 0 2024-04-06T12:23:15.718 INFO:tasks.workunit.client.1.smithi195.stdout:4/799: dwrite d4/d6/f9a [0,4194304] 0 2024-04-06T12:23:15.720 INFO:tasks.workunit.client.1.smithi195.stdout:2/930: chown d2/d41/c6a 7045 1 2024-04-06T12:23:15.723 INFO:tasks.workunit.client.1.smithi195.stdout:2/931: stat d2/d3f/cbe 0 2024-04-06T12:23:15.723 INFO:tasks.workunit.client.1.smithi195.stdout:1/827: write d4/d14/d17/f42 [2285362,37397] 0 2024-04-06T12:23:15.724 INFO:tasks.workunit.client.1.smithi195.stdout:8/833: creat d6/dd/d70/d24/d34/d67/da1/f119 x:0 0 0 2024-04-06T12:23:15.728 INFO:tasks.workunit.client.1.smithi195.stdout:0/856: sync 2024-04-06T12:23:15.728 INFO:tasks.workunit.client.1.smithi195.stdout:9/860: dwrite d3/db9/dbc/d103/ff7 [0,4194304] 0 2024-04-06T12:23:15.731 INFO:tasks.workunit.client.1.smithi195.stdout:0/857: write d4/dbc/fc2 [880619,55875] 0 2024-04-06T12:23:15.732 INFO:tasks.workunit.client.1.smithi195.stdout:2/932: symlink d2/d21/d29/de7/l132 0 2024-04-06T12:23:15.734 INFO:tasks.workunit.client.1.smithi195.stdout:0/858: dread - d4/d53/ffc zero size 2024-04-06T12:23:15.734 INFO:tasks.workunit.client.1.smithi195.stdout:5/907: dwrite d0/da/fb [0,4194304] 0 2024-04-06T12:23:15.734 INFO:tasks.workunit.client.1.smithi195.stdout:1/828: creat d4/d14/d17/d24/d99/d4e/d71/f112 x:0 0 0 2024-04-06T12:23:15.735 INFO:tasks.workunit.client.1.smithi195.stdout:0/859: chown d4/d6/d1a/f72 4376 1 2024-04-06T12:23:15.737 INFO:tasks.workunit.client.1.smithi195.stdout:4/800: creat d4/d6/d38/d1a/da7/ffb x:0 0 0 2024-04-06T12:23:15.739 INFO:tasks.workunit.client.1.smithi195.stdout:1/829: write d4/d14/d17/d3a/da8/da4/db2/d28/fb1 [3162747,118614] 0 2024-04-06T12:23:15.741 INFO:tasks.workunit.client.1.smithi195.stdout:8/834: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/f55 [3012359,29384] 0 2024-04-06T12:23:15.744 INFO:tasks.workunit.client.1.smithi195.stdout:9/861: dread d3/f17 [0,4194304] 0 2024-04-06T12:23:15.746 INFO:tasks.workunit.client.1.smithi195.stdout:5/908: unlink d0/da/d13/d87/lb7 0 2024-04-06T12:23:15.750 INFO:tasks.workunit.client.1.smithi195.stdout:0/860: chown d4/d48/d77/d97/le3 13 1 2024-04-06T12:23:15.753 INFO:tasks.workunit.client.1.smithi195.stdout:3/908: sync 2024-04-06T12:23:15.753 INFO:tasks.workunit.client.1.smithi195.stdout:7/759: getdents d4/d10/d18 0 2024-04-06T12:23:15.753 INFO:tasks.workunit.client.1.smithi195.stdout:6/975: write d8/d21/d2b/d46/d44/f7d [3546985,48049] 0 2024-04-06T12:23:15.753 INFO:tasks.workunit.client.1.smithi195.stdout:4/801: write d4/f7e [340922,14887] 0 2024-04-06T12:23:15.754 INFO:tasks.workunit.client.1.smithi195.stdout:1/830: dwrite d4/d14/d17/d24/d99/d88/ffa [0,4194304] 0 2024-04-06T12:23:15.754 INFO:tasks.workunit.client.1.smithi195.stdout:2/933: unlink d2/d41/d84/d8d/c106 0 2024-04-06T12:23:15.756 INFO:tasks.workunit.client.1.smithi195.stdout:9/862: mkdir d3/d10/d7d/dee/d11d 0 2024-04-06T12:23:15.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/835: mknod d6/dd/d70/d24/d25/c11a 0 2024-04-06T12:23:15.760 INFO:tasks.workunit.client.1.smithi195.stdout:7/760: symlink d4/d10/d18/da0/lf0 0 2024-04-06T12:23:15.761 INFO:tasks.workunit.client.1.smithi195.stdout:1/831: readlink d4/d14/d17/d24/d2a/d45/l83 0 2024-04-06T12:23:15.763 INFO:tasks.workunit.client.1.smithi195.stdout:6/976: truncate d8/d3d/fd5 693431 0 2024-04-06T12:23:15.763 INFO:tasks.workunit.client.1.smithi195.stdout:2/934: write d2/d3f/fc0 [263368,81790] 0 2024-04-06T12:23:15.764 INFO:tasks.workunit.client.1.smithi195.stdout:9/863: truncate d3/d10/d3a/d5d/f113 827381 0 2024-04-06T12:23:15.766 INFO:tasks.workunit.client.1.smithi195.stdout:1/832: chown d4/d14/d17/d24/d99/l70 5 1 2024-04-06T12:23:15.766 INFO:tasks.workunit.client.1.smithi195.stdout:4/802: creat d4/d6d/da6/dae/dec/ffc x:0 0 0 2024-04-06T12:23:15.767 INFO:tasks.workunit.client.1.smithi195.stdout:4/803: dread - d4/faa zero size 2024-04-06T12:23:15.768 INFO:tasks.workunit.client.1.smithi195.stdout:4/804: dread - d4/faa zero size 2024-04-06T12:23:15.769 INFO:tasks.workunit.client.1.smithi195.stdout:6/977: dread d8/d21/d31/d26/f78 [0,4194304] 0 2024-04-06T12:23:15.771 INFO:tasks.workunit.client.1.smithi195.stdout:6/978: chown d8/d21/d31/d26/dcf/de4/l109 33 1 2024-04-06T12:23:15.773 INFO:tasks.workunit.client.1.smithi195.stdout:9/864: creat d3/db9/dbc/d103/d48/f11e x:0 0 0 2024-04-06T12:23:15.775 INFO:tasks.workunit.client.1.smithi195.stdout:1/833: symlink d4/d14/d17/d24/d99/d4e/d8f/l113 0 2024-04-06T12:23:15.776 INFO:tasks.workunit.client.1.smithi195.stdout:4/805: dwrite d4/d6d/da6/dae/dec/ffc [0,4194304] 0 2024-04-06T12:23:15.776 INFO:tasks.workunit.client.1.smithi195.stdout:5/909: truncate d0/da/dd/d1c/d5a/d68/dd7/d101/f4d 2281442 0 2024-04-06T12:23:15.778 INFO:tasks.workunit.client.1.smithi195.stdout:1/834: chown d4/d14/d17/d24/d99/d4e/d60/ffb 59 1 2024-04-06T12:23:15.778 INFO:tasks.workunit.client.1.smithi195.stdout:7/761: rename d4/d10/d12/da5/lbb to d4/d10/d18/d33/d6e/lf1 0 2024-04-06T12:23:15.781 INFO:tasks.workunit.client.1.smithi195.stdout:3/909: write d4/df/f35 [89960,15597] 0 2024-04-06T12:23:15.782 INFO:tasks.workunit.client.1.smithi195.stdout:1/835: fsync d4/d14/d17/d3a/da8/da4/db2/d5d/db3/fff 0 2024-04-06T12:23:15.782 INFO:tasks.workunit.client.1.smithi195.stdout:2/935: dread d2/f13 [0,4194304] 0 2024-04-06T12:23:15.784 INFO:tasks.workunit.client.1.smithi195.stdout:3/910: write d4/d9/d2b/d3b/d40/f71 [434002,80648] 0 2024-04-06T12:23:15.785 INFO:tasks.workunit.client.1.smithi195.stdout:3/911: stat d4/d9/d37/db9/d121/d127 0 2024-04-06T12:23:15.787 INFO:tasks.workunit.client.1.smithi195.stdout:3/912: write d4/de/dc8/ff9 [1982358,55483] 0 2024-04-06T12:23:15.788 INFO:tasks.workunit.client.1.smithi195.stdout:8/836: dread d6/dd/d70/d24/d34/d67/f88 [0,4194304] 0 2024-04-06T12:23:15.793 INFO:tasks.workunit.client.1.smithi195.stdout:3/913: dwrite d4/d9/d2b/d87/f11b [0,4194304] 0 2024-04-06T12:23:15.804 INFO:tasks.workunit.client.1.smithi195.stdout:0/861: truncate d4/d48/d77/d97/fca 13508 0 2024-04-06T12:23:15.807 INFO:tasks.workunit.client.1.smithi195.stdout:2/936: creat d2/d3f/d7d/d7a/f133 x:0 0 0 2024-04-06T12:23:15.814 INFO:tasks.workunit.client.1.smithi195.stdout:5/910: symlink d0/da/dd/d33/l13a 0 2024-04-06T12:23:15.815 INFO:tasks.workunit.client.1.smithi195.stdout:5/911: chown d0/da/d4b/f6a 3 1 2024-04-06T12:23:15.817 INFO:tasks.workunit.client.1.smithi195.stdout:7/762: symlink d4/d16/dd/d22/d3f/dbe/lf2 0 2024-04-06T12:23:15.818 INFO:tasks.workunit.client.1.smithi195.stdout:6/979: link d8/d21/d31/l17 d8/d21/d31/d26/dc8/l174 0 2024-04-06T12:23:15.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/763: fdatasync d4/d16/dd/d22/d3f/d54/f9d 0 2024-04-06T12:23:15.820 INFO:tasks.workunit.client.1.smithi195.stdout:6/980: dread - d8/d21/d31/d26/dc8/d4e/f144 zero size 2024-04-06T12:23:15.820 INFO:tasks.workunit.client.1.smithi195.stdout:6/981: chown d8/d21/d31/d26/dc8/f5f 5 1 2024-04-06T12:23:15.821 INFO:tasks.workunit.client.1.smithi195.stdout:8/837: link d6/dd/d42/fd6 d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/f11b 0 2024-04-06T12:23:15.821 INFO:tasks.workunit.client.1.smithi195.stdout:6/982: write d8/d3d/d5e/d72/d10c/d32/f112 [451694,47770] 0 2024-04-06T12:23:15.822 INFO:tasks.workunit.client.1.smithi195.stdout:3/914: link d4/d9/fb0 d4/d9/dcf/f130 0 2024-04-06T12:23:15.824 INFO:tasks.workunit.client.1.smithi195.stdout:5/912: creat d0/da/d23/d38/d107/f13b x:0 0 0 2024-04-06T12:23:15.824 INFO:tasks.workunit.client.1.smithi195.stdout:4/806: link d4/d6/d38/d1a/d40/d20/f60 d4/d6d/ffd 0 2024-04-06T12:23:15.825 INFO:tasks.workunit.client.1.smithi195.stdout:9/865: getdents d3/dd3 0 2024-04-06T12:23:15.826 INFO:tasks.workunit.client.1.smithi195.stdout:7/764: creat d4/d16/d11/ff3 x:0 0 0 2024-04-06T12:23:15.829 INFO:tasks.workunit.client.1.smithi195.stdout:5/913: dwrite d0/da/d4b/f6a [4194304,4194304] 0 2024-04-06T12:23:15.829 INFO:tasks.workunit.client.1.smithi195.stdout:1/836: rename d4/d14/d17/d3a/da8/da4/db2 to d4/d14/d17/d24/d99/d88/d114 0 2024-04-06T12:23:15.831 INFO:tasks.workunit.client.1.smithi195.stdout:8/838: mkdir d6/dd/d70/d24/d53/d11c 0 2024-04-06T12:23:15.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/839: readlink d6/db/l18 0 2024-04-06T12:23:15.832 INFO:tasks.workunit.client.1.smithi195.stdout:6/983: creat d8/d21/d2b/f175 x:0 0 0 2024-04-06T12:23:15.833 INFO:tasks.workunit.client.1.smithi195.stdout:8/840: write d6/db/f60 [2562440,86838] 0 2024-04-06T12:23:15.834 INFO:tasks.workunit.client.1.smithi195.stdout:5/914: dread d0/da/d4b/f6a [4194304,4194304] 0 2024-04-06T12:23:15.837 INFO:tasks.workunit.client.1.smithi195.stdout:0/862: creat d4/d48/d77/f114 x:0 0 0 2024-04-06T12:23:15.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/866: rmdir d3/db9/dbc 39 2024-04-06T12:23:15.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/867: readlink d3/d10/d3a/l3d 0 2024-04-06T12:23:15.843 INFO:tasks.workunit.client.1.smithi195.stdout:2/937: rename d2/d21/ld7 to d2/d41/d84/db2/dfe/l134 0 2024-04-06T12:23:15.845 INFO:tasks.workunit.client.1.smithi195.stdout:2/938: write d2/ddc/f109 [146166,61245] 0 2024-04-06T12:23:15.845 INFO:tasks.workunit.client.1.smithi195.stdout:1/837: creat d4/d14/d17/d24/d2a/d45/f115 x:0 0 0 2024-04-06T12:23:15.868 INFO:tasks.workunit.client.1.smithi195.stdout:3/915: truncate f3 4075953 0 2024-04-06T12:23:15.868 INFO:tasks.workunit.client.1.smithi195.stdout:8/841: symlink d6/dd/d70/d24/d34/d67/da1/da2/l11d 0 2024-04-06T12:23:15.869 INFO:tasks.workunit.client.1.smithi195.stdout:5/915: mkdir d0/da/dd/d1c/d5a/d62/d64/d13c 0 2024-04-06T12:23:15.870 INFO:tasks.workunit.client.1.smithi195.stdout:9/868: dwrite d3/d10/d3a/d5d/f113 [0,4194304] 0 2024-04-06T12:23:15.871 INFO:tasks.workunit.client.1.smithi195.stdout:5/916: chown d0/da/d23/dd4 32832040 1 2024-04-06T12:23:15.874 INFO:tasks.workunit.client.1.smithi195.stdout:1/838: unlink d4/d14/d17/d24/d99/d4e/d8f/l113 0 2024-04-06T12:23:15.878 INFO:tasks.workunit.client.1.smithi195.stdout:6/984: truncate d8/f2a 1818365 0 2024-04-06T12:23:15.878 INFO:tasks.workunit.client.1.smithi195.stdout:9/869: chown d3/d10/d7d/dd0/ldc 71736 1 2024-04-06T12:23:15.878 INFO:tasks.workunit.client.1.smithi195.stdout:4/807: creat d4/d6/d38/d1a/d40/d57/ffe x:0 0 0 2024-04-06T12:23:15.878 INFO:tasks.workunit.client.1.smithi195.stdout:3/916: mknod d4/de/d8e/d92/d9e/da4/c131 0 2024-04-06T12:23:15.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/917: creat d0/da/d23/dd4/dc2/f13d x:0 0 0 2024-04-06T12:23:15.878 INFO:tasks.workunit.client.1.smithi195.stdout:2/939: truncate d2/d14/f18 2802681 0 2024-04-06T12:23:15.878 INFO:tasks.workunit.client.1.smithi195.stdout:3/917: stat d4/d53/fc7 0 2024-04-06T12:23:15.881 INFO:tasks.workunit.client.1.smithi195.stdout:6/985: unlink d8/d21/d31/d6c/d7b/l90 0 2024-04-06T12:23:15.882 INFO:tasks.workunit.client.1.smithi195.stdout:1/839: rmdir d4/d14/d17/d3a/da8/db8 39 2024-04-06T12:23:15.882 INFO:tasks.workunit.client.1.smithi195.stdout:3/918: chown d4/d9/d37/db9/d121/d127 6488 1 2024-04-06T12:23:15.883 INFO:tasks.workunit.client.1.smithi195.stdout:7/765: dread d4/d10/f27 [4194304,4194304] 0 2024-04-06T12:23:15.885 INFO:tasks.workunit.client.1.smithi195.stdout:9/870: unlink d3/d10/d3a/d6b/c9f 0 2024-04-06T12:23:15.886 INFO:tasks.workunit.client.1.smithi195.stdout:6/986: fdatasync d8/d3d/d5e/d72/d10c/d9c/faa 0 2024-04-06T12:23:15.886 INFO:tasks.workunit.client.1.smithi195.stdout:7/766: write d4/f7 [866454,83613] 0 2024-04-06T12:23:15.887 INFO:tasks.workunit.client.1.smithi195.stdout:5/918: mknod d0/da/d23/dd4/d106/c13e 0 2024-04-06T12:23:15.888 INFO:tasks.workunit.client.1.smithi195.stdout:8/842: dwrite d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/f9c [0,4194304] 0 2024-04-06T12:23:15.888 INFO:tasks.workunit.client.1.smithi195.stdout:9/871: stat d3/dc6/fbb 0 2024-04-06T12:23:15.888 INFO:tasks.workunit.client.1.smithi195.stdout:2/940: creat d2/d41/d84/d8d/d94/db6/d123/f135 x:0 0 0 2024-04-06T12:23:15.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/840: rmdir d4/d14/d17/d24/d99/d88/d114/d28 39 2024-04-06T12:23:15.899 INFO:tasks.workunit.client.1.smithi195.stdout:7/767: rmdir d4/d10/d12/da5 39 2024-04-06T12:23:15.899 INFO:tasks.workunit.client.1.smithi195.stdout:5/919: chown d0/da/d13/c95 2 1 2024-04-06T12:23:15.900 INFO:tasks.workunit.client.1.smithi195.stdout:1/841: truncate d4/d14/d17/fb9 763344 0 2024-04-06T12:23:15.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/808: rename d4/d6/c69 to d4/d6/d38/d1a/cff 0 2024-04-06T12:23:15.904 INFO:tasks.workunit.client.1.smithi195.stdout:8/843: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/fe0 [986827,108912] 0 2024-04-06T12:23:15.905 INFO:tasks.workunit.client.1.smithi195.stdout:6/987: mkdir d8/d3d/dc1/d105/d176 0 2024-04-06T12:23:15.906 INFO:tasks.workunit.client.1.smithi195.stdout:5/920: mknod d0/da/dd/d33/c13f 0 2024-04-06T12:23:15.907 INFO:tasks.workunit.client.1.smithi195.stdout:1/842: readlink d4/d14/d17/l3c 0 2024-04-06T12:23:15.907 INFO:tasks.workunit.client.1.smithi195.stdout:2/941: symlink d2/d21/d69/l136 0 2024-04-06T12:23:15.911 INFO:tasks.workunit.client.1.smithi195.stdout:4/809: rename d4/d6d to d4/d6/d38/d1a/da7/d100 0 2024-04-06T12:23:15.911 INFO:tasks.workunit.client.1.smithi195.stdout:9/872: dwrite d3/db9/f10d [0,4194304] 0 2024-04-06T12:23:15.913 INFO:tasks.workunit.client.1.smithi195.stdout:4/810: dread - d4/faa zero size 2024-04-06T12:23:15.916 INFO:tasks.workunit.client.1.smithi195.stdout:3/919: getdents d4/d9/d2b 0 2024-04-06T12:23:15.919 INFO:tasks.workunit.client.1.smithi195.stdout:1/843: creat d4/d14/d17/dc1/f116 x:0 0 0 2024-04-06T12:23:15.920 INFO:tasks.workunit.client.1.smithi195.stdout:2/942: dwrite d2/d41/d84/fbc [0,4194304] 0 2024-04-06T12:23:15.921 INFO:tasks.workunit.client.1.smithi195.stdout:5/921: dwrite d0/da/dd/d1c/d5a/d62/d64/f8a [4194304,4194304] 0 2024-04-06T12:23:15.925 INFO:tasks.workunit.client.1.smithi195.stdout:7/768: getdents d4/d10/d18/d19 0 2024-04-06T12:23:15.931 INFO:tasks.workunit.client.1.smithi195.stdout:8/844: mkdir d6/dd/d70/d24/d53/d11c/d11e 0 2024-04-06T12:23:15.933 INFO:tasks.workunit.client.1.smithi195.stdout:4/811: fdatasync d4/d6/d38/d1a/d40/f41 0 2024-04-06T12:23:15.936 INFO:tasks.workunit.client.1.smithi195.stdout:2/943: rename d2/d21/d2c/ff8 to d2/d41/d84/d8d/d94/dbb/f137 0 2024-04-06T12:23:15.938 INFO:tasks.workunit.client.1.smithi195.stdout:7/769: rename d4/d10 to d4/d10/d18/d33/d6e/df4 22 2024-04-06T12:23:15.940 INFO:tasks.workunit.client.1.smithi195.stdout:4/812: chown d4/d6/d38/l8f 156 1 2024-04-06T12:23:15.945 INFO:tasks.workunit.client.1.smithi195.stdout:1/844: dwrite d4/d14/d17/d24/d99/d88/ff4 [0,4194304] 0 2024-04-06T12:23:15.946 INFO:tasks.workunit.client.1.smithi195.stdout:5/922: dwrite d0/da/d23/d38/d107/f13b [0,4194304] 0 2024-04-06T12:23:15.948 INFO:tasks.workunit.client.1.smithi195.stdout:2/944: write d2/d3f/d7d/d7a/f117 [800653,103386] 0 2024-04-06T12:23:15.949 INFO:tasks.workunit.client.1.smithi195.stdout:6/988: rename d8/d21/d2b/d46/d44/df7/f156 to d8/d3d/d5e/dd3/f177 0 2024-04-06T12:23:15.950 INFO:tasks.workunit.client.1.smithi195.stdout:3/920: link d4/df/d39/da7/l101 d4/de/l132 0 2024-04-06T12:23:15.951 INFO:tasks.workunit.client.1.smithi195.stdout:7/770: write d4/d16/dd/d22/d76/f97 [4096957,20878] 0 2024-04-06T12:23:15.955 INFO:tasks.workunit.client.1.smithi195.stdout:5/923: symlink d0/da/d23/dd4/d106/df3/l140 0 2024-04-06T12:23:15.955 INFO:tasks.workunit.client.1.smithi195.stdout:1/845: fdatasync d4/d14/d17/d24/d99/f1d 0 2024-04-06T12:23:15.956 INFO:tasks.workunit.client.1.smithi195.stdout:9/873: dwrite d3/d10/d7d/dee/ff0 [0,4194304] 0 2024-04-06T12:23:15.958 INFO:tasks.workunit.client.1.smithi195.stdout:4/813: dread d4/d6/d38/d1a/d40/f41 [0,4194304] 0 2024-04-06T12:23:15.958 INFO:tasks.workunit.client.1.smithi195.stdout:3/921: write d4/d9/dcf/f110 [1031075,111919] 0 2024-04-06T12:23:15.961 INFO:tasks.workunit.client.1.smithi195.stdout:5/924: write d0/f6 [415356,118164] 0 2024-04-06T12:23:15.961 INFO:tasks.workunit.client.1.smithi195.stdout:1/846: fsync d4/d14/d17/d24/d2a/f54 0 2024-04-06T12:23:15.961 INFO:tasks.workunit.client.1.smithi195.stdout:8/845: dwrite d6/dd/d70/d24/d34/d67/f6c [0,4194304] 0 2024-04-06T12:23:15.962 INFO:tasks.workunit.client.1.smithi195.stdout:9/874: creat d3/dc6/f11f x:0 0 0 2024-04-06T12:23:15.964 INFO:tasks.workunit.client.1.smithi195.stdout:2/945: link d2/d41/d84/d8d/d94/ff9 d2/ddc/deb/f138 0 2024-04-06T12:23:15.965 INFO:tasks.workunit.client.1.smithi195.stdout:4/814: stat d4/d6/d38/d1a/d40/d57 0 2024-04-06T12:23:15.968 INFO:tasks.workunit.client.1.smithi195.stdout:9/875: read d3/da1/fb4 [3554556,2367] 0 2024-04-06T12:23:15.970 INFO:tasks.workunit.client.1.smithi195.stdout:2/946: symlink d2/d41/l139 0 2024-04-06T12:23:15.972 INFO:tasks.workunit.client.1.smithi195.stdout:8/846: rename d6/db/f60 to d6/db/f11f 0 2024-04-06T12:23:15.973 INFO:tasks.workunit.client.1.smithi195.stdout:7/771: dwrite d4/d16/dd/feb [0,4194304] 0 2024-04-06T12:23:15.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/925: mknod d0/da/dd/d1c/d5a/d62/d64/d13c/c141 0 2024-04-06T12:23:15.975 INFO:tasks.workunit.client.1.smithi195.stdout:1/847: creat d4/d14/d17/d24/d99/d4e/de5/f117 x:0 0 0 2024-04-06T12:23:15.976 INFO:tasks.workunit.client.1.smithi195.stdout:8/847: stat d6/dd/d70/d24/d25/l56 0 2024-04-06T12:23:15.977 INFO:tasks.workunit.client.1.smithi195.stdout:3/922: rename d4/de/d8e/d92/d9e/da4/c131 to d4/de/d8e/d92/d9e/da4/d10c/c133 0 2024-04-06T12:23:15.979 INFO:tasks.workunit.client.1.smithi195.stdout:7/772: truncate d4/d24/f1a 880170 0 2024-04-06T12:23:15.980 INFO:tasks.workunit.client.1.smithi195.stdout:9/876: mkdir d3/db9/dbc/d103/d111/d120 0 2024-04-06T12:23:15.982 INFO:tasks.workunit.client.1.smithi195.stdout:2/947: mkdir d2/d21/d29/d13a 0 2024-04-06T12:23:15.984 INFO:tasks.workunit.client.1.smithi195.stdout:5/926: mknod d0/da/d23/d7a/c142 0 2024-04-06T12:23:15.985 INFO:tasks.workunit.client.1.smithi195.stdout:1/848: symlink d4/d14/d17/d24/d99/d88/dec/dda/l118 0 2024-04-06T12:23:15.988 INFO:tasks.workunit.client.1.smithi195.stdout:4/815: link d4/d6/d38/d65/dc5/cea d4/d8c/d96/dc9/df8/c101 0 2024-04-06T12:23:15.988 INFO:tasks.workunit.client.1.smithi195.stdout:5/927: write d0/da/dd/f3b [3490328,74467] 0 2024-04-06T12:23:15.991 INFO:tasks.workunit.client.1.smithi195.stdout:9/877: dwrite d3/da1/fd5 [0,4194304] 0 2024-04-06T12:23:15.992 INFO:tasks.workunit.client.1.smithi195.stdout:7/773: creat d4/d10/ff5 x:0 0 0 2024-04-06T12:23:15.994 INFO:tasks.workunit.client.1.smithi195.stdout:9/878: stat d3/db9/dbc/d103/d50/lc5 0 2024-04-06T12:23:15.995 INFO:tasks.workunit.client.1.smithi195.stdout:4/816: dread d4/d3e/f98 [0,4194304] 0 2024-04-06T12:23:15.997 INFO:tasks.workunit.client.1.smithi195.stdout:3/923: dread d4/d9/d2b/d3b/d5e/d7e/fc6 [0,4194304] 0 2024-04-06T12:23:16.000 INFO:tasks.workunit.client.1.smithi195.stdout:9/879: mknod d3/db9/dbc/d103/d48/c121 0 2024-04-06T12:23:16.003 INFO:tasks.workunit.client.1.smithi195.stdout:4/817: mknod d4/d6/d38/d1a/d40/d20/d23/c102 0 2024-04-06T12:23:16.006 INFO:tasks.workunit.client.1.smithi195.stdout:7/774: creat d4/ff6 x:0 0 0 2024-04-06T12:23:16.008 INFO:tasks.workunit.client.1.smithi195.stdout:9/880: dwrite d3/d10/d7d/dee/df1/ff9 [0,4194304] 0 2024-04-06T12:23:16.010 INFO:tasks.workunit.client.1.smithi195.stdout:9/881: fdatasync d3/d10/d4f/fe4 0 2024-04-06T12:23:16.011 INFO:tasks.workunit.client.1.smithi195.stdout:1/849: write d4/d14/d17/d24/d2a/d5a/daa/f10e [1583791,99116] 0 2024-04-06T12:23:16.014 INFO:tasks.workunit.client.1.smithi195.stdout:9/882: read d3/db9/dbc/d103/d50/f86 [1341622,105533] 0 2024-04-06T12:23:16.015 INFO:tasks.workunit.client.1.smithi195.stdout:7/775: dwrite d4/d10/d12/fb1 [0,4194304] 0 2024-04-06T12:23:16.017 INFO:tasks.workunit.client.1.smithi195.stdout:8/848: dread d6/dd/d70/d118/f4d [4194304,4194304] 0 2024-04-06T12:23:16.020 INFO:tasks.workunit.client.1.smithi195.stdout:1/850: unlink d4/d14/d17/d24/d99/d88/dec/dda/ff2 0 2024-04-06T12:23:16.023 INFO:tasks.workunit.client.1.smithi195.stdout:0/863: sync 2024-04-06T12:23:16.024 INFO:tasks.workunit.client.1.smithi195.stdout:3/924: dwrite d4/f22 [4194304,4194304] 0 2024-04-06T12:23:16.027 INFO:tasks.workunit.client.1.smithi195.stdout:0/864: read d4/dbc/ff3 [823549,22798] 0 2024-04-06T12:23:16.029 INFO:tasks.workunit.client.1.smithi195.stdout:1/851: mkdir d4/d14/d119 0 2024-04-06T12:23:16.030 INFO:tasks.workunit.client.1.smithi195.stdout:9/883: creat d3/db9/f122 x:0 0 0 2024-04-06T12:23:16.031 INFO:tasks.workunit.client.1.smithi195.stdout:1/852: write d4/d14/d17/d24/d99/d88/d114/d5d/db3/fff [124707,39269] 0 2024-04-06T12:23:16.033 INFO:tasks.workunit.client.1.smithi195.stdout:1/853: dread d4/d14/d17/f85 [0,4194304] 0 2024-04-06T12:23:16.034 INFO:tasks.workunit.client.1.smithi195.stdout:8/849: rename d6/dd/d70/d24/c4f to d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/dda/ddb/c120 0 2024-04-06T12:23:16.037 INFO:tasks.workunit.client.1.smithi195.stdout:0/865: creat d4/d6/d58/f115 x:0 0 0 2024-04-06T12:23:16.038 INFO:tasks.workunit.client.1.smithi195.stdout:7/776: truncate d4/d16/dd/feb 928306 0 2024-04-06T12:23:16.038 INFO:tasks.workunit.client.1.smithi195.stdout:7/777: chown d4/d16/f2d 30375 1 2024-04-06T12:23:16.040 INFO:tasks.workunit.client.1.smithi195.stdout:1/854: fsync d4/d14/d17/d24/d99/d88/d114/d28/fb1 0 2024-04-06T12:23:16.041 INFO:tasks.workunit.client.1.smithi195.stdout:0/866: unlink d4/d48/d77/f114 0 2024-04-06T12:23:16.042 INFO:tasks.workunit.client.1.smithi195.stdout:7/778: readlink d4/d16/l3a 0 2024-04-06T12:23:16.042 INFO:tasks.workunit.client.1.smithi195.stdout:9/884: truncate d3/fc1 477664 0 2024-04-06T12:23:16.045 INFO:tasks.workunit.client.1.smithi195.stdout:0/867: mknod d4/d6/d1a/d9f/c116 0 2024-04-06T12:23:16.054 INFO:tasks.workunit.client.1.smithi195.stdout:1/855: creat d4/d14/d17/d24/d99/d88/deb/f11a x:0 0 0 2024-04-06T12:23:16.058 INFO:tasks.workunit.client.1.smithi195.stdout:9/885: dread d3/db9/dbc/d103/d50/f86 [0,4194304] 0 2024-04-06T12:23:16.061 INFO:tasks.workunit.client.1.smithi195.stdout:3/925: dread d4/d9/d37/db9/d121/f114 [0,4194304] 0 2024-04-06T12:23:16.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/856: dwrite d4/d14/d17/d24/d99/d88/d114/d5d/db3/fff [0,4194304] 0 2024-04-06T12:23:16.063 INFO:tasks.workunit.client.1.smithi195.stdout:3/926: chown d4/d9/d2b/d3b/d5e/d7e/f11a 90 1 2024-04-06T12:23:16.063 INFO:tasks.workunit.client.1.smithi195.stdout:1/857: dread - d4/d14/d17/dc1/f116 zero size 2024-04-06T12:23:16.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/927: chown d4/d9/d2b/d77/d9a/def/f11e 11875235 1 2024-04-06T12:23:16.065 INFO:tasks.workunit.client.1.smithi195.stdout:1/858: dread - d4/d14/d17/d3a/da8/fd3 zero size 2024-04-06T12:23:16.069 INFO:tasks.workunit.client.1.smithi195.stdout:1/859: write d4/d14/d17/d24/d99/f4c [957110,46320] 0 2024-04-06T12:23:16.072 INFO:tasks.workunit.client.1.smithi195.stdout:3/928: dwrite d4/de/d8e/d92/d9e/df0/f102 [4194304,4194304] 0 2024-04-06T12:23:16.082 INFO:tasks.workunit.client.1.smithi195.stdout:8/850: getdents d6/dd/d70/d24/d34/d67/dec/d97 0 2024-04-06T12:23:16.083 INFO:tasks.workunit.client.1.smithi195.stdout:0/868: mknod d4/d48/d67/d75/c117 0 2024-04-06T12:23:16.083 INFO:tasks.workunit.client.1.smithi195.stdout:8/851: chown d6/dd/d70/d24/d34/d67/dec/l5c 16364413 1 2024-04-06T12:23:16.084 INFO:tasks.workunit.client.1.smithi195.stdout:9/886: symlink d3/d10/d7d/d105/l123 0 2024-04-06T12:23:16.088 INFO:tasks.workunit.client.1.smithi195.stdout:3/929: rename d4/dc4 to d4/d9/d2b/d3b/d5e/dab/d134 0 2024-04-06T12:23:16.090 INFO:tasks.workunit.client.1.smithi195.stdout:8/852: symlink d6/dd/d70/d24/d34/d67/d9d/dd7/l121 0 2024-04-06T12:23:16.091 INFO:tasks.workunit.client.1.smithi195.stdout:9/887: read d3/db9/dbc/d103/d111/f51 [246952,108776] 0 2024-04-06T12:23:16.092 INFO:tasks.workunit.client.1.smithi195.stdout:8/853: truncate d6/dd/d70/d24/d25/d49/fe9 270014 0 2024-04-06T12:23:16.094 INFO:tasks.workunit.client.1.smithi195.stdout:8/854: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/f8d [1347429,38879] 0 2024-04-06T12:23:16.094 INFO:tasks.workunit.client.1.smithi195.stdout:1/860: link d4/d14/d17/d24/d99/d88/dbf/ld1 d4/d14/d17/d24/d2a/d45/d111/l11b 0 2024-04-06T12:23:16.102 INFO:tasks.workunit.client.1.smithi195.stdout:0/869: getdents d4/d6/d58 0 2024-04-06T12:23:16.102 INFO:tasks.workunit.client.1.smithi195.stdout:0/870: chown d4 23161 1 2024-04-06T12:23:16.104 INFO:tasks.workunit.client.1.smithi195.stdout:1/861: creat d4/d14/d17/f11c x:0 0 0 2024-04-06T12:23:16.108 INFO:tasks.workunit.client.1.smithi195.stdout:0/871: dwrite d4/dd5/ff4 [0,4194304] 0 2024-04-06T12:23:16.109 INFO:tasks.workunit.client.1.smithi195.stdout:0/872: fdatasync d4/d48/d67/d75/f78 0 2024-04-06T12:23:16.114 INFO:tasks.workunit.client.1.smithi195.stdout:3/930: write d4/de/f34 [978524,123143] 0 2024-04-06T12:23:16.114 INFO:tasks.workunit.client.1.smithi195.stdout:8/855: write d6/f91 [1815561,67711] 0 2024-04-06T12:23:16.121 INFO:tasks.workunit.client.1.smithi195.stdout:8/856: mknod d6/dd/d70/d24/d34/d67/d9d/dd7/df5/c122 0 2024-04-06T12:23:16.123 INFO:tasks.workunit.client.1.smithi195.stdout:6/989: sync 2024-04-06T12:23:16.123 INFO:tasks.workunit.client.1.smithi195.stdout:9/888: dwrite d3/dc6/fbb [4194304,4194304] 0 2024-04-06T12:23:16.124 INFO:tasks.workunit.client.1.smithi195.stdout:1/862: dwrite d4/d14/d17/f53 [0,4194304] 0 2024-04-06T12:23:16.132 INFO:tasks.workunit.client.1.smithi195.stdout:6/990: fdatasync d8/d21/d31/d6c/ded/ff3 0 2024-04-06T12:23:16.134 INFO:tasks.workunit.client.1.smithi195.stdout:3/931: dwrite d4/f12 [0,4194304] 0 2024-04-06T12:23:16.137 INFO:tasks.workunit.client.1.smithi195.stdout:1/863: creat d4/d14/d17/d24/d2a/d45/f11d x:0 0 0 2024-04-06T12:23:16.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/991: mknod d8/d3d/d5e/d72/d10c/d32/c178 0 2024-04-06T12:23:16.140 INFO:tasks.workunit.client.1.smithi195.stdout:8/857: dwrite d6/dd/d70/d24/d34/d67/dec/fe7 [0,4194304] 0 2024-04-06T12:23:16.143 INFO:tasks.workunit.client.1.smithi195.stdout:8/858: write d6/dd/d70/d24/d34/d67/da1/da2/f111 [649687,94181] 0 2024-04-06T12:23:16.149 INFO:tasks.workunit.client.1.smithi195.stdout:1/864: getdents d4/d14/d17/d24/d99/d4e/d71 0 2024-04-06T12:23:16.151 INFO:tasks.workunit.client.1.smithi195.stdout:1/865: creat d4/d14/d17/d24/f11e x:0 0 0 2024-04-06T12:23:16.152 INFO:tasks.workunit.client.1.smithi195.stdout:1/866: chown d4/d14/d17/d3a 423 1 2024-04-06T12:23:16.154 INFO:tasks.workunit.client.1.smithi195.stdout:1/867: fdatasync d4/d14/d17/d3a/da8/db8/fc8 0 2024-04-06T12:23:16.156 INFO:tasks.workunit.client.1.smithi195.stdout:1/868: creat d4/d14/d17/d24/d2a/d10a/f11f x:0 0 0 2024-04-06T12:23:16.159 INFO:tasks.workunit.client.1.smithi195.stdout:1/869: symlink d4/d14/d17/d24/l120 0 2024-04-06T12:23:16.162 INFO:tasks.workunit.client.1.smithi195.stdout:9/889: dread d3/d10/f22 [0,4194304] 0 2024-04-06T12:23:16.164 INFO:tasks.workunit.client.1.smithi195.stdout:1/870: creat d4/d14/d17/d3a/da8/da4/f121 x:0 0 0 2024-04-06T12:23:16.165 INFO:tasks.workunit.client.1.smithi195.stdout:6/992: dwrite d8/d3d/fd2 [0,4194304] 0 2024-04-06T12:23:16.166 INFO:tasks.workunit.client.1.smithi195.stdout:8/859: dwrite d6/dd/d70/d24/d25/d7c/fa9 [0,4194304] 0 2024-04-06T12:23:16.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/993: write d8/d21/d31/d26/fb1 [3861067,111787] 0 2024-04-06T12:23:16.170 INFO:tasks.workunit.client.1.smithi195.stdout:8/860: read d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/f26 [6510804,13650] 0 2024-04-06T12:23:16.172 INFO:tasks.workunit.client.1.smithi195.stdout:1/871: creat d4/d14/d17/dc1/f122 x:0 0 0 2024-04-06T12:23:16.174 INFO:tasks.workunit.client.1.smithi195.stdout:9/890: link d3/db9/dbc/d103/d48/f11e d3/d10/f124 0 2024-04-06T12:23:16.176 INFO:tasks.workunit.client.1.smithi195.stdout:1/872: mkdir d4/d14/d17/d24/d99/d88/d114/d5d/db3/de4/d123 0 2024-04-06T12:23:16.177 INFO:tasks.workunit.client.1.smithi195.stdout:6/994: read d8/d3d/d5e/d72/d10c/d9c/faa [2616059,14080] 0 2024-04-06T12:23:16.180 INFO:tasks.workunit.client.1.smithi195.stdout:9/891: rename d3/cd7 to d3/da1/c125 0 2024-04-06T12:23:16.181 INFO:tasks.workunit.client.1.smithi195.stdout:1/873: creat d4/d14/d17/d24/d99/d88/dec/f124 x:0 0 0 2024-04-06T12:23:16.183 INFO:tasks.workunit.client.1.smithi195.stdout:1/874: write d4/d14/d17/d3a/da8/fae [1154240,111573] 0 2024-04-06T12:23:16.184 INFO:tasks.workunit.client.1.smithi195.stdout:8/861: write d6/dd/d70/d118/d46/fa6 [2878706,118687] 0 2024-04-06T12:23:16.187 INFO:tasks.workunit.client.1.smithi195.stdout:1/875: mkdir d4/d14/d17/d3a/da8/da4/d125 0 2024-04-06T12:23:16.189 INFO:tasks.workunit.client.1.smithi195.stdout:8/862: unlink d6/dd/d70/d24/d34/d67/dec/f77 0 2024-04-06T12:23:16.189 INFO:tasks.workunit.client.1.smithi195.stdout:6/995: dread d8/d21/d2b/d46/d44/f7d [0,4194304] 0 2024-04-06T12:23:16.190 INFO:tasks.workunit.client.1.smithi195.stdout:1/876: mkdir d4/d14/d17/d24/d99/d4e/d8f/d126 0 2024-04-06T12:23:16.191 INFO:tasks.workunit.client.1.smithi195.stdout:1/877: fsync d4/d14/d17/d24/d2a/d10a/f11f 0 2024-04-06T12:23:16.194 INFO:tasks.workunit.client.1.smithi195.stdout:9/892: truncate d3/d10/d7d/dee/ff0 2083538 0 2024-04-06T12:23:16.194 INFO:tasks.workunit.client.1.smithi195.stdout:9/893: readlink d3/db9/dbc/d103/l4c 0 2024-04-06T12:23:16.195 INFO:tasks.workunit.client.1.smithi195.stdout:8/863: getdents d6/dd/d70/d24/d34/d67/dec/d4b 0 2024-04-06T12:23:16.197 INFO:tasks.workunit.client.1.smithi195.stdout:1/878: dread d4/d14/d17/d24/d2a/d5a/daa/fad [0,4194304] 0 2024-04-06T12:23:16.198 INFO:tasks.workunit.client.1.smithi195.stdout:6/996: dread d8/d21/d31/d49/f51 [0,4194304] 0 2024-04-06T12:23:16.200 INFO:tasks.workunit.client.1.smithi195.stdout:6/997: fsync d8/d21/d2b/d46/d44/f135 0 2024-04-06T12:23:16.201 INFO:tasks.workunit.client.1.smithi195.stdout:8/864: dread d6/dd/d70/d24/d25/f2a [0,4194304] 0 2024-04-06T12:23:16.205 INFO:tasks.workunit.client.1.smithi195.stdout:6/998: dread - d8/d21/d2b/d46/d44/df7/f15c zero size 2024-04-06T12:23:16.207 INFO:tasks.workunit.client.1.smithi195.stdout:9/894: dwrite d3/db9/dbc/d103/d111/d102/f118 [0,4194304] 0 2024-04-06T12:23:16.207 INFO:tasks.workunit.client.1.smithi195.stdout:1/879: dwrite d4/d14/d17/dc1/f116 [0,4194304] 0 2024-04-06T12:23:16.211 INFO:tasks.workunit.client.1.smithi195.stdout:9/895: truncate d3/db9/dbc/d103/d48/d5e/ffc 721352 0 2024-04-06T12:23:16.211 INFO:tasks.workunit.client.1.smithi195.stdout:8/865: truncate d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d83/f113 648876 0 2024-04-06T12:23:16.211 INFO:tasks.workunit.client.1.smithi195.stdout:6/999: creat d8/d21/d31/d157/f179 x:0 0 0 2024-04-06T12:23:16.215 INFO:tasks.workunit.client.1.smithi195.stdout:1/880: getdents d4/d14/d17/d24/d99/d88/dec 0 2024-04-06T12:23:16.216 INFO:tasks.workunit.client.1.smithi195.stdout:9/896: creat d3/db9/dbc/d103/f126 x:0 0 0 2024-04-06T12:23:16.219 INFO:tasks.workunit.client.1.smithi195.stdout:9/897: chown d3/db9/le3 65196112 1 2024-04-06T12:23:16.219 INFO:tasks.workunit.client.1.smithi195.stdout:8/866: dwrite d6/dd/d70/d118/fd1 [0,4194304] 0 2024-04-06T12:23:16.223 INFO:tasks.workunit.client.1.smithi195.stdout:8/867: rmdir d6/dd/d42 39 2024-04-06T12:23:16.227 INFO:tasks.workunit.client.1.smithi195.stdout:9/898: read d3/db9/dbc/d103/d111/f58 [2332768,99125] 0 2024-04-06T12:23:16.229 INFO:tasks.workunit.client.1.smithi195.stdout:1/881: dwrite d4/d14/d17/d3a/da8/fd3 [0,4194304] 0 2024-04-06T12:23:16.229 INFO:tasks.workunit.client.1.smithi195.stdout:9/899: read d3/f17 [744031,52261] 0 2024-04-06T12:23:16.229 INFO:tasks.workunit.client.1.smithi195.stdout:8/868: mkdir d6/dd/d70/d24/d25/d7c/d123 0 2024-04-06T12:23:16.233 INFO:tasks.workunit.client.1.smithi195.stdout:1/882: unlink d4/d14/d17/d24/d2a/d5a/daa/f10e 0 2024-04-06T12:23:16.235 INFO:tasks.workunit.client.1.smithi195.stdout:8/869: chown d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/f37 8107794 1 2024-04-06T12:23:16.239 INFO:tasks.workunit.client.1.smithi195.stdout:1/883: rename d4/d14/d17/d24/d99/d4e/d8f/ld9 to d4/d14/d17/d24/d99/d4e/de5/l127 0 2024-04-06T12:23:16.241 INFO:tasks.workunit.client.1.smithi195.stdout:1/884: chown d4/d14/d17/d24/d99/d88/d114/d5d/fa6 25 1 2024-04-06T12:23:16.241 INFO:tasks.workunit.client.1.smithi195.stdout:9/900: truncate d3/d10/d3a/d5d/f113 2358671 0 2024-04-06T12:23:16.242 INFO:tasks.workunit.client.1.smithi195.stdout:8/870: dwrite d6/f10d [0,4194304] 0 2024-04-06T12:23:16.245 INFO:tasks.workunit.client.1.smithi195.stdout:5/928: sync 2024-04-06T12:23:16.245 INFO:tasks.workunit.client.1.smithi195.stdout:4/818: sync 2024-04-06T12:23:16.245 INFO:tasks.workunit.client.1.smithi195.stdout:2/948: sync 2024-04-06T12:23:16.247 INFO:tasks.workunit.client.1.smithi195.stdout:8/871: symlink d6/dd/d70/d24/d34/d67/l124 0 2024-04-06T12:23:16.247 INFO:tasks.workunit.client.1.smithi195.stdout:1/885: creat d4/d14/d17/d24/d99/d88/f128 x:0 0 0 2024-04-06T12:23:16.251 INFO:tasks.workunit.client.1.smithi195.stdout:5/929: symlink d0/da/dd/d1c/d5a/d62/d64/d13c/l143 0 2024-04-06T12:23:16.252 INFO:tasks.workunit.client.1.smithi195.stdout:8/872: mknod d6/dd/d70/d24/d25/d7c/d123/c125 0 2024-04-06T12:23:16.254 INFO:tasks.workunit.client.1.smithi195.stdout:5/930: fdatasync d0/da/d4b/f117 0 2024-04-06T12:23:16.254 INFO:tasks.workunit.client.1.smithi195.stdout:9/901: dwrite d3/db9/dbc/d103/d48/d9c/f8c [0,4194304] 0 2024-04-06T12:23:16.256 INFO:tasks.workunit.client.1.smithi195.stdout:1/886: creat d4/d14/d17/d24/d99/d4e/d71/f129 x:0 0 0 2024-04-06T12:23:16.257 INFO:tasks.workunit.client.1.smithi195.stdout:2/949: dwrite d2/d3f/d7d/d7a/f133 [0,4194304] 0 2024-04-06T12:23:16.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/819: write d4/d6/d38/f5d [253487,129927] 0 2024-04-06T12:23:16.265 INFO:tasks.workunit.client.1.smithi195.stdout:9/902: rename d3/d10/d7d/dd0/ldc to d3/d10/d7d/d105/d110/l127 0 2024-04-06T12:23:16.266 INFO:tasks.workunit.client.1.smithi195.stdout:2/950: mknod d2/d14/c13b 0 2024-04-06T12:23:16.267 INFO:tasks.workunit.client.1.smithi195.stdout:4/820: creat d4/d3e/f103 x:0 0 0 2024-04-06T12:23:16.269 INFO:tasks.workunit.client.1.smithi195.stdout:4/821: fdatasync d4/d6/d38/d1a/da7/d100/da6/dae/dec/fee 0 2024-04-06T12:23:16.270 INFO:tasks.workunit.client.1.smithi195.stdout:9/903: dread d3/db9/dbc/d103/d48/d9c/f91 [0,4194304] 0 2024-04-06T12:23:16.271 INFO:tasks.workunit.client.1.smithi195.stdout:2/951: mkdir d2/d21/d5e/d105/d12a/d13c 0 2024-04-06T12:23:16.272 INFO:tasks.workunit.client.1.smithi195.stdout:4/822: unlink d4/d6/d38/d1a/l30 0 2024-04-06T12:23:16.273 INFO:tasks.workunit.client.1.smithi195.stdout:4/823: write d4/d6/d38/d1a/fd7 [634401,62996] 0 2024-04-06T12:23:16.273 INFO:tasks.workunit.client.1.smithi195.stdout:2/952: symlink d2/d21/d5e/d105/d12a/d13c/l13d 0 2024-04-06T12:23:16.277 INFO:tasks.workunit.client.1.smithi195.stdout:4/824: truncate d4/d6/d38/d1a/da7/d100/da6/dae/dec/fee 839843 0 2024-04-06T12:23:16.277 INFO:tasks.workunit.client.1.smithi195.stdout:4/825: chown d4/d8c/d96/dc6/fc8 865 1 2024-04-06T12:23:16.282 INFO:tasks.workunit.client.1.smithi195.stdout:4/826: mknod d4/d6/d38/d1a/d40/ded/c104 0 2024-04-06T12:23:16.285 INFO:tasks.workunit.client.1.smithi195.stdout:8/873: dwrite d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d61/f81 [0,4194304] 0 2024-04-06T12:23:16.287 INFO:tasks.workunit.client.1.smithi195.stdout:1/887: dwrite d4/d14/d17/d3a/da8/f3f [0,4194304] 0 2024-04-06T12:23:16.290 INFO:tasks.workunit.client.1.smithi195.stdout:1/888: mkdir d4/df0/d12a 0 2024-04-06T12:23:16.290 INFO:tasks.workunit.client.1.smithi195.stdout:2/953: dwrite d2/d3f/f80 [0,4194304] 0 2024-04-06T12:23:16.293 INFO:tasks.workunit.client.1.smithi195.stdout:8/874: creat d6/dd/d70/d118/f126 x:0 0 0 2024-04-06T12:23:16.294 INFO:tasks.workunit.client.1.smithi195.stdout:4/827: truncate d4/f88 691355 0 2024-04-06T12:23:16.295 INFO:tasks.workunit.client.1.smithi195.stdout:9/904: dread d3/db9/dbc/d103/d48/f49 [0,4194304] 0 2024-04-06T12:23:16.295 INFO:tasks.workunit.client.1.smithi195.stdout:1/889: dread - d4/d14/d17/d24/d99/d4e/d8f/fa7 zero size 2024-04-06T12:23:16.300 INFO:tasks.workunit.client.1.smithi195.stdout:8/875: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/f8d [3501209,31369] 0 2024-04-06T12:23:16.301 INFO:tasks.workunit.client.1.smithi195.stdout:4/828: mknod d4/d6/d38/d65/d7a/c105 0 2024-04-06T12:23:16.304 INFO:tasks.workunit.client.1.smithi195.stdout:9/905: mknod d3/db9/dbc/d103/d111/c128 0 2024-04-06T12:23:16.305 INFO:tasks.workunit.client.1.smithi195.stdout:2/954: mkdir d2/d41/d84/d8d/d94/db6/d119/d13e 0 2024-04-06T12:23:16.305 INFO:tasks.workunit.client.1.smithi195.stdout:4/829: creat d4/d8c/f106 x:0 0 0 2024-04-06T12:23:16.307 INFO:tasks.workunit.client.1.smithi195.stdout:8/876: truncate d6/dd/f38 3207309 0 2024-04-06T12:23:16.308 INFO:tasks.workunit.client.1.smithi195.stdout:9/906: chown d3/db9/dbc/d103/d111/laa 2 1 2024-04-06T12:23:16.308 INFO:tasks.workunit.client.1.smithi195.stdout:1/890: dwrite d4/d14/d17/fb9 [0,4194304] 0 2024-04-06T12:23:16.309 INFO:tasks.workunit.client.1.smithi195.stdout:4/830: truncate d4/d6/d38/d1a/fce 582489 0 2024-04-06T12:23:16.311 INFO:tasks.workunit.client.1.smithi195.stdout:9/907: rmdir d3/dd3 39 2024-04-06T12:23:16.317 INFO:tasks.workunit.client.1.smithi195.stdout:4/831: rename d4/d8c/d96 to d4/d6/d38/d1a/d40/d20/d107 0 2024-04-06T12:23:16.318 INFO:tasks.workunit.client.1.smithi195.stdout:2/955: dread d2/d41/d84/fdb [0,4194304] 0 2024-04-06T12:23:16.319 INFO:tasks.workunit.client.1.smithi195.stdout:4/832: write d4/d8c/f106 [349226,26543] 0 2024-04-06T12:23:16.320 INFO:tasks.workunit.client.1.smithi195.stdout:1/891: dwrite d4/d14/d17/d24/d2a/fde [0,4194304] 0 2024-04-06T12:23:16.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/908: truncate d3/dc6/fbb 7609080 0 2024-04-06T12:23:16.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/909: stat d3/d10/d4f 0 2024-04-06T12:23:16.336 INFO:tasks.workunit.client.1.smithi195.stdout:2/956: dwrite d2/d14/fb1 [0,4194304] 0 2024-04-06T12:23:16.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/873: sync 2024-04-06T12:23:16.337 INFO:tasks.workunit.client.1.smithi195.stdout:7/779: sync 2024-04-06T12:23:16.337 INFO:tasks.workunit.client.1.smithi195.stdout:4/833: dwrite d4/d6/d38/d1a/da7/d100/ffd [0,4194304] 0 2024-04-06T12:23:16.341 INFO:tasks.workunit.client.1.smithi195.stdout:0/874: mknod d4/d6/d2f/c118 0 2024-04-06T12:23:16.343 INFO:tasks.workunit.client.1.smithi195.stdout:4/834: mknod d4/d6/d38/d65/dc5/df1/c108 0 2024-04-06T12:23:16.349 INFO:tasks.workunit.client.1.smithi195.stdout:0/875: truncate d4/d6/f109 530289 0 2024-04-06T12:23:16.349 INFO:tasks.workunit.client.1.smithi195.stdout:9/910: dwrite d3/db9/dbc/d103/d111/f58 [0,4194304] 0 2024-04-06T12:23:16.352 INFO:tasks.workunit.client.1.smithi195.stdout:2/957: dwrite d2/d3f/d7d/f73 [0,4194304] 0 2024-04-06T12:23:16.360 INFO:tasks.workunit.client.1.smithi195.stdout:1/892: dread d4/d14/d17/d3a/da8/f33 [4194304,4194304] 0 2024-04-06T12:23:16.361 INFO:tasks.workunit.client.1.smithi195.stdout:2/958: write d2/d41/fb9 [1402839,56530] 0 2024-04-06T12:23:16.365 INFO:tasks.workunit.client.1.smithi195.stdout:1/893: creat d4/d14/d17/d3a/da8/da4/f12b x:0 0 0 2024-04-06T12:23:16.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/876: dread d4/dbc/fc2 [0,4194304] 0 2024-04-06T12:23:16.366 INFO:tasks.workunit.client.1.smithi195.stdout:9/911: link d3/db9/dbc/d103/d111/lad d3/db9/dbc/d103/d50/l129 0 2024-04-06T12:23:16.366 INFO:tasks.workunit.client.1.smithi195.stdout:2/959: read - d2/d21/d2c/d2d/f11b zero size 2024-04-06T12:23:16.370 INFO:tasks.workunit.client.1.smithi195.stdout:4/835: dwrite d4/d6/d38/d1a/d40/d20/f6e [0,4194304] 0 2024-04-06T12:23:16.370 INFO:tasks.workunit.client.1.smithi195.stdout:1/894: readlink d4/d14/d17/d24/d2a/d5a/daa/l105 0 2024-04-06T12:23:16.371 INFO:tasks.workunit.client.1.smithi195.stdout:9/912: creat d3/d10/d7d/dd0/f12a x:0 0 0 2024-04-06T12:23:16.373 INFO:tasks.workunit.client.1.smithi195.stdout:2/960: rmdir d2/ddc/d101 0 2024-04-06T12:23:16.374 INFO:tasks.workunit.client.1.smithi195.stdout:4/836: write d4/d6/d38/d1a/da7/d100/da6/dae/fb4 [3178031,108984] 0 2024-04-06T12:23:16.376 INFO:tasks.workunit.client.1.smithi195.stdout:0/877: dread d4/d53/d81/f88 [0,4194304] 0 2024-04-06T12:23:16.378 INFO:tasks.workunit.client.1.smithi195.stdout:1/895: mkdir d4/d14/d17/d24/d99/d88/d114/d5d/d12c 0 2024-04-06T12:23:16.378 INFO:tasks.workunit.client.1.smithi195.stdout:9/913: unlink d3/db9/dbc/d103/d48/f4a 0 2024-04-06T12:23:16.378 INFO:tasks.workunit.client.1.smithi195.stdout:0/878: write d4/d6/d58/da7/dc6/fea [177970,62126] 0 2024-04-06T12:23:16.378 INFO:tasks.workunit.client.1.smithi195.stdout:4/837: creat d4/d8c/f109 x:0 0 0 2024-04-06T12:23:16.380 INFO:tasks.workunit.client.1.smithi195.stdout:4/838: chown d4/d6/d38/d1a/d40/f15 22 1 2024-04-06T12:23:16.381 INFO:tasks.workunit.client.1.smithi195.stdout:0/879: rmdir d4/d48/d4e/dfd 39 2024-04-06T12:23:16.381 INFO:tasks.workunit.client.1.smithi195.stdout:1/896: truncate d4/d14/d17/d24/d99/d88/d114/d5d/fa6 489901 0 2024-04-06T12:23:16.382 INFO:tasks.workunit.client.1.smithi195.stdout:9/914: symlink d3/db9/dbc/l12b 0 2024-04-06T12:23:16.382 INFO:tasks.workunit.client.1.smithi195.stdout:2/961: getdents d2/d41/d84/d8d/dce 0 2024-04-06T12:23:16.383 INFO:tasks.workunit.client.1.smithi195.stdout:0/880: creat d4/f119 x:0 0 0 2024-04-06T12:23:16.386 INFO:tasks.workunit.client.1.smithi195.stdout:9/915: write d3/d10/d7d/dd0/fe1 [177305,43968] 0 2024-04-06T12:23:16.388 INFO:tasks.workunit.client.1.smithi195.stdout:0/881: write d4/d48/d67/d83/fdb [1045910,101638] 0 2024-04-06T12:23:16.391 INFO:tasks.workunit.client.1.smithi195.stdout:2/962: creat d2/d41/d5a/ddd/f13f x:0 0 0 2024-04-06T12:23:16.392 INFO:tasks.workunit.client.1.smithi195.stdout:9/916: unlink d3/db9/f122 0 2024-04-06T12:23:16.392 INFO:tasks.workunit.client.1.smithi195.stdout:0/882: dread - d4/dbc/de2/d10c/f113 zero size 2024-04-06T12:23:16.393 INFO:tasks.workunit.client.1.smithi195.stdout:4/839: dwrite d4/d6/d38/d1a/da7/ffb [0,4194304] 0 2024-04-06T12:23:16.394 INFO:tasks.workunit.client.1.smithi195.stdout:1/897: dwrite d4/d14/d17/d3a/da8/db8/fe2 [0,4194304] 0 2024-04-06T12:23:16.395 INFO:tasks.workunit.client.1.smithi195.stdout:4/840: dread - d4/d8c/f109 zero size 2024-04-06T12:23:16.398 INFO:tasks.workunit.client.1.smithi195.stdout:1/898: write d4/d14/d17/d3a/da8/f3f [2545177,53280] 0 2024-04-06T12:23:16.398 INFO:tasks.workunit.client.1.smithi195.stdout:0/883: fsync d4/d6/f20 0 2024-04-06T12:23:16.400 INFO:tasks.workunit.client.1.smithi195.stdout:9/917: write d3/dd3/fe6 [3809895,81085] 0 2024-04-06T12:23:16.402 INFO:tasks.workunit.client.1.smithi195.stdout:9/918: stat d3/db9/dbc/d103/l98 0 2024-04-06T12:23:16.404 INFO:tasks.workunit.client.1.smithi195.stdout:0/884: dread d4/d6/d2f/d49/f52 [0,4194304] 0 2024-04-06T12:23:16.406 INFO:tasks.workunit.client.1.smithi195.stdout:2/963: creat d2/d41/d84/d8d/d94/db6/d119/d13e/f140 x:0 0 0 2024-04-06T12:23:16.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/899: rmdir d4/d14/d17/dd4 39 2024-04-06T12:23:16.409 INFO:tasks.workunit.client.1.smithi195.stdout:9/919: read d3/d10/f89 [176340,38597] 0 2024-04-06T12:23:16.410 INFO:tasks.workunit.client.1.smithi195.stdout:1/900: fsync d4/d14/d17/d24/d99/f29 0 2024-04-06T12:23:16.410 INFO:tasks.workunit.client.1.smithi195.stdout:4/841: write d4/d6/d38/f2c [700594,6568] 0 2024-04-06T12:23:16.411 INFO:tasks.workunit.client.1.smithi195.stdout:0/885: dwrite d4/d6/f27 [0,4194304] 0 2024-04-06T12:23:16.413 INFO:tasks.workunit.client.1.smithi195.stdout:9/920: write d3/d10/d7d/dee/df1/ff9 [4571781,91066] 0 2024-04-06T12:23:16.417 INFO:tasks.workunit.client.1.smithi195.stdout:9/921: creat d3/d10/d7d/d105/f12c x:0 0 0 2024-04-06T12:23:16.417 INFO:tasks.workunit.client.1.smithi195.stdout:1/901: read d4/d14/d17/d24/d99/f29 [622417,97419] 0 2024-04-06T12:23:16.419 INFO:tasks.workunit.client.1.smithi195.stdout:4/842: link d4/d6/d38/d1a/d40/f41 d4/d8c/f10a 0 2024-04-06T12:23:16.423 INFO:tasks.workunit.client.1.smithi195.stdout:4/843: mkdir d4/d6/d38/d65/d10b 0 2024-04-06T12:23:16.425 INFO:tasks.workunit.client.1.smithi195.stdout:9/922: dwrite d3/f43 [4194304,4194304] 0 2024-04-06T12:23:16.427 INFO:tasks.workunit.client.1.smithi195.stdout:1/902: link d4/d14/d17/d24/d99/d88/dec/f124 d4/d14/d17/d24/d99/d88/d114/d5d/db3/de4/d123/f12d 0 2024-04-06T12:23:16.430 INFO:tasks.workunit.client.1.smithi195.stdout:9/923: unlink d3/d10/d4f/fea 0 2024-04-06T12:23:16.431 INFO:tasks.workunit.client.1.smithi195.stdout:1/903: stat d4/d14/d17/d24/d99/d88/dec 0 2024-04-06T12:23:16.434 INFO:tasks.workunit.client.1.smithi195.stdout:9/924: stat d3/db9/dbc/d103/d48/d9c/f84 0 2024-04-06T12:23:16.438 INFO:tasks.workunit.client.1.smithi195.stdout:4/844: dwrite d4/d6/d38/d1a/d40/d57/fe2 [0,4194304] 0 2024-04-06T12:23:16.444 INFO:tasks.workunit.client.1.smithi195.stdout:9/925: dread d3/db9/dbc/d103/d48/d5e/fe9 [0,4194304] 0 2024-04-06T12:23:16.444 INFO:tasks.workunit.client.1.smithi195.stdout:1/904: dwrite d4/d14/d17/d24/d2a/f109 [0,4194304] 0 2024-04-06T12:23:16.445 INFO:tasks.workunit.client.1.smithi195.stdout:3/932: sync 2024-04-06T12:23:16.446 INFO:tasks.workunit.client.1.smithi195.stdout:2/964: dread d2/d21/d2c/d2d/f76 [0,4194304] 0 2024-04-06T12:23:16.446 INFO:tasks.workunit.client.1.smithi195.stdout:1/905: dread - d4/d14/d17/d24/d2a/fe3 zero size 2024-04-06T12:23:16.447 INFO:tasks.workunit.client.1.smithi195.stdout:2/965: chown d2/d3f/ccc 11371 1 2024-04-06T12:23:16.448 INFO:tasks.workunit.client.1.smithi195.stdout:1/906: chown d4/d14/d17/d24/d2a/d5a/daa/lb4 38642708 1 2024-04-06T12:23:16.448 INFO:tasks.workunit.client.1.smithi195.stdout:3/933: write d4/d9/f49 [850713,120666] 0 2024-04-06T12:23:16.449 INFO:tasks.workunit.client.1.smithi195.stdout:2/966: write d2/d3f/d7d/d7a/f91 [894072,104334] 0 2024-04-06T12:23:16.451 INFO:tasks.workunit.client.1.smithi195.stdout:3/934: chown d4/d9/d2b/d87/la5 742239 1 2024-04-06T12:23:16.452 INFO:tasks.workunit.client.1.smithi195.stdout:1/907: creat d4/d14/d17/d24/d2a/d45/f12e x:0 0 0 2024-04-06T12:23:16.456 INFO:tasks.workunit.client.1.smithi195.stdout:3/935: symlink d4/de/dc8/l135 0 2024-04-06T12:23:16.457 INFO:tasks.workunit.client.1.smithi195.stdout:2/967: truncate d2/d3f/d7d/d5d/f7c 58900 0 2024-04-06T12:23:16.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/845: dread d4/d6/d38/d1a/d40/d20/f9c [0,4194304] 0 2024-04-06T12:23:16.477 INFO:tasks.workunit.client.1.smithi195.stdout:1/908: creat d4/d14/d17/d24/d99/d88/f12f x:0 0 0 2024-04-06T12:23:16.478 INFO:tasks.workunit.client.1.smithi195.stdout:9/926: dread d3/db9/dbc/d103/d48/f4b [0,4194304] 0 2024-04-06T12:23:16.480 INFO:tasks.workunit.client.1.smithi195.stdout:4/846: rename d4/d6/d38/d65/d7a to d4/d6/d38/d1a/d40/d57/d10c 0 2024-04-06T12:23:16.482 INFO:tasks.workunit.client.1.smithi195.stdout:1/909: chown d4/d14/d17/d24/d2a/d45/d111/l11b 0 1 2024-04-06T12:23:16.482 INFO:tasks.workunit.client.1.smithi195.stdout:9/927: creat d3/dc6/f12d x:0 0 0 2024-04-06T12:23:16.483 INFO:tasks.workunit.client.1.smithi195.stdout:4/847: mknod d4/d6/d38/d1a/da7/d100/d85/c10d 0 2024-04-06T12:23:16.484 INFO:tasks.workunit.client.1.smithi195.stdout:2/968: write d2/d14/f18 [3743073,82697] 0 2024-04-06T12:23:16.485 INFO:tasks.workunit.client.1.smithi195.stdout:9/928: unlink d3/d10/d3a/l59 0 2024-04-06T12:23:16.485 INFO:tasks.workunit.client.1.smithi195.stdout:1/910: truncate d4/d14/d17/d3a/da8/da4/f12b 1008166 0 2024-04-06T12:23:16.487 INFO:tasks.workunit.client.1.smithi195.stdout:4/848: write d4/d6/d38/d1a/d40/d57/d64/f7d [1139435,55632] 0 2024-04-06T12:23:16.488 INFO:tasks.workunit.client.1.smithi195.stdout:9/929: truncate d3/dc6/f12d 838031 0 2024-04-06T12:23:16.492 INFO:tasks.workunit.client.1.smithi195.stdout:3/936: dread d4/df/d39/f47 [0,4194304] 0 2024-04-06T12:23:16.544 INFO:tasks.workunit.client.1.smithi195.stdout:1/911: dread d4/d14/d17/dc1/f116 [0,4194304] 0 2024-04-06T12:23:16.544 INFO:tasks.workunit.client.1.smithi195.stdout:2/969: dwrite d2/d21/d2c/dc9/f122 [0,4194304] 0 2024-04-06T12:23:16.544 INFO:tasks.workunit.client.1.smithi195.stdout:9/930: link d3/da1/le8 d3/db9/dbc/d103/d111/l12e 0 2024-04-06T12:23:16.546 INFO:tasks.workunit.client.1.smithi195.stdout:9/931: read - d3/d10/d7d/dee/f112 zero size 2024-04-06T12:23:16.551 INFO:tasks.workunit.client.1.smithi195.stdout:1/912: rmdir d4/d14/d17/d24/d99 39 2024-04-06T12:23:16.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/970: symlink d2/d21/d5e/d105/l141 0 2024-04-06T12:23:16.556 INFO:tasks.workunit.client.1.smithi195.stdout:9/932: truncate d3/db9/dbc/d103/d111/f7b 1660920 0 2024-04-06T12:23:16.556 INFO:tasks.workunit.client.1.smithi195.stdout:2/971: chown d2/d21/cb3 56299 1 2024-04-06T12:23:16.559 INFO:tasks.workunit.client.1.smithi195.stdout:9/933: creat d3/f12f x:0 0 0 2024-04-06T12:23:16.559 INFO:tasks.workunit.client.1.smithi195.stdout:3/937: dwrite d4/de/d8e/fec [0,4194304] 0 2024-04-06T12:23:16.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/913: rename d4/d14/d17/d24/l2e to d4/d14/d17/d24/d99/d4e/d8f/l130 0 2024-04-06T12:23:16.562 INFO:tasks.workunit.client.1.smithi195.stdout:2/972: write d2/d41/d84/fdb [1898198,59326] 0 2024-04-06T12:23:16.567 INFO:tasks.workunit.client.1.smithi195.stdout:9/934: symlink d3/db9/l130 0 2024-04-06T12:23:16.568 INFO:tasks.workunit.client.1.smithi195.stdout:2/973: mknod d2/d21/d5e/d64/c142 0 2024-04-06T12:23:16.570 INFO:tasks.workunit.client.1.smithi195.stdout:1/914: dwrite d4/d14/d17/d3a/da8/f33 [0,4194304] 0 2024-04-06T12:23:16.570 INFO:tasks.workunit.client.1.smithi195.stdout:3/938: rename d4/de/fe5 to d4/d9/d2b/d3b/d40/f136 0 2024-04-06T12:23:16.571 INFO:tasks.workunit.client.1.smithi195.stdout:3/939: chown d4/df/c1d 16165 1 2024-04-06T12:23:16.572 INFO:tasks.workunit.client.1.smithi195.stdout:3/940: readlink d4/d9/d2b/d3b/d5e/lee 0 2024-04-06T12:23:16.574 INFO:tasks.workunit.client.1.smithi195.stdout:5/931: sync 2024-04-06T12:23:16.574 INFO:tasks.workunit.client.1.smithi195.stdout:2/974: rmdir d2/d21/d2c/d2d/d92/d95/d9b 39 2024-04-06T12:23:16.574 INFO:tasks.workunit.client.1.smithi195.stdout:7/780: sync 2024-04-06T12:23:16.575 INFO:tasks.workunit.client.1.smithi195.stdout:8/877: sync 2024-04-06T12:23:16.575 INFO:tasks.workunit.client.1.smithi195.stdout:1/915: creat d4/d14/d17/d24/d2a/d45/f131 x:0 0 0 2024-04-06T12:23:16.576 INFO:tasks.workunit.client.1.smithi195.stdout:9/935: creat d3/db9/dbc/d103/f131 x:0 0 0 2024-04-06T12:23:16.578 INFO:tasks.workunit.client.1.smithi195.stdout:3/941: creat d4/d9/d2b/d3b/d5e/f137 x:0 0 0 2024-04-06T12:23:16.578 INFO:tasks.workunit.client.1.smithi195.stdout:2/975: mkdir d2/d3f/d143 0 2024-04-06T12:23:16.579 INFO:tasks.workunit.client.1.smithi195.stdout:1/916: stat d4/d14/d17/d24/d99/d88/dbf 0 2024-04-06T12:23:16.579 INFO:tasks.workunit.client.1.smithi195.stdout:9/936: dread - d3/db9/dbc/d103/f126 zero size 2024-04-06T12:23:16.580 INFO:tasks.workunit.client.1.smithi195.stdout:7/781: chown d4/d16/d11/cdc 7823 1 2024-04-06T12:23:16.580 INFO:tasks.workunit.client.1.smithi195.stdout:8/878: fsync d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/f9c 0 2024-04-06T12:23:16.583 INFO:tasks.workunit.client.1.smithi195.stdout:8/879: fdatasync d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/f9c 0 2024-04-06T12:23:16.584 INFO:tasks.workunit.client.1.smithi195.stdout:8/880: write d6/f91 [190048,23899] 0 2024-04-06T12:23:16.585 INFO:tasks.workunit.client.1.smithi195.stdout:9/937: mknod d3/d10/d7d/dee/df1/c132 0 2024-04-06T12:23:16.586 INFO:tasks.workunit.client.1.smithi195.stdout:1/917: rename d4/d14/d17/d24 to d4/df0/d132 0 2024-04-06T12:23:16.587 INFO:tasks.workunit.client.1.smithi195.stdout:2/976: getdents d2/d21/d69/d12c 0 2024-04-06T12:23:16.587 INFO:tasks.workunit.client.1.smithi195.stdout:8/881: read d6/dd/d70/d24/d34/d67/da1/da2/f102 [3407052,126532] 0 2024-04-06T12:23:16.588 INFO:tasks.workunit.client.1.smithi195.stdout:7/782: symlink d4/d16/dd/d22/d3f/d54/da9/lf7 0 2024-04-06T12:23:16.589 INFO:tasks.workunit.client.1.smithi195.stdout:5/932: truncate d0/da/d13/f15 3603062 0 2024-04-06T12:23:16.592 INFO:tasks.workunit.client.1.smithi195.stdout:5/933: chown d0/da/dd/d2e/f90 4 1 2024-04-06T12:23:16.592 INFO:tasks.workunit.client.1.smithi195.stdout:2/977: mkdir d2/d41/d84/d8d/d94/d144 0 2024-04-06T12:23:16.592 INFO:tasks.workunit.client.1.smithi195.stdout:1/918: symlink d4/df0/d132/d99/d88/d114/d5d/db3/de4/l133 0 2024-04-06T12:23:16.593 INFO:tasks.workunit.client.1.smithi195.stdout:8/882: symlink d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/l127 0 2024-04-06T12:23:16.595 INFO:tasks.workunit.client.1.smithi195.stdout:8/883: chown d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101 42 1 2024-04-06T12:23:16.598 INFO:tasks.workunit.client.1.smithi195.stdout:8/884: chown d6/dd/d70/d24/d34/d67/f86 5281 1 2024-04-06T12:23:16.599 INFO:tasks.workunit.client.1.smithi195.stdout:7/783: link d4/d16/dd/d22/d3f/d54/lb5 d4/d10/d18/d57/lf8 0 2024-04-06T12:23:16.603 INFO:tasks.workunit.client.1.smithi195.stdout:8/885: symlink d6/l128 0 2024-04-06T12:23:16.603 INFO:tasks.workunit.client.1.smithi195.stdout:9/938: dread d3/d10/f46 [0,4194304] 0 2024-04-06T12:23:16.603 INFO:tasks.workunit.client.1.smithi195.stdout:2/978: dread d2/f61 [0,4194304] 0 2024-04-06T12:23:16.605 INFO:tasks.workunit.client.1.smithi195.stdout:9/939: write d3/d10/d4f/fa9 [6924073,17804] 0 2024-04-06T12:23:16.606 INFO:tasks.workunit.client.1.smithi195.stdout:1/919: dread d4/d14/f18 [0,4194304] 0 2024-04-06T12:23:16.606 INFO:tasks.workunit.client.1.smithi195.stdout:5/934: write d0/d35/f6b [7481082,31103] 0 2024-04-06T12:23:16.607 INFO:tasks.workunit.client.1.smithi195.stdout:8/886: mkdir d6/dd/d70/d24/d25/d49/d129 0 2024-04-06T12:23:16.609 INFO:tasks.workunit.client.1.smithi195.stdout:8/887: stat d6 0 2024-04-06T12:23:16.612 INFO:tasks.workunit.client.1.smithi195.stdout:7/784: dwrite d4/d16/dd/d22/d3f/d54/da9/f4e [0,4194304] 0 2024-04-06T12:23:16.612 INFO:tasks.workunit.client.1.smithi195.stdout:2/979: rename d2/d21/d29/de7/df6/d10f to d2/d41/d84/db2/dfe/d145 0 2024-04-06T12:23:16.617 INFO:tasks.workunit.client.1.smithi195.stdout:1/920: dwrite d4/d14/d17/d3a/da8/fae [0,4194304] 0 2024-04-06T12:23:16.621 INFO:tasks.workunit.client.1.smithi195.stdout:9/940: rename d3/d10 to d3/db9/dbc/d103/d50/d133 0 2024-04-06T12:23:16.623 INFO:tasks.workunit.client.1.smithi195.stdout:2/980: write d2/d21/d2c/f38 [2928163,93885] 0 2024-04-06T12:23:16.627 INFO:tasks.workunit.client.1.smithi195.stdout:9/941: dwrite d3/da1/fae [0,4194304] 0 2024-04-06T12:23:16.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/886: sync 2024-04-06T12:23:16.630 INFO:tasks.workunit.client.1.smithi195.stdout:1/921: unlink d4/df0/d132/d99/d4e/l72 0 2024-04-06T12:23:16.635 INFO:tasks.workunit.client.1.smithi195.stdout:2/981: read d2/d21/d2c/d2d/d92/fd6 [672667,30143] 0 2024-04-06T12:23:16.638 INFO:tasks.workunit.client.1.smithi195.stdout:9/942: mkdir d3/db9/dd8/d134 0 2024-04-06T12:23:16.640 INFO:tasks.workunit.client.1.smithi195.stdout:2/982: mknod d2/d3f/d7d/d5d/c146 0 2024-04-06T12:23:16.641 INFO:tasks.workunit.client.1.smithi195.stdout:0/887: mknod d4/d48/d67/d83/d94/c11a 0 2024-04-06T12:23:16.642 INFO:tasks.workunit.client.1.smithi195.stdout:8/888: dwrite d6/dd/d70/d118/f45 [4194304,4194304] 0 2024-04-06T12:23:16.642 INFO:tasks.workunit.client.1.smithi195.stdout:9/943: read d3/db9/f10d [4067184,40425] 0 2024-04-06T12:23:16.643 INFO:tasks.workunit.client.1.smithi195.stdout:5/935: rename d0/da/d4b/d4e/f10b to d0/da/d23/d38/d41/f144 0 2024-04-06T12:23:16.645 INFO:tasks.workunit.client.1.smithi195.stdout:1/922: creat d4/df0/d132/d99/d88/f134 x:0 0 0 2024-04-06T12:23:16.649 INFO:tasks.workunit.client.1.smithi195.stdout:5/936: chown d0/da/dd/d33/l36 266827425 1 2024-04-06T12:23:16.649 INFO:tasks.workunit.client.1.smithi195.stdout:8/889: stat d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/lf2 0 2024-04-06T12:23:16.650 INFO:tasks.workunit.client.1.smithi195.stdout:9/944: mknod d3/db9/dbc/d103/d111/d120/c135 0 2024-04-06T12:23:16.652 INFO:tasks.workunit.client.1.smithi195.stdout:4/849: sync 2024-04-06T12:23:16.653 INFO:tasks.workunit.client.1.smithi195.stdout:2/983: dwrite d2/d3f/d7d/f68 [0,4194304] 0 2024-04-06T12:23:16.655 INFO:tasks.workunit.client.1.smithi195.stdout:4/850: mkdir d4/d3e/d10e 0 2024-04-06T12:23:16.656 INFO:tasks.workunit.client.1.smithi195.stdout:0/888: dwrite d4/d53/fc9 [0,4194304] 0 2024-04-06T12:23:16.656 INFO:tasks.workunit.client.1.smithi195.stdout:7/785: truncate d4/d10/f40 3783719 0 2024-04-06T12:23:16.665 INFO:tasks.workunit.client.1.smithi195.stdout:5/937: truncate d0/da/dd/f3b 2361717 0 2024-04-06T12:23:16.665 INFO:tasks.workunit.client.1.smithi195.stdout:9/945: creat d3/db9/dbc/d103/d111/d102/f136 x:0 0 0 2024-04-06T12:23:16.665 INFO:tasks.workunit.client.1.smithi195.stdout:5/938: chown d0/da/dd/d2e/d6f/d58 0 1 2024-04-06T12:23:16.665 INFO:tasks.workunit.client.1.smithi195.stdout:2/984: rename d2/d14/f1d to d2/d41/d84/d8d/d94/dbb/f147 0 2024-04-06T12:23:16.666 INFO:tasks.workunit.client.1.smithi195.stdout:2/985: chown d2/d3f/d7d/d5d/l86 8476545 1 2024-04-06T12:23:16.667 INFO:tasks.workunit.client.1.smithi195.stdout:4/851: mkdir d4/d6/d38/d10f 0 2024-04-06T12:23:16.668 INFO:tasks.workunit.client.1.smithi195.stdout:0/889: fdatasync d4/d6/d2f/f4a 0 2024-04-06T12:23:16.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/986: write d2/d3f/d7d/f54 [3161585,66307] 0 2024-04-06T12:23:16.673 INFO:tasks.workunit.client.1.smithi195.stdout:0/890: symlink d4/d53/d81/l11b 0 2024-04-06T12:23:16.673 INFO:tasks.workunit.client.1.smithi195.stdout:2/987: chown d2/d3f/d7d/d7a/cd1 86 1 2024-04-06T12:23:16.673 INFO:tasks.workunit.client.1.smithi195.stdout:4/852: fdatasync d4/d6/d38/d1a/da7/d100/da6/fb3 0 2024-04-06T12:23:16.674 INFO:tasks.workunit.client.1.smithi195.stdout:7/786: dwrite d4/d10/d18/d19/f43 [0,4194304] 0 2024-04-06T12:23:16.686 INFO:tasks.workunit.client.1.smithi195.stdout:4/853: mkdir d4/d6/d38/d65/dc5/df1/d110 0 2024-04-06T12:23:16.687 INFO:tasks.workunit.client.1.smithi195.stdout:1/923: dread d4/df0/d132/f6b [0,4194304] 0 2024-04-06T12:23:16.694 INFO:tasks.workunit.client.1.smithi195.stdout:1/924: dread d4/df0/d132/d99/f4c [0,4194304] 0 2024-04-06T12:23:16.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/942: sync 2024-04-06T12:23:16.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/943: readlink d4/de/d8e/d92/d9e/l12d 0 2024-04-06T12:23:16.779 INFO:tasks.workunit.client.1.smithi195.stdout:8/890: sync 2024-04-06T12:23:16.789 INFO:tasks.workunit.client.1.smithi195.stdout:5/939: rename d0/da/dd/d1c/d5a to d0/da/d23/dd4/dfe/d145 0 2024-04-06T12:23:16.791 INFO:tasks.workunit.client.1.smithi195.stdout:2/988: rmdir d2 39 2024-04-06T12:23:16.792 INFO:tasks.workunit.client.1.smithi195.stdout:1/925: unlink d4/d14/d17/d3a/f95 0 2024-04-06T12:23:16.800 INFO:tasks.workunit.client.1.smithi195.stdout:4/854: dread d4/d6/d38/f28 [0,4194304] 0 2024-04-06T12:23:16.814 INFO:tasks.workunit.client.1.smithi195.stdout:3/944: rename d4/de/dc8/ff9 to d4/de/d8e/d92/d9e/f138 0 2024-04-06T12:23:16.816 INFO:tasks.workunit.client.1.smithi195.stdout:5/940: mkdir d0/da/d23/dd4/dfe/d145/d62/db8/d146 0 2024-04-06T12:23:16.817 INFO:tasks.workunit.client.1.smithi195.stdout:2/989: chown d2/d21/d2c/d2d 80264 1 2024-04-06T12:23:16.817 INFO:tasks.workunit.client.1.smithi195.stdout:1/926: rmdir d4/df0/d132/d99/d4e/d8f/dbe 39 2024-04-06T12:23:16.818 INFO:tasks.workunit.client.1.smithi195.stdout:4/855: rmdir d4/d6/d38/d1a/da7/d100/da6 39 2024-04-06T12:23:16.819 INFO:tasks.workunit.client.1.smithi195.stdout:0/891: sync 2024-04-06T12:23:16.819 INFO:tasks.workunit.client.1.smithi195.stdout:7/787: sync 2024-04-06T12:23:16.819 INFO:tasks.workunit.client.1.smithi195.stdout:9/946: sync 2024-04-06T12:23:16.821 INFO:tasks.workunit.client.1.smithi195.stdout:3/945: fsync d4/d9/f29 0 2024-04-06T12:23:16.822 INFO:tasks.workunit.client.1.smithi195.stdout:9/947: read d3/db9/dbc/d103/d48/f6f [3093637,62337] 0 2024-04-06T12:23:16.823 INFO:tasks.workunit.client.1.smithi195.stdout:3/946: chown d4/d9/d9f/cc3 2790138 1 2024-04-06T12:23:16.824 INFO:tasks.workunit.client.1.smithi195.stdout:3/947: fdatasync d4/d9/d2b/d77/fba 0 2024-04-06T12:23:16.825 INFO:tasks.workunit.client.1.smithi195.stdout:5/941: unlink d0/da/d13/d5e/d93/l9c 0 2024-04-06T12:23:16.830 INFO:tasks.workunit.client.1.smithi195.stdout:1/927: readlink d4/df0/d132/l62 0 2024-04-06T12:23:16.830 INFO:tasks.workunit.client.1.smithi195.stdout:2/990: dread d2/d21/d5e/ff4 [4194304,4194304] 0 2024-04-06T12:23:16.831 INFO:tasks.workunit.client.1.smithi195.stdout:0/892: creat d4/d6/d2f/d49/f11c x:0 0 0 2024-04-06T12:23:16.835 INFO:tasks.workunit.client.1.smithi195.stdout:4/856: mknod d4/d6/d38/d1a/da7/c111 0 2024-04-06T12:23:16.835 INFO:tasks.workunit.client.1.smithi195.stdout:8/891: dwrite d6/dd/d70/d24/d53/f10c [0,4194304] 0 2024-04-06T12:23:16.837 INFO:tasks.workunit.client.1.smithi195.stdout:9/948: fsync d3/db9/dbc/d103/d50/d133/d3a/f80 0 2024-04-06T12:23:16.839 INFO:tasks.workunit.client.1.smithi195.stdout:3/948: rmdir d4/d9/d2b/d3b/d5e/dab 39 2024-04-06T12:23:16.842 INFO:tasks.workunit.client.1.smithi195.stdout:4/857: dwrite d4/d6/d38/d1a/da7/d100/fdb [0,4194304] 0 2024-04-06T12:23:16.842 INFO:tasks.workunit.client.1.smithi195.stdout:5/942: creat d0/da/d13/d5e/da7/f147 x:0 0 0 2024-04-06T12:23:16.845 INFO:tasks.workunit.client.1.smithi195.stdout:4/858: write d4/d6/d38/d1a/d40/d57/d10c/ff4 [530435,79344] 0 2024-04-06T12:23:16.846 INFO:tasks.workunit.client.1.smithi195.stdout:4/859: fsync d4/f12 0 2024-04-06T12:23:16.846 INFO:tasks.workunit.client.1.smithi195.stdout:4/860: fdatasync d4/f7e 0 2024-04-06T12:23:16.848 INFO:tasks.workunit.client.1.smithi195.stdout:7/788: mknod d4/d16/dd/d22/cf9 0 2024-04-06T12:23:16.849 INFO:tasks.workunit.client.1.smithi195.stdout:0/893: mknod d4/d53/d81/c11d 0 2024-04-06T12:23:16.853 INFO:tasks.workunit.client.1.smithi195.stdout:8/892: rmdir d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12 39 2024-04-06T12:23:16.855 INFO:tasks.workunit.client.1.smithi195.stdout:8/893: read - d6/dd/d70/d24/d34/d67/da1/da2/dc6/f107 zero size 2024-04-06T12:23:16.856 INFO:tasks.workunit.client.1.smithi195.stdout:9/949: read d3/fc1 [457641,34697] 0 2024-04-06T12:23:16.856 INFO:tasks.workunit.client.1.smithi195.stdout:3/949: creat d4/de/d8e/d92/d9e/f139 x:0 0 0 2024-04-06T12:23:16.857 INFO:tasks.workunit.client.1.smithi195.stdout:1/928: fdatasync d4/d14/fa0 0 2024-04-06T12:23:16.860 INFO:tasks.workunit.client.1.smithi195.stdout:5/943: rename d0/da/d23/d7a/dc5 to d0/da/d23/dd4/dc2/d148 0 2024-04-06T12:23:16.862 INFO:tasks.workunit.client.1.smithi195.stdout:5/944: write d0/da/d23/dd4/dfe/d145/d62/fc9 [913352,41266] 0 2024-04-06T12:23:16.862 INFO:tasks.workunit.client.1.smithi195.stdout:5/945: fsync d0/da/f113 0 2024-04-06T12:23:16.863 INFO:tasks.workunit.client.1.smithi195.stdout:5/946: fsync d0/da/f22 0 2024-04-06T12:23:16.864 INFO:tasks.workunit.client.1.smithi195.stdout:4/861: mknod d4/d6/d38/d1a/d40/ded/c112 0 2024-04-06T12:23:16.864 INFO:tasks.workunit.client.1.smithi195.stdout:5/947: readlink d0/d35/lf1 0 2024-04-06T12:23:16.865 INFO:tasks.workunit.client.1.smithi195.stdout:5/948: fsync d0/da/d23/dd4/d106/fe9 0 2024-04-06T12:23:16.865 INFO:tasks.workunit.client.1.smithi195.stdout:4/862: write d4/d6/d38/d1a/fce [1307460,58374] 0 2024-04-06T12:23:16.866 INFO:tasks.workunit.client.1.smithi195.stdout:7/789: unlink d4/d16/d11/cdc 0 2024-04-06T12:23:16.866 INFO:tasks.workunit.client.1.smithi195.stdout:5/949: stat d0/da/dd/d2e/d6f/ccc 0 2024-04-06T12:23:16.868 INFO:tasks.workunit.client.1.smithi195.stdout:4/863: chown d4/d6/d38/d1a/d40/d57/d10c/ca8 2493 1 2024-04-06T12:23:16.870 INFO:tasks.workunit.client.1.smithi195.stdout:4/864: write d4/d6/d38/d1a/feb [186145,16271] 0 2024-04-06T12:23:16.870 INFO:tasks.workunit.client.1.smithi195.stdout:9/950: rmdir d3/db9/dbc/d103/d48 39 2024-04-06T12:23:16.873 INFO:tasks.workunit.client.1.smithi195.stdout:3/950: mkdir d4/d53/d13a 0 2024-04-06T12:23:16.874 INFO:tasks.workunit.client.1.smithi195.stdout:3/951: truncate d4/de/d8e/f6c 2276867 0 2024-04-06T12:23:16.875 INFO:tasks.workunit.client.1.smithi195.stdout:0/894: dread d4/d41/f99 [0,4194304] 0 2024-04-06T12:23:16.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/950: unlink d0/da/dd/l65 0 2024-04-06T12:23:16.879 INFO:tasks.workunit.client.1.smithi195.stdout:7/790: symlink d4/d16/dd/d22/d3f/d54/lfa 0 2024-04-06T12:23:16.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/894: creat d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d83/f12a x:0 0 0 2024-04-06T12:23:16.881 INFO:tasks.workunit.client.1.smithi195.stdout:9/951: stat d3/db9/dbc/d103/d48/d9c/f84 0 2024-04-06T12:23:16.882 INFO:tasks.workunit.client.1.smithi195.stdout:8/895: fsync d6/dd/d70/d24/d34/d67/d9d/dd7/df5/ffb 0 2024-04-06T12:23:16.884 INFO:tasks.workunit.client.1.smithi195.stdout:2/991: getdents d2/ddc 0 2024-04-06T12:23:16.885 INFO:tasks.workunit.client.1.smithi195.stdout:1/929: rename d4/d14/d17/d3a/da8/ld5 to d4/d14/d17/dd4/l135 0 2024-04-06T12:23:16.886 INFO:tasks.workunit.client.1.smithi195.stdout:1/930: stat d4/d14/f18 0 2024-04-06T12:23:16.886 INFO:tasks.workunit.client.1.smithi195.stdout:0/895: stat d4/d48/d67/lc3 0 2024-04-06T12:23:16.887 INFO:tasks.workunit.client.1.smithi195.stdout:7/791: chown d4/d10/d12/da5/l86 11107 1 2024-04-06T12:23:16.888 INFO:tasks.workunit.client.1.smithi195.stdout:9/952: mkdir d3/db9/dbc/d103/d48/d137 0 2024-04-06T12:23:16.889 INFO:tasks.workunit.client.1.smithi195.stdout:2/992: fsync d2/d3f/fa4 0 2024-04-06T12:23:16.890 INFO:tasks.workunit.client.1.smithi195.stdout:5/951: symlink d0/da/dd/d2e/d6f/l149 0 2024-04-06T12:23:16.892 INFO:tasks.workunit.client.1.smithi195.stdout:3/952: dread d4/de/d8e/d92/d9e/f138 [0,4194304] 0 2024-04-06T12:23:16.893 INFO:tasks.workunit.client.1.smithi195.stdout:1/931: rename d4/df0 to d4/d14/d119/d136 0 2024-04-06T12:23:16.894 INFO:tasks.workunit.client.1.smithi195.stdout:8/896: symlink d6/dd/d42/l12b 0 2024-04-06T12:23:16.896 INFO:tasks.workunit.client.1.smithi195.stdout:0/896: dwrite d4/d6/d1a/f86 [4194304,4194304] 0 2024-04-06T12:23:16.900 INFO:tasks.workunit.client.1.smithi195.stdout:4/865: creat d4/d6/d38/d1a/da7/d100/da6/f113 x:0 0 0 2024-04-06T12:23:16.900 INFO:tasks.workunit.client.1.smithi195.stdout:7/792: dread d4/d16/dd/d22/d3f/d54/da9/f42 [0,4194304] 0 2024-04-06T12:23:16.902 INFO:tasks.workunit.client.1.smithi195.stdout:5/952: rename d0/da/d23/dd4/dfe to d0/da/d23/d127/d14a 0 2024-04-06T12:23:16.904 INFO:tasks.workunit.client.1.smithi195.stdout:3/953: mkdir d4/de/d8e/d92/d9e/df0/d13b 0 2024-04-06T12:23:16.904 INFO:tasks.workunit.client.1.smithi195.stdout:4/866: chown d4/d6/d38/d1a/d40/d57/fe2 31241 1 2024-04-06T12:23:16.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/932: chown d4/d14/d119/d136/d132/d99/d4e/d8f/dbe 3232 1 2024-04-06T12:23:16.906 INFO:tasks.workunit.client.1.smithi195.stdout:8/897: dwrite d6/dd/d70/d24/d34/d67/da1/da2/dc6/f107 [0,4194304] 0 2024-04-06T12:23:16.908 INFO:tasks.workunit.client.1.smithi195.stdout:0/897: creat d4/d53/d81/f11e x:0 0 0 2024-04-06T12:23:16.909 INFO:tasks.workunit.client.1.smithi195.stdout:1/933: read - d4/d14/d119/d136/d132/d99/d88/f134 zero size 2024-04-06T12:23:16.909 INFO:tasks.workunit.client.1.smithi195.stdout:8/898: readlink d6/dd/d70/d24/d34/d67/dec/l5f 0 2024-04-06T12:23:16.909 INFO:tasks.workunit.client.1.smithi195.stdout:0/898: read d4/d53/d81/f88 [433174,123987] 0 2024-04-06T12:23:16.912 INFO:tasks.workunit.client.1.smithi195.stdout:8/899: write d6/dd/d42/feb [295062,127013] 0 2024-04-06T12:23:16.912 INFO:tasks.workunit.client.1.smithi195.stdout:9/953: link d3/db9/dbc/f100 d3/db9/dbc/d103/d50/d133/d3a/d5d/d116/f138 0 2024-04-06T12:23:16.917 INFO:tasks.workunit.client.1.smithi195.stdout:3/954: mknod d4/de/d8e/d92/d9e/da4/c13c 0 2024-04-06T12:23:16.920 INFO:tasks.workunit.client.1.smithi195.stdout:2/993: dwrite d2/d41/d5a/fc4 [0,4194304] 0 2024-04-06T12:23:16.921 INFO:tasks.workunit.client.1.smithi195.stdout:1/934: dwrite d4/d14/d119/d136/d132/f94 [0,4194304] 0 2024-04-06T12:23:16.924 INFO:tasks.workunit.client.1.smithi195.stdout:2/994: chown d2/d41/d5a/c5b 0 1 2024-04-06T12:23:16.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/867: creat d4/d6/d38/d1a/d40/d20/d107/dc6/df7/f114 x:0 0 0 2024-04-06T12:23:16.925 INFO:tasks.workunit.client.1.smithi195.stdout:8/900: rename d6/dd/d70/d24/d53/d11c to d6/dd/d70/d118/d46/d12c 0 2024-04-06T12:23:16.928 INFO:tasks.workunit.client.1.smithi195.stdout:8/901: write d6/dd/d70/d24/d25/fe2 [3281852,10163] 0 2024-04-06T12:23:16.929 INFO:tasks.workunit.client.1.smithi195.stdout:0/899: dwrite d4/dbc/fc2 [0,4194304] 0 2024-04-06T12:23:16.935 INFO:tasks.workunit.client.1.smithi195.stdout:9/954: creat d3/db9/dbc/d103/d48/d137/f139 x:0 0 0 2024-04-06T12:23:16.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/902: stat d6/dd/d70/d24/d34/d67/d9d/lae 0 2024-04-06T12:23:16.935 INFO:tasks.workunit.client.1.smithi195.stdout:0/900: write d4/d53/fc9 [5767593,93299] 0 2024-04-06T12:23:16.935 INFO:tasks.workunit.client.1.smithi195.stdout:0/901: chown d4/d6/d1a/d73/f92 8328 1 2024-04-06T12:23:16.935 INFO:tasks.workunit.client.1.smithi195.stdout:5/953: fsync d0/da/dd/f18 0 2024-04-06T12:23:16.941 INFO:tasks.workunit.client.1.smithi195.stdout:0/902: unlink d4/l1e 0 2024-04-06T12:23:16.942 INFO:tasks.workunit.client.1.smithi195.stdout:8/903: symlink d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/dda/l12d 0 2024-04-06T12:23:16.943 INFO:tasks.workunit.client.1.smithi195.stdout:1/935: dwrite d4/d14/d119/d136/d132/fef [0,4194304] 0 2024-04-06T12:23:16.945 INFO:tasks.workunit.client.1.smithi195.stdout:5/954: chown d0/da/d23/d38/d107/f12f 7 1 2024-04-06T12:23:16.946 INFO:tasks.workunit.client.1.smithi195.stdout:9/955: getdents d3/db9/dbc/d103/d111/d102 0 2024-04-06T12:23:16.948 INFO:tasks.workunit.client.1.smithi195.stdout:0/903: truncate d4/fd 2507079 0 2024-04-06T12:23:16.948 INFO:tasks.workunit.client.1.smithi195.stdout:8/904: mkdir d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/d12e 0 2024-04-06T12:23:16.950 INFO:tasks.workunit.client.1.smithi195.stdout:5/955: creat d0/da/d23/dd4/dc2/d148/f14b x:0 0 0 2024-04-06T12:23:16.950 INFO:tasks.workunit.client.1.smithi195.stdout:9/956: symlink d3/dc6/l13a 0 2024-04-06T12:23:16.950 INFO:tasks.workunit.client.1.smithi195.stdout:0/904: read - d4/dbc/de2/f10f zero size 2024-04-06T12:23:16.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/905: unlink d6/dd/d42/l12b 0 2024-04-06T12:23:16.952 INFO:tasks.workunit.client.1.smithi195.stdout:0/905: readlink d4/d48/d67/d75/lb3 0 2024-04-06T12:23:16.954 INFO:tasks.workunit.client.1.smithi195.stdout:5/956: read d0/da/dd/fe5 [1909647,45781] 0 2024-04-06T12:23:16.955 INFO:tasks.workunit.client.1.smithi195.stdout:9/957: creat d3/db9/dbc/f13b x:0 0 0 2024-04-06T12:23:16.957 INFO:tasks.workunit.client.1.smithi195.stdout:9/958: fdatasync d3/db9/dbc/d103/f55 0 2024-04-06T12:23:16.957 INFO:tasks.workunit.client.1.smithi195.stdout:5/957: mknod d0/da/dd/c14c 0 2024-04-06T12:23:16.958 INFO:tasks.workunit.client.1.smithi195.stdout:0/906: getdents d4/d6/d58/da7/dc6 0 2024-04-06T12:23:16.961 INFO:tasks.workunit.client.1.smithi195.stdout:9/959: write d3/db9/dbc/d103/f131 [433390,130776] 0 2024-04-06T12:23:16.966 INFO:tasks.workunit.client.1.smithi195.stdout:0/907: fsync d4/d48/d67/d75/f7d 0 2024-04-06T12:23:16.971 INFO:tasks.workunit.client.1.smithi195.stdout:8/906: dread d6/dd/d70/d24/d25/fe2 [0,4194304] 0 2024-04-06T12:23:16.971 INFO:tasks.workunit.client.1.smithi195.stdout:3/955: dwrite d4/de/d8e/f6c [0,4194304] 0 2024-04-06T12:23:16.973 INFO:tasks.workunit.client.1.smithi195.stdout:4/868: dwrite d4/d6/d38/d1a/d40/f32 [0,4194304] 0 2024-04-06T12:23:16.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/958: write d0/f30 [2814878,104260] 0 2024-04-06T12:23:16.975 INFO:tasks.workunit.client.1.smithi195.stdout:3/956: unlink d4/d9/d2b/d3b/d40/f4a 0 2024-04-06T12:23:16.981 INFO:tasks.workunit.client.1.smithi195.stdout:0/908: dread d4/d41/f69 [0,4194304] 0 2024-04-06T12:23:16.981 INFO:tasks.workunit.client.1.smithi195.stdout:5/959: write d0/da/f9f [1178519,50852] 0 2024-04-06T12:23:16.981 INFO:tasks.workunit.client.1.smithi195.stdout:9/960: dwrite d3/db9/dbc/d103/d48/fcb [0,4194304] 0 2024-04-06T12:23:16.981 INFO:tasks.workunit.client.1.smithi195.stdout:3/957: symlink d4/df/d39/d112/l13d 0 2024-04-06T12:23:16.985 INFO:tasks.workunit.client.1.smithi195.stdout:4/869: write d4/d3e/f52 [4708139,16629] 0 2024-04-06T12:23:16.986 INFO:tasks.workunit.client.1.smithi195.stdout:8/907: truncate d6/fb6 3559912 0 2024-04-06T12:23:16.987 INFO:tasks.workunit.client.1.smithi195.stdout:0/909: creat d4/d53/d81/f11f x:0 0 0 2024-04-06T12:23:16.989 INFO:tasks.workunit.client.1.smithi195.stdout:5/960: unlink d0/da/d23/f131 0 2024-04-06T12:23:16.991 INFO:tasks.workunit.client.1.smithi195.stdout:8/908: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d61/ff9 [892924,46918] 0 2024-04-06T12:23:16.991 INFO:tasks.workunit.client.1.smithi195.stdout:3/958: creat d4/d9/d2b/d77/d9a/def/f13e x:0 0 0 2024-04-06T12:23:16.992 INFO:tasks.workunit.client.1.smithi195.stdout:5/961: read d0/da/dd/d2e/d6f/d58/f104 [275392,89814] 0 2024-04-06T12:23:16.992 INFO:tasks.workunit.client.1.smithi195.stdout:9/961: creat d3/db9/dbc/d103/d50/d133/d7d/dee/df1/f13c x:0 0 0 2024-04-06T12:23:16.993 INFO:tasks.workunit.client.1.smithi195.stdout:5/962: stat d0/l3e 0 2024-04-06T12:23:16.994 INFO:tasks.workunit.client.1.smithi195.stdout:4/870: rename d4/d3e/f8d to d4/d8c/f115 0 2024-04-06T12:23:16.997 INFO:tasks.workunit.client.1.smithi195.stdout:9/962: read d3/db9/dbc/d103/d50/d133/d4f/f5a [2360252,81007] 0 2024-04-06T12:23:17.000 INFO:tasks.workunit.client.1.smithi195.stdout:5/963: unlink d0/da/d23/d127/d14a/d145/d62/f76 0 2024-04-06T12:23:17.001 INFO:tasks.workunit.client.1.smithi195.stdout:4/871: write d4/d6/d38/d65/f7f [82825,30200] 0 2024-04-06T12:23:17.002 INFO:tasks.workunit.client.1.smithi195.stdout:4/872: chown d4/d6/d38/d1a/d40/d20/f9c 3 1 2024-04-06T12:23:17.002 INFO:tasks.workunit.client.1.smithi195.stdout:0/910: mknod d4/d6/d1a/c120 0 2024-04-06T12:23:17.004 INFO:tasks.workunit.client.1.smithi195.stdout:4/873: truncate d4/d6/d38/d1a/da7/d100/ff9 713609 0 2024-04-06T12:23:17.005 INFO:tasks.workunit.client.1.smithi195.stdout:7/793: sync 2024-04-06T12:23:17.009 INFO:tasks.workunit.client.1.smithi195.stdout:8/909: link d6/dd/d70/d24/d25/d7c/f8c d6/dd/d70/d118/d46/db2/f12f 0 2024-04-06T12:23:17.011 INFO:tasks.workunit.client.1.smithi195.stdout:0/911: creat d4/d53/d81/da9/f121 x:0 0 0 2024-04-06T12:23:17.013 INFO:tasks.workunit.client.1.smithi195.stdout:4/874: rename d4/d6/d38/d1a/d40/d57/la0 to d4/d6/d38/d1a/d40/d20/d107/dc9/df8/l116 0 2024-04-06T12:23:17.016 INFO:tasks.workunit.client.1.smithi195.stdout:0/912: unlink d4/d48/d77/d97/db7/lb4 0 2024-04-06T12:23:17.017 INFO:tasks.workunit.client.1.smithi195.stdout:0/913: truncate d4/d53/d81/f11f 773907 0 2024-04-06T12:23:17.018 INFO:tasks.workunit.client.1.smithi195.stdout:0/914: truncate d4/d48/d4e/fe7 858646 0 2024-04-06T12:23:17.019 INFO:tasks.workunit.client.1.smithi195.stdout:0/915: write d4/d6/d2f/d49/f11c [306174,124802] 0 2024-04-06T12:23:17.020 INFO:tasks.workunit.client.1.smithi195.stdout:3/959: unlink d4/d9/d2b/d77/d9a/def/f13e 0 2024-04-06T12:23:17.020 INFO:tasks.workunit.client.1.smithi195.stdout:0/916: readlink d4/d48/d77/d97/la5 0 2024-04-06T12:23:17.021 INFO:tasks.workunit.client.1.smithi195.stdout:8/910: creat d6/dd/d70/d24/d25/f130 x:0 0 0 2024-04-06T12:23:17.022 INFO:tasks.workunit.client.1.smithi195.stdout:9/963: write d3/db9/dbc/d103/d50/d133/d3a/d5d/d116/f138 [620619,51749] 0 2024-04-06T12:23:17.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:15.576432+0000 mgr.smithi195.ausetj (mgr.24375) 58 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 1.8 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 80 MiB/s rd, 250 MiB/s wr, 476 op/s 2024-04-06T12:23:17.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:15.576432+0000 mgr.smithi195.ausetj (mgr.24375) 58 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 1.8 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 80 MiB/s rd, 250 MiB/s wr, 476 op/s 2024-04-06T12:23:17.128 INFO:tasks.workunit.client.1.smithi195.stdout:2/995: sync 2024-04-06T12:23:17.139 INFO:tasks.workunit.client.1.smithi195.stdout:4/875: truncate d4/d6/d38/d1a/d40/d57/fe2 2720524 0 2024-04-06T12:23:17.139 INFO:tasks.workunit.client.1.smithi195.stdout:2/996: chown d2/ddc/deb/f138 8358816 1 2024-04-06T12:23:17.139 INFO:tasks.workunit.client.1.smithi195.stdout:3/960: fdatasync d4/d9/fa 0 2024-04-06T12:23:17.141 INFO:tasks.workunit.client.1.smithi195.stdout:0/917: dwrite d4/d6/d1a/f47 [4194304,4194304] 0 2024-04-06T12:23:17.142 INFO:tasks.workunit.client.1.smithi195.stdout:0/918: fdatasync d4/d53/fc9 0 2024-04-06T12:23:17.146 INFO:tasks.workunit.client.1.smithi195.stdout:4/876: dread d4/d6/d38/d1a/fce [0,4194304] 0 2024-04-06T12:23:17.147 INFO:tasks.workunit.client.1.smithi195.stdout:9/964: link d3/db9/dbc/d103/d48/f69 d3/db9/dbc/d103/d50/d133/d4f/f13d 0 2024-04-06T12:23:17.147 INFO:tasks.workunit.client.1.smithi195.stdout:4/877: stat d4/d8c/f99 0 2024-04-06T12:23:17.205 INFO:tasks.workunit.client.1.smithi195.stdout:4/878: chown d4/d6/d38/d1a/d40/l6b 388 1 2024-04-06T12:23:17.205 INFO:tasks.workunit.client.1.smithi195.stdout:8/911: truncate d6/dd/d70/d24/f32 1289995 0 2024-04-06T12:23:17.207 INFO:tasks.workunit.client.1.smithi195.stdout:3/961: creat d4/d9/f13f x:0 0 0 2024-04-06T12:23:17.208 INFO:tasks.workunit.client.1.smithi195.stdout:0/919: mknod d4/d48/d4e/dfd/c122 0 2024-04-06T12:23:17.209 INFO:tasks.workunit.client.1.smithi195.stdout:9/965: creat d3/db9/dbc/d103/d50/d133/d7d/dd0/f13e x:0 0 0 2024-04-06T12:23:17.210 INFO:tasks.workunit.client.1.smithi195.stdout:3/962: readlink d4/d9/d2b/l117 0 2024-04-06T12:23:17.211 INFO:tasks.workunit.client.1.smithi195.stdout:0/920: creat d4/f123 x:0 0 0 2024-04-06T12:23:17.213 INFO:tasks.workunit.client.1.smithi195.stdout:4/879: dwrite d4/d6/d38/d1a/d40/d20/f60 [0,4194304] 0 2024-04-06T12:23:17.215 INFO:tasks.workunit.client.1.smithi195.stdout:3/963: creat d4/d9/d2b/d77/d9a/def/f140 x:0 0 0 2024-04-06T12:23:17.220 INFO:tasks.workunit.client.1.smithi195.stdout:9/966: dwrite d3/db9/dbc/f100 [0,4194304] 0 2024-04-06T12:23:17.220 INFO:tasks.workunit.client.1.smithi195.stdout:3/964: chown d4/d9/d2b/d77/d9a/def/f140 81209495 1 2024-04-06T12:23:17.222 INFO:tasks.workunit.client.1.smithi195.stdout:5/964: sync 2024-04-06T12:23:17.222 INFO:tasks.workunit.client.1.smithi195.stdout:1/936: sync 2024-04-06T12:23:17.222 INFO:tasks.workunit.client.1.smithi195.stdout:4/880: truncate d4/d6/d38/d1a/d40/d57/d10c/ff4 1048794 0 2024-04-06T12:23:17.226 INFO:tasks.workunit.client.1.smithi195.stdout:0/921: dwrite d4/dbc/de2/d10c/f113 [0,4194304] 0 2024-04-06T12:23:17.228 INFO:tasks.workunit.client.1.smithi195.stdout:5/965: creat d0/da/d23/f14d x:0 0 0 2024-04-06T12:23:17.229 INFO:tasks.workunit.client.1.smithi195.stdout:4/881: write d4/d6/d38/d1a/d40/d20/f8a [1127161,13626] 0 2024-04-06T12:23:17.230 INFO:tasks.workunit.client.1.smithi195.stdout:8/912: dread d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/f37 [0,4194304] 0 2024-04-06T12:23:17.230 INFO:tasks.workunit.client.1.smithi195.stdout:1/937: mkdir d4/d14/d119/d136/d132/d99/d88/dec/d137 0 2024-04-06T12:23:17.233 INFO:tasks.workunit.client.1.smithi195.stdout:5/966: unlink d0/la5 0 2024-04-06T12:23:17.235 INFO:tasks.workunit.client.1.smithi195.stdout:0/922: symlink d4/d48/l124 0 2024-04-06T12:23:17.236 INFO:tasks.workunit.client.1.smithi195.stdout:9/967: link d3/db9/dbc/d103/d111/l12e d3/db9/dd8/d134/l13f 0 2024-04-06T12:23:17.237 INFO:tasks.workunit.client.1.smithi195.stdout:1/938: write d4/d14/d119/d136/d132/d2a/d45/f11d [998607,83250] 0 2024-04-06T12:23:17.238 INFO:tasks.workunit.client.1.smithi195.stdout:4/882: creat d4/d6/d38/d1a/d40/d57/d64/f117 x:0 0 0 2024-04-06T12:23:17.238 INFO:tasks.workunit.client.1.smithi195.stdout:3/965: dwrite d4/df/d39/f8a [0,4194304] 0 2024-04-06T12:23:17.240 INFO:tasks.workunit.client.1.smithi195.stdout:1/939: fsync d4/d14/d17/fb9 0 2024-04-06T12:23:17.240 INFO:tasks.workunit.client.1.smithi195.stdout:8/913: mknod d6/dd/d70/d24/d34/d67/d9d/c131 0 2024-04-06T12:23:17.241 INFO:tasks.workunit.client.1.smithi195.stdout:5/967: mknod d0/da/d23/d38/d107/c14e 0 2024-04-06T12:23:17.243 INFO:tasks.workunit.client.1.smithi195.stdout:9/968: dread d3/db9/dbc/d103/d48/d5e/ffc [0,4194304] 0 2024-04-06T12:23:17.244 INFO:tasks.workunit.client.1.smithi195.stdout:8/914: fdatasync d6/dd/d70/d24/d34/d67/da1/da2/f111 0 2024-04-06T12:23:17.246 INFO:tasks.workunit.client.1.smithi195.stdout:8/915: stat d6/dd/d70/d24/d34/d67 0 2024-04-06T12:23:17.246 INFO:tasks.workunit.client.1.smithi195.stdout:1/940: dread d4/d14/d17/d3a/da8/fe9 [0,4194304] 0 2024-04-06T12:23:17.247 INFO:tasks.workunit.client.1.smithi195.stdout:4/883: mkdir d4/d6/d38/d1a/d40/d20/d23/d118 0 2024-04-06T12:23:17.250 INFO:tasks.workunit.client.1.smithi195.stdout:5/968: unlink d0/da/d23/dd4/f49 0 2024-04-06T12:23:17.253 INFO:tasks.workunit.client.1.smithi195.stdout:0/923: rename d4/d53/f7a to d4/d48/d77/d97/f125 0 2024-04-06T12:23:17.259 INFO:tasks.workunit.client.1.smithi195.stdout:9/969: mknod d3/db9/c140 0 2024-04-06T12:23:17.260 INFO:tasks.workunit.client.1.smithi195.stdout:3/966: write d4/df/f28 [952718,99515] 0 2024-04-06T12:23:17.261 INFO:tasks.workunit.client.1.smithi195.stdout:8/916: symlink d6/dd/d70/d24/l132 0 2024-04-06T12:23:17.262 INFO:tasks.workunit.client.1.smithi195.stdout:4/884: dwrite d4/d6/d38/d1a/d40/d20/f61 [0,4194304] 0 2024-04-06T12:23:17.263 INFO:tasks.workunit.client.1.smithi195.stdout:7/794: sync 2024-04-06T12:23:17.264 INFO:tasks.workunit.client.1.smithi195.stdout:9/970: fsync d3/db9/dbc/d103/d50/d133/d4f/fa9 0 2024-04-06T12:23:17.266 INFO:tasks.workunit.client.1.smithi195.stdout:0/924: getdents d4/d53/d81 0 2024-04-06T12:23:17.267 INFO:tasks.workunit.client.1.smithi195.stdout:3/967: chown d4/d9/d2b/f90 55896601 1 2024-04-06T12:23:17.268 INFO:tasks.workunit.client.1.smithi195.stdout:5/969: creat d0/da/d13/f14f x:0 0 0 2024-04-06T12:23:17.269 INFO:tasks.workunit.client.1.smithi195.stdout:3/968: chown d4/d9/d37/f7d 122305392 1 2024-04-06T12:23:17.269 INFO:tasks.workunit.client.1.smithi195.stdout:7/795: stat d4/ld0 0 2024-04-06T12:23:17.271 INFO:tasks.workunit.client.1.smithi195.stdout:7/796: dread - d4/d16/d11/fbd zero size 2024-04-06T12:23:17.275 INFO:tasks.workunit.client.1.smithi195.stdout:4/885: getdents d4/d6/d38/d1a/d40/d20/d23/d118 0 2024-04-06T12:23:17.276 INFO:tasks.workunit.client.1.smithi195.stdout:0/925: dwrite d4/f119 [0,4194304] 0 2024-04-06T12:23:17.277 INFO:tasks.workunit.client.1.smithi195.stdout:3/969: creat d4/d53/f141 x:0 0 0 2024-04-06T12:23:17.279 INFO:tasks.workunit.client.1.smithi195.stdout:4/886: readlink d4/d6/d38/d1a/d40/d57/d64/lc2 0 2024-04-06T12:23:17.282 INFO:tasks.workunit.client.1.smithi195.stdout:1/941: truncate d4/d14/d119/d136/d132/f6b 3409767 0 2024-04-06T12:23:17.283 INFO:tasks.workunit.client.1.smithi195.stdout:5/970: dwrite d0/da/d23/d127/d14a/d145/d62/d64/f8a [4194304,4194304] 0 2024-04-06T12:23:17.285 INFO:tasks.workunit.client.1.smithi195.stdout:9/971: creat d3/db9/dbc/d103/d50/d133/f141 x:0 0 0 2024-04-06T12:23:17.286 INFO:tasks.workunit.client.1.smithi195.stdout:8/917: truncate d6/f10d 1879128 0 2024-04-06T12:23:17.291 INFO:tasks.workunit.client.1.smithi195.stdout:9/972: write d3/db9/dbc/d103/d50/d133/d3a/f10a [50779,14677] 0 2024-04-06T12:23:17.294 INFO:tasks.workunit.client.1.smithi195.stdout:1/942: rename d4/cba to d4/d14/d17/dd4/c138 0 2024-04-06T12:23:17.296 INFO:tasks.workunit.client.1.smithi195.stdout:2/997: sync 2024-04-06T12:23:17.296 INFO:tasks.workunit.client.1.smithi195.stdout:5/971: creat d0/da/d23/dd4/dc2/d11b/f150 x:0 0 0 2024-04-06T12:23:17.297 INFO:tasks.workunit.client.1.smithi195.stdout:7/797: creat d4/d16/dd/d22/ffb x:0 0 0 2024-04-06T12:23:17.299 INFO:tasks.workunit.client.1.smithi195.stdout:9/973: dread - d3/db9/dbc/d103/d50/d133/d3a/d5d/f93 zero size 2024-04-06T12:23:17.299 INFO:tasks.workunit.client.1.smithi195.stdout:4/887: dwrite d4/faa [0,4194304] 0 2024-04-06T12:23:17.300 INFO:tasks.workunit.client.1.smithi195.stdout:3/970: getdents d4/d9/d2b/d3b/d40/de2 0 2024-04-06T12:23:17.306 INFO:tasks.workunit.client.1.smithi195.stdout:0/926: dwrite d4/f5 [0,4194304] 0 2024-04-06T12:23:17.306 INFO:tasks.workunit.client.1.smithi195.stdout:8/918: link d6/dd/d70/d24/d34/d67/d9d/dd7/l121 d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/dcb/l133 0 2024-04-06T12:23:17.307 INFO:tasks.workunit.client.1.smithi195.stdout:7/798: truncate d4/d10/ff5 11330 0 2024-04-06T12:23:17.307 INFO:tasks.workunit.client.1.smithi195.stdout:1/943: mknod d4/d14/d119/d136/d132/d99/d4e/d71/c139 0 2024-04-06T12:23:17.311 INFO:tasks.workunit.client.1.smithi195.stdout:5/972: mknod d0/da/d23/d127/d14a/d145/d68/dd7/d101/c151 0 2024-04-06T12:23:17.314 INFO:tasks.workunit.client.1.smithi195.stdout:9/974: creat d3/db9/dbc/d103/d50/d133/d7d/f142 x:0 0 0 2024-04-06T12:23:17.314 INFO:tasks.workunit.client.1.smithi195.stdout:0/927: rmdir d4/d6/d1a/d9f 39 2024-04-06T12:23:17.315 INFO:tasks.workunit.client.1.smithi195.stdout:2/998: dwrite d2/d21/d69/fe9 [0,4194304] 0 2024-04-06T12:23:17.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/971: creat d4/d9/d37/db9/d121/d127/f142 x:0 0 0 2024-04-06T12:23:17.321 INFO:tasks.workunit.client.1.smithi195.stdout:5/973: rename d0/d35/f6b to d0/da/d23/dd4/dc2/d148/dce/f152 0 2024-04-06T12:23:17.323 INFO:tasks.workunit.client.1.smithi195.stdout:3/972: truncate d4/d9/d2b/d87/fd3 1211332 0 2024-04-06T12:23:17.324 INFO:tasks.workunit.client.1.smithi195.stdout:2/999: symlink d2/d41/d84/d8d/d94/db6/d119/l148 0 2024-04-06T12:23:17.324 INFO:tasks.workunit.client.1.smithi195.stdout:9/975: dwrite d3/db9/dbc/d103/d48/d5e/f82 [0,4194304] 0 2024-04-06T12:23:17.329 INFO:tasks.workunit.client.1.smithi195.stdout:7/799: getdents d4/d10/d18/d33/d6e 0 2024-04-06T12:23:17.330 INFO:tasks.workunit.client.1.smithi195.stdout:0/928: link d4/d48/d67/d83/fab d4/d53/f126 0 2024-04-06T12:23:17.331 INFO:tasks.workunit.client.1.smithi195.stdout:4/888: truncate d4/d6/d38/d65/f84 214063 0 2024-04-06T12:23:17.332 INFO:tasks.workunit.client.1.smithi195.stdout:5/974: truncate d0/da/d23/d38/f85 910022 0 2024-04-06T12:23:17.333 INFO:tasks.workunit.client.1.smithi195.stdout:0/929: chown d4/d6/d1a/f86 31292356 1 2024-04-06T12:23:17.334 INFO:tasks.workunit.client.1.smithi195.stdout:4/889: write d4/d6/d38/d1a/da7/fc4 [193654,127167] 0 2024-04-06T12:23:17.334 INFO:tasks.workunit.client.1.smithi195.stdout:5/975: stat d0/da/d23/d38/d41/d7d/fd3 0 2024-04-06T12:23:17.336 INFO:tasks.workunit.client.1.smithi195.stdout:0/930: unlink d4/d53/lcb 0 2024-04-06T12:23:17.336 INFO:tasks.workunit.client.1.smithi195.stdout:9/976: dread d3/db9/dbc/d103/d111/f7b [0,4194304] 0 2024-04-06T12:23:17.338 INFO:tasks.workunit.client.1.smithi195.stdout:5/976: creat d0/da/dd/d2e/f153 x:0 0 0 2024-04-06T12:23:17.338 INFO:tasks.workunit.client.1.smithi195.stdout:4/890: mkdir d4/d6/d38/d65/d119 0 2024-04-06T12:23:17.341 INFO:tasks.workunit.client.1.smithi195.stdout:9/977: write d3/db9/dbc/d103/d48/fcf [4435102,89186] 0 2024-04-06T12:23:17.342 INFO:tasks.workunit.client.1.smithi195.stdout:5/977: mkdir d0/da/dd/d2e/d6f/d154 0 2024-04-06T12:23:17.344 INFO:tasks.workunit.client.1.smithi195.stdout:4/891: creat d4/d6/d38/d65/dc5/df1/f11a x:0 0 0 2024-04-06T12:23:17.344 INFO:tasks.workunit.client.1.smithi195.stdout:9/978: readlink d3/db9/dd8/l11a 0 2024-04-06T12:23:17.346 INFO:tasks.workunit.client.1.smithi195.stdout:0/931: dwrite d4/d48/f56 [0,4194304] 0 2024-04-06T12:23:17.347 INFO:tasks.workunit.client.1.smithi195.stdout:7/800: dread d4/d16/dd/d22/d76/f97 [0,4194304] 0 2024-04-06T12:23:17.350 INFO:tasks.workunit.client.1.smithi195.stdout:5/978: rename d0/da/d23/d127/d14a/d145/d68/f12e to d0/da/d23/dd4/f155 0 2024-04-06T12:23:17.351 INFO:tasks.workunit.client.1.smithi195.stdout:7/801: chown d4/d16/f1c 42 1 2024-04-06T12:23:17.352 INFO:tasks.workunit.client.1.smithi195.stdout:5/979: write d0/da/dd/fe6 [1814244,130748] 0 2024-04-06T12:23:17.353 INFO:tasks.workunit.client.1.smithi195.stdout:0/932: creat d4/d48/d77/d97/db7/f127 x:0 0 0 2024-04-06T12:23:17.355 INFO:tasks.workunit.client.1.smithi195.stdout:9/979: getdents d3/db9/dbc/d103/d48/d9c 0 2024-04-06T12:23:17.356 INFO:tasks.workunit.client.1.smithi195.stdout:7/802: symlink d4/d16/lfc 0 2024-04-06T12:23:17.358 INFO:tasks.workunit.client.1.smithi195.stdout:0/933: truncate d4/d6/f6b 52109 0 2024-04-06T12:23:17.359 INFO:tasks.workunit.client.1.smithi195.stdout:5/980: rename d0/da/d13/l19 to d0/da/d13/d5e/da7/l156 0 2024-04-06T12:23:17.359 INFO:tasks.workunit.client.1.smithi195.stdout:9/980: rmdir d3/db9/dbc/d103/d48 39 2024-04-06T12:23:17.360 INFO:tasks.workunit.client.1.smithi195.stdout:5/981: fdatasync d0/da/dd/d1c/f102 0 2024-04-06T12:23:17.361 INFO:tasks.workunit.client.1.smithi195.stdout:7/803: symlink d4/d10/d12/lfd 0 2024-04-06T12:23:17.362 INFO:tasks.workunit.client.1.smithi195.stdout:5/982: fdatasync d0/da/d23/dd4/dc2/fe8 0 2024-04-06T12:23:17.363 INFO:tasks.workunit.client.1.smithi195.stdout:0/934: read d4/d6/d1a/f47 [2432523,13061] 0 2024-04-06T12:23:17.367 INFO:tasks.workunit.client.1.smithi195.stdout:0/935: write d4/d48/d67/d83/fdb [754918,37506] 0 2024-04-06T12:23:17.372 INFO:tasks.workunit.client.1.smithi195.stdout:4/892: dread d4/d8c/fbf [0,4194304] 0 2024-04-06T12:23:17.373 INFO:tasks.workunit.client.1.smithi195.stdout:5/983: getdents d0/da/d23/d127 0 2024-04-06T12:23:17.373 INFO:tasks.workunit.client.1.smithi195.stdout:4/893: stat d4/d8c/f109 0 2024-04-06T12:23:17.374 INFO:tasks.workunit.client.1.smithi195.stdout:7/804: dwrite d4/d16/dd/d22/d3f/d54/fb4 [0,4194304] 0 2024-04-06T12:23:17.374 INFO:tasks.workunit.client.1.smithi195.stdout:9/981: dwrite d3/db9/dbc/d103/d48/d9c/f91 [0,4194304] 0 2024-04-06T12:23:17.376 INFO:tasks.workunit.client.1.smithi195.stdout:0/936: unlink d4/d6/d1a/l1c 0 2024-04-06T12:23:17.377 INFO:tasks.workunit.client.1.smithi195.stdout:4/894: chown d4/d6/d38/d1a/d40/d20/d23/ld0 536658807 1 2024-04-06T12:23:17.378 INFO:tasks.workunit.client.1.smithi195.stdout:7/805: mkdir d4/d24/dfe 0 2024-04-06T12:23:17.383 INFO:tasks.workunit.client.1.smithi195.stdout:0/937: creat d4/d48/d67/d75/de9/f128 x:0 0 0 2024-04-06T12:23:17.384 INFO:tasks.workunit.client.1.smithi195.stdout:7/806: symlink d4/d10/d18/d33/d6e/lff 0 2024-04-06T12:23:17.387 INFO:tasks.workunit.client.1.smithi195.stdout:9/982: truncate d3/dc6/fbb 3648467 0 2024-04-06T12:23:17.388 INFO:tasks.workunit.client.1.smithi195.stdout:1/944: sync 2024-04-06T12:23:17.388 INFO:tasks.workunit.client.1.smithi195.stdout:3/973: sync 2024-04-06T12:23:17.388 INFO:tasks.workunit.client.1.smithi195.stdout:8/919: sync 2024-04-06T12:23:17.388 INFO:tasks.workunit.client.1.smithi195.stdout:0/938: dread d4/d6/d1a/f86 [4194304,4194304] 0 2024-04-06T12:23:17.391 INFO:tasks.workunit.client.1.smithi195.stdout:3/974: write d4/f25 [2360919,26777] 0 2024-04-06T12:23:17.391 INFO:tasks.workunit.client.1.smithi195.stdout:0/939: stat d4/d6/d58/da7/fd7 0 2024-04-06T12:23:17.396 INFO:tasks.workunit.client.1.smithi195.stdout:8/920: mknod d6/dd/d70/d118/d46/d12c/c134 0 2024-04-06T12:23:17.397 INFO:tasks.workunit.client.1.smithi195.stdout:4/895: dread d4/d6/d38/d1a/da7/d100/da6/dae/dec/ffc [0,4194304] 0 2024-04-06T12:23:17.397 INFO:tasks.workunit.client.1.smithi195.stdout:1/945: symlink d4/d14/d17/dd4/l13a 0 2024-04-06T12:23:17.399 INFO:tasks.workunit.client.1.smithi195.stdout:7/807: dwrite d4/d24/f49 [0,4194304] 0 2024-04-06T12:23:17.401 INFO:tasks.workunit.client.1.smithi195.stdout:0/940: unlink d4/d53/lfe 0 2024-04-06T12:23:17.406 INFO:tasks.workunit.client.1.smithi195.stdout:5/984: dwrite d0/da/dd/d2e/d6f/d58/f104 [0,4194304] 0 2024-04-06T12:23:17.411 INFO:tasks.workunit.client.1.smithi195.stdout:8/921: mknod d6/dd/d70/d118/d46/db2/c135 0 2024-04-06T12:23:17.412 INFO:tasks.workunit.client.1.smithi195.stdout:3/975: truncate d4/df/d39/fd2 698050 0 2024-04-06T12:23:17.418 INFO:tasks.workunit.client.1.smithi195.stdout:0/941: chown d4/d6/d1a/l33 10 1 2024-04-06T12:23:17.418 INFO:tasks.workunit.client.1.smithi195.stdout:9/983: dread d3/db9/dbc/d103/d48/d9c/f8c [0,4194304] 0 2024-04-06T12:23:17.420 INFO:tasks.workunit.client.1.smithi195.stdout:5/985: fdatasync d0/da/d4b/fed 0 2024-04-06T12:23:17.421 INFO:tasks.workunit.client.1.smithi195.stdout:5/986: write d0/da/d23/dd4/dc2/d148/fc6 [844097,33395] 0 2024-04-06T12:23:17.421 INFO:tasks.workunit.client.1.smithi195.stdout:7/808: truncate d4/f34 1776588 0 2024-04-06T12:23:17.423 INFO:tasks.workunit.client.1.smithi195.stdout:7/809: fdatasync d4/d16/d11/fc6 0 2024-04-06T12:23:17.433 INFO:tasks.workunit.client.1.smithi195.stdout:4/896: rename d4/d6/d38/d65/dc5/cd5 to d4/d6/d38/d1a/c11b 0 2024-04-06T12:23:17.439 INFO:tasks.workunit.client.1.smithi195.stdout:4/897: symlink d4/d6/d38/d1a/d40/d20/d107/dc6/l11c 0 2024-04-06T12:23:17.440 INFO:tasks.workunit.client.1.smithi195.stdout:3/976: dwrite d4/d9/d2b/d3b/d5e/d7e/fca [0,4194304] 0 2024-04-06T12:23:17.440 INFO:tasks.workunit.client.1.smithi195.stdout:4/898: fdatasync d4/f79 0 2024-04-06T12:23:17.441 INFO:tasks.workunit.client.1.smithi195.stdout:3/977: write d4/d53/f60 [1546259,31713] 0 2024-04-06T12:23:17.446 INFO:tasks.workunit.client.1.smithi195.stdout:9/984: read d3/db9/dbc/d103/d50/d133/d7d/dee/ff0 [835370,130737] 0 2024-04-06T12:23:17.448 INFO:tasks.workunit.client.1.smithi195.stdout:0/942: read d4/d48/d77/d97/db7/f66 [2018837,73287] 0 2024-04-06T12:23:17.451 INFO:tasks.workunit.client.1.smithi195.stdout:8/922: getdents d6/dd/d70/d24/d34/d67/d9d/dd7/df5 0 2024-04-06T12:23:17.452 INFO:tasks.workunit.client.1.smithi195.stdout:7/810: truncate d4/d16/dd/d22/d3f/d54/fb4 1653209 0 2024-04-06T12:23:17.453 INFO:tasks.workunit.client.1.smithi195.stdout:8/923: read d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d83/f113 [417063,95118] 0 2024-04-06T12:23:17.453 INFO:tasks.workunit.client.1.smithi195.stdout:8/924: chown d6/db/c1f 4052985 1 2024-04-06T12:23:17.453 INFO:tasks.workunit.client.1.smithi195.stdout:3/978: unlink d4/d9/dcf/f115 0 2024-04-06T12:23:17.455 INFO:tasks.workunit.client.1.smithi195.stdout:1/946: rename d4/d14/d119/d136/d132/d99/d88/f134 to d4/d14/d119/d136/d132/d99/d4e/d8f/f13b 0 2024-04-06T12:23:17.458 INFO:tasks.workunit.client.1.smithi195.stdout:9/985: unlink d3/db9/dbc/d103/d50/d133/f35 0 2024-04-06T12:23:17.459 INFO:tasks.workunit.client.1.smithi195.stdout:4/899: dread d4/d3e/f94 [0,4194304] 0 2024-04-06T12:23:17.459 INFO:tasks.workunit.client.1.smithi195.stdout:0/943: mkdir d4/d48/d4e/dfd/d101/d129 0 2024-04-06T12:23:17.459 INFO:tasks.workunit.client.1.smithi195.stdout:9/986: stat d3/db9/dbc/d103/d111/c128 0 2024-04-06T12:23:17.459 INFO:tasks.workunit.client.1.smithi195.stdout:7/811: fdatasync d4/f96 0 2024-04-06T12:23:17.460 INFO:tasks.workunit.client.1.smithi195.stdout:4/900: dread - d4/d6/d38/d65/dc5/df1/f11a zero size 2024-04-06T12:23:17.462 INFO:tasks.workunit.client.1.smithi195.stdout:4/901: chown d4/d6/d38/d1a/d40/d20/cf6 28699 1 2024-04-06T12:23:17.464 INFO:tasks.workunit.client.1.smithi195.stdout:5/987: rename d0/da/d23/dd4/dc2/d11b to d0/da/dd/d33/d105/d157 0 2024-04-06T12:23:17.464 INFO:tasks.workunit.client.1.smithi195.stdout:7/812: dread d4/d10/d18/d33/d6e/fbc [0,4194304] 0 2024-04-06T12:23:17.466 INFO:tasks.workunit.client.1.smithi195.stdout:0/944: fdatasync d4/d53/ffc 0 2024-04-06T12:23:17.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/813: readlink d4/d10/d18/da0/lf0 0 2024-04-06T12:23:17.466 INFO:tasks.workunit.client.1.smithi195.stdout:9/987: dread d3/db9/dbc/d103/d50/d133/d3a/d6b/fbf [4194304,4194304] 0 2024-04-06T12:23:17.468 INFO:tasks.workunit.client.1.smithi195.stdout:8/925: symlink d6/dd/d70/d24/d25/d49/d129/l136 0 2024-04-06T12:23:17.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/926: fdatasync d6/dd/d70/d24/d25/d49/fe9 0 2024-04-06T12:23:17.470 INFO:tasks.workunit.client.1.smithi195.stdout:3/979: symlink d4/d9/d2b/d3b/d5e/dab/l143 0 2024-04-06T12:23:17.473 INFO:tasks.workunit.client.1.smithi195.stdout:1/947: unlink d4/d14/d119/d136/d132/f27 0 2024-04-06T12:23:17.475 INFO:tasks.workunit.client.1.smithi195.stdout:8/927: dwrite d6/dd/d70/d24/d34/d67/f76 [0,4194304] 0 2024-04-06T12:23:17.476 INFO:tasks.workunit.client.1.smithi195.stdout:8/928: dread - d6/dd/d42/f6f zero size 2024-04-06T12:23:17.481 INFO:tasks.workunit.client.1.smithi195.stdout:4/902: symlink d4/d6/d38/d65/dc5/df1/d110/l11d 0 2024-04-06T12:23:17.482 INFO:tasks.workunit.client.1.smithi195.stdout:3/980: mknod d4/d9/dcf/c144 0 2024-04-06T12:23:17.484 INFO:tasks.workunit.client.1.smithi195.stdout:5/988: symlink d0/da/d13/l158 0 2024-04-06T12:23:17.484 INFO:tasks.workunit.client.1.smithi195.stdout:5/989: chown d0/f6 7828820 1 2024-04-06T12:23:17.486 INFO:tasks.workunit.client.1.smithi195.stdout:5/990: write d0/f30 [3177158,107562] 0 2024-04-06T12:23:17.486 INFO:tasks.workunit.client.1.smithi195.stdout:7/814: symlink d4/d16/dd/d22/l100 0 2024-04-06T12:23:17.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/988: write d3/db9/dbc/d103/d50/d133/d3a/d5d/fb8 [3071499,82902] 0 2024-04-06T12:23:17.487 INFO:tasks.workunit.client.1.smithi195.stdout:0/945: symlink d4/d6/d1a/d73/l12a 0 2024-04-06T12:23:17.489 INFO:tasks.workunit.client.1.smithi195.stdout:0/946: stat d4/d6/d58/c5d 0 2024-04-06T12:23:17.489 INFO:tasks.workunit.client.1.smithi195.stdout:8/929: mknod d6/dd/d70/c137 0 2024-04-06T12:23:17.492 INFO:tasks.workunit.client.1.smithi195.stdout:5/991: chown d0/da/l77 6907 1 2024-04-06T12:23:17.493 INFO:tasks.workunit.client.1.smithi195.stdout:7/815: dread - d4/d16/dd/d22/d3f/d54/da9/f4d zero size 2024-04-06T12:23:17.494 INFO:tasks.workunit.client.1.smithi195.stdout:9/989: mkdir d3/db9/dbc/d103/d50/d133/d3a/d5d/d116/d143 0 2024-04-06T12:23:17.495 INFO:tasks.workunit.client.1.smithi195.stdout:4/903: mkdir d4/d6/d38/d1a/da7/d100/d11e 0 2024-04-06T12:23:17.496 INFO:tasks.workunit.client.1.smithi195.stdout:8/930: mknod d6/dd/d42/dce/c138 0 2024-04-06T12:23:17.499 INFO:tasks.workunit.client.1.smithi195.stdout:1/948: creat d4/d14/f13c x:0 0 0 2024-04-06T12:23:17.507 INFO:tasks.workunit.client.1.smithi195.stdout:8/931: dwrite d6/dd/d70/d24/d34/d67/da1/da2/da4/fc3 [0,4194304] 0 2024-04-06T12:23:17.507 INFO:tasks.workunit.client.1.smithi195.stdout:4/904: dread d4/f5 [0,4194304] 0 2024-04-06T12:23:17.507 INFO:tasks.workunit.client.1.smithi195.stdout:1/949: unlink d4/d14/d17/f11c 0 2024-04-06T12:23:17.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/981: getdents d4/d9/d2b/d77/d9a/def 0 2024-04-06T12:23:17.511 INFO:tasks.workunit.client.1.smithi195.stdout:9/990: symlink d3/db9/dbc/d103/d50/d133/d7d/d105/d110/l144 0 2024-04-06T12:23:17.520 INFO:tasks.workunit.client.1.smithi195.stdout:3/982: creat d4/de/d8e/dbb/de8/f145 x:0 0 0 2024-04-06T12:23:17.522 INFO:tasks.workunit.client.1.smithi195.stdout:3/983: truncate d4/de/d8e/d92/d9e/fdb 674035 0 2024-04-06T12:23:17.524 INFO:tasks.workunit.client.1.smithi195.stdout:4/905: creat d4/d6/d38/d65/d119/f11f x:0 0 0 2024-04-06T12:23:17.527 INFO:tasks.workunit.client.1.smithi195.stdout:5/992: write d0/da/dd/d2e/d6f/f4f [713756,86960] 0 2024-04-06T12:23:17.529 INFO:tasks.workunit.client.1.smithi195.stdout:8/932: write d6/dd/d70/d24/f32 [936084,90492] 0 2024-04-06T12:23:17.529 INFO:tasks.workunit.client.1.smithi195.stdout:7/816: write d4/d16/dd/d22/d3f/d54/fb4 [1094964,22003] 0 2024-04-06T12:23:17.530 INFO:tasks.workunit.client.1.smithi195.stdout:1/950: dread d4/d14/f34 [0,4194304] 0 2024-04-06T12:23:17.531 INFO:tasks.workunit.client.1.smithi195.stdout:4/906: creat d4/d6/d38/d65/f120 x:0 0 0 2024-04-06T12:23:17.532 INFO:tasks.workunit.client.1.smithi195.stdout:3/984: dwrite d4/de/d8e/d92/d9e/fac [4194304,4194304] 0 2024-04-06T12:23:17.532 INFO:tasks.workunit.client.1.smithi195.stdout:5/993: read d0/d52/d91/f129 [25774,11747] 0 2024-04-06T12:23:17.536 INFO:tasks.workunit.client.1.smithi195.stdout:3/985: fsync d4/d9/d37/f3a 0 2024-04-06T12:23:17.536 INFO:tasks.workunit.client.1.smithi195.stdout:5/994: chown d0/da/d23/cf2 1302586 1 2024-04-06T12:23:17.537 INFO:tasks.workunit.client.1.smithi195.stdout:1/951: write d4/d14/d119/d136/d132/d99/d4e/d71/f112 [209832,96946] 0 2024-04-06T12:23:17.537 INFO:tasks.workunit.client.1.smithi195.stdout:4/907: mknod d4/d3e/c121 0 2024-04-06T12:23:17.540 INFO:tasks.workunit.client.1.smithi195.stdout:3/986: symlink d4/de/d8e/d92/d9e/da4/d10c/l146 0 2024-04-06T12:23:17.540 INFO:tasks.workunit.client.1.smithi195.stdout:1/952: readlink d4/d14/d119/d136/d132/d99/d88/dbf/ld1 0 2024-04-06T12:23:17.540 INFO:tasks.workunit.client.1.smithi195.stdout:7/817: write d4/d16/dd/d22/d3f/faa [1825003,32727] 0 2024-04-06T12:23:17.542 INFO:tasks.workunit.client.1.smithi195.stdout:8/933: link d6/dd/d70/d24/d25/f2a d6/dd/f139 0 2024-04-06T12:23:17.543 INFO:tasks.workunit.client.1.smithi195.stdout:3/987: write d4/d9/d2b/d87/f11b [3853913,35306] 0 2024-04-06T12:23:17.543 INFO:tasks.workunit.client.1.smithi195.stdout:4/908: mknod d4/d6/d38/d1a/d40/d20/d23/d118/c122 0 2024-04-06T12:23:17.545 INFO:tasks.workunit.client.1.smithi195.stdout:4/909: chown d4/d6/d38/d1a/d40/d57/d10c 469002764 1 2024-04-06T12:23:17.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/953: unlink d4/d14/d17/d3a/da8/db8/fc8 0 2024-04-06T12:23:17.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/954: readlink d4/d14/d119/d136/d132/d99/d88/d114/d28/l10d 0 2024-04-06T12:23:17.551 INFO:tasks.workunit.client.1.smithi195.stdout:3/988: fdatasync d4/d9/f68 0 2024-04-06T12:23:17.552 INFO:tasks.workunit.client.1.smithi195.stdout:7/818: write d4/d16/f1c [33537,41351] 0 2024-04-06T12:23:17.553 INFO:tasks.workunit.client.1.smithi195.stdout:7/819: chown d4/d16/d11/fc8 64488 1 2024-04-06T12:23:17.556 INFO:tasks.workunit.client.1.smithi195.stdout:3/989: mknod d4/d9/dcf/c147 0 2024-04-06T12:23:17.560 INFO:tasks.workunit.client.1.smithi195.stdout:5/995: dread d0/da/d23/d127/d14a/d145/d68/dd7/d101/f7e [0,4194304] 0 2024-04-06T12:23:17.560 INFO:tasks.workunit.client.1.smithi195.stdout:5/996: stat d0 0 2024-04-06T12:23:17.560 INFO:tasks.workunit.client.1.smithi195.stdout:3/990: unlink d4/de/d8e/dbb/f122 0 2024-04-06T12:23:17.560 INFO:tasks.workunit.client.1.smithi195.stdout:4/910: write d4/f16 [5039198,105354] 0 2024-04-06T12:23:17.564 INFO:tasks.workunit.client.1.smithi195.stdout:1/955: creat d4/d14/d119/d136/d132/d99/d88/d114/d28/f13d x:0 0 0 2024-04-06T12:23:17.564 INFO:tasks.workunit.client.1.smithi195.stdout:5/997: chown d0/da/f3c 425706 1 2024-04-06T12:23:17.564 INFO:tasks.workunit.client.1.smithi195.stdout:1/956: chown d4/d14/d119/d136/d132/d99/d88/d114/d28/f50 208 1 2024-04-06T12:23:17.564 INFO:tasks.workunit.client.1.smithi195.stdout:4/911: mkdir d4/d6/d38/d1a/d40/d20/d107/dc9/df8/d123 0 2024-04-06T12:23:17.565 INFO:tasks.workunit.client.1.smithi195.stdout:3/991: creat d4/de/d8e/d92/d9e/df0/d13b/f148 x:0 0 0 2024-04-06T12:23:17.567 INFO:tasks.workunit.client.1.smithi195.stdout:4/912: mkdir d4/d6/d38/d65/dc5/df1/d124 0 2024-04-06T12:23:17.567 INFO:tasks.workunit.client.1.smithi195.stdout:5/998: creat d0/da/dd/d2e/d6f/f159 x:0 0 0 2024-04-06T12:23:17.573 INFO:tasks.workunit.client.1.smithi195.stdout:5/999: rename d0/da/d23/d127/d14a/d145/d68/dd7/d101/f110 to d0/da/d4b/d4e/f15a 0 2024-04-06T12:23:17.574 INFO:tasks.workunit.client.1.smithi195.stdout:3/992: dread d4/d53/f54 [0,4194304] 0 2024-04-06T12:23:17.576 INFO:tasks.workunit.client.1.smithi195.stdout:3/993: write d4/d9/d2b/d3b/d5e/d7e/fb6 [2097286,39094] 0 2024-04-06T12:23:17.576 INFO:tasks.workunit.client.1.smithi195.stdout:1/957: dread d4/d14/d17/d3a/da8/fd3 [0,4194304] 0 2024-04-06T12:23:17.581 INFO:tasks.workunit.client.1.smithi195.stdout:3/994: rename d4/d9/d2b/d3b/d5e/d7e/fb6 to d4/d9/d2b/d87/db8/f149 0 2024-04-06T12:23:17.582 INFO:tasks.workunit.client.1.smithi195.stdout:4/913: dread d4/d6/d38/d1a/d40/d57/d10c/f7c [0,4194304] 0 2024-04-06T12:23:17.584 INFO:tasks.workunit.client.1.smithi195.stdout:3/995: creat d4/de/f14a x:0 0 0 2024-04-06T12:23:17.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/996: link d4/d9/d2b/d3b/d5e/l7a d4/d53/d13a/l14b 0 2024-04-06T12:23:17.590 INFO:tasks.workunit.client.1.smithi195.stdout:3/997: getdents d4/de/d8e/d92/d9e/da4/d10c 0 2024-04-06T12:23:17.596 INFO:tasks.workunit.client.1.smithi195.stdout:1/958: write d4/d14/d119/d136/d132/d99/f4d [3348306,4745] 0 2024-04-06T12:23:17.597 INFO:tasks.workunit.client.1.smithi195.stdout:3/998: write d4/de/f46 [753017,110822] 0 2024-04-06T12:23:17.599 INFO:tasks.workunit.client.1.smithi195.stdout:1/959: mknod d4/d14/d119/d136/d132/d99/d88/d114/c13e 0 2024-04-06T12:23:17.600 INFO:tasks.workunit.client.1.smithi195.stdout:1/960: dread - d4/d14/d17/d3a/f106 zero size 2024-04-06T12:23:17.621 INFO:tasks.workunit.client.1.smithi195.stdout:0/947: sync 2024-04-06T12:23:17.628 INFO:tasks.workunit.client.1.smithi195.stdout:3/999: dwrite d4/df/f10b [0,4194304] 0 2024-04-06T12:23:17.629 INFO:tasks.workunit.client.1.smithi195.stdout:0/948: symlink d4/d6/d1a/d9f/l12b 0 2024-04-06T12:23:17.633 INFO:tasks.workunit.client.1.smithi195.stdout:1/961: dwrite d4/d14/d17/dc1/f116 [0,4194304] 0 2024-04-06T12:23:17.635 INFO:tasks.workunit.client.1.smithi195.stdout:1/962: write d4/d14/d119/d136/d132/d99/f20 [1965060,103791] 0 2024-04-06T12:23:17.638 INFO:tasks.workunit.client.1.smithi195.stdout:1/963: fdatasync d4/d14/d17/d3a/da8/fcc 0 2024-04-06T12:23:17.639 INFO:tasks.workunit.client.1.smithi195.stdout:0/949: dread d4/d6/d58/fc4 [0,4194304] 0 2024-04-06T12:23:17.641 INFO:tasks.workunit.client.1.smithi195.stdout:1/964: chown d4/d14/d17/cb6 1974287 1 2024-04-06T12:23:17.643 INFO:tasks.workunit.client.1.smithi195.stdout:0/950: read d4/d6/d2f/d49/f11c [132062,4814] 0 2024-04-06T12:23:17.643 INFO:tasks.workunit.client.1.smithi195.stdout:1/965: readlink d4/d14/d119/d136/d132/d99/d88/d114/l81 0 2024-04-06T12:23:17.643 INFO:tasks.workunit.client.1.smithi195.stdout:0/951: read - d4/d53/d81/f11e zero size 2024-04-06T12:23:17.645 INFO:tasks.workunit.client.1.smithi195.stdout:1/966: read d4/d14/d119/d136/d132/d99/d88/d114/d5d/f7d [189260,31607] 0 2024-04-06T12:23:17.646 INFO:tasks.workunit.client.1.smithi195.stdout:0/952: mkdir d4/d48/d77/d12c 0 2024-04-06T12:23:17.646 INFO:tasks.workunit.client.1.smithi195.stdout:1/967: chown d4/d14/d119/d136/d132/d99/f29 324 1 2024-04-06T12:23:17.647 INFO:tasks.workunit.client.1.smithi195.stdout:0/953: write d4/d53/d81/da9/f105 [839941,18579] 0 2024-04-06T12:23:17.654 INFO:tasks.workunit.client.1.smithi195.stdout:1/968: truncate d4/d14/d17/dc1/fc6 1378255 0 2024-04-06T12:23:17.654 INFO:tasks.workunit.client.1.smithi195.stdout:0/954: dwrite d4/d6/d1a/f3f [4194304,4194304] 0 2024-04-06T12:23:17.659 INFO:tasks.workunit.client.1.smithi195.stdout:0/955: symlink d4/dd5/l12d 0 2024-04-06T12:23:17.660 INFO:tasks.workunit.client.1.smithi195.stdout:1/969: symlink d4/d14/d17/l13f 0 2024-04-06T12:23:17.663 INFO:tasks.workunit.client.1.smithi195.stdout:0/956: rename d4/d48/d67/d83/lf1 to d4/d48/d4e/dfd/d101/d129/l12e 0 2024-04-06T12:23:17.664 INFO:tasks.workunit.client.1.smithi195.stdout:0/957: stat d4/d48/lad 0 2024-04-06T12:23:17.668 INFO:tasks.workunit.client.1.smithi195.stdout:1/970: dwrite d4/d14/d119/d136/d132/d99/d88/deb/f11a [0,4194304] 0 2024-04-06T12:23:17.668 INFO:tasks.workunit.client.1.smithi195.stdout:0/958: mkdir d4/d6/d1a/d73/d12f 0 2024-04-06T12:23:17.673 INFO:tasks.workunit.client.1.smithi195.stdout:1/971: unlink d4/d14/d119/d136/d132/f94 0 2024-04-06T12:23:17.674 INFO:tasks.workunit.client.1.smithi195.stdout:0/959: dwrite d4/d6/d1a/d73/f74 [0,4194304] 0 2024-04-06T12:23:17.675 INFO:tasks.workunit.client.1.smithi195.stdout:1/972: write d4/d14/d119/d136/d132/fef [909647,25828] 0 2024-04-06T12:23:17.680 INFO:tasks.workunit.client.1.smithi195.stdout:1/973: link d4/d14/d17/f85 d4/d14/d17/d3a/f140 0 2024-04-06T12:23:17.681 INFO:tasks.workunit.client.1.smithi195.stdout:9/991: sync 2024-04-06T12:23:17.681 INFO:tasks.workunit.client.1.smithi195.stdout:0/960: getdents d4/d53/d81/da9 0 2024-04-06T12:23:17.684 INFO:tasks.workunit.client.1.smithi195.stdout:9/992: chown d3/db9/dbc/d103/d50/f52 20436 1 2024-04-06T12:23:17.684 INFO:tasks.workunit.client.1.smithi195.stdout:1/974: chown d4/d14/d119/d136/d132/d99/f4d 1232 1 2024-04-06T12:23:17.685 INFO:tasks.workunit.client.1.smithi195.stdout:0/961: unlink d4/lb5 0 2024-04-06T12:23:17.686 INFO:tasks.workunit.client.1.smithi195.stdout:9/993: dread d3/db9/dbc/d103/d50/d133/d3a/f10a [0,4194304] 0 2024-04-06T12:23:17.689 INFO:tasks.workunit.client.1.smithi195.stdout:0/962: read d4/f64 [236469,8592] 0 2024-04-06T12:23:17.690 INFO:tasks.workunit.client.1.smithi195.stdout:1/975: mknod d4/d14/c141 0 2024-04-06T12:23:17.691 INFO:tasks.workunit.client.1.smithi195.stdout:9/994: symlink d3/db9/dbc/d103/d111/ddf/l145 0 2024-04-06T12:23:17.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/963: dread - d4/d48/d77/f10b zero size 2024-04-06T12:23:17.693 INFO:tasks.workunit.client.1.smithi195.stdout:1/976: chown d4/d14/d119/d136/d132/d99/d88/dbf/lc3 8023847 1 2024-04-06T12:23:17.694 INFO:tasks.workunit.client.1.smithi195.stdout:9/995: mkdir d3/db9/dbc/d103/d50/d133/d3a/d5d/d146 0 2024-04-06T12:23:17.694 INFO:tasks.workunit.client.1.smithi195.stdout:0/964: write d4/d6/d2f/f8a [70776,34139] 0 2024-04-06T12:23:17.696 INFO:tasks.workunit.client.1.smithi195.stdout:9/996: chown d3/db9/dbc/d103/d50/d133/d4f/l73 0 1 2024-04-06T12:23:17.696 INFO:tasks.workunit.client.1.smithi195.stdout:0/965: write d4/d6/d2f/fda [285510,2170] 0 2024-04-06T12:23:17.696 INFO:tasks.workunit.client.1.smithi195.stdout:1/977: unlink d4/d14/d119/d136/d132/d99/l70 0 2024-04-06T12:23:17.705 INFO:tasks.workunit.client.1.smithi195.stdout:1/978: write d4/d14/d119/d136/d132/d99/f68 [1017806,116561] 0 2024-04-06T12:23:17.705 INFO:tasks.workunit.client.1.smithi195.stdout:0/966: truncate d4/f3d 2487065 0 2024-04-06T12:23:17.707 INFO:tasks.workunit.client.1.smithi195.stdout:0/967: mknod d4/d6/d2f/d49/c130 0 2024-04-06T12:23:17.708 INFO:tasks.workunit.client.1.smithi195.stdout:0/968: fsync d4/d6/d1a/d73/fb9 0 2024-04-06T12:23:17.708 INFO:tasks.workunit.client.1.smithi195.stdout:1/979: mknod d4/d14/d119/d136/d132/d99/d88/dec/dda/c142 0 2024-04-06T12:23:17.710 INFO:tasks.workunit.client.1.smithi195.stdout:1/980: chown d4/d14/d17/d3a/da8/da4/f12b 2488514 1 2024-04-06T12:23:17.711 INFO:tasks.workunit.client.1.smithi195.stdout:0/969: mkdir d4/d48/d67/d83/d131 0 2024-04-06T12:23:17.713 INFO:tasks.workunit.client.1.smithi195.stdout:1/981: symlink d4/d14/d119/d136/d132/d99/d88/d114/l143 0 2024-04-06T12:23:17.714 INFO:tasks.workunit.client.1.smithi195.stdout:0/970: creat d4/d6/d58/da7/f132 x:0 0 0 2024-04-06T12:23:17.715 INFO:tasks.workunit.client.1.smithi195.stdout:1/982: mknod d4/d14/d17/c144 0 2024-04-06T12:23:17.718 INFO:tasks.workunit.client.1.smithi195.stdout:1/983: truncate d4/d14/f34 2868838 0 2024-04-06T12:23:17.719 INFO:tasks.workunit.client.1.smithi195.stdout:1/984: fsync d4/d14/d119/d136/d132/d2a/d45/f55 0 2024-04-06T12:23:17.726 INFO:tasks.workunit.client.1.smithi195.stdout:0/971: dwrite d4/d48/d77/d97/db7/f66 [0,4194304] 0 2024-04-06T12:23:17.727 INFO:tasks.workunit.client.1.smithi195.stdout:1/985: rename d4/d14/d119/d136/d132/d99/d88/d114/d5d/db3/de4/d123 to d4/d14/d119/d136/d132/d99/d88/d114/d28/d145 0 2024-04-06T12:23:17.730 INFO:tasks.workunit.client.1.smithi195.stdout:0/972: dread d4/d6/d1a/f47 [4194304,4194304] 0 2024-04-06T12:23:17.731 INFO:tasks.workunit.client.1.smithi195.stdout:1/986: symlink d4/d14/d119/d136/d132/d2a/d5a/daa/l146 0 2024-04-06T12:23:17.734 INFO:tasks.workunit.client.1.smithi195.stdout:0/973: rename d4/d6/f20 to d4/d48/d67/d75/de9/f133 0 2024-04-06T12:23:17.737 INFO:tasks.workunit.client.1.smithi195.stdout:0/974: dread d4/d48/d67/d75/dcf/fed [0,4194304] 0 2024-04-06T12:23:17.738 INFO:tasks.workunit.client.1.smithi195.stdout:1/987: creat d4/d14/d17/d3a/da8/f147 x:0 0 0 2024-04-06T12:23:17.740 INFO:tasks.workunit.client.1.smithi195.stdout:0/975: fdatasync d4/f21 0 2024-04-06T12:23:17.744 INFO:tasks.workunit.client.1.smithi195.stdout:0/976: creat d4/d41/f134 x:0 0 0 2024-04-06T12:23:17.746 INFO:tasks.workunit.client.1.smithi195.stdout:1/988: mkdir d4/d14/d119/d136/d132/d99/d4e/d8f/dbe/dc2/d148 0 2024-04-06T12:23:17.747 INFO:tasks.workunit.client.1.smithi195.stdout:0/977: mknod d4/d48/d4e/c135 0 2024-04-06T12:23:17.748 INFO:tasks.workunit.client.1.smithi195.stdout:0/978: chown d4/d6/d1a/f72 1238861 1 2024-04-06T12:23:17.749 INFO:tasks.workunit.client.1.smithi195.stdout:1/989: creat d4/d14/d119/d136/d132/d2a/d45/f149 x:0 0 0 2024-04-06T12:23:17.752 INFO:tasks.workunit.client.1.smithi195.stdout:0/979: creat d4/d53/d81/da9/f136 x:0 0 0 2024-04-06T12:23:17.754 INFO:tasks.workunit.client.1.smithi195.stdout:1/990: link d4/d14/d17/f8c d4/d14/d119/d136/d132/d99/d88/d114/d5d/f14a 0 2024-04-06T12:23:17.754 INFO:tasks.workunit.client.1.smithi195.stdout:0/980: truncate d4/fd 2600030 0 2024-04-06T12:23:17.758 INFO:tasks.workunit.client.1.smithi195.stdout:0/981: mkdir d4/d6/d137 0 2024-04-06T12:23:17.758 INFO:tasks.workunit.client.1.smithi195.stdout:0/982: chown d4/f119 765707 1 2024-04-06T12:23:17.758 INFO:tasks.workunit.client.1.smithi195.stdout:0/983: write d4/d6/f109 [1531756,76601] 0 2024-04-06T12:23:17.759 INFO:tasks.workunit.client.1.smithi195.stdout:1/991: link d4/d14/d119/d136/d132/d99/d4e/d8f/l97 d4/d14/d119/d136/d132/d99/d4e/d71/l14b 0 2024-04-06T12:23:17.763 INFO:tasks.workunit.client.1.smithi195.stdout:4/914: sync 2024-04-06T12:23:17.763 INFO:tasks.workunit.client.1.smithi195.stdout:7/820: sync 2024-04-06T12:23:17.763 INFO:tasks.workunit.client.1.smithi195.stdout:8/934: sync 2024-04-06T12:23:17.766 INFO:tasks.workunit.client.1.smithi195.stdout:1/992: dwrite d4/d14/d119/d136/d132/fef [4194304,4194304] 0 2024-04-06T12:23:17.766 INFO:tasks.workunit.client.1.smithi195.stdout:4/915: chown d4/d6/d38/d1a/d40/d57/d10c/lca 11 1 2024-04-06T12:23:17.767 INFO:tasks.workunit.client.1.smithi195.stdout:1/993: readlink d4/d14/d17/dc1/lc5 0 2024-04-06T12:23:17.770 INFO:tasks.workunit.client.1.smithi195.stdout:8/935: mkdir d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/db0/d13a 0 2024-04-06T12:23:17.770 INFO:tasks.workunit.client.1.smithi195.stdout:1/994: rmdir d4/d14/d119/d136/d132/d99 39 2024-04-06T12:23:17.772 INFO:tasks.workunit.client.1.smithi195.stdout:8/936: creat d6/dd/d70/f13b x:0 0 0 2024-04-06T12:23:17.774 INFO:tasks.workunit.client.1.smithi195.stdout:4/916: dwrite d4/d6/d38/d65/d119/f11f [0,4194304] 0 2024-04-06T12:23:17.775 INFO:tasks.workunit.client.1.smithi195.stdout:4/917: chown d4/f2e 81312762 1 2024-04-06T12:23:17.778 INFO:tasks.workunit.client.1.smithi195.stdout:1/995: chown d4/d14/d119/d136/d132/d99/d88/dbf 303105 1 2024-04-06T12:23:17.780 INFO:tasks.workunit.client.1.smithi195.stdout:1/996: stat d4/d14/d119/d136/d132/d99/d4e/l93 0 2024-04-06T12:23:17.781 INFO:tasks.workunit.client.1.smithi195.stdout:8/937: creat d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/dcb/f13c x:0 0 0 2024-04-06T12:23:17.782 INFO:tasks.workunit.client.1.smithi195.stdout:7/821: truncate d4/d16/f1b 425019 0 2024-04-06T12:23:17.786 INFO:tasks.workunit.client.1.smithi195.stdout:4/918: getdents d4/d6/d38/d1a/d40/d57/d10c 0 2024-04-06T12:23:17.790 INFO:tasks.workunit.client.1.smithi195.stdout:7/822: rename d4/d10/d18/d19/c62 to d4/d10/d18/d19/d63/dc2/c101 0 2024-04-06T12:23:17.790 INFO:tasks.workunit.client.1.smithi195.stdout:1/997: dwrite d4/d14/d17/f53 [0,4194304] 0 2024-04-06T12:23:17.792 INFO:tasks.workunit.client.1.smithi195.stdout:4/919: chown d4/d6/d38/d1a/d40/d20/d107/dc9/df8/c101 1931 1 2024-04-06T12:23:17.792 INFO:tasks.workunit.client.1.smithi195.stdout:8/938: write d6/dd/d70/d118/f8e [114524,24471] 0 2024-04-06T12:23:17.798 INFO:tasks.workunit.client.1.smithi195.stdout:7/823: chown d4/d16/dd/d22/l93 954048 1 2024-04-06T12:23:17.800 INFO:tasks.workunit.client.1.smithi195.stdout:1/998: rename d4/d14/d17/dc1/fc6 to d4/d14/d119/d136/d132/f14c 0 2024-04-06T12:23:17.802 INFO:tasks.workunit.client.1.smithi195.stdout:7/824: mknod d4/d10/de6/c102 0 2024-04-06T12:23:17.803 INFO:tasks.workunit.client.1.smithi195.stdout:4/920: getdents d4/d6/d38 0 2024-04-06T12:23:17.805 INFO:tasks.workunit.client.1.smithi195.stdout:7/825: rmdir d4/d24/d80 39 2024-04-06T12:23:17.805 INFO:tasks.workunit.client.1.smithi195.stdout:7/826: readlink d4/d10/d12/da5/da3/le3 0 2024-04-06T12:23:17.807 INFO:tasks.workunit.client.1.smithi195.stdout:1/999: mkdir d4/d14/d17/d3a/da8/d14d 0 2024-04-06T12:23:17.807 INFO:tasks.workunit.client.1.smithi195.stdout:7/827: write d4/d16/dd/f2a [3581454,29023] 0 2024-04-06T12:23:17.808 INFO:tasks.workunit.client.1.smithi195.stdout:4/921: mknod d4/d6/d38/d65/d119/c125 0 2024-04-06T12:23:17.814 INFO:tasks.workunit.client.1.smithi195.stdout:4/922: fdatasync d4/d6/d38/d1a/da7/d100/da6/dae/fb4 0 2024-04-06T12:23:17.816 INFO:tasks.workunit.client.1.smithi195.stdout:7/828: dwrite d4/d16/dd/d22/d3f/fee [0,4194304] 0 2024-04-06T12:23:17.819 INFO:tasks.workunit.client.1.smithi195.stdout:4/923: mknod d4/d6/d38/d1a/d40/d57/c126 0 2024-04-06T12:23:17.820 INFO:tasks.workunit.client.1.smithi195.stdout:7/829: write d4/d16/dd/d22/d76/f97 [2562258,95167] 0 2024-04-06T12:23:17.820 INFO:tasks.workunit.client.1.smithi195.stdout:4/924: fsync d4/d8c/fc0 0 2024-04-06T12:23:17.822 INFO:tasks.workunit.client.1.smithi195.stdout:8/939: dread d6/dd/d70/f3b [0,4194304] 0 2024-04-06T12:23:17.825 INFO:tasks.workunit.client.1.smithi195.stdout:4/925: mkdir d4/d6/d38/d65/d127 0 2024-04-06T12:23:17.826 INFO:tasks.workunit.client.1.smithi195.stdout:8/940: mknod d6/dd/c13d 0 2024-04-06T12:23:17.827 INFO:tasks.workunit.client.1.smithi195.stdout:7/830: dwrite d4/d24/f49 [0,4194304] 0 2024-04-06T12:23:17.830 INFO:tasks.workunit.client.1.smithi195.stdout:7/831: mkdir d4/d16/dd/d22/d3f/dbe/d103 0 2024-04-06T12:23:17.831 INFO:tasks.workunit.client.1.smithi195.stdout:7/832: chown d4/d16/dd/d22/d3f/dbe/d103 269636017 1 2024-04-06T12:23:17.834 INFO:tasks.workunit.client.1.smithi195.stdout:4/926: creat d4/d6/d38/d1a/da7/d100/f128 x:0 0 0 2024-04-06T12:23:17.835 INFO:tasks.workunit.client.1.smithi195.stdout:7/833: truncate d4/f20 6250632 0 2024-04-06T12:23:17.835 INFO:tasks.workunit.client.1.smithi195.stdout:7/834: chown d4/d10/d18/f53 20 1 2024-04-06T12:23:17.838 INFO:tasks.workunit.client.1.smithi195.stdout:8/941: rmdir d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/dda/d110 0 2024-04-06T12:23:17.839 INFO:tasks.workunit.client.1.smithi195.stdout:7/835: symlink d4/d10/d18/d19/l104 0 2024-04-06T12:23:17.850 INFO:tasks.workunit.client.1.smithi195.stdout:7/836: truncate d4/d16/dd/d22/d3f/fee 2974469 0 2024-04-06T12:23:17.852 INFO:tasks.workunit.client.1.smithi195.stdout:4/927: dwrite d4/d6/d38/f86 [0,4194304] 0 2024-04-06T12:23:17.856 INFO:tasks.workunit.client.1.smithi195.stdout:8/942: dwrite d6/dd/f38 [0,4194304] 0 2024-04-06T12:23:17.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/837: rename d4/d16/dd/d22/d3f/dbe to d4/d24/d80/d105 0 2024-04-06T12:23:17.859 INFO:tasks.workunit.client.1.smithi195.stdout:8/943: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d61/f81 [717194,82374] 0 2024-04-06T12:23:17.862 INFO:tasks.workunit.client.1.smithi195.stdout:4/928: symlink d4/d6/d38/d1a/da7/d100/da6/l129 0 2024-04-06T12:23:17.863 INFO:tasks.workunit.client.1.smithi195.stdout:4/929: chown d4/d6/d38/d1a/d40/d57/d64/f7d 46 1 2024-04-06T12:23:17.864 INFO:tasks.workunit.client.1.smithi195.stdout:9/997: sync 2024-04-06T12:23:17.870 INFO:tasks.workunit.client.1.smithi195.stdout:4/930: creat d4/d6/d38/d1a/d40/d20/d107/dc9/df8/d123/f12a x:0 0 0 2024-04-06T12:23:17.871 INFO:tasks.workunit.client.1.smithi195.stdout:4/931: chown d4/d6/d38/d1a/da7/ffb 121060849 1 2024-04-06T12:23:17.873 INFO:tasks.workunit.client.1.smithi195.stdout:8/944: link d6/dd/d70/d24/d34/f6d d6/dd/d70/d118/f13e 0 2024-04-06T12:23:17.874 INFO:tasks.workunit.client.1.smithi195.stdout:4/932: mknod d4/d6/d38/d1a/d40/d20/d107/dc9/c12b 0 2024-04-06T12:23:17.877 INFO:tasks.workunit.client.1.smithi195.stdout:4/933: creat d4/d6/d38/d1a/d40/d57/d64/f12c x:0 0 0 2024-04-06T12:23:17.878 INFO:tasks.workunit.client.1.smithi195.stdout:4/934: write d4/d6/d38/d1a/d40/d57/ffe [138051,12744] 0 2024-04-06T12:23:17.879 INFO:tasks.workunit.client.1.smithi195.stdout:8/945: rename d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/f2f to d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/d12e/f13f 0 2024-04-06T12:23:17.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/838: write d4/d10/d18/d19/faf [396036,119627] 0 2024-04-06T12:23:17.892 INFO:tasks.workunit.client.1.smithi195.stdout:7/839: getdents d4/d10/d18/d57 0 2024-04-06T12:23:17.893 INFO:tasks.workunit.client.1.smithi195.stdout:4/935: truncate d4/d6/d38/d1a/d40/d57/d64/f7d 684432 0 2024-04-06T12:23:17.893 INFO:tasks.workunit.client.1.smithi195.stdout:8/946: truncate d6/dd/d70/d24/d34/d67/da1/da2/dc6/f107 1082599 0 2024-04-06T12:23:17.894 INFO:tasks.workunit.client.1.smithi195.stdout:9/998: dread d3/db9/dbc/d103/d111/f21 [0,4194304] 0 2024-04-06T12:23:17.894 INFO:tasks.workunit.client.1.smithi195.stdout:7/840: write d4/d16/dd/d22/d76/f8f [3300940,15810] 0 2024-04-06T12:23:17.896 INFO:tasks.workunit.client.1.smithi195.stdout:9/999: chown d3/l2e 1431363 1 2024-04-06T12:23:17.896 INFO:tasks.workunit.client.1.smithi195.stdout:0/984: sync 2024-04-06T12:23:17.896 INFO:tasks.workunit.client.1.smithi195.stdout:4/936: creat d4/d6/d38/d10f/f12d x:0 0 0 2024-04-06T12:23:17.897 INFO:tasks.workunit.client.1.smithi195.stdout:8/947: creat d6/dd/d70/d24/d25/da5/f140 x:0 0 0 2024-04-06T12:23:17.899 INFO:tasks.workunit.client.1.smithi195.stdout:7/841: unlink d4/d10/d18/d19/c31 0 2024-04-06T12:23:17.900 INFO:tasks.workunit.client.1.smithi195.stdout:4/937: unlink d4/d6/d38/cdd 0 2024-04-06T12:23:17.902 INFO:tasks.workunit.client.1.smithi195.stdout:0/985: creat d4/d48/d4e/f138 x:0 0 0 2024-04-06T12:23:17.905 INFO:tasks.workunit.client.1.smithi195.stdout:0/986: symlink d4/d6/d58/da7/l139 0 2024-04-06T12:23:17.908 INFO:tasks.workunit.client.1.smithi195.stdout:7/842: rename d4/d24 to d4/d16/dd/d22/d106 0 2024-04-06T12:23:17.909 INFO:tasks.workunit.client.1.smithi195.stdout:8/948: getdents d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/d12e 0 2024-04-06T12:23:17.914 INFO:tasks.workunit.client.1.smithi195.stdout:0/987: link d4/d48/d67/d75/f78 d4/d48/d67/d75/de9/dff/f13a 0 2024-04-06T12:23:17.915 INFO:tasks.workunit.client.1.smithi195.stdout:7/843: fsync d4/d10/f40 0 2024-04-06T12:23:17.916 INFO:tasks.workunit.client.1.smithi195.stdout:0/988: dread - d4/d53/d81/da9/f121 zero size 2024-04-06T12:23:17.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/949: dwrite d6/dd/d70/d118/d46/f8b [0,4194304] 0 2024-04-06T12:23:17.919 INFO:tasks.workunit.client.1.smithi195.stdout:7/844: write d4/d16/d11/ff3 [959826,124023] 0 2024-04-06T12:23:17.920 INFO:tasks.workunit.client.1.smithi195.stdout:0/989: write d4/d48/d67/d75/fa1 [5088420,116007] 0 2024-04-06T12:23:17.927 INFO:tasks.workunit.client.1.smithi195.stdout:4/938: write d4/d6/d38/d1a/da7/fc4 [882833,109515] 0 2024-04-06T12:23:17.928 INFO:tasks.workunit.client.1.smithi195.stdout:0/990: dread - d4/d6/d58/da7/fd7 zero size 2024-04-06T12:23:17.928 INFO:tasks.workunit.client.1.smithi195.stdout:7/845: dread d4/d10/d18/da0/fef [0,4194304] 0 2024-04-06T12:23:17.933 INFO:tasks.workunit.client.1.smithi195.stdout:0/991: symlink d4/d48/d67/d83/l13b 0 2024-04-06T12:23:17.933 INFO:tasks.workunit.client.1.smithi195.stdout:7/846: creat d4/d10/f107 x:0 0 0 2024-04-06T12:23:17.934 INFO:tasks.workunit.client.1.smithi195.stdout:8/950: dread d6/dd/d70/d24/d25/fe2 [0,4194304] 0 2024-04-06T12:23:17.936 INFO:tasks.workunit.client.1.smithi195.stdout:0/992: mkdir d4/d6/d58/da7/dc6/d13c 0 2024-04-06T12:23:17.940 INFO:tasks.workunit.client.1.smithi195.stdout:7/847: link d4/d10/f40 d4/d10/d12/d6f/f108 0 2024-04-06T12:23:17.942 INFO:tasks.workunit.client.1.smithi195.stdout:0/993: link d4/d6/d58/f115 d4/d48/d77/f13d 0 2024-04-06T12:23:17.943 INFO:tasks.workunit.client.1.smithi195.stdout:8/951: dwrite d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/f9c [0,4194304] 0 2024-04-06T12:23:17.949 INFO:tasks.workunit.client.1.smithi195.stdout:4/939: dwrite d4/d6/d38/d1a/d40/d57/d64/f7d [0,4194304] 0 2024-04-06T12:23:17.951 INFO:tasks.workunit.client.1.smithi195.stdout:8/952: chown d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d61/f81 700381 1 2024-04-06T12:23:17.956 INFO:tasks.workunit.client.1.smithi195.stdout:8/953: creat d6/dd/d70/d24/d34/d67/dec/d97/f141 x:0 0 0 2024-04-06T12:23:17.958 INFO:tasks.workunit.client.1.smithi195.stdout:4/940: mknod d4/c12e 0 2024-04-06T12:23:17.960 INFO:tasks.workunit.client.1.smithi195.stdout:8/954: chown d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/db0 393332 1 2024-04-06T12:23:17.964 INFO:tasks.workunit.client.1.smithi195.stdout:4/941: mkdir d4/d6/d38/d1a/da7/d100/d11e/d12f 0 2024-04-06T12:23:17.964 INFO:tasks.workunit.client.1.smithi195.stdout:0/994: dwrite d4/d6/d2f/f8a [0,4194304] 0 2024-04-06T12:23:17.964 INFO:tasks.workunit.client.1.smithi195.stdout:7/848: dwrite d4/d16/dd/d22/d3f/fee [0,4194304] 0 2024-04-06T12:23:17.967 INFO:tasks.workunit.client.1.smithi195.stdout:4/942: readlink d4/d6/d38/d1a/da7/d100/da6/lbd 0 2024-04-06T12:23:17.977 INFO:tasks.workunit.client.1.smithi195.stdout:4/943: creat d4/d6/d38/f130 x:0 0 0 2024-04-06T12:23:17.978 INFO:tasks.workunit.client.1.smithi195.stdout:0/995: getdents d4/d48/d67/d75/de9/dff 0 2024-04-06T12:23:17.983 INFO:tasks.workunit.client.1.smithi195.stdout:0/996: write d4/dbc/de2/d10c/f113 [4928559,56457] 0 2024-04-06T12:23:17.984 INFO:tasks.workunit.client.1.smithi195.stdout:4/944: rmdir d4/d6/d38/d1a/d40/d20/d107/dc9 39 2024-04-06T12:23:17.985 INFO:tasks.workunit.client.1.smithi195.stdout:0/997: dread - d4/d48/d4e/f138 zero size 2024-04-06T12:23:17.986 INFO:tasks.workunit.client.1.smithi195.stdout:8/955: dwrite d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/d83/fbb [0,4194304] 0 2024-04-06T12:23:17.987 INFO:tasks.workunit.client.1.smithi195.stdout:7/849: dread d4/d16/dd/d22/d3f/d54/f90 [0,4194304] 0 2024-04-06T12:23:17.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/998: chown d4/d48/d67/d75/dcf/f10d 93635 1 2024-04-06T12:23:17.993 INFO:tasks.workunit.client.1.smithi195.stdout:4/945: rename d4/d6/d38/d1a/d40/d20/d107/dc6/df7 to d4/d6/d38/d65/d10b/d131 0 2024-04-06T12:23:17.993 INFO:tasks.workunit.client.1.smithi195.stdout:0/999: truncate d4/d6/d58/f115 1008667 0 2024-04-06T12:23:17.993 INFO:tasks.workunit.client.1.smithi195.stdout:7/850: rmdir d4/d16/dd/d22/d106/d80/d105 39 2024-04-06T12:23:17.996 INFO:tasks.workunit.client.1.smithi195.stdout:8/956: symlink d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/db0/l142 0 2024-04-06T12:23:18.000 INFO:tasks.workunit.client.1.smithi195.stdout:8/957: mknod d6/dd/d70/d24/d34/d67/da1/c143 0 2024-04-06T12:23:18.000 INFO:tasks.workunit.client.1.smithi195.stdout:7/851: link d4/d10/d18/d19/d63/c69 d4/d16/dd/d22/d3f/d54/c109 0 2024-04-06T12:23:18.001 INFO:tasks.workunit.client.1.smithi195.stdout:8/958: chown d6/dd/d70/d24/d34/d67/da1/da2/lc4 29352347 1 2024-04-06T12:23:18.005 INFO:tasks.workunit.client.1.smithi195.stdout:8/959: fsync d6/fb6 0 2024-04-06T12:23:18.008 INFO:tasks.workunit.client.1.smithi195.stdout:8/960: mknod d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/dab/c144 0 2024-04-06T12:23:18.011 INFO:tasks.workunit.client.1.smithi195.stdout:8/961: write d6/dd/d70/d118/d46/db2/fc2 [8039805,14842] 0 2024-04-06T12:23:18.012 INFO:tasks.workunit.client.1.smithi195.stdout:7/852: dwrite d4/d10/f40 [0,4194304] 0 2024-04-06T12:23:18.014 INFO:tasks.workunit.client.1.smithi195.stdout:4/946: dread d4/d3e/f78 [4194304,4194304] 0 2024-04-06T12:23:18.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/962: rename d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12/f37 to d6/dd/d70/d24/d25/d7c/d123/f145 0 2024-04-06T12:23:18.019 INFO:tasks.workunit.client.1.smithi195.stdout:8/963: readlink d6/dd/d42/l7b 0 2024-04-06T12:23:18.022 INFO:tasks.workunit.client.1.smithi195.stdout:4/947: truncate d4/d6/d38/d1a/d40/d20/d107/dc6/fc8 2407448 0 2024-04-06T12:23:18.023 INFO:tasks.workunit.client.1.smithi195.stdout:8/964: creat d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/dab/f146 x:0 0 0 2024-04-06T12:23:18.025 INFO:tasks.workunit.client.1.smithi195.stdout:4/948: mkdir d4/d6/d38/d1a/d40/d20/d107/d132 0 2024-04-06T12:23:18.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/965: chown d6/dd/d42/f9b 242468779 1 2024-04-06T12:23:18.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/949: rename d4/d6/d38/d1a/d40/c1f to d4/d6/d38/d65/d127/c133 0 2024-04-06T12:23:18.037 INFO:tasks.workunit.client.1.smithi195.stdout:8/966: dread d6/dd/d70/d24/d25/f93 [0,4194304] 0 2024-04-06T12:23:18.038 INFO:tasks.workunit.client.1.smithi195.stdout:4/950: write d4/d6/d38/d1a/da7/d100/d85/ff5 [654367,110616] 0 2024-04-06T12:23:18.041 INFO:tasks.workunit.client.1.smithi195.stdout:8/967: creat d6/dd/d70/d24/d34/d67/da1/da2/da4/f147 x:0 0 0 2024-04-06T12:23:18.042 INFO:tasks.workunit.client.1.smithi195.stdout:4/951: getdents d4/d6/d38/d10f 0 2024-04-06T12:23:18.044 INFO:tasks.workunit.client.1.smithi195.stdout:4/952: readlink d4/d6/d38/d1a/d40/d57/d64/lc2 0 2024-04-06T12:23:18.045 INFO:tasks.workunit.client.1.smithi195.stdout:8/968: getdents d6/dd/d70/d118/d46/d12c 0 2024-04-06T12:23:18.046 INFO:tasks.workunit.client.1.smithi195.stdout:4/953: mkdir d4/d6/d38/d65/dc5/d134 0 2024-04-06T12:23:18.047 INFO:tasks.workunit.client.1.smithi195.stdout:8/969: chown d6/dd/d70/d24/d34/d67/da1/da2/f102 7 1 2024-04-06T12:23:18.049 INFO:tasks.workunit.client.1.smithi195.stdout:4/954: creat d4/d6/d38/d1a/da7/d100/da6/f135 x:0 0 0 2024-04-06T12:23:18.052 INFO:tasks.workunit.client.1.smithi195.stdout:4/955: creat d4/d6/d38/d1a/d40/d20/d107/f136 x:0 0 0 2024-04-06T12:23:18.053 INFO:tasks.workunit.client.1.smithi195.stdout:4/956: chown d4/d8c/fbf 6 1 2024-04-06T12:23:18.053 INFO:tasks.workunit.client.1.smithi195.stdout:8/970: dread d6/f10d [0,4194304] 0 2024-04-06T12:23:18.057 INFO:tasks.workunit.client.1.smithi195.stdout:8/971: getdents d6/dd/d70/d24/d25/da5 0 2024-04-06T12:23:18.058 INFO:tasks.workunit.client.1.smithi195.stdout:8/972: fdatasync d6/f10d 0 2024-04-06T12:23:18.063 INFO:tasks.workunit.client.1.smithi195.stdout:4/957: dwrite d4/f4a [4194304,4194304] 0 2024-04-06T12:23:18.066 INFO:tasks.workunit.client.1.smithi195.stdout:4/958: read d4/d6/d38/f86 [1844274,30921] 0 2024-04-06T12:23:18.070 INFO:tasks.workunit.client.1.smithi195.stdout:4/959: read d4/d6/d38/d1a/d40/d57/d64/fb2 [2931885,50234] 0 2024-04-06T12:23:18.071 INFO:tasks.workunit.client.1.smithi195.stdout:8/973: dwrite d6/dd/d70/d118/d46/f63 [0,4194304] 0 2024-04-06T12:23:18.074 INFO:tasks.workunit.client.1.smithi195.stdout:4/960: mkdir d4/d3e/d10e/d137 0 2024-04-06T12:23:18.082 INFO:tasks.workunit.client.1.smithi195.stdout:4/961: dwrite d4/fda [0,4194304] 0 2024-04-06T12:23:18.084 INFO:tasks.workunit.client.1.smithi195.stdout:4/962: fdatasync d4/d6/d38/d65/fa3 0 2024-04-06T12:23:18.091 INFO:tasks.workunit.client.1.smithi195.stdout:4/963: rename d4/f2e to d4/d6/d38/f138 0 2024-04-06T12:23:18.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/964: rename d4/d6/d38/d1a/da7/d100/da6/dae/dec/fee to d4/d6/d38/d1a/d40/d20/d107/dc9/f139 0 2024-04-06T12:23:18.098 INFO:tasks.workunit.client.1.smithi195.stdout:4/965: write d4/d6/d38/d1a/da7/d100/ff9 [237818,92991] 0 2024-04-06T12:23:18.100 INFO:tasks.workunit.client.1.smithi195.stdout:8/974: dread d6/dd/d70/d24/d25/f78 [0,4194304] 0 2024-04-06T12:23:18.101 INFO:tasks.workunit.client.1.smithi195.stdout:4/966: fsync d4/f5 0 2024-04-06T12:23:18.102 INFO:tasks.workunit.client.1.smithi195.stdout:4/967: write d4/d6/d38/d65/f120 [35666,82905] 0 2024-04-06T12:23:18.104 INFO:tasks.workunit.client.1.smithi195.stdout:8/975: creat d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/d12e/f148 x:0 0 0 2024-04-06T12:23:18.106 INFO:tasks.workunit.client.1.smithi195.stdout:4/968: creat d4/f13a x:0 0 0 2024-04-06T12:23:18.106 INFO:tasks.workunit.client.1.smithi195.stdout:8/976: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/ff1 [848669,493] 0 2024-04-06T12:23:18.109 INFO:tasks.workunit.client.1.smithi195.stdout:4/969: creat d4/d6/d38/d1a/d40/d20/d107/dc9/df8/f13b x:0 0 0 2024-04-06T12:23:18.110 INFO:tasks.workunit.client.1.smithi195.stdout:8/977: creat d6/dd/d70/d24/d34/d67/da1/f149 x:0 0 0 2024-04-06T12:23:18.112 INFO:tasks.workunit.client.1.smithi195.stdout:4/970: mkdir d4/d6/d38/d1a/d40/d20/d107/d13c 0 2024-04-06T12:23:18.112 INFO:tasks.workunit.client.1.smithi195.stdout:8/978: creat d6/dd/d70/d118/d46/d12c/f14a x:0 0 0 2024-04-06T12:23:18.116 INFO:tasks.workunit.client.1.smithi195.stdout:8/979: stat d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/dda/df6 0 2024-04-06T12:23:18.116 INFO:tasks.workunit.client.1.smithi195.stdout:7/853: sync 2024-04-06T12:23:18.119 INFO:tasks.workunit.client.1.smithi195.stdout:4/971: dwrite d4/d6/d38/d1a/da7/d100/f128 [0,4194304] 0 2024-04-06T12:23:18.124 INFO:tasks.workunit.client.1.smithi195.stdout:4/972: creat d4/d6/d38/d65/dc5/df1/f13d x:0 0 0 2024-04-06T12:23:18.126 INFO:tasks.workunit.client.1.smithi195.stdout:8/980: getdents d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d12 0 2024-04-06T12:23:18.127 INFO:tasks.workunit.client.1.smithi195.stdout:7/854: dwrite d4/d10/d12/fb1 [0,4194304] 0 2024-04-06T12:23:18.127 INFO:tasks.workunit.client.1.smithi195.stdout:4/973: read d4/d8c/f115 [1435577,93596] 0 2024-04-06T12:23:18.128 INFO:tasks.workunit.client.1.smithi195.stdout:8/981: creat d6/dd/d70/f14b x:0 0 0 2024-04-06T12:23:18.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/982: dread d6/dd/d70/d24/d25/f93 [0,4194304] 0 2024-04-06T12:23:18.157 INFO:tasks.workunit.client.1.smithi195.stdout:4/974: dread d4/d6/d38/d1a/d40/d57/fe4 [0,4194304] 0 2024-04-06T12:23:18.162 INFO:tasks.workunit.client.1.smithi195.stdout:8/983: dread d6/f91 [0,4194304] 0 2024-04-06T12:23:18.166 INFO:tasks.workunit.client.1.smithi195.stdout:4/975: mkdir d4/d6/d38/d1a/d40/d20/d107/dc9/df8/d13e 0 2024-04-06T12:23:18.185 INFO:tasks.workunit.client.1.smithi195.stdout:4/976: dwrite d4/f5 [0,4194304] 0 2024-04-06T12:23:18.189 INFO:tasks.workunit.client.1.smithi195.stdout:4/977: creat d4/d6/d38/d1a/da7/d100/da6/f13f x:0 0 0 2024-04-06T12:23:18.226 INFO:tasks.workunit.client.1.smithi195.stdout:4/978: truncate d4/d6/d38/d1a/d40/d20/f60 3617608 0 2024-04-06T12:23:18.228 INFO:tasks.workunit.client.1.smithi195.stdout:4/979: creat d4/d6/d38/d1a/da7/d100/f140 x:0 0 0 2024-04-06T12:23:18.230 INFO:tasks.workunit.client.1.smithi195.stdout:4/980: mkdir d4/d3e/d10e/d141 0 2024-04-06T12:23:18.231 INFO:tasks.workunit.client.1.smithi195.stdout:4/981: read d4/d6/fab [2859312,96117] 0 2024-04-06T12:23:18.237 INFO:tasks.workunit.client.1.smithi195.stdout:4/982: dwrite d4/d6/d38/d1a/da7/d100/f140 [0,4194304] 0 2024-04-06T12:23:18.241 INFO:tasks.workunit.client.1.smithi195.stdout:4/983: rename d4/d6/d38/d65/fd8 to d4/d3e/d10e/f142 0 2024-04-06T12:23:18.252 INFO:tasks.workunit.client.1.smithi195.stdout:4/984: dread d4/d6/d38/f1d [0,4194304] 0 2024-04-06T12:23:18.254 INFO:tasks.workunit.client.1.smithi195.stdout:4/985: creat d4/d6/d38/d65/d10b/d131/f143 x:0 0 0 2024-04-06T12:23:18.255 INFO:tasks.workunit.client.1.smithi195.stdout:4/986: fsync d4/d3e/f52 0 2024-04-06T12:23:18.257 INFO:tasks.workunit.client.1.smithi195.stdout:7/855: sync 2024-04-06T12:23:18.259 INFO:tasks.workunit.client.1.smithi195.stdout:7/856: creat d4/d10/f10a x:0 0 0 2024-04-06T12:23:18.263 INFO:tasks.workunit.client.1.smithi195.stdout:4/987: dread d4/d3e/f78 [0,4194304] 0 2024-04-06T12:23:18.268 INFO:tasks.workunit.client.1.smithi195.stdout:4/988: rmdir d4/d6/d38/d1a 39 2024-04-06T12:23:18.270 INFO:tasks.workunit.client.1.smithi195.stdout:7/857: link d4/d16/dd/d22/d3f/ce1 d4/d10/d18/d19/c10b 0 2024-04-06T12:23:18.274 INFO:tasks.workunit.client.1.smithi195.stdout:4/989: mkdir d4/d6/d38/d1a/da7/d100/da6/d144 0 2024-04-06T12:23:18.276 INFO:tasks.workunit.client.1.smithi195.stdout:4/990: mkdir d4/d6/d38/d1a/da7/d100/d85/d145 0 2024-04-06T12:23:18.279 INFO:tasks.workunit.client.1.smithi195.stdout:4/991: mkdir d4/d6/d38/d1a/da7/d100/da6/dae/d146 0 2024-04-06T12:23:18.279 INFO:tasks.workunit.client.1.smithi195.stdout:7/858: dwrite d4/d16/f6a [0,4194304] 0 2024-04-06T12:23:18.292 INFO:tasks.workunit.client.1.smithi195.stdout:4/992: dwrite d4/d8c/f10a [0,4194304] 0 2024-04-06T12:23:18.294 INFO:tasks.workunit.client.1.smithi195.stdout:4/993: creat d4/d6/f147 x:0 0 0 2024-04-06T12:23:18.298 INFO:tasks.workunit.client.1.smithi195.stdout:7/859: dread d4/d10/f27 [4194304,4194304] 0 2024-04-06T12:23:18.300 INFO:tasks.workunit.client.1.smithi195.stdout:4/994: dread d4/d3e/f98 [0,4194304] 0 2024-04-06T12:23:18.301 INFO:tasks.workunit.client.1.smithi195.stdout:7/860: creat d4/d10/d18/d19/f10c x:0 0 0 2024-04-06T12:23:18.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/861: creat d4/d10/d18/da0/f10d x:0 0 0 2024-04-06T12:23:18.305 INFO:tasks.workunit.client.1.smithi195.stdout:4/995: write d4/d6/d38/d65/fa3 [1888884,128097] 0 2024-04-06T12:23:18.306 INFO:tasks.workunit.client.1.smithi195.stdout:8/984: sync 2024-04-06T12:23:18.306 INFO:tasks.workunit.client.1.smithi195.stdout:7/862: mkdir d4/d10/d18/d19/d10e 0 2024-04-06T12:23:18.308 INFO:tasks.workunit.client.1.smithi195.stdout:4/996: unlink d4/d6/d38/c5a 0 2024-04-06T12:23:18.311 INFO:tasks.workunit.client.1.smithi195.stdout:4/997: chown d4/d6/d38/d1a/da7/d100/da6/dae/fe3 0 1 2024-04-06T12:23:18.313 INFO:tasks.workunit.client.1.smithi195.stdout:7/863: dwrite d4/d10/ff5 [0,4194304] 0 2024-04-06T12:23:18.315 INFO:tasks.workunit.client.1.smithi195.stdout:4/998: creat d4/d6/d38/d10f/f148 x:0 0 0 2024-04-06T12:23:18.315 INFO:tasks.workunit.client.1.smithi195.stdout:4/999: dread - d4/d6/f147 zero size 2024-04-06T12:23:18.317 INFO:tasks.workunit.client.1.smithi195.stdout:7/864: creat d4/d16/dd/d22/d106/dfe/f10f x:0 0 0 2024-04-06T12:23:18.322 INFO:tasks.workunit.client.1.smithi195.stdout:7/865: getdents d4 0 2024-04-06T12:23:18.326 INFO:tasks.workunit.client.1.smithi195.stdout:7/866: rename d4/d16/dd/d22/l100 to d4/d16/dd/d22/d106/l110 0 2024-04-06T12:23:18.327 INFO:tasks.workunit.client.1.smithi195.stdout:7/867: creat d4/d16/dd/f111 x:0 0 0 2024-04-06T12:23:18.329 INFO:tasks.workunit.client.1.smithi195.stdout:7/868: mkdir d4/d10/d18/da0/d112 0 2024-04-06T12:23:18.331 INFO:tasks.workunit.client.1.smithi195.stdout:7/869: symlink d4/d10/d18/d19/d10e/l113 0 2024-04-06T12:23:18.335 INFO:tasks.workunit.client.1.smithi195.stdout:7/870: write d4/d10/d18/d57/f7f [4551056,5760] 0 2024-04-06T12:23:18.342 INFO:tasks.workunit.client.1.smithi195.stdout:7/871: dwrite d4/d10/d18/d19/f9e [4194304,4194304] 0 2024-04-06T12:23:18.347 INFO:tasks.workunit.client.1.smithi195.stdout:7/872: write d4/d10/d12/f14 [598072,111271] 0 2024-04-06T12:23:18.349 INFO:tasks.workunit.client.1.smithi195.stdout:7/873: dread - d4/d16/dd/d22/d3f/d54/da9/f4d zero size 2024-04-06T12:23:18.351 INFO:tasks.workunit.client.1.smithi195.stdout:7/874: mknod d4/d10/d12/da5/c114 0 2024-04-06T12:23:18.358 INFO:tasks.workunit.client.1.smithi195.stdout:7/875: write d4/d16/dd/d22/d3f/f68 [672293,55162] 0 2024-04-06T12:23:18.364 INFO:tasks.workunit.client.1.smithi195.stdout:7/876: dwrite d4/d16/dd/d22/d76/f7a [0,4194304] 0 2024-04-06T12:23:18.373 INFO:tasks.workunit.client.1.smithi195.stdout:7/877: dwrite d4/d16/dd/d22/d106/dfe/f10f [0,4194304] 0 2024-04-06T12:23:18.374 INFO:tasks.workunit.client.1.smithi195.stdout:7/878: dread - d4/d10/f10a zero size 2024-04-06T12:23:18.377 INFO:tasks.workunit.client.1.smithi195.stdout:7/879: creat d4/d10/d18/d19/d63/f115 x:0 0 0 2024-04-06T12:23:18.380 INFO:tasks.workunit.client.1.smithi195.stdout:7/880: symlink d4/d10/d18/d33/l116 0 2024-04-06T12:23:18.384 INFO:tasks.workunit.client.1.smithi195.stdout:7/881: getdents d4/d16/dd/d22/d106/d80 0 2024-04-06T12:23:18.385 INFO:tasks.workunit.client.1.smithi195.stdout:7/882: fsync d4/fcf 0 2024-04-06T12:23:18.386 INFO:tasks.workunit.client.1.smithi195.stdout:7/883: write d4/d16/dd/d22/d106/f49 [962446,31350] 0 2024-04-06T12:23:18.388 INFO:tasks.workunit.client.1.smithi195.stdout:7/884: rmdir d4/d10/d12/da5 39 2024-04-06T12:23:18.388 INFO:tasks.workunit.client.1.smithi195.stdout:7/885: chown d4/d10/d18/d19/d10e 373134756 1 2024-04-06T12:23:18.389 INFO:tasks.workunit.client.1.smithi195.stdout:7/886: write d4/d10/d18/d33/d6e/f7d [124104,79195] 0 2024-04-06T12:23:18.393 INFO:tasks.workunit.client.1.smithi195.stdout:7/887: rename d4/d10/d18/d57/l6d to d4/d10/d12/l117 0 2024-04-06T12:23:18.395 INFO:tasks.workunit.client.1.smithi195.stdout:7/888: creat d4/f118 x:0 0 0 2024-04-06T12:23:18.407 INFO:tasks.workunit.client.1.smithi195.stdout:7/889: dwrite d4/d10/d18/f53 [0,4194304] 0 2024-04-06T12:23:18.409 INFO:tasks.workunit.client.1.smithi195.stdout:7/890: chown d4/d16/f2d 13842 1 2024-04-06T12:23:18.410 INFO:tasks.workunit.client.1.smithi195.stdout:7/891: fsync d4/d16/dd/d22/fc5 0 2024-04-06T12:23:18.414 INFO:tasks.workunit.client.1.smithi195.stdout:7/892: mkdir d4/d10/d12/da5/d119 0 2024-04-06T12:23:18.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/893: dread d4/d10/d18/d33/d6e/fbc [0,4194304] 0 2024-04-06T12:23:18.423 INFO:tasks.workunit.client.1.smithi195.stdout:8/985: sync 2024-04-06T12:23:18.425 INFO:tasks.workunit.client.1.smithi195.stdout:8/986: chown d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/fc9 17269 1 2024-04-06T12:23:18.425 INFO:tasks.workunit.client.1.smithi195.stdout:7/894: dread d4/d16/dd/d22/d3f/d54/fb4 [0,4194304] 0 2024-04-06T12:23:18.425 INFO:tasks.workunit.client.1.smithi195.stdout:8/987: chown d6/dd/d70/d24/d34 3 1 2024-04-06T12:23:18.426 INFO:tasks.workunit.client.1.smithi195.stdout:7/895: rename d4/d10/d12/da5 to d4/d10/d12/da5/da3/d11a 22 2024-04-06T12:23:18.428 INFO:tasks.workunit.client.1.smithi195.stdout:8/988: read d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/f55 [2607852,52245] 0 2024-04-06T12:23:18.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/896: chown d4/d16/dd/d22/d3f/d54/cb3 28 1 2024-04-06T12:23:18.431 INFO:tasks.workunit.client.1.smithi195.stdout:7/897: symlink d4/d10/d18/d33/l11b 0 2024-04-06T12:23:18.431 INFO:tasks.workunit.client.1.smithi195.stdout:8/989: dread d6/f91 [0,4194304] 0 2024-04-06T12:23:18.432 INFO:tasks.workunit.client.1.smithi195.stdout:8/990: chown d6/db/c27 314 1 2024-04-06T12:23:18.432 INFO:tasks.workunit.client.1.smithi195.stdout:7/898: write d4/d10/d12/d6f/fd9 [553049,73130] 0 2024-04-06T12:23:18.433 INFO:tasks.workunit.client.1.smithi195.stdout:7/899: chown d4/d16/dd/d22/cdf 655597 1 2024-04-06T12:23:18.434 INFO:tasks.workunit.client.1.smithi195.stdout:7/900: chown d4/d16/dd/d22/d106/d80 5233 1 2024-04-06T12:23:18.438 INFO:tasks.workunit.client.1.smithi195.stdout:8/991: rename d6/dd/d70/d24/d25/l4a to d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/d52/db0/d13a/l14c 0 2024-04-06T12:23:18.439 INFO:tasks.workunit.client.1.smithi195.stdout:7/901: write d4/d16/dd/d22/d3f/d54/da9/f42 [577116,1577] 0 2024-04-06T12:23:18.442 INFO:tasks.workunit.client.1.smithi195.stdout:7/902: symlink d4/l11c 0 2024-04-06T12:23:18.446 INFO:tasks.workunit.client.1.smithi195.stdout:7/903: creat d4/d16/dd/d22/d76/f11d x:0 0 0 2024-04-06T12:23:18.448 INFO:tasks.workunit.client.1.smithi195.stdout:7/904: dread - d4/d16/dd/f78 zero size 2024-04-06T12:23:18.448 INFO:tasks.workunit.client.1.smithi195.stdout:8/992: dwrite d6/dd/d70/d118/d46/f89 [0,4194304] 0 2024-04-06T12:23:18.451 INFO:tasks.workunit.client.1.smithi195.stdout:8/993: truncate d6/dd/d70/ffe 1723605 0 2024-04-06T12:23:18.454 INFO:tasks.workunit.client.1.smithi195.stdout:7/905: write d4/d16/dd/d22/d3f/d54/da9/f77 [962075,47462] 0 2024-04-06T12:23:18.455 INFO:tasks.workunit.client.1.smithi195.stdout:8/994: mknod d6/dd/d70/d24/d25/d49/d129/c14d 0 2024-04-06T12:23:18.455 INFO:tasks.workunit.client.1.smithi195.stdout:7/906: read d4/d16/d11/f59 [7956924,3742] 0 2024-04-06T12:23:18.456 INFO:tasks.workunit.client.1.smithi195.stdout:8/995: chown d6/dd/d70/d24/d34/d67/da1/da2/f102 480121 1 2024-04-06T12:23:18.457 INFO:tasks.workunit.client.1.smithi195.stdout:7/907: creat d4/d16/d11/f11e x:0 0 0 2024-04-06T12:23:18.462 INFO:tasks.workunit.client.1.smithi195.stdout:8/996: dwrite d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/fde [0,4194304] 0 2024-04-06T12:23:18.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/908: link d4/d16/dd/d22/l93 d4/d10/d18/da0/d112/l11f 0 2024-04-06T12:23:18.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/909: mknod d4/d16/dd/d22/d106/dfe/c120 0 2024-04-06T12:23:18.467 INFO:tasks.workunit.client.1.smithi195.stdout:7/910: fdatasync d4/d10/ff5 0 2024-04-06T12:23:18.467 INFO:tasks.workunit.client.1.smithi195.stdout:8/997: mkdir d6/dd/d70/d24/d25/d14e 0 2024-04-06T12:23:18.470 INFO:tasks.workunit.client.1.smithi195.stdout:7/911: dread d4/d10/d12/f14 [0,4194304] 0 2024-04-06T12:23:18.470 INFO:tasks.workunit.client.1.smithi195.stdout:8/998: write d6/dd/d70/d24/d34/d67/da1/da2/dc6/d101/de8/daa/dab/ffd [344519,82815] 0 2024-04-06T12:23:18.473 INFO:tasks.workunit.client.1.smithi195.stdout:7/912: symlink d4/d16/dd/l121 0 2024-04-06T12:23:18.476 INFO:tasks.workunit.client.1.smithi195.stdout:8/999: rmdir d6/dd/d70/d24/d25 39 2024-04-06T12:23:18.480 INFO:tasks.workunit.client.1.smithi195.stdout:7/913: truncate d4/f96 3398303 0 2024-04-06T12:23:18.482 INFO:tasks.workunit.client.1.smithi195.stdout:7/914: write d4/d16/dd/d22/d3f/d54/da9/f42 [1152228,127499] 0 2024-04-06T12:23:18.487 INFO:tasks.workunit.client.1.smithi195.stdout:7/915: truncate d4/d10/d18/d19/f50 368922 0 2024-04-06T12:23:18.493 INFO:tasks.workunit.client.1.smithi195.stdout:7/916: dwrite d4/d10/d12/d6f/f108 [0,4194304] 0 2024-04-06T12:23:18.495 INFO:tasks.workunit.client.1.smithi195.stdout:7/917: write d4/d16/dd/d22/d76/fd7 [3871572,83857] 0 2024-04-06T12:23:18.503 INFO:tasks.workunit.client.1.smithi195.stdout:7/918: dwrite d4/d16/dd/d22/d3f/f68 [0,4194304] 0 2024-04-06T12:23:18.506 INFO:tasks.workunit.client.1.smithi195.stdout:7/919: dread d4/d16/dd/d22/d3f/d54/f90 [0,4194304] 0 2024-04-06T12:23:18.509 INFO:tasks.workunit.client.1.smithi195.stdout:7/920: symlink d4/d10/d12/l122 0 2024-04-06T12:23:18.510 INFO:tasks.workunit.client.1.smithi195.stdout:7/921: dread - d4/d16/dd/d22/ffb zero size 2024-04-06T12:23:18.512 INFO:tasks.workunit.client.1.smithi195.stdout:7/922: creat d4/d16/dd/d22/d3f/f123 x:0 0 0 2024-04-06T12:23:18.514 INFO:tasks.workunit.client.1.smithi195.stdout:7/923: dread - d4/d16/dd/d22/d3f/f99 zero size 2024-04-06T12:23:18.516 INFO:tasks.workunit.client.1.smithi195.stdout:7/924: fdatasync d4/d16/dd/d22/d3f/d54/da9/f3b 0 2024-04-06T12:23:18.518 INFO:tasks.workunit.client.1.smithi195.stdout:7/925: chown d4/d10/d12/d6f/f108 25426423 1 2024-04-06T12:23:18.520 INFO:tasks.workunit.client.1.smithi195.stdout:7/926: creat d4/d16/dd/d22/d106/d80/d105/d103/f124 x:0 0 0 2024-04-06T12:23:18.522 INFO:tasks.workunit.client.1.smithi195.stdout:7/927: mknod d4/d16/dd/d22/d106/c125 0 2024-04-06T12:23:18.523 INFO:tasks.workunit.client.1.smithi195.stdout:7/928: chown d4/d16/d11/f11e 23504 1 2024-04-06T12:23:18.533 INFO:tasks.workunit.client.1.smithi195.stdout:7/929: dread d4/d16/f2d [0,4194304] 0 2024-04-06T12:23:18.537 INFO:tasks.workunit.client.1.smithi195.stdout:7/930: dwrite d4/d10/d12/f2e [0,4194304] 0 2024-04-06T12:23:18.542 INFO:tasks.workunit.client.1.smithi195.stdout:7/931: dread d4/d10/f40 [0,4194304] 0 2024-04-06T12:23:18.544 INFO:tasks.workunit.client.1.smithi195.stdout:7/932: symlink d4/d10/d18/d33/dd8/l126 0 2024-04-06T12:23:18.545 INFO:tasks.workunit.client.1.smithi195.stdout:7/933: creat d4/d16/dd/f127 x:0 0 0 2024-04-06T12:23:18.548 INFO:tasks.workunit.client.1.smithi195.stdout:7/934: rename d4/d16/dd/d22/d3f/d54/f9d to d4/d10/d18/da0/f128 0 2024-04-06T12:23:18.550 INFO:tasks.workunit.client.1.smithi195.stdout:7/935: symlink d4/d10/d18/d33/d6e/l129 0 2024-04-06T12:23:18.559 INFO:tasks.workunit.client.1.smithi195.stdout:7/936: dread d4/d10/d12/da5/da3/fe0 [0,4194304] 0 2024-04-06T12:23:18.561 INFO:tasks.workunit.client.1.smithi195.stdout:7/937: mknod d4/d16/dd/d22/d106/d80/d105/c12a 0 2024-04-06T12:23:18.568 INFO:tasks.workunit.client.1.smithi195.stdout:7/938: dwrite d4/f96 [0,4194304] 0 2024-04-06T12:23:18.574 INFO:tasks.workunit.client.1.smithi195.stdout:7/939: link d4/d10/d12/da5/da3/lcd d4/d16/dd/d22/d106/d80/d105/d103/l12b 0 2024-04-06T12:23:18.583 INFO:tasks.workunit.client.1.smithi195.stdout:7/940: dwrite d4/d16/dd/d22/d106/d80/fc9 [0,4194304] 0 2024-04-06T12:23:18.585 INFO:tasks.workunit.client.1.smithi195.stdout:7/941: chown d4/d10/f40 2635552 1 2024-04-06T12:23:18.585 INFO:tasks.workunit.client.1.smithi195.stdout:7/942: dread - d4/d16/dd/d22/d3f/f99 zero size 2024-04-06T12:23:18.586 INFO:tasks.workunit.client.1.smithi195.stdout:7/943: write d4/d10/d12/d6f/f108 [2241605,121226] 0 2024-04-06T12:23:18.587 INFO:tasks.workunit.client.1.smithi195.stdout:7/944: fdatasync d4/d10/d18/d19/d63/f115 0 2024-04-06T12:23:18.589 INFO:tasks.workunit.client.1.smithi195.stdout:7/945: chown d4/d16/dd/d22/d106/d80/f9c 38809307 1 2024-04-06T12:23:18.592 INFO:tasks.workunit.client.1.smithi195.stdout:7/946: dread d4/d10/d12/da5/da3/fe0 [0,4194304] 0 2024-04-06T12:23:18.597 INFO:tasks.workunit.client.1.smithi195.stdout:7/947: link d4/d10/d18/d33/d6e/fbc d4/d16/dd/d22/d106/dfe/f12c 0 2024-04-06T12:23:18.599 INFO:tasks.workunit.client.1.smithi195.stdout:7/948: symlink d4/d16/dd/d22/d106/d80/d105/l12d 0 2024-04-06T12:23:18.599 INFO:tasks.workunit.client.1.smithi195.stdout:7/949: chown d4/d16/dd/d22/d3f/d54/da9/f42 14567 1 2024-04-06T12:23:18.603 INFO:tasks.workunit.client.1.smithi195.stdout:7/950: rename d4/d16/dd/d22/d3f/d54/f5f to d4/d10/d18/d33/dd8/f12e 0 2024-04-06T12:23:18.604 INFO:tasks.workunit.client.1.smithi195.stdout:7/951: readlink d4/d10/d12/l117 0 2024-04-06T12:23:18.610 INFO:tasks.workunit.client.1.smithi195.stdout:7/952: truncate d4/d16/dd/d22/d3f/d54/fb4 1139036 0 2024-04-06T12:23:18.613 INFO:tasks.workunit.client.1.smithi195.stdout:7/953: rename d4/d16/f47 to d4/d10/d18/da0/f12f 0 2024-04-06T12:23:18.613 INFO:tasks.workunit.client.1.smithi195.stdout:7/954: stat d4/d16/dd/d22/d106/d80/fa8 0 2024-04-06T12:23:18.616 INFO:tasks.workunit.client.1.smithi195.stdout:7/955: dread d4/d16/dd/d22/d3f/d54/f90 [0,4194304] 0 2024-04-06T12:23:18.618 INFO:tasks.workunit.client.1.smithi195.stdout:7/956: mknod d4/d16/dd/d22/d106/dfe/c130 0 2024-04-06T12:23:18.620 INFO:tasks.workunit.client.1.smithi195.stdout:7/957: symlink d4/d10/d18/d19/d63/dc2/l131 0 2024-04-06T12:23:18.634 INFO:tasks.workunit.client.1.smithi195.stdout:7/958: dread d4/d10/d18/d33/dd8/f12e [0,4194304] 0 2024-04-06T12:23:18.635 INFO:tasks.workunit.client.1.smithi195.stdout:7/959: read d4/d16/f1b [15562,84951] 0 2024-04-06T12:23:18.637 INFO:tasks.workunit.client.1.smithi195.stdout:7/960: mkdir d4/d10/d12/da5/da3/d132 0 2024-04-06T12:23:18.640 INFO:tasks.workunit.client.1.smithi195.stdout:7/961: dread d4/d16/dd/d22/d106/f49 [0,4194304] 0 2024-04-06T12:23:18.640 INFO:tasks.workunit.client.1.smithi195.stdout:7/962: fdatasync d4/d10/ff5 0 2024-04-06T12:23:18.642 INFO:tasks.workunit.client.1.smithi195.stdout:7/963: mknod d4/d10/d18/c133 0 2024-04-06T12:23:18.644 INFO:tasks.workunit.client.1.smithi195.stdout:7/964: creat d4/d10/d18/d19/d63/f134 x:0 0 0 2024-04-06T12:23:18.644 INFO:tasks.workunit.client.1.smithi195.stdout:7/965: stat d4/d10/d12/da5/c114 0 2024-04-06T12:23:18.645 INFO:tasks.workunit.client.1.smithi195.stdout:7/966: write d4/f118 [381940,105954] 0 2024-04-06T12:23:18.646 INFO:tasks.workunit.client.1.smithi195.stdout:7/967: write d4/d10/d18/d19/d63/f134 [690325,19496] 0 2024-04-06T12:23:18.649 INFO:tasks.workunit.client.1.smithi195.stdout:7/968: unlink d4/d16/dd/d22/d106/dfe/c120 0 2024-04-06T12:23:18.649 INFO:tasks.workunit.client.1.smithi195.stdout:7/969: fsync d4/d16/d11/fc6 0 2024-04-06T12:23:18.651 INFO:tasks.workunit.client.1.smithi195.stdout:7/970: creat d4/d10/de6/f135 x:0 0 0 2024-04-06T12:23:18.654 INFO:tasks.workunit.client.1.smithi195.stdout:7/971: rename d4/d16/f2d to d4/d10/d12/da5/d119/f136 0 2024-04-06T12:23:18.655 INFO:tasks.workunit.client.1.smithi195.stdout:7/972: truncate d4/d10/de6/f135 50177 0 2024-04-06T12:23:18.657 INFO:tasks.workunit.client.1.smithi195.stdout:7/973: creat d4/f137 x:0 0 0 2024-04-06T12:23:18.658 INFO:tasks.workunit.client.1.smithi195.stdout:7/974: readlink d4/d10/d12/da5/da3/lcd 0 2024-04-06T12:23:18.670 INFO:tasks.workunit.client.1.smithi195.stdout:7/975: rename d4/d10/d12/da5 to d4/d10/d18/d33/d6e/d138 0 2024-04-06T12:23:18.675 INFO:tasks.workunit.client.1.smithi195.stdout:7/976: rename d4/d10/d18/d33/d6e/d138/l86 to d4/d10/l139 0 2024-04-06T12:23:18.677 INFO:tasks.workunit.client.1.smithi195.stdout:7/977: mkdir d4/d10/d18/d33/d13a 0 2024-04-06T12:23:18.678 INFO:tasks.workunit.client.1.smithi195.stdout:7/978: write d4/d10/d18/d19/d63/f115 [795890,20763] 0 2024-04-06T12:23:18.678 INFO:tasks.workunit.client.1.smithi195.stdout:7/979: chown d4/d16/dd/d22/d3f 6004759 1 2024-04-06T12:23:18.682 INFO:tasks.workunit.client.1.smithi195.stdout:7/980: getdents d4/d10/d18/d33/d6e/d138/d119 0 2024-04-06T12:23:18.683 INFO:tasks.workunit.client.1.smithi195.stdout:7/981: write d4/d10/f10a [517918,87399] 0 2024-04-06T12:23:18.686 INFO:tasks.workunit.client.1.smithi195.stdout:7/982: getdents d4/d16/dd/d22/d3f 0 2024-04-06T12:23:18.688 INFO:tasks.workunit.client.1.smithi195.stdout:7/983: symlink d4/d16/dd/d22/d76/l13b 0 2024-04-06T12:23:18.690 INFO:tasks.workunit.client.1.smithi195.stdout:7/984: fdatasync d4/d16/fe 0 2024-04-06T12:23:18.692 INFO:tasks.workunit.client.1.smithi195.stdout:7/985: write d4/d10/d18/da0/f12f [313689,109943] 0 2024-04-06T12:23:18.696 INFO:tasks.workunit.client.1.smithi195.stdout:7/986: dread d4/d16/dd/d22/d3f/d54/da9/f77 [0,4194304] 0 2024-04-06T12:23:18.697 INFO:tasks.workunit.client.1.smithi195.stdout:7/987: chown d4/f20 8 1 2024-04-06T12:23:18.702 INFO:tasks.workunit.client.1.smithi195.stdout:7/988: dwrite d4/d10/d18/d19/f9e [4194304,4194304] 0 2024-04-06T12:23:18.710 INFO:tasks.workunit.client.1.smithi195.stdout:7/989: dwrite d4/d16/d11/f59 [0,4194304] 0 2024-04-06T12:23:18.712 INFO:tasks.workunit.client.1.smithi195.stdout:7/990: mknod d4/d16/dd/d22/d106/d80/d105/d103/c13c 0 2024-04-06T12:23:18.718 INFO:tasks.workunit.client.1.smithi195.stdout:7/991: link d4/d16/lfc d4/d10/d18/d33/l13d 0 2024-04-06T12:23:18.720 INFO:tasks.workunit.client.1.smithi195.stdout:7/992: truncate d4/d16/dd/d22/d3f/d54/da9/f4e 4951248 0 2024-04-06T12:23:18.722 INFO:tasks.workunit.client.1.smithi195.stdout:7/993: symlink d4/d16/dd/d22/d106/l13e 0 2024-04-06T12:23:18.727 INFO:tasks.workunit.client.1.smithi195.stdout:7/994: write d4/d16/dd/d22/d3f/d54/da9/f4d [168696,77714] 0 2024-04-06T12:23:18.728 INFO:tasks.workunit.client.1.smithi195.stdout:7/995: write d4/d16/dd/d22/d76/fda [189000,85804] 0 2024-04-06T12:23:18.730 INFO:tasks.workunit.client.1.smithi195.stdout:7/996: truncate d4/d16/d11/ff3 1322882 0 2024-04-06T12:23:18.731 INFO:tasks.workunit.client.1.smithi195.stdout:7/997: creat d4/d10/d18/d19/f13f x:0 0 0 2024-04-06T12:23:18.733 INFO:tasks.workunit.client.1.smithi195.stdout:7/998: symlink d4/d10/d18/d19/d63/l140 0 2024-04-06T12:23:18.739 INFO:tasks.workunit.client.1.smithi195.stdout:7/999: dwrite d4/d10/d12/f2e [4194304,4194304] 0 2024-04-06T12:23:18.742 INFO:tasks.workunit.client.1.smithi195.stderr:+ rm -rf -- ./tmp.JohQYXlnc2 2024-04-06T12:23:19.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:17.576875+0000 mgr.smithi195.ausetj (mgr.24375) 59 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 1.8 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 173 MiB/s wr, 357 op/s 2024-04-06T12:23:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:17.788123+0000 mon.smithi195 (mon.1) 61 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:23:19.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:17.576875+0000 mgr.smithi195.ausetj (mgr.24375) 59 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 1.8 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 173 MiB/s wr, 357 op/s 2024-04-06T12:23:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:17.788123+0000 mon.smithi195 (mon.1) 61 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:23:21.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:19.577374+0000 mgr.smithi195.ausetj (mgr.24375) 60 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 106 MiB/s rd, 255 MiB/s wr, 527 op/s 2024-04-06T12:23:21.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:19.577374+0000 mgr.smithi195.ausetj (mgr.24375) 60 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 106 MiB/s rd, 255 MiB/s wr, 527 op/s 2024-04-06T12:23:22.438 INFO:tasks.workunit.client.0.smithi152.stdout:9/31: sync 2024-04-06T12:23:22.441 INFO:tasks.workunit.client.0.smithi152.stdout:9/32: creat d5/fb x:0 0 0 2024-04-06T12:23:22.443 INFO:tasks.workunit.client.0.smithi152.stdout:9/33: mknod d5/d6/cc 0 2024-04-06T12:23:22.452 INFO:tasks.workunit.client.0.smithi152.stdout:9/34: rmdir d5 39 2024-04-06T12:23:22.456 INFO:tasks.workunit.client.0.smithi152.stdout:9/35: truncate d5/d6/f7 2178601 0 2024-04-06T12:23:22.458 INFO:tasks.workunit.client.0.smithi152.stdout:9/36: creat d5/d6/fd x:0 0 0 2024-04-06T12:23:22.460 INFO:tasks.workunit.client.0.smithi152.stdout:9/37: dread f3 [0,4194304] 0 2024-04-06T12:23:22.461 INFO:tasks.workunit.client.0.smithi152.stdout:9/38: read d5/f9 [88083,66967] 0 2024-04-06T12:23:22.462 INFO:tasks.workunit.client.0.smithi152.stdout:9/39: mknod d5/ce 0 2024-04-06T12:23:22.464 INFO:tasks.workunit.client.0.smithi152.stdout:9/40: mknod d5/d6/cf 0 2024-04-06T12:23:22.470 INFO:tasks.workunit.client.0.smithi152.stdout:9/41: dread d5/d6/f7 [0,4194304] 0 2024-04-06T12:23:22.476 INFO:tasks.workunit.client.0.smithi152.stdout:9/42: rename d5/f8 to d5/f10 0 2024-04-06T12:23:22.478 INFO:tasks.workunit.client.0.smithi152.stdout:9/43: dread d5/d6/f7 [0,4194304] 0 2024-04-06T12:23:22.478 INFO:tasks.workunit.client.0.smithi152.stdout:9/44: chown d5/d6/cc 6 1 2024-04-06T12:23:22.479 INFO:tasks.workunit.client.0.smithi152.stdout:9/45: truncate d5/d6/fd 965219 0 2024-04-06T12:23:22.479 INFO:tasks.workunit.client.0.smithi152.stdout:9/46: readlink d5/d6/la 0 2024-04-06T12:23:22.481 INFO:tasks.workunit.client.0.smithi152.stdout:9/47: mkdir d5/d11 0 2024-04-06T12:23:22.540 INFO:tasks.workunit.client.0.smithi152.stdout:9/48: rmdir d5/d11 0 2024-04-06T12:23:22.542 INFO:tasks.workunit.client.0.smithi152.stdout:9/49: unlink d5/d6/cf 0 2024-04-06T12:23:22.543 INFO:tasks.workunit.client.0.smithi152.stdout:9/50: dread d5/d6/fd [0,4194304] 0 2024-04-06T12:23:22.552 INFO:tasks.workunit.client.0.smithi152.stdout:9/51: dread - d5/f10 zero size 2024-04-06T12:23:22.553 INFO:tasks.workunit.client.0.smithi152.stdout:9/52: dread f3 [0,4194304] 0 2024-04-06T12:23:22.556 INFO:tasks.workunit.client.0.smithi152.stdout:9/53: link c1 d5/d6/c12 0 2024-04-06T12:23:22.557 INFO:tasks.workunit.client.0.smithi152.stdout:9/54: dread - d5/fb zero size 2024-04-06T12:23:22.559 INFO:tasks.workunit.client.0.smithi152.stdout:9/55: dread d5/d6/fd [0,4194304] 0 2024-04-06T12:23:22.561 INFO:tasks.workunit.client.0.smithi152.stdout:9/56: symlink d5/l13 0 2024-04-06T12:23:22.562 INFO:tasks.workunit.client.0.smithi152.stdout:9/57: dread f3 [0,4194304] 0 2024-04-06T12:23:22.564 INFO:tasks.workunit.client.0.smithi152.stdout:9/58: rename f3 to d5/d6/f14 0 2024-04-06T12:23:22.566 INFO:tasks.workunit.client.0.smithi152.stdout:9/59: truncate d5/f10 632284 0 2024-04-06T12:23:22.574 INFO:tasks.workunit.client.0.smithi152.stdout:9/60: fdatasync d5/d6/f14 0 2024-04-06T12:23:23.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:21.577628+0000 mgr.smithi195.ausetj (mgr.24375) 61 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 167 MiB/s wr, 350 op/s 2024-04-06T12:23:23.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:21.577628+0000 mgr.smithi195.ausetj (mgr.24375) 61 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 167 MiB/s wr, 350 op/s 2024-04-06T12:23:25.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:23.577922+0000 mgr.smithi195.ausetj (mgr.24375) 62 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 167 MiB/s wr, 350 op/s 2024-04-06T12:23:25.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:23.577922+0000 mgr.smithi195.ausetj (mgr.24375) 62 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 167 MiB/s wr, 350 op/s 2024-04-06T12:23:27.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:25.578332+0000 mgr.smithi195.ausetj (mgr.24375) 63 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 73 MiB/s rd, 169 MiB/s wr, 404 op/s 2024-04-06T12:23:27.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:25.578332+0000 mgr.smithi195.ausetj (mgr.24375) 63 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 73 MiB/s rd, 169 MiB/s wr, 404 op/s 2024-04-06T12:23:29.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:27.578661+0000 mgr.smithi195.ausetj (mgr.24375) 64 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 33 MiB/s rd, 83 MiB/s wr, 224 op/s 2024-04-06T12:23:29.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:27.578661+0000 mgr.smithi195.ausetj (mgr.24375) 64 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 33 MiB/s rd, 83 MiB/s wr, 224 op/s 2024-04-06T12:23:30.268 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-06T12:23:30.269 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-06T12:23:31.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:29.579107+0000 mgr.smithi195.ausetj (mgr.24375) 65 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 34 MiB/s rd, 83 MiB/s wr, 282 op/s 2024-04-06T12:23:31.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:29.579107+0000 mgr.smithi195.ausetj (mgr.24375) 65 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 34 MiB/s rd, 83 MiB/s wr, 282 op/s 2024-04-06T12:23:33.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:31.579459+0000 mgr.smithi195.ausetj (mgr.24375) 66 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 1003 KiB/s rd, 2.0 MiB/s wr, 112 op/s 2024-04-06T12:23:33.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:31.579459+0000 mgr.smithi195.ausetj (mgr.24375) 66 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 1003 KiB/s rd, 2.0 MiB/s wr, 112 op/s 2024-04-06T12:23:34.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:32.787961+0000 mon.smithi195 (mon.1) 62 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:23:34.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:32.787961+0000 mon.smithi195 (mon.1) 62 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:23:35.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:33.579744+0000 mgr.smithi195.ausetj (mgr.24375) 67 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 1003 KiB/s rd, 2.0 MiB/s wr, 112 op/s 2024-04-06T12:23:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:33.579744+0000 mgr.smithi195.ausetj (mgr.24375) 67 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 1003 KiB/s rd, 2.0 MiB/s wr, 112 op/s 2024-04-06T12:23:35.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.321+0000 7fccd2eac700 1 -- 172.21.15.152:0/2048084627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc0fa950 msgr2=0x7fcccc0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.321+0000 7fccd2eac700 1 --2- 172.21.15.152:0/2048084627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc0fa950 0x7fcccc0fcda0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fccb80047f0 tx=0x7fccb8009cb0).stop 2024-04-06T12:23:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.321+0000 7fccd2eac700 1 -- 172.21.15.152:0/2048084627 shutdown_connections 2024-04-06T12:23:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.321+0000 7fccd2eac700 1 --2- 172.21.15.152:0/2048084627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc0fa950 0x7fcccc0fcda0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.321+0000 7fccd2eac700 1 --2- 172.21.15.152:0/2048084627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcccc061280 0x7fcccc0fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.321+0000 7fccd2eac700 1 -- 172.21.15.152:0/2048084627 >> 172.21.15.152:0/2048084627 conn(0x7fcccc0f1e50 msgr2=0x7fcccc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.321+0000 7fccd2eac700 1 -- 172.21.15.152:0/2048084627 shutdown_connections 2024-04-06T12:23:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.321+0000 7fccd2eac700 1 -- 172.21.15.152:0/2048084627 wait complete. 2024-04-06T12:23:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd2eac700 1 Processor -- start 2024-04-06T12:23:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd2eac700 1 -- start start 2024-04-06T12:23:35.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd2eac700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc061280 0x7fcccc0f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:35.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd2eac700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcccc0fa950 0x7fcccc0f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd2eac700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc0f8220 con 0x7fcccc061280 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd2eac700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc0f67c0 con 0x7fcccc0fa950 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd0c48700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc061280 0x7fcccc0f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd0c48700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc061280 0x7fcccc0f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36372/0 (socket says 172.21.15.152:36372) 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd0c48700 1 -- 172.21.15.152:0/1908157212 learned_addr learned my addr 172.21.15.152:0/1908157212 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fcccbfff700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcccc0fa950 0x7fcccc0f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd0c48700 1 -- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcccc0fa950 msgr2=0x7fcccc0f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd0c48700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcccc0fa950 0x7fcccc0f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.322+0000 7fccd0c48700 1 -- 172.21.15.152:0/1908157212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8005040 con 0x7fcccc061280 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.323+0000 7fccd0c48700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc061280 0x7fcccc0f7c70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fccc000e910 tx=0x7fccc000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.323+0000 7fccc9ffb700 1 -- 172.21.15.152:0/1908157212 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc0007b40 con 0x7fcccc061280 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.323+0000 7fccc9ffb700 1 -- 172.21.15.152:0/1908157212 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fccc000f040 con 0x7fcccc061280 2024-04-06T12:23:35.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.323+0000 7fccc9ffb700 1 -- 172.21.15.152:0/1908157212 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc0014920 con 0x7fcccc061280 2024-04-06T12:23:35.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.323+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcccc0f69e0 con 0x7fcccc061280 2024-04-06T12:23:35.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.323+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcccc0f6fa0 con 0x7fcccc061280 2024-04-06T12:23:35.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.324+0000 7fccc9ffb700 1 -- 172.21.15.152:0/1908157212 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fccc0007ca0 con 0x7fcccc061280 2024-04-06T12:23:35.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.324+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcccc0fffd0 con 0x7fcccc061280 2024-04-06T12:23:35.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.325+0000 7fccc9ffb700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fccbc066dc0 0x7fccbc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:35.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.325+0000 7fccc9ffb700 1 -- 172.21.15.152:0/1908157212 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fccc0083e10 con 0x7fcccc061280 2024-04-06T12:23:35.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.327+0000 7fcccbfff700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fccbc066dc0 0x7fccbc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:35.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.327+0000 7fcccbfff700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fccbc066dc0 0x7fccbc069280 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fccb80047c0 tx=0x7fccb8009cb0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:35.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.329+0000 7fccc9ffb700 1 -- 172.21.15.152:0/1908157212 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fccc0051df0 con 0x7fcccc061280 2024-04-06T12:23:35.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.584+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcccc059120 con 0x7fccbc066dc0 2024-04-06T12:23:35.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.585+0000 7fccc9ffb700 1 -- 172.21.15.152:0/1908157212 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fcccc059120 con 0x7fccbc066dc0 2024-04-06T12:23:35.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fccbc066dc0 msgr2=0x7fccbc069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:35.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fccbc066dc0 0x7fccbc069280 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fccb80047c0 tx=0x7fccb8009cb0).stop 2024-04-06T12:23:35.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc061280 msgr2=0x7fcccc0f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:35.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc061280 0x7fcccc0f7c70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fccc000e910 tx=0x7fccc000b040).stop 2024-04-06T12:23:35.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 shutdown_connections 2024-04-06T12:23:35.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fccbc066dc0 0x7fccbc069280 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcccc061280 0x7fcccc0f7c70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 --2- 172.21.15.152:0/1908157212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcccc0fa950 0x7fcccc0f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 >> 172.21.15.152:0/1908157212 conn(0x7fcccc0f1e50 msgr2=0x7fcccc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:35.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 shutdown_connections 2024-04-06T12:23:35.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.588+0000 7fccd2eac700 1 -- 172.21.15.152:0/1908157212 wait complete. 2024-04-06T12:23:35.597 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:23:35.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.716+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2738936435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80f6710 msgr2=0x7fb3a80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:35.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.716+0000 7fb3ad5c8700 1 --2- 172.21.15.152:0/2738936435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80f6710 0x7fb3a80f6b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb3980047f0 tx=0x7fb398009cb0).stop 2024-04-06T12:23:35.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.716+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2738936435 shutdown_connections 2024-04-06T12:23:35.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.716+0000 7fb3ad5c8700 1 --2- 172.21.15.152:0/2738936435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a80f79b0 0x7fb3a80f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.716+0000 7fb3ad5c8700 1 --2- 172.21.15.152:0/2738936435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80f6710 0x7fb3a80f6b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.716+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2738936435 >> 172.21.15.152:0/2738936435 conn(0x7fb3a80f1e50 msgr2=0x7fb3a80f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:35.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.716+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2738936435 shutdown_connections 2024-04-06T12:23:35.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.716+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2738936435 wait complete. 2024-04-06T12:23:35.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.717+0000 7fb3ad5c8700 1 Processor -- start 2024-04-06T12:23:35.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.717+0000 7fb3ad5c8700 1 -- start start 2024-04-06T12:23:35.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3ad5c8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a80f6710 0x7fb3a8061060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:35.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3ad5c8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80f79b0 0x7fb3a810ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:35.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3ad5c8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a810d2f0 con 0x7fb3a80f6710 2024-04-06T12:23:35.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3ad5c8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a810d430 con 0x7fb3a80f79b0 2024-04-06T12:23:35.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a80f6710 0x7fb3a8061060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:35.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a80f6710 0x7fb3a8061060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36388/0 (socket says 172.21.15.152:36388) 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a6ffd700 1 -- 172.21.15.152:0/2519158770 learned_addr learned my addr 172.21.15.152:0/2519158770 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb39e7fc700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80f79b0 0x7fb3a810ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a6ffd700 1 -- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80f79b0 msgr2=0x7fb3a810ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a6ffd700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80f79b0 0x7fb3a810ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a6ffd700 1 -- 172.21.15.152:0/2519158770 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb398005040 con 0x7fb3a80f6710 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb39e7fc700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80f79b0 0x7fb3a810ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a6ffd700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a80f6710 0x7fb3a8061060 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fb398013560 tx=0x7fb398009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a4ff9700 1 -- 172.21.15.152:0/2519158770 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb398018070 con 0x7fb3a80f6710 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a4ff9700 1 -- 172.21.15.152:0/2519158770 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb398007e90 con 0x7fb3a80f6710 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a810d630 con 0x7fb3a80f6710 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.718+0000 7fb3a4ff9700 1 -- 172.21.15.152:0/2519158770 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb39801c380 con 0x7fb3a80f6710 2024-04-06T12:23:35.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.719+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a810db60 con 0x7fb3a80f6710 2024-04-06T12:23:35.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.719+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a80feed0 con 0x7fb3a80f6710 2024-04-06T12:23:35.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.720+0000 7fb3a4ff9700 1 -- 172.21.15.152:0/2519158770 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fb39801c5f0 con 0x7fb3a80f6710 2024-04-06T12:23:35.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.720+0000 7fb3a4ff9700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fb394066dc0 0x7fb394069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:35.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.720+0000 7fb3a4ff9700 1 -- 172.21.15.152:0/2519158770 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fb398085110 con 0x7fb3a80f6710 2024-04-06T12:23:35.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.720+0000 7fb39e7fc700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fb394066dc0 0x7fb394069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:35.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.721+0000 7fb39e7fc700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fb394066dc0 0x7fb394069280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb390007bf0 tx=0x7fb39000b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:35.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.725+0000 7fb3a4ff9700 1 -- 172.21.15.152:0/2519158770 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fb3980531b0 con 0x7fb3a80f6710 2024-04-06T12:23:35.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.976+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3a8059120 con 0x7fb394066dc0 2024-04-06T12:23:35.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.977+0000 7fb3a4ff9700 1 -- 172.21.15.152:0/2519158770 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb3a8059120 con 0x7fb394066dc0 2024-04-06T12:23:35.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.981+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fb394066dc0 msgr2=0x7fb394069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:35.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.981+0000 7fb3ad5c8700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fb394066dc0 0x7fb394069280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb390007bf0 tx=0x7fb39000b040).stop 2024-04-06T12:23:35.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.981+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a80f6710 msgr2=0x7fb3a8061060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:35.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.981+0000 7fb3ad5c8700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a80f6710 0x7fb3a8061060 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fb398013560 tx=0x7fb398009cb0).stop 2024-04-06T12:23:35.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.981+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 shutdown_connections 2024-04-06T12:23:35.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.981+0000 7fb3ad5c8700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fb394066dc0 0x7fb394069280 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0x7fb390007bf0 tx=0x7fb39000b040).stop 2024-04-06T12:23:35.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.981+0000 7fb3ad5c8700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a80f6710 0x7fb3a8061060 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0x7fb398013560 tx=0x7fb398009cb0).stop 2024-04-06T12:23:35.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.981+0000 7fb3ad5c8700 1 --2- 172.21.15.152:0/2519158770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80f79b0 0x7fb3a810ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:35.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.981+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 >> 172.21.15.152:0/2519158770 conn(0x7fb3a80f1e50 msgr2=0x7fb3a80fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:35.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.985+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 shutdown_connections 2024-04-06T12:23:35.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:35.986+0000 7fb3ad5c8700 1 -- 172.21.15.152:0/2519158770 wait complete. 2024-04-06T12:23:36.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.122+0000 7fddc2073700 1 -- 172.21.15.152:0/1986782645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 msgr2=0x7fddbc0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.122+0000 7fddc2073700 1 --2- 172.21.15.152:0/1986782645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 0x7fddbc0f7a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fddb00047f0 tx=0x7fddb0009cb0).stop 2024-04-06T12:23:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.122+0000 7fddc2073700 1 -- 172.21.15.152:0/1986782645 shutdown_connections 2024-04-06T12:23:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.122+0000 7fddc2073700 1 --2- 172.21.15.152:0/1986782645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 0x7fddbc0f7a20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.122+0000 7fddc2073700 1 --2- 172.21.15.152:0/1986782645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0f66e0 0x7fddbc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.122+0000 7fddc2073700 1 -- 172.21.15.152:0/1986782645 >> 172.21.15.152:0/1986782645 conn(0x7fddbc0f1ee0 msgr2=0x7fddbc0f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.122+0000 7fddc2073700 1 -- 172.21.15.152:0/1986782645 shutdown_connections 2024-04-06T12:23:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.122+0000 7fddc2073700 1 -- 172.21.15.152:0/1986782645 wait complete. 2024-04-06T12:23:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddc2073700 1 Processor -- start 2024-04-06T12:23:36.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddc2073700 1 -- start start 2024-04-06T12:23:36.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddc2073700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0f66e0 0x7fddbc0fa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddc2073700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 0x7fddbc0f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddc2073700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0facb0 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddc2073700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0f9250 con 0x7fddbc0f66e0 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddbaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 0x7fddbc0f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddbaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 0x7fddbc0f8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36398/0 (socket says 172.21.15.152:36398) 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddbaffd700 1 -- 172.21.15.152:0/2877433442 learned_addr learned my addr 172.21.15.152:0/2877433442 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.123+0000 7fddbb7fe700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0f66e0 0x7fddbc0fa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.124+0000 7fddbaffd700 1 -- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0f66e0 msgr2=0x7fddbc0fa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.124+0000 7fddbaffd700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0f66e0 0x7fddbc0fa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.124+0000 7fddbaffd700 1 -- 172.21.15.152:0/2877433442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb0005040 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.124+0000 7fddbaffd700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 0x7fddbc0f8d60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fddb0009380 tx=0x7fddb0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.124+0000 7fddb8ff9700 1 -- 172.21.15.152:0/2877433442 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddb0018070 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.124+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc0f9470 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.124+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc0f99d0 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.124+0000 7fddb8ff9700 1 -- 172.21.15.152:0/2877433442 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fddb0007e90 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.124+0000 7fddb8ff9700 1 -- 172.21.15.152:0/2877433442 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddb0012ec0 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.125+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda8005150 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.126+0000 7fddb8ff9700 1 -- 172.21.15.152:0/2877433442 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fddb00123c0 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.126+0000 7fddb8ff9700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdda4066dc0 0x7fdda4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.126+0000 7fddb8ff9700 1 -- 172.21.15.152:0/2877433442 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fddb0084fe0 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.127+0000 7fddbb7fe700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdda4066dc0 0x7fdda4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.127+0000 7fddbb7fe700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdda4066dc0 0x7fdda4069280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fddac0048b0 tx=0x7fddac00b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:36.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.133+0000 7fddb8ff9700 1 -- 172.21.15.152:0/2877433442 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fddb0053040 con 0x7fddbc0f6ff0 2024-04-06T12:23:36.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.374+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdda8000bf0 con 0x7fdda4066dc0 2024-04-06T12:23:36.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.384+0000 7fddb8ff9700 1 -- 172.21.15.152:0/2877433442 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdda8000bf0 con 0x7fdda4066dc0 2024-04-06T12:23:36.382 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:23:36.382 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 starting - - - - 2024-04-06T12:23:36.382 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (8m) 72s ago 8m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:23:36.382 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (8m) 64s ago 8m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (7m) 72s ago 8m 57.2M - 8.3.5 dad864ee21e9 68f8b2b6d071 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (3m) 72s ago 3m 79.0M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (3m) 72s ago 3m 111M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (3m) 64s ago 3m 12.0M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (3m) 64s ago 3m 12.8M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:9283 running (10m) 72s ago 10m 317M - 16.2.15-1-g8963e9de 727f386679cb 10652d2c4bd5 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283 running (88s) 64s ago 8m 476M - 18.2.2-1086-g052adcad 87261d5ece5a 5089ad242cab 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (10m) 72s ago 10m 47.7M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (8m) 64s ago 8m 39.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (8m) 72s ago 8m 25.9M - 1.3.1 1dbe0e931976 7122c2020056 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 64s ago 7m 23.6M - 1.3.1 1dbe0e931976 9dbc0ed205d9 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (7m) 72s ago 7m 63.4M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (6m) 72s ago 6m 62.1M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (6m) 72s ago 6m 53.4M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:23:36.383 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (5m) 64s ago 5m 64.5M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:23:36.384 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (5m) 64s ago 5m 57.7M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:23:36.384 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (5m) 64s ago 5m 58.3M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:23:36.384 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (7m) 64s ago 7m 60.4M - 2.33.4 514e6a882f6e d9a8fc6b6cf9 2024-04-06T12:23:36.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.386+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdda4066dc0 msgr2=0x7fdda4069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.386+0000 7fddc2073700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdda4066dc0 0x7fdda4069280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fddac0048b0 tx=0x7fddac00b040).stop 2024-04-06T12:23:36.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.386+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 msgr2=0x7fddbc0f8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.386+0000 7fddc2073700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 0x7fddbc0f8d60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fddb0009380 tx=0x7fddb0009cb0).stop 2024-04-06T12:23:36.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.386+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 shutdown_connections 2024-04-06T12:23:36.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.386+0000 7fddc2073700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdda4066dc0 0x7fdda4069280 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.386+0000 7fddc2073700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0f66e0 0x7fddbc0fa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.386+0000 7fddc2073700 1 --2- 172.21.15.152:0/2877433442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddbc0f6ff0 0x7fddbc0f8d60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.386+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 >> 172.21.15.152:0/2877433442 conn(0x7fddbc0f1ee0 msgr2=0x7fddbc061360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:36.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.387+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 shutdown_connections 2024-04-06T12:23:36.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.387+0000 7fddc2073700 1 -- 172.21.15.152:0/2877433442 wait complete. 2024-04-06T12:23:36.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.490+0000 7fdbedd93700 1 -- 172.21.15.152:0/3488924967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe80fa950 msgr2=0x7fdbe80fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.490+0000 7fdbedd93700 1 --2- 172.21.15.152:0/3488924967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe80fa950 0x7fdbe80fcda0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fdbdc0047f0 tx=0x7fdbdc009cb0).stop 2024-04-06T12:23:36.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.490+0000 7fdbedd93700 1 -- 172.21.15.152:0/3488924967 shutdown_connections 2024-04-06T12:23:36.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.490+0000 7fdbedd93700 1 --2- 172.21.15.152:0/3488924967 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe80fa950 0x7fdbe80fcda0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.490+0000 7fdbedd93700 1 --2- 172.21.15.152:0/3488924967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe8061280 0x7fdbe80fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.490+0000 7fdbedd93700 1 -- 172.21.15.152:0/3488924967 >> 172.21.15.152:0/3488924967 conn(0x7fdbe80f1e50 msgr2=0x7fdbe80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:36.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.490+0000 7fdbedd93700 1 -- 172.21.15.152:0/3488924967 shutdown_connections 2024-04-06T12:23:36.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.490+0000 7fdbedd93700 1 -- 172.21.15.152:0/3488924967 wait complete. 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.491+0000 7fdbedd93700 1 Processor -- start 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.491+0000 7fdbedd93700 1 -- start start 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.491+0000 7fdbedd93700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe8061280 0x7fdbe8108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbedd93700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fa950 0x7fdbe8108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbedd93700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8108b20 con 0x7fdbe8061280 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbedd93700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8108c60 con 0x7fdbe80fa950 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe8061280 0x7fdbe8108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe8061280 0x7fdbe8108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36416/0 (socket says 172.21.15.152:36416) 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe77fe700 1 -- 172.21.15.152:0/1679137612 learned_addr learned my addr 172.21.15.152:0/1679137612 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe6ffd700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fa950 0x7fdbe8108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe77fe700 1 -- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fa950 msgr2=0x7fdbe8108570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe77fe700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fa950 0x7fdbe8108570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe77fe700 1 -- 172.21.15.152:0/1679137612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc005040 con 0x7fdbe8061280 2024-04-06T12:23:36.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe77fe700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe8061280 0x7fdbe8108080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fdbd800e910 tx=0x7fdbd800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:36.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe4ff9700 1 -- 172.21.15.152:0/1679137612 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd8007b40 con 0x7fdbe8061280 2024-04-06T12:23:36.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe4ff9700 1 -- 172.21.15.152:0/1679137612 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdbd800f040 con 0x7fdbe8061280 2024-04-06T12:23:36.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbe4ff9700 1 -- 172.21.15.152:0/1679137612 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd8014920 con 0x7fdbe8061280 2024-04-06T12:23:36.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe810d700 con 0x7fdbe8061280 2024-04-06T12:23:36.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.492+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe810dcc0 con 0x7fdbe8061280 2024-04-06T12:23:36.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.493+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe80fffd0 con 0x7fdbe8061280 2024-04-06T12:23:36.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.494+0000 7fdbe4ff9700 1 -- 172.21.15.152:0/1679137612 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fdbd8007ca0 con 0x7fdbe8061280 2024-04-06T12:23:36.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.494+0000 7fdbe4ff9700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdbd0066dc0 0x7fdbd0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:36.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.494+0000 7fdbe4ff9700 1 -- 172.21.15.152:0/1679137612 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fdbd8083d50 con 0x7fdbe8061280 2024-04-06T12:23:36.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.494+0000 7fdbe6ffd700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdbd0066dc0 0x7fdbd0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:36.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.495+0000 7fdbe6ffd700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdbd0066dc0 0x7fdbd0069280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fdbdc0047c0 tx=0x7fdbdc009cb0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:36.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.499+0000 7fdbe4ff9700 1 -- 172.21.15.152:0/1679137612 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fdbd8051df0 con 0x7fdbe8061280 2024-04-06T12:23:36.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.836+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdbe8101e40 con 0x7fdbe8061280 2024-04-06T12:23:36.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.836+0000 7fdbe4ff9700 1 -- 172.21.15.152:0/1679137612 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fdbd80519e0 con 0x7fdbe8061280 2024-04-06T12:23:36.834 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:23:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:23:36.836 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-04-06T12:23:36.836 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:23:36.836 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:23:36.836 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:23:36.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.838+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdbd0066dc0 msgr2=0x7fdbd0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.838+0000 7fdbedd93700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdbd0066dc0 0x7fdbd0069280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fdbdc0047c0 tx=0x7fdbdc009cb0).stop 2024-04-06T12:23:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.838+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe8061280 msgr2=0x7fdbe8108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.838+0000 7fdbedd93700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe8061280 0x7fdbe8108080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fdbd800e910 tx=0x7fdbd800b040).stop 2024-04-06T12:23:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.838+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 shutdown_connections 2024-04-06T12:23:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.838+0000 7fdbedd93700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fdbd0066dc0 0x7fdbd0069280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.838+0000 7fdbedd93700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe8061280 0x7fdbe8108080 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.838+0000 7fdbedd93700 1 --2- 172.21.15.152:0/1679137612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fa950 0x7fdbe8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.838+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 >> 172.21.15.152:0/1679137612 conn(0x7fdbe80f1e50 msgr2=0x7fdbe80f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.839+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 shutdown_connections 2024-04-06T12:23:36.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.839+0000 7fdbedd93700 1 -- 172.21.15.152:0/1679137612 wait complete. 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.964+0000 7f1d38026700 1 -- 172.21.15.152:0/4170068162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 msgr2=0x7f1d300fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.964+0000 7f1d38026700 1 --2- 172.21.15.152:0/4170068162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 0x7f1d300fcdc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f1d200047f0 tx=0x7f1d20009cb0).stop 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.964+0000 7f1d38026700 1 -- 172.21.15.152:0/4170068162 shutdown_connections 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.964+0000 7f1d38026700 1 --2- 172.21.15.152:0/4170068162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 0x7f1d300fcdc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.964+0000 7f1d38026700 1 --2- 172.21.15.152:0/4170068162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d300612a0 0x7f1d300fa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.964+0000 7f1d38026700 1 -- 172.21.15.152:0/4170068162 >> 172.21.15.152:0/4170068162 conn(0x7f1d300f1e50 msgr2=0x7f1d300f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.964+0000 7f1d38026700 1 -- 172.21.15.152:0/4170068162 shutdown_connections 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.964+0000 7f1d38026700 1 -- 172.21.15.152:0/4170068162 wait complete. 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.965+0000 7f1d38026700 1 Processor -- start 2024-04-06T12:23:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.965+0000 7f1d38026700 1 -- start start 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.965+0000 7f1d38026700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d300612a0 0x7f1d300f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.965+0000 7f1d38026700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 0x7f1d300f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.965+0000 7f1d38026700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300f8240 con 0x7f1d300fa970 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.965+0000 7f1d38026700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300f67e0 con 0x7f1d300612a0 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.965+0000 7f1d355c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 0x7f1d300f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.965+0000 7f1d355c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 0x7f1d300f62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36436/0 (socket says 172.21.15.152:36436) 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.965+0000 7f1d355c1700 1 -- 172.21.15.152:0/2315883819 learned_addr learned my addr 172.21.15.152:0/2315883819 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d35dc2700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d300612a0 0x7f1d300f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d355c1700 1 -- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d300612a0 msgr2=0x7f1d300f7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d355c1700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d300612a0 0x7f1d300f7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d355c1700 1 -- 172.21.15.152:0/2315883819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20005040 con 0x7f1d300fa970 2024-04-06T12:23:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d355c1700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 0x7f1d300f62f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f1d20013560 tx=0x7f1d20009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d26ffd700 1 -- 172.21.15.152:0/2315883819 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d20018070 con 0x7f1d300fa970 2024-04-06T12:23:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d300f6a00 con 0x7f1d300fa970 2024-04-06T12:23:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d26ffd700 1 -- 172.21.15.152:0/2315883819 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d20007e90 con 0x7f1d300fa970 2024-04-06T12:23:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d26ffd700 1 -- 172.21.15.152:0/2315883819 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d2001c380 con 0x7f1d300fa970 2024-04-06T12:23:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.966+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d300f6f60 con 0x7f1d300fa970 2024-04-06T12:23:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.967+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d30047540 con 0x7f1d300fa970 2024-04-06T12:23:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.968+0000 7f1d26ffd700 1 -- 172.21.15.152:0/2315883819 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f1d200123c0 con 0x7f1d300fa970 2024-04-06T12:23:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.968+0000 7f1d26ffd700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1d1c066dc0 0x7f1d1c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:23:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.969+0000 7f1d26ffd700 1 -- 172.21.15.152:0/2315883819 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f1d200850a0 con 0x7f1d300fa970 2024-04-06T12:23:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.969+0000 7f1d35dc2700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1d1c066dc0 0x7f1d1c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:23:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.969+0000 7f1d35dc2700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1d1c066dc0 0x7f1d1c069280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1d2c004ee0 tx=0x7f1d2c00b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:23:36.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:36.977+0000 7f1d26ffd700 1 -- 172.21.15.152:0/2315883819 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f1d20053140 con 0x7f1d300fa970 2024-04-06T12:23:37.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:35.580144+0000 mgr.smithi195.ausetj (mgr.24375) 68 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 348 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 173 op/s 2024-04-06T12:23:37.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:35.586532+0000 mgr.smithi195.ausetj (mgr.24375) 69 : audit [DBG] from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:37.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:35.580144+0000 mgr.smithi195.ausetj (mgr.24375) 68 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 348 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 173 op/s 2024-04-06T12:23:37.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:35.586532+0000 mgr.smithi195.ausetj (mgr.24375) 69 : audit [DBG] from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:37.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.243+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d30102050 con 0x7f1d1c066dc0 2024-04-06T12:23:37.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.244+0000 7f1d26ffd700 1 -- 172.21.15.152:0/2315883819 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f1d2c00f040 con 0x7f1d1c066dc0 2024-04-06T12:23:37.242 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:23:37.242 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:23:37.242 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:23:37.242 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:23:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2024-04-06T12:23:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "1/2 daemons upgraded", 2024-04-06T12:23:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2024-04-06T12:23:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:23:37.243 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.246+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1d1c066dc0 msgr2=0x7f1d1c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.246+0000 7f1d38026700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1d1c066dc0 0x7f1d1c069280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1d2c004ee0 tx=0x7f1d2c00b040).stop 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.246+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 msgr2=0x7f1d300f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.246+0000 7f1d38026700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 0x7f1d300f62f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f1d20013560 tx=0x7f1d20009cb0).stop 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.247+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 shutdown_connections 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.247+0000 7f1d38026700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1d1c066dc0 0x7f1d1c069280 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.247+0000 7f1d38026700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d300612a0 0x7f1d300f7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.247+0000 7f1d38026700 1 --2- 172.21.15.152:0/2315883819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d300fa970 0x7f1d300f62f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.247+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 >> 172.21.15.152:0/2315883819 conn(0x7f1d300f1e50 msgr2=0x7f1d300f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.247+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 shutdown_connections 2024-04-06T12:23:37.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:23:37.247+0000 7f1d38026700 1 -- 172.21.15.152:0/2315883819 wait complete. 2024-04-06T12:23:38.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:35.978202+0000 mgr.smithi195.ausetj (mgr.24375) 70 : audit [DBG] from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:38.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:36.376411+0000 mgr.smithi195.ausetj (mgr.24375) 71 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:38.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:36.837280+0000 mon.smithi152 (mon.0) 696 : audit [DBG] from='client.? 172.21.15.152:0/1679137612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:23:38.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:35.978202+0000 mgr.smithi195.ausetj (mgr.24375) 70 : audit [DBG] from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:38.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:36.376411+0000 mgr.smithi195.ausetj (mgr.24375) 71 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:38.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:36.837280+0000 mon.smithi152 (mon.0) 696 : audit [DBG] from='client.? 172.21.15.152:0/1679137612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:23:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:37.245356+0000 mgr.smithi195.ausetj (mgr.24375) 72 : audit [DBG] from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:37.580430+0000 mgr.smithi195.ausetj (mgr.24375) 73 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 348 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 995 KiB/s rd, 965 KiB/s wr, 118 op/s 2024-04-06T12:23:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:37.245356+0000 mgr.smithi195.ausetj (mgr.24375) 72 : audit [DBG] from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:23:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:37.580430+0000 mgr.smithi195.ausetj (mgr.24375) 73 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 348 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 995 KiB/s rd, 965 KiB/s wr, 118 op/s 2024-04-06T12:23:39.500 INFO:tasks.workunit.client.0.smithi152.stdout:5/29: sync 2024-04-06T12:23:39.500 INFO:tasks.workunit.client.0.smithi152.stdout:6/49: sync 2024-04-06T12:23:39.501 INFO:tasks.workunit.client.0.smithi152.stdout:8/25: sync 2024-04-06T12:23:39.501 INFO:tasks.workunit.client.0.smithi152.stdout:0/48: sync 2024-04-06T12:23:39.501 INFO:tasks.workunit.client.0.smithi152.stdout:1/26: sync 2024-04-06T12:23:39.501 INFO:tasks.workunit.client.0.smithi152.stdout:4/40: sync 2024-04-06T12:23:39.501 INFO:tasks.workunit.client.0.smithi152.stdout:7/22: sync 2024-04-06T12:23:39.501 INFO:tasks.workunit.client.0.smithi152.stdout:9/61: sync 2024-04-06T12:23:39.501 INFO:tasks.workunit.client.0.smithi152.stdout:3/56: sync 2024-04-06T12:23:39.501 INFO:tasks.workunit.client.0.smithi152.stdout:2/98: sync 2024-04-06T12:23:39.502 INFO:tasks.workunit.client.0.smithi152.stdout:5/30: readlink d3/l6 0 2024-04-06T12:23:39.502 INFO:tasks.workunit.client.0.smithi152.stdout:3/57: chown d0/f8 5319812 1 2024-04-06T12:23:39.504 INFO:tasks.workunit.client.0.smithi152.stdout:0/49: fsync f2 0 2024-04-06T12:23:39.504 INFO:tasks.workunit.client.0.smithi152.stdout:0/50: chown f1 0 1 2024-04-06T12:23:39.506 INFO:tasks.workunit.client.0.smithi152.stdout:8/26: fsync f1 0 2024-04-06T12:23:39.508 INFO:tasks.workunit.client.0.smithi152.stdout:9/62: mkdir d5/d6/d15 0 2024-04-06T12:23:39.511 INFO:tasks.workunit.client.0.smithi152.stdout:1/27: mknod d2/cd 0 2024-04-06T12:23:39.513 INFO:tasks.workunit.client.0.smithi152.stdout:2/99: creat d0/d2/f21 x:0 0 0 2024-04-06T12:23:39.514 INFO:tasks.workunit.client.0.smithi152.stdout:2/100: write d0/d2/f21 [608717,111345] 0 2024-04-06T12:23:39.522 INFO:tasks.workunit.client.0.smithi152.stdout:5/31: dread d3/f7 [0,4194304] 0 2024-04-06T12:23:39.525 INFO:tasks.workunit.client.0.smithi152.stdout:0/51: mknod d4/c12 0 2024-04-06T12:23:39.530 INFO:tasks.workunit.client.0.smithi152.stdout:8/27: rename f2 to d4/f9 0 2024-04-06T12:23:39.540 INFO:tasks.workunit.client.0.smithi152.stdout:6/50: creat d7/d9/d11/f12 x:0 0 0 2024-04-06T12:23:39.544 INFO:tasks.workunit.client.0.smithi152.stdout:3/58: mkdir d0/d10 0 2024-04-06T12:23:39.549 INFO:tasks.workunit.client.0.smithi152.stdout:5/32: mknod d3/c8 0 2024-04-06T12:23:39.551 INFO:tasks.workunit.client.0.smithi152.stdout:0/52: mkdir d4/d13 0 2024-04-06T12:23:39.554 INFO:tasks.workunit.client.0.smithi152.stdout:0/53: dread f0 [0,4194304] 0 2024-04-06T12:23:39.555 INFO:tasks.workunit.client.0.smithi152.stdout:4/41: write f5 [575323,37617] 0 2024-04-06T12:23:39.555 INFO:tasks.workunit.client.0.smithi152.stdout:0/54: read f2 [1602170,42070] 0 2024-04-06T12:23:39.556 INFO:tasks.workunit.client.0.smithi152.stdout:8/28: symlink d4/la 0 2024-04-06T12:23:39.563 INFO:tasks.workunit.client.0.smithi152.stdout:6/51: read f6 [5291024,97317] 0 2024-04-06T12:23:39.565 INFO:tasks.workunit.client.0.smithi152.stdout:9/63: write d5/f9 [633614,65548] 0 2024-04-06T12:23:39.567 INFO:tasks.workunit.client.0.smithi152.stdout:5/33: mkdir d3/d9 0 2024-04-06T12:23:39.569 INFO:tasks.workunit.client.0.smithi152.stdout:4/42: creat d7/fb x:0 0 0 2024-04-06T12:23:39.574 INFO:tasks.workunit.client.0.smithi152.stdout:8/29: read d4/f9 [1263386,6425] 0 2024-04-06T12:23:39.575 INFO:tasks.workunit.client.0.smithi152.stdout:1/28: dwrite d2/fb [0,4194304] 0 2024-04-06T12:23:39.578 INFO:tasks.workunit.client.0.smithi152.stdout:3/59: rename d0/cc to d0/de/c11 0 2024-04-06T12:23:39.580 INFO:tasks.workunit.client.0.smithi152.stdout:2/101: dwrite d0/f1c [0,4194304] 0 2024-04-06T12:23:39.584 INFO:tasks.workunit.client.0.smithi152.stdout:9/64: unlink d5/f9 0 2024-04-06T12:23:39.590 INFO:tasks.workunit.client.0.smithi152.stdout:5/34: fdatasync d3/f5 0 2024-04-06T12:23:39.605 INFO:tasks.workunit.client.0.smithi152.stdout:6/52: write d7/d9/f10 [537993,83718] 0 2024-04-06T12:23:39.606 INFO:tasks.workunit.client.0.smithi152.stdout:1/29: rename d2/f9 to d2/fe 0 2024-04-06T12:23:39.607 INFO:tasks.workunit.client.0.smithi152.stdout:6/53: readlink d7/d9/la 0 2024-04-06T12:23:39.609 INFO:tasks.workunit.client.0.smithi152.stdout:0/55: dwrite f1 [0,4194304] 0 2024-04-06T12:23:39.617 INFO:tasks.workunit.client.0.smithi152.stdout:2/102: dwrite d0/d2/d5/f1f [0,4194304] 0 2024-04-06T12:23:39.618 INFO:tasks.workunit.client.0.smithi152.stdout:9/65: truncate d5/d6/f14 1098435 0 2024-04-06T12:23:39.623 INFO:tasks.workunit.client.0.smithi152.stdout:8/30: write f3 [457251,31930] 0 2024-04-06T12:23:39.628 INFO:tasks.workunit.client.0.smithi152.stdout:1/30: creat d2/ff x:0 0 0 2024-04-06T12:23:39.629 INFO:tasks.workunit.client.0.smithi152.stdout:6/54: mknod d7/c13 0 2024-04-06T12:23:39.630 INFO:tasks.workunit.client.0.smithi152.stdout:1/31: write d2/fb [4778431,55254] 0 2024-04-06T12:23:39.635 INFO:tasks.workunit.client.0.smithi152.stdout:2/103: write d0/f3 [781919,48479] 0 2024-04-06T12:23:39.635 INFO:tasks.workunit.client.0.smithi152.stdout:9/66: creat d5/d6/f16 x:0 0 0 2024-04-06T12:23:39.636 INFO:tasks.workunit.client.0.smithi152.stdout:3/60: dwrite d0/f8 [0,4194304] 0 2024-04-06T12:23:39.642 INFO:tasks.workunit.client.0.smithi152.stdout:8/31: mkdir d4/db 0 2024-04-06T12:23:39.648 INFO:tasks.workunit.client.0.smithi152.stdout:1/32: unlink d2/ca 0 2024-04-06T12:23:39.649 INFO:tasks.workunit.client.0.smithi152.stdout:6/55: creat d7/d9/d11/f14 x:0 0 0 2024-04-06T12:23:39.650 INFO:tasks.workunit.client.0.smithi152.stdout:6/56: truncate d7/d9/f10 1649723 0 2024-04-06T12:23:39.653 INFO:tasks.workunit.client.0.smithi152.stdout:6/57: dread f6 [0,4194304] 0 2024-04-06T12:23:39.654 INFO:tasks.workunit.client.0.smithi152.stdout:9/67: unlink c4 0 2024-04-06T12:23:39.658 INFO:tasks.workunit.client.0.smithi152.stdout:2/104: dread d0/d2/d5/fe [0,4194304] 0 2024-04-06T12:23:39.659 INFO:tasks.workunit.client.0.smithi152.stdout:4/43: getdents d7 0 2024-04-06T12:23:39.660 INFO:tasks.workunit.client.0.smithi152.stdout:5/35: truncate d3/f5 4789643 0 2024-04-06T12:23:39.661 INFO:tasks.workunit.client.0.smithi152.stdout:2/105: write d0/d2/fa [2748384,37714] 0 2024-04-06T12:23:39.662 INFO:tasks.workunit.client.0.smithi152.stdout:0/56: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:23:39.664 INFO:tasks.workunit.client.0.smithi152.stdout:8/32: mkdir d4/dc 0 2024-04-06T12:23:39.666 INFO:tasks.workunit.client.0.smithi152.stdout:0/57: rename d4 to d4/d13/d14 22 2024-04-06T12:23:39.668 INFO:tasks.workunit.client.0.smithi152.stdout:1/33: creat d2/f10 x:0 0 0 2024-04-06T12:23:39.669 INFO:tasks.workunit.client.0.smithi152.stdout:2/106: dread d0/d2/fa [0,4194304] 0 2024-04-06T12:23:39.670 INFO:tasks.workunit.client.0.smithi152.stdout:6/58: rename d7/d9/d11/f12 to d7/d9/d11/f15 0 2024-04-06T12:23:39.673 INFO:tasks.workunit.client.0.smithi152.stdout:3/61: symlink d0/l12 0 2024-04-06T12:23:39.674 INFO:tasks.workunit.client.0.smithi152.stdout:8/33: dwrite f1 [4194304,4194304] 0 2024-04-06T12:23:39.678 INFO:tasks.workunit.client.0.smithi152.stdout:8/34: chown d4/db 192 1 2024-04-06T12:23:39.678 INFO:tasks.workunit.client.0.smithi152.stdout:8/35: chown d4/db 6947702 1 2024-04-06T12:23:39.679 INFO:tasks.workunit.client.0.smithi152.stdout:1/34: dwrite d2/f10 [0,4194304] 0 2024-04-06T12:23:39.680 INFO:tasks.workunit.client.0.smithi152.stdout:4/44: creat d7/fc x:0 0 0 2024-04-06T12:23:39.681 INFO:tasks.workunit.client.0.smithi152.stdout:1/35: stat d2/c5 0 2024-04-06T12:23:39.681 INFO:tasks.workunit.client.0.smithi152.stdout:4/45: chown d7/c9 173399 1 2024-04-06T12:23:39.683 INFO:tasks.workunit.client.0.smithi152.stdout:5/36: mkdir d3/da 0 2024-04-06T12:23:39.683 INFO:tasks.workunit.client.0.smithi152.stdout:5/37: chown d3/d9 1206 1 2024-04-06T12:23:39.696 INFO:tasks.workunit.client.0.smithi152.stdout:9/68: mkdir d5/d6/d15/d17 0 2024-04-06T12:23:39.698 INFO:tasks.workunit.client.0.smithi152.stdout:6/59: rmdir d7/d9 39 2024-04-06T12:23:39.698 INFO:tasks.workunit.client.0.smithi152.stdout:9/69: dread d5/d6/f7 [0,4194304] 0 2024-04-06T12:23:39.699 INFO:tasks.workunit.client.0.smithi152.stdout:9/70: chown d5/ce 0 1 2024-04-06T12:23:39.700 INFO:tasks.workunit.client.0.smithi152.stdout:2/107: creat d0/d2/d5/d10/f22 x:0 0 0 2024-04-06T12:23:39.704 INFO:tasks.workunit.client.0.smithi152.stdout:0/58: fdatasync d4/f8 0 2024-04-06T12:23:39.706 INFO:tasks.workunit.client.0.smithi152.stdout:8/36: truncate d4/f8 782906 0 2024-04-06T12:23:39.710 INFO:tasks.workunit.client.0.smithi152.stdout:4/46: rmdir d7 39 2024-04-06T12:23:39.710 INFO:tasks.workunit.client.0.smithi152.stdout:4/47: stat f1 0 2024-04-06T12:23:39.712 INFO:tasks.workunit.client.0.smithi152.stdout:1/36: creat d2/f11 x:0 0 0 2024-04-06T12:23:39.719 INFO:tasks.workunit.client.0.smithi152.stdout:9/71: truncate d5/fb 582979 0 2024-04-06T12:23:39.722 INFO:tasks.workunit.client.0.smithi152.stdout:3/62: mkdir d0/d10/d13 0 2024-04-06T12:23:39.725 INFO:tasks.workunit.client.0.smithi152.stdout:0/59: symlink d4/de/l15 0 2024-04-06T12:23:39.728 INFO:tasks.workunit.client.0.smithi152.stdout:0/60: dread d4/f8 [0,4194304] 0 2024-04-06T12:23:39.731 INFO:tasks.workunit.client.0.smithi152.stdout:1/37: creat d2/f12 x:0 0 0 2024-04-06T12:23:39.732 INFO:tasks.workunit.client.0.smithi152.stdout:1/38: chown d2/cd 4046 1 2024-04-06T12:23:39.734 INFO:tasks.workunit.client.0.smithi152.stdout:5/38: getdents d3/da 0 2024-04-06T12:23:39.736 INFO:tasks.workunit.client.0.smithi152.stdout:6/60: dwrite f3 [4194304,4194304] 0 2024-04-06T12:23:39.747 INFO:tasks.workunit.client.0.smithi152.stdout:8/37: getdents d4/dc 0 2024-04-06T12:23:39.750 INFO:tasks.workunit.client.0.smithi152.stdout:4/48: dwrite f1 [0,4194304] 0 2024-04-06T12:23:39.751 INFO:tasks.workunit.client.0.smithi152.stdout:1/39: creat d2/f13 x:0 0 0 2024-04-06T12:23:39.758 INFO:tasks.workunit.client.0.smithi152.stdout:2/108: link d0/fd d0/d2/d5/f23 0 2024-04-06T12:23:39.758 INFO:tasks.workunit.client.0.smithi152.stdout:2/109: chown d0 5165445 1 2024-04-06T12:23:39.761 INFO:tasks.workunit.client.0.smithi152.stdout:0/61: mknod d4/d13/c16 0 2024-04-06T12:23:39.763 INFO:tasks.workunit.client.0.smithi152.stdout:4/49: fsync d7/fb 0 2024-04-06T12:23:39.764 INFO:tasks.workunit.client.0.smithi152.stdout:3/63: dwrite d0/f7 [0,4194304] 0 2024-04-06T12:23:39.765 INFO:tasks.workunit.client.0.smithi152.stdout:1/40: read d2/f3 [3973593,45906] 0 2024-04-06T12:23:39.765 INFO:tasks.workunit.client.0.smithi152.stdout:5/39: creat d3/d9/fb x:0 0 0 2024-04-06T12:23:39.772 INFO:tasks.workunit.client.0.smithi152.stdout:2/110: write d0/d2/d5/f20 [661526,68026] 0 2024-04-06T12:23:39.774 INFO:tasks.workunit.client.0.smithi152.stdout:4/50: dwrite d7/fc [0,4194304] 0 2024-04-06T12:23:39.888 INFO:tasks.workunit.client.0.smithi152.stdout:9/72: getdents d5/d6/d15 0 2024-04-06T12:23:39.891 INFO:tasks.workunit.client.0.smithi152.stdout:6/61: truncate f3 4694756 0 2024-04-06T12:23:39.894 INFO:tasks.workunit.client.0.smithi152.stdout:8/38: truncate f3 3492596 0 2024-04-06T12:23:39.900 INFO:tasks.workunit.client.0.smithi152.stdout:0/62: truncate d4/f8 612375 0 2024-04-06T12:23:39.900 INFO:tasks.workunit.client.0.smithi152.stdout:5/40: write d3/f7 [1363609,76740] 0 2024-04-06T12:23:39.903 INFO:tasks.workunit.client.0.smithi152.stdout:5/41: fdatasync d3/f7 0 2024-04-06T12:23:39.904 INFO:tasks.workunit.client.0.smithi152.stdout:5/42: write d3/f7 [2129420,59519] 0 2024-04-06T12:23:39.909 INFO:tasks.workunit.client.0.smithi152.stdout:9/73: symlink d5/d6/d15/l18 0 2024-04-06T12:23:39.910 INFO:tasks.workunit.client.0.smithi152.stdout:9/74: chown d5/d6/f16 30066257 1 2024-04-06T12:23:39.915 INFO:tasks.workunit.client.0.smithi152.stdout:2/111: mkdir d0/d15/d24 0 2024-04-06T12:23:39.915 INFO:tasks.workunit.client.0.smithi152.stdout:2/112: dread - d0/fd zero size 2024-04-06T12:23:39.922 INFO:tasks.workunit.client.0.smithi152.stdout:0/63: creat d4/f17 x:0 0 0 2024-04-06T12:23:39.939 INFO:tasks.workunit.client.0.smithi152.stdout:0/64: mkdir d4/d13/d18 0 2024-04-06T12:23:39.941 INFO:tasks.workunit.client.0.smithi152.stdout:1/41: getdents d2 0 2024-04-06T12:23:39.942 INFO:tasks.workunit.client.0.smithi152.stdout:5/43: creat d3/da/fc x:0 0 0 2024-04-06T12:23:39.947 INFO:tasks.workunit.client.0.smithi152.stdout:4/51: getdents d7 0 2024-04-06T12:23:39.950 INFO:tasks.workunit.client.0.smithi152.stdout:7/23: sync 2024-04-06T12:23:39.956 INFO:tasks.workunit.client.0.smithi152.stdout:0/65: mkdir d4/d19 0 2024-04-06T12:23:39.959 INFO:tasks.workunit.client.0.smithi152.stdout:1/42: mknod d2/c14 0 2024-04-06T12:23:39.965 INFO:tasks.workunit.client.0.smithi152.stdout:9/75: dwrite d5/f10 [0,4194304] 0 2024-04-06T12:23:39.966 INFO:tasks.workunit.client.0.smithi152.stdout:1/43: dread d2/f7 [0,4194304] 0 2024-04-06T12:23:39.966 INFO:tasks.workunit.client.0.smithi152.stdout:4/52: rmdir d7 39 2024-04-06T12:23:39.974 INFO:tasks.workunit.client.0.smithi152.stdout:6/62: write f3 [1666640,70974] 0 2024-04-06T12:23:39.975 INFO:tasks.workunit.client.0.smithi152.stdout:0/66: mknod d4/de/c1a 0 2024-04-06T12:23:39.992 INFO:tasks.workunit.client.0.smithi152.stdout:9/76: chown d5/d6/f14 1650 1 2024-04-06T12:23:39.996 INFO:tasks.workunit.client.0.smithi152.stdout:1/44: mkdir d2/d15 0 2024-04-06T12:23:40.002 INFO:tasks.workunit.client.0.smithi152.stdout:2/113: getdents d0/d2/d5 0 2024-04-06T12:23:40.004 INFO:tasks.workunit.client.0.smithi152.stdout:8/39: dread f3 [0,4194304] 0 2024-04-06T12:23:40.005 INFO:tasks.workunit.client.0.smithi152.stdout:5/44: link c1 d3/da/cd 0 2024-04-06T12:23:40.005 INFO:tasks.workunit.client.0.smithi152.stdout:5/45: chown d3/d9 705163557 1 2024-04-06T12:23:40.006 INFO:tasks.workunit.client.0.smithi152.stdout:4/53: mknod d7/cd 0 2024-04-06T12:23:40.008 INFO:tasks.workunit.client.0.smithi152.stdout:4/54: read f5 [381288,98201] 0 2024-04-06T12:23:40.011 INFO:tasks.workunit.client.0.smithi152.stdout:7/24: rename l5 to d8/la 0 2024-04-06T12:23:40.014 INFO:tasks.workunit.client.0.smithi152.stdout:4/55: dwrite d7/fc [4194304,4194304] 0 2024-04-06T12:23:40.015 INFO:tasks.workunit.client.0.smithi152.stdout:0/67: getdents d4/d19 0 2024-04-06T12:23:40.023 INFO:tasks.workunit.client.0.smithi152.stdout:4/56: dwrite d7/fb [0,4194304] 0 2024-04-06T12:23:40.024 INFO:tasks.workunit.client.0.smithi152.stdout:7/25: rmdir d8 39 2024-04-06T12:23:40.026 INFO:tasks.workunit.client.0.smithi152.stdout:8/40: creat d4/dc/fd x:0 0 0 2024-04-06T12:23:40.028 INFO:tasks.workunit.client.0.smithi152.stdout:0/68: mknod d4/c1b 0 2024-04-06T12:23:40.034 INFO:tasks.workunit.client.0.smithi152.stdout:1/45: rmdir d2/d15 0 2024-04-06T12:23:40.035 INFO:tasks.workunit.client.0.smithi152.stdout:1/46: chown d2/f12 303 1 2024-04-06T12:23:40.036 INFO:tasks.workunit.client.0.smithi152.stdout:1/47: fdatasync d2/fb 0 2024-04-06T12:23:40.036 INFO:tasks.workunit.client.0.smithi152.stdout:1/48: readlink l0 0 2024-04-06T12:23:40.038 INFO:tasks.workunit.client.0.smithi152.stdout:4/57: symlink d7/le 0 2024-04-06T12:23:40.045 INFO:tasks.workunit.client.0.smithi152.stdout:4/58: dread d7/fc [4194304,4194304] 0 2024-04-06T12:23:40.046 INFO:tasks.workunit.client.0.smithi152.stdout:7/26: dwrite f3 [4194304,4194304] 0 2024-04-06T12:23:40.046 INFO:tasks.workunit.client.0.smithi152.stdout:4/59: write f1 [2013794,72538] 0 2024-04-06T12:23:40.047 INFO:tasks.workunit.client.0.smithi152.stdout:4/60: fdatasync d7/fc 0 2024-04-06T12:23:40.049 INFO:tasks.workunit.client.0.smithi152.stdout:1/49: creat d2/f16 x:0 0 0 2024-04-06T12:23:40.052 INFO:tasks.workunit.client.0.smithi152.stdout:2/114: getdents d0/d15 0 2024-04-06T12:23:40.053 INFO:tasks.workunit.client.0.smithi152.stdout:0/69: symlink d4/d19/l1c 0 2024-04-06T12:23:40.061 INFO:tasks.workunit.client.0.smithi152.stdout:4/61: symlink d7/lf 0 2024-04-06T12:23:40.061 INFO:tasks.workunit.client.0.smithi152.stdout:4/62: chown f5 93 1 2024-04-06T12:23:40.066 INFO:tasks.workunit.client.0.smithi152.stdout:1/50: creat d2/f17 x:0 0 0 2024-04-06T12:23:40.068 INFO:tasks.workunit.client.0.smithi152.stdout:0/70: creat d4/f1d x:0 0 0 2024-04-06T12:23:40.068 INFO:tasks.workunit.client.0.smithi152.stdout:0/71: chown d4/de/f11 27 1 2024-04-06T12:23:40.069 INFO:tasks.workunit.client.0.smithi152.stdout:0/72: fdatasync d4/f1d 0 2024-04-06T12:23:40.071 INFO:tasks.workunit.client.0.smithi152.stdout:7/27: creat d8/fb x:0 0 0 2024-04-06T12:23:40.071 INFO:tasks.workunit.client.0.smithi152.stdout:7/28: dread - d8/fb zero size 2024-04-06T12:23:40.073 INFO:tasks.workunit.client.0.smithi152.stdout:7/29: truncate d8/fb 578813 0 2024-04-06T12:23:40.073 INFO:tasks.workunit.client.0.smithi152.stdout:7/30: chown d8/fb 13 1 2024-04-06T12:23:40.074 INFO:tasks.workunit.client.0.smithi152.stdout:7/31: dread d8/fb [0,4194304] 0 2024-04-06T12:23:40.075 INFO:tasks.workunit.client.0.smithi152.stdout:2/115: unlink d0/fc 0 2024-04-06T12:23:40.076 INFO:tasks.workunit.client.0.smithi152.stdout:0/73: creat d4/de/f1e x:0 0 0 2024-04-06T12:23:40.077 INFO:tasks.workunit.client.0.smithi152.stdout:0/74: readlink d4/de/l15 0 2024-04-06T12:23:40.085 INFO:tasks.workunit.client.0.smithi152.stdout:0/75: fdatasync f0 0 2024-04-06T12:23:40.086 INFO:tasks.workunit.client.0.smithi152.stdout:0/76: truncate d4/de/f11 545800 0 2024-04-06T12:23:40.086 INFO:tasks.workunit.client.0.smithi152.stdout:0/77: chown d4 5 1 2024-04-06T12:23:40.086 INFO:tasks.workunit.client.0.smithi152.stdout:0/78: read - d4/f1d zero size 2024-04-06T12:23:40.095 INFO:tasks.workunit.client.0.smithi152.stdout:2/116: dread d0/d2/d5/fe [0,4194304] 0 2024-04-06T12:23:40.099 INFO:tasks.workunit.client.0.smithi152.stdout:5/46: dwrite d3/f5 [0,4194304] 0 2024-04-06T12:23:40.100 INFO:tasks.workunit.client.0.smithi152.stdout:2/117: mkdir d0/d25 0 2024-04-06T12:23:40.101 INFO:tasks.workunit.client.0.smithi152.stdout:5/47: truncate d3/da/fc 363248 0 2024-04-06T12:23:40.102 INFO:tasks.workunit.client.0.smithi152.stdout:5/48: fdatasync d3/d9/fb 0 2024-04-06T12:23:40.103 INFO:tasks.workunit.client.0.smithi152.stdout:5/49: fdatasync d3/d9/fb 0 2024-04-06T12:23:40.104 INFO:tasks.workunit.client.0.smithi152.stdout:2/118: read d0/d2/d5/d10/f18 [567280,116985] 0 2024-04-06T12:23:40.109 INFO:tasks.workunit.client.0.smithi152.stdout:5/50: mkdir d3/de 0 2024-04-06T12:23:40.109 INFO:tasks.workunit.client.0.smithi152.stdout:5/51: chown d3 10213 1 2024-04-06T12:23:40.124 INFO:tasks.workunit.client.0.smithi152.stdout:8/41: dwrite f3 [4194304,4194304] 0 2024-04-06T12:23:40.151 INFO:tasks.workunit.client.0.smithi152.stdout:7/32: rmdir d8 39 2024-04-06T12:23:40.158 INFO:tasks.workunit.client.0.smithi152.stdout:7/33: mkdir d8/dc 0 2024-04-06T12:23:40.158 INFO:tasks.workunit.client.0.smithi152.stdout:1/51: dwrite d2/f7 [0,4194304] 0 2024-04-06T12:23:40.160 INFO:tasks.workunit.client.0.smithi152.stdout:1/52: write d2/ff [788252,32294] 0 2024-04-06T12:23:40.163 INFO:tasks.workunit.client.0.smithi152.stdout:7/34: fdatasync d8/fb 0 2024-04-06T12:23:40.164 INFO:tasks.workunit.client.0.smithi152.stdout:7/35: chown f6 8 1 2024-04-06T12:23:40.165 INFO:tasks.workunit.client.0.smithi152.stdout:1/53: creat d2/f18 x:0 0 0 2024-04-06T12:23:40.166 INFO:tasks.workunit.client.0.smithi152.stdout:1/54: write d2/f10 [2424503,130274] 0 2024-04-06T12:23:40.168 INFO:tasks.workunit.client.0.smithi152.stdout:1/55: write d2/f3 [4320230,37564] 0 2024-04-06T12:23:40.170 INFO:tasks.workunit.client.0.smithi152.stdout:1/56: write d2/f13 [617849,110336] 0 2024-04-06T12:23:40.176 INFO:tasks.workunit.client.0.smithi152.stdout:7/36: symlink d8/dc/ld 0 2024-04-06T12:23:40.176 INFO:tasks.workunit.client.0.smithi152.stdout:7/37: chown d8/c9 3884016 1 2024-04-06T12:23:40.178 INFO:tasks.workunit.client.0.smithi152.stdout:1/57: rename d2/c5 to d2/c19 0 2024-04-06T12:23:40.178 INFO:tasks.workunit.client.0.smithi152.stdout:1/58: readlink l1 0 2024-04-06T12:23:40.180 INFO:tasks.workunit.client.0.smithi152.stdout:0/79: write f0 [4021477,17037] 0 2024-04-06T12:23:40.181 INFO:tasks.workunit.client.0.smithi152.stdout:1/59: mknod d2/c1a 0 2024-04-06T12:23:40.183 INFO:tasks.workunit.client.0.smithi152.stdout:7/38: link f3 d8/dc/fe 0 2024-04-06T12:23:40.185 INFO:tasks.workunit.client.0.smithi152.stdout:1/60: dread d2/f7 [0,4194304] 0 2024-04-06T12:23:40.185 INFO:tasks.workunit.client.0.smithi152.stdout:1/61: dread - d2/f17 zero size 2024-04-06T12:23:40.187 INFO:tasks.workunit.client.0.smithi152.stdout:0/80: unlink d4/f7 0 2024-04-06T12:23:40.187 INFO:tasks.workunit.client.0.smithi152.stdout:0/81: chown d4/c5 16116801 1 2024-04-06T12:23:40.190 INFO:tasks.workunit.client.0.smithi152.stdout:7/39: fdatasync f6 0 2024-04-06T12:23:40.194 INFO:tasks.workunit.client.0.smithi152.stdout:1/62: rename d2/f17 to d2/f1b 0 2024-04-06T12:23:40.198 INFO:tasks.workunit.client.0.smithi152.stdout:0/82: mknod d4/d13/c1f 0 2024-04-06T12:23:40.198 INFO:tasks.workunit.client.0.smithi152.stdout:0/83: write d4/f17 [406690,31473] 0 2024-04-06T12:23:40.206 INFO:tasks.workunit.client.0.smithi152.stdout:1/63: write d2/f7 [2066619,13002] 0 2024-04-06T12:23:40.207 INFO:tasks.workunit.client.0.smithi152.stdout:0/84: unlink d4/d19/l1c 0 2024-04-06T12:23:40.208 INFO:tasks.workunit.client.0.smithi152.stdout:7/40: dwrite f3 [4194304,4194304] 0 2024-04-06T12:23:40.212 INFO:tasks.workunit.client.0.smithi152.stdout:1/64: symlink d2/l1c 0 2024-04-06T12:23:40.212 INFO:tasks.workunit.client.0.smithi152.stdout:1/65: stat d2/f10 0 2024-04-06T12:23:40.217 INFO:tasks.workunit.client.0.smithi152.stdout:1/66: mkdir d2/d1d 0 2024-04-06T12:23:40.227 INFO:tasks.workunit.client.0.smithi152.stdout:1/67: link d2/f18 d2/d1d/f1e 0 2024-04-06T12:23:40.229 INFO:tasks.workunit.client.0.smithi152.stdout:5/52: truncate d3/f7 752898 0 2024-04-06T12:23:40.230 INFO:tasks.workunit.client.0.smithi152.stdout:5/53: chown d3/de 1300929 1 2024-04-06T12:23:40.230 INFO:tasks.workunit.client.0.smithi152.stdout:1/68: symlink d2/d1d/l1f 0 2024-04-06T12:23:40.232 INFO:tasks.workunit.client.0.smithi152.stdout:5/54: rmdir d3 39 2024-04-06T12:23:40.240 INFO:tasks.workunit.client.0.smithi152.stdout:5/55: rename l2 to d3/d9/lf 0 2024-04-06T12:23:40.246 INFO:tasks.workunit.client.0.smithi152.stdout:8/42: write d4/f9 [1933628,38020] 0 2024-04-06T12:23:40.247 INFO:tasks.workunit.client.0.smithi152.stdout:8/43: chown d4/la 825337 1 2024-04-06T12:23:40.248 INFO:tasks.workunit.client.0.smithi152.stdout:8/44: write d4/dc/fd [669864,118254] 0 2024-04-06T12:23:40.248 INFO:tasks.workunit.client.0.smithi152.stdout:8/45: chown f1 14 1 2024-04-06T12:23:40.252 INFO:tasks.workunit.client.0.smithi152.stdout:8/46: dread f3 [0,4194304] 0 2024-04-06T12:23:40.252 INFO:tasks.workunit.client.0.smithi152.stdout:8/47: read f1 [5616047,11724] 0 2024-04-06T12:23:40.253 INFO:tasks.workunit.client.0.smithi152.stdout:8/48: chown d4/c7 891431 1 2024-04-06T12:23:40.426 INFO:tasks.workunit.client.0.smithi152.stdout:7/41: write f6 [797063,98218] 0 2024-04-06T12:23:40.432 INFO:tasks.workunit.client.0.smithi152.stdout:7/42: mkdir d8/df 0 2024-04-06T12:23:40.443 INFO:tasks.workunit.client.0.smithi152.stdout:7/43: dread f3 [4194304,4194304] 0 2024-04-06T12:23:40.454 INFO:tasks.workunit.client.0.smithi152.stdout:3/64: sync 2024-04-06T12:23:40.455 INFO:tasks.workunit.client.0.smithi152.stdout:0/85: getdents d4/d19 0 2024-04-06T12:23:40.455 INFO:tasks.workunit.client.0.smithi152.stdout:7/44: dwrite f3 [4194304,4194304] 0 2024-04-06T12:23:40.456 INFO:tasks.workunit.client.0.smithi152.stdout:3/65: fsync d0/f7 0 2024-04-06T12:23:40.459 INFO:tasks.workunit.client.0.smithi152.stdout:0/86: creat d4/d19/f20 x:0 0 0 2024-04-06T12:23:40.463 INFO:tasks.workunit.client.0.smithi152.stdout:7/45: mknod d8/dc/c10 0 2024-04-06T12:23:40.464 INFO:tasks.workunit.client.0.smithi152.stdout:3/66: fdatasync d0/fb 0 2024-04-06T12:23:40.468 INFO:tasks.workunit.client.0.smithi152.stdout:0/87: dread f0 [0,4194304] 0 2024-04-06T12:23:40.470 INFO:tasks.workunit.client.0.smithi152.stdout:1/69: getdents d2 0 2024-04-06T12:23:40.473 INFO:tasks.workunit.client.0.smithi152.stdout:1/70: unlink d2/d1d/l1f 0 2024-04-06T12:23:40.475 INFO:tasks.workunit.client.0.smithi152.stdout:1/71: chown d2/f11 4489 1 2024-04-06T12:23:40.476 INFO:tasks.workunit.client.0.smithi152.stdout:3/67: dwrite d0/f7 [4194304,4194304] 0 2024-04-06T12:23:40.478 INFO:tasks.workunit.client.0.smithi152.stdout:1/72: write d2/f11 [84270,61428] 0 2024-04-06T12:23:40.479 INFO:tasks.workunit.client.0.smithi152.stdout:0/88: dwrite d4/de/f1e [0,4194304] 0 2024-04-06T12:23:40.480 INFO:tasks.workunit.client.0.smithi152.stdout:1/73: readlink d2/l1c 0 2024-04-06T12:23:40.481 INFO:tasks.workunit.client.0.smithi152.stdout:1/74: fdatasync d2/f12 0 2024-04-06T12:23:40.487 INFO:tasks.workunit.client.0.smithi152.stdout:0/89: read d4/f8 [113400,57195] 0 2024-04-06T12:23:40.489 INFO:tasks.workunit.client.0.smithi152.stdout:3/68: creat d0/de/f14 x:0 0 0 2024-04-06T12:23:40.495 INFO:tasks.workunit.client.0.smithi152.stdout:1/75: creat d2/f20 x:0 0 0 2024-04-06T12:23:40.495 INFO:tasks.workunit.client.0.smithi152.stdout:1/76: dread - d2/f16 zero size 2024-04-06T12:23:40.498 INFO:tasks.workunit.client.0.smithi152.stdout:3/69: creat d0/d10/f15 x:0 0 0 2024-04-06T12:23:40.502 INFO:tasks.workunit.client.0.smithi152.stdout:1/77: dwrite d2/f12 [0,4194304] 0 2024-04-06T12:23:40.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/70: dwrite d0/f8 [0,4194304] 0 2024-04-06T12:23:40.510 INFO:tasks.workunit.client.0.smithi152.stdout:1/78: mkdir d2/d1d/d21 0 2024-04-06T12:23:40.511 INFO:tasks.workunit.client.0.smithi152.stdout:1/79: chown d2/d1d/d21 1 1 2024-04-06T12:23:40.522 INFO:tasks.workunit.client.0.smithi152.stdout:1/80: fdatasync d2/f12 0 2024-04-06T12:23:40.525 INFO:tasks.workunit.client.0.smithi152.stdout:1/81: mknod d2/d1d/d21/c22 0 2024-04-06T12:23:40.528 INFO:tasks.workunit.client.0.smithi152.stdout:1/82: creat d2/d1d/f23 x:0 0 0 2024-04-06T12:23:40.530 INFO:tasks.workunit.client.0.smithi152.stdout:1/83: symlink d2/d1d/d21/l24 0 2024-04-06T12:23:40.536 INFO:tasks.workunit.client.0.smithi152.stdout:1/84: link d2/lc d2/d1d/l25 0 2024-04-06T12:23:40.539 INFO:tasks.workunit.client.0.smithi152.stdout:1/85: creat d2/d1d/d21/f26 x:0 0 0 2024-04-06T12:23:40.542 INFO:tasks.workunit.client.0.smithi152.stdout:1/86: mknod d2/d1d/c27 0 2024-04-06T12:23:40.546 INFO:tasks.workunit.client.0.smithi152.stdout:1/87: write d2/f1b [747047,15829] 0 2024-04-06T12:23:40.546 INFO:tasks.workunit.client.0.smithi152.stdout:1/88: readlink l0 0 2024-04-06T12:23:40.548 INFO:tasks.workunit.client.0.smithi152.stdout:1/89: mkdir d2/d1d/d21/d28 0 2024-04-06T12:23:40.551 INFO:tasks.workunit.client.0.smithi152.stdout:1/90: mknod d2/d1d/d21/d28/c29 0 2024-04-06T12:23:40.554 INFO:tasks.workunit.client.0.smithi152.stdout:1/91: rename d2/d1d/c27 to d2/d1d/d21/c2a 0 2024-04-06T12:23:40.555 INFO:tasks.workunit.client.0.smithi152.stdout:8/49: write d4/f8 [1558251,126184] 0 2024-04-06T12:23:40.557 INFO:tasks.workunit.client.0.smithi152.stdout:1/92: mknod d2/d1d/d21/d28/c2b 0 2024-04-06T12:23:40.558 INFO:tasks.workunit.client.0.smithi152.stdout:1/93: write d2/d1d/f23 [936028,74627] 0 2024-04-06T12:23:40.559 INFO:tasks.workunit.client.0.smithi152.stdout:8/50: rename d4/c7 to d4/ce 0 2024-04-06T12:23:40.562 INFO:tasks.workunit.client.0.smithi152.stdout:1/94: dread d2/f1b [0,4194304] 0 2024-04-06T12:23:40.563 INFO:tasks.workunit.client.0.smithi152.stdout:1/95: stat d2/f13 0 2024-04-06T12:23:40.565 INFO:tasks.workunit.client.0.smithi152.stdout:1/96: dread d2/f3 [4194304,4194304] 0 2024-04-06T12:23:40.567 INFO:tasks.workunit.client.0.smithi152.stdout:8/51: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:23:40.571 INFO:tasks.workunit.client.0.smithi152.stdout:1/97: fdatasync d2/f1b 0 2024-04-06T12:23:40.572 INFO:tasks.workunit.client.0.smithi152.stdout:1/98: readlink d2/d1d/d21/l24 0 2024-04-06T12:23:40.574 INFO:tasks.workunit.client.0.smithi152.stdout:8/52: symlink d4/dc/lf 0 2024-04-06T12:23:40.577 INFO:tasks.workunit.client.0.smithi152.stdout:1/99: symlink d2/d1d/d21/d28/l2c 0 2024-04-06T12:23:40.577 INFO:tasks.workunit.client.0.smithi152.stdout:8/53: dread d4/f9 [0,4194304] 0 2024-04-06T12:23:40.578 INFO:tasks.workunit.client.0.smithi152.stdout:8/54: chown f1 1128885 1 2024-04-06T12:23:40.578 INFO:tasks.workunit.client.0.smithi152.stdout:8/55: chown f1 80336 1 2024-04-06T12:23:40.585 INFO:tasks.workunit.client.0.smithi152.stdout:8/56: dwrite d4/dc/fd [0,4194304] 0 2024-04-06T12:23:40.588 INFO:tasks.workunit.client.0.smithi152.stdout:8/57: mkdir d4/dc/d10 0 2024-04-06T12:23:40.590 INFO:tasks.workunit.client.0.smithi152.stdout:8/58: symlink d4/dc/d10/l11 0 2024-04-06T12:23:40.661 INFO:tasks.workunit.client.0.smithi152.stdout:0/90: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:23:40.675 INFO:tasks.workunit.client.0.smithi152.stdout:3/71: truncate d0/f8 190743 0 2024-04-06T12:23:40.676 INFO:tasks.workunit.client.0.smithi152.stdout:0/91: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:23:40.677 INFO:tasks.workunit.client.0.smithi152.stdout:6/63: sync 2024-04-06T12:23:40.678 INFO:tasks.workunit.client.0.smithi152.stdout:6/64: chown d7/fb 68058617 1 2024-04-06T12:23:40.681 INFO:tasks.workunit.client.0.smithi152.stdout:3/72: unlink d0/d10/f15 0 2024-04-06T12:23:40.683 INFO:tasks.workunit.client.0.smithi152.stdout:0/92: dwrite f1 [0,4194304] 0 2024-04-06T12:23:40.683 INFO:tasks.workunit.client.0.smithi152.stdout:0/93: chown d4/cc 3543 1 2024-04-06T12:23:40.688 INFO:tasks.workunit.client.0.smithi152.stdout:0/94: dread f0 [0,4194304] 0 2024-04-06T12:23:40.689 INFO:tasks.workunit.client.0.smithi152.stdout:0/95: read f0 [1412150,95235] 0 2024-04-06T12:23:40.691 INFO:tasks.workunit.client.0.smithi152.stdout:0/96: read d4/f8 [1449225,26886] 0 2024-04-06T12:23:40.698 INFO:tasks.workunit.client.0.smithi152.stdout:6/65: symlink d7/d9/d11/l16 0 2024-04-06T12:23:40.698 INFO:tasks.workunit.client.0.smithi152.stdout:6/66: write f6 [5604884,123639] 0 2024-04-06T12:23:40.699 INFO:tasks.workunit.client.0.smithi152.stdout:6/67: write d7/d9/f10 [2618635,24844] 0 2024-04-06T12:23:40.700 INFO:tasks.workunit.client.0.smithi152.stdout:0/97: symlink d4/l21 0 2024-04-06T12:23:40.702 INFO:tasks.workunit.client.0.smithi152.stdout:0/98: write d4/de/f1e [1097591,130376] 0 2024-04-06T12:23:40.703 INFO:tasks.workunit.client.0.smithi152.stdout:0/99: write d4/f1d [582684,49836] 0 2024-04-06T12:23:40.703 INFO:tasks.workunit.client.0.smithi152.stdout:0/100: chown d4/c5 384727704 1 2024-04-06T12:23:40.711 INFO:tasks.workunit.client.0.smithi152.stdout:6/68: creat d7/d9/f17 x:0 0 0 2024-04-06T12:23:40.715 INFO:tasks.workunit.client.0.smithi152.stdout:3/73: rename d0/de/f14 to d0/f16 0 2024-04-06T12:23:40.720 INFO:tasks.workunit.client.0.smithi152.stdout:0/101: creat d4/d13/f22 x:0 0 0 2024-04-06T12:23:40.724 INFO:tasks.workunit.client.0.smithi152.stdout:6/69: rename d7/d9/d11/f14 to d7/d9/f18 0 2024-04-06T12:23:40.728 INFO:tasks.workunit.client.0.smithi152.stdout:1/100: chown d2/d1d/d21/c2a 18141 1 2024-04-06T12:23:40.732 INFO:tasks.workunit.client.0.smithi152.stdout:1/101: dread d2/fb [0,4194304] 0 2024-04-06T12:23:40.734 INFO:tasks.workunit.client.0.smithi152.stdout:6/70: dread d7/fb [0,4194304] 0 2024-04-06T12:23:40.735 INFO:tasks.workunit.client.0.smithi152.stdout:6/71: dread - d7/d9/f17 zero size 2024-04-06T12:23:40.736 INFO:tasks.workunit.client.0.smithi152.stdout:6/72: chown d7/fd 77 1 2024-04-06T12:23:40.738 INFO:tasks.workunit.client.0.smithi152.stdout:1/102: creat d2/d1d/f2d x:0 0 0 2024-04-06T12:23:40.742 INFO:tasks.workunit.client.0.smithi152.stdout:1/103: creat d2/d1d/f2e x:0 0 0 2024-04-06T12:23:40.744 INFO:tasks.workunit.client.0.smithi152.stdout:1/104: rmdir d2/d1d/d21/d28 39 2024-04-06T12:23:40.746 INFO:tasks.workunit.client.0.smithi152.stdout:1/105: truncate d2/d1d/f2d 387806 0 2024-04-06T12:23:40.752 INFO:tasks.workunit.client.0.smithi152.stdout:1/106: dwrite d2/f1b [0,4194304] 0 2024-04-06T12:23:40.760 INFO:tasks.workunit.client.0.smithi152.stdout:1/107: dwrite d2/f16 [0,4194304] 0 2024-04-06T12:23:40.767 INFO:tasks.workunit.client.0.smithi152.stdout:1/108: mkdir d2/d2f 0 2024-04-06T12:23:40.767 INFO:tasks.workunit.client.0.smithi152.stdout:1/109: chown d2/fe 98 1 2024-04-06T12:23:40.768 INFO:tasks.workunit.client.0.smithi152.stdout:1/110: fsync d2/f11 0 2024-04-06T12:23:40.770 INFO:tasks.workunit.client.0.smithi152.stdout:1/111: fdatasync d2/f18 0 2024-04-06T12:23:40.771 INFO:tasks.workunit.client.0.smithi152.stdout:1/112: write d2/f16 [3373703,84727] 0 2024-04-06T12:23:40.772 INFO:tasks.workunit.client.0.smithi152.stdout:1/113: chown d2/f7 1594353781 1 2024-04-06T12:23:40.778 INFO:tasks.workunit.client.0.smithi152.stdout:1/114: truncate d2/f7 4764749 0 2024-04-06T12:23:40.782 INFO:tasks.workunit.client.0.smithi152.stdout:1/115: dread d2/f16 [0,4194304] 0 2024-04-06T12:23:40.823 INFO:tasks.workunit.client.0.smithi152.stdout:4/63: sync 2024-04-06T12:23:40.823 INFO:tasks.workunit.client.0.smithi152.stdout:9/77: sync 2024-04-06T12:23:40.825 INFO:tasks.workunit.client.0.smithi152.stdout:3/74: rename d0/f16 to d0/d10/d13/f17 0 2024-04-06T12:23:40.828 INFO:tasks.workunit.client.0.smithi152.stdout:4/64: unlink d7/fc 0 2024-04-06T12:23:40.832 INFO:tasks.workunit.client.0.smithi152.stdout:6/73: rmdir d7/d9 39 2024-04-06T12:23:40.833 INFO:tasks.workunit.client.0.smithi152.stdout:3/75: creat d0/de/f18 x:0 0 0 2024-04-06T12:23:40.834 INFO:tasks.workunit.client.0.smithi152.stdout:0/102: write f0 [224645,5915] 0 2024-04-06T12:23:40.835 INFO:tasks.workunit.client.0.smithi152.stdout:0/103: chown d4/d13 2157469 1 2024-04-06T12:23:40.836 INFO:tasks.workunit.client.0.smithi152.stdout:4/65: dwrite d7/fb [0,4194304] 0 2024-04-06T12:23:40.841 INFO:tasks.workunit.client.0.smithi152.stdout:6/74: dread - d7/d9/f17 zero size 2024-04-06T12:23:40.844 INFO:tasks.workunit.client.0.smithi152.stdout:4/66: dwrite d7/fb [4194304,4194304] 0 2024-04-06T12:23:40.846 INFO:tasks.workunit.client.0.smithi152.stdout:3/76: symlink d0/d10/d13/l19 0 2024-04-06T12:23:40.847 INFO:tasks.workunit.client.0.smithi152.stdout:9/78: link d5/d6/f14 d5/d6/d15/d17/f19 0 2024-04-06T12:23:40.852 INFO:tasks.workunit.client.0.smithi152.stdout:0/104: mknod d4/de/c23 0 2024-04-06T12:23:40.853 INFO:tasks.workunit.client.0.smithi152.stdout:2/119: sync 2024-04-06T12:23:40.853 INFO:tasks.workunit.client.0.smithi152.stdout:5/56: sync 2024-04-06T12:23:40.854 INFO:tasks.workunit.client.0.smithi152.stdout:0/105: read d4/f1d [374099,92337] 0 2024-04-06T12:23:40.855 INFO:tasks.workunit.client.0.smithi152.stdout:0/106: readlink d4/l6 0 2024-04-06T12:23:40.855 INFO:tasks.workunit.client.0.smithi152.stdout:8/59: sync 2024-04-06T12:23:40.855 INFO:tasks.workunit.client.0.smithi152.stdout:7/46: sync 2024-04-06T12:23:40.856 INFO:tasks.workunit.client.0.smithi152.stdout:7/47: write f3 [6785941,14118] 0 2024-04-06T12:23:40.857 INFO:tasks.workunit.client.0.smithi152.stdout:6/75: fsync d7/fd 0 2024-04-06T12:23:40.858 INFO:tasks.workunit.client.0.smithi152.stdout:6/76: chown d7/d9/d11/f15 574342 1 2024-04-06T12:23:40.860 INFO:tasks.workunit.client.0.smithi152.stdout:6/77: chown d7/d9/f17 357856 1 2024-04-06T12:23:40.860 INFO:tasks.workunit.client.0.smithi152.stdout:6/78: dread - d7/d9/d11/f15 zero size 2024-04-06T12:23:40.861 INFO:tasks.workunit.client.0.smithi152.stdout:7/48: dread f6 [0,4194304] 0 2024-04-06T12:23:40.864 INFO:tasks.workunit.client.0.smithi152.stdout:9/79: mkdir d5/d6/d1a 0 2024-04-06T12:23:40.866 INFO:tasks.workunit.client.0.smithi152.stdout:3/77: creat d0/d10/d13/f1a x:0 0 0 2024-04-06T12:23:40.869 INFO:tasks.workunit.client.0.smithi152.stdout:6/79: dwrite d7/d9/f10 [0,4194304] 0 2024-04-06T12:23:40.870 INFO:tasks.workunit.client.0.smithi152.stdout:6/80: chown d7/c13 194 1 2024-04-06T12:23:40.875 INFO:tasks.workunit.client.0.smithi152.stdout:5/57: creat d3/d9/f10 x:0 0 0 2024-04-06T12:23:40.884 INFO:tasks.workunit.client.0.smithi152.stdout:5/58: dwrite d3/d9/fb [0,4194304] 0 2024-04-06T12:23:40.894 INFO:tasks.workunit.client.0.smithi152.stdout:1/116: dwrite d2/d1d/f1e [0,4194304] 0 2024-04-06T12:23:40.896 INFO:tasks.workunit.client.0.smithi152.stdout:3/78: readlink d0/ld 0 2024-04-06T12:23:40.902 INFO:tasks.workunit.client.0.smithi152.stdout:2/120: readlink d0/d2/d5/d10/l12 0 2024-04-06T12:23:40.918 INFO:tasks.workunit.client.0.smithi152.stdout:5/59: creat d3/f11 x:0 0 0 2024-04-06T12:23:40.920 INFO:tasks.workunit.client.0.smithi152.stdout:5/60: write d3/f11 [877932,18625] 0 2024-04-06T12:23:40.921 INFO:tasks.workunit.client.0.smithi152.stdout:7/49: getdents d8/df 0 2024-04-06T12:23:40.921 INFO:tasks.workunit.client.0.smithi152.stdout:5/61: fsync d3/da/fc 0 2024-04-06T12:23:40.928 INFO:tasks.workunit.client.0.smithi152.stdout:3/79: symlink d0/de/l1b 0 2024-04-06T12:23:40.928 INFO:tasks.workunit.client.0.smithi152.stdout:3/80: readlink d0/de/l1b 0 2024-04-06T12:23:40.929 INFO:tasks.workunit.client.0.smithi152.stdout:2/121: truncate d0/fd 843442 0 2024-04-06T12:23:40.936 INFO:tasks.workunit.client.0.smithi152.stdout:7/50: fdatasync f6 0 2024-04-06T12:23:40.940 INFO:tasks.workunit.client.0.smithi152.stdout:1/117: creat d2/d1d/d21/d28/f30 x:0 0 0 2024-04-06T12:23:40.942 INFO:tasks.workunit.client.0.smithi152.stdout:0/107: rmdir d4/de 39 2024-04-06T12:23:40.948 INFO:tasks.workunit.client.0.smithi152.stdout:6/81: rename d7/d9/d11 to d7/d19 0 2024-04-06T12:23:40.951 INFO:tasks.workunit.client.0.smithi152.stdout:4/67: dwrite f5 [0,4194304] 0 2024-04-06T12:23:40.952 INFO:tasks.workunit.client.0.smithi152.stdout:4/68: chown l6 76801 1 2024-04-06T12:23:40.954 INFO:tasks.workunit.client.0.smithi152.stdout:9/80: link d5/d6/c12 d5/d6/d15/c1b 0 2024-04-06T12:23:40.959 INFO:tasks.workunit.client.0.smithi152.stdout:0/108: rename d4/d13/c1f to d4/d13/c24 0 2024-04-06T12:23:40.965 INFO:tasks.workunit.client.0.smithi152.stdout:2/122: mkdir d0/d25/d26 0 2024-04-06T12:23:40.967 INFO:tasks.workunit.client.0.smithi152.stdout:8/60: dwrite d4/f9 [4194304,4194304] 0 2024-04-06T12:23:40.969 INFO:tasks.workunit.client.0.smithi152.stdout:8/61: fsync d4/dc/fd 0 2024-04-06T12:23:40.970 INFO:tasks.workunit.client.0.smithi152.stdout:8/62: write d4/f9 [9192088,91357] 0 2024-04-06T12:23:40.971 INFO:tasks.workunit.client.0.smithi152.stdout:7/51: unlink l4 0 2024-04-06T12:23:40.972 INFO:tasks.workunit.client.0.smithi152.stdout:8/63: write d4/dc/fd [3845476,58318] 0 2024-04-06T12:23:40.973 INFO:tasks.workunit.client.0.smithi152.stdout:6/82: mknod d7/d19/c1a 0 2024-04-06T12:23:40.981 INFO:tasks.workunit.client.0.smithi152.stdout:1/118: truncate d2/f7 4887988 0 2024-04-06T12:23:40.991 INFO:tasks.workunit.client.0.smithi152.stdout:1/119: dwrite d2/d1d/d21/f26 [0,4194304] 0 2024-04-06T12:23:40.993 INFO:tasks.workunit.client.0.smithi152.stdout:1/120: write d2/d1d/f2e [159085,68998] 0 2024-04-06T12:23:40.994 INFO:tasks.workunit.client.0.smithi152.stdout:1/121: write d2/d1d/f23 [2024656,11620] 0 2024-04-06T12:23:40.996 INFO:tasks.workunit.client.0.smithi152.stdout:1/122: chown d2/d1d/d21/d28/c29 5207 1 2024-04-06T12:23:41.002 INFO:tasks.workunit.client.0.smithi152.stdout:3/81: link d0/l12 d0/d10/d13/l1c 0 2024-04-06T12:23:41.011 INFO:tasks.workunit.client.0.smithi152.stdout:0/109: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:23:41.022 INFO:tasks.workunit.client.0.smithi152.stdout:8/64: write f3 [1338056,38561] 0 2024-04-06T12:23:41.022 INFO:tasks.workunit.client.0.smithi152.stdout:6/83: mkdir d7/d19/d1b 0 2024-04-06T12:23:41.026 INFO:tasks.workunit.client.0.smithi152.stdout:6/84: dread d7/fb [0,4194304] 0 2024-04-06T12:23:41.026 INFO:tasks.workunit.client.0.smithi152.stdout:5/62: getdents d3/da 0 2024-04-06T12:23:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:39.580830+0000 mgr.smithi195.ausetj (mgr.24375) 74 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-04-06T12:23:41.030 INFO:tasks.workunit.client.0.smithi152.stdout:9/81: mknod d5/d6/d15/d17/c1c 0 2024-04-06T12:23:41.036 INFO:tasks.workunit.client.0.smithi152.stdout:1/123: symlink d2/d1d/l31 0 2024-04-06T12:23:41.040 INFO:tasks.workunit.client.0.smithi152.stdout:2/123: mkdir d0/d2/d5/d27 0 2024-04-06T12:23:41.045 INFO:tasks.workunit.client.0.smithi152.stdout:0/110: mknod d4/d13/c25 0 2024-04-06T12:23:41.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:39.580830+0000 mgr.smithi195.ausetj (mgr.24375) 74 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-04-06T12:23:41.050 INFO:tasks.workunit.client.0.smithi152.stdout:3/82: dwrite d0/f8 [0,4194304] 0 2024-04-06T12:23:41.051 INFO:tasks.workunit.client.0.smithi152.stdout:7/52: creat d8/df/f11 x:0 0 0 2024-04-06T12:23:41.053 INFO:tasks.workunit.client.0.smithi152.stdout:2/124: dwrite d0/d2/f21 [0,4194304] 0 2024-04-06T12:23:41.056 INFO:tasks.workunit.client.0.smithi152.stdout:6/85: unlink d7/ce 0 2024-04-06T12:23:41.060 INFO:tasks.workunit.client.0.smithi152.stdout:4/69: link d7/lf d7/l10 0 2024-04-06T12:23:41.061 INFO:tasks.workunit.client.0.smithi152.stdout:4/70: write f5 [1380734,18837] 0 2024-04-06T12:23:41.062 INFO:tasks.workunit.client.0.smithi152.stdout:4/71: stat d7/fb 0 2024-04-06T12:23:41.074 INFO:tasks.workunit.client.0.smithi152.stdout:3/83: creat d0/de/f1d x:0 0 0 2024-04-06T12:23:41.076 INFO:tasks.workunit.client.0.smithi152.stdout:3/84: write d0/d10/d13/f1a [928597,29143] 0 2024-04-06T12:23:41.077 INFO:tasks.workunit.client.0.smithi152.stdout:3/85: chown d0/ff 2 1 2024-04-06T12:23:41.083 INFO:tasks.workunit.client.0.smithi152.stdout:6/86: fdatasync d7/ff 0 2024-04-06T12:23:41.086 INFO:tasks.workunit.client.0.smithi152.stdout:5/63: link d3/d9/f10 d3/d9/f12 0 2024-04-06T12:23:41.091 INFO:tasks.workunit.client.0.smithi152.stdout:1/124: truncate d2/fb 4074921 0 2024-04-06T12:23:41.094 INFO:tasks.workunit.client.0.smithi152.stdout:4/72: symlink d7/l11 0 2024-04-06T12:23:41.095 INFO:tasks.workunit.client.0.smithi152.stdout:9/82: truncate d5/d6/d15/d17/f19 2114607 0 2024-04-06T12:23:41.098 INFO:tasks.workunit.client.0.smithi152.stdout:0/111: rename d4/de/l15 to d4/d13/d18/l26 0 2024-04-06T12:23:41.098 INFO:tasks.workunit.client.0.smithi152.stdout:0/112: fdatasync f1 0 2024-04-06T12:23:41.099 INFO:tasks.workunit.client.0.smithi152.stdout:2/125: mkdir d0/d2/d5/d27/d28 0 2024-04-06T12:23:41.099 INFO:tasks.workunit.client.0.smithi152.stdout:2/126: chown d0/l17 113805621 1 2024-04-06T12:23:41.101 INFO:tasks.workunit.client.0.smithi152.stdout:0/113: dread d4/f17 [0,4194304] 0 2024-04-06T12:23:41.103 INFO:tasks.workunit.client.0.smithi152.stdout:5/64: creat d3/da/f13 x:0 0 0 2024-04-06T12:23:41.106 INFO:tasks.workunit.client.0.smithi152.stdout:4/73: creat d7/f12 x:0 0 0 2024-04-06T12:23:41.112 INFO:tasks.workunit.client.0.smithi152.stdout:4/74: dwrite d7/fb [8388608,4194304] 0 2024-04-06T12:23:41.115 INFO:tasks.workunit.client.0.smithi152.stdout:4/75: dread f5 [0,4194304] 0 2024-04-06T12:23:41.118 INFO:tasks.workunit.client.0.smithi152.stdout:0/114: symlink d4/de/l27 0 2024-04-06T12:23:41.119 INFO:tasks.workunit.client.0.smithi152.stdout:5/65: symlink d3/l14 0 2024-04-06T12:23:41.120 INFO:tasks.workunit.client.0.smithi152.stdout:5/66: fdatasync d3/da/f13 0 2024-04-06T12:23:41.120 INFO:tasks.workunit.client.0.smithi152.stdout:0/115: truncate d4/de/f1e 4256576 0 2024-04-06T12:23:41.121 INFO:tasks.workunit.client.0.smithi152.stdout:5/67: dread - d3/d9/f10 zero size 2024-04-06T12:23:41.121 INFO:tasks.workunit.client.0.smithi152.stdout:5/68: fsync d3/da/fc 0 2024-04-06T12:23:41.128 INFO:tasks.workunit.client.0.smithi152.stdout:5/69: dwrite d3/da/fc [0,4194304] 0 2024-04-06T12:23:41.195 INFO:tasks.workunit.client.0.smithi152.stdout:9/83: creat d5/f1d x:0 0 0 2024-04-06T12:23:41.195 INFO:tasks.workunit.client.0.smithi152.stdout:9/84: chown d5/d6/f16 77102067 1 2024-04-06T12:23:41.316 INFO:tasks.workunit.client.0.smithi152.stdout:5/70: mkdir d3/da/d15 0 2024-04-06T12:23:41.320 INFO:tasks.workunit.client.0.smithi152.stdout:2/127: creat d0/f29 x:0 0 0 2024-04-06T12:23:41.325 INFO:tasks.workunit.client.0.smithi152.stdout:9/85: mknod d5/c1e 0 2024-04-06T12:23:41.327 INFO:tasks.workunit.client.0.smithi152.stdout:3/86: rename d0/de to d0/d10/d1e 0 2024-04-06T12:23:41.329 INFO:tasks.workunit.client.0.smithi152.stdout:2/128: dwrite d0/f3 [0,4194304] 0 2024-04-06T12:23:41.331 INFO:tasks.workunit.client.0.smithi152.stdout:7/53: mknod d8/c12 0 2024-04-06T12:23:41.333 INFO:tasks.workunit.client.0.smithi152.stdout:8/65: truncate f1 5416765 0 2024-04-06T12:23:41.338 INFO:tasks.workunit.client.0.smithi152.stdout:6/87: rename d7/f8 to d7/d19/f1c 0 2024-04-06T12:23:41.339 INFO:tasks.workunit.client.0.smithi152.stdout:2/129: chown d0/d2/d5/f20 5 1 2024-04-06T12:23:41.346 INFO:tasks.workunit.client.0.smithi152.stdout:8/66: mknod d4/c12 0 2024-04-06T12:23:41.349 INFO:tasks.workunit.client.0.smithi152.stdout:3/87: mkdir d0/d1f 0 2024-04-06T12:23:41.350 INFO:tasks.workunit.client.0.smithi152.stdout:3/88: chown d0/d10/d13/l19 0 1 2024-04-06T12:23:41.353 INFO:tasks.workunit.client.0.smithi152.stdout:1/125: rename d2/d1d/f1e to d2/d2f/f32 0 2024-04-06T12:23:41.353 INFO:tasks.workunit.client.0.smithi152.stdout:3/89: dread d0/f8 [0,4194304] 0 2024-04-06T12:23:41.355 INFO:tasks.workunit.client.0.smithi152.stdout:6/88: symlink d7/d9/l1d 0 2024-04-06T12:23:41.358 INFO:tasks.workunit.client.0.smithi152.stdout:7/54: rmdir d8/df 39 2024-04-06T12:23:41.370 INFO:tasks.workunit.client.0.smithi152.stdout:1/126: mknod d2/d1d/d21/d28/c33 0 2024-04-06T12:23:41.371 INFO:tasks.workunit.client.0.smithi152.stdout:1/127: write d2/f12 [2834551,54383] 0 2024-04-06T12:23:41.371 INFO:tasks.workunit.client.0.smithi152.stdout:1/128: readlink d2/d1d/l31 0 2024-04-06T12:23:41.373 INFO:tasks.workunit.client.0.smithi152.stdout:1/129: truncate d2/d1d/f23 2518336 0 2024-04-06T12:23:41.373 INFO:tasks.workunit.client.0.smithi152.stdout:3/90: symlink d0/d10/d1e/l20 0 2024-04-06T12:23:41.376 INFO:tasks.workunit.client.0.smithi152.stdout:0/116: rename d4/d13 to d4/de/d28 0 2024-04-06T12:23:41.377 INFO:tasks.workunit.client.0.smithi152.stdout:1/130: dread d2/f10 [0,4194304] 0 2024-04-06T12:23:41.378 INFO:tasks.workunit.client.0.smithi152.stdout:3/91: dread d0/fb [0,4194304] 0 2024-04-06T12:23:41.379 INFO:tasks.workunit.client.0.smithi152.stdout:2/130: creat d0/d25/d26/f2a x:0 0 0 2024-04-06T12:23:41.382 INFO:tasks.workunit.client.0.smithi152.stdout:8/67: creat d4/db/f13 x:0 0 0 2024-04-06T12:23:41.389 INFO:tasks.workunit.client.0.smithi152.stdout:5/71: rename d3/d9/f10 to d3/f16 0 2024-04-06T12:23:41.392 INFO:tasks.workunit.client.0.smithi152.stdout:1/131: readlink d2/lc 0 2024-04-06T12:23:41.393 INFO:tasks.workunit.client.0.smithi152.stdout:1/132: stat d2/d1d/l31 0 2024-04-06T12:23:41.393 INFO:tasks.workunit.client.0.smithi152.stdout:3/92: fsync d0/fb 0 2024-04-06T12:23:41.399 INFO:tasks.workunit.client.0.smithi152.stdout:0/117: mkdir d4/d29 0 2024-04-06T12:23:41.401 INFO:tasks.workunit.client.0.smithi152.stdout:5/72: dread d3/f7 [0,4194304] 0 2024-04-06T12:23:41.403 INFO:tasks.workunit.client.0.smithi152.stdout:6/89: creat d7/f1e x:0 0 0 2024-04-06T12:23:41.473 INFO:tasks.workunit.client.0.smithi152.stdout:2/131: rename d0/d2/d5/d10/f22 to d0/d25/d26/f2b 0 2024-04-06T12:23:41.474 INFO:tasks.workunit.client.0.smithi152.stdout:5/73: mkdir d3/d17 0 2024-04-06T12:23:41.474 INFO:tasks.workunit.client.0.smithi152.stdout:3/93: write d0/ff [372217,87241] 0 2024-04-06T12:23:41.475 INFO:tasks.workunit.client.0.smithi152.stdout:8/68: unlink f1 0 2024-04-06T12:23:41.476 INFO:tasks.workunit.client.0.smithi152.stdout:9/86: truncate d5/f10 777871 0 2024-04-06T12:23:41.478 INFO:tasks.workunit.client.0.smithi152.stdout:5/74: dread d3/f5 [4194304,4194304] 0 2024-04-06T12:23:41.478 INFO:tasks.workunit.client.0.smithi152.stdout:8/69: chown d4/dc/d10/l11 1000 0 2024-04-06T12:23:41.478 INFO:tasks.workunit.client.0.smithi152.stdout:2/132: creat d0/d2/f2c x:0 0 0 2024-04-06T12:23:41.481 INFO:tasks.workunit.client.0.smithi152.stdout:0/118: rmdir d4/de/d28 39 2024-04-06T12:23:41.484 INFO:tasks.workunit.client.0.smithi152.stdout:3/94: rmdir d0 39 2024-04-06T12:23:41.484 INFO:tasks.workunit.client.0.smithi152.stdout:5/75: dwrite d3/d9/fb [0,4194304] 0 2024-04-06T12:23:41.487 INFO:tasks.workunit.client.0.smithi152.stdout:5/76: write d3/f11 [1017372,41139] 0 2024-04-06T12:23:41.489 INFO:tasks.workunit.client.0.smithi152.stdout:6/90: mkdir d7/d19/d1b/d1f 0 2024-04-06T12:23:41.490 INFO:tasks.workunit.client.0.smithi152.stdout:6/91: truncate d7/d9/f17 345175 0 2024-04-06T12:23:41.491 INFO:tasks.workunit.client.0.smithi152.stdout:6/92: readlink d7/d9/l1d 0 2024-04-06T12:23:41.496 INFO:tasks.workunit.client.0.smithi152.stdout:2/133: dread d0/d2/d5/f23 [0,4194304] 0 2024-04-06T12:23:41.499 INFO:tasks.workunit.client.0.smithi152.stdout:0/119: fsync d4/de/d28/f22 0 2024-04-06T12:23:41.500 INFO:tasks.workunit.client.0.smithi152.stdout:3/95: write d0/ff [705200,85197] 0 2024-04-06T12:23:41.503 INFO:tasks.workunit.client.0.smithi152.stdout:9/87: mknod d5/d6/d1a/c1f 0 2024-04-06T12:23:41.504 INFO:tasks.workunit.client.0.smithi152.stdout:9/88: write d5/f1d [842902,20794] 0 2024-04-06T12:23:41.507 INFO:tasks.workunit.client.0.smithi152.stdout:6/93: write f3 [6600980,61688] 0 2024-04-06T12:23:41.508 INFO:tasks.workunit.client.0.smithi152.stdout:6/94: chown d7/d9/f17 987466 1 2024-04-06T12:23:41.509 INFO:tasks.workunit.client.0.smithi152.stdout:9/89: dread d5/f1d [0,4194304] 0 2024-04-06T12:23:41.524 INFO:tasks.workunit.client.0.smithi152.stdout:6/95: truncate d7/fc 7232775 0 2024-04-06T12:23:41.525 INFO:tasks.workunit.client.0.smithi152.stdout:6/96: fdatasync d7/f1e 0 2024-04-06T12:23:41.525 INFO:tasks.workunit.client.0.smithi152.stdout:6/97: readlink d7/d9/l1d 0 2024-04-06T12:23:41.528 INFO:tasks.workunit.client.0.smithi152.stdout:3/96: mknod d0/d1f/c21 0 2024-04-06T12:23:41.532 INFO:tasks.workunit.client.0.smithi152.stdout:6/98: write d7/d19/f15 [893611,6058] 0 2024-04-06T12:23:41.536 INFO:tasks.workunit.client.0.smithi152.stdout:0/120: rmdir d4 39 2024-04-06T12:23:41.544 INFO:tasks.workunit.client.0.smithi152.stdout:6/99: mkdir d7/d19/d1b/d20 0 2024-04-06T12:23:41.545 INFO:tasks.workunit.client.0.smithi152.stdout:6/100: chown d7/fb 0 1 2024-04-06T12:23:41.546 INFO:tasks.workunit.client.0.smithi152.stdout:3/97: mknod d0/c22 0 2024-04-06T12:23:41.551 INFO:tasks.workunit.client.0.smithi152.stdout:0/121: fsync d4/fa 0 2024-04-06T12:23:41.558 INFO:tasks.workunit.client.0.smithi152.stdout:3/98: creat d0/d1f/f23 x:0 0 0 2024-04-06T12:23:41.560 INFO:tasks.workunit.client.0.smithi152.stdout:0/122: fdatasync d4/f1d 0 2024-04-06T12:23:41.564 INFO:tasks.workunit.client.0.smithi152.stdout:3/99: write d0/d10/d1e/f18 [137103,73200] 0 2024-04-06T12:23:41.571 INFO:tasks.workunit.client.0.smithi152.stdout:3/100: fsync d0/d10/d13/f17 0 2024-04-06T12:23:41.571 INFO:tasks.workunit.client.0.smithi152.stdout:0/123: mkdir d4/de/d2a 0 2024-04-06T12:23:41.575 INFO:tasks.workunit.client.0.smithi152.stdout:0/124: dread - d4/de/d28/f22 zero size 2024-04-06T12:23:41.580 INFO:tasks.workunit.client.0.smithi152.stdout:3/101: symlink d0/d10/l24 0 2024-04-06T12:23:41.592 INFO:tasks.workunit.client.0.smithi152.stdout:3/102: read d0/d10/d1e/f18 [50487,29115] 0 2024-04-06T12:23:41.593 INFO:tasks.workunit.client.0.smithi152.stdout:3/103: stat d0/d10/d13 0 2024-04-06T12:23:41.594 INFO:tasks.workunit.client.0.smithi152.stdout:0/125: creat d4/f2b x:0 0 0 2024-04-06T12:23:41.604 INFO:tasks.workunit.client.0.smithi152.stdout:0/126: creat d4/de/d28/d18/f2c x:0 0 0 2024-04-06T12:23:41.637 INFO:tasks.workunit.client.0.smithi152.stdout:3/104: unlink d0/d10/d1e/f18 0 2024-04-06T12:23:41.640 INFO:tasks.workunit.client.0.smithi152.stdout:3/105: symlink d0/d10/d1e/l25 0 2024-04-06T12:23:41.646 INFO:tasks.workunit.client.0.smithi152.stdout:0/127: link d4/c1b d4/de/d2a/c2d 0 2024-04-06T12:23:41.646 INFO:tasks.workunit.client.0.smithi152.stdout:3/106: dwrite d0/d10/d13/f17 [0,4194304] 0 2024-04-06T12:23:41.648 INFO:tasks.workunit.client.0.smithi152.stdout:0/128: write d4/d19/f20 [284357,100420] 0 2024-04-06T12:23:41.649 INFO:tasks.workunit.client.0.smithi152.stdout:0/129: chown d4/de/d28/c25 435115 1 2024-04-06T12:23:41.649 INFO:tasks.workunit.client.0.smithi152.stdout:0/130: chown f1 1185 1 2024-04-06T12:23:41.650 INFO:tasks.workunit.client.0.smithi152.stdout:0/131: truncate d4/d19/f20 772067 0 2024-04-06T12:23:41.651 INFO:tasks.workunit.client.0.smithi152.stdout:3/107: mknod d0/d1f/c26 0 2024-04-06T12:23:41.651 INFO:tasks.workunit.client.0.smithi152.stdout:3/108: dread - d0/d10/d1e/f1d zero size 2024-04-06T12:23:41.657 INFO:tasks.workunit.client.0.smithi152.stdout:0/132: dwrite f2 [0,4194304] 0 2024-04-06T12:23:41.658 INFO:tasks.workunit.client.0.smithi152.stdout:0/133: write f2 [1055262,73453] 0 2024-04-06T12:23:41.665 INFO:tasks.workunit.client.0.smithi152.stdout:0/134: mkdir d4/d29/d2e 0 2024-04-06T12:23:41.669 INFO:tasks.workunit.client.0.smithi152.stdout:0/135: creat d4/d29/f2f x:0 0 0 2024-04-06T12:23:41.679 INFO:tasks.workunit.client.0.smithi152.stdout:0/136: creat d4/de/f30 x:0 0 0 2024-04-06T12:23:41.684 INFO:tasks.workunit.client.0.smithi152.stdout:0/137: unlink d4/f1d 0 2024-04-06T12:23:41.691 INFO:tasks.workunit.client.0.smithi152.stdout:0/138: mkdir d4/d31 0 2024-04-06T12:23:41.700 INFO:tasks.workunit.client.0.smithi152.stdout:0/139: creat d4/f32 x:0 0 0 2024-04-06T12:23:41.701 INFO:tasks.workunit.client.0.smithi152.stdout:0/140: dread - d4/de/d28/d18/f2c zero size 2024-04-06T12:23:41.702 INFO:tasks.workunit.client.0.smithi152.stdout:0/141: write d4/f2b [260353,71961] 0 2024-04-06T12:23:41.703 INFO:tasks.workunit.client.0.smithi152.stdout:0/142: stat d4/de/d28/f22 0 2024-04-06T12:23:41.705 INFO:tasks.workunit.client.0.smithi152.stdout:0/143: rmdir d4/de/d2a 39 2024-04-06T12:23:41.748 INFO:tasks.workunit.client.0.smithi152.stdout:5/77: dwrite d3/f7 [0,4194304] 0 2024-04-06T12:23:41.755 INFO:tasks.workunit.client.0.smithi152.stdout:5/78: dread d3/da/fc [0,4194304] 0 2024-04-06T12:23:41.756 INFO:tasks.workunit.client.0.smithi152.stdout:2/134: dwrite d0/d2/d5/f23 [0,4194304] 0 2024-04-06T12:23:41.761 INFO:tasks.workunit.client.0.smithi152.stdout:2/135: mknod d0/d15/c2d 0 2024-04-06T12:23:41.764 INFO:tasks.workunit.client.0.smithi152.stdout:5/79: getdents d3/da 0 2024-04-06T12:23:41.768 INFO:tasks.workunit.client.0.smithi152.stdout:2/136: creat d0/d2/d5/d10/f2e x:0 0 0 2024-04-06T12:23:41.771 INFO:tasks.workunit.client.0.smithi152.stdout:5/80: unlink d3/l14 0 2024-04-06T12:23:41.771 INFO:tasks.workunit.client.0.smithi152.stdout:9/90: write d5/d6/f7 [9432,119137] 0 2024-04-06T12:23:41.774 INFO:tasks.workunit.client.0.smithi152.stdout:2/137: mkdir d0/d15/d2f 0 2024-04-06T12:23:41.775 INFO:tasks.workunit.client.0.smithi152.stdout:5/81: mknod d3/c18 0 2024-04-06T12:23:41.779 INFO:tasks.workunit.client.0.smithi152.stdout:9/91: rename d5/d6/d1a/c1f to d5/d6/d1a/c20 0 2024-04-06T12:23:41.782 INFO:tasks.workunit.client.0.smithi152.stdout:5/82: dwrite d3/d9/fb [4194304,4194304] 0 2024-04-06T12:23:41.787 INFO:tasks.workunit.client.0.smithi152.stdout:6/101: write d7/fd [3395917,69451] 0 2024-04-06T12:23:41.787 INFO:tasks.workunit.client.0.smithi152.stdout:9/92: chown d5/d6/c12 868 1 2024-04-06T12:23:41.788 INFO:tasks.workunit.client.0.smithi152.stdout:6/102: fdatasync f3 0 2024-04-06T12:23:41.791 INFO:tasks.workunit.client.0.smithi152.stdout:5/83: symlink d3/da/l19 0 2024-04-06T12:23:41.791 INFO:tasks.workunit.client.0.smithi152.stdout:5/84: dread - d3/d9/f12 zero size 2024-04-06T12:23:41.792 INFO:tasks.workunit.client.0.smithi152.stdout:9/93: dread d5/fb [0,4194304] 0 2024-04-06T12:23:41.795 INFO:tasks.workunit.client.0.smithi152.stdout:6/103: symlink d7/d9/l21 0 2024-04-06T12:23:41.893 INFO:tasks.workunit.client.0.smithi152.stdout:5/85: rename d3/c18 to d3/c1a 0 2024-04-06T12:23:41.894 INFO:tasks.workunit.client.0.smithi152.stdout:5/86: readlink d3/da/l19 0 2024-04-06T12:23:41.894 INFO:tasks.workunit.client.0.smithi152.stdout:9/94: mknod d5/d6/d1a/c21 0 2024-04-06T12:23:41.897 INFO:tasks.workunit.client.0.smithi152.stdout:0/144: mkdir d4/de/d2a/d33 0 2024-04-06T12:23:41.898 INFO:tasks.workunit.client.0.smithi152.stdout:5/87: symlink d3/l1b 0 2024-04-06T12:23:41.900 INFO:tasks.workunit.client.0.smithi152.stdout:4/76: sync 2024-04-06T12:23:41.902 INFO:tasks.workunit.client.0.smithi152.stdout:9/95: read d5/d6/f14 [783270,109607] 0 2024-04-06T12:23:41.902 INFO:tasks.workunit.client.0.smithi152.stdout:0/145: truncate d4/f17 1033219 0 2024-04-06T12:23:41.904 INFO:tasks.workunit.client.0.smithi152.stdout:9/96: write d5/d6/f7 [186461,64989] 0 2024-04-06T12:23:41.908 INFO:tasks.workunit.client.0.smithi152.stdout:4/77: dwrite d7/f12 [0,4194304] 0 2024-04-06T12:23:41.910 INFO:tasks.workunit.client.0.smithi152.stdout:0/146: dread d4/f8 [0,4194304] 0 2024-04-06T12:23:41.921 INFO:tasks.workunit.client.0.smithi152.stdout:0/147: creat d4/d31/f34 x:0 0 0 2024-04-06T12:23:41.921 INFO:tasks.workunit.client.0.smithi152.stdout:3/109: write d0/f8 [452398,6529] 0 2024-04-06T12:23:41.924 INFO:tasks.workunit.client.0.smithi152.stdout:3/110: symlink d0/d1f/l27 0 2024-04-06T12:23:41.930 INFO:tasks.workunit.client.0.smithi152.stdout:3/111: dwrite d0/d10/d13/f17 [0,4194304] 0 2024-04-06T12:23:41.931 INFO:tasks.workunit.client.0.smithi152.stdout:3/112: dread - d0/d10/d1e/f1d zero size 2024-04-06T12:23:41.934 INFO:tasks.workunit.client.0.smithi152.stdout:0/148: link d4/de/d28/d18/f2c d4/f35 0 2024-04-06T12:23:41.945 INFO:tasks.workunit.client.0.smithi152.stdout:3/113: getdents d0/d10/d1e 0 2024-04-06T12:23:41.951 INFO:tasks.workunit.client.0.smithi152.stdout:3/114: mkdir d0/d1f/d28 0 2024-04-06T12:23:41.951 INFO:tasks.workunit.client.0.smithi152.stdout:3/115: readlink d0/ld 0 2024-04-06T12:23:41.951 INFO:tasks.workunit.client.0.smithi152.stdout:3/116: chown d0/d10 149335026 1 2024-04-06T12:23:41.951 INFO:tasks.workunit.client.0.smithi152.stdout:8/70: truncate f3 2730465 0 2024-04-06T12:23:41.953 INFO:tasks.workunit.client.0.smithi152.stdout:8/71: dread - f0 zero size 2024-04-06T12:23:41.955 INFO:tasks.workunit.client.0.smithi152.stdout:3/117: getdents d0/d1f/d28 0 2024-04-06T12:23:41.956 INFO:tasks.workunit.client.0.smithi152.stdout:3/118: readlink d0/ld 0 2024-04-06T12:23:41.960 INFO:tasks.workunit.client.0.smithi152.stdout:3/119: rename d0/d10/d1e/l25 to d0/d10/d1e/l29 0 2024-04-06T12:23:41.961 INFO:tasks.workunit.client.0.smithi152.stdout:3/120: dread - d0/d10/d1e/f1d zero size 2024-04-06T12:23:41.963 INFO:tasks.workunit.client.0.smithi152.stdout:8/72: symlink d4/dc/d10/l14 0 2024-04-06T12:23:41.965 INFO:tasks.workunit.client.0.smithi152.stdout:3/121: mkdir d0/d10/d13/d2a 0 2024-04-06T12:23:41.965 INFO:tasks.workunit.client.0.smithi152.stdout:3/122: readlink d0/ld 0 2024-04-06T12:23:41.969 INFO:tasks.workunit.client.0.smithi152.stdout:8/73: dwrite d4/dc/fd [0,4194304] 0 2024-04-06T12:23:41.970 INFO:tasks.workunit.client.0.smithi152.stdout:8/74: chown d4 1168 1 2024-04-06T12:23:41.971 INFO:tasks.workunit.client.0.smithi152.stdout:8/75: dread - d4/db/f13 zero size 2024-04-06T12:23:41.976 INFO:tasks.workunit.client.0.smithi152.stdout:8/76: mkdir d4/dc/d10/d15 0 2024-04-06T12:23:41.977 INFO:tasks.workunit.client.0.smithi152.stdout:7/55: sync 2024-04-06T12:23:41.977 INFO:tasks.workunit.client.0.smithi152.stdout:1/133: sync 2024-04-06T12:23:41.984 INFO:tasks.workunit.client.0.smithi152.stdout:8/77: fdatasync f3 0 2024-04-06T12:23:41.985 INFO:tasks.workunit.client.0.smithi152.stdout:8/78: write d4/dc/fd [1598264,47631] 0 2024-04-06T12:23:41.988 INFO:tasks.workunit.client.0.smithi152.stdout:8/79: dread d4/f8 [0,4194304] 0 2024-04-06T12:23:41.991 INFO:tasks.workunit.client.0.smithi152.stdout:8/80: dread d4/f8 [0,4194304] 0 2024-04-06T12:23:41.992 INFO:tasks.workunit.client.0.smithi152.stdout:8/81: chown f0 126643775 1 2024-04-06T12:23:42.013 INFO:tasks.workunit.client.0.smithi152.stdout:8/82: getdents d4/dc 0 2024-04-06T12:23:42.013 INFO:tasks.workunit.client.0.smithi152.stdout:8/83: read d4/f9 [95341,69355] 0 2024-04-06T12:23:42.017 INFO:tasks.workunit.client.0.smithi152.stdout:8/84: creat d4/db/f16 x:0 0 0 2024-04-06T12:23:42.021 INFO:tasks.workunit.client.0.smithi152.stdout:8/85: fdatasync d4/f9 0 2024-04-06T12:23:42.022 INFO:tasks.workunit.client.0.smithi152.stdout:2/138: write d0/d2/d5/d10/f18 [4850462,25844] 0 2024-04-06T12:23:42.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/139: mknod d0/d2/c30 0 2024-04-06T12:23:42.026 INFO:tasks.workunit.client.0.smithi152.stdout:8/86: symlink d4/dc/d10/l17 0 2024-04-06T12:23:42.030 INFO:tasks.workunit.client.0.smithi152.stdout:8/87: mkdir d4/dc/d10/d18 0 2024-04-06T12:23:42.033 INFO:tasks.workunit.client.0.smithi152.stdout:2/140: symlink d0/d15/d24/l31 0 2024-04-06T12:23:42.034 INFO:tasks.workunit.client.0.smithi152.stdout:2/141: fsync d0/f29 0 2024-04-06T12:23:42.035 INFO:tasks.workunit.client.0.smithi152.stdout:8/88: chown d4/ce 4 1 2024-04-06T12:23:42.039 INFO:tasks.workunit.client.0.smithi152.stdout:8/89: dread d4/dc/fd [0,4194304] 0 2024-04-06T12:23:42.051 INFO:tasks.workunit.client.0.smithi152.stdout:2/142: rmdir d0/d15/d2f 0 2024-04-06T12:23:42.053 INFO:tasks.workunit.client.0.smithi152.stdout:5/88: dwrite d3/d9/f12 [0,4194304] 0 2024-04-06T12:23:42.054 INFO:tasks.workunit.client.0.smithi152.stdout:8/90: link d4/f8 d4/dc/f19 0 2024-04-06T12:23:42.055 INFO:tasks.workunit.client.0.smithi152.stdout:2/143: mknod d0/d2/d5/d27/c32 0 2024-04-06T12:23:42.057 INFO:tasks.workunit.client.0.smithi152.stdout:8/91: write d4/dc/f19 [2407767,111024] 0 2024-04-06T12:23:42.063 INFO:tasks.workunit.client.0.smithi152.stdout:2/144: dwrite d0/d2/f2c [0,4194304] 0 2024-04-06T12:23:42.064 INFO:tasks.workunit.client.0.smithi152.stdout:8/92: symlink d4/dc/d10/d15/l1a 0 2024-04-06T12:23:42.068 INFO:tasks.workunit.client.0.smithi152.stdout:8/93: rmdir d4/dc/d10/d15 39 2024-04-06T12:23:42.069 INFO:tasks.workunit.client.0.smithi152.stdout:2/145: dread d0/d2/f2c [0,4194304] 0 2024-04-06T12:23:42.074 INFO:tasks.workunit.client.0.smithi152.stdout:2/146: link d0/d15/c2d d0/c33 0 2024-04-06T12:23:42.079 INFO:tasks.workunit.client.0.smithi152.stdout:2/147: rename d0/d2/d5/l1b to d0/d2/d5/d27/l34 0 2024-04-06T12:23:42.082 INFO:tasks.workunit.client.0.smithi152.stdout:2/148: write d0/d2/d5/f1f [1167250,18668] 0 2024-04-06T12:23:42.087 INFO:tasks.workunit.client.0.smithi152.stdout:3/123: write d0/fb [1563124,25776] 0 2024-04-06T12:23:42.090 INFO:tasks.workunit.client.0.smithi152.stdout:2/149: dwrite d0/d2/f21 [0,4194304] 0 2024-04-06T12:23:42.091 INFO:tasks.workunit.client.0.smithi152.stdout:2/150: chown d0/d15 37200 1 2024-04-06T12:23:42.092 INFO:tasks.workunit.client.0.smithi152.stdout:3/124: creat d0/d10/f2b x:0 0 0 2024-04-06T12:23:42.092 INFO:tasks.workunit.client.0.smithi152.stdout:2/151: rename d0/d2 to d0/d2/d5/d10/d35 22 2024-04-06T12:23:42.094 INFO:tasks.workunit.client.0.smithi152.stdout:1/134: write d2/f3 [5770061,40131] 0 2024-04-06T12:23:42.094 INFO:tasks.workunit.client.0.smithi152.stdout:3/125: readlink d0/d10/l24 0 2024-04-06T12:23:42.095 INFO:tasks.workunit.client.0.smithi152.stdout:3/126: write d0/ff [3298653,58536] 0 2024-04-06T12:23:42.097 INFO:tasks.workunit.client.0.smithi152.stdout:2/152: creat d0/d15/d24/f36 x:0 0 0 2024-04-06T12:23:42.102 INFO:tasks.workunit.client.0.smithi152.stdout:3/127: dwrite d0/ff [0,4194304] 0 2024-04-06T12:23:42.105 INFO:tasks.workunit.client.0.smithi152.stdout:1/135: creat d2/d1d/d21/f34 x:0 0 0 2024-04-06T12:23:42.107 INFO:tasks.workunit.client.0.smithi152.stdout:1/136: fsync d2/f3 0 2024-04-06T12:23:42.114 INFO:tasks.workunit.client.0.smithi152.stdout:1/137: write d2/f18 [1996237,189] 0 2024-04-06T12:23:42.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/138: chown d2/d1d/d21/d28/c29 36605968 1 2024-04-06T12:23:42.133 INFO:tasks.workunit.client.0.smithi152.stdout:3/128: getdents d0/d1f 0 2024-04-06T12:23:42.133 INFO:tasks.workunit.client.0.smithi152.stdout:3/129: fsync d0/f7 0 2024-04-06T12:23:42.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/139: dread d2/f7 [0,4194304] 0 2024-04-06T12:23:42.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/140: stat d2/fb 0 2024-04-06T12:23:42.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/141: mknod d2/c35 0 2024-04-06T12:23:42.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/142: creat d2/f36 x:0 0 0 2024-04-06T12:23:42.135 INFO:tasks.workunit.client.0.smithi152.stdout:0/149: write d4/f17 [18118,101798] 0 2024-04-06T12:23:42.139 INFO:tasks.workunit.client.0.smithi152.stdout:2/153: getdents d0/d15 0 2024-04-06T12:23:42.140 INFO:tasks.workunit.client.0.smithi152.stdout:2/154: readlink d0/d2/d5/d10/l1e 0 2024-04-06T12:23:42.140 INFO:tasks.workunit.client.0.smithi152.stdout:2/155: chown d0/d25 382 1 2024-04-06T12:23:42.141 INFO:tasks.workunit.client.0.smithi152.stdout:2/156: readlink d0/d15/d24/l31 0 2024-04-06T12:23:42.142 INFO:tasks.workunit.client.0.smithi152.stdout:2/157: read d0/d2/f21 [2044524,23973] 0 2024-04-06T12:23:42.143 INFO:tasks.workunit.client.0.smithi152.stdout:0/150: mkdir d4/d36 0 2024-04-06T12:23:42.146 INFO:tasks.workunit.client.0.smithi152.stdout:2/158: dread d0/fd [0,4194304] 0 2024-04-06T12:23:42.154 INFO:tasks.workunit.client.0.smithi152.stdout:2/159: mknod d0/d15/d24/c37 0 2024-04-06T12:23:42.155 INFO:tasks.workunit.client.0.smithi152.stdout:5/89: truncate d3/f16 1438780 0 2024-04-06T12:23:42.159 INFO:tasks.workunit.client.0.smithi152.stdout:0/151: rename d4/cb to d4/de/d2a/d33/c37 0 2024-04-06T12:23:42.162 INFO:tasks.workunit.client.0.smithi152.stdout:6/104: sync 2024-04-06T12:23:42.163 INFO:tasks.workunit.client.0.smithi152.stdout:6/105: chown d7/d9/la 219757804 1 2024-04-06T12:23:42.164 INFO:tasks.workunit.client.0.smithi152.stdout:6/106: write d7/d9/f17 [1071597,97919] 0 2024-04-06T12:23:42.172 INFO:tasks.workunit.client.0.smithi152.stdout:6/107: rmdir d7 39 2024-04-06T12:23:42.178 INFO:tasks.workunit.client.0.smithi152.stdout:2/160: getdents d0/d2 0 2024-04-06T12:23:42.178 INFO:tasks.workunit.client.0.smithi152.stdout:6/108: rmdir d7 39 2024-04-06T12:23:42.180 INFO:tasks.workunit.client.0.smithi152.stdout:2/161: mknod d0/d25/d26/c38 0 2024-04-06T12:23:42.181 INFO:tasks.workunit.client.0.smithi152.stdout:6/109: write d7/f1e [635184,494] 0 2024-04-06T12:23:42.195 INFO:tasks.workunit.client.0.smithi152.stdout:1/143: write d2/fe [506083,78554] 0 2024-04-06T12:23:42.197 INFO:tasks.workunit.client.0.smithi152.stdout:1/144: write d2/f13 [136657,27098] 0 2024-04-06T12:23:42.200 INFO:tasks.workunit.client.0.smithi152.stdout:1/145: write d2/d1d/d21/d28/f30 [448121,563] 0 2024-04-06T12:23:42.209 INFO:tasks.workunit.client.0.smithi152.stdout:1/146: dwrite d2/f1b [4194304,4194304] 0 2024-04-06T12:23:42.212 INFO:tasks.workunit.client.0.smithi152.stdout:5/90: fsync d3/f16 0 2024-04-06T12:23:42.216 INFO:tasks.workunit.client.0.smithi152.stdout:1/147: rmdir d2/d1d/d21 39 2024-04-06T12:23:42.218 INFO:tasks.workunit.client.0.smithi152.stdout:0/152: chown d4/de/d2a/d33/c37 1623838 1 2024-04-06T12:23:42.223 INFO:tasks.workunit.client.0.smithi152.stdout:5/91: creat d3/da/d15/f1c x:0 0 0 2024-04-06T12:23:42.224 INFO:tasks.workunit.client.0.smithi152.stdout:0/153: symlink d4/d31/l38 0 2024-04-06T12:23:42.224 INFO:tasks.workunit.client.0.smithi152.stdout:1/148: rmdir d2/d1d/d21/d28 39 2024-04-06T12:23:42.225 INFO:tasks.workunit.client.0.smithi152.stdout:0/154: read - d4/fa zero size 2024-04-06T12:23:42.225 INFO:tasks.workunit.client.0.smithi152.stdout:5/92: fdatasync d3/da/d15/f1c 0 2024-04-06T12:23:42.227 INFO:tasks.workunit.client.0.smithi152.stdout:1/149: truncate d2/ff 1221094 0 2024-04-06T12:23:42.227 INFO:tasks.workunit.client.0.smithi152.stdout:5/93: fdatasync d3/da/d15/f1c 0 2024-04-06T12:23:42.228 INFO:tasks.workunit.client.0.smithi152.stdout:0/155: read - d4/de/f30 zero size 2024-04-06T12:23:42.228 INFO:tasks.workunit.client.0.smithi152.stdout:5/94: chown d3/da 10221 1 2024-04-06T12:23:42.230 INFO:tasks.workunit.client.0.smithi152.stdout:1/150: mkdir d2/d2f/d37 0 2024-04-06T12:23:42.235 INFO:tasks.workunit.client.0.smithi152.stdout:0/156: chown d4/de/d28/d18/l26 23755 1 2024-04-06T12:23:42.240 INFO:tasks.workunit.client.0.smithi152.stdout:1/151: symlink d2/d1d/d21/d28/l38 0 2024-04-06T12:23:42.242 INFO:tasks.workunit.client.0.smithi152.stdout:2/162: write d0/f11 [830528,88363] 0 2024-04-06T12:23:42.243 INFO:tasks.workunit.client.0.smithi152.stdout:6/110: write d7/ff [49052,9872] 0 2024-04-06T12:23:42.247 INFO:tasks.workunit.client.0.smithi152.stdout:0/157: rename f2 to d4/f39 0 2024-04-06T12:23:42.249 INFO:tasks.workunit.client.0.smithi152.stdout:1/152: creat d2/f39 x:0 0 0 2024-04-06T12:23:42.252 INFO:tasks.workunit.client.0.smithi152.stdout:6/111: mkdir d7/d19/d1b/d22 0 2024-04-06T12:23:42.253 INFO:tasks.workunit.client.0.smithi152.stdout:6/112: read d7/d19/f1c [813077,31211] 0 2024-04-06T12:23:42.260 INFO:tasks.workunit.client.0.smithi152.stdout:2/163: getdents d0/d15 0 2024-04-06T12:23:42.260 INFO:tasks.workunit.client.0.smithi152.stdout:6/113: dwrite d7/d19/f15 [0,4194304] 0 2024-04-06T12:23:42.261 INFO:tasks.workunit.client.0.smithi152.stdout:0/158: creat d4/f3a x:0 0 0 2024-04-06T12:23:42.261 INFO:tasks.workunit.client.0.smithi152.stdout:2/164: dread - d0/f29 zero size 2024-04-06T12:23:42.262 INFO:tasks.workunit.client.0.smithi152.stdout:6/114: write d7/d19/f15 [2236179,39916] 0 2024-04-06T12:23:42.263 INFO:tasks.workunit.client.0.smithi152.stdout:2/165: write d0/f11 [685926,80586] 0 2024-04-06T12:23:42.265 INFO:tasks.workunit.client.0.smithi152.stdout:2/166: dread - d0/d2/f14 zero size 2024-04-06T12:23:42.270 INFO:tasks.workunit.client.0.smithi152.stdout:0/159: rename d4/d29 to d4/de/d28/d18/d3b 0 2024-04-06T12:23:42.273 INFO:tasks.workunit.client.0.smithi152.stdout:2/167: creat d0/d25/f39 x:0 0 0 2024-04-06T12:23:42.280 INFO:tasks.workunit.client.0.smithi152.stdout:0/160: chown d4/c1b 46 1 2024-04-06T12:23:42.281 INFO:tasks.workunit.client.0.smithi152.stdout:0/161: dread - d4/de/d28/f22 zero size 2024-04-06T12:23:42.284 INFO:tasks.workunit.client.0.smithi152.stdout:2/168: mkdir d0/d2/d5/d3a 0 2024-04-06T12:23:42.287 INFO:tasks.workunit.client.0.smithi152.stdout:2/169: dread d0/f1c [0,4194304] 0 2024-04-06T12:23:42.289 INFO:tasks.workunit.client.0.smithi152.stdout:1/153: truncate d2/fe 133392 0 2024-04-06T12:23:42.293 INFO:tasks.workunit.client.0.smithi152.stdout:0/162: fsync d4/f3a 0 2024-04-06T12:23:42.294 INFO:tasks.workunit.client.0.smithi152.stdout:1/154: getdents d2/d2f/d37 0 2024-04-06T12:23:42.296 INFO:tasks.workunit.client.0.smithi152.stdout:6/115: dread d7/fd [0,4194304] 0 2024-04-06T12:23:42.307 INFO:tasks.workunit.client.0.smithi152.stdout:6/116: dwrite d7/fd [4194304,4194304] 0 2024-04-06T12:23:42.313 INFO:tasks.workunit.client.0.smithi152.stdout:0/163: dread f3 [0,4194304] 0 2024-04-06T12:23:42.315 INFO:tasks.workunit.client.0.smithi152.stdout:6/117: dwrite d7/f1e [0,4194304] 0 2024-04-06T12:23:42.318 INFO:tasks.workunit.client.0.smithi152.stdout:0/164: truncate d4/fa 150327 0 2024-04-06T12:23:42.319 INFO:tasks.workunit.client.0.smithi152.stdout:0/165: write d4/f32 [1029323,23681] 0 2024-04-06T12:23:42.319 INFO:tasks.workunit.client.0.smithi152.stdout:6/118: creat d7/d19/f23 x:0 0 0 2024-04-06T12:23:42.321 INFO:tasks.workunit.client.0.smithi152.stdout:1/155: link d2/fe d2/d1d/d21/d28/f3a 0 2024-04-06T12:23:42.325 INFO:tasks.workunit.client.0.smithi152.stdout:0/166: dwrite d4/de/f1e [0,4194304] 0 2024-04-06T12:23:42.326 INFO:tasks.workunit.client.0.smithi152.stdout:6/119: mknod d7/d19/d1b/d22/c24 0 2024-04-06T12:23:42.327 INFO:tasks.workunit.client.0.smithi152.stdout:0/167: write d4/f17 [1941444,75254] 0 2024-04-06T12:23:42.328 INFO:tasks.workunit.client.0.smithi152.stdout:1/156: mkdir d2/d1d/d3b 0 2024-04-06T12:23:42.330 INFO:tasks.workunit.client.0.smithi152.stdout:1/157: write d2/d1d/d21/d28/f30 [403205,125333] 0 2024-04-06T12:23:42.334 INFO:tasks.workunit.client.0.smithi152.stdout:6/120: truncate d7/fc 4794093 0 2024-04-06T12:23:42.336 INFO:tasks.workunit.client.0.smithi152.stdout:1/158: symlink d2/d1d/d21/l3c 0 2024-04-06T12:23:42.338 INFO:tasks.workunit.client.0.smithi152.stdout:0/168: dwrite f1 [0,4194304] 0 2024-04-06T12:23:42.340 INFO:tasks.workunit.client.0.smithi152.stdout:0/169: fsync d4/f3a 0 2024-04-06T12:23:42.342 INFO:tasks.workunit.client.0.smithi152.stdout:1/159: mknod d2/c3d 0 2024-04-06T12:23:42.342 INFO:tasks.workunit.client.0.smithi152.stdout:6/121: dwrite f3 [0,4194304] 0 2024-04-06T12:23:42.344 INFO:tasks.workunit.client.0.smithi152.stdout:6/122: write d7/fd [4501979,7445] 0 2024-04-06T12:23:42.346 INFO:tasks.workunit.client.0.smithi152.stdout:0/170: symlink d4/de/d2a/l3c 0 2024-04-06T12:23:42.347 INFO:tasks.workunit.client.0.smithi152.stdout:1/160: rmdir d2/d1d/d21 39 2024-04-06T12:23:42.353 INFO:tasks.workunit.client.0.smithi152.stdout:6/123: link d7/d19/d1b/d22/c24 d7/d19/d1b/c25 0 2024-04-06T12:23:42.355 INFO:tasks.workunit.client.0.smithi152.stdout:1/161: dwrite d2/f3 [4194304,4194304] 0 2024-04-06T12:23:42.357 INFO:tasks.workunit.client.0.smithi152.stdout:0/171: getdents d4/de/d28/d18 0 2024-04-06T12:23:42.359 INFO:tasks.workunit.client.0.smithi152.stdout:6/124: mkdir d7/d9/d26 0 2024-04-06T12:23:42.359 INFO:tasks.workunit.client.0.smithi152.stdout:6/125: read d7/d19/f1c [2282599,4231] 0 2024-04-06T12:23:42.362 INFO:tasks.workunit.client.0.smithi152.stdout:0/172: dread f1 [0,4194304] 0 2024-04-06T12:23:42.370 INFO:tasks.workunit.client.0.smithi152.stdout:6/126: mknod d7/c27 0 2024-04-06T12:23:42.370 INFO:tasks.workunit.client.0.smithi152.stdout:6/127: chown d7/d19/l16 1102 1 2024-04-06T12:23:42.371 INFO:tasks.workunit.client.0.smithi152.stdout:6/128: stat d7/fb 0 2024-04-06T12:23:42.371 INFO:tasks.workunit.client.0.smithi152.stdout:6/129: fsync d7/ff 0 2024-04-06T12:23:42.372 INFO:tasks.workunit.client.0.smithi152.stdout:6/130: stat f6 0 2024-04-06T12:23:42.499 INFO:tasks.workunit.client.0.smithi152.stdout:9/97: sync 2024-04-06T12:23:42.499 INFO:tasks.workunit.client.0.smithi152.stdout:4/78: sync 2024-04-06T12:23:42.501 INFO:tasks.workunit.client.0.smithi152.stdout:6/131: mknod d7/c28 0 2024-04-06T12:23:42.502 INFO:tasks.workunit.client.0.smithi152.stdout:4/79: rmdir d7 39 2024-04-06T12:23:42.506 INFO:tasks.workunit.client.0.smithi152.stdout:6/132: chown d7/d19/d1b/c25 206955346 1 2024-04-06T12:23:42.510 INFO:tasks.workunit.client.0.smithi152.stdout:4/80: write d7/f12 [662010,65943] 0 2024-04-06T12:23:42.513 INFO:tasks.workunit.client.0.smithi152.stdout:6/133: creat d7/d19/d1b/d22/f29 x:0 0 0 2024-04-06T12:23:42.514 INFO:tasks.workunit.client.0.smithi152.stdout:4/81: read f5 [1126269,76071] 0 2024-04-06T12:23:42.515 INFO:tasks.workunit.client.0.smithi152.stdout:4/82: write f1 [1779993,93374] 0 2024-04-06T12:23:42.516 INFO:tasks.workunit.client.0.smithi152.stdout:4/83: write d7/fb [11757908,86529] 0 2024-04-06T12:23:42.517 INFO:tasks.workunit.client.0.smithi152.stdout:6/134: creat d7/d19/d1b/d1f/f2a x:0 0 0 2024-04-06T12:23:42.521 INFO:tasks.workunit.client.0.smithi152.stdout:9/98: write d5/d6/d15/d17/f19 [418189,73079] 0 2024-04-06T12:23:42.522 INFO:tasks.workunit.client.0.smithi152.stdout:6/135: rmdir d7/d9 39 2024-04-06T12:23:42.525 INFO:tasks.workunit.client.0.smithi152.stdout:9/99: creat d5/d6/d15/d17/f22 x:0 0 0 2024-04-06T12:23:42.526 INFO:tasks.workunit.client.0.smithi152.stdout:9/100: dread d5/fb [0,4194304] 0 2024-04-06T12:23:42.528 INFO:tasks.workunit.client.0.smithi152.stdout:4/84: write f5 [3913139,118793] 0 2024-04-06T12:23:42.529 INFO:tasks.workunit.client.0.smithi152.stdout:4/85: readlink d7/l11 0 2024-04-06T12:23:42.531 INFO:tasks.workunit.client.0.smithi152.stdout:4/86: symlink d7/l13 0 2024-04-06T12:23:42.531 INFO:tasks.workunit.client.0.smithi152.stdout:4/87: chown d7/cd 1015 1 2024-04-06T12:23:42.532 INFO:tasks.workunit.client.0.smithi152.stdout:9/101: getdents d5/d6 0 2024-04-06T12:23:42.533 INFO:tasks.workunit.client.0.smithi152.stdout:4/88: write f5 [3975199,127417] 0 2024-04-06T12:23:42.533 INFO:tasks.workunit.client.0.smithi152.stdout:9/102: read d5/d6/fd [36635,88102] 0 2024-04-06T12:23:42.538 INFO:tasks.workunit.client.0.smithi152.stdout:9/103: rename d5/d6/d1a to d5/d6/d15/d17/d23 0 2024-04-06T12:23:42.540 INFO:tasks.workunit.client.0.smithi152.stdout:9/104: creat d5/d6/f24 x:0 0 0 2024-04-06T12:23:42.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/89: truncate d7/fb 266936 0 2024-04-06T12:23:42.544 INFO:tasks.workunit.client.0.smithi152.stdout:9/105: symlink d5/l25 0 2024-04-06T12:23:42.544 INFO:tasks.workunit.client.0.smithi152.stdout:4/90: chown d7/lf 117 1 2024-04-06T12:23:42.546 INFO:tasks.workunit.client.0.smithi152.stdout:4/91: mknod d7/c14 0 2024-04-06T12:23:42.546 INFO:tasks.workunit.client.0.smithi152.stdout:4/92: fsync f5 0 2024-04-06T12:23:42.557 INFO:tasks.workunit.client.0.smithi152.stdout:4/93: getdents d7 0 2024-04-06T12:23:42.561 INFO:tasks.workunit.client.0.smithi152.stdout:4/94: link d7/lf d7/l15 0 2024-04-06T12:23:42.619 INFO:tasks.workunit.client.0.smithi152.stdout:7/56: sync 2024-04-06T12:23:42.620 INFO:tasks.workunit.client.0.smithi152.stdout:5/95: sync 2024-04-06T12:23:42.620 INFO:tasks.workunit.client.0.smithi152.stdout:3/130: sync 2024-04-06T12:23:42.620 INFO:tasks.workunit.client.0.smithi152.stdout:8/94: sync 2024-04-06T12:23:42.620 INFO:tasks.workunit.client.0.smithi152.stdout:5/96: fdatasync d3/d9/f12 0 2024-04-06T12:23:42.620 INFO:tasks.workunit.client.0.smithi152.stdout:3/131: chown d0/d1f/c26 1 1 2024-04-06T12:23:42.622 INFO:tasks.workunit.client.0.smithi152.stdout:3/132: write d0/fb [4628568,1672] 0 2024-04-06T12:23:42.623 INFO:tasks.workunit.client.0.smithi152.stdout:5/97: mknod d3/c1d 0 2024-04-06T12:23:42.624 INFO:tasks.workunit.client.0.smithi152.stdout:8/95: dread d4/f9 [4194304,4194304] 0 2024-04-06T12:23:42.625 INFO:tasks.workunit.client.0.smithi152.stdout:7/57: creat d8/dc/f13 x:0 0 0 2024-04-06T12:23:42.626 INFO:tasks.workunit.client.0.smithi152.stdout:8/96: read - d4/db/f16 zero size 2024-04-06T12:23:42.628 INFO:tasks.workunit.client.0.smithi152.stdout:5/98: symlink d3/da/l1e 0 2024-04-06T12:23:42.631 INFO:tasks.workunit.client.0.smithi152.stdout:3/133: mknod d0/d1f/d28/c2c 0 2024-04-06T12:23:42.634 INFO:tasks.workunit.client.0.smithi152.stdout:5/99: dwrite d3/f7 [4194304,4194304] 0 2024-04-06T12:23:42.635 INFO:tasks.workunit.client.0.smithi152.stdout:8/97: rename d4/dc/d10/l11 to d4/dc/d10/d15/l1b 0 2024-04-06T12:23:42.636 INFO:tasks.workunit.client.0.smithi152.stdout:5/100: stat d3/da/l19 0 2024-04-06T12:23:42.639 INFO:tasks.workunit.client.0.smithi152.stdout:5/101: dread d3/f7 [4194304,4194304] 0 2024-04-06T12:23:42.647 INFO:tasks.workunit.client.0.smithi152.stdout:3/134: mkdir d0/d2d 0 2024-04-06T12:23:42.650 INFO:tasks.workunit.client.0.smithi152.stdout:5/102: creat d3/f1f x:0 0 0 2024-04-06T12:23:42.650 INFO:tasks.workunit.client.0.smithi152.stdout:3/135: dread d0/f7 [4194304,4194304] 0 2024-04-06T12:23:42.655 INFO:tasks.workunit.client.0.smithi152.stdout:8/98: mknod d4/dc/d10/d18/c1c 0 2024-04-06T12:23:42.655 INFO:tasks.workunit.client.0.smithi152.stdout:8/99: chown d4/dc/d10/l14 93663 1 2024-04-06T12:23:42.658 INFO:tasks.workunit.client.0.smithi152.stdout:5/103: mknod d3/da/c20 0 2024-04-06T12:23:42.658 INFO:tasks.workunit.client.0.smithi152.stdout:5/104: stat d3/f1f 0 2024-04-06T12:23:42.659 INFO:tasks.workunit.client.0.smithi152.stdout:3/136: unlink d0/d1f/d28/c2c 0 2024-04-06T12:23:42.660 INFO:tasks.workunit.client.0.smithi152.stdout:3/137: chown d0/f7 0 1 2024-04-06T12:23:42.661 INFO:tasks.workunit.client.0.smithi152.stdout:3/138: write d0/d10/d13/f1a [1633292,16482] 0 2024-04-06T12:23:42.661 INFO:tasks.workunit.client.0.smithi152.stdout:3/139: chown d0/d10/d13/l19 268126764 1 2024-04-06T12:23:42.663 INFO:tasks.workunit.client.0.smithi152.stdout:7/58: getdents d8/df 0 2024-04-06T12:23:42.664 INFO:tasks.workunit.client.0.smithi152.stdout:8/100: mknod d4/db/c1d 0 2024-04-06T12:23:42.666 INFO:tasks.workunit.client.0.smithi152.stdout:5/105: readlink d3/d9/lf 0 2024-04-06T12:23:42.673 INFO:tasks.workunit.client.0.smithi152.stdout:8/101: mkdir d4/d1e 0 2024-04-06T12:23:42.673 INFO:tasks.workunit.client.0.smithi152.stdout:8/102: chown d4/ce 2516 1 2024-04-06T12:23:42.674 INFO:tasks.workunit.client.0.smithi152.stdout:5/106: creat d3/da/d15/f21 x:0 0 0 2024-04-06T12:23:42.675 INFO:tasks.workunit.client.0.smithi152.stdout:5/107: fdatasync d3/f1f 0 2024-04-06T12:23:42.675 INFO:tasks.workunit.client.0.smithi152.stdout:5/108: stat d3/c8 0 2024-04-06T12:23:42.675 INFO:tasks.workunit.client.0.smithi152.stdout:5/109: read d3/f16 [418240,102892] 0 2024-04-06T12:23:42.676 INFO:tasks.workunit.client.0.smithi152.stdout:5/110: chown d3/f11 7030068 1 2024-04-06T12:23:42.676 INFO:tasks.workunit.client.0.smithi152.stdout:5/111: readlink d3/da/l19 0 2024-04-06T12:23:42.677 INFO:tasks.workunit.client.0.smithi152.stdout:3/140: mknod d0/d10/d13/d2a/c2e 0 2024-04-06T12:23:42.679 INFO:tasks.workunit.client.0.smithi152.stdout:8/103: creat d4/dc/f1f x:0 0 0 2024-04-06T12:23:42.683 INFO:tasks.workunit.client.0.smithi152.stdout:7/59: rename c7 to d8/c14 0 2024-04-06T12:23:42.684 INFO:tasks.workunit.client.0.smithi152.stdout:3/141: rename d0/d10 to d0/d10/d13/d2f 22 2024-04-06T12:23:42.685 INFO:tasks.workunit.client.0.smithi152.stdout:5/112: dwrite d3/f7 [4194304,4194304] 0 2024-04-06T12:23:42.687 INFO:tasks.workunit.client.0.smithi152.stdout:7/60: mknod d8/df/c15 0 2024-04-06T12:23:42.691 INFO:tasks.workunit.client.0.smithi152.stdout:3/142: dwrite d0/d10/d13/f17 [0,4194304] 0 2024-04-06T12:23:42.700 INFO:tasks.workunit.client.0.smithi152.stdout:5/113: creat d3/de/f22 x:0 0 0 2024-04-06T12:23:42.707 INFO:tasks.workunit.client.0.smithi152.stdout:8/104: getdents d4/db 0 2024-04-06T12:23:42.708 INFO:tasks.workunit.client.0.smithi152.stdout:5/114: mknod d3/da/c23 0 2024-04-06T12:23:42.711 INFO:tasks.workunit.client.0.smithi152.stdout:7/61: link d8/df/f11 d8/f16 0 2024-04-06T12:23:42.712 INFO:tasks.workunit.client.0.smithi152.stdout:7/62: write d8/dc/fe [3620029,57082] 0 2024-04-06T12:23:42.713 INFO:tasks.workunit.client.0.smithi152.stdout:3/143: link d0/d10/d1e/c11 d0/d10/d13/c30 0 2024-04-06T12:23:42.714 INFO:tasks.workunit.client.0.smithi152.stdout:8/105: dwrite d4/dc/f19 [0,4194304] 0 2024-04-06T12:23:42.719 INFO:tasks.workunit.client.0.smithi152.stdout:5/115: creat d3/da/f24 x:0 0 0 2024-04-06T12:23:42.725 INFO:tasks.workunit.client.0.smithi152.stdout:3/144: symlink d0/d10/d13/l31 0 2024-04-06T12:23:42.733 INFO:tasks.workunit.client.0.smithi152.stdout:3/145: rename d0/f7 to d0/d10/d13/f32 0 2024-04-06T12:23:42.734 INFO:tasks.workunit.client.0.smithi152.stdout:3/146: stat d0 0 2024-04-06T12:23:42.734 INFO:tasks.workunit.client.0.smithi152.stdout:3/147: chown d0/d1f 28006 1 2024-04-06T12:23:42.735 INFO:tasks.workunit.client.0.smithi152.stdout:3/148: dread - d0/d1f/f23 zero size 2024-04-06T12:23:42.738 INFO:tasks.workunit.client.0.smithi152.stdout:3/149: dread d0/ff [0,4194304] 0 2024-04-06T12:23:42.739 INFO:tasks.workunit.client.0.smithi152.stdout:3/150: fdatasync d0/d10/d1e/f1d 0 2024-04-06T12:23:42.740 INFO:tasks.workunit.client.0.smithi152.stdout:3/151: write d0/d10/d13/f1a [117657,97973] 0 2024-04-06T12:23:42.741 INFO:tasks.workunit.client.0.smithi152.stdout:3/152: write d0/fb [2514222,16915] 0 2024-04-06T12:23:42.742 INFO:tasks.workunit.client.0.smithi152.stdout:3/153: chown d0/d10/d1e/l20 4291 1 2024-04-06T12:23:42.744 INFO:tasks.workunit.client.0.smithi152.stdout:8/106: link d4/dc/d10/d18/c1c d4/db/c20 0 2024-04-06T12:23:42.745 INFO:tasks.workunit.client.0.smithi152.stdout:8/107: chown d4/db/f16 1 1 2024-04-06T12:23:42.745 INFO:tasks.workunit.client.0.smithi152.stdout:7/63: fsync d8/df/f11 0 2024-04-06T12:23:42.746 INFO:tasks.workunit.client.0.smithi152.stdout:5/116: link d3/da/l19 d3/da/l25 0 2024-04-06T12:23:42.753 INFO:tasks.workunit.client.0.smithi152.stdout:3/154: symlink d0/d1f/l33 0 2024-04-06T12:23:42.757 INFO:tasks.workunit.client.0.smithi152.stdout:7/64: mkdir d8/dc/d17 0 2024-04-06T12:23:42.759 INFO:tasks.workunit.client.0.smithi152.stdout:3/155: dwrite d0/d10/d13/f17 [0,4194304] 0 2024-04-06T12:23:42.764 INFO:tasks.workunit.client.0.smithi152.stdout:3/156: symlink d0/d1f/l34 0 2024-04-06T12:23:42.766 INFO:tasks.workunit.client.0.smithi152.stdout:5/117: dwrite d3/da/fc [0,4194304] 0 2024-04-06T12:23:42.767 INFO:tasks.workunit.client.0.smithi152.stdout:8/108: link d4/f8 d4/dc/d10/d15/f21 0 2024-04-06T12:23:42.768 INFO:tasks.workunit.client.0.smithi152.stdout:2/170: sync 2024-04-06T12:23:42.768 INFO:tasks.workunit.client.0.smithi152.stdout:8/109: dread - d4/db/f13 zero size 2024-04-06T12:23:42.774 INFO:tasks.workunit.client.0.smithi152.stdout:7/65: creat d8/f18 x:0 0 0 2024-04-06T12:23:42.776 INFO:tasks.workunit.client.0.smithi152.stdout:8/110: creat d4/db/f22 x:0 0 0 2024-04-06T12:23:42.777 INFO:tasks.workunit.client.0.smithi152.stdout:8/111: dread - d4/db/f16 zero size 2024-04-06T12:23:42.777 INFO:tasks.workunit.client.0.smithi152.stdout:3/157: mkdir d0/d35 0 2024-04-06T12:23:42.778 INFO:tasks.workunit.client.0.smithi152.stdout:8/112: chown d4/db/f16 2155042 1 2024-04-06T12:23:42.780 INFO:tasks.workunit.client.0.smithi152.stdout:7/66: readlink d8/la 0 2024-04-06T12:23:42.780 INFO:tasks.workunit.client.0.smithi152.stdout:7/67: chown d8/df/c15 122 1 2024-04-06T12:23:42.781 INFO:tasks.workunit.client.0.smithi152.stdout:2/171: symlink d0/d2/d5/d27/d28/l3b 0 2024-04-06T12:23:42.782 INFO:tasks.workunit.client.0.smithi152.stdout:8/113: dread d4/dc/f19 [0,4194304] 0 2024-04-06T12:23:42.783 INFO:tasks.workunit.client.0.smithi152.stdout:8/114: stat d4/dc/d10/l17 0 2024-04-06T12:23:42.784 INFO:tasks.workunit.client.0.smithi152.stdout:8/115: dread - d4/db/f13 zero size 2024-04-06T12:23:42.786 INFO:tasks.workunit.client.0.smithi152.stdout:2/172: dread d0/f3 [0,4194304] 0 2024-04-06T12:23:42.788 INFO:tasks.workunit.client.0.smithi152.stdout:5/118: write d3/f5 [1306612,26708] 0 2024-04-06T12:23:42.790 INFO:tasks.workunit.client.0.smithi152.stdout:5/119: dread - d3/f1f zero size 2024-04-06T12:23:42.790 INFO:tasks.workunit.client.0.smithi152.stdout:5/120: write d3/de/f22 [177530,75753] 0 2024-04-06T12:23:42.791 INFO:tasks.workunit.client.0.smithi152.stdout:7/68: getdents d8/df 0 2024-04-06T12:23:42.797 INFO:tasks.workunit.client.0.smithi152.stdout:5/121: symlink d3/de/l26 0 2024-04-06T12:23:42.797 INFO:tasks.workunit.client.0.smithi152.stdout:8/116: write d4/f8 [4261094,51060] 0 2024-04-06T12:23:42.799 INFO:tasks.workunit.client.0.smithi152.stdout:2/173: dread d0/d2/d5/f1f [0,4194304] 0 2024-04-06T12:23:42.800 INFO:tasks.workunit.client.0.smithi152.stdout:5/122: creat d3/d9/f27 x:0 0 0 2024-04-06T12:23:42.800 INFO:tasks.workunit.client.0.smithi152.stdout:7/69: dread d8/fb [0,4194304] 0 2024-04-06T12:23:42.802 INFO:tasks.workunit.client.0.smithi152.stdout:5/123: write d3/d9/f27 [464318,3663] 0 2024-04-06T12:23:42.802 INFO:tasks.workunit.client.0.smithi152.stdout:8/117: creat d4/dc/d10/d15/f23 x:0 0 0 2024-04-06T12:23:42.802 INFO:tasks.workunit.client.0.smithi152.stdout:7/70: chown d8/dc/ld 3869 1 2024-04-06T12:23:42.802 INFO:tasks.workunit.client.0.smithi152.stdout:2/174: fsync d0/f13 0 2024-04-06T12:23:42.806 INFO:tasks.workunit.client.0.smithi152.stdout:2/175: mknod d0/d2/d5/d27/c3c 0 2024-04-06T12:23:42.808 INFO:tasks.workunit.client.0.smithi152.stdout:5/124: rename d3/da/l1e to d3/da/l28 0 2024-04-06T12:23:42.815 INFO:tasks.workunit.client.0.smithi152.stdout:2/176: dwrite d0/d2/d5/f20 [0,4194304] 0 2024-04-06T12:23:42.819 INFO:tasks.workunit.client.0.smithi152.stdout:5/125: dread d3/da/fc [0,4194304] 0 2024-04-06T12:23:42.820 INFO:tasks.workunit.client.0.smithi152.stdout:8/118: dwrite f0 [0,4194304] 0 2024-04-06T12:23:42.827 INFO:tasks.workunit.client.0.smithi152.stdout:8/119: chown d4/dc/d10/d18/c1c 6624 1 2024-04-06T12:23:42.827 INFO:tasks.workunit.client.0.smithi152.stdout:5/126: dread d3/f5 [0,4194304] 0 2024-04-06T12:23:42.829 INFO:tasks.workunit.client.0.smithi152.stdout:2/177: write d0/fd [3225019,76803] 0 2024-04-06T12:23:42.831 INFO:tasks.workunit.client.0.smithi152.stdout:5/127: rename d3/f5 to d3/da/f29 0 2024-04-06T12:23:42.832 INFO:tasks.workunit.client.0.smithi152.stdout:5/128: readlink d3/de/l26 0 2024-04-06T12:23:42.832 INFO:tasks.workunit.client.0.smithi152.stdout:8/120: mknod d4/dc/d10/c24 0 2024-04-06T12:23:42.833 INFO:tasks.workunit.client.0.smithi152.stdout:5/129: write d3/f7 [3206844,127301] 0 2024-04-06T12:23:42.833 INFO:tasks.workunit.client.0.smithi152.stdout:8/121: truncate d4/db/f13 216624 0 2024-04-06T12:23:42.834 INFO:tasks.workunit.client.0.smithi152.stdout:5/130: read - d3/da/d15/f1c zero size 2024-04-06T12:23:42.835 INFO:tasks.workunit.client.0.smithi152.stdout:2/178: rename d0/d2/d5/d10 to d0/d15/d24/d3d 0 2024-04-06T12:23:42.835 INFO:tasks.workunit.client.0.smithi152.stdout:5/131: write d3/da/f24 [83276,76027] 0 2024-04-06T12:23:42.839 INFO:tasks.workunit.client.0.smithi152.stdout:5/132: read d3/da/f24 [88614,111516] 0 2024-04-06T12:23:42.840 INFO:tasks.workunit.client.0.smithi152.stdout:2/179: dread d0/d2/d5/f23 [0,4194304] 0 2024-04-06T12:23:42.847 INFO:tasks.workunit.client.0.smithi152.stdout:8/122: rmdir d4/d1e 0 2024-04-06T12:23:42.849 INFO:tasks.workunit.client.0.smithi152.stdout:2/180: mknod d0/d2/d5/d3a/c3e 0 2024-04-06T12:23:42.849 INFO:tasks.workunit.client.0.smithi152.stdout:2/181: readlink d0/d15/d24/l31 0 2024-04-06T12:23:42.850 INFO:tasks.workunit.client.0.smithi152.stdout:8/123: fsync d4/dc/fd 0 2024-04-06T12:23:42.851 INFO:tasks.workunit.client.0.smithi152.stdout:2/182: creat d0/d25/f3f x:0 0 0 2024-04-06T12:23:42.852 INFO:tasks.workunit.client.0.smithi152.stdout:8/124: creat d4/dc/f25 x:0 0 0 2024-04-06T12:23:42.853 INFO:tasks.workunit.client.0.smithi152.stdout:8/125: write d4/db/f13 [190672,84131] 0 2024-04-06T12:23:42.856 INFO:tasks.workunit.client.0.smithi152.stdout:8/126: chown d4/dc/d10/d15/l1b 21 1 2024-04-06T12:23:42.859 INFO:tasks.workunit.client.0.smithi152.stdout:8/127: creat d4/dc/d10/d18/f26 x:0 0 0 2024-04-06T12:23:42.861 INFO:tasks.workunit.client.0.smithi152.stdout:2/183: dwrite d0/d25/d26/f2b [0,4194304] 0 2024-04-06T12:23:42.861 INFO:tasks.workunit.client.0.smithi152.stdout:8/128: stat d4/dc/d10/d15/f23 0 2024-04-06T12:23:42.861 INFO:tasks.workunit.client.0.smithi152.stdout:2/184: readlink d0/l8 0 2024-04-06T12:23:42.862 INFO:tasks.workunit.client.0.smithi152.stdout:2/185: chown d0/d25/f3f 1169593 1 2024-04-06T12:23:42.869 INFO:tasks.workunit.client.0.smithi152.stdout:8/129: dwrite d4/dc/f19 [0,4194304] 0 2024-04-06T12:23:42.871 INFO:tasks.workunit.client.0.smithi152.stdout:8/130: write d4/dc/f1f [724170,76948] 0 2024-04-06T12:23:42.873 INFO:tasks.workunit.client.0.smithi152.stdout:2/186: dwrite d0/d2/f2c [0,4194304] 0 2024-04-06T12:23:42.886 INFO:tasks.workunit.client.0.smithi152.stdout:8/131: dwrite d4/db/f22 [0,4194304] 0 2024-04-06T12:23:42.886 INFO:tasks.workunit.client.0.smithi152.stdout:2/187: dwrite d0/d25/f39 [0,4194304] 0 2024-04-06T12:23:42.893 INFO:tasks.workunit.client.0.smithi152.stdout:2/188: fdatasync d0/fd 0 2024-04-06T12:23:42.894 INFO:tasks.workunit.client.0.smithi152.stdout:2/189: readlink d0/d15/d24/d3d/l1e 0 2024-04-06T12:23:42.896 INFO:tasks.workunit.client.0.smithi152.stdout:8/132: link f0 d4/db/f27 0 2024-04-06T12:23:42.899 INFO:tasks.workunit.client.0.smithi152.stdout:8/133: fdatasync d4/db/f27 0 2024-04-06T12:23:42.900 INFO:tasks.workunit.client.0.smithi152.stdout:8/134: write d4/db/f27 [2166422,26169] 0 2024-04-06T12:23:42.904 INFO:tasks.workunit.client.0.smithi152.stdout:2/190: rename d0/d25 to d0/d40 0 2024-04-06T12:23:42.905 INFO:tasks.workunit.client.0.smithi152.stdout:8/135: mkdir d4/d28 0 2024-04-06T12:23:42.909 INFO:tasks.workunit.client.0.smithi152.stdout:2/191: dread d0/d2/d5/f20 [0,4194304] 0 2024-04-06T12:23:42.909 INFO:tasks.workunit.client.0.smithi152.stdout:8/136: mknod d4/dc/d10/d15/c29 0 2024-04-06T12:23:42.913 INFO:tasks.workunit.client.0.smithi152.stdout:8/137: mkdir d4/db/d2a 0 2024-04-06T12:23:42.914 INFO:tasks.workunit.client.0.smithi152.stdout:2/192: truncate d0/d2/d5/f23 4260998 0 2024-04-06T12:23:42.915 INFO:tasks.workunit.client.0.smithi152.stdout:2/193: read d0/f13 [597065,65896] 0 2024-04-06T12:23:42.916 INFO:tasks.workunit.client.0.smithi152.stdout:2/194: chown d0/d2/d5/d27 142620 1 2024-04-06T12:23:42.920 INFO:tasks.workunit.client.0.smithi152.stdout:2/195: rename d0/d2/d5/d27 to d0/d40/d41 0 2024-04-06T12:23:42.921 INFO:tasks.workunit.client.0.smithi152.stdout:8/138: mkdir d4/d28/d2b 0 2024-04-06T12:23:42.921 INFO:tasks.workunit.client.0.smithi152.stdout:8/139: readlink d4/dc/d10/d15/l1a 0 2024-04-06T12:23:42.925 INFO:tasks.workunit.client.0.smithi152.stdout:2/196: rename d0/d2/d5/f20 to d0/d2/d5/f42 0 2024-04-06T12:23:42.926 INFO:tasks.workunit.client.0.smithi152.stdout:2/197: chown d0/d2 9016 1 2024-04-06T12:23:42.933 INFO:tasks.workunit.client.0.smithi152.stdout:2/198: creat d0/f43 x:0 0 0 2024-04-06T12:23:42.934 INFO:tasks.workunit.client.0.smithi152.stdout:8/140: rename d4/d28 to d4/d2c 0 2024-04-06T12:23:42.938 INFO:tasks.workunit.client.0.smithi152.stdout:2/199: unlink d0/d40/d41/d28/l3b 0 2024-04-06T12:23:42.940 INFO:tasks.workunit.client.0.smithi152.stdout:8/141: dwrite f3 [0,4194304] 0 2024-04-06T12:23:42.950 INFO:tasks.workunit.client.0.smithi152.stdout:8/142: creat d4/dc/d10/f2d x:0 0 0 2024-04-06T12:23:42.952 INFO:tasks.workunit.client.0.smithi152.stdout:8/143: truncate d4/db/f16 584435 0 2024-04-06T12:23:42.952 INFO:tasks.workunit.client.0.smithi152.stdout:8/144: fsync d4/dc/f25 0 2024-04-06T12:23:42.953 INFO:tasks.workunit.client.0.smithi152.stdout:8/145: chown d4/db/d2a 19521 1 2024-04-06T12:23:42.954 INFO:tasks.workunit.client.0.smithi152.stdout:8/146: truncate d4/dc/d10/d15/f23 507798 0 2024-04-06T12:23:42.957 INFO:tasks.workunit.client.0.smithi152.stdout:8/147: mknod d4/dc/c2e 0 2024-04-06T12:23:42.958 INFO:tasks.workunit.client.0.smithi152.stdout:8/148: chown d4/dc/d10/d15/l1b 13 1 2024-04-06T12:23:42.958 INFO:tasks.workunit.client.0.smithi152.stdout:8/149: read - d4/dc/d10/f2d zero size 2024-04-06T12:23:42.960 INFO:tasks.workunit.client.0.smithi152.stdout:8/150: truncate d4/dc/d10/f2d 637853 0 2024-04-06T12:23:42.960 INFO:tasks.workunit.client.0.smithi152.stdout:8/151: read d4/dc/f19 [2219758,113196] 0 2024-04-06T12:23:42.961 INFO:tasks.workunit.client.0.smithi152.stdout:8/152: fsync d4/dc/f1f 0 2024-04-06T12:23:42.967 INFO:tasks.workunit.client.0.smithi152.stdout:8/153: unlink d4/dc/d10/c24 0 2024-04-06T12:23:42.968 INFO:tasks.workunit.client.0.smithi152.stdout:2/200: dwrite d0/fd [0,4194304] 0 2024-04-06T12:23:42.969 INFO:tasks.workunit.client.0.smithi152.stdout:6/136: sync 2024-04-06T12:23:42.970 INFO:tasks.workunit.client.0.smithi152.stdout:1/162: sync 2024-04-06T12:23:42.970 INFO:tasks.workunit.client.0.smithi152.stdout:0/173: sync 2024-04-06T12:23:42.972 INFO:tasks.workunit.client.0.smithi152.stdout:8/154: dread f0 [0,4194304] 0 2024-04-06T12:23:42.973 INFO:tasks.workunit.client.0.smithi152.stdout:2/201: symlink d0/d15/d24/d3d/l44 0 2024-04-06T12:23:42.975 INFO:tasks.workunit.client.0.smithi152.stdout:6/137: write d7/d9/f10 [1585801,74316] 0 2024-04-06T12:23:42.978 INFO:tasks.workunit.client.0.smithi152.stdout:0/174: write f1 [901719,44293] 0 2024-04-06T12:23:42.979 INFO:tasks.workunit.client.0.smithi152.stdout:0/175: chown d4/de/d28/c25 46913 1 2024-04-06T12:23:42.981 INFO:tasks.workunit.client.0.smithi152.stdout:2/202: dwrite d0/fd [0,4194304] 0 2024-04-06T12:23:42.986 INFO:tasks.workunit.client.0.smithi152.stdout:6/138: creat d7/d9/f2b x:0 0 0 2024-04-06T12:23:42.987 INFO:tasks.workunit.client.0.smithi152.stdout:6/139: write d7/fd [4110096,28103] 0 2024-04-06T12:23:42.988 INFO:tasks.workunit.client.0.smithi152.stdout:6/140: write d7/ff [618791,77195] 0 2024-04-06T12:23:42.989 INFO:tasks.workunit.client.0.smithi152.stdout:6/141: write d7/d9/f10 [431256,34411] 0 2024-04-06T12:23:42.992 INFO:tasks.workunit.client.0.smithi152.stdout:8/155: symlink d4/d2c/d2b/l2f 0 2024-04-06T12:23:42.994 INFO:tasks.workunit.client.0.smithi152.stdout:0/176: creat d4/d31/f3d x:0 0 0 2024-04-06T12:23:42.997 INFO:tasks.workunit.client.0.smithi152.stdout:6/142: dread f6 [0,4194304] 0 2024-04-06T12:23:42.998 INFO:tasks.workunit.client.0.smithi152.stdout:8/156: dread f0 [0,4194304] 0 2024-04-06T12:23:42.998 INFO:tasks.workunit.client.0.smithi152.stdout:2/203: write d0/d2/d5/f42 [4561115,23697] 0 2024-04-06T12:23:43.000 INFO:tasks.workunit.client.0.smithi152.stdout:1/163: creat d2/d1d/f3e x:0 0 0 2024-04-06T12:23:43.004 INFO:tasks.workunit.client.0.smithi152.stdout:0/177: mknod d4/d31/c3e 0 2024-04-06T12:23:43.005 INFO:tasks.workunit.client.0.smithi152.stdout:6/143: symlink d7/d19/l2c 0 2024-04-06T12:23:43.007 INFO:tasks.workunit.client.0.smithi152.stdout:2/204: creat d0/d2/f45 x:0 0 0 2024-04-06T12:23:43.008 INFO:tasks.workunit.client.0.smithi152.stdout:2/205: fdatasync d0/d40/f39 0 2024-04-06T12:23:43.008 INFO:tasks.workunit.client.0.smithi152.stdout:0/178: dread f1 [0,4194304] 0 2024-04-06T12:23:43.009 INFO:tasks.workunit.client.0.smithi152.stdout:0/179: readlink d4/d31/l38 0 2024-04-06T12:23:43.023 INFO:tasks.workunit.client.0.smithi152.stdout:6/144: rmdir d7 39 2024-04-06T12:23:43.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:41.581200+0000 mgr.smithi195.ausetj (mgr.24375) 75 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 998 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2024-04-06T12:23:43.026 INFO:tasks.workunit.client.0.smithi152.stdout:1/164: rename d2/fe to d2/f3f 0 2024-04-06T12:23:43.031 INFO:tasks.workunit.client.0.smithi152.stdout:6/145: chown d7/fd 49 1 2024-04-06T12:23:43.032 INFO:tasks.workunit.client.0.smithi152.stdout:8/157: creat d4/dc/d10/f30 x:0 0 0 2024-04-06T12:23:43.035 INFO:tasks.workunit.client.0.smithi152.stdout:0/180: creat d4/d36/f3f x:0 0 0 2024-04-06T12:23:43.037 INFO:tasks.workunit.client.0.smithi152.stdout:6/146: write f6 [1410759,74083] 0 2024-04-06T12:23:43.038 INFO:tasks.workunit.client.0.smithi152.stdout:8/158: rename d4/dc/d10/d15/c29 to d4/dc/c31 0 2024-04-06T12:23:43.040 INFO:tasks.workunit.client.0.smithi152.stdout:6/147: dread f6 [4194304,4194304] 0 2024-04-06T12:23:43.043 INFO:tasks.workunit.client.0.smithi152.stdout:2/206: creat d0/d2/d5/f46 x:0 0 0 2024-04-06T12:23:43.045 INFO:tasks.workunit.client.0.smithi152.stdout:0/181: unlink d4/f17 0 2024-04-06T12:23:43.046 INFO:tasks.workunit.client.0.smithi152.stdout:0/182: chown d4/d31/f34 450 1 2024-04-06T12:23:43.046 INFO:tasks.workunit.client.0.smithi152.stdout:6/148: dwrite d7/d19/f23 [0,4194304] 0 2024-04-06T12:23:43.048 INFO:tasks.workunit.client.0.smithi152.stdout:0/183: dread d4/de/f11 [0,4194304] 0 2024-04-06T12:23:43.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:41.581200+0000 mgr.smithi195.ausetj (mgr.24375) 75 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 998 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2024-04-06T12:23:43.049 INFO:tasks.workunit.client.0.smithi152.stdout:8/159: mkdir d4/db/d32 0 2024-04-06T12:23:43.049 INFO:tasks.workunit.client.0.smithi152.stdout:0/184: readlink d4/de/l27 0 2024-04-06T12:23:43.130 INFO:tasks.workunit.client.0.smithi152.stdout:6/149: symlink d7/d9/l2d 0 2024-04-06T12:23:43.136 INFO:tasks.workunit.client.0.smithi152.stdout:0/185: truncate d4/de/d28/d18/f2c 391218 0 2024-04-06T12:23:43.137 INFO:tasks.workunit.client.0.smithi152.stdout:1/165: truncate d2/d1d/d21/d28/f3a 9744 0 2024-04-06T12:23:43.138 INFO:tasks.workunit.client.0.smithi152.stdout:0/186: fsync d4/f2b 0 2024-04-06T12:23:43.141 INFO:tasks.workunit.client.0.smithi152.stdout:8/160: creat d4/db/d32/f33 x:0 0 0 2024-04-06T12:23:43.142 INFO:tasks.workunit.client.0.smithi152.stdout:0/187: fdatasync d4/de/d28/d18/d3b/f2f 0 2024-04-06T12:23:43.143 INFO:tasks.workunit.client.0.smithi152.stdout:2/207: creat d0/f47 x:0 0 0 2024-04-06T12:23:43.148 INFO:tasks.workunit.client.0.smithi152.stdout:8/161: truncate d4/f8 2778406 0 2024-04-06T12:23:43.152 INFO:tasks.workunit.client.0.smithi152.stdout:6/150: getdents d7/d9 0 2024-04-06T12:23:43.158 INFO:tasks.workunit.client.0.smithi152.stdout:1/166: rename d2/d1d/d21/f26 to d2/d1d/d21/f40 0 2024-04-06T12:23:43.163 INFO:tasks.workunit.client.0.smithi152.stdout:8/162: dwrite d4/dc/d10/d18/f26 [0,4194304] 0 2024-04-06T12:23:43.167 INFO:tasks.workunit.client.0.smithi152.stdout:6/151: fsync d7/fb 0 2024-04-06T12:23:43.167 INFO:tasks.workunit.client.0.smithi152.stdout:8/163: dread - d4/db/d32/f33 zero size 2024-04-06T12:23:43.169 INFO:tasks.workunit.client.0.smithi152.stdout:8/164: chown d4/dc 3202 1 2024-04-06T12:23:43.177 INFO:tasks.workunit.client.0.smithi152.stdout:0/188: dwrite f1 [0,4194304] 0 2024-04-06T12:23:43.179 INFO:tasks.workunit.client.0.smithi152.stdout:0/189: readlink d4/de/d28/d18/l26 0 2024-04-06T12:23:43.183 INFO:tasks.workunit.client.0.smithi152.stdout:2/208: rename d0/d2/d5/c9 to d0/c48 0 2024-04-06T12:23:43.183 INFO:tasks.workunit.client.0.smithi152.stdout:8/165: rmdir d4/db/d32 39 2024-04-06T12:23:43.185 INFO:tasks.workunit.client.0.smithi152.stdout:1/167: dwrite d2/f20 [0,4194304] 0 2024-04-06T12:23:43.188 INFO:tasks.workunit.client.0.smithi152.stdout:1/168: chown d2/d1d/d21/d28/c29 2732164 1 2024-04-06T12:23:43.190 INFO:tasks.workunit.client.0.smithi152.stdout:0/190: creat d4/de/d28/f40 x:0 0 0 2024-04-06T12:23:43.192 INFO:tasks.workunit.client.0.smithi152.stdout:6/152: mkdir d7/d9/d26/d2e 0 2024-04-06T12:23:43.195 INFO:tasks.workunit.client.0.smithi152.stdout:0/191: creat d4/d19/f41 x:0 0 0 2024-04-06T12:23:43.195 INFO:tasks.workunit.client.0.smithi152.stdout:8/166: creat d4/dc/d10/d18/f34 x:0 0 0 2024-04-06T12:23:43.196 INFO:tasks.workunit.client.0.smithi152.stdout:0/192: write d4/de/d28/f40 [213344,124526] 0 2024-04-06T12:23:43.198 INFO:tasks.workunit.client.0.smithi152.stdout:4/95: sync 2024-04-06T12:23:43.198 INFO:tasks.workunit.client.0.smithi152.stdout:9/106: sync 2024-04-06T12:23:43.199 INFO:tasks.workunit.client.0.smithi152.stdout:2/209: mknod d0/d40/d26/c49 0 2024-04-06T12:23:43.201 INFO:tasks.workunit.client.0.smithi152.stdout:8/167: dread d4/db/f22 [0,4194304] 0 2024-04-06T12:23:43.202 INFO:tasks.workunit.client.0.smithi152.stdout:8/168: chown d4/db/f27 165 1 2024-04-06T12:23:43.204 INFO:tasks.workunit.client.0.smithi152.stdout:4/96: mkdir d7/d16 0 2024-04-06T12:23:43.205 INFO:tasks.workunit.client.0.smithi152.stdout:9/107: mknod d5/d6/d15/d17/c26 0 2024-04-06T12:23:43.206 INFO:tasks.workunit.client.0.smithi152.stdout:6/153: symlink d7/l2f 0 2024-04-06T12:23:43.206 INFO:tasks.workunit.client.0.smithi152.stdout:9/108: write d5/d6/f14 [2031870,18420] 0 2024-04-06T12:23:43.210 INFO:tasks.workunit.client.0.smithi152.stdout:2/210: rename d0/c19 to d0/d2/c4a 0 2024-04-06T12:23:43.210 INFO:tasks.workunit.client.0.smithi152.stdout:8/169: creat d4/f35 x:0 0 0 2024-04-06T12:23:43.218 INFO:tasks.workunit.client.0.smithi152.stdout:9/109: truncate d5/fb 1220834 0 2024-04-06T12:23:43.220 INFO:tasks.workunit.client.0.smithi152.stdout:8/170: dwrite d4/db/f16 [0,4194304] 0 2024-04-06T12:23:43.222 INFO:tasks.workunit.client.0.smithi152.stdout:9/110: read d5/d6/f14 [931292,42047] 0 2024-04-06T12:23:43.229 INFO:tasks.workunit.client.0.smithi152.stdout:0/193: dwrite d4/de/d28/d18/f2c [0,4194304] 0 2024-04-06T12:23:43.230 INFO:tasks.workunit.client.0.smithi152.stdout:6/154: link d7/ff d7/d19/f30 0 2024-04-06T12:23:43.233 INFO:tasks.workunit.client.0.smithi152.stdout:4/97: truncate f1 2830699 0 2024-04-06T12:23:43.237 INFO:tasks.workunit.client.0.smithi152.stdout:8/171: creat d4/f36 x:0 0 0 2024-04-06T12:23:43.240 INFO:tasks.workunit.client.0.smithi152.stdout:9/111: symlink d5/d6/d15/d17/l27 0 2024-04-06T12:23:43.241 INFO:tasks.workunit.client.0.smithi152.stdout:2/211: creat d0/f4b x:0 0 0 2024-04-06T12:23:43.242 INFO:tasks.workunit.client.0.smithi152.stdout:6/155: dwrite d7/d19/f15 [4194304,4194304] 0 2024-04-06T12:23:43.249 INFO:tasks.workunit.client.0.smithi152.stdout:4/98: creat d7/f17 x:0 0 0 2024-04-06T12:23:43.253 INFO:tasks.workunit.client.0.smithi152.stdout:2/212: dread d0/fd [0,4194304] 0 2024-04-06T12:23:43.255 INFO:tasks.workunit.client.0.smithi152.stdout:2/213: readlink d0/l17 0 2024-04-06T12:23:43.256 INFO:tasks.workunit.client.0.smithi152.stdout:6/156: mkdir d7/d19/d1b/d31 0 2024-04-06T12:23:43.259 INFO:tasks.workunit.client.0.smithi152.stdout:4/99: dwrite d7/f17 [0,4194304] 0 2024-04-06T12:23:43.269 INFO:tasks.workunit.client.0.smithi152.stdout:9/112: dwrite d5/d6/fd [0,4194304] 0 2024-04-06T12:23:43.273 INFO:tasks.workunit.client.0.smithi152.stdout:2/214: mknod d0/d40/d26/c4c 0 2024-04-06T12:23:43.277 INFO:tasks.workunit.client.0.smithi152.stdout:4/100: readlink d7/lf 0 2024-04-06T12:23:43.281 INFO:tasks.workunit.client.0.smithi152.stdout:8/172: dwrite d4/dc/d10/d15/f21 [0,4194304] 0 2024-04-06T12:23:43.282 INFO:tasks.workunit.client.0.smithi152.stdout:9/113: creat d5/d6/f28 x:0 0 0 2024-04-06T12:23:43.283 INFO:tasks.workunit.client.0.smithi152.stdout:8/173: write d4/dc/d10/f2d [384887,36594] 0 2024-04-06T12:23:43.284 INFO:tasks.workunit.client.0.smithi152.stdout:2/215: truncate d0/fd 1865740 0 2024-04-06T12:23:43.284 INFO:tasks.workunit.client.0.smithi152.stdout:6/157: write d7/d19/f1c [2170576,88102] 0 2024-04-06T12:23:43.289 INFO:tasks.workunit.client.0.smithi152.stdout:9/114: symlink d5/d6/d15/d17/d23/l29 0 2024-04-06T12:23:43.291 INFO:tasks.workunit.client.0.smithi152.stdout:4/101: mknod d7/d16/c18 0 2024-04-06T12:23:43.292 INFO:tasks.workunit.client.0.smithi152.stdout:9/115: mknod d5/d6/c2a 0 2024-04-06T12:23:43.293 INFO:tasks.workunit.client.0.smithi152.stdout:6/158: creat d7/d19/d1b/d20/f32 x:0 0 0 2024-04-06T12:23:43.294 INFO:tasks.workunit.client.0.smithi152.stdout:6/159: chown d7/d9 5290 1 2024-04-06T12:23:43.351 INFO:tasks.workunit.client.0.smithi152.stdout:4/102: rename d7/d16/c18 to d7/c19 0 2024-04-06T12:23:43.352 INFO:tasks.workunit.client.0.smithi152.stdout:9/116: truncate d5/f1d 746279 0 2024-04-06T12:23:43.353 INFO:tasks.workunit.client.0.smithi152.stdout:9/117: chown d5/d6/d15/d17/l27 0 1 2024-04-06T12:23:43.356 INFO:tasks.workunit.client.0.smithi152.stdout:4/103: dread f5 [0,4194304] 0 2024-04-06T12:23:43.356 INFO:tasks.workunit.client.0.smithi152.stdout:6/160: creat d7/d19/f33 x:0 0 0 2024-04-06T12:23:43.359 INFO:tasks.workunit.client.0.smithi152.stdout:4/104: dread d7/f17 [0,4194304] 0 2024-04-06T12:23:43.361 INFO:tasks.workunit.client.0.smithi152.stdout:9/118: mknod d5/d6/d15/d17/c2b 0 2024-04-06T12:23:43.361 INFO:tasks.workunit.client.0.smithi152.stdout:2/216: write d0/d2/f14 [490027,119763] 0 2024-04-06T12:23:43.364 INFO:tasks.workunit.client.0.smithi152.stdout:6/161: mknod d7/d9/d26/c34 0 2024-04-06T12:23:43.366 INFO:tasks.workunit.client.0.smithi152.stdout:6/162: write d7/d19/d1b/d22/f29 [702334,71627] 0 2024-04-06T12:23:43.371 INFO:tasks.workunit.client.0.smithi152.stdout:2/217: mkdir d0/d15/d4d 0 2024-04-06T12:23:43.382 INFO:tasks.workunit.client.0.smithi152.stdout:2/218: rename d0/f4b to d0/d15/d4d/f4e 0 2024-04-06T12:23:43.385 INFO:tasks.workunit.client.0.smithi152.stdout:6/163: mkdir d7/d19/d1b/d31/d35 0 2024-04-06T12:23:43.386 INFO:tasks.workunit.client.0.smithi152.stdout:4/105: write d7/fb [559652,40087] 0 2024-04-06T12:23:43.390 INFO:tasks.workunit.client.0.smithi152.stdout:2/219: chown d0/d2/d5/c1d 3 1 2024-04-06T12:23:43.393 INFO:tasks.workunit.client.0.smithi152.stdout:4/106: creat d7/d16/f1a x:0 0 0 2024-04-06T12:23:43.394 INFO:tasks.workunit.client.0.smithi152.stdout:4/107: chown d7 599 1 2024-04-06T12:23:43.395 INFO:tasks.workunit.client.0.smithi152.stdout:9/119: dwrite d5/f1d [0,4194304] 0 2024-04-06T12:23:43.396 INFO:tasks.workunit.client.0.smithi152.stdout:6/164: dwrite d7/f1e [0,4194304] 0 2024-04-06T12:23:43.399 INFO:tasks.workunit.client.0.smithi152.stdout:6/165: write f6 [2429628,46807] 0 2024-04-06T12:23:43.400 INFO:tasks.workunit.client.0.smithi152.stdout:2/220: rename d0/f3 to d0/d15/d24/d3d/f4f 0 2024-04-06T12:23:43.400 INFO:tasks.workunit.client.0.smithi152.stdout:6/166: chown d7/d9/d26 621971 1 2024-04-06T12:23:43.407 INFO:tasks.workunit.client.0.smithi152.stdout:4/108: dwrite d7/f12 [4194304,4194304] 0 2024-04-06T12:23:43.409 INFO:tasks.workunit.client.0.smithi152.stdout:2/221: rename d0/d2/d5/f46 to d0/d2/d5/f50 0 2024-04-06T12:23:43.410 INFO:tasks.workunit.client.0.smithi152.stdout:9/120: dread d5/d6/d15/d17/f19 [0,4194304] 0 2024-04-06T12:23:43.414 INFO:tasks.workunit.client.0.smithi152.stdout:2/222: creat d0/d40/f51 x:0 0 0 2024-04-06T12:23:43.414 INFO:tasks.workunit.client.0.smithi152.stdout:4/109: truncate d7/f17 921468 0 2024-04-06T12:23:43.415 INFO:tasks.workunit.client.0.smithi152.stdout:6/167: dwrite d7/d19/d1b/d1f/f2a [0,4194304] 0 2024-04-06T12:23:43.416 INFO:tasks.workunit.client.0.smithi152.stdout:9/121: creat d5/d6/f2c x:0 0 0 2024-04-06T12:23:43.426 INFO:tasks.workunit.client.0.smithi152.stdout:4/110: dwrite d7/d16/f1a [0,4194304] 0 2024-04-06T12:23:43.428 INFO:tasks.workunit.client.0.smithi152.stdout:9/122: mkdir d5/d6/d15/d17/d23/d2d 0 2024-04-06T12:23:43.428 INFO:tasks.workunit.client.0.smithi152.stdout:9/123: truncate d5/d6/f16 727904 0 2024-04-06T12:23:43.430 INFO:tasks.workunit.client.0.smithi152.stdout:2/223: rename d0/d2/d5/f23 to d0/d15/d4d/f52 0 2024-04-06T12:23:43.432 INFO:tasks.workunit.client.0.smithi152.stdout:2/224: write d0/d2/f45 [456699,49288] 0 2024-04-06T12:23:43.440 INFO:tasks.workunit.client.0.smithi152.stdout:9/124: mknod d5/d6/d15/d17/d23/c2e 0 2024-04-06T12:23:43.445 INFO:tasks.workunit.client.0.smithi152.stdout:6/168: dwrite d7/d19/f30 [0,4194304] 0 2024-04-06T12:23:43.450 INFO:tasks.workunit.client.0.smithi152.stdout:6/169: creat d7/d19/d1b/d31/f36 x:0 0 0 2024-04-06T12:23:43.450 INFO:tasks.workunit.client.0.smithi152.stdout:6/170: chown d7/c13 1356 1 2024-04-06T12:23:43.451 INFO:tasks.workunit.client.0.smithi152.stdout:9/125: link d5/l25 d5/d6/l2f 0 2024-04-06T12:23:43.451 INFO:tasks.workunit.client.0.smithi152.stdout:6/171: stat d7/c13 0 2024-04-06T12:23:43.452 INFO:tasks.workunit.client.0.smithi152.stdout:9/126: write d5/d6/f16 [1730998,118693] 0 2024-04-06T12:23:43.453 INFO:tasks.workunit.client.0.smithi152.stdout:9/127: stat c1 0 2024-04-06T12:23:43.454 INFO:tasks.workunit.client.0.smithi152.stdout:4/111: fdatasync d7/f17 0 2024-04-06T12:23:43.457 INFO:tasks.workunit.client.0.smithi152.stdout:6/172: creat d7/d19/d1b/d31/f37 x:0 0 0 2024-04-06T12:23:43.458 INFO:tasks.workunit.client.0.smithi152.stdout:9/128: mknod d5/d6/d15/c30 0 2024-04-06T12:23:43.459 INFO:tasks.workunit.client.0.smithi152.stdout:6/173: write d7/d19/f1c [3206481,130891] 0 2024-04-06T12:23:43.461 INFO:tasks.workunit.client.0.smithi152.stdout:9/129: read d5/d6/d15/d17/f19 [544163,102892] 0 2024-04-06T12:23:43.462 INFO:tasks.workunit.client.0.smithi152.stdout:9/130: truncate d5/d6/f24 563151 0 2024-04-06T12:23:43.464 INFO:tasks.workunit.client.0.smithi152.stdout:9/131: write d5/d6/fd [2649114,25523] 0 2024-04-06T12:23:43.469 INFO:tasks.workunit.client.0.smithi152.stdout:6/174: dwrite d7/d9/f17 [0,4194304] 0 2024-04-06T12:23:43.470 INFO:tasks.workunit.client.0.smithi152.stdout:4/112: truncate d7/f17 1928486 0 2024-04-06T12:23:43.476 INFO:tasks.workunit.client.0.smithi152.stdout:6/175: dread d7/f1e [0,4194304] 0 2024-04-06T12:23:43.478 INFO:tasks.workunit.client.0.smithi152.stdout:4/113: dwrite f5 [0,4194304] 0 2024-04-06T12:23:43.481 INFO:tasks.workunit.client.0.smithi152.stdout:4/114: symlink d7/l1b 0 2024-04-06T12:23:43.482 INFO:tasks.workunit.client.0.smithi152.stdout:6/176: creat d7/d19/d1b/f38 x:0 0 0 2024-04-06T12:23:43.484 INFO:tasks.workunit.client.0.smithi152.stdout:9/132: dwrite d5/f10 [0,4194304] 0 2024-04-06T12:23:43.486 INFO:tasks.workunit.client.0.smithi152.stdout:6/177: chown d7/d19/f23 13 1 2024-04-06T12:23:43.488 INFO:tasks.workunit.client.0.smithi152.stdout:4/115: mknod d7/c1c 0 2024-04-06T12:23:43.493 INFO:tasks.workunit.client.0.smithi152.stdout:9/133: dread d5/f10 [0,4194304] 0 2024-04-06T12:23:43.495 INFO:tasks.workunit.client.0.smithi152.stdout:6/178: creat d7/d9/d26/d2e/f39 x:0 0 0 2024-04-06T12:23:43.497 INFO:tasks.workunit.client.0.smithi152.stdout:4/116: truncate f1 3241438 0 2024-04-06T12:23:43.500 INFO:tasks.workunit.client.0.smithi152.stdout:4/117: write d7/f17 [2448277,129358] 0 2024-04-06T12:23:43.504 INFO:tasks.workunit.client.0.smithi152.stdout:9/134: dwrite d5/d6/f16 [0,4194304] 0 2024-04-06T12:23:43.504 INFO:tasks.workunit.client.0.smithi152.stdout:4/118: symlink d7/l1d 0 2024-04-06T12:23:43.507 INFO:tasks.workunit.client.0.smithi152.stdout:9/135: fsync d5/d6/f2c 0 2024-04-06T12:23:43.507 INFO:tasks.workunit.client.0.smithi152.stdout:6/179: dwrite d7/d9/d26/d2e/f39 [0,4194304] 0 2024-04-06T12:23:43.509 INFO:tasks.workunit.client.0.smithi152.stdout:9/136: chown d5/d6/d15/d17/d23 15 1 2024-04-06T12:23:43.511 INFO:tasks.workunit.client.0.smithi152.stdout:4/119: dread d7/d16/f1a [0,4194304] 0 2024-04-06T12:23:43.514 INFO:tasks.workunit.client.0.smithi152.stdout:6/180: creat d7/d9/d26/f3a x:0 0 0 2024-04-06T12:23:43.515 INFO:tasks.workunit.client.0.smithi152.stdout:4/120: mknod d7/c1e 0 2024-04-06T12:23:43.517 INFO:tasks.workunit.client.0.smithi152.stdout:4/121: chown d7/c19 6 1 2024-04-06T12:23:43.517 INFO:tasks.workunit.client.0.smithi152.stdout:7/71: sync 2024-04-06T12:23:43.517 INFO:tasks.workunit.client.0.smithi152.stdout:3/158: sync 2024-04-06T12:23:43.523 INFO:tasks.workunit.client.0.smithi152.stdout:4/122: rmdir d7/d16 39 2024-04-06T12:23:43.526 INFO:tasks.workunit.client.0.smithi152.stdout:7/72: rename d8/c12 to d8/df/c19 0 2024-04-06T12:23:43.528 INFO:tasks.workunit.client.0.smithi152.stdout:6/181: truncate f6 853219 0 2024-04-06T12:23:43.530 INFO:tasks.workunit.client.0.smithi152.stdout:4/123: symlink d7/l1f 0 2024-04-06T12:23:43.530 INFO:tasks.workunit.client.0.smithi152.stdout:3/159: write d0/ff [3582476,31060] 0 2024-04-06T12:23:43.533 INFO:tasks.workunit.client.0.smithi152.stdout:7/73: rename d8/f18 to d8/dc/d17/f1a 0 2024-04-06T12:23:43.536 INFO:tasks.workunit.client.0.smithi152.stdout:6/182: symlink d7/d19/d1b/l3b 0 2024-04-06T12:23:43.543 INFO:tasks.workunit.client.0.smithi152.stdout:6/183: dwrite d7/d9/d26/d2e/f39 [0,4194304] 0 2024-04-06T12:23:43.545 INFO:tasks.workunit.client.0.smithi152.stdout:4/124: creat d7/d16/f20 x:0 0 0 2024-04-06T12:23:43.546 INFO:tasks.workunit.client.0.smithi152.stdout:4/125: write f5 [2335751,14417] 0 2024-04-06T12:23:43.547 INFO:tasks.workunit.client.0.smithi152.stdout:4/126: chown d7/l13 2 1 2024-04-06T12:23:43.552 INFO:tasks.workunit.client.0.smithi152.stdout:7/74: creat d8/f1b x:0 0 0 2024-04-06T12:23:43.553 INFO:tasks.workunit.client.0.smithi152.stdout:7/75: stat d8/df/f11 0 2024-04-06T12:23:43.554 INFO:tasks.workunit.client.0.smithi152.stdout:6/184: link d7/d19/f23 d7/d19/d1b/d31/f3c 0 2024-04-06T12:23:43.556 INFO:tasks.workunit.client.0.smithi152.stdout:4/127: rmdir d7 39 2024-04-06T12:23:43.558 INFO:tasks.workunit.client.0.smithi152.stdout:6/185: dread f3 [0,4194304] 0 2024-04-06T12:23:43.560 INFO:tasks.workunit.client.0.smithi152.stdout:7/76: mkdir d8/d1c 0 2024-04-06T12:23:43.564 INFO:tasks.workunit.client.0.smithi152.stdout:7/77: symlink d8/dc/d17/l1d 0 2024-04-06T12:23:43.573 INFO:tasks.workunit.client.0.smithi152.stdout:4/128: dwrite d7/d16/f1a [0,4194304] 0 2024-04-06T12:23:43.575 INFO:tasks.workunit.client.0.smithi152.stdout:7/78: dwrite d8/dc/fe [0,4194304] 0 2024-04-06T12:23:43.575 INFO:tasks.workunit.client.0.smithi152.stdout:4/129: chown d7/fb 52 1 2024-04-06T12:23:43.580 INFO:tasks.workunit.client.0.smithi152.stdout:6/186: dread d7/fc [0,4194304] 0 2024-04-06T12:23:43.583 INFO:tasks.workunit.client.0.smithi152.stdout:6/187: mkdir d7/d19/d1b/d1f/d3d 0 2024-04-06T12:23:43.583 INFO:tasks.workunit.client.0.smithi152.stdout:6/188: chown d7/d19/f23 18608 1 2024-04-06T12:23:43.586 INFO:tasks.workunit.client.0.smithi152.stdout:6/189: mkdir d7/d19/d3e 0 2024-04-06T12:23:43.593 INFO:tasks.workunit.client.0.smithi152.stdout:6/190: dwrite d7/d9/f2b [0,4194304] 0 2024-04-06T12:23:43.596 INFO:tasks.workunit.client.0.smithi152.stdout:6/191: symlink d7/l3f 0 2024-04-06T12:23:43.600 INFO:tasks.workunit.client.0.smithi152.stdout:6/192: rmdir d7/d19/d1b/d1f 39 2024-04-06T12:23:43.606 INFO:tasks.workunit.client.0.smithi152.stdout:6/193: creat d7/d19/d3e/f40 x:0 0 0 2024-04-06T12:23:43.614 INFO:tasks.workunit.client.0.smithi152.stdout:6/194: dwrite d7/ff [0,4194304] 0 2024-04-06T12:23:43.622 INFO:tasks.workunit.client.0.smithi152.stdout:6/195: symlink d7/d19/d1b/d1f/d3d/l41 0 2024-04-06T12:23:43.622 INFO:tasks.workunit.client.0.smithi152.stdout:6/196: chown d7/d19/f33 113 1 2024-04-06T12:23:43.627 INFO:tasks.workunit.client.0.smithi152.stdout:6/197: link d7/f1e d7/d9/d26/d2e/f42 0 2024-04-06T12:23:43.628 INFO:tasks.workunit.client.0.smithi152.stdout:6/198: rmdir d7/d19/d1b/d1f 39 2024-04-06T12:23:43.630 INFO:tasks.workunit.client.0.smithi152.stdout:6/199: rmdir d7/d9 39 2024-04-06T12:23:43.632 INFO:tasks.workunit.client.0.smithi152.stdout:6/200: symlink d7/d19/l43 0 2024-04-06T12:23:43.634 INFO:tasks.workunit.client.0.smithi152.stdout:6/201: mknod d7/d19/d1b/d31/d35/c44 0 2024-04-06T12:23:43.732 INFO:tasks.workunit.client.0.smithi152.stdout:6/202: rename d7/d9/la to d7/d19/d1b/d1f/d3d/l45 0 2024-04-06T12:23:43.738 INFO:tasks.workunit.client.0.smithi152.stdout:6/203: dwrite d7/d19/f30 [0,4194304] 0 2024-04-06T12:23:43.742 INFO:tasks.workunit.client.0.smithi152.stdout:6/204: rename d7/d19/l2c to d7/d19/d1b/d22/l46 0 2024-04-06T12:23:43.743 INFO:tasks.workunit.client.0.smithi152.stdout:6/205: truncate d7/ff 4416897 0 2024-04-06T12:23:43.744 INFO:tasks.workunit.client.0.smithi152.stdout:6/206: write d7/d9/f2b [1932755,69505] 0 2024-04-06T12:23:43.747 INFO:tasks.workunit.client.0.smithi152.stdout:6/207: fsync d7/d19/d1b/d31/f36 0 2024-04-06T12:23:43.750 INFO:tasks.workunit.client.0.smithi152.stdout:6/208: symlink d7/d9/d26/d2e/l47 0 2024-04-06T12:23:43.753 INFO:tasks.workunit.client.0.smithi152.stdout:6/209: creat d7/d9/f48 x:0 0 0 2024-04-06T12:23:43.754 INFO:tasks.workunit.client.0.smithi152.stdout:6/210: write d7/d19/d1b/d22/f29 [768126,102972] 0 2024-04-06T12:23:43.755 INFO:tasks.workunit.client.0.smithi152.stdout:6/211: dread - d7/d9/d26/f3a zero size 2024-04-06T12:23:43.757 INFO:tasks.workunit.client.0.smithi152.stdout:6/212: truncate d7/d19/d1b/d20/f32 962450 0 2024-04-06T12:23:43.762 INFO:tasks.workunit.client.0.smithi152.stdout:6/213: symlink d7/d19/d1b/d22/l49 0 2024-04-06T12:23:43.762 INFO:tasks.workunit.client.0.smithi152.stdout:6/214: dread f6 [0,4194304] 0 2024-04-06T12:23:43.764 INFO:tasks.workunit.client.0.smithi152.stdout:6/215: rename d7/d19/d1b/d20 to d7/d9/d26/d4a 0 2024-04-06T12:23:43.766 INFO:tasks.workunit.client.0.smithi152.stdout:6/216: mknod d7/d19/d1b/d31/d35/c4b 0 2024-04-06T12:23:43.767 INFO:tasks.workunit.client.0.smithi152.stdout:6/217: read - d7/d19/d1b/f38 zero size 2024-04-06T12:23:43.767 INFO:tasks.workunit.client.0.smithi152.stdout:6/218: chown d7/fd 296 1 2024-04-06T12:23:43.769 INFO:tasks.workunit.client.0.smithi152.stdout:6/219: dread d7/d19/f1c [0,4194304] 0 2024-04-06T12:23:43.769 INFO:tasks.workunit.client.0.smithi152.stdout:6/220: chown c4 1 1 2024-04-06T12:23:43.776 INFO:tasks.workunit.client.0.smithi152.stdout:6/221: truncate d7/d19/d1b/d22/f29 341253 0 2024-04-06T12:23:43.779 INFO:tasks.workunit.client.0.smithi152.stdout:1/169: sync 2024-04-06T12:23:43.779 INFO:tasks.workunit.client.0.smithi152.stdout:5/133: sync 2024-04-06T12:23:43.780 INFO:tasks.workunit.client.0.smithi152.stdout:6/222: dread d7/d9/d26/d2e/f39 [0,4194304] 0 2024-04-06T12:23:43.785 INFO:tasks.workunit.client.0.smithi152.stdout:6/223: unlink d7/d9/f17 0 2024-04-06T12:23:43.786 INFO:tasks.workunit.client.0.smithi152.stdout:5/134: dwrite d3/f7 [0,4194304] 0 2024-04-06T12:23:43.789 INFO:tasks.workunit.client.0.smithi152.stdout:1/170: dwrite d2/f16 [0,4194304] 0 2024-04-06T12:23:43.790 INFO:tasks.workunit.client.0.smithi152.stdout:6/224: creat d7/d19/d1b/d1f/f4c x:0 0 0 2024-04-06T12:23:43.790 INFO:tasks.workunit.client.0.smithi152.stdout:6/225: readlink d7/d19/l16 0 2024-04-06T12:23:43.791 INFO:tasks.workunit.client.0.smithi152.stdout:5/135: creat d3/d9/f2a x:0 0 0 2024-04-06T12:23:43.797 INFO:tasks.workunit.client.0.smithi152.stdout:1/171: rmdir d2 39 2024-04-06T12:23:43.800 INFO:tasks.workunit.client.0.smithi152.stdout:5/136: dwrite d3/d9/f2a [0,4194304] 0 2024-04-06T12:23:43.806 INFO:tasks.workunit.client.0.smithi152.stdout:5/137: mkdir d3/da/d15/d2b 0 2024-04-06T12:23:43.806 INFO:tasks.workunit.client.0.smithi152.stdout:5/138: write d3/d9/f12 [1584659,31704] 0 2024-04-06T12:23:43.808 INFO:tasks.workunit.client.0.smithi152.stdout:1/172: mknod d2/d1d/c41 0 2024-04-06T12:23:43.818 INFO:tasks.workunit.client.0.smithi152.stdout:1/173: rename d2/f3f to d2/f42 0 2024-04-06T12:23:43.821 INFO:tasks.workunit.client.0.smithi152.stdout:6/226: dwrite d7/fc [0,4194304] 0 2024-04-06T12:23:43.821 INFO:tasks.workunit.client.0.smithi152.stdout:5/139: rmdir d3/d17 0 2024-04-06T12:23:43.826 INFO:tasks.workunit.client.0.smithi152.stdout:6/227: symlink d7/d9/d26/d4a/l4d 0 2024-04-06T12:23:43.828 INFO:tasks.workunit.client.0.smithi152.stdout:5/140: rename d3/l6 to d3/da/d15/l2c 0 2024-04-06T12:23:43.828 INFO:tasks.workunit.client.0.smithi152.stdout:6/228: rename d7/d19/d1b/d31 to d7/d19/d1b/d31/d4e 22 2024-04-06T12:23:43.829 INFO:tasks.workunit.client.0.smithi152.stdout:5/141: chown d3/da/c20 6821 1 2024-04-06T12:23:43.830 INFO:tasks.workunit.client.0.smithi152.stdout:1/174: mknod d2/d1d/c43 0 2024-04-06T12:23:43.831 INFO:tasks.workunit.client.0.smithi152.stdout:5/142: write d3/da/d15/f21 [500766,123988] 0 2024-04-06T12:23:43.832 INFO:tasks.workunit.client.0.smithi152.stdout:6/229: rename d7/d9/d26/d2e/f39 to d7/d19/d3e/f4f 0 2024-04-06T12:23:43.834 INFO:tasks.workunit.client.0.smithi152.stdout:5/143: dread d3/f16 [0,4194304] 0 2024-04-06T12:23:43.834 INFO:tasks.workunit.client.0.smithi152.stdout:6/230: write d7/d19/f33 [1043985,78876] 0 2024-04-06T12:23:43.837 INFO:tasks.workunit.client.0.smithi152.stdout:6/231: dread d7/d19/f1c [0,4194304] 0 2024-04-06T12:23:43.839 INFO:tasks.workunit.client.0.smithi152.stdout:6/232: truncate d7/d9/f2b 4885550 0 2024-04-06T12:23:43.839 INFO:tasks.workunit.client.0.smithi152.stdout:5/144: write d3/d9/f12 [1545508,126426] 0 2024-04-06T12:23:43.840 INFO:tasks.workunit.client.0.smithi152.stdout:1/175: getdents d2/d2f 0 2024-04-06T12:23:43.841 INFO:tasks.workunit.client.0.smithi152.stdout:5/145: truncate d3/da/d15/f1c 272647 0 2024-04-06T12:23:43.842 INFO:tasks.workunit.client.0.smithi152.stdout:6/233: symlink d7/d19/d1b/d31/l50 0 2024-04-06T12:23:43.843 INFO:tasks.workunit.client.0.smithi152.stdout:6/234: truncate d7/d19/f33 1161906 0 2024-04-06T12:23:43.844 INFO:tasks.workunit.client.0.smithi152.stdout:6/235: rename d7/d19/d1b/d31/d35 to d7/d19/d1b/d31/d35/d51 22 2024-04-06T12:23:43.845 INFO:tasks.workunit.client.0.smithi152.stdout:6/236: chown d7/l3f 12 1 2024-04-06T12:23:43.846 INFO:tasks.workunit.client.0.smithi152.stdout:1/176: creat d2/d2f/d37/f44 x:0 0 0 2024-04-06T12:23:43.848 INFO:tasks.workunit.client.0.smithi152.stdout:5/146: rename d3/da/l28 to d3/da/l2d 0 2024-04-06T12:23:43.854 INFO:tasks.workunit.client.0.smithi152.stdout:6/237: dwrite d7/fc [0,4194304] 0 2024-04-06T12:23:43.856 INFO:tasks.workunit.client.0.smithi152.stdout:1/177: dwrite d2/d2f/d37/f44 [0,4194304] 0 2024-04-06T12:23:43.861 INFO:tasks.workunit.client.0.smithi152.stdout:6/238: creat d7/d9/d26/f52 x:0 0 0 2024-04-06T12:23:43.866 INFO:tasks.workunit.client.0.smithi152.stdout:1/178: dwrite d2/d1d/f2d [0,4194304] 0 2024-04-06T12:23:43.876 INFO:tasks.workunit.client.0.smithi152.stdout:5/147: dwrite d3/da/f24 [0,4194304] 0 2024-04-06T12:23:43.880 INFO:tasks.workunit.client.0.smithi152.stdout:5/148: creat d3/de/f2e x:0 0 0 2024-04-06T12:23:43.883 INFO:tasks.workunit.client.0.smithi152.stdout:1/179: write d2/f10 [86161,3008] 0 2024-04-06T12:23:43.888 INFO:tasks.workunit.client.0.smithi152.stdout:5/149: getdents d3/da 0 2024-04-06T12:23:43.890 INFO:tasks.workunit.client.0.smithi152.stdout:1/180: dread d2/f11 [0,4194304] 0 2024-04-06T12:23:43.898 INFO:tasks.workunit.client.0.smithi152.stdout:5/150: truncate d3/d9/fb 1155541 0 2024-04-06T12:23:43.899 INFO:tasks.workunit.client.0.smithi152.stdout:5/151: chown d3/d9/f12 5217711 1 2024-04-06T12:23:43.902 INFO:tasks.workunit.client.0.smithi152.stdout:1/181: dread d2/d1d/d21/f40 [0,4194304] 0 2024-04-06T12:23:43.908 INFO:tasks.workunit.client.0.smithi152.stdout:1/182: dwrite d2/d1d/d21/d28/f30 [0,4194304] 0 2024-04-06T12:23:43.911 INFO:tasks.workunit.client.0.smithi152.stdout:1/183: mkdir d2/d2f/d45 0 2024-04-06T12:23:43.913 INFO:tasks.workunit.client.0.smithi152.stdout:1/184: mknod d2/d1d/d21/d28/c46 0 2024-04-06T12:23:43.920 INFO:tasks.workunit.client.0.smithi152.stdout:1/185: dwrite d2/f13 [0,4194304] 0 2024-04-06T12:23:43.927 INFO:tasks.workunit.client.0.smithi152.stdout:1/186: dwrite d2/f11 [0,4194304] 0 2024-04-06T12:23:43.928 INFO:tasks.workunit.client.0.smithi152.stdout:1/187: chown d2/d1d/d21/d28/l2c 0 1 2024-04-06T12:23:43.937 INFO:tasks.workunit.client.0.smithi152.stdout:1/188: fdatasync d2/d1d/d21/d28/f3a 0 2024-04-06T12:23:43.943 INFO:tasks.workunit.client.0.smithi152.stdout:1/189: creat d2/f47 x:0 0 0 2024-04-06T12:23:43.948 INFO:tasks.workunit.client.0.smithi152.stdout:1/190: mkdir d2/d1d/d48 0 2024-04-06T12:23:43.958 INFO:tasks.workunit.client.0.smithi152.stdout:1/191: dread d2/f10 [0,4194304] 0 2024-04-06T12:23:43.962 INFO:tasks.workunit.client.0.smithi152.stdout:1/192: dread d2/f16 [0,4194304] 0 2024-04-06T12:23:43.999 INFO:tasks.workunit.client.0.smithi152.stdout:9/137: sync 2024-04-06T12:23:43.999 INFO:tasks.workunit.client.0.smithi152.stdout:0/194: sync 2024-04-06T12:23:43.999 INFO:tasks.workunit.client.0.smithi152.stdout:2/225: sync 2024-04-06T12:23:43.999 INFO:tasks.workunit.client.0.smithi152.stdout:8/174: sync 2024-04-06T12:23:44.000 INFO:tasks.workunit.client.0.smithi152.stdout:0/195: chown d4/de/d28/f22 92 1 2024-04-06T12:23:44.000 INFO:tasks.workunit.client.0.smithi152.stdout:8/175: truncate d4/dc/f25 1046811 0 2024-04-06T12:23:44.001 INFO:tasks.workunit.client.0.smithi152.stdout:0/196: read - d4/d36/f3f zero size 2024-04-06T12:23:44.005 INFO:tasks.workunit.client.0.smithi152.stdout:0/197: unlink d4/de/d2a/l3c 0 2024-04-06T12:23:44.006 INFO:tasks.workunit.client.0.smithi152.stdout:8/176: symlink d4/db/d2a/l37 0 2024-04-06T12:23:44.007 INFO:tasks.workunit.client.0.smithi152.stdout:8/177: readlink d4/d2c/d2b/l2f 0 2024-04-06T12:23:44.008 INFO:tasks.workunit.client.0.smithi152.stdout:2/226: getdents d0 0 2024-04-06T12:23:44.008 INFO:tasks.workunit.client.0.smithi152.stdout:0/198: creat d4/de/d28/d18/d3b/f42 x:0 0 0 2024-04-06T12:23:44.010 INFO:tasks.workunit.client.0.smithi152.stdout:2/227: fdatasync d0/f1c 0 2024-04-06T12:23:44.011 INFO:tasks.workunit.client.0.smithi152.stdout:2/228: stat d0/d40/d26/c38 0 2024-04-06T12:23:44.012 INFO:tasks.workunit.client.0.smithi152.stdout:0/199: mkdir d4/de/d28/d18/d43 0 2024-04-06T12:23:44.012 INFO:tasks.workunit.client.0.smithi152.stdout:0/200: write d4/d19/f41 [396371,20008] 0 2024-04-06T12:23:44.014 INFO:tasks.workunit.client.0.smithi152.stdout:2/229: unlink d0/d40/d26/c49 0 2024-04-06T12:23:44.015 INFO:tasks.workunit.client.0.smithi152.stdout:2/230: read - d0/f43 zero size 2024-04-06T12:23:44.018 INFO:tasks.workunit.client.0.smithi152.stdout:0/201: rename d4/c9 to d4/de/d2a/d33/c44 0 2024-04-06T12:23:44.022 INFO:tasks.workunit.client.0.smithi152.stdout:2/231: dwrite d0/d40/d26/f2a [0,4194304] 0 2024-04-06T12:23:44.033 INFO:tasks.workunit.client.0.smithi152.stdout:2/232: mknod d0/d15/d4d/c53 0 2024-04-06T12:23:44.035 INFO:tasks.workunit.client.0.smithi152.stdout:8/178: truncate d4/dc/d10/d15/f21 4058352 0 2024-04-06T12:23:44.037 INFO:tasks.workunit.client.0.smithi152.stdout:2/233: mkdir d0/d40/d41/d28/d54 0 2024-04-06T12:23:44.040 INFO:tasks.workunit.client.0.smithi152.stdout:8/179: creat d4/d2c/d2b/f38 x:0 0 0 2024-04-06T12:23:44.041 INFO:tasks.workunit.client.0.smithi152.stdout:8/180: write d4/dc/f25 [1515834,12223] 0 2024-04-06T12:23:44.044 INFO:tasks.workunit.client.0.smithi152.stdout:0/202: getdents d4 0 2024-04-06T12:23:44.045 INFO:tasks.workunit.client.0.smithi152.stdout:0/203: stat d4/f39 0 2024-04-06T12:23:44.051 INFO:tasks.workunit.client.0.smithi152.stdout:0/204: mknod d4/d36/c45 0 2024-04-06T12:23:44.053 INFO:tasks.workunit.client.0.smithi152.stdout:8/181: mkdir d4/db/d39 0 2024-04-06T12:23:44.054 INFO:tasks.workunit.client.0.smithi152.stdout:2/234: getdents d0/d2 0 2024-04-06T12:23:44.060 INFO:tasks.workunit.client.0.smithi152.stdout:8/182: getdents d4/dc 0 2024-04-06T12:23:44.061 INFO:tasks.workunit.client.0.smithi152.stdout:2/235: dwrite d0/d2/f2c [0,4194304] 0 2024-04-06T12:23:44.062 INFO:tasks.workunit.client.0.smithi152.stdout:2/236: write d0/f29 [252979,18431] 0 2024-04-06T12:23:44.063 INFO:tasks.workunit.client.0.smithi152.stdout:2/237: chown d0/d2/d5/c1d 198938917 1 2024-04-06T12:23:44.066 INFO:tasks.workunit.client.0.smithi152.stdout:8/183: creat d4/db/f3a x:0 0 0 2024-04-06T12:23:44.069 INFO:tasks.workunit.client.0.smithi152.stdout:8/184: mknod d4/dc/d10/d18/c3b 0 2024-04-06T12:23:44.072 INFO:tasks.workunit.client.0.smithi152.stdout:8/185: symlink d4/l3c 0 2024-04-06T12:23:44.073 INFO:tasks.workunit.client.0.smithi152.stdout:8/186: read - d4/db/f3a zero size 2024-04-06T12:23:44.075 INFO:tasks.workunit.client.0.smithi152.stdout:8/187: symlink d4/dc/d10/d15/l3d 0 2024-04-06T12:23:44.083 INFO:tasks.workunit.client.0.smithi152.stdout:8/188: fdatasync d4/f8 0 2024-04-06T12:23:44.087 INFO:tasks.workunit.client.0.smithi152.stdout:8/189: unlink d4/db/f16 0 2024-04-06T12:23:44.088 INFO:tasks.workunit.client.0.smithi152.stdout:8/190: write d4/dc/d10/d15/f23 [1162579,80912] 0 2024-04-06T12:23:44.093 INFO:tasks.workunit.client.0.smithi152.stdout:8/191: creat d4/db/d2a/f3e x:0 0 0 2024-04-06T12:23:44.095 INFO:tasks.workunit.client.0.smithi152.stdout:2/238: dwrite d0/d15/d4d/f52 [0,4194304] 0 2024-04-06T12:23:44.099 INFO:tasks.workunit.client.0.smithi152.stdout:8/192: creat d4/db/d39/f3f x:0 0 0 2024-04-06T12:23:44.102 INFO:tasks.workunit.client.0.smithi152.stdout:2/239: dread d0/d2/d5/f42 [0,4194304] 0 2024-04-06T12:23:44.104 INFO:tasks.workunit.client.0.smithi152.stdout:2/240: truncate d0/d2/d5/f50 907029 0 2024-04-06T12:23:44.106 INFO:tasks.workunit.client.0.smithi152.stdout:8/193: dread d4/dc/f1f [0,4194304] 0 2024-04-06T12:23:44.107 INFO:tasks.workunit.client.0.smithi152.stdout:2/241: creat d0/d15/d4d/f55 x:0 0 0 2024-04-06T12:23:44.107 INFO:tasks.workunit.client.0.smithi152.stdout:2/242: stat d0/d40/d26/f2a 0 2024-04-06T12:23:44.112 INFO:tasks.workunit.client.0.smithi152.stdout:2/243: unlink d0/d2/d5/d3a/c3e 0 2024-04-06T12:23:44.112 INFO:tasks.workunit.client.0.smithi152.stdout:8/194: dwrite d4/db/d39/f3f [0,4194304] 0 2024-04-06T12:23:44.114 INFO:tasks.workunit.client.0.smithi152.stdout:2/244: fdatasync d0/d2/f45 0 2024-04-06T12:23:44.117 INFO:tasks.workunit.client.0.smithi152.stdout:8/195: creat d4/dc/f40 x:0 0 0 2024-04-06T12:23:44.117 INFO:tasks.workunit.client.0.smithi152.stdout:8/196: stat d4/dc/d10/d15/l3d 0 2024-04-06T12:23:44.118 INFO:tasks.workunit.client.0.smithi152.stdout:8/197: readlink d4/la 0 2024-04-06T12:23:44.122 INFO:tasks.workunit.client.0.smithi152.stdout:8/198: rename d4/dc/d10/f30 to d4/d2c/f41 0 2024-04-06T12:23:44.126 INFO:tasks.workunit.client.0.smithi152.stdout:2/245: getdents d0/d15 0 2024-04-06T12:23:44.129 INFO:tasks.workunit.client.0.smithi152.stdout:8/199: symlink d4/dc/d10/l42 0 2024-04-06T12:23:44.130 INFO:tasks.workunit.client.0.smithi152.stdout:2/246: creat d0/d40/f56 x:0 0 0 2024-04-06T12:23:44.136 INFO:tasks.workunit.client.0.smithi152.stdout:8/200: dwrite d4/dc/d10/d18/f26 [0,4194304] 0 2024-04-06T12:23:44.136 INFO:tasks.workunit.client.0.smithi152.stdout:2/247: dread d0/d15/d24/d3d/f4f [0,4194304] 0 2024-04-06T12:23:44.137 INFO:tasks.workunit.client.0.smithi152.stdout:8/201: chown d4/db/d2a/f3e 35610 1 2024-04-06T12:23:44.141 INFO:tasks.workunit.client.0.smithi152.stdout:8/202: symlink d4/db/d39/l43 0 2024-04-06T12:23:44.144 INFO:tasks.workunit.client.0.smithi152.stdout:8/203: creat d4/d2c/d2b/f44 x:0 0 0 2024-04-06T12:23:44.145 INFO:tasks.workunit.client.0.smithi152.stdout:8/204: write d4/db/d39/f3f [4113139,57367] 0 2024-04-06T12:23:44.149 INFO:tasks.workunit.client.0.smithi152.stdout:8/205: dread f0 [0,4194304] 0 2024-04-06T12:23:44.152 INFO:tasks.workunit.client.0.smithi152.stdout:8/206: mknod d4/db/d2a/c45 0 2024-04-06T12:23:44.164 INFO:tasks.workunit.client.0.smithi152.stdout:8/207: dread d4/dc/fd [0,4194304] 0 2024-04-06T12:23:44.164 INFO:tasks.workunit.client.0.smithi152.stdout:8/208: dread - d4/dc/d10/d18/f34 zero size 2024-04-06T12:23:44.166 INFO:tasks.workunit.client.0.smithi152.stdout:8/209: chown d4/db/d39/f3f 4039194 1 2024-04-06T12:23:44.216 INFO:tasks.workunit.client.0.smithi152.stdout:3/160: sync 2024-04-06T12:23:44.217 INFO:tasks.workunit.client.0.smithi152.stdout:7/79: sync 2024-04-06T12:23:44.217 INFO:tasks.workunit.client.0.smithi152.stdout:4/130: sync 2024-04-06T12:23:44.221 INFO:tasks.workunit.client.0.smithi152.stdout:2/248: truncate d0/d2/d5/f50 689007 0 2024-04-06T12:23:44.224 INFO:tasks.workunit.client.0.smithi152.stdout:8/210: rmdir d4/db 39 2024-04-06T12:23:44.225 INFO:tasks.workunit.client.0.smithi152.stdout:8/211: stat d4/d2c/d2b/f44 0 2024-04-06T12:23:44.227 INFO:tasks.workunit.client.0.smithi152.stdout:4/131: mknod d7/d16/c21 0 2024-04-06T12:23:44.236 INFO:tasks.workunit.client.0.smithi152.stdout:3/161: rename d0/l12 to d0/d1f/d28/l36 0 2024-04-06T12:23:44.240 INFO:tasks.workunit.client.0.smithi152.stdout:2/249: dwrite d0/d15/d24/f36 [0,4194304] 0 2024-04-06T12:23:44.243 INFO:tasks.workunit.client.0.smithi152.stdout:4/132: rmdir d7/d16 39 2024-04-06T12:23:44.247 INFO:tasks.workunit.client.0.smithi152.stdout:8/212: dread - d4/db/d32/f33 zero size 2024-04-06T12:23:44.248 INFO:tasks.workunit.client.0.smithi152.stdout:8/213: chown d4/db/d39 56423343 1 2024-04-06T12:23:44.251 INFO:tasks.workunit.client.0.smithi152.stdout:7/80: link d8/dc/c10 d8/c1e 0 2024-04-06T12:23:44.251 INFO:tasks.workunit.client.0.smithi152.stdout:2/250: mknod d0/d2/c57 0 2024-04-06T12:23:44.259 INFO:tasks.workunit.client.0.smithi152.stdout:8/214: dread d4/dc/d10/d15/f21 [0,4194304] 0 2024-04-06T12:23:44.260 INFO:tasks.workunit.client.0.smithi152.stdout:4/133: stat d7/d16/f1a 0 2024-04-06T12:23:44.263 INFO:tasks.workunit.client.0.smithi152.stdout:8/215: chown d4/dc/d10/l17 22 1 2024-04-06T12:23:44.272 INFO:tasks.workunit.client.0.smithi152.stdout:2/251: dwrite d0/fd [4194304,4194304] 0 2024-04-06T12:23:44.275 INFO:tasks.workunit.client.0.smithi152.stdout:3/162: dread d0/f8 [0,4194304] 0 2024-04-06T12:23:44.278 INFO:tasks.workunit.client.0.smithi152.stdout:7/81: link d8/dc/c10 d8/c1f 0 2024-04-06T12:23:44.282 INFO:tasks.workunit.client.0.smithi152.stdout:3/163: dread - d0/d10/f2b zero size 2024-04-06T12:23:44.284 INFO:tasks.workunit.client.0.smithi152.stdout:7/82: stat d8/c14 0 2024-04-06T12:23:44.284 INFO:tasks.workunit.client.0.smithi152.stdout:2/252: truncate d0/f1c 3813942 0 2024-04-06T12:23:44.287 INFO:tasks.workunit.client.0.smithi152.stdout:4/134: dwrite d7/fb [0,4194304] 0 2024-04-06T12:23:44.288 INFO:tasks.workunit.client.0.smithi152.stdout:4/135: stat d7/l1d 0 2024-04-06T12:23:44.290 INFO:tasks.workunit.client.0.smithi152.stdout:2/253: creat d0/d2/d5/d3a/f58 x:0 0 0 2024-04-06T12:23:44.291 INFO:tasks.workunit.client.0.smithi152.stdout:8/216: dwrite d4/dc/d10/d15/f23 [0,4194304] 0 2024-04-06T12:23:44.291 INFO:tasks.workunit.client.0.smithi152.stdout:7/83: mknod d8/c20 0 2024-04-06T12:23:44.302 INFO:tasks.workunit.client.0.smithi152.stdout:8/217: dwrite d4/db/d32/f33 [0,4194304] 0 2024-04-06T12:23:44.312 INFO:tasks.workunit.client.0.smithi152.stdout:8/218: dwrite d4/d2c/d2b/f38 [0,4194304] 0 2024-04-06T12:23:44.314 INFO:tasks.workunit.client.0.smithi152.stdout:4/136: dread f1 [0,4194304] 0 2024-04-06T12:23:44.318 INFO:tasks.workunit.client.0.smithi152.stdout:8/219: mknod d4/dc/d10/d18/c46 0 2024-04-06T12:23:44.321 INFO:tasks.workunit.client.0.smithi152.stdout:3/164: truncate d0/f8 2220806 0 2024-04-06T12:23:44.321 INFO:tasks.workunit.client.0.smithi152.stdout:4/137: mkdir d7/d16/d22 0 2024-04-06T12:23:44.322 INFO:tasks.workunit.client.0.smithi152.stdout:8/220: chown d4/dc/d10/l17 353 1 2024-04-06T12:23:44.322 INFO:tasks.workunit.client.0.smithi152.stdout:7/84: write d8/df/f11 [635082,12820] 0 2024-04-06T12:23:44.325 INFO:tasks.workunit.client.0.smithi152.stdout:7/85: truncate d8/dc/d17/f1a 175711 0 2024-04-06T12:23:44.327 INFO:tasks.workunit.client.0.smithi152.stdout:8/221: mknod d4/dc/d10/d18/c47 0 2024-04-06T12:23:44.330 INFO:tasks.workunit.client.0.smithi152.stdout:3/165: mknod d0/d2d/c37 0 2024-04-06T12:23:44.331 INFO:tasks.workunit.client.0.smithi152.stdout:3/166: write d0/fb [4275848,16122] 0 2024-04-06T12:23:44.331 INFO:tasks.workunit.client.0.smithi152.stdout:8/222: creat d4/d2c/d2b/f48 x:0 0 0 2024-04-06T12:23:44.332 INFO:tasks.workunit.client.0.smithi152.stdout:3/167: chown d0/d1f/l33 4180679 1 2024-04-06T12:23:44.333 INFO:tasks.workunit.client.0.smithi152.stdout:3/168: truncate d0/d10/f2b 505780 0 2024-04-06T12:23:44.337 INFO:tasks.workunit.client.0.smithi152.stdout:4/138: truncate f5 3957087 0 2024-04-06T12:23:44.338 INFO:tasks.workunit.client.0.smithi152.stdout:4/139: write d7/d16/f20 [1008860,37943] 0 2024-04-06T12:23:44.339 INFO:tasks.workunit.client.0.smithi152.stdout:4/140: rename d7 to d7/d16/d22/d23 22 2024-04-06T12:23:44.340 INFO:tasks.workunit.client.0.smithi152.stdout:4/141: read f1 [1120893,25128] 0 2024-04-06T12:23:44.342 INFO:tasks.workunit.client.0.smithi152.stdout:3/169: chown d0/d1f/d28/l36 0 1 2024-04-06T12:23:44.342 INFO:tasks.workunit.client.0.smithi152.stdout:3/170: chown d0/fb 0 1 2024-04-06T12:23:44.343 INFO:tasks.workunit.client.0.smithi152.stdout:8/223: mkdir d4/dc/d10/d49 0 2024-04-06T12:23:44.343 INFO:tasks.workunit.client.0.smithi152.stdout:8/224: readlink d4/la 0 2024-04-06T12:23:44.346 INFO:tasks.workunit.client.0.smithi152.stdout:7/86: rmdir d8/d1c 0 2024-04-06T12:23:44.346 INFO:tasks.workunit.client.0.smithi152.stdout:7/87: stat d8/dc/ld 0 2024-04-06T12:23:44.349 INFO:tasks.workunit.client.0.smithi152.stdout:3/171: rmdir d0/d10 39 2024-04-06T12:23:44.358 INFO:tasks.workunit.client.0.smithi152.stdout:7/88: mknod d8/df/c21 0 2024-04-06T12:23:44.367 INFO:tasks.workunit.client.0.smithi152.stdout:7/89: rename d8/df/c21 to d8/df/c22 0 2024-04-06T12:23:44.369 INFO:tasks.workunit.client.0.smithi152.stdout:3/172: unlink d0/d10/f2b 0 2024-04-06T12:23:44.369 INFO:tasks.workunit.client.0.smithi152.stdout:7/90: dread d8/dc/d17/f1a [0,4194304] 0 2024-04-06T12:23:44.370 INFO:tasks.workunit.client.0.smithi152.stdout:3/173: fdatasync d0/d10/d13/f17 0 2024-04-06T12:23:44.373 INFO:tasks.workunit.client.0.smithi152.stdout:7/91: creat d8/dc/f23 x:0 0 0 2024-04-06T12:23:44.377 INFO:tasks.workunit.client.0.smithi152.stdout:8/225: truncate d4/dc/d10/d18/f26 4107617 0 2024-04-06T12:23:44.383 INFO:tasks.workunit.client.0.smithi152.stdout:3/174: dwrite d0/d10/d13/f32 [4194304,4194304] 0 2024-04-06T12:23:44.387 INFO:tasks.workunit.client.0.smithi152.stdout:7/92: dwrite f3 [0,4194304] 0 2024-04-06T12:23:44.387 INFO:tasks.workunit.client.0.smithi152.stdout:3/175: write d0/d1f/f23 [72612,94795] 0 2024-04-06T12:23:44.388 INFO:tasks.workunit.client.0.smithi152.stdout:4/142: dread d7/f12 [0,4194304] 0 2024-04-06T12:23:44.397 INFO:tasks.workunit.client.0.smithi152.stdout:3/176: readlink d0/d1f/d28/l36 0 2024-04-06T12:23:44.397 INFO:tasks.workunit.client.0.smithi152.stdout:8/226: creat d4/f4a x:0 0 0 2024-04-06T12:23:44.399 INFO:tasks.workunit.client.0.smithi152.stdout:3/177: readlink d0/d1f/l27 0 2024-04-06T12:23:44.401 INFO:tasks.workunit.client.0.smithi152.stdout:4/143: dwrite d7/d16/f20 [0,4194304] 0 2024-04-06T12:23:44.402 INFO:tasks.workunit.client.0.smithi152.stdout:7/93: getdents d8 0 2024-04-06T12:23:44.402 INFO:tasks.workunit.client.0.smithi152.stdout:8/227: creat d4/db/d32/f4b x:0 0 0 2024-04-06T12:23:44.407 INFO:tasks.workunit.client.0.smithi152.stdout:3/178: read d0/ff [2749529,61704] 0 2024-04-06T12:23:44.407 INFO:tasks.workunit.client.0.smithi152.stdout:7/94: chown d8/df/c19 257394 1 2024-04-06T12:23:44.408 INFO:tasks.workunit.client.0.smithi152.stdout:7/95: chown d8/f16 9379 1 2024-04-06T12:23:44.409 INFO:tasks.workunit.client.0.smithi152.stdout:3/179: rmdir d0 39 2024-04-06T12:23:44.411 INFO:tasks.workunit.client.0.smithi152.stdout:7/96: chown d8/fb 1303873 1 2024-04-06T12:23:44.411 INFO:tasks.workunit.client.0.smithi152.stdout:7/97: fsync d8/dc/fe 0 2024-04-06T12:23:44.416 INFO:tasks.workunit.client.0.smithi152.stdout:4/144: symlink d7/d16/d22/l24 0 2024-04-06T12:23:44.416 INFO:tasks.workunit.client.0.smithi152.stdout:7/98: truncate f6 1093847 0 2024-04-06T12:23:44.418 INFO:tasks.workunit.client.0.smithi152.stdout:3/180: write d0/d1f/f23 [909214,113382] 0 2024-04-06T12:23:44.418 INFO:tasks.workunit.client.0.smithi152.stdout:4/145: rename d7/d16 to d7/d16/d22/d25 22 2024-04-06T12:23:44.419 INFO:tasks.workunit.client.0.smithi152.stdout:7/99: dread d8/dc/d17/f1a [0,4194304] 0 2024-04-06T12:23:44.423 INFO:tasks.workunit.client.0.smithi152.stdout:4/146: dread d7/d16/f1a [0,4194304] 0 2024-04-06T12:23:44.428 INFO:tasks.workunit.client.0.smithi152.stdout:3/181: mknod d0/d1f/d28/c38 0 2024-04-06T12:23:44.429 INFO:tasks.workunit.client.0.smithi152.stdout:3/182: chown d0/fb 28794 1 2024-04-06T12:23:44.431 INFO:tasks.workunit.client.0.smithi152.stdout:7/100: creat d8/dc/f24 x:0 0 0 2024-04-06T12:23:44.432 INFO:tasks.workunit.client.0.smithi152.stdout:4/147: rename d7/d16/c21 to d7/d16/c26 0 2024-04-06T12:23:44.435 INFO:tasks.workunit.client.0.smithi152.stdout:3/183: dwrite d0/d10/d13/f1a [0,4194304] 0 2024-04-06T12:23:44.437 INFO:tasks.workunit.client.0.smithi152.stdout:3/184: read d0/d1f/f23 [184047,93848] 0 2024-04-06T12:23:44.440 INFO:tasks.workunit.client.0.smithi152.stdout:7/101: creat d8/df/f25 x:0 0 0 2024-04-06T12:23:44.440 INFO:tasks.workunit.client.0.smithi152.stdout:8/228: truncate d4/dc/d10/d18/f26 3641009 0 2024-04-06T12:23:44.442 INFO:tasks.workunit.client.0.smithi152.stdout:8/229: write d4/f35 [822801,12598] 0 2024-04-06T12:23:44.446 INFO:tasks.workunit.client.0.smithi152.stdout:3/185: chown d0/d10/d1e/l29 258 1 2024-04-06T12:23:44.448 INFO:tasks.workunit.client.0.smithi152.stdout:7/102: mknod d8/c26 0 2024-04-06T12:23:44.452 INFO:tasks.workunit.client.0.smithi152.stdout:8/230: rename d4/d2c/d2b/f48 to d4/dc/d10/d49/f4c 0 2024-04-06T12:23:44.453 INFO:tasks.workunit.client.0.smithi152.stdout:8/231: write d4/db/f13 [382390,109967] 0 2024-04-06T12:23:44.457 INFO:tasks.workunit.client.0.smithi152.stdout:3/186: dread d0/f8 [0,4194304] 0 2024-04-06T12:23:44.459 INFO:tasks.workunit.client.0.smithi152.stdout:3/187: chown d0/d10/d13/l31 137810506 1 2024-04-06T12:23:44.460 INFO:tasks.workunit.client.0.smithi152.stdout:3/188: read - d0/d10/d1e/f1d zero size 2024-04-06T12:23:44.463 INFO:tasks.workunit.client.0.smithi152.stdout:6/239: sync 2024-04-06T12:23:44.463 INFO:tasks.workunit.client.0.smithi152.stdout:1/193: sync 2024-04-06T12:23:44.464 INFO:tasks.workunit.client.0.smithi152.stdout:5/152: sync 2024-04-06T12:23:44.466 INFO:tasks.workunit.client.0.smithi152.stdout:3/189: dwrite d0/d10/d13/f1a [0,4194304] 0 2024-04-06T12:23:44.471 INFO:tasks.workunit.client.0.smithi152.stdout:5/153: fsync d3/da/f29 0 2024-04-06T12:23:44.473 INFO:tasks.workunit.client.0.smithi152.stdout:5/154: write d3/de/f22 [820071,124842] 0 2024-04-06T12:23:44.477 INFO:tasks.workunit.client.0.smithi152.stdout:6/240: creat d7/d19/d3e/f53 x:0 0 0 2024-04-06T12:23:44.480 INFO:tasks.workunit.client.0.smithi152.stdout:4/148: write f5 [903323,35453] 0 2024-04-06T12:23:44.481 INFO:tasks.workunit.client.0.smithi152.stdout:3/190: mkdir d0/d10/d1e/d39 0 2024-04-06T12:23:44.484 INFO:tasks.workunit.client.0.smithi152.stdout:3/191: dread d0/f8 [0,4194304] 0 2024-04-06T12:23:44.488 INFO:tasks.workunit.client.0.smithi152.stdout:5/155: unlink d3/da/l2d 0 2024-04-06T12:23:44.488 INFO:tasks.workunit.client.0.smithi152.stdout:5/156: chown d3/c1d 201526 1 2024-04-06T12:23:44.494 INFO:tasks.workunit.client.0.smithi152.stdout:6/241: creat d7/d19/d1b/d31/d35/f54 x:0 0 0 2024-04-06T12:23:44.495 INFO:tasks.workunit.client.0.smithi152.stdout:4/149: symlink d7/d16/d22/l27 0 2024-04-06T12:23:44.496 INFO:tasks.workunit.client.0.smithi152.stdout:8/232: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:23:44.496 INFO:tasks.workunit.client.0.smithi152.stdout:6/242: write d7/d19/f30 [183537,70037] 0 2024-04-06T12:23:44.500 INFO:tasks.workunit.client.0.smithi152.stdout:5/157: rename d3/da/c20 to d3/d9/c2f 0 2024-04-06T12:23:44.503 INFO:tasks.workunit.client.0.smithi152.stdout:5/158: chown d3/d9/f27 19988 1 2024-04-06T12:23:44.504 INFO:tasks.workunit.client.0.smithi152.stdout:4/150: dwrite d7/f17 [0,4194304] 0 2024-04-06T12:23:44.506 INFO:tasks.workunit.client.0.smithi152.stdout:4/151: write f5 [2227132,595] 0 2024-04-06T12:23:44.508 INFO:tasks.workunit.client.0.smithi152.stdout:1/194: rmdir d2/d1d/d48 0 2024-04-06T12:23:44.508 INFO:tasks.workunit.client.0.smithi152.stdout:4/152: chown d7/l8 684976201 1 2024-04-06T12:23:44.508 INFO:tasks.workunit.client.0.smithi152.stdout:7/103: mknod d8/c27 0 2024-04-06T12:23:44.509 INFO:tasks.workunit.client.0.smithi152.stdout:5/159: dread d3/da/f24 [0,4194304] 0 2024-04-06T12:23:44.510 INFO:tasks.workunit.client.0.smithi152.stdout:1/195: truncate d2/f36 25970 0 2024-04-06T12:23:44.513 INFO:tasks.workunit.client.0.smithi152.stdout:6/243: creat d7/d19/f55 x:0 0 0 2024-04-06T12:23:44.516 INFO:tasks.workunit.client.0.smithi152.stdout:4/153: dread d7/f17 [0,4194304] 0 2024-04-06T12:23:44.519 INFO:tasks.workunit.client.0.smithi152.stdout:1/196: dwrite d2/d1d/f2e [0,4194304] 0 2024-04-06T12:23:44.526 INFO:tasks.workunit.client.0.smithi152.stdout:8/233: symlink d4/l4d 0 2024-04-06T12:23:44.531 INFO:tasks.workunit.client.0.smithi152.stdout:6/244: creat d7/d9/f56 x:0 0 0 2024-04-06T12:23:44.533 INFO:tasks.workunit.client.0.smithi152.stdout:7/104: mkdir d8/df/d28 0 2024-04-06T12:23:44.534 INFO:tasks.workunit.client.0.smithi152.stdout:4/154: write d7/f12 [718481,91763] 0 2024-04-06T12:23:44.534 INFO:tasks.workunit.client.0.smithi152.stdout:3/192: link d0/d10/d13/l31 d0/l3a 0 2024-04-06T12:23:44.538 INFO:tasks.workunit.client.0.smithi152.stdout:5/160: rename d3/da/l19 to d3/da/d15/d2b/l30 0 2024-04-06T12:23:44.539 INFO:tasks.workunit.client.0.smithi152.stdout:6/245: mknod d7/d19/c57 0 2024-04-06T12:23:44.541 INFO:tasks.workunit.client.0.smithi152.stdout:6/246: fdatasync d7/fc 0 2024-04-06T12:23:44.544 INFO:tasks.workunit.client.0.smithi152.stdout:6/247: chown f3 1 1 2024-04-06T12:23:44.545 INFO:tasks.workunit.client.0.smithi152.stdout:8/234: dwrite d4/dc/d10/d49/f4c [0,4194304] 0 2024-04-06T12:23:44.546 INFO:tasks.workunit.client.0.smithi152.stdout:4/155: dwrite d7/d16/f20 [0,4194304] 0 2024-04-06T12:23:44.547 INFO:tasks.workunit.client.0.smithi152.stdout:4/156: chown d7/c1e 8 1 2024-04-06T12:23:44.549 INFO:tasks.workunit.client.0.smithi152.stdout:5/161: creat d3/f31 x:0 0 0 2024-04-06T12:23:44.550 INFO:tasks.workunit.client.0.smithi152.stdout:3/193: rename d0/d10/d1e/l1b to d0/d10/l3b 0 2024-04-06T12:23:44.550 INFO:tasks.workunit.client.0.smithi152.stdout:6/248: truncate d7/d19/d3e/f53 632890 0 2024-04-06T12:23:44.553 INFO:tasks.workunit.client.0.smithi152.stdout:9/138: sync 2024-04-06T12:23:44.553 INFO:tasks.workunit.client.0.smithi152.stdout:0/205: sync 2024-04-06T12:23:44.562 INFO:tasks.workunit.client.0.smithi152.stdout:8/235: dwrite d4/dc/fd [0,4194304] 0 2024-04-06T12:23:44.563 INFO:tasks.workunit.client.0.smithi152.stdout:1/197: link d2/d1d/d21/d28/f3a d2/d2f/d37/f49 0 2024-04-06T12:23:44.567 INFO:tasks.workunit.client.0.smithi152.stdout:0/206: symlink d4/de/d28/d18/d3b/l46 0 2024-04-06T12:23:44.567 INFO:tasks.workunit.client.0.smithi152.stdout:9/139: mknod d5/c31 0 2024-04-06T12:23:44.568 INFO:tasks.workunit.client.0.smithi152.stdout:1/198: read d2/d2f/d37/f44 [1354394,16660] 0 2024-04-06T12:23:44.570 INFO:tasks.workunit.client.0.smithi152.stdout:4/157: fsync d7/d16/f20 0 2024-04-06T12:23:44.571 INFO:tasks.workunit.client.0.smithi152.stdout:8/236: creat d4/db/d2a/f4e x:0 0 0 2024-04-06T12:23:44.573 INFO:tasks.workunit.client.0.smithi152.stdout:9/140: fsync d5/d6/f2c 0 2024-04-06T12:23:44.573 INFO:tasks.workunit.client.0.smithi152.stdout:7/105: dread d8/dc/fe [4194304,4194304] 0 2024-04-06T12:23:44.573 INFO:tasks.workunit.client.0.smithi152.stdout:4/158: fsync d7/f12 0 2024-04-06T12:23:44.574 INFO:tasks.workunit.client.0.smithi152.stdout:5/162: dwrite d3/d9/f2a [4194304,4194304] 0 2024-04-06T12:23:44.574 INFO:tasks.workunit.client.0.smithi152.stdout:1/199: write d2/d2f/f32 [2660726,1555] 0 2024-04-06T12:23:44.574 INFO:tasks.workunit.client.0.smithi152.stdout:0/207: mkdir d4/d31/d47 0 2024-04-06T12:23:44.577 INFO:tasks.workunit.client.0.smithi152.stdout:7/106: chown d8/c26 840224769 1 2024-04-06T12:23:44.578 INFO:tasks.workunit.client.0.smithi152.stdout:6/249: getdents d7/d9/d26/d4a 0 2024-04-06T12:23:44.580 INFO:tasks.workunit.client.0.smithi152.stdout:3/194: dwrite d0/d10/d13/f32 [0,4194304] 0 2024-04-06T12:23:44.580 INFO:tasks.workunit.client.0.smithi152.stdout:0/208: write d4/de/d28/d18/f2c [4961572,43301] 0 2024-04-06T12:23:44.581 INFO:tasks.workunit.client.0.smithi152.stdout:7/107: write d8/dc/f24 [291588,691] 0 2024-04-06T12:23:44.581 INFO:tasks.workunit.client.0.smithi152.stdout:8/237: creat d4/db/d39/f4f x:0 0 0 2024-04-06T12:23:44.588 INFO:tasks.workunit.client.0.smithi152.stdout:4/159: creat d7/d16/d22/f28 x:0 0 0 2024-04-06T12:23:44.591 INFO:tasks.workunit.client.0.smithi152.stdout:6/250: creat d7/d9/d26/d4a/f58 x:0 0 0 2024-04-06T12:23:44.592 INFO:tasks.workunit.client.0.smithi152.stdout:0/209: creat d4/de/d2a/d33/f48 x:0 0 0 2024-04-06T12:23:44.593 INFO:tasks.workunit.client.0.smithi152.stdout:8/238: creat d4/db/d39/f50 x:0 0 0 2024-04-06T12:23:44.597 INFO:tasks.workunit.client.0.smithi152.stdout:9/141: mkdir d5/d6/d15/d17/d23/d2d/d32 0 2024-04-06T12:23:44.600 INFO:tasks.workunit.client.0.smithi152.stdout:2/254: sync 2024-04-06T12:23:44.600 INFO:tasks.workunit.client.0.smithi152.stdout:4/160: rmdir d7/d16 39 2024-04-06T12:23:44.603 INFO:tasks.workunit.client.0.smithi152.stdout:4/161: dread f1 [0,4194304] 0 2024-04-06T12:23:44.605 INFO:tasks.workunit.client.0.smithi152.stdout:0/210: symlink d4/l49 0 2024-04-06T12:23:44.607 INFO:tasks.workunit.client.0.smithi152.stdout:7/108: symlink d8/df/d28/l29 0 2024-04-06T12:23:44.610 INFO:tasks.workunit.client.0.smithi152.stdout:9/142: rename d5/d6/d15/d17/c1c to d5/d6/d15/d17/d23/d2d/d32/c33 0 2024-04-06T12:23:44.612 INFO:tasks.workunit.client.0.smithi152.stdout:5/163: truncate d3/da/f24 1478057 0 2024-04-06T12:23:44.613 INFO:tasks.workunit.client.0.smithi152.stdout:2/255: mknod d0/d2/c59 0 2024-04-06T12:23:44.614 INFO:tasks.workunit.client.0.smithi152.stdout:1/200: truncate d2/f10 2610549 0 2024-04-06T12:23:44.621 INFO:tasks.workunit.client.0.smithi152.stdout:3/195: link d0/ff d0/f3c 0 2024-04-06T12:23:44.625 INFO:tasks.workunit.client.0.smithi152.stdout:9/143: dwrite d5/d6/fd [0,4194304] 0 2024-04-06T12:23:44.629 INFO:tasks.workunit.client.0.smithi152.stdout:5/164: dwrite d3/de/f22 [0,4194304] 0 2024-04-06T12:23:44.636 INFO:tasks.workunit.client.0.smithi152.stdout:5/165: dread d3/f11 [0,4194304] 0 2024-04-06T12:23:44.636 INFO:tasks.workunit.client.0.smithi152.stdout:4/162: mkdir d7/d29 0 2024-04-06T12:23:44.639 INFO:tasks.workunit.client.0.smithi152.stdout:1/201: creat d2/d2f/d37/f4a x:0 0 0 2024-04-06T12:23:44.641 INFO:tasks.workunit.client.0.smithi152.stdout:7/109: mkdir d8/d2a 0 2024-04-06T12:23:44.679 INFO:tasks.workunit.client.0.smithi152.stdout:8/239: rename d4/dc/d10/d15 to d4/dc/d10/d51 0 2024-04-06T12:23:44.680 INFO:tasks.workunit.client.0.smithi152.stdout:1/202: truncate d2/f16 5021952 0 2024-04-06T12:23:44.681 INFO:tasks.workunit.client.0.smithi152.stdout:7/110: readlink d8/dc/d17/l1d 0 2024-04-06T12:23:44.681 INFO:tasks.workunit.client.0.smithi152.stdout:6/251: getdents d7/d9/d26/d2e 0 2024-04-06T12:23:44.682 INFO:tasks.workunit.client.0.smithi152.stdout:1/203: fsync d2/f1b 0 2024-04-06T12:23:44.682 INFO:tasks.workunit.client.0.smithi152.stdout:5/166: mkdir d3/da/d15/d32 0 2024-04-06T12:23:44.683 INFO:tasks.workunit.client.0.smithi152.stdout:4/163: dwrite d7/fb [0,4194304] 0 2024-04-06T12:23:44.684 INFO:tasks.workunit.client.0.smithi152.stdout:3/196: mkdir d0/d10/d1e/d39/d3d 0 2024-04-06T12:23:44.684 INFO:tasks.workunit.client.0.smithi152.stdout:5/167: dread - d3/de/f2e zero size 2024-04-06T12:23:44.685 INFO:tasks.workunit.client.0.smithi152.stdout:5/168: chown d3 3 1 2024-04-06T12:23:44.689 INFO:tasks.workunit.client.0.smithi152.stdout:4/164: dread f1 [0,4194304] 0 2024-04-06T12:23:44.695 INFO:tasks.workunit.client.0.smithi152.stdout:5/169: dwrite d3/f16 [0,4194304] 0 2024-04-06T12:23:44.697 INFO:tasks.workunit.client.0.smithi152.stdout:8/240: creat d4/db/d32/f52 x:0 0 0 2024-04-06T12:23:44.698 INFO:tasks.workunit.client.0.smithi152.stdout:6/252: symlink d7/d9/d26/d4a/l59 0 2024-04-06T12:23:44.700 INFO:tasks.workunit.client.0.smithi152.stdout:6/253: chown d7/d9/f10 24 1 2024-04-06T12:23:44.702 INFO:tasks.workunit.client.0.smithi152.stdout:7/111: rename d8/dc/d17/l1d to d8/df/d28/l2b 0 2024-04-06T12:23:44.704 INFO:tasks.workunit.client.0.smithi152.stdout:8/241: dwrite d4/db/d2a/f4e [0,4194304] 0 2024-04-06T12:23:44.709 INFO:tasks.workunit.client.0.smithi152.stdout:1/204: unlink d2/d1d/d21/c2a 0 2024-04-06T12:23:44.712 INFO:tasks.workunit.client.0.smithi152.stdout:4/165: dwrite d7/f17 [0,4194304] 0 2024-04-06T12:23:44.714 INFO:tasks.workunit.client.0.smithi152.stdout:5/170: symlink d3/de/l33 0 2024-04-06T12:23:44.719 INFO:tasks.workunit.client.0.smithi152.stdout:6/254: rename d7/d19/d1b/d31/f36 to d7/d9/d26/f5a 0 2024-04-06T12:23:44.721 INFO:tasks.workunit.client.0.smithi152.stdout:8/242: dread d4/dc/d10/f2d [0,4194304] 0 2024-04-06T12:23:44.721 INFO:tasks.workunit.client.0.smithi152.stdout:7/112: mkdir d8/dc/d17/d2c 0 2024-04-06T12:23:44.723 INFO:tasks.workunit.client.0.smithi152.stdout:7/113: write d8/df/f11 [1144684,129135] 0 2024-04-06T12:23:44.723 INFO:tasks.workunit.client.0.smithi152.stdout:2/256: truncate d0/d15/d24/d3d/f4f 3632594 0 2024-04-06T12:23:44.726 INFO:tasks.workunit.client.0.smithi152.stdout:0/211: rename d4/de/d2a to d4/de/d4a 0 2024-04-06T12:23:44.727 INFO:tasks.workunit.client.0.smithi152.stdout:7/114: dread - d8/dc/f13 zero size 2024-04-06T12:23:44.729 INFO:tasks.workunit.client.0.smithi152.stdout:5/171: symlink d3/da/d15/l34 0 2024-04-06T12:23:44.731 INFO:tasks.workunit.client.0.smithi152.stdout:8/243: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:23:44.732 INFO:tasks.workunit.client.0.smithi152.stdout:5/172: truncate d3/d9/f27 685685 0 2024-04-06T12:23:44.734 INFO:tasks.workunit.client.0.smithi152.stdout:5/173: write d3/d9/f12 [2185914,48078] 0 2024-04-06T12:23:44.736 INFO:tasks.workunit.client.0.smithi152.stdout:8/244: chown d4/dc/d10/d18/c1c 2251 1 2024-04-06T12:23:44.737 INFO:tasks.workunit.client.0.smithi152.stdout:8/245: chown d4/ce 2327972 1 2024-04-06T12:23:44.738 INFO:tasks.workunit.client.0.smithi152.stdout:2/257: mknod d0/d15/c5a 0 2024-04-06T12:23:44.739 INFO:tasks.workunit.client.0.smithi152.stdout:7/115: dwrite d8/dc/fe [4194304,4194304] 0 2024-04-06T12:23:44.740 INFO:tasks.workunit.client.0.smithi152.stdout:1/205: mknod d2/d2f/d45/c4b 0 2024-04-06T12:23:44.741 INFO:tasks.workunit.client.0.smithi152.stdout:7/116: read - d8/dc/f23 zero size 2024-04-06T12:23:44.741 INFO:tasks.workunit.client.0.smithi152.stdout:1/206: write d2/f47 [992385,62775] 0 2024-04-06T12:23:44.742 INFO:tasks.workunit.client.0.smithi152.stdout:0/212: fsync d4/d19/f20 0 2024-04-06T12:23:44.744 INFO:tasks.workunit.client.0.smithi152.stdout:6/255: getdents d7/d9/d26/d2e 0 2024-04-06T12:23:44.744 INFO:tasks.workunit.client.0.smithi152.stdout:0/213: fdatasync d4/d19/f41 0 2024-04-06T12:23:44.748 INFO:tasks.workunit.client.0.smithi152.stdout:5/174: dread d3/f11 [0,4194304] 0 2024-04-06T12:23:44.753 INFO:tasks.workunit.client.0.smithi152.stdout:7/117: rmdir d8/dc 39 2024-04-06T12:23:44.757 INFO:tasks.workunit.client.0.smithi152.stdout:4/166: creat d7/f2a x:0 0 0 2024-04-06T12:23:44.758 INFO:tasks.workunit.client.0.smithi152.stdout:1/207: symlink d2/d1d/d21/d28/l4c 0 2024-04-06T12:23:44.763 INFO:tasks.workunit.client.0.smithi152.stdout:6/256: mknod d7/d19/c5b 0 2024-04-06T12:23:44.764 INFO:tasks.workunit.client.0.smithi152.stdout:2/258: write d0/d2/f21 [4853054,114808] 0 2024-04-06T12:23:44.767 INFO:tasks.workunit.client.0.smithi152.stdout:7/118: truncate d8/dc/f23 684042 0 2024-04-06T12:23:44.768 INFO:tasks.workunit.client.0.smithi152.stdout:1/208: mknod d2/d2f/d45/c4d 0 2024-04-06T12:23:44.772 INFO:tasks.workunit.client.0.smithi152.stdout:8/246: creat d4/db/f53 x:0 0 0 2024-04-06T12:23:44.773 INFO:tasks.workunit.client.0.smithi152.stdout:2/259: creat d0/d15/d24/f5b x:0 0 0 2024-04-06T12:23:44.774 INFO:tasks.workunit.client.0.smithi152.stdout:2/260: truncate d0/d15/d24/d3d/f2e 812120 0 2024-04-06T12:23:44.775 INFO:tasks.workunit.client.0.smithi152.stdout:6/257: rename d7/d9/d26/f5a to d7/d19/d1b/d31/d35/f5c 0 2024-04-06T12:23:44.777 INFO:tasks.workunit.client.0.smithi152.stdout:5/175: truncate d3/d9/fb 1500495 0 2024-04-06T12:23:44.777 INFO:tasks.workunit.client.0.smithi152.stdout:4/167: creat d7/d29/f2b x:0 0 0 2024-04-06T12:23:44.779 INFO:tasks.workunit.client.0.smithi152.stdout:7/119: read - d8/f1b zero size 2024-04-06T12:23:44.780 INFO:tasks.workunit.client.0.smithi152.stdout:0/214: getdents d4/d31/d47 0 2024-04-06T12:23:44.782 INFO:tasks.workunit.client.0.smithi152.stdout:2/261: creat d0/d40/d41/f5c x:0 0 0 2024-04-06T12:23:44.783 INFO:tasks.workunit.client.0.smithi152.stdout:7/120: truncate d8/f1b 737537 0 2024-04-06T12:23:44.784 INFO:tasks.workunit.client.0.smithi152.stdout:2/262: stat d0/d40 0 2024-04-06T12:23:44.784 INFO:tasks.workunit.client.0.smithi152.stdout:1/209: dread d2/f7 [4194304,4194304] 0 2024-04-06T12:23:44.785 INFO:tasks.workunit.client.0.smithi152.stdout:6/258: rename d7/d19/d1b/f38 to d7/d19/d3e/f5d 0 2024-04-06T12:23:44.787 INFO:tasks.workunit.client.0.smithi152.stdout:5/176: dwrite d3/da/f29 [4194304,4194304] 0 2024-04-06T12:23:44.788 INFO:tasks.workunit.client.0.smithi152.stdout:1/210: write d2/d1d/d21/d28/f30 [914399,63900] 0 2024-04-06T12:23:44.789 INFO:tasks.workunit.client.0.smithi152.stdout:8/247: fdatasync d4/dc/d10/d18/f26 0 2024-04-06T12:23:44.792 INFO:tasks.workunit.client.0.smithi152.stdout:8/248: write d4/dc/f40 [227650,112534] 0 2024-04-06T12:23:44.803 INFO:tasks.workunit.client.0.smithi152.stdout:5/177: rename d3/d9/f12 to d3/de/f35 0 2024-04-06T12:23:44.805 INFO:tasks.workunit.client.0.smithi152.stdout:1/211: creat d2/d1d/d21/d28/f4e x:0 0 0 2024-04-06T12:23:44.809 INFO:tasks.workunit.client.0.smithi152.stdout:7/121: mkdir d8/dc/d17/d2c/d2d 0 2024-04-06T12:23:44.810 INFO:tasks.workunit.client.0.smithi152.stdout:8/249: mkdir d4/d2c/d54 0 2024-04-06T12:23:44.813 INFO:tasks.workunit.client.0.smithi152.stdout:0/215: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:23:44.814 INFO:tasks.workunit.client.0.smithi152.stdout:2/263: link d0/d15/d4d/f55 d0/d15/f5d 0 2024-04-06T12:23:44.816 INFO:tasks.workunit.client.0.smithi152.stdout:6/259: dread d7/d19/f23 [0,4194304] 0 2024-04-06T12:23:44.818 INFO:tasks.workunit.client.0.smithi152.stdout:2/264: truncate d0/d15/f5d 221960 0 2024-04-06T12:23:44.818 INFO:tasks.workunit.client.0.smithi152.stdout:7/122: dwrite d8/dc/fe [4194304,4194304] 0 2024-04-06T12:23:44.820 INFO:tasks.workunit.client.0.smithi152.stdout:1/212: write d2/f7 [8172406,17635] 0 2024-04-06T12:23:44.826 INFO:tasks.workunit.client.0.smithi152.stdout:0/216: write d4/f2b [1333916,85257] 0 2024-04-06T12:23:44.828 INFO:tasks.workunit.client.0.smithi152.stdout:6/260: creat d7/d19/f5e x:0 0 0 2024-04-06T12:23:44.828 INFO:tasks.workunit.client.0.smithi152.stdout:8/250: mkdir d4/dc/d10/d55 0 2024-04-06T12:23:44.829 INFO:tasks.workunit.client.0.smithi152.stdout:7/123: rmdir d8/dc/d17 39 2024-04-06T12:23:44.832 INFO:tasks.workunit.client.0.smithi152.stdout:1/213: dwrite d2/f18 [0,4194304] 0 2024-04-06T12:23:44.833 INFO:tasks.workunit.client.0.smithi152.stdout:5/178: getdents d3/de 0 2024-04-06T12:23:44.835 INFO:tasks.workunit.client.0.smithi152.stdout:8/251: mkdir d4/db/d56 0 2024-04-06T12:23:44.837 INFO:tasks.workunit.client.0.smithi152.stdout:1/214: creat d2/d2f/d37/f4f x:0 0 0 2024-04-06T12:23:44.839 INFO:tasks.workunit.client.0.smithi152.stdout:5/179: rename d3/da/c23 to d3/da/d15/c36 0 2024-04-06T12:23:44.843 INFO:tasks.workunit.client.0.smithi152.stdout:8/252: symlink d4/dc/d10/d49/l57 0 2024-04-06T12:23:44.845 INFO:tasks.workunit.client.0.smithi152.stdout:1/215: creat d2/f50 x:0 0 0 2024-04-06T12:23:44.845 INFO:tasks.workunit.client.0.smithi152.stdout:1/216: dread d2/f36 [0,4194304] 0 2024-04-06T12:23:44.846 INFO:tasks.workunit.client.0.smithi152.stdout:5/180: mkdir d3/d37 0 2024-04-06T12:23:44.846 INFO:tasks.workunit.client.0.smithi152.stdout:1/217: chown d2/d1d/d21/d28 189 1 2024-04-06T12:23:44.847 INFO:tasks.workunit.client.0.smithi152.stdout:1/218: dread - d2/d1d/f3e zero size 2024-04-06T12:23:44.848 INFO:tasks.workunit.client.0.smithi152.stdout:0/217: link d4/d36/f3f d4/de/d28/d18/d3b/d2e/f4b 0 2024-04-06T12:23:44.850 INFO:tasks.workunit.client.0.smithi152.stdout:6/261: getdents d7/d19/d1b/d22 0 2024-04-06T12:23:44.858 INFO:tasks.workunit.client.0.smithi152.stdout:5/181: symlink d3/da/d15/d32/l38 0 2024-04-06T12:23:44.859 INFO:tasks.workunit.client.0.smithi152.stdout:5/182: chown d3/d9/lf 599 1 2024-04-06T12:23:44.861 INFO:tasks.workunit.client.0.smithi152.stdout:8/253: creat d4/db/f58 x:0 0 0 2024-04-06T12:23:44.862 INFO:tasks.workunit.client.0.smithi152.stdout:0/218: link d4/de/d28/f22 d4/f4c 0 2024-04-06T12:23:44.862 INFO:tasks.workunit.client.0.smithi152.stdout:6/262: dread d7/d19/f30 [0,4194304] 0 2024-04-06T12:23:44.865 INFO:tasks.workunit.client.0.smithi152.stdout:8/254: unlink d4/d2c/f41 0 2024-04-06T12:23:44.867 INFO:tasks.workunit.client.0.smithi152.stdout:0/219: chown d4/de/d28/d18/d3b/d2e 1709544 1 2024-04-06T12:23:44.871 INFO:tasks.workunit.client.0.smithi152.stdout:8/255: fdatasync d4/dc/d10/d18/f26 0 2024-04-06T12:23:44.873 INFO:tasks.workunit.client.0.smithi152.stdout:8/256: write d4/f36 [393835,12469] 0 2024-04-06T12:23:44.873 INFO:tasks.workunit.client.0.smithi152.stdout:8/257: chown d4/db/c1d 47274 1 2024-04-06T12:23:44.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/258: write d4/db/d32/f33 [1240450,82541] 0 2024-04-06T12:23:44.875 INFO:tasks.workunit.client.0.smithi152.stdout:0/220: mknod d4/de/d4a/c4d 0 2024-04-06T12:23:44.876 INFO:tasks.workunit.client.0.smithi152.stdout:8/259: fdatasync d4/dc/d10/d51/f21 0 2024-04-06T12:23:44.877 INFO:tasks.workunit.client.0.smithi152.stdout:0/221: dread - d4/de/d28/d18/d3b/f2f zero size 2024-04-06T12:23:44.877 INFO:tasks.workunit.client.0.smithi152.stdout:8/260: stat d4/d2c/d2b/l2f 0 2024-04-06T12:23:44.888 INFO:tasks.workunit.client.0.smithi152.stdout:5/183: link d3/da/l25 d3/da/l39 0 2024-04-06T12:23:44.891 INFO:tasks.workunit.client.0.smithi152.stdout:6/263: dwrite d7/fb [0,4194304] 0 2024-04-06T12:23:44.892 INFO:tasks.workunit.client.0.smithi152.stdout:6/264: chown d7/d19/d1b 0 1 2024-04-06T12:23:44.893 INFO:tasks.workunit.client.0.smithi152.stdout:5/184: readlink d3/da/d15/l2c 0 2024-04-06T12:23:44.896 INFO:tasks.workunit.client.0.smithi152.stdout:5/185: symlink d3/da/l3a 0 2024-04-06T12:23:44.898 INFO:tasks.workunit.client.0.smithi152.stdout:8/261: truncate d4/db/d2a/f4e 3344046 0 2024-04-06T12:23:44.902 INFO:tasks.workunit.client.0.smithi152.stdout:8/262: write d4/dc/f25 [2433738,15079] 0 2024-04-06T12:23:44.906 INFO:tasks.workunit.client.0.smithi152.stdout:8/263: write d4/f9 [7466528,97953] 0 2024-04-06T12:23:44.907 INFO:tasks.workunit.client.0.smithi152.stdout:5/186: dwrite d3/da/d15/f1c [0,4194304] 0 2024-04-06T12:23:44.908 INFO:tasks.workunit.client.0.smithi152.stdout:0/222: dwrite d4/f4c [0,4194304] 0 2024-04-06T12:23:44.909 INFO:tasks.workunit.client.0.smithi152.stdout:5/187: fsync d3/de/f2e 0 2024-04-06T12:23:44.915 INFO:tasks.workunit.client.0.smithi152.stdout:8/264: creat d4/d2c/d54/f59 x:0 0 0 2024-04-06T12:23:44.919 INFO:tasks.workunit.client.0.smithi152.stdout:8/265: write d4/db/d32/f33 [4977101,129587] 0 2024-04-06T12:23:44.920 INFO:tasks.workunit.client.0.smithi152.stdout:5/188: dwrite d3/f7 [4194304,4194304] 0 2024-04-06T12:23:44.926 INFO:tasks.workunit.client.0.smithi152.stdout:0/223: dwrite d4/d19/f20 [0,4194304] 0 2024-04-06T12:23:44.927 INFO:tasks.workunit.client.0.smithi152.stdout:8/266: dread - d4/db/d2a/f3e zero size 2024-04-06T12:23:44.929 INFO:tasks.workunit.client.0.smithi152.stdout:5/189: link d3/da/f29 d3/d37/f3b 0 2024-04-06T12:23:44.937 INFO:tasks.workunit.client.0.smithi152.stdout:0/224: link d4/de/f30 d4/d19/f4e 0 2024-04-06T12:23:44.939 INFO:tasks.workunit.client.0.smithi152.stdout:5/190: mknod d3/d37/c3c 0 2024-04-06T12:23:44.940 INFO:tasks.workunit.client.0.smithi152.stdout:0/225: mknod d4/de/d28/c4f 0 2024-04-06T12:23:44.941 INFO:tasks.workunit.client.0.smithi152.stdout:8/267: link d4/db/d2a/l37 d4/db/d32/l5a 0 2024-04-06T12:23:44.943 INFO:tasks.workunit.client.0.smithi152.stdout:5/191: write d3/d37/f3b [2702041,93608] 0 2024-04-06T12:23:44.946 INFO:tasks.workunit.client.0.smithi152.stdout:8/268: fdatasync d4/dc/d10/f2d 0 2024-04-06T12:23:44.946 INFO:tasks.workunit.client.0.smithi152.stdout:8/269: chown d4/dc/d10/d18/c3b 1536 1 2024-04-06T12:23:44.947 INFO:tasks.workunit.client.0.smithi152.stdout:8/270: chown d4/db/d56 737369 1 2024-04-06T12:23:44.947 INFO:tasks.workunit.client.0.smithi152.stdout:5/192: rename d3/da/d15/d32/l38 to d3/da/d15/d32/l3d 0 2024-04-06T12:23:44.948 INFO:tasks.workunit.client.0.smithi152.stdout:5/193: read - d3/da/f13 zero size 2024-04-06T12:23:44.950 INFO:tasks.workunit.client.0.smithi152.stdout:5/194: mknod d3/de/c3e 0 2024-04-06T12:23:44.950 INFO:tasks.workunit.client.0.smithi152.stdout:5/195: readlink d3/da/d15/l2c 0 2024-04-06T12:23:44.953 INFO:tasks.workunit.client.0.smithi152.stdout:5/196: fdatasync d3/de/f35 0 2024-04-06T12:23:44.955 INFO:tasks.workunit.client.0.smithi152.stdout:5/197: mkdir d3/da/d15/d2b/d3f 0 2024-04-06T12:23:44.958 INFO:tasks.workunit.client.0.smithi152.stdout:5/198: rmdir d3/d37 39 2024-04-06T12:23:44.958 INFO:tasks.workunit.client.0.smithi152.stdout:0/226: rmdir d4/de/d28 39 2024-04-06T12:23:44.960 INFO:tasks.workunit.client.0.smithi152.stdout:5/199: mkdir d3/da/d15/d40 0 2024-04-06T12:23:44.961 INFO:tasks.workunit.client.0.smithi152.stdout:0/227: write d4/f2b [1323557,28301] 0 2024-04-06T12:23:44.964 INFO:tasks.workunit.client.0.smithi152.stdout:8/271: truncate d4/dc/d10/f2d 1298552 0 2024-04-06T12:23:44.967 INFO:tasks.workunit.client.0.smithi152.stdout:0/228: chown d4/f8 213391845 1 2024-04-06T12:23:44.968 INFO:tasks.workunit.client.0.smithi152.stdout:5/200: write d3/f11 [550550,53313] 0 2024-04-06T12:23:44.970 INFO:tasks.workunit.client.0.smithi152.stdout:8/272: rename d4/d2c/d2b/f38 to d4/dc/f5b 0 2024-04-06T12:23:44.972 INFO:tasks.workunit.client.0.smithi152.stdout:0/229: rmdir d4/de 39 2024-04-06T12:23:44.975 INFO:tasks.workunit.client.0.smithi152.stdout:5/201: symlink d3/da/d15/d32/l41 0 2024-04-06T12:23:44.976 INFO:tasks.workunit.client.0.smithi152.stdout:5/202: chown d3/f16 5954 1 2024-04-06T12:23:44.979 INFO:tasks.workunit.client.0.smithi152.stdout:5/203: unlink d3/c1d 0 2024-04-06T12:23:44.983 INFO:tasks.workunit.client.0.smithi152.stdout:5/204: stat d3/da/d15/d2b/l30 0 2024-04-06T12:23:44.983 INFO:tasks.workunit.client.0.smithi152.stdout:0/230: read d4/de/d28/d18/f2c [1346776,70305] 0 2024-04-06T12:23:44.985 INFO:tasks.workunit.client.0.smithi152.stdout:8/273: write d4/dc/d10/f2d [699311,9945] 0 2024-04-06T12:23:44.987 INFO:tasks.workunit.client.0.smithi152.stdout:5/205: mknod d3/da/d15/d2b/c42 0 2024-04-06T12:23:44.988 INFO:tasks.workunit.client.0.smithi152.stdout:5/206: chown d3/da/fc 4468 1 2024-04-06T12:23:44.988 INFO:tasks.workunit.client.0.smithi152.stdout:0/231: rmdir d4/de/d28/d18 39 2024-04-06T12:23:44.989 INFO:tasks.workunit.client.0.smithi152.stdout:5/207: read d3/f16 [2889906,70357] 0 2024-04-06T12:23:44.990 INFO:tasks.workunit.client.0.smithi152.stdout:5/208: chown d3/d37/f3b 2291055 1 2024-04-06T12:23:44.992 INFO:tasks.workunit.client.0.smithi152.stdout:0/232: mknod d4/de/d28/c50 0 2024-04-06T12:23:44.994 INFO:tasks.workunit.client.0.smithi152.stdout:5/209: creat d3/da/d15/d2b/d3f/f43 x:0 0 0 2024-04-06T12:23:44.996 INFO:tasks.workunit.client.0.smithi152.stdout:5/210: rmdir d3/d9 39 2024-04-06T12:23:45.012 INFO:tasks.workunit.client.0.smithi152.stdout:5/211: dwrite d3/da/f24 [0,4194304] 0 2024-04-06T12:23:45.013 INFO:tasks.workunit.client.0.smithi152.stdout:0/233: dwrite d4/f35 [4194304,4194304] 0 2024-04-06T12:23:45.018 INFO:tasks.workunit.client.0.smithi152.stdout:5/212: mkdir d3/da/d15/d2b/d44 0 2024-04-06T12:23:45.019 INFO:tasks.workunit.client.0.smithi152.stdout:5/213: dread - d3/da/d15/d2b/d3f/f43 zero size 2024-04-06T12:23:45.020 INFO:tasks.workunit.client.0.smithi152.stdout:5/214: write d3/f16 [2312793,54867] 0 2024-04-06T12:23:45.021 INFO:tasks.workunit.client.0.smithi152.stdout:0/234: mkdir d4/d31/d47/d51 0 2024-04-06T12:23:45.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:43.581525+0000 mgr.smithi195.ausetj (mgr.24375) 76 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 998 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2024-04-06T12:23:45.028 INFO:tasks.workunit.client.0.smithi152.stdout:0/235: unlink d4/d36/f3f 0 2024-04-06T12:23:45.037 INFO:tasks.workunit.client.0.smithi152.stdout:5/215: getdents d3/da/d15/d2b 0 2024-04-06T12:23:45.041 INFO:tasks.workunit.client.0.smithi152.stdout:0/236: truncate d4/de/d28/d18/d3b/f2f 776696 0 2024-04-06T12:23:45.041 INFO:tasks.workunit.client.0.smithi152.stdout:0/237: chown f0 0 1 2024-04-06T12:23:45.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:43.581525+0000 mgr.smithi195.ausetj (mgr.24375) 76 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 998 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2024-04-06T12:23:45.050 INFO:tasks.workunit.client.0.smithi152.stdout:5/216: truncate d3/da/d15/f21 444130 0 2024-04-06T12:23:45.053 INFO:tasks.workunit.client.0.smithi152.stdout:0/238: dread f1 [0,4194304] 0 2024-04-06T12:23:45.054 INFO:tasks.workunit.client.0.smithi152.stdout:5/217: creat d3/d37/f45 x:0 0 0 2024-04-06T12:23:45.054 INFO:tasks.workunit.client.0.smithi152.stdout:0/239: write d4/de/d4a/d33/f48 [54553,56109] 0 2024-04-06T12:23:45.056 INFO:tasks.workunit.client.0.smithi152.stdout:0/240: write d4/de/d28/d18/f2c [4657913,8232] 0 2024-04-06T12:23:45.060 INFO:tasks.workunit.client.0.smithi152.stdout:5/218: mkdir d3/da/d15/d40/d46 0 2024-04-06T12:23:45.065 INFO:tasks.workunit.client.0.smithi152.stdout:0/241: creat d4/f52 x:0 0 0 2024-04-06T12:23:45.068 INFO:tasks.workunit.client.0.smithi152.stdout:0/242: creat d4/d19/f53 x:0 0 0 2024-04-06T12:23:45.068 INFO:tasks.workunit.client.0.smithi152.stdout:5/219: dwrite d3/f31 [0,4194304] 0 2024-04-06T12:23:45.069 INFO:tasks.workunit.client.0.smithi152.stdout:0/243: write d4/f8 [1407449,55205] 0 2024-04-06T12:23:45.070 INFO:tasks.workunit.client.0.smithi152.stdout:0/244: fsync d4/d31/f34 0 2024-04-06T12:23:45.072 INFO:tasks.workunit.client.0.smithi152.stdout:0/245: fsync d4/d19/f20 0 2024-04-06T12:23:45.078 INFO:tasks.workunit.client.0.smithi152.stdout:5/220: dwrite d3/d9/f2a [4194304,4194304] 0 2024-04-06T12:23:45.080 INFO:tasks.workunit.client.0.smithi152.stdout:0/246: write f0 [310251,89226] 0 2024-04-06T12:23:45.082 INFO:tasks.workunit.client.0.smithi152.stdout:5/221: creat d3/da/f47 x:0 0 0 2024-04-06T12:23:45.086 INFO:tasks.workunit.client.0.smithi152.stdout:0/247: dread d4/de/d28/f40 [0,4194304] 0 2024-04-06T12:23:45.092 INFO:tasks.workunit.client.0.smithi152.stdout:5/222: creat d3/da/d15/d40/d46/f48 x:0 0 0 2024-04-06T12:23:45.093 INFO:tasks.workunit.client.0.smithi152.stdout:5/223: readlink d3/da/l3a 0 2024-04-06T12:23:45.094 INFO:tasks.workunit.client.0.smithi152.stdout:0/248: dwrite f0 [4194304,4194304] 0 2024-04-06T12:23:45.099 INFO:tasks.workunit.client.0.smithi152.stdout:0/249: symlink d4/de/d4a/l54 0 2024-04-06T12:23:45.099 INFO:tasks.workunit.client.0.smithi152.stdout:0/250: write d4/f52 [864855,6842] 0 2024-04-06T12:23:45.108 INFO:tasks.workunit.client.0.smithi152.stdout:5/224: getdents d3/da 0 2024-04-06T12:23:45.111 INFO:tasks.workunit.client.0.smithi152.stdout:0/251: dwrite d4/d31/f34 [0,4194304] 0 2024-04-06T12:23:45.118 INFO:tasks.workunit.client.0.smithi152.stdout:5/225: dwrite d3/da/d15/d40/d46/f48 [0,4194304] 0 2024-04-06T12:23:45.118 INFO:tasks.workunit.client.0.smithi152.stdout:0/252: symlink d4/de/d28/d18/d43/l55 0 2024-04-06T12:23:45.119 INFO:tasks.workunit.client.0.smithi152.stdout:0/253: stat d4/de/d4a/c4d 0 2024-04-06T12:23:45.121 INFO:tasks.workunit.client.0.smithi152.stdout:5/226: mknod d3/da/d15/d32/c49 0 2024-04-06T12:23:45.124 INFO:tasks.workunit.client.0.smithi152.stdout:5/227: write d3/da/f24 [1564080,49110] 0 2024-04-06T12:23:45.130 INFO:tasks.workunit.client.0.smithi152.stdout:0/254: dwrite d4/d19/f20 [0,4194304] 0 2024-04-06T12:23:45.132 INFO:tasks.workunit.client.0.smithi152.stdout:0/255: write f0 [1524925,1397] 0 2024-04-06T12:23:45.137 INFO:tasks.workunit.client.0.smithi152.stdout:0/256: fsync d4/de/f1e 0 2024-04-06T12:23:45.137 INFO:tasks.workunit.client.0.smithi152.stdout:5/228: dwrite d3/d9/f2a [0,4194304] 0 2024-04-06T12:23:45.141 INFO:tasks.workunit.client.0.smithi152.stdout:0/257: read f0 [3294466,45716] 0 2024-04-06T12:23:45.143 INFO:tasks.workunit.client.0.smithi152.stdout:5/229: creat d3/da/f4a x:0 0 0 2024-04-06T12:23:45.144 INFO:tasks.workunit.client.0.smithi152.stdout:5/230: chown d3/da/d15/d2b 9962419 1 2024-04-06T12:23:45.147 INFO:tasks.workunit.client.0.smithi152.stdout:5/231: creat d3/d9/f4b x:0 0 0 2024-04-06T12:23:45.150 INFO:tasks.workunit.client.0.smithi152.stdout:5/232: mkdir d3/da/d15/d2b/d3f/d4c 0 2024-04-06T12:23:45.150 INFO:tasks.workunit.client.0.smithi152.stdout:0/258: link d4/de/d4a/d33/c44 d4/d19/c56 0 2024-04-06T12:23:45.152 INFO:tasks.workunit.client.0.smithi152.stdout:5/233: mkdir d3/da/d15/d2b/d4d 0 2024-04-06T12:23:45.158 INFO:tasks.workunit.client.0.smithi152.stdout:0/259: dwrite d4/de/d28/d18/f2c [4194304,4194304] 0 2024-04-06T12:23:45.162 INFO:tasks.workunit.client.0.smithi152.stdout:0/260: rename d4/f8 to d4/d36/f57 0 2024-04-06T12:23:45.182 INFO:tasks.workunit.client.0.smithi152.stdout:5/234: truncate d3/da/f29 3358053 0 2024-04-06T12:23:45.188 INFO:tasks.workunit.client.0.smithi152.stdout:0/261: truncate d4/d36/f57 306459 0 2024-04-06T12:23:45.190 INFO:tasks.workunit.client.0.smithi152.stdout:5/235: mkdir d3/da/d15/d40/d4e 0 2024-04-06T12:23:45.197 INFO:tasks.workunit.client.0.smithi152.stdout:5/236: mkdir d3/da/d15/d40/d4f 0 2024-04-06T12:23:45.199 INFO:tasks.workunit.client.0.smithi152.stdout:0/262: fdatasync d4/d36/f57 0 2024-04-06T12:23:45.205 INFO:tasks.workunit.client.0.smithi152.stdout:5/237: rename d3/da/d15/d32 to d3/da/d15/d40/d50 0 2024-04-06T12:23:45.205 INFO:tasks.workunit.client.0.smithi152.stdout:0/263: dread d4/de/d4a/d33/f48 [0,4194304] 0 2024-04-06T12:23:45.208 INFO:tasks.workunit.client.0.smithi152.stdout:0/264: chown d4/de/d28/f40 390271365 1 2024-04-06T12:23:45.209 INFO:tasks.workunit.client.0.smithi152.stdout:0/265: write d4/f4c [43079,127221] 0 2024-04-06T12:23:45.219 INFO:tasks.workunit.client.0.smithi152.stdout:5/238: creat d3/da/d15/d40/d4f/f51 x:0 0 0 2024-04-06T12:23:45.225 INFO:tasks.workunit.client.0.smithi152.stdout:5/239: creat d3/da/d15/d40/d4e/f52 x:0 0 0 2024-04-06T12:23:45.226 INFO:tasks.workunit.client.0.smithi152.stdout:5/240: chown d3/da/d15/d40/d4f/f51 1711 1 2024-04-06T12:23:45.232 INFO:tasks.workunit.client.0.smithi152.stdout:5/241: dwrite d3/d37/f45 [0,4194304] 0 2024-04-06T12:23:45.240 INFO:tasks.workunit.client.0.smithi152.stdout:5/242: dwrite d3/da/d15/d40/d46/f48 [0,4194304] 0 2024-04-06T12:23:45.241 INFO:tasks.workunit.client.0.smithi152.stdout:5/243: fdatasync d3/d9/f27 0 2024-04-06T12:23:45.251 INFO:tasks.workunit.client.0.smithi152.stdout:5/244: getdents d3/da/d15/d40/d4e 0 2024-04-06T12:23:45.264 INFO:tasks.workunit.client.0.smithi152.stdout:5/245: truncate d3/d9/f27 92914 0 2024-04-06T12:23:45.265 INFO:tasks.workunit.client.0.smithi152.stdout:5/246: truncate d3/d9/f4b 762479 0 2024-04-06T12:23:45.265 INFO:tasks.workunit.client.0.smithi152.stdout:5/247: chown d3/da/l25 261319525 1 2024-04-06T12:23:45.267 INFO:tasks.workunit.client.0.smithi152.stdout:5/248: truncate d3/da/d15/d40/d4e/f52 531116 0 2024-04-06T12:23:45.270 INFO:tasks.workunit.client.0.smithi152.stdout:5/249: truncate d3/d37/f3b 1194744 0 2024-04-06T12:23:45.272 INFO:tasks.workunit.client.0.smithi152.stdout:5/250: mkdir d3/da/d53 0 2024-04-06T12:23:45.274 INFO:tasks.workunit.client.0.smithi152.stdout:5/251: creat d3/da/d15/d40/d4f/f54 x:0 0 0 2024-04-06T12:23:45.275 INFO:tasks.workunit.client.0.smithi152.stdout:5/252: fsync d3/de/f35 0 2024-04-06T12:23:45.280 INFO:tasks.workunit.client.0.smithi152.stdout:5/253: dwrite d3/da/f47 [0,4194304] 0 2024-04-06T12:23:45.282 INFO:tasks.workunit.client.0.smithi152.stdout:5/254: dread d3/f11 [0,4194304] 0 2024-04-06T12:23:45.306 INFO:tasks.workunit.client.0.smithi152.stdout:5/255: write d3/d9/fb [395133,84489] 0 2024-04-06T12:23:45.518 INFO:tasks.workunit.client.0.smithi152.stdout:9/144: sync 2024-04-06T12:23:45.518 INFO:tasks.workunit.client.0.smithi152.stdout:3/197: sync 2024-04-06T12:23:45.518 INFO:tasks.workunit.client.0.smithi152.stdout:9/145: chown d5/d6/d15/d17 55887 1 2024-04-06T12:23:45.519 INFO:tasks.workunit.client.0.smithi152.stdout:9/146: write d5/d6/f2c [1034626,109611] 0 2024-04-06T12:23:45.521 INFO:tasks.workunit.client.0.smithi152.stdout:9/147: dread - d5/d6/f28 zero size 2024-04-06T12:23:45.523 INFO:tasks.workunit.client.0.smithi152.stdout:3/198: rename d0/d10/d13/l31 to d0/d35/l3e 0 2024-04-06T12:23:45.525 INFO:tasks.workunit.client.0.smithi152.stdout:9/148: rmdir d5/d6/d15/d17 39 2024-04-06T12:23:45.525 INFO:tasks.workunit.client.0.smithi152.stdout:9/149: fdatasync d5/d6/f28 0 2024-04-06T12:23:45.528 INFO:tasks.workunit.client.0.smithi152.stdout:3/199: unlink d0/f8 0 2024-04-06T12:23:45.529 INFO:tasks.workunit.client.0.smithi152.stdout:9/150: fsync d5/f10 0 2024-04-06T12:23:45.531 INFO:tasks.workunit.client.0.smithi152.stdout:9/151: dread d5/d6/f24 [0,4194304] 0 2024-04-06T12:23:45.534 INFO:tasks.workunit.client.0.smithi152.stdout:3/200: link d0/d1f/l33 d0/d10/d1e/d39/d3d/l3f 0 2024-04-06T12:23:45.536 INFO:tasks.workunit.client.0.smithi152.stdout:9/152: mknod d5/d6/d15/d17/d23/d2d/c34 0 2024-04-06T12:23:45.540 INFO:tasks.workunit.client.0.smithi152.stdout:9/153: write d5/d6/f24 [442080,42543] 0 2024-04-06T12:23:45.541 INFO:tasks.workunit.client.0.smithi152.stdout:3/201: dwrite d0/fb [0,4194304] 0 2024-04-06T12:23:45.542 INFO:tasks.workunit.client.0.smithi152.stdout:3/202: chown d0/d10/l24 135687 1 2024-04-06T12:23:45.542 INFO:tasks.workunit.client.0.smithi152.stdout:3/203: chown d0 222672 1 2024-04-06T12:23:45.543 INFO:tasks.workunit.client.0.smithi152.stdout:3/204: write d0/d10/d13/f32 [7200836,105238] 0 2024-04-06T12:23:45.545 INFO:tasks.workunit.client.0.smithi152.stdout:9/154: write d5/f10 [1259393,28464] 0 2024-04-06T12:23:45.549 INFO:tasks.workunit.client.0.smithi152.stdout:3/205: rename d0/d1f/l34 to d0/d1f/l40 0 2024-04-06T12:23:45.550 INFO:tasks.workunit.client.0.smithi152.stdout:3/206: dread - d0/d10/d1e/f1d zero size 2024-04-06T12:23:45.553 INFO:tasks.workunit.client.0.smithi152.stdout:3/207: mknod d0/d2d/c41 0 2024-04-06T12:23:45.555 INFO:tasks.workunit.client.0.smithi152.stdout:9/155: creat d5/f35 x:0 0 0 2024-04-06T12:23:45.558 INFO:tasks.workunit.client.0.smithi152.stdout:9/156: dread d5/d6/f24 [0,4194304] 0 2024-04-06T12:23:45.560 INFO:tasks.workunit.client.0.smithi152.stdout:9/157: mkdir d5/d6/d15/d17/d23/d2d/d32/d36 0 2024-04-06T12:23:45.561 INFO:tasks.workunit.client.0.smithi152.stdout:9/158: write d5/d6/f2c [337689,79350] 0 2024-04-06T12:23:45.715 INFO:tasks.workunit.client.0.smithi152.stdout:2/265: sync 2024-04-06T12:23:45.715 INFO:tasks.workunit.client.0.smithi152.stdout:7/124: sync 2024-04-06T12:23:45.715 INFO:tasks.workunit.client.0.smithi152.stdout:4/168: sync 2024-04-06T12:23:45.715 INFO:tasks.workunit.client.0.smithi152.stdout:1/219: sync 2024-04-06T12:23:45.716 INFO:tasks.workunit.client.0.smithi152.stdout:2/266: chown d0/d2/c57 17707597 1 2024-04-06T12:23:45.717 INFO:tasks.workunit.client.0.smithi152.stdout:7/125: read d8/dc/f24 [129140,123674] 0 2024-04-06T12:23:45.728 INFO:tasks.workunit.client.0.smithi152.stdout:1/220: dwrite d2/d1d/f3e [0,4194304] 0 2024-04-06T12:23:45.729 INFO:tasks.workunit.client.0.smithi152.stdout:2/267: dwrite d0/fd [4194304,4194304] 0 2024-04-06T12:23:45.733 INFO:tasks.workunit.client.0.smithi152.stdout:7/126: creat d8/d2a/f2e x:0 0 0 2024-04-06T12:23:45.733 INFO:tasks.workunit.client.0.smithi152.stdout:1/221: fdatasync d2/f1b 0 2024-04-06T12:23:45.737 INFO:tasks.workunit.client.0.smithi152.stdout:9/159: dwrite d5/d6/f14 [0,4194304] 0 2024-04-06T12:23:45.739 INFO:tasks.workunit.client.0.smithi152.stdout:1/222: readlink d2/d1d/d21/d28/l38 0 2024-04-06T12:23:45.741 INFO:tasks.workunit.client.0.smithi152.stdout:1/223: write d2/f18 [2963697,62595] 0 2024-04-06T12:23:45.742 INFO:tasks.workunit.client.0.smithi152.stdout:2/268: symlink d0/d40/d41/d28/l5e 0 2024-04-06T12:23:45.744 INFO:tasks.workunit.client.0.smithi152.stdout:4/169: rename d7/d16/d22/f28 to d7/f2c 0 2024-04-06T12:23:45.746 INFO:tasks.workunit.client.0.smithi152.stdout:9/160: mkdir d5/d6/d15/d17/d37 0 2024-04-06T12:23:45.749 INFO:tasks.workunit.client.0.smithi152.stdout:1/224: unlink d2/d1d/d21/l3c 0 2024-04-06T12:23:45.751 INFO:tasks.workunit.client.0.smithi152.stdout:4/170: mknod d7/d29/c2d 0 2024-04-06T12:23:45.752 INFO:tasks.workunit.client.0.smithi152.stdout:9/161: symlink d5/d6/d15/d17/d23/l38 0 2024-04-06T12:23:45.754 INFO:tasks.workunit.client.0.smithi152.stdout:9/162: write d5/d6/d15/d17/f19 [3236412,117838] 0 2024-04-06T12:23:45.756 INFO:tasks.workunit.client.0.smithi152.stdout:1/225: mknod d2/d1d/d21/d28/c51 0 2024-04-06T12:23:45.758 INFO:tasks.workunit.client.0.smithi152.stdout:4/171: mkdir d7/d29/d2e 0 2024-04-06T12:23:45.759 INFO:tasks.workunit.client.0.smithi152.stdout:4/172: write d7/f2a [969342,19519] 0 2024-04-06T12:23:45.767 INFO:tasks.workunit.client.0.smithi152.stdout:1/226: symlink d2/d2f/d45/l52 0 2024-04-06T12:23:45.767 INFO:tasks.workunit.client.0.smithi152.stdout:7/127: link d8/la d8/dc/l2f 0 2024-04-06T12:23:45.770 INFO:tasks.workunit.client.0.smithi152.stdout:2/269: write d0/d15/d24/d3d/f4f [2236284,92467] 0 2024-04-06T12:23:45.772 INFO:tasks.workunit.client.0.smithi152.stdout:9/163: mkdir d5/d39 0 2024-04-06T12:23:45.773 INFO:tasks.workunit.client.0.smithi152.stdout:2/270: write d0/f29 [757384,94606] 0 2024-04-06T12:23:45.774 INFO:tasks.workunit.client.0.smithi152.stdout:1/227: mknod d2/d2f/d45/c53 0 2024-04-06T12:23:45.775 INFO:tasks.workunit.client.0.smithi152.stdout:9/164: read - d5/d6/d15/d17/f22 zero size 2024-04-06T12:23:45.776 INFO:tasks.workunit.client.0.smithi152.stdout:7/128: dwrite d8/df/f11 [0,4194304] 0 2024-04-06T12:23:45.777 INFO:tasks.workunit.client.0.smithi152.stdout:9/165: chown d5/d6/d15/d17/d23/c21 14 1 2024-04-06T12:23:45.778 INFO:tasks.workunit.client.0.smithi152.stdout:4/173: mkdir d7/d29/d2e/d2f 0 2024-04-06T12:23:45.783 INFO:tasks.workunit.client.0.smithi152.stdout:2/271: chown d0/d40/d41/l34 420004646 1 2024-04-06T12:23:45.785 INFO:tasks.workunit.client.0.smithi152.stdout:2/272: chown d0/d15/d24/d3d/l1e 1158 1 2024-04-06T12:23:45.786 INFO:tasks.workunit.client.0.smithi152.stdout:9/166: dwrite d5/d6/f14 [4194304,4194304] 0 2024-04-06T12:23:45.786 INFO:tasks.workunit.client.0.smithi152.stdout:7/129: symlink d8/df/l30 0 2024-04-06T12:23:45.794 INFO:tasks.workunit.client.0.smithi152.stdout:9/167: symlink d5/d6/d15/d17/d37/l3a 0 2024-04-06T12:23:45.794 INFO:tasks.workunit.client.0.smithi152.stdout:7/130: dread f3 [4194304,4194304] 0 2024-04-06T12:23:45.795 INFO:tasks.workunit.client.0.smithi152.stdout:7/131: chown d8/dc/f24 39 1 2024-04-06T12:23:45.797 INFO:tasks.workunit.client.0.smithi152.stdout:9/168: symlink d5/l3b 0 2024-04-06T12:23:45.798 INFO:tasks.workunit.client.0.smithi152.stdout:9/169: write d5/d6/f7 [3092059,23403] 0 2024-04-06T12:23:45.798 INFO:tasks.workunit.client.0.smithi152.stdout:7/132: symlink d8/df/l31 0 2024-04-06T12:23:45.800 INFO:tasks.workunit.client.0.smithi152.stdout:4/174: rmdir d7 39 2024-04-06T12:23:45.807 INFO:tasks.workunit.client.0.smithi152.stdout:4/175: unlink d7/c1c 0 2024-04-06T12:23:45.808 INFO:tasks.workunit.client.0.smithi152.stdout:7/133: getdents d8/dc/d17/d2c/d2d 0 2024-04-06T12:23:45.809 INFO:tasks.workunit.client.0.smithi152.stdout:4/176: truncate d7/d29/f2b 5879 0 2024-04-06T12:23:45.811 INFO:tasks.workunit.client.0.smithi152.stdout:7/134: write f3 [8251840,125358] 0 2024-04-06T12:23:45.811 INFO:tasks.workunit.client.0.smithi152.stdout:2/273: dwrite d0/f13 [0,4194304] 0 2024-04-06T12:23:45.813 INFO:tasks.workunit.client.0.smithi152.stdout:4/177: mkdir d7/d16/d22/d30 0 2024-04-06T12:23:45.814 INFO:tasks.workunit.client.0.smithi152.stdout:9/170: truncate d5/d6/fd 3865880 0 2024-04-06T12:23:45.814 INFO:tasks.workunit.client.0.smithi152.stdout:4/178: read d7/f2a [862475,66531] 0 2024-04-06T12:23:45.815 INFO:tasks.workunit.client.0.smithi152.stdout:4/179: readlink l4 0 2024-04-06T12:23:45.815 INFO:tasks.workunit.client.0.smithi152.stdout:7/135: chown d8/c20 156047 1 2024-04-06T12:23:45.816 INFO:tasks.workunit.client.0.smithi152.stdout:4/180: write d7/f17 [2135363,67201] 0 2024-04-06T12:23:45.816 INFO:tasks.workunit.client.0.smithi152.stdout:7/136: write d8/dc/f23 [888612,60348] 0 2024-04-06T12:23:45.818 INFO:tasks.workunit.client.0.smithi152.stdout:7/137: write f6 [134648,75277] 0 2024-04-06T12:23:45.818 INFO:tasks.workunit.client.0.smithi152.stdout:9/171: creat d5/d6/f3c x:0 0 0 2024-04-06T12:23:45.824 INFO:tasks.workunit.client.0.smithi152.stdout:4/181: mknod d7/d16/c31 0 2024-04-06T12:23:45.827 INFO:tasks.workunit.client.0.smithi152.stdout:9/172: dread d5/d6/d15/d17/f19 [0,4194304] 0 2024-04-06T12:23:45.827 INFO:tasks.workunit.client.0.smithi152.stdout:7/138: write d8/f16 [811197,44356] 0 2024-04-06T12:23:45.833 INFO:tasks.workunit.client.0.smithi152.stdout:2/274: dread d0/d2/f21 [0,4194304] 0 2024-04-06T12:23:45.834 INFO:tasks.workunit.client.0.smithi152.stdout:2/275: chown d0/d15/d24/c37 97121 1 2024-04-06T12:23:45.837 INFO:tasks.workunit.client.0.smithi152.stdout:7/139: chown d8/fb 25005 1 2024-04-06T12:23:45.843 INFO:tasks.workunit.client.0.smithi152.stdout:7/140: dwrite d8/dc/f13 [0,4194304] 0 2024-04-06T12:23:45.845 INFO:tasks.workunit.client.0.smithi152.stdout:7/141: dread d8/fb [0,4194304] 0 2024-04-06T12:23:45.850 INFO:tasks.workunit.client.0.smithi152.stdout:2/276: unlink d0/d15/d24/c37 0 2024-04-06T12:23:45.850 INFO:tasks.workunit.client.0.smithi152.stdout:2/277: chown d0/d2 87029462 1 2024-04-06T12:23:45.850 INFO:tasks.workunit.client.0.smithi152.stdout:2/278: chown d0/d2/c57 58240905 1 2024-04-06T12:23:45.850 INFO:tasks.workunit.client.0.smithi152.stdout:7/142: dread d8/df/f11 [0,4194304] 0 2024-04-06T12:23:45.851 INFO:tasks.workunit.client.0.smithi152.stdout:7/143: truncate f6 1306917 0 2024-04-06T12:23:45.851 INFO:tasks.workunit.client.0.smithi152.stdout:2/279: truncate d0/d40/d41/f5c 657579 0 2024-04-06T12:23:45.853 INFO:tasks.workunit.client.0.smithi152.stdout:9/173: link d5/d6/d15/d17/f22 d5/d39/f3d 0 2024-04-06T12:23:45.859 INFO:tasks.workunit.client.0.smithi152.stdout:4/182: rename d7/c19 to d7/c32 0 2024-04-06T12:23:45.860 INFO:tasks.workunit.client.0.smithi152.stdout:7/144: dwrite d8/d2a/f2e [0,4194304] 0 2024-04-06T12:23:45.861 INFO:tasks.workunit.client.0.smithi152.stdout:4/183: readlink d7/l10 0 2024-04-06T12:23:45.864 INFO:tasks.workunit.client.0.smithi152.stdout:2/280: mkdir d0/d40/d41/d28/d5f 0 2024-04-06T12:23:45.865 INFO:tasks.workunit.client.0.smithi152.stdout:9/174: dwrite d5/d6/f3c [0,4194304] 0 2024-04-06T12:23:45.866 INFO:tasks.workunit.client.0.smithi152.stdout:2/281: chown d0/d15/d24/d3d/l1e 12991703 1 2024-04-06T12:23:45.868 INFO:tasks.workunit.client.0.smithi152.stdout:4/184: dread f1 [0,4194304] 0 2024-04-06T12:23:45.870 INFO:tasks.workunit.client.0.smithi152.stdout:2/282: truncate d0/d40/f56 975518 0 2024-04-06T12:23:45.870 INFO:tasks.workunit.client.0.smithi152.stdout:7/145: dread d8/dc/f23 [0,4194304] 0 2024-04-06T12:23:45.880 INFO:tasks.workunit.client.0.smithi152.stdout:4/185: unlink d7/l1f 0 2024-04-06T12:23:45.882 INFO:tasks.workunit.client.0.smithi152.stdout:2/283: creat d0/f60 x:0 0 0 2024-04-06T12:23:45.884 INFO:tasks.workunit.client.0.smithi152.stdout:9/175: dread d5/d6/f16 [0,4194304] 0 2024-04-06T12:23:45.885 INFO:tasks.workunit.client.0.smithi152.stdout:4/186: dread d7/fb [0,4194304] 0 2024-04-06T12:23:45.888 INFO:tasks.workunit.client.0.smithi152.stdout:7/146: creat d8/dc/d17/d2c/d2d/f32 x:0 0 0 2024-04-06T12:23:45.889 INFO:tasks.workunit.client.0.smithi152.stdout:7/147: write d8/f1b [1613329,99675] 0 2024-04-06T12:23:45.889 INFO:tasks.workunit.client.0.smithi152.stdout:7/148: chown d8/d2a 12 1 2024-04-06T12:23:45.890 INFO:tasks.workunit.client.0.smithi152.stdout:2/284: creat d0/d40/d41/d28/f61 x:0 0 0 2024-04-06T12:23:45.890 INFO:tasks.workunit.client.0.smithi152.stdout:2/285: chown d0/f29 99652 1 2024-04-06T12:23:45.897 INFO:tasks.workunit.client.0.smithi152.stdout:9/176: link d5/ce d5/d6/d15/d17/d23/d2d/d32/c3e 0 2024-04-06T12:23:45.898 INFO:tasks.workunit.client.0.smithi152.stdout:6/265: sync 2024-04-06T12:23:45.898 INFO:tasks.workunit.client.0.smithi152.stdout:8/274: sync 2024-04-06T12:23:45.898 INFO:tasks.workunit.client.0.smithi152.stdout:0/266: sync 2024-04-06T12:23:45.898 INFO:tasks.workunit.client.0.smithi152.stdout:5/256: sync 2024-04-06T12:23:45.902 INFO:tasks.workunit.client.0.smithi152.stdout:7/149: dwrite d8/dc/d17/f1a [0,4194304] 0 2024-04-06T12:23:45.902 INFO:tasks.workunit.client.0.smithi152.stdout:5/257: dread - d3/da/d15/d40/d4f/f54 zero size 2024-04-06T12:23:45.907 INFO:tasks.workunit.client.0.smithi152.stdout:5/258: dread d3/da/f47 [0,4194304] 0 2024-04-06T12:23:45.910 INFO:tasks.workunit.client.0.smithi152.stdout:0/267: write f3 [5331306,74162] 0 2024-04-06T12:23:45.910 INFO:tasks.workunit.client.0.smithi152.stdout:2/286: dread d0/f1c [0,4194304] 0 2024-04-06T12:23:45.911 INFO:tasks.workunit.client.0.smithi152.stdout:9/177: mkdir d5/d39/d3f 0 2024-04-06T12:23:45.911 INFO:tasks.workunit.client.0.smithi152.stdout:0/268: chown d4/de/d28/f22 30854 1 2024-04-06T12:23:45.912 INFO:tasks.workunit.client.0.smithi152.stdout:6/266: mknod d7/d19/d1b/c5f 0 2024-04-06T12:23:45.917 INFO:tasks.workunit.client.0.smithi152.stdout:8/275: unlink d4/db/d2a/f4e 0 2024-04-06T12:23:45.918 INFO:tasks.workunit.client.0.smithi152.stdout:5/259: mknod d3/da/d15/c55 0 2024-04-06T12:23:45.919 INFO:tasks.workunit.client.0.smithi152.stdout:9/178: write d5/d6/f24 [900402,68791] 0 2024-04-06T12:23:45.920 INFO:tasks.workunit.client.0.smithi152.stdout:0/269: chown d4/c12 2588645 1 2024-04-06T12:23:45.921 INFO:tasks.workunit.client.0.smithi152.stdout:0/270: chown d4/de/d28/c4f 1153576 1 2024-04-06T12:23:45.922 INFO:tasks.workunit.client.0.smithi152.stdout:0/271: write d4/de/d28/d18/f2c [8012982,12527] 0 2024-04-06T12:23:45.923 INFO:tasks.workunit.client.0.smithi152.stdout:2/287: creat d0/d40/f62 x:0 0 0 2024-04-06T12:23:45.923 INFO:tasks.workunit.client.0.smithi152.stdout:2/288: fsync d0/f60 0 2024-04-06T12:23:45.925 INFO:tasks.workunit.client.0.smithi152.stdout:6/267: creat d7/d19/d1b/d31/d35/f60 x:0 0 0 2024-04-06T12:23:45.928 INFO:tasks.workunit.client.0.smithi152.stdout:8/276: unlink d4/db/f53 0 2024-04-06T12:23:45.928 INFO:tasks.workunit.client.0.smithi152.stdout:5/260: rmdir d3/d9 39 2024-04-06T12:23:45.929 INFO:tasks.workunit.client.0.smithi152.stdout:5/261: readlink d3/da/d15/d2b/l30 0 2024-04-06T12:23:45.930 INFO:tasks.workunit.client.0.smithi152.stdout:9/179: fdatasync d5/d6/d15/d17/f19 0 2024-04-06T12:23:45.931 INFO:tasks.workunit.client.0.smithi152.stdout:9/180: dread - d5/d6/d15/d17/f22 zero size 2024-04-06T12:23:45.935 INFO:tasks.workunit.client.0.smithi152.stdout:2/289: mkdir d0/d40/d41/d63 0 2024-04-06T12:23:45.939 INFO:tasks.workunit.client.0.smithi152.stdout:0/272: write d4/d19/f4e [996280,14854] 0 2024-04-06T12:23:45.948 INFO:tasks.workunit.client.0.smithi152.stdout:2/290: rename d0/d2/c4a to d0/c64 0 2024-04-06T12:23:45.949 INFO:tasks.workunit.client.0.smithi152.stdout:7/150: getdents d8/df 0 2024-04-06T12:23:45.951 INFO:tasks.workunit.client.0.smithi152.stdout:9/181: dread d5/f10 [0,4194304] 0 2024-04-06T12:23:45.953 INFO:tasks.workunit.client.0.smithi152.stdout:9/182: dread - d5/d6/d15/d17/f22 zero size 2024-04-06T12:23:45.953 INFO:tasks.workunit.client.0.smithi152.stdout:0/273: dread d4/de/d28/d18/f2c [0,4194304] 0 2024-04-06T12:23:45.954 INFO:tasks.workunit.client.0.smithi152.stdout:8/277: mknod d4/db/d56/c5c 0 2024-04-06T12:23:45.955 INFO:tasks.workunit.client.0.smithi152.stdout:5/262: chown d3/d9/f27 78275733 1 2024-04-06T12:23:45.958 INFO:tasks.workunit.client.0.smithi152.stdout:6/268: truncate d7/d19/f30 2993720 0 2024-04-06T12:23:45.960 INFO:tasks.workunit.client.0.smithi152.stdout:7/151: mkdir d8/dc/d17/d2c/d33 0 2024-04-06T12:23:45.964 INFO:tasks.workunit.client.0.smithi152.stdout:0/274: rename d4/d36/f57 to d4/d31/f58 0 2024-04-06T12:23:45.966 INFO:tasks.workunit.client.0.smithi152.stdout:8/278: creat d4/d2c/d54/f5d x:0 0 0 2024-04-06T12:23:45.968 INFO:tasks.workunit.client.0.smithi152.stdout:5/263: creat d3/d37/f56 x:0 0 0 2024-04-06T12:23:45.969 INFO:tasks.workunit.client.0.smithi152.stdout:9/183: write d5/d39/f3d [258611,2801] 0 2024-04-06T12:23:45.969 INFO:tasks.workunit.client.0.smithi152.stdout:5/264: read - d3/de/f2e zero size 2024-04-06T12:23:45.970 INFO:tasks.workunit.client.0.smithi152.stdout:2/291: mknod d0/d2/d5/c65 0 2024-04-06T12:23:45.971 INFO:tasks.workunit.client.0.smithi152.stdout:2/292: chown d0/d15/d4d/f55 218845809 1 2024-04-06T12:23:45.972 INFO:tasks.workunit.client.0.smithi152.stdout:7/152: rmdir d8 39 2024-04-06T12:23:45.975 INFO:tasks.workunit.client.0.smithi152.stdout:5/265: dread d3/f16 [0,4194304] 0 2024-04-06T12:23:45.975 INFO:tasks.workunit.client.0.smithi152.stdout:6/269: rename d7/d19/d1b/d31/l50 to d7/d19/d1b/d22/l61 0 2024-04-06T12:23:45.978 INFO:tasks.workunit.client.0.smithi152.stdout:6/270: truncate d7/f1e 4312562 0 2024-04-06T12:23:45.979 INFO:tasks.workunit.client.0.smithi152.stdout:2/293: dwrite d0/d40/f56 [0,4194304] 0 2024-04-06T12:23:45.981 INFO:tasks.workunit.client.0.smithi152.stdout:6/271: write d7/d9/d26/d4a/f58 [363615,124467] 0 2024-04-06T12:23:45.981 INFO:tasks.workunit.client.0.smithi152.stdout:7/153: write d8/dc/fe [3186722,14415] 0 2024-04-06T12:23:45.986 INFO:tasks.workunit.client.0.smithi152.stdout:0/275: symlink d4/l59 0 2024-04-06T12:23:45.986 INFO:tasks.workunit.client.0.smithi152.stdout:6/272: chown d7/d9/f18 0 1 2024-04-06T12:23:45.989 INFO:tasks.workunit.client.0.smithi152.stdout:9/184: symlink d5/l40 0 2024-04-06T12:23:45.990 INFO:tasks.workunit.client.0.smithi152.stdout:9/185: chown d5/d6/d15/d17/d23/d2d/d32 313 1 2024-04-06T12:23:45.990 INFO:tasks.workunit.client.0.smithi152.stdout:9/186: readlink d5/d6/d15/l18 0 2024-04-06T12:23:45.995 INFO:tasks.workunit.client.0.smithi152.stdout:0/276: write d4/de/d4a/d33/f48 [126699,109882] 0 2024-04-06T12:23:45.996 INFO:tasks.workunit.client.0.smithi152.stdout:6/273: chown d7/d19/f30 881 1 2024-04-06T12:23:45.996 INFO:tasks.workunit.client.0.smithi152.stdout:9/187: rmdir d5/d6/d15/d17/d23/d2d 39 2024-04-06T12:23:45.997 INFO:tasks.workunit.client.0.smithi152.stdout:0/277: dread d4/d31/f58 [0,4194304] 0 2024-04-06T12:23:45.998 INFO:tasks.workunit.client.0.smithi152.stdout:9/188: chown d5/d6/d15/d17/d23/c2e 15 1 2024-04-06T12:23:45.999 INFO:tasks.workunit.client.0.smithi152.stdout:0/278: read d4/de/d28/d18/d3b/f2f [630469,37954] 0 2024-04-06T12:23:45.999 INFO:tasks.workunit.client.0.smithi152.stdout:5/266: write d3/de/f22 [4954065,55232] 0 2024-04-06T12:23:46.000 INFO:tasks.workunit.client.0.smithi152.stdout:9/189: chown d5/d6/f16 295455 1 2024-04-06T12:23:46.002 INFO:tasks.workunit.client.0.smithi152.stdout:9/190: chown d5/d39 1740 1 2024-04-06T12:23:46.005 INFO:tasks.workunit.client.0.smithi152.stdout:0/279: dread d4/d19/f41 [0,4194304] 0 2024-04-06T12:23:46.006 INFO:tasks.workunit.client.0.smithi152.stdout:0/280: chown d4/d19/f4e 0 1 2024-04-06T12:23:46.008 INFO:tasks.workunit.client.0.smithi152.stdout:5/267: dwrite d3/d9/f2a [4194304,4194304] 0 2024-04-06T12:23:46.009 INFO:tasks.workunit.client.0.smithi152.stdout:0/281: write d4/f4c [689316,87169] 0 2024-04-06T12:23:46.011 INFO:tasks.workunit.client.0.smithi152.stdout:0/282: stat d4/de 0 2024-04-06T12:23:46.013 INFO:tasks.workunit.client.0.smithi152.stdout:9/191: creat d5/d6/d15/d17/d37/f41 x:0 0 0 2024-04-06T12:23:46.013 INFO:tasks.workunit.client.0.smithi152.stdout:7/154: dwrite d8/f16 [0,4194304] 0 2024-04-06T12:23:46.020 INFO:tasks.workunit.client.0.smithi152.stdout:0/283: fsync d4/de/f11 0 2024-04-06T12:23:46.024 INFO:tasks.workunit.client.0.smithi152.stdout:6/274: dwrite d7/d19/d1b/d22/f29 [0,4194304] 0 2024-04-06T12:23:46.024 INFO:tasks.workunit.client.0.smithi152.stdout:7/155: mkdir d8/df/d34 0 2024-04-06T12:23:46.025 INFO:tasks.workunit.client.0.smithi152.stdout:6/275: dread - d7/d19/d3e/f40 zero size 2024-04-06T12:23:46.025 INFO:tasks.workunit.client.0.smithi152.stdout:0/284: creat d4/de/d28/d18/d3b/f5a x:0 0 0 2024-04-06T12:23:46.026 INFO:tasks.workunit.client.0.smithi152.stdout:6/276: fsync d7/fb 0 2024-04-06T12:23:46.029 INFO:tasks.workunit.client.0.smithi152.stdout:9/192: mkdir d5/d39/d3f/d42 0 2024-04-06T12:23:46.030 INFO:tasks.workunit.client.0.smithi152.stdout:5/268: rmdir d3/da/d15/d2b/d44 0 2024-04-06T12:23:46.033 INFO:tasks.workunit.client.0.smithi152.stdout:0/285: creat d4/d36/f5b x:0 0 0 2024-04-06T12:23:46.035 INFO:tasks.workunit.client.0.smithi152.stdout:6/277: mkdir d7/d62 0 2024-04-06T12:23:46.036 INFO:tasks.workunit.client.0.smithi152.stdout:9/193: symlink d5/d6/d15/d17/d23/l43 0 2024-04-06T12:23:46.037 INFO:tasks.workunit.client.0.smithi152.stdout:9/194: read - d5/d6/f28 zero size 2024-04-06T12:23:46.038 INFO:tasks.workunit.client.0.smithi152.stdout:0/286: unlink d4/d19/f20 0 2024-04-06T12:23:46.045 INFO:tasks.workunit.client.0.smithi152.stdout:5/269: dread d3/f7 [0,4194304] 0 2024-04-06T12:23:46.046 INFO:tasks.workunit.client.0.smithi152.stdout:5/270: chown d3/d37 224093893 1 2024-04-06T12:23:46.048 INFO:tasks.workunit.client.0.smithi152.stdout:0/287: creat d4/d31/f5c x:0 0 0 2024-04-06T12:23:46.048 INFO:tasks.workunit.client.0.smithi152.stdout:0/288: fdatasync d4/de/d28/d18/d3b/f5a 0 2024-04-06T12:23:46.049 INFO:tasks.workunit.client.0.smithi152.stdout:6/278: creat d7/d62/f63 x:0 0 0 2024-04-06T12:23:46.050 INFO:tasks.workunit.client.0.smithi152.stdout:6/279: dread - d7/d62/f63 zero size 2024-04-06T12:23:46.051 INFO:tasks.workunit.client.0.smithi152.stdout:5/271: write d3/da/fc [1369665,114876] 0 2024-04-06T12:23:46.056 INFO:tasks.workunit.client.0.smithi152.stdout:0/289: mknod d4/c5d 0 2024-04-06T12:23:46.057 INFO:tasks.workunit.client.0.smithi152.stdout:9/195: getdents d5/d6/d15/d17 0 2024-04-06T12:23:46.061 INFO:tasks.workunit.client.0.smithi152.stdout:5/272: dwrite d3/da/f13 [0,4194304] 0 2024-04-06T12:23:46.064 INFO:tasks.workunit.client.0.smithi152.stdout:0/290: unlink d4/de/d4a/c2d 0 2024-04-06T12:23:46.066 INFO:tasks.workunit.client.0.smithi152.stdout:7/156: write d8/dc/f24 [500132,2542] 0 2024-04-06T12:23:46.069 INFO:tasks.workunit.client.0.smithi152.stdout:7/157: chown d8/dc/f13 1044 1 2024-04-06T12:23:46.073 INFO:tasks.workunit.client.0.smithi152.stdout:9/196: dwrite d5/d6/d15/d17/d37/f41 [0,4194304] 0 2024-04-06T12:23:46.073 INFO:tasks.workunit.client.0.smithi152.stdout:7/158: write d8/df/f25 [1005618,30367] 0 2024-04-06T12:23:46.075 INFO:tasks.workunit.client.0.smithi152.stdout:6/280: dread d7/fd [0,4194304] 0 2024-04-06T12:23:46.077 INFO:tasks.workunit.client.0.smithi152.stdout:9/197: chown d5/d6/d15/d17/f22 1 1 2024-04-06T12:23:46.078 INFO:tasks.workunit.client.0.smithi152.stdout:7/159: chown d8/df/d34 73413356 1 2024-04-06T12:23:46.079 INFO:tasks.workunit.client.0.smithi152.stdout:0/291: truncate d4/de/f11 77975 0 2024-04-06T12:23:46.081 INFO:tasks.workunit.client.0.smithi152.stdout:5/273: dwrite d3/d9/f2a [4194304,4194304] 0 2024-04-06T12:23:46.083 INFO:tasks.workunit.client.0.smithi152.stdout:9/198: write d5/f35 [518612,114848] 0 2024-04-06T12:23:46.084 INFO:tasks.workunit.client.0.smithi152.stdout:6/281: symlink d7/d9/d26/d2e/l64 0 2024-04-06T12:23:46.086 INFO:tasks.workunit.client.0.smithi152.stdout:0/292: symlink d4/de/l5e 0 2024-04-06T12:23:46.086 INFO:tasks.workunit.client.0.smithi152.stdout:5/274: creat d3/da/d15/d40/d4f/f57 x:0 0 0 2024-04-06T12:23:46.088 INFO:tasks.workunit.client.0.smithi152.stdout:7/160: symlink d8/dc/d17/d2c/d33/l35 0 2024-04-06T12:23:46.088 INFO:tasks.workunit.client.0.smithi152.stdout:5/275: fdatasync d3/d9/fb 0 2024-04-06T12:23:46.089 INFO:tasks.workunit.client.0.smithi152.stdout:9/199: mknod d5/d6/d15/d17/d37/c44 0 2024-04-06T12:23:46.090 INFO:tasks.workunit.client.0.smithi152.stdout:6/282: mknod d7/d62/c65 0 2024-04-06T12:23:46.090 INFO:tasks.workunit.client.0.smithi152.stdout:9/200: truncate d5/d39/f3d 742029 0 2024-04-06T12:23:46.092 INFO:tasks.workunit.client.0.smithi152.stdout:9/201: write d5/d6/f28 [100835,36895] 0 2024-04-06T12:23:46.092 INFO:tasks.workunit.client.0.smithi152.stdout:0/293: creat d4/de/d28/d18/d43/f5f x:0 0 0 2024-04-06T12:23:46.097 INFO:tasks.workunit.client.0.smithi152.stdout:9/202: symlink d5/d6/l45 0 2024-04-06T12:23:46.102 INFO:tasks.workunit.client.0.smithi152.stdout:5/276: creat d3/f58 x:0 0 0 2024-04-06T12:23:46.103 INFO:tasks.workunit.client.0.smithi152.stdout:9/203: chown d5/d6/d15/d17/d23/d2d/d32 31020990 1 2024-04-06T12:23:46.106 INFO:tasks.workunit.client.0.smithi152.stdout:6/283: link d7/d9/l2d d7/d19/d1b/d1f/l66 0 2024-04-06T12:23:46.106 INFO:tasks.workunit.client.0.smithi152.stdout:5/277: dread d3/da/f13 [0,4194304] 0 2024-04-06T12:23:46.111 INFO:tasks.workunit.client.0.smithi152.stdout:9/204: creat d5/d6/d15/d17/f46 x:0 0 0 2024-04-06T12:23:46.112 INFO:tasks.workunit.client.0.smithi152.stdout:7/161: getdents d8/dc/d17 0 2024-04-06T12:23:46.114 INFO:tasks.workunit.client.0.smithi152.stdout:6/284: write d7/d9/f18 [1027466,26181] 0 2024-04-06T12:23:46.114 INFO:tasks.workunit.client.0.smithi152.stdout:6/285: dread - d7/d19/f55 zero size 2024-04-06T12:23:46.120 INFO:tasks.workunit.client.0.smithi152.stdout:7/162: creat d8/dc/d17/d2c/f36 x:0 0 0 2024-04-06T12:23:46.122 INFO:tasks.workunit.client.0.smithi152.stdout:5/278: fdatasync d3/d37/f3b 0 2024-04-06T12:23:46.122 INFO:tasks.workunit.client.0.smithi152.stdout:6/286: dwrite d7/d19/d1b/d1f/f4c [0,4194304] 0 2024-04-06T12:23:46.125 INFO:tasks.workunit.client.0.smithi152.stdout:5/279: write d3/f1f [531709,24308] 0 2024-04-06T12:23:46.126 INFO:tasks.workunit.client.0.smithi152.stdout:9/205: dread d5/d6/d15/d17/f19 [4194304,4194304] 0 2024-04-06T12:23:46.127 INFO:tasks.workunit.client.0.smithi152.stdout:5/280: write d3/f31 [524594,32503] 0 2024-04-06T12:23:46.132 INFO:tasks.workunit.client.0.smithi152.stdout:7/163: dwrite d8/f1b [0,4194304] 0 2024-04-06T12:23:46.132 INFO:tasks.workunit.client.0.smithi152.stdout:6/287: unlink d7/d19/l43 0 2024-04-06T12:23:46.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/281: dwrite d3/f1f [0,4194304] 0 2024-04-06T12:23:46.144 INFO:tasks.workunit.client.0.smithi152.stdout:7/164: mkdir d8/d2a/d37 0 2024-04-06T12:23:46.147 INFO:tasks.workunit.client.0.smithi152.stdout:9/206: mknod d5/c47 0 2024-04-06T12:23:46.149 INFO:tasks.workunit.client.0.smithi152.stdout:9/207: chown d5/c1e 2150808 1 2024-04-06T12:23:46.150 INFO:tasks.workunit.client.0.smithi152.stdout:5/282: dwrite d3/f58 [0,4194304] 0 2024-04-06T12:23:46.155 INFO:tasks.workunit.client.0.smithi152.stdout:7/165: dwrite d8/df/f11 [4194304,4194304] 0 2024-04-06T12:23:46.157 INFO:tasks.workunit.client.0.smithi152.stdout:3/208: sync 2024-04-06T12:23:46.158 INFO:tasks.workunit.client.0.smithi152.stdout:5/283: mknod d3/da/c59 0 2024-04-06T12:23:46.159 INFO:tasks.workunit.client.0.smithi152.stdout:3/209: fsync d0/d10/d13/f1a 0 2024-04-06T12:23:46.164 INFO:tasks.workunit.client.0.smithi152.stdout:7/166: dwrite f3 [4194304,4194304] 0 2024-04-06T12:23:46.165 INFO:tasks.workunit.client.0.smithi152.stdout:3/210: mknod d0/d1f/c42 0 2024-04-06T12:23:46.167 INFO:tasks.workunit.client.0.smithi152.stdout:5/284: fdatasync d3/f1f 0 2024-04-06T12:23:46.172 INFO:tasks.workunit.client.0.smithi152.stdout:7/167: rename d8/d2a/f2e to d8/dc/d17/d2c/f38 0 2024-04-06T12:23:46.174 INFO:tasks.workunit.client.0.smithi152.stdout:3/211: dwrite d0/d10/d13/f1a [0,4194304] 0 2024-04-06T12:23:46.179 INFO:tasks.workunit.client.0.smithi152.stdout:5/285: creat d3/f5a x:0 0 0 2024-04-06T12:23:46.180 INFO:tasks.workunit.client.0.smithi152.stdout:0/294: truncate d4/f32 592397 0 2024-04-06T12:23:46.184 INFO:tasks.workunit.client.0.smithi152.stdout:5/286: dread d3/d9/f4b [0,4194304] 0 2024-04-06T12:23:46.184 INFO:tasks.workunit.client.0.smithi152.stdout:0/295: creat d4/d36/f60 x:0 0 0 2024-04-06T12:23:46.190 INFO:tasks.workunit.client.0.smithi152.stdout:5/287: rmdir d3/da/d15 39 2024-04-06T12:23:46.199 INFO:tasks.workunit.client.0.smithi152.stdout:7/168: getdents d8/dc/d17/d2c/d33 0 2024-04-06T12:23:46.202 INFO:tasks.workunit.client.0.smithi152.stdout:5/288: dwrite d3/d37/f56 [0,4194304] 0 2024-04-06T12:23:46.206 INFO:tasks.workunit.client.0.smithi152.stdout:0/296: getdents d4/de 0 2024-04-06T12:23:46.208 INFO:tasks.workunit.client.0.smithi152.stdout:5/289: creat d3/de/f5b x:0 0 0 2024-04-06T12:23:46.210 INFO:tasks.workunit.client.0.smithi152.stdout:0/297: truncate d4/d36/f60 472339 0 2024-04-06T12:23:46.212 INFO:tasks.workunit.client.0.smithi152.stdout:7/169: creat d8/dc/d17/d2c/d33/f39 x:0 0 0 2024-04-06T12:23:46.213 INFO:tasks.workunit.client.0.smithi152.stdout:7/170: dread - d8/dc/d17/d2c/d33/f39 zero size 2024-04-06T12:23:46.221 INFO:tasks.workunit.client.0.smithi152.stdout:7/171: creat d8/f3a x:0 0 0 2024-04-06T12:23:46.225 INFO:tasks.workunit.client.0.smithi152.stdout:7/172: mknod d8/d2a/c3b 0 2024-04-06T12:23:46.227 INFO:tasks.workunit.client.0.smithi152.stdout:0/298: dwrite d4/d31/f3d [0,4194304] 0 2024-04-06T12:23:46.233 INFO:tasks.workunit.client.0.smithi152.stdout:0/299: mknod d4/de/d28/d18/d43/c61 0 2024-04-06T12:23:46.235 INFO:tasks.workunit.client.0.smithi152.stdout:7/173: creat d8/dc/f3c x:0 0 0 2024-04-06T12:23:46.237 INFO:tasks.workunit.client.0.smithi152.stdout:0/300: mkdir d4/de/d28/d18/d43/d62 0 2024-04-06T12:23:46.237 INFO:tasks.workunit.client.0.smithi152.stdout:0/301: fsync f3 0 2024-04-06T12:23:46.242 INFO:tasks.workunit.client.0.smithi152.stdout:0/302: unlink d4/f35 0 2024-04-06T12:23:46.248 INFO:tasks.workunit.client.0.smithi152.stdout:0/303: unlink d4/de/f11 0 2024-04-06T12:23:46.252 INFO:tasks.workunit.client.0.smithi152.stdout:7/174: rename d8/dc/d17/d2c/d33 to d8/dc/d3d 0 2024-04-06T12:23:46.252 INFO:tasks.workunit.client.0.smithi152.stdout:5/290: write d3/da/f13 [652900,115239] 0 2024-04-06T12:23:46.253 INFO:tasks.workunit.client.0.smithi152.stdout:5/291: chown d3/d9/lf 58908 1 2024-04-06T12:23:46.255 INFO:tasks.workunit.client.0.smithi152.stdout:7/175: unlink d8/df/f11 0 2024-04-06T12:23:46.256 INFO:tasks.workunit.client.0.smithi152.stdout:7/176: dread - d8/dc/d17/d2c/f36 zero size 2024-04-06T12:23:46.256 INFO:tasks.workunit.client.0.smithi152.stdout:7/177: chown f3 180882984 1 2024-04-06T12:23:46.258 INFO:tasks.workunit.client.0.smithi152.stdout:7/178: chown d8/c9 1831478 1 2024-04-06T12:23:46.258 INFO:tasks.workunit.client.0.smithi152.stdout:7/179: chown d8/df/c22 0 1 2024-04-06T12:23:46.261 INFO:tasks.workunit.client.0.smithi152.stdout:5/292: truncate d3/f16 3017351 0 2024-04-06T12:23:46.262 INFO:tasks.workunit.client.0.smithi152.stdout:5/293: fsync d3/da/fc 0 2024-04-06T12:23:46.278 INFO:tasks.workunit.client.0.smithi152.stdout:0/304: getdents d4/de/d28/d18/d43 0 2024-04-06T12:23:46.279 INFO:tasks.workunit.client.0.smithi152.stdout:0/305: stat d4/de/d28/d18/d3b/f42 0 2024-04-06T12:23:46.347 INFO:tasks.workunit.client.0.smithi152.stdout:1/228: sync 2024-04-06T12:23:46.353 INFO:tasks.workunit.client.0.smithi152.stdout:1/229: truncate d2/d1d/d21/f40 3630763 0 2024-04-06T12:23:46.358 INFO:tasks.workunit.client.0.smithi152.stdout:1/230: dwrite d2/d1d/f2d [0,4194304] 0 2024-04-06T12:23:46.382 INFO:tasks.workunit.client.0.smithi152.stdout:1/231: dwrite d2/f47 [0,4194304] 0 2024-04-06T12:23:46.386 INFO:tasks.workunit.client.0.smithi152.stdout:1/232: mkdir d2/d2f/d54 0 2024-04-06T12:23:46.388 INFO:tasks.workunit.client.0.smithi152.stdout:1/233: rename d2/d1d/d21/d28/c46 to d2/d2f/d37/c55 0 2024-04-06T12:23:46.390 INFO:tasks.workunit.client.0.smithi152.stdout:1/234: creat d2/d1d/d3b/f56 x:0 0 0 2024-04-06T12:23:46.393 INFO:tasks.workunit.client.0.smithi152.stdout:1/235: rename d2/f47 to d2/d2f/d54/f57 0 2024-04-06T12:23:46.394 INFO:tasks.workunit.client.0.smithi152.stdout:1/236: fsync d2/f1b 0 2024-04-06T12:23:46.396 INFO:tasks.workunit.client.0.smithi152.stdout:1/237: creat d2/f58 x:0 0 0 2024-04-06T12:23:46.397 INFO:tasks.workunit.client.0.smithi152.stdout:1/238: write d2/f12 [347830,64941] 0 2024-04-06T12:23:46.418 INFO:tasks.workunit.client.0.smithi152.stdout:1/239: chown d2/d1d/l31 433210 1 2024-04-06T12:23:46.418 INFO:tasks.workunit.client.0.smithi152.stdout:1/240: chown d2/d1d/d21/d28/c33 4075 1 2024-04-06T12:23:46.418 INFO:tasks.workunit.client.0.smithi152.stdout:1/241: mknod d2/d2f/c59 0 2024-04-06T12:23:46.419 INFO:tasks.workunit.client.0.smithi152.stdout:1/242: chown d2/fb 1 1 2024-04-06T12:23:46.421 INFO:tasks.workunit.client.0.smithi152.stdout:1/243: creat d2/f5a x:0 0 0 2024-04-06T12:23:46.423 INFO:tasks.workunit.client.0.smithi152.stdout:1/244: rmdir d2/d2f 39 2024-04-06T12:23:46.426 INFO:tasks.workunit.client.0.smithi152.stdout:1/245: mknod d2/d1d/d21/c5b 0 2024-04-06T12:23:46.428 INFO:tasks.workunit.client.0.smithi152.stdout:1/246: mknod d2/d1d/d21/d28/c5c 0 2024-04-06T12:23:46.430 INFO:tasks.workunit.client.0.smithi152.stdout:1/247: mkdir d2/d5d 0 2024-04-06T12:23:46.433 INFO:tasks.workunit.client.0.smithi152.stdout:1/248: symlink d2/d2f/l5e 0 2024-04-06T12:23:46.435 INFO:tasks.workunit.client.0.smithi152.stdout:1/249: creat d2/d2f/d37/f5f x:0 0 0 2024-04-06T12:23:46.436 INFO:tasks.workunit.client.0.smithi152.stdout:1/250: write d2/f7 [2860296,117683] 0 2024-04-06T12:23:46.448 INFO:tasks.workunit.client.0.smithi152.stdout:1/251: dwrite d2/fb [0,4194304] 0 2024-04-06T12:23:46.449 INFO:tasks.workunit.client.0.smithi152.stdout:1/252: dread - d2/d1d/d21/d28/f4e zero size 2024-04-06T12:23:46.453 INFO:tasks.workunit.client.0.smithi152.stdout:1/253: rename d2/d1d/d21/c22 to d2/d1d/d21/d28/c60 0 2024-04-06T12:23:46.455 INFO:tasks.workunit.client.0.smithi152.stdout:1/254: mkdir d2/d61 0 2024-04-06T12:23:46.456 INFO:tasks.workunit.client.0.smithi152.stdout:1/255: truncate d2/d2f/d37/f4a 432877 0 2024-04-06T12:23:46.463 INFO:tasks.workunit.client.0.smithi152.stdout:1/256: dwrite d2/ff [0,4194304] 0 2024-04-06T12:23:46.548 INFO:tasks.workunit.client.0.smithi152.stdout:4/187: sync 2024-04-06T12:23:46.551 INFO:tasks.workunit.client.0.smithi152.stdout:4/188: mkdir d7/d29/d2e/d2f/d33 0 2024-04-06T12:23:46.551 INFO:tasks.workunit.client.0.smithi152.stdout:4/189: stat d7/l10 0 2024-04-06T12:23:46.555 INFO:tasks.workunit.client.0.smithi152.stdout:4/190: rename d7/c32 to d7/d29/d2e/c34 0 2024-04-06T12:23:46.556 INFO:tasks.workunit.client.0.smithi152.stdout:4/191: rmdir d7/d16/d22 39 2024-04-06T12:23:46.557 INFO:tasks.workunit.client.0.smithi152.stdout:4/192: truncate d7/f2c 89688 0 2024-04-06T12:23:46.569 INFO:tasks.workunit.client.0.smithi152.stdout:4/193: dread d7/f12 [4194304,4194304] 0 2024-04-06T12:23:46.574 INFO:tasks.workunit.client.0.smithi152.stdout:4/194: link d7/lf d7/d29/d2e/l35 0 2024-04-06T12:23:46.576 INFO:tasks.workunit.client.0.smithi152.stdout:4/195: write d7/f2c [656835,98508] 0 2024-04-06T12:23:46.579 INFO:tasks.workunit.client.0.smithi152.stdout:4/196: mkdir d7/d36 0 2024-04-06T12:23:46.583 INFO:tasks.workunit.client.0.smithi152.stdout:4/197: creat d7/d16/d22/d30/f37 x:0 0 0 2024-04-06T12:23:46.588 INFO:tasks.workunit.client.0.smithi152.stdout:4/198: link d7/l11 d7/d29/d2e/l38 0 2024-04-06T12:23:46.592 INFO:tasks.workunit.client.0.smithi152.stdout:4/199: dread d7/fb [0,4194304] 0 2024-04-06T12:23:46.594 INFO:tasks.workunit.client.0.smithi152.stdout:4/200: creat d7/d29/d2e/d2f/f39 x:0 0 0 2024-04-06T12:23:46.596 INFO:tasks.workunit.client.0.smithi152.stdout:4/201: symlink d7/d36/l3a 0 2024-04-06T12:23:46.598 INFO:tasks.workunit.client.0.smithi152.stdout:4/202: dread f1 [0,4194304] 0 2024-04-06T12:23:46.599 INFO:tasks.workunit.client.0.smithi152.stdout:4/203: stat d7/l1b 0 2024-04-06T12:23:46.599 INFO:tasks.workunit.client.0.smithi152.stdout:4/204: write d7/f17 [2744439,55178] 0 2024-04-06T12:23:46.602 INFO:tasks.workunit.client.0.smithi152.stdout:4/205: mknod d7/d16/d22/c3b 0 2024-04-06T12:23:46.605 INFO:tasks.workunit.client.0.smithi152.stdout:4/206: mknod d7/d29/d2e/d2f/d33/c3c 0 2024-04-06T12:23:46.610 INFO:tasks.workunit.client.0.smithi152.stdout:4/207: rename d7/d16/d22/l24 to d7/d29/d2e/d2f/l3d 0 2024-04-06T12:23:46.612 INFO:tasks.workunit.client.0.smithi152.stdout:4/208: rmdir d7/d36 39 2024-04-06T12:23:46.615 INFO:tasks.workunit.client.0.smithi152.stdout:4/209: rename d7/f12 to d7/d16/d22/f3e 0 2024-04-06T12:23:46.629 INFO:tasks.workunit.client.0.smithi152.stdout:4/210: dread f5 [0,4194304] 0 2024-04-06T12:23:46.629 INFO:tasks.workunit.client.0.smithi152.stdout:4/211: chown d7/c1e 353635052 1 2024-04-06T12:23:46.630 INFO:tasks.workunit.client.0.smithi152.stdout:4/212: truncate f1 2142031 0 2024-04-06T12:23:46.638 INFO:tasks.workunit.client.0.smithi152.stdout:4/213: chown d7/d36/l3a 103111 1 2024-04-06T12:23:46.641 INFO:tasks.workunit.client.0.smithi152.stdout:4/214: mkdir d7/d16/d22/d3f 0 2024-04-06T12:23:46.648 INFO:tasks.workunit.client.0.smithi152.stdout:4/215: dwrite d7/d16/d22/f3e [4194304,4194304] 0 2024-04-06T12:23:46.655 INFO:tasks.workunit.client.0.smithi152.stdout:4/216: dwrite d7/f17 [4194304,4194304] 0 2024-04-06T12:23:46.665 INFO:tasks.workunit.client.0.smithi152.stdout:4/217: rename d7/d16/c26 to d7/d16/d22/d30/c40 0 2024-04-06T12:23:46.690 INFO:tasks.workunit.client.0.smithi152.stdout:4/218: write d7/f2a [338384,126122] 0 2024-04-06T12:23:46.696 INFO:tasks.workunit.client.0.smithi152.stdout:4/219: getdents d7/d29/d2e 0 2024-04-06T12:23:46.697 INFO:tasks.workunit.client.0.smithi152.stdout:4/220: write d7/d29/f2b [53695,12223] 0 2024-04-06T12:23:46.697 INFO:tasks.workunit.client.0.smithi152.stdout:4/221: chown d7/d16/d22/d30 327664261 1 2024-04-06T12:23:46.806 INFO:tasks.workunit.client.0.smithi152.stdout:8/279: sync 2024-04-06T12:23:46.855 INFO:tasks.workunit.client.0.smithi152.stdout:4/222: symlink d7/d16/l41 0 2024-04-06T12:23:46.855 INFO:tasks.workunit.client.0.smithi152.stdout:8/280: mknod d4/db/c5e 0 2024-04-06T12:23:46.856 INFO:tasks.workunit.client.0.smithi152.stdout:8/281: stat d4/dc 0 2024-04-06T12:23:46.857 INFO:tasks.workunit.client.0.smithi152.stdout:4/223: mknod d7/d29/d2e/d2f/c42 0 2024-04-06T12:23:46.858 INFO:tasks.workunit.client.0.smithi152.stdout:8/282: mkdir d4/d5f 0 2024-04-06T12:23:46.866 INFO:tasks.workunit.client.0.smithi152.stdout:8/283: dwrite d4/db/d32/f4b [0,4194304] 0 2024-04-06T12:23:46.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/284: dwrite d4/db/d2a/f3e [0,4194304] 0 2024-04-06T12:23:46.877 INFO:tasks.workunit.client.0.smithi152.stdout:8/285: symlink d4/d2c/d54/l60 0 2024-04-06T12:23:46.878 INFO:tasks.workunit.client.0.smithi152.stdout:4/224: write d7/d16/f1a [223953,114785] 0 2024-04-06T12:23:46.894 INFO:tasks.workunit.client.0.smithi152.stdout:8/286: dread d4/dc/f5b [0,4194304] 0 2024-04-06T12:23:46.897 INFO:tasks.workunit.client.0.smithi152.stdout:8/287: creat d4/dc/d10/d51/f61 x:0 0 0 2024-04-06T12:23:46.899 INFO:tasks.workunit.client.0.smithi152.stdout:4/225: dread d7/d16/f1a [0,4194304] 0 2024-04-06T12:23:46.900 INFO:tasks.workunit.client.0.smithi152.stdout:8/288: symlink d4/d5f/l62 0 2024-04-06T12:23:46.901 INFO:tasks.workunit.client.0.smithi152.stdout:4/226: creat d7/d16/d22/d30/f43 x:0 0 0 2024-04-06T12:23:46.902 INFO:tasks.workunit.client.0.smithi152.stdout:8/289: mknod d4/db/d32/c63 0 2024-04-06T12:23:46.903 INFO:tasks.workunit.client.0.smithi152.stdout:4/227: dread - d7/d16/d22/d30/f43 zero size 2024-04-06T12:23:46.903 INFO:tasks.workunit.client.0.smithi152.stdout:8/290: readlink d4/dc/d10/l14 0 2024-04-06T12:23:46.908 INFO:tasks.workunit.client.0.smithi152.stdout:4/228: truncate f1 1208616 0 2024-04-06T12:23:46.909 INFO:tasks.workunit.client.0.smithi152.stdout:4/229: write d7/f17 [182013,130843] 0 2024-04-06T12:23:46.912 INFO:tasks.workunit.client.0.smithi152.stdout:4/230: creat d7/d29/d2e/d2f/d33/f44 x:0 0 0 2024-04-06T12:23:46.913 INFO:tasks.workunit.client.0.smithi152.stdout:4/231: dread d7/d29/f2b [0,4194304] 0 2024-04-06T12:23:46.918 INFO:tasks.workunit.client.0.smithi152.stdout:8/291: dread d4/db/d39/f3f [0,4194304] 0 2024-04-06T12:23:46.919 INFO:tasks.workunit.client.0.smithi152.stdout:8/292: read d4/dc/f5b [3243103,22470] 0 2024-04-06T12:23:46.919 INFO:tasks.workunit.client.0.smithi152.stdout:8/293: fsync d4/f36 0 2024-04-06T12:23:46.920 INFO:tasks.workunit.client.0.smithi152.stdout:4/232: truncate d7/fb 2527240 0 2024-04-06T12:23:46.920 INFO:tasks.workunit.client.0.smithi152.stdout:4/233: readlink d7/l8 0 2024-04-06T12:23:46.922 INFO:tasks.workunit.client.0.smithi152.stdout:4/234: fdatasync d7/d16/d22/d30/f37 0 2024-04-06T12:23:46.922 INFO:tasks.workunit.client.0.smithi152.stdout:2/294: sync 2024-04-06T12:23:46.922 INFO:tasks.workunit.client.0.smithi152.stdout:6/288: sync 2024-04-06T12:23:46.922 INFO:tasks.workunit.client.0.smithi152.stdout:4/235: readlink l6 0 2024-04-06T12:23:46.924 INFO:tasks.workunit.client.0.smithi152.stdout:4/236: write d7/f2a [695866,64734] 0 2024-04-06T12:23:46.924 INFO:tasks.workunit.client.0.smithi152.stdout:2/295: dread - d0/d40/f51 zero size 2024-04-06T12:23:46.925 INFO:tasks.workunit.client.0.smithi152.stdout:6/289: chown d7/d19/d1b/d31/d35/f54 73 1 2024-04-06T12:23:46.926 INFO:tasks.workunit.client.0.smithi152.stdout:6/290: chown c4 1926 1 2024-04-06T12:23:46.930 INFO:tasks.workunit.client.0.smithi152.stdout:6/291: symlink d7/d9/d26/l67 0 2024-04-06T12:23:46.931 INFO:tasks.workunit.client.0.smithi152.stdout:4/237: mkdir d7/d45 0 2024-04-06T12:23:46.931 INFO:tasks.workunit.client.0.smithi152.stdout:6/292: write d7/d19/f33 [946606,75543] 0 2024-04-06T12:23:46.931 INFO:tasks.workunit.client.0.smithi152.stdout:6/293: chown c4 32 1 2024-04-06T12:23:46.933 INFO:tasks.workunit.client.0.smithi152.stdout:4/238: dread - d7/d29/d2e/d2f/d33/f44 zero size 2024-04-06T12:23:46.935 INFO:tasks.workunit.client.0.smithi152.stdout:6/294: read d7/d19/d1b/d31/f3c [771287,35928] 0 2024-04-06T12:23:46.936 INFO:tasks.workunit.client.0.smithi152.stdout:6/295: readlink d7/d19/d1b/d1f/d3d/l41 0 2024-04-06T12:23:46.939 INFO:tasks.workunit.client.0.smithi152.stdout:8/294: dread d4/db/d32/f33 [0,4194304] 0 2024-04-06T12:23:46.945 INFO:tasks.workunit.client.0.smithi152.stdout:8/295: creat d4/dc/d10/d49/f64 x:0 0 0 2024-04-06T12:23:46.946 INFO:tasks.workunit.client.0.smithi152.stdout:8/296: write d4/db/d39/f50 [903396,69623] 0 2024-04-06T12:23:46.947 INFO:tasks.workunit.client.0.smithi152.stdout:2/296: write d0/d2/d5/fe [1621887,34570] 0 2024-04-06T12:23:46.948 INFO:tasks.workunit.client.0.smithi152.stdout:8/297: read d4/dc/d10/f2d [888091,117070] 0 2024-04-06T12:23:46.949 INFO:tasks.workunit.client.0.smithi152.stdout:2/297: write d0/d40/f39 [3413282,2947] 0 2024-04-06T12:23:46.952 INFO:tasks.workunit.client.0.smithi152.stdout:8/298: mknod d4/db/d39/c65 0 2024-04-06T12:23:46.952 INFO:tasks.workunit.client.0.smithi152.stdout:2/298: dread - d0/d40/d41/d28/f61 zero size 2024-04-06T12:23:46.952 INFO:tasks.workunit.client.0.smithi152.stdout:6/296: dread d7/f1e [0,4194304] 0 2024-04-06T12:23:46.952 INFO:tasks.workunit.client.0.smithi152.stdout:2/299: read - d0/f47 zero size 2024-04-06T12:23:46.954 INFO:tasks.workunit.client.0.smithi152.stdout:2/300: write d0/d2/f2c [2423990,123505] 0 2024-04-06T12:23:46.955 INFO:tasks.workunit.client.0.smithi152.stdout:2/301: write d0/d15/d24/d3d/f4f [1841988,50844] 0 2024-04-06T12:23:46.955 INFO:tasks.workunit.client.0.smithi152.stdout:8/299: creat d4/db/d39/f66 x:0 0 0 2024-04-06T12:23:46.957 INFO:tasks.workunit.client.0.smithi152.stdout:6/297: creat d7/d19/d1b/d22/f68 x:0 0 0 2024-04-06T12:23:46.969 INFO:tasks.workunit.client.0.smithi152.stdout:6/298: link d7/d19/d1b/d22/l49 d7/d19/d1b/d31/d35/l69 0 2024-04-06T12:23:46.970 INFO:tasks.workunit.client.0.smithi152.stdout:6/299: fdatasync d7/d19/d1b/d31/d35/f54 0 2024-04-06T12:23:46.973 INFO:tasks.workunit.client.0.smithi152.stdout:8/300: getdents d4/d2c 0 2024-04-06T12:23:46.973 INFO:tasks.workunit.client.0.smithi152.stdout:8/301: stat d4/dc/f19 0 2024-04-06T12:23:46.973 INFO:tasks.workunit.client.0.smithi152.stdout:2/302: link d0/d40/d41/c32 d0/d2/d5/c66 0 2024-04-06T12:23:46.974 INFO:tasks.workunit.client.0.smithi152.stdout:2/303: write d0/f29 [1159996,21170] 0 2024-04-06T12:23:46.976 INFO:tasks.workunit.client.0.smithi152.stdout:6/300: symlink d7/d9/l6a 0 2024-04-06T12:23:46.979 INFO:tasks.workunit.client.0.smithi152.stdout:8/302: dwrite d4/f9 [4194304,4194304] 0 2024-04-06T12:23:46.980 INFO:tasks.workunit.client.0.smithi152.stdout:2/304: symlink d0/d15/d4d/l67 0 2024-04-06T12:23:46.981 INFO:tasks.workunit.client.0.smithi152.stdout:6/301: fsync d7/d19/f30 0 2024-04-06T12:23:46.984 INFO:tasks.workunit.client.0.smithi152.stdout:6/302: truncate d7/d9/f56 671227 0 2024-04-06T12:23:46.989 INFO:tasks.workunit.client.0.smithi152.stdout:8/303: dwrite d4/db/d39/f3f [4194304,4194304] 0 2024-04-06T12:23:46.990 INFO:tasks.workunit.client.0.smithi152.stdout:6/303: fdatasync d7/d19/f30 0 2024-04-06T12:23:46.991 INFO:tasks.workunit.client.0.smithi152.stdout:6/304: stat d7/d19/d1b/c5f 0 2024-04-06T12:23:46.993 INFO:tasks.workunit.client.0.smithi152.stdout:2/305: getdents d0/d15/d24 0 2024-04-06T12:23:46.994 INFO:tasks.workunit.client.0.smithi152.stdout:2/306: write d0/d40/f56 [159535,56304] 0 2024-04-06T12:23:47.002 INFO:tasks.workunit.client.0.smithi152.stdout:2/307: rename d0/d15/d24/d3d/l1e to d0/d40/d41/d28/d5f/l68 0 2024-04-06T12:23:47.006 INFO:tasks.workunit.client.0.smithi152.stdout:2/308: mknod d0/c69 0 2024-04-06T12:23:47.007 INFO:tasks.workunit.client.0.smithi152.stdout:6/305: link d7/d9/d26/d4a/l59 d7/l6b 0 2024-04-06T12:23:47.007 INFO:tasks.workunit.client.0.smithi152.stdout:2/309: readlink d0/d2/lb 0 2024-04-06T12:23:47.009 INFO:tasks.workunit.client.0.smithi152.stdout:2/310: creat d0/d15/d24/d3d/f6a x:0 0 0 2024-04-06T12:23:47.011 INFO:tasks.workunit.client.0.smithi152.stdout:2/311: unlink d0/d15/d24/d3d/l12 0 2024-04-06T12:23:47.014 INFO:tasks.workunit.client.0.smithi152.stdout:2/312: dread d0/f1c [0,4194304] 0 2024-04-06T12:23:47.018 INFO:tasks.workunit.client.0.smithi152.stdout:2/313: truncate d0/d2/d5/f50 1026260 0 2024-04-06T12:23:47.019 INFO:tasks.workunit.client.0.smithi152.stdout:2/314: creat d0/d15/d24/f6b x:0 0 0 2024-04-06T12:23:47.023 INFO:tasks.workunit.client.0.smithi152.stdout:2/315: dread d0/d2/f14 [0,4194304] 0 2024-04-06T12:23:47.024 INFO:tasks.workunit.client.0.smithi152.stdout:2/316: creat d0/d40/d41/f6c x:0 0 0 2024-04-06T12:23:47.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:45.582203+0000 mgr.smithi195.ausetj (mgr.24375) 77 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 587 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 3.9 MiB/s rd, 38 MiB/s wr, 177 op/s 2024-04-06T12:23:47.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/317: chown d0/d40/d41/c3c 143581 1 2024-04-06T12:23:47.026 INFO:tasks.workunit.client.0.smithi152.stdout:2/318: truncate d0/f47 218475 0 2024-04-06T12:23:47.030 INFO:tasks.workunit.client.0.smithi152.stdout:2/319: read - d0/d15/d24/f6b zero size 2024-04-06T12:23:47.030 INFO:tasks.workunit.client.0.smithi152.stdout:2/320: fsync d0/d2/f14 0 2024-04-06T12:23:47.034 INFO:tasks.workunit.client.0.smithi152.stdout:2/321: dwrite d0/f29 [0,4194304] 0 2024-04-06T12:23:47.034 INFO:tasks.workunit.client.0.smithi152.stdout:2/322: chown d0/d2/f21 59 1 2024-04-06T12:23:47.037 INFO:tasks.workunit.client.0.smithi152.stdout:2/323: mknod d0/d40/d41/c6d 0 2024-04-06T12:23:47.037 INFO:tasks.workunit.client.0.smithi152.stdout:2/324: stat d0 0 2024-04-06T12:23:47.037 INFO:tasks.workunit.client.0.smithi152.stdout:2/325: readlink d0/d40/d41/l34 0 2024-04-06T12:23:47.039 INFO:tasks.workunit.client.0.smithi152.stdout:2/326: rmdir d0/d15/d24/d3d 39 2024-04-06T12:23:47.045 INFO:tasks.workunit.client.0.smithi152.stdout:9/208: sync 2024-04-06T12:23:47.045 INFO:tasks.workunit.client.0.smithi152.stdout:3/212: sync 2024-04-06T12:23:47.046 INFO:tasks.workunit.client.0.smithi152.stdout:3/213: stat d0/d1f/c21 0 2024-04-06T12:23:47.047 INFO:tasks.workunit.client.0.smithi152.stdout:9/209: fdatasync d5/d6/f3c 0 2024-04-06T12:23:47.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:45.582203+0000 mgr.smithi195.ausetj (mgr.24375) 77 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 587 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 3.9 MiB/s rd, 38 MiB/s wr, 177 op/s 2024-04-06T12:23:47.059 INFO:tasks.workunit.client.0.smithi152.stdout:2/327: dread d0/fd [4194304,4194304] 0 2024-04-06T12:23:47.060 INFO:tasks.workunit.client.0.smithi152.stdout:3/214: dread d0/d10/d13/f17 [0,4194304] 0 2024-04-06T12:23:47.061 INFO:tasks.workunit.client.0.smithi152.stdout:3/215: write d0/fb [3326548,117347] 0 2024-04-06T12:23:47.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/210: link d5/d6/f7 d5/d39/d3f/d42/f48 0 2024-04-06T12:23:47.065 INFO:tasks.workunit.client.0.smithi152.stdout:2/328: rename d0/f47 to d0/d15/d4d/f6e 0 2024-04-06T12:23:47.067 INFO:tasks.workunit.client.0.smithi152.stdout:3/216: mkdir d0/d35/d43 0 2024-04-06T12:23:47.068 INFO:tasks.workunit.client.0.smithi152.stdout:9/211: stat d5/d6/fd 0 2024-04-06T12:23:47.068 INFO:tasks.workunit.client.0.smithi152.stdout:9/212: chown d5/d39/d3f/d42 7 1 2024-04-06T12:23:47.070 INFO:tasks.workunit.client.0.smithi152.stdout:3/217: stat d0/d10/d1e/c11 0 2024-04-06T12:23:47.072 INFO:tasks.workunit.client.0.smithi152.stdout:9/213: truncate d5/d6/d15/d17/f19 8906495 0 2024-04-06T12:23:47.074 INFO:tasks.workunit.client.0.smithi152.stdout:3/218: fsync d0/f3c 0 2024-04-06T12:23:47.077 INFO:tasks.workunit.client.0.smithi152.stdout:9/214: rmdir d5/d6/d15 39 2024-04-06T12:23:47.081 INFO:tasks.workunit.client.0.smithi152.stdout:2/329: getdents d0/d40/d41 0 2024-04-06T12:23:47.083 INFO:tasks.workunit.client.0.smithi152.stdout:3/219: mkdir d0/d1f/d44 0 2024-04-06T12:23:47.092 INFO:tasks.workunit.client.0.smithi152.stdout:3/220: truncate d0/d10/d13/f17 3817613 0 2024-04-06T12:23:47.093 INFO:tasks.workunit.client.0.smithi152.stdout:9/215: creat d5/d6/f49 x:0 0 0 2024-04-06T12:23:47.093 INFO:tasks.workunit.client.0.smithi152.stdout:3/221: read d0/fb [2937277,77658] 0 2024-04-06T12:23:47.102 INFO:tasks.workunit.client.0.smithi152.stdout:9/216: rename d5/d6/d15/c30 to d5/d6/d15/c4a 0 2024-04-06T12:23:47.103 INFO:tasks.workunit.client.0.smithi152.stdout:9/217: fdatasync d5/d6/f24 0 2024-04-06T12:23:47.106 INFO:tasks.workunit.client.0.smithi152.stdout:2/330: truncate d0/fd 4929183 0 2024-04-06T12:23:47.107 INFO:tasks.workunit.client.0.smithi152.stdout:9/218: truncate d5/d6/f14 8952627 0 2024-04-06T12:23:47.110 INFO:tasks.workunit.client.0.smithi152.stdout:2/331: getdents d0/d40/d41/d28/d54 0 2024-04-06T12:23:47.112 INFO:tasks.workunit.client.0.smithi152.stdout:9/219: dread d5/d6/d15/d17/d37/f41 [0,4194304] 0 2024-04-06T12:23:47.112 INFO:tasks.workunit.client.0.smithi152.stdout:2/332: write d0/d40/d41/f6c [954045,41423] 0 2024-04-06T12:23:47.114 INFO:tasks.workunit.client.0.smithi152.stdout:3/222: dread d0/d10/d13/f17 [0,4194304] 0 2024-04-06T12:23:47.116 INFO:tasks.workunit.client.0.smithi152.stdout:9/220: stat d5/l25 0 2024-04-06T12:23:47.117 INFO:tasks.workunit.client.0.smithi152.stdout:9/221: chown d5/d6/d15/d17/d37 1 1 2024-04-06T12:23:47.117 INFO:tasks.workunit.client.0.smithi152.stdout:2/333: mkdir d0/d2/d6f 0 2024-04-06T12:23:47.118 INFO:tasks.workunit.client.0.smithi152.stdout:2/334: write d0/f60 [185318,41005] 0 2024-04-06T12:23:47.118 INFO:tasks.workunit.client.0.smithi152.stdout:9/222: write d5/d6/f49 [748626,90155] 0 2024-04-06T12:23:47.122 INFO:tasks.workunit.client.0.smithi152.stdout:2/335: chown d0/d15/d24/d3d/l44 648939484 1 2024-04-06T12:23:47.123 INFO:tasks.workunit.client.0.smithi152.stdout:2/336: chown d0/d15/d4d/f55 54042344 1 2024-04-06T12:23:47.124 INFO:tasks.workunit.client.0.smithi152.stdout:9/223: dread d5/d6/f24 [0,4194304] 0 2024-04-06T12:23:47.125 INFO:tasks.workunit.client.0.smithi152.stdout:2/337: truncate d0/d15/d24/f5b 525024 0 2024-04-06T12:23:47.128 INFO:tasks.workunit.client.0.smithi152.stdout:9/224: mkdir d5/d6/d15/d17/d23/d2d/d4b 0 2024-04-06T12:23:47.129 INFO:tasks.workunit.client.0.smithi152.stdout:2/338: mknod d0/d40/d41/d28/c70 0 2024-04-06T12:23:47.131 INFO:tasks.workunit.client.0.smithi152.stdout:3/223: dread d0/fb [0,4194304] 0 2024-04-06T12:23:47.132 INFO:tasks.workunit.client.0.smithi152.stdout:2/339: creat d0/d40/d26/f71 x:0 0 0 2024-04-06T12:23:47.135 INFO:tasks.workunit.client.0.smithi152.stdout:3/224: mkdir d0/d10/d45 0 2024-04-06T12:23:47.139 INFO:tasks.workunit.client.0.smithi152.stdout:9/225: link d5/d6/f16 d5/d6/d15/d17/d23/d2d/d32/d36/f4c 0 2024-04-06T12:23:47.140 INFO:tasks.workunit.client.0.smithi152.stdout:9/226: truncate d5/f35 763790 0 2024-04-06T12:23:47.143 INFO:tasks.workunit.client.0.smithi152.stdout:3/225: creat d0/d10/d1e/f46 x:0 0 0 2024-04-06T12:23:47.143 INFO:tasks.workunit.client.0.smithi152.stdout:9/227: dread d5/f35 [0,4194304] 0 2024-04-06T12:23:47.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/226: dread - d0/d10/d1e/f1d zero size 2024-04-06T12:23:47.145 INFO:tasks.workunit.client.0.smithi152.stdout:3/227: dread - d0/d10/d1e/f46 zero size 2024-04-06T12:23:47.145 INFO:tasks.workunit.client.0.smithi152.stdout:2/340: creat d0/d15/d24/f72 x:0 0 0 2024-04-06T12:23:47.150 INFO:tasks.workunit.client.0.smithi152.stdout:2/341: dread d0/f11 [0,4194304] 0 2024-04-06T12:23:47.150 INFO:tasks.workunit.client.0.smithi152.stdout:2/342: dread - d0/d2/d5/d3a/f58 zero size 2024-04-06T12:23:47.151 INFO:tasks.workunit.client.0.smithi152.stdout:3/228: creat d0/d10/d45/f47 x:0 0 0 2024-04-06T12:23:47.158 INFO:tasks.workunit.client.0.smithi152.stdout:2/343: dwrite d0/d2/d5/f1f [0,4194304] 0 2024-04-06T12:23:47.160 INFO:tasks.workunit.client.0.smithi152.stdout:3/229: dread d0/d1f/f23 [0,4194304] 0 2024-04-06T12:23:47.166 INFO:tasks.workunit.client.0.smithi152.stdout:2/344: symlink d0/d40/d41/d63/l73 0 2024-04-06T12:23:47.166 INFO:tasks.workunit.client.0.smithi152.stdout:2/345: stat d0/l8 0 2024-04-06T12:23:47.167 INFO:tasks.workunit.client.0.smithi152.stdout:2/346: write d0/d40/f39 [1285274,49777] 0 2024-04-06T12:23:47.169 INFO:tasks.workunit.client.0.smithi152.stdout:3/230: mkdir d0/d35/d43/d48 0 2024-04-06T12:23:47.169 INFO:tasks.workunit.client.0.smithi152.stdout:3/231: stat d0/d1f/c21 0 2024-04-06T12:23:47.170 INFO:tasks.workunit.client.0.smithi152.stdout:3/232: fdatasync d0/d10/d13/f1a 0 2024-04-06T12:23:47.173 INFO:tasks.workunit.client.0.smithi152.stdout:2/347: rename d0/d15/d4d/l67 to d0/l74 0 2024-04-06T12:23:47.177 INFO:tasks.workunit.client.0.smithi152.stdout:3/233: mkdir d0/d10/d1e/d39/d49 0 2024-04-06T12:23:47.177 INFO:tasks.workunit.client.0.smithi152.stdout:2/348: dread d0/d2/d5/f1f [0,4194304] 0 2024-04-06T12:23:47.179 INFO:tasks.workunit.client.0.smithi152.stdout:2/349: truncate d0/f60 1273080 0 2024-04-06T12:23:47.181 INFO:tasks.workunit.client.0.smithi152.stdout:3/234: write d0/d10/d1e/f1d [352,83184] 0 2024-04-06T12:23:47.183 INFO:tasks.workunit.client.0.smithi152.stdout:2/350: creat d0/d40/d41/f75 x:0 0 0 2024-04-06T12:23:47.192 INFO:tasks.workunit.client.0.smithi152.stdout:2/351: link d0/d40/d26/f2a d0/d15/d4d/f76 0 2024-04-06T12:23:47.226 INFO:tasks.workunit.client.0.smithi152.stdout:3/235: dwrite d0/f3c [0,4194304] 0 2024-04-06T12:23:47.229 INFO:tasks.workunit.client.0.smithi152.stdout:2/352: dwrite d0/d15/f5d [0,4194304] 0 2024-04-06T12:23:47.237 INFO:tasks.workunit.client.0.smithi152.stdout:3/236: dwrite d0/ff [0,4194304] 0 2024-04-06T12:23:47.250 INFO:tasks.workunit.client.0.smithi152.stdout:3/237: truncate d0/d10/d13/f32 2513197 0 2024-04-06T12:23:47.252 INFO:tasks.workunit.client.0.smithi152.stdout:3/238: mkdir d0/d1f/d4a 0 2024-04-06T12:23:47.254 INFO:tasks.workunit.client.0.smithi152.stdout:3/239: mkdir d0/d10/d13/d2a/d4b 0 2024-04-06T12:23:47.268 INFO:tasks.workunit.client.0.smithi152.stdout:4/239: sync 2024-04-06T12:23:47.268 INFO:tasks.workunit.client.0.smithi152.stdout:7/180: sync 2024-04-06T12:23:47.269 INFO:tasks.workunit.client.0.smithi152.stdout:5/294: sync 2024-04-06T12:23:47.269 INFO:tasks.workunit.client.0.smithi152.stdout:0/306: sync 2024-04-06T12:23:47.269 INFO:tasks.workunit.client.0.smithi152.stdout:1/257: sync 2024-04-06T12:23:47.270 INFO:tasks.workunit.client.0.smithi152.stdout:7/181: write f3 [9103352,122993] 0 2024-04-06T12:23:47.279 INFO:tasks.workunit.client.0.smithi152.stdout:3/240: dwrite d0/d1f/f23 [0,4194304] 0 2024-04-06T12:23:47.283 INFO:tasks.workunit.client.0.smithi152.stdout:3/241: dread d0/d10/d13/f17 [0,4194304] 0 2024-04-06T12:23:47.285 INFO:tasks.workunit.client.0.smithi152.stdout:0/307: rename d4/d36/c45 to d4/de/d28/d18/d3b/c63 0 2024-04-06T12:23:47.288 INFO:tasks.workunit.client.0.smithi152.stdout:4/240: mknod d7/d16/c46 0 2024-04-06T12:23:47.294 INFO:tasks.workunit.client.0.smithi152.stdout:1/258: write d2/d1d/d21/d28/f3a [491694,33663] 0 2024-04-06T12:23:47.295 INFO:tasks.workunit.client.0.smithi152.stdout:1/259: stat d2/d1d/d3b 0 2024-04-06T12:23:47.298 INFO:tasks.workunit.client.0.smithi152.stdout:3/242: chown d0/d10/d1e/d39/d3d/l3f 119429985 1 2024-04-06T12:23:47.299 INFO:tasks.workunit.client.0.smithi152.stdout:3/243: truncate d0/d10/d45/f47 734378 0 2024-04-06T12:23:47.301 INFO:tasks.workunit.client.0.smithi152.stdout:3/244: write d0/d10/d1e/f1d [88106,82913] 0 2024-04-06T12:23:47.302 INFO:tasks.workunit.client.0.smithi152.stdout:5/295: symlink d3/da/d15/d2b/d4d/l5c 0 2024-04-06T12:23:47.304 INFO:tasks.workunit.client.0.smithi152.stdout:7/182: symlink d8/dc/d3d/l3e 0 2024-04-06T12:23:47.305 INFO:tasks.workunit.client.0.smithi152.stdout:0/308: dwrite f1 [0,4194304] 0 2024-04-06T12:23:47.305 INFO:tasks.workunit.client.0.smithi152.stdout:1/260: creat d2/d2f/d45/f62 x:0 0 0 2024-04-06T12:23:47.306 INFO:tasks.workunit.client.0.smithi152.stdout:7/183: read f3 [5886346,53967] 0 2024-04-06T12:23:47.307 INFO:tasks.workunit.client.0.smithi152.stdout:0/309: write d4/d31/f5c [622302,76843] 0 2024-04-06T12:23:47.307 INFO:tasks.workunit.client.0.smithi152.stdout:4/241: unlink f1 0 2024-04-06T12:23:47.308 INFO:tasks.workunit.client.0.smithi152.stdout:4/242: stat d7/c14 0 2024-04-06T12:23:47.308 INFO:tasks.workunit.client.0.smithi152.stdout:0/310: fsync d4/d19/f4e 0 2024-04-06T12:23:47.311 INFO:tasks.workunit.client.0.smithi152.stdout:3/245: readlink d0/d10/l3b 0 2024-04-06T12:23:47.313 INFO:tasks.workunit.client.0.smithi152.stdout:5/296: creat d3/da/d15/d40/d4e/f5d x:0 0 0 2024-04-06T12:23:47.314 INFO:tasks.workunit.client.0.smithi152.stdout:5/297: chown d3/da/f4a 3598 1 2024-04-06T12:23:47.320 INFO:tasks.workunit.client.0.smithi152.stdout:1/261: dread d2/f16 [0,4194304] 0 2024-04-06T12:23:47.322 INFO:tasks.workunit.client.0.smithi152.stdout:4/243: write d7/d16/f1a [1932532,27235] 0 2024-04-06T12:23:47.326 INFO:tasks.workunit.client.0.smithi152.stdout:7/184: mkdir d8/d2a/d3f 0 2024-04-06T12:23:47.327 INFO:tasks.workunit.client.0.smithi152.stdout:5/298: mknod d3/da/d15/d40/d50/c5e 0 2024-04-06T12:23:47.329 INFO:tasks.workunit.client.0.smithi152.stdout:1/262: rename d2/d1d/d21/d28/c29 to d2/d5d/c63 0 2024-04-06T12:23:47.330 INFO:tasks.workunit.client.0.smithi152.stdout:0/311: symlink d4/de/d28/d18/d43/d62/l64 0 2024-04-06T12:23:47.330 INFO:tasks.workunit.client.0.smithi152.stdout:5/299: dread d3/f1f [0,4194304] 0 2024-04-06T12:23:47.331 INFO:tasks.workunit.client.0.smithi152.stdout:0/312: write d4/de/d28/d18/d43/f5f [839821,29843] 0 2024-04-06T12:23:47.334 INFO:tasks.workunit.client.0.smithi152.stdout:7/185: mknod d8/dc/d17/c40 0 2024-04-06T12:23:47.334 INFO:tasks.workunit.client.0.smithi152.stdout:7/186: read - d8/dc/f3c zero size 2024-04-06T12:23:47.337 INFO:tasks.workunit.client.0.smithi152.stdout:1/263: creat d2/d2f/d37/f64 x:0 0 0 2024-04-06T12:23:47.337 INFO:tasks.workunit.client.0.smithi152.stdout:1/264: stat d2/d1d/f2e 0 2024-04-06T12:23:47.337 INFO:tasks.workunit.client.0.smithi152.stdout:5/300: mkdir d3/da/d15/d40/d4f/d5f 0 2024-04-06T12:23:47.341 INFO:tasks.workunit.client.0.smithi152.stdout:4/244: mkdir d7/d16/d22/d3f/d47 0 2024-04-06T12:23:47.343 INFO:tasks.workunit.client.0.smithi152.stdout:0/313: dread d4/de/f30 [0,4194304] 0 2024-04-06T12:23:47.347 INFO:tasks.workunit.client.0.smithi152.stdout:1/265: creat d2/d2f/f65 x:0 0 0 2024-04-06T12:23:47.349 INFO:tasks.workunit.client.0.smithi152.stdout:7/187: mkdir d8/df/d28/d41 0 2024-04-06T12:23:47.354 INFO:tasks.workunit.client.0.smithi152.stdout:5/301: creat d3/da/d53/f60 x:0 0 0 2024-04-06T12:23:47.357 INFO:tasks.workunit.client.0.smithi152.stdout:3/246: truncate d0/d1f/f23 3085441 0 2024-04-06T12:23:47.358 INFO:tasks.workunit.client.0.smithi152.stdout:7/188: write d8/fb [1082584,75040] 0 2024-04-06T12:23:47.360 INFO:tasks.workunit.client.0.smithi152.stdout:0/314: unlink d4/de/d28/d18/d3b/c63 0 2024-04-06T12:23:47.365 INFO:tasks.workunit.client.0.smithi152.stdout:4/245: link d7/l1d d7/d29/d2e/d2f/d33/l48 0 2024-04-06T12:23:47.373 INFO:tasks.workunit.client.0.smithi152.stdout:4/246: mknod d7/d16/d22/c49 0 2024-04-06T12:23:47.373 INFO:tasks.workunit.client.0.smithi152.stdout:5/302: truncate d3/de/f22 150655 0 2024-04-06T12:23:47.376 INFO:tasks.workunit.client.0.smithi152.stdout:7/189: getdents d8/df/d28/d41 0 2024-04-06T12:23:47.376 INFO:tasks.workunit.client.0.smithi152.stdout:1/266: dwrite d2/d1d/d21/f40 [0,4194304] 0 2024-04-06T12:23:47.377 INFO:tasks.workunit.client.0.smithi152.stdout:7/190: chown d8/d2a/c3b 214 1 2024-04-06T12:23:47.378 INFO:tasks.workunit.client.0.smithi152.stdout:0/315: symlink d4/d31/d47/d51/l65 0 2024-04-06T12:23:47.378 INFO:tasks.workunit.client.0.smithi152.stdout:7/191: fdatasync d8/dc/d17/f1a 0 2024-04-06T12:23:47.379 INFO:tasks.workunit.client.0.smithi152.stdout:3/247: write d0/d1f/f23 [465404,87826] 0 2024-04-06T12:23:47.380 INFO:tasks.workunit.client.0.smithi152.stdout:7/192: dread - d8/dc/d3d/f39 zero size 2024-04-06T12:23:47.386 INFO:tasks.workunit.client.0.smithi152.stdout:3/248: dwrite d0/d1f/f23 [0,4194304] 0 2024-04-06T12:23:47.393 INFO:tasks.workunit.client.0.smithi152.stdout:7/193: mkdir d8/d2a/d42 0 2024-04-06T12:23:47.399 INFO:tasks.workunit.client.0.smithi152.stdout:7/194: write d8/f3a [870136,122552] 0 2024-04-06T12:23:47.399 INFO:tasks.workunit.client.0.smithi152.stdout:4/247: creat d7/f4a x:0 0 0 2024-04-06T12:23:47.402 INFO:tasks.workunit.client.0.smithi152.stdout:5/303: getdents d3/da 0 2024-04-06T12:23:47.405 INFO:tasks.workunit.client.0.smithi152.stdout:5/304: creat d3/da/d15/d40/d50/f61 x:0 0 0 2024-04-06T12:23:47.406 INFO:tasks.workunit.client.0.smithi152.stdout:5/305: truncate d3/f5a 925183 0 2024-04-06T12:23:47.407 INFO:tasks.workunit.client.0.smithi152.stdout:7/195: mkdir d8/d2a/d37/d43 0 2024-04-06T12:23:47.408 INFO:tasks.workunit.client.0.smithi152.stdout:1/267: truncate d2/f20 2488912 0 2024-04-06T12:23:47.408 INFO:tasks.workunit.client.0.smithi152.stdout:7/196: write d8/dc/f3c [233763,102697] 0 2024-04-06T12:23:47.412 INFO:tasks.workunit.client.0.smithi152.stdout:1/268: mknod d2/d2f/d45/c66 0 2024-04-06T12:23:47.414 INFO:tasks.workunit.client.0.smithi152.stdout:1/269: fdatasync d2/d1d/f2e 0 2024-04-06T12:23:47.417 INFO:tasks.workunit.client.0.smithi152.stdout:1/270: fdatasync d2/d2f/d37/f5f 0 2024-04-06T12:23:47.420 INFO:tasks.workunit.client.0.smithi152.stdout:4/248: dwrite d7/d29/f2b [0,4194304] 0 2024-04-06T12:23:47.421 INFO:tasks.workunit.client.0.smithi152.stdout:7/197: dwrite d8/dc/d17/d2c/f36 [0,4194304] 0 2024-04-06T12:23:47.423 INFO:tasks.workunit.client.0.smithi152.stdout:1/271: rmdir d2/d2f 39 2024-04-06T12:23:47.423 INFO:tasks.workunit.client.0.smithi152.stdout:5/306: dread d3/da/fc [0,4194304] 0 2024-04-06T12:23:47.430 INFO:tasks.workunit.client.0.smithi152.stdout:5/307: creat d3/da/d53/f62 x:0 0 0 2024-04-06T12:23:47.431 INFO:tasks.workunit.client.0.smithi152.stdout:7/198: mkdir d8/d44 0 2024-04-06T12:23:47.432 INFO:tasks.workunit.client.0.smithi152.stdout:5/308: write d3/da/f13 [4851107,98423] 0 2024-04-06T12:23:47.432 INFO:tasks.workunit.client.0.smithi152.stdout:7/199: stat d8/dc/d17/f1a 0 2024-04-06T12:23:47.434 INFO:tasks.workunit.client.0.smithi152.stdout:4/249: mknod d7/d16/d22/d3f/d47/c4b 0 2024-04-06T12:23:47.440 INFO:tasks.workunit.client.0.smithi152.stdout:7/200: truncate d8/f16 8349650 0 2024-04-06T12:23:47.444 INFO:tasks.workunit.client.0.smithi152.stdout:4/250: rename d7/d29/d2e/d2f to d7/d4c 0 2024-04-06T12:23:47.446 INFO:tasks.workunit.client.0.smithi152.stdout:7/201: symlink d8/l45 0 2024-04-06T12:23:47.450 INFO:tasks.workunit.client.0.smithi152.stdout:5/309: dwrite d3/d37/f3b [0,4194304] 0 2024-04-06T12:23:47.452 INFO:tasks.workunit.client.0.smithi152.stdout:4/251: symlink d7/d16/l4d 0 2024-04-06T12:23:47.458 INFO:tasks.workunit.client.0.smithi152.stdout:7/202: getdents d8 0 2024-04-06T12:23:47.461 INFO:tasks.workunit.client.0.smithi152.stdout:4/252: dwrite d7/d4c/f39 [0,4194304] 0 2024-04-06T12:23:47.464 INFO:tasks.workunit.client.0.smithi152.stdout:4/253: unlink f5 0 2024-04-06T12:23:47.465 INFO:tasks.workunit.client.0.smithi152.stdout:4/254: chown d7/d16/d22 259024983 1 2024-04-06T12:23:47.473 INFO:tasks.workunit.client.0.smithi152.stdout:4/255: dwrite d7/d4c/d33/f44 [0,4194304] 0 2024-04-06T12:23:47.473 INFO:tasks.workunit.client.0.smithi152.stdout:7/203: dwrite d8/f16 [4194304,4194304] 0 2024-04-06T12:23:47.475 INFO:tasks.workunit.client.0.smithi152.stdout:7/204: write d8/dc/d17/d2c/d2d/f32 [1011973,65328] 0 2024-04-06T12:23:47.477 INFO:tasks.workunit.client.0.smithi152.stdout:6/306: sync 2024-04-06T12:23:47.477 INFO:tasks.workunit.client.0.smithi152.stdout:8/304: sync 2024-04-06T12:23:47.478 INFO:tasks.workunit.client.0.smithi152.stdout:4/256: symlink d7/d16/d22/d3f/d47/l4e 0 2024-04-06T12:23:47.478 INFO:tasks.workunit.client.0.smithi152.stdout:8/305: readlink d4/dc/d10/d49/l57 0 2024-04-06T12:23:47.479 INFO:tasks.workunit.client.0.smithi152.stdout:4/257: fdatasync d7/f2c 0 2024-04-06T12:23:47.480 INFO:tasks.workunit.client.0.smithi152.stdout:4/258: fsync d7/d16/f1a 0 2024-04-06T12:23:47.485 INFO:tasks.workunit.client.0.smithi152.stdout:8/306: creat d4/dc/d10/d51/f67 x:0 0 0 2024-04-06T12:23:47.486 INFO:tasks.workunit.client.0.smithi152.stdout:8/307: write d4/db/f13 [140834,47840] 0 2024-04-06T12:23:47.491 INFO:tasks.workunit.client.0.smithi152.stdout:8/308: fdatasync d4/db/f22 0 2024-04-06T12:23:47.494 INFO:tasks.workunit.client.0.smithi152.stdout:4/259: link d7/d4c/f39 d7/f4f 0 2024-04-06T12:23:47.495 INFO:tasks.workunit.client.0.smithi152.stdout:4/260: chown d7/f4a 12160885 1 2024-04-06T12:23:47.497 INFO:tasks.workunit.client.0.smithi152.stdout:8/309: creat d4/db/f68 x:0 0 0 2024-04-06T12:23:47.499 INFO:tasks.workunit.client.0.smithi152.stdout:8/310: creat d4/db/d56/f69 x:0 0 0 2024-04-06T12:23:47.501 INFO:tasks.workunit.client.0.smithi152.stdout:4/261: unlink d7/d29/d2e/l38 0 2024-04-06T12:23:47.503 INFO:tasks.workunit.client.0.smithi152.stdout:8/311: symlink d4/l6a 0 2024-04-06T12:23:47.505 INFO:tasks.workunit.client.0.smithi152.stdout:7/205: truncate d8/dc/f13 1965082 0 2024-04-06T12:23:47.507 INFO:tasks.workunit.client.0.smithi152.stdout:4/262: dwrite d7/f4a [0,4194304] 0 2024-04-06T12:23:47.509 INFO:tasks.workunit.client.0.smithi152.stdout:7/206: symlink d8/df/l46 0 2024-04-06T12:23:47.509 INFO:tasks.workunit.client.0.smithi152.stdout:6/307: truncate d7/d19/d3e/f4f 3745168 0 2024-04-06T12:23:47.510 INFO:tasks.workunit.client.0.smithi152.stdout:7/207: chown d8/f1b 15 1 2024-04-06T12:23:47.516 INFO:tasks.workunit.client.0.smithi152.stdout:7/208: creat d8/d2a/d37/f47 x:0 0 0 2024-04-06T12:23:47.521 INFO:tasks.workunit.client.0.smithi152.stdout:6/308: rename d7/d19/d1b/d31/d35/l69 to d7/d62/l6c 0 2024-04-06T12:23:47.521 INFO:tasks.workunit.client.0.smithi152.stdout:6/309: dread - d7/d62/f63 zero size 2024-04-06T12:23:47.522 INFO:tasks.workunit.client.0.smithi152.stdout:8/312: dread d4/db/f27 [0,4194304] 0 2024-04-06T12:23:47.522 INFO:tasks.workunit.client.0.smithi152.stdout:6/310: truncate d7/d19/f5e 1021769 0 2024-04-06T12:23:47.522 INFO:tasks.workunit.client.0.smithi152.stdout:7/209: unlink d8/df/c22 0 2024-04-06T12:23:47.525 INFO:tasks.workunit.client.0.smithi152.stdout:6/311: rmdir d7/d9/d26/d4a 39 2024-04-06T12:23:47.527 INFO:tasks.workunit.client.0.smithi152.stdout:4/263: write d7/f4f [912462,17498] 0 2024-04-06T12:23:47.528 INFO:tasks.workunit.client.0.smithi152.stdout:7/210: rmdir d8/dc/d17/d2c 39 2024-04-06T12:23:47.528 INFO:tasks.workunit.client.0.smithi152.stdout:6/312: fsync d7/d9/d26/f3a 0 2024-04-06T12:23:47.530 INFO:tasks.workunit.client.0.smithi152.stdout:8/313: dwrite d4/db/d56/f69 [0,4194304] 0 2024-04-06T12:23:47.533 INFO:tasks.workunit.client.0.smithi152.stdout:6/313: mkdir d7/d62/d6d 0 2024-04-06T12:23:47.538 INFO:tasks.workunit.client.0.smithi152.stdout:4/264: creat d7/d16/d22/d30/f50 x:0 0 0 2024-04-06T12:23:47.539 INFO:tasks.workunit.client.0.smithi152.stdout:8/314: dwrite d4/dc/f19 [0,4194304] 0 2024-04-06T12:23:47.542 INFO:tasks.workunit.client.0.smithi152.stdout:8/315: write d4/dc/d10/d51/f21 [3771582,111902] 0 2024-04-06T12:23:47.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/265: write d7/d4c/f39 [5170082,40191] 0 2024-04-06T12:23:47.544 INFO:tasks.workunit.client.0.smithi152.stdout:6/314: truncate f6 1457964 0 2024-04-06T12:23:47.545 INFO:tasks.workunit.client.0.smithi152.stdout:4/266: write d7/d16/d22/d30/f37 [642869,71692] 0 2024-04-06T12:23:47.546 INFO:tasks.workunit.client.0.smithi152.stdout:7/211: getdents d8/d2a/d42 0 2024-04-06T12:23:47.551 INFO:tasks.workunit.client.0.smithi152.stdout:6/315: mkdir d7/d9/d26/d4a/d6e 0 2024-04-06T12:23:47.553 INFO:tasks.workunit.client.0.smithi152.stdout:8/316: mknod d4/dc/d10/d55/c6b 0 2024-04-06T12:23:47.554 INFO:tasks.workunit.client.0.smithi152.stdout:7/212: mkdir d8/df/d28/d41/d48 0 2024-04-06T12:23:47.556 INFO:tasks.workunit.client.0.smithi152.stdout:6/316: rename d7/fd to d7/d62/f6f 0 2024-04-06T12:23:47.558 INFO:tasks.workunit.client.0.smithi152.stdout:8/317: symlink d4/d5f/l6c 0 2024-04-06T12:23:47.559 INFO:tasks.workunit.client.0.smithi152.stdout:6/317: truncate d7/d19/d1b/d31/d35/f54 1020636 0 2024-04-06T12:23:47.563 INFO:tasks.workunit.client.0.smithi152.stdout:4/267: getdents d7/d16/d22/d3f 0 2024-04-06T12:23:47.565 INFO:tasks.workunit.client.0.smithi152.stdout:8/318: symlink d4/db/d2a/l6d 0 2024-04-06T12:23:47.566 INFO:tasks.workunit.client.0.smithi152.stdout:6/318: mkdir d7/d19/d3e/d70 0 2024-04-06T12:23:47.570 INFO:tasks.workunit.client.0.smithi152.stdout:4/268: mknod d7/d16/d22/d3f/d47/c51 0 2024-04-06T12:23:47.572 INFO:tasks.workunit.client.0.smithi152.stdout:8/319: mkdir d4/db/d2a/d6e 0 2024-04-06T12:23:47.572 INFO:tasks.workunit.client.0.smithi152.stdout:8/320: chown d4/l6a 77 1 2024-04-06T12:23:47.575 INFO:tasks.workunit.client.0.smithi152.stdout:4/269: mknod d7/d16/d22/d3f/c52 0 2024-04-06T12:23:47.579 INFO:tasks.workunit.client.0.smithi152.stdout:8/321: rename d4/d2c/d54/f59 to d4/dc/d10/d55/f6f 0 2024-04-06T12:23:47.581 INFO:tasks.workunit.client.0.smithi152.stdout:7/213: dwrite d8/dc/f13 [0,4194304] 0 2024-04-06T12:23:47.582 INFO:tasks.workunit.client.0.smithi152.stdout:7/214: chown f6 66 1 2024-04-06T12:23:47.583 INFO:tasks.workunit.client.0.smithi152.stdout:6/319: dread d7/d9/f10 [0,4194304] 0 2024-04-06T12:23:47.588 INFO:tasks.workunit.client.0.smithi152.stdout:8/322: rename d4/db/d32/f33 to d4/dc/d10/d49/f70 0 2024-04-06T12:23:47.590 INFO:tasks.workunit.client.0.smithi152.stdout:7/215: dwrite d8/f1b [0,4194304] 0 2024-04-06T12:23:47.592 INFO:tasks.workunit.client.0.smithi152.stdout:6/320: unlink d7/c28 0 2024-04-06T12:23:47.593 INFO:tasks.workunit.client.0.smithi152.stdout:6/321: dread - d7/d19/f55 zero size 2024-04-06T12:23:47.599 INFO:tasks.workunit.client.0.smithi152.stdout:6/322: dwrite d7/fb [0,4194304] 0 2024-04-06T12:23:47.600 INFO:tasks.workunit.client.0.smithi152.stdout:7/216: mkdir d8/d2a/d37/d49 0 2024-04-06T12:23:47.602 INFO:tasks.workunit.client.0.smithi152.stdout:4/270: write d7/fb [2869050,70670] 0 2024-04-06T12:23:47.605 INFO:tasks.workunit.client.0.smithi152.stdout:7/217: unlink d8/df/l46 0 2024-04-06T12:23:47.608 INFO:tasks.workunit.client.0.smithi152.stdout:4/271: mkdir d7/d4c/d33/d53 0 2024-04-06T12:23:47.609 INFO:tasks.workunit.client.0.smithi152.stdout:7/218: mkdir d8/df/d4a 0 2024-04-06T12:23:47.611 INFO:tasks.workunit.client.0.smithi152.stdout:6/323: rename d7/d9/d26/d4a/l4d to d7/d19/d1b/l71 0 2024-04-06T12:23:47.613 INFO:tasks.workunit.client.0.smithi152.stdout:6/324: fdatasync d7/d19/f55 0 2024-04-06T12:23:47.615 INFO:tasks.workunit.client.0.smithi152.stdout:7/219: mkdir d8/dc/d4b 0 2024-04-06T12:23:47.615 INFO:tasks.workunit.client.0.smithi152.stdout:4/272: dwrite d7/d16/d22/d30/f43 [0,4194304] 0 2024-04-06T12:23:47.618 INFO:tasks.workunit.client.0.smithi152.stdout:7/220: write d8/dc/d3d/f39 [468767,24528] 0 2024-04-06T12:23:47.621 INFO:tasks.workunit.client.0.smithi152.stdout:4/273: symlink d7/d36/l54 0 2024-04-06T12:23:47.622 INFO:tasks.workunit.client.0.smithi152.stdout:6/325: dwrite d7/d19/f33 [0,4194304] 0 2024-04-06T12:23:47.629 INFO:tasks.workunit.client.0.smithi152.stdout:7/221: creat d8/d2a/d42/f4c x:0 0 0 2024-04-06T12:23:47.630 INFO:tasks.workunit.client.0.smithi152.stdout:6/326: creat d7/d19/d3e/f72 x:0 0 0 2024-04-06T12:23:47.630 INFO:tasks.workunit.client.0.smithi152.stdout:7/222: write d8/dc/f13 [3087582,76016] 0 2024-04-06T12:23:47.631 INFO:tasks.workunit.client.0.smithi152.stdout:6/327: chown d7/d19/d1b/d1f/f4c 38371 1 2024-04-06T12:23:47.636 INFO:tasks.workunit.client.0.smithi152.stdout:4/274: mkdir d7/d16/d55 0 2024-04-06T12:23:47.637 INFO:tasks.workunit.client.0.smithi152.stdout:7/223: creat d8/df/d28/f4d x:0 0 0 2024-04-06T12:23:47.638 INFO:tasks.workunit.client.0.smithi152.stdout:6/328: mkdir d7/d9/d73 0 2024-04-06T12:23:47.639 INFO:tasks.workunit.client.0.smithi152.stdout:6/329: fdatasync d7/d19/d3e/f53 0 2024-04-06T12:23:47.641 INFO:tasks.workunit.client.0.smithi152.stdout:4/275: chown d7/d16/d22/d30/c40 30205041 1 2024-04-06T12:23:47.645 INFO:tasks.workunit.client.0.smithi152.stdout:7/224: creat d8/dc/d4b/f4e x:0 0 0 2024-04-06T12:23:47.645 INFO:tasks.workunit.client.0.smithi152.stdout:4/276: mknod d7/d29/d2e/c56 0 2024-04-06T12:23:47.646 INFO:tasks.workunit.client.0.smithi152.stdout:7/225: write d8/dc/f24 [1077588,121320] 0 2024-04-06T12:23:47.649 INFO:tasks.workunit.client.0.smithi152.stdout:4/277: rmdir d7/d29 39 2024-04-06T12:23:47.650 INFO:tasks.workunit.client.0.smithi152.stdout:4/278: read d7/f4a [2809418,16553] 0 2024-04-06T12:23:47.651 INFO:tasks.workunit.client.0.smithi152.stdout:6/330: rmdir d7/d62/d6d 0 2024-04-06T12:23:47.653 INFO:tasks.workunit.client.0.smithi152.stdout:7/226: dwrite d8/f16 [0,4194304] 0 2024-04-06T12:23:47.655 INFO:tasks.workunit.client.0.smithi152.stdout:7/227: write d8/fb [400868,115932] 0 2024-04-06T12:23:47.660 INFO:tasks.workunit.client.0.smithi152.stdout:7/228: read d8/dc/d17/f1a [3099811,94437] 0 2024-04-06T12:23:47.662 INFO:tasks.workunit.client.0.smithi152.stdout:6/331: dwrite d7/d9/f56 [0,4194304] 0 2024-04-06T12:23:47.664 INFO:tasks.workunit.client.0.smithi152.stdout:4/279: dread d7/d29/f2b [0,4194304] 0 2024-04-06T12:23:47.669 INFO:tasks.workunit.client.0.smithi152.stdout:7/229: symlink d8/l4f 0 2024-04-06T12:23:47.670 INFO:tasks.workunit.client.0.smithi152.stdout:6/332: rmdir d7/d19/d1b/d22 39 2024-04-06T12:23:47.671 INFO:tasks.workunit.client.0.smithi152.stdout:6/333: write d7/d19/f15 [5218564,36825] 0 2024-04-06T12:23:47.678 INFO:tasks.workunit.client.0.smithi152.stdout:4/280: mknod d7/d16/c57 0 2024-04-06T12:23:47.683 INFO:tasks.workunit.client.0.smithi152.stdout:7/230: rmdir d8/d2a/d3f 0 2024-04-06T12:23:47.686 INFO:tasks.workunit.client.0.smithi152.stdout:4/281: mknod d7/d16/d55/c58 0 2024-04-06T12:23:47.688 INFO:tasks.workunit.client.0.smithi152.stdout:6/334: rename d7/d19/f1c to d7/d9/d26/f74 0 2024-04-06T12:23:47.690 INFO:tasks.workunit.client.0.smithi152.stdout:7/231: dwrite d8/d2a/d42/f4c [0,4194304] 0 2024-04-06T12:23:47.690 INFO:tasks.workunit.client.0.smithi152.stdout:4/282: unlink d7/d16/d22/d3f/c52 0 2024-04-06T12:23:47.691 INFO:tasks.workunit.client.0.smithi152.stdout:7/232: chown d8/d2a/d37/f47 24323 1 2024-04-06T12:23:47.692 INFO:tasks.workunit.client.0.smithi152.stdout:7/233: fdatasync d8/dc/f24 0 2024-04-06T12:23:47.695 INFO:tasks.workunit.client.0.smithi152.stdout:7/234: chown d8/df/d28/d41/d48 481095 1 2024-04-06T12:23:47.697 INFO:tasks.workunit.client.0.smithi152.stdout:7/235: dread - d8/dc/d4b/f4e zero size 2024-04-06T12:23:47.700 INFO:tasks.workunit.client.0.smithi152.stdout:4/283: dwrite d7/d16/d22/f3e [4194304,4194304] 0 2024-04-06T12:23:47.702 INFO:tasks.workunit.client.0.smithi152.stdout:7/236: mknod d8/df/d28/c50 0 2024-04-06T12:23:47.704 INFO:tasks.workunit.client.0.smithi152.stdout:7/237: fsync d8/f16 0 2024-04-06T12:23:47.705 INFO:tasks.workunit.client.0.smithi152.stdout:4/284: write d7/d29/f2b [3887129,81983] 0 2024-04-06T12:23:47.706 INFO:tasks.workunit.client.0.smithi152.stdout:7/238: mknod d8/df/d28/c51 0 2024-04-06T12:23:47.708 INFO:tasks.workunit.client.0.smithi152.stdout:4/285: read d7/d29/f2b [1398486,85172] 0 2024-04-06T12:23:47.709 INFO:tasks.workunit.client.0.smithi152.stdout:6/335: dread d7/d62/f6f [4194304,4194304] 0 2024-04-06T12:23:47.712 INFO:tasks.workunit.client.0.smithi152.stdout:4/286: dread - d7/d16/d22/d30/f50 zero size 2024-04-06T12:23:47.714 INFO:tasks.workunit.client.0.smithi152.stdout:4/287: readlink d7/d36/l3a 0 2024-04-06T12:23:47.718 INFO:tasks.workunit.client.0.smithi152.stdout:6/336: dwrite d7/d19/f15 [4194304,4194304] 0 2024-04-06T12:23:47.724 INFO:tasks.workunit.client.0.smithi152.stdout:4/288: dwrite d7/d16/f20 [0,4194304] 0 2024-04-06T12:23:47.727 INFO:tasks.workunit.client.0.smithi152.stdout:7/239: dwrite f3 [4194304,4194304] 0 2024-04-06T12:23:47.727 INFO:tasks.workunit.client.0.smithi152.stdout:4/289: truncate d7/d16/d22/d30/f43 4331494 0 2024-04-06T12:23:47.739 INFO:tasks.workunit.client.0.smithi152.stdout:6/337: symlink d7/d19/d1b/d22/l75 0 2024-04-06T12:23:47.739 INFO:tasks.workunit.client.0.smithi152.stdout:4/290: rename d7/d36 to d7/d4c/d33/d53/d59 0 2024-04-06T12:23:47.740 INFO:tasks.workunit.client.0.smithi152.stdout:4/291: chown d7/d16/f20 8173001 1 2024-04-06T12:23:47.744 INFO:tasks.workunit.client.0.smithi152.stdout:6/338: dread d7/f1e [0,4194304] 0 2024-04-06T12:23:47.744 INFO:tasks.workunit.client.0.smithi152.stdout:4/292: rmdir d7/d16/d22/d3f 39 2024-04-06T12:23:47.745 INFO:tasks.workunit.client.0.smithi152.stdout:4/293: chown d7/f17 2 1 2024-04-06T12:23:47.747 INFO:tasks.workunit.client.0.smithi152.stdout:7/240: link d8/f1b d8/dc/d17/d2c/f52 0 2024-04-06T12:23:47.749 INFO:tasks.workunit.client.0.smithi152.stdout:6/339: stat d7/d19/d1b/l71 0 2024-04-06T12:23:47.810 INFO:tasks.workunit.client.0.smithi152.stdout:2/353: sync 2024-04-06T12:23:47.810 INFO:tasks.workunit.client.0.smithi152.stdout:9/228: sync 2024-04-06T12:23:47.810 INFO:tasks.workunit.client.0.smithi152.stdout:7/241: mkdir d8/dc/d3d/d53 0 2024-04-06T12:23:47.811 INFO:tasks.workunit.client.0.smithi152.stdout:2/354: chown d0/d15/d4d/f55 2736 1 2024-04-06T12:23:47.811 INFO:tasks.workunit.client.0.smithi152.stdout:7/242: write d8/f16 [1543742,88343] 0 2024-04-06T12:23:47.813 INFO:tasks.workunit.client.0.smithi152.stdout:2/355: read - d0/d40/f62 zero size 2024-04-06T12:23:47.814 INFO:tasks.workunit.client.0.smithi152.stdout:4/294: rename d7/d4c to d7/d16/d22/d3f/d5a 0 2024-04-06T12:23:47.819 INFO:tasks.workunit.client.0.smithi152.stdout:9/229: rename d5/c47 to d5/d6/d15/d17/d23/d2d/d4b/c4d 0 2024-04-06T12:23:47.820 INFO:tasks.workunit.client.0.smithi152.stdout:6/340: dwrite d7/d19/f30 [0,4194304] 0 2024-04-06T12:23:47.823 INFO:tasks.workunit.client.0.smithi152.stdout:2/356: creat d0/d2/d6f/f77 x:0 0 0 2024-04-06T12:23:47.824 INFO:tasks.workunit.client.0.smithi152.stdout:2/357: read d0/f1c [2972529,82475] 0 2024-04-06T12:23:47.828 INFO:tasks.workunit.client.0.smithi152.stdout:7/243: creat d8/dc/d17/f54 x:0 0 0 2024-04-06T12:23:47.828 INFO:tasks.workunit.client.0.smithi152.stdout:9/230: symlink d5/d39/d3f/d42/l4e 0 2024-04-06T12:23:47.830 INFO:tasks.workunit.client.0.smithi152.stdout:4/295: rmdir d7/d45 0 2024-04-06T12:23:47.832 INFO:tasks.workunit.client.0.smithi152.stdout:2/358: symlink d0/d40/d26/l78 0 2024-04-06T12:23:47.832 INFO:tasks.workunit.client.0.smithi152.stdout:2/359: readlink d0/l8 0 2024-04-06T12:23:47.842 INFO:tasks.workunit.client.0.smithi152.stdout:2/360: unlink d0/f29 0 2024-04-06T12:23:47.845 INFO:tasks.workunit.client.0.smithi152.stdout:7/244: symlink d8/df/d28/d41/d48/l55 0 2024-04-06T12:23:47.847 INFO:tasks.workunit.client.0.smithi152.stdout:6/341: getdents d7/d9/d26/d4a 0 2024-04-06T12:23:47.848 INFO:tasks.workunit.client.0.smithi152.stdout:6/342: write d7/d19/f55 [425221,43113] 0 2024-04-06T12:23:47.849 INFO:tasks.workunit.client.0.smithi152.stdout:7/245: mkdir d8/dc/d4b/d56 0 2024-04-06T12:23:47.851 INFO:tasks.workunit.client.0.smithi152.stdout:2/361: mkdir d0/d15/d24/d79 0 2024-04-06T12:23:47.852 INFO:tasks.workunit.client.0.smithi152.stdout:4/296: getdents d7/d29 0 2024-04-06T12:23:47.854 INFO:tasks.workunit.client.0.smithi152.stdout:2/362: chown d0/d15/d4d/f4e 163 1 2024-04-06T12:23:47.854 INFO:tasks.workunit.client.0.smithi152.stdout:7/246: dread d8/dc/fe [8388608,4194304] 0 2024-04-06T12:23:47.855 INFO:tasks.workunit.client.0.smithi152.stdout:6/343: creat d7/d19/d1b/d22/f76 x:0 0 0 2024-04-06T12:23:47.857 INFO:tasks.workunit.client.0.smithi152.stdout:9/231: dwrite d5/d6/d15/d17/d23/d2d/d32/d36/f4c [0,4194304] 0 2024-04-06T12:23:47.857 INFO:tasks.workunit.client.0.smithi152.stdout:4/297: write d7/d16/d22/d3f/d5a/d33/f44 [3390107,10711] 0 2024-04-06T12:23:47.863 INFO:tasks.workunit.client.0.smithi152.stdout:7/247: dread d8/dc/f13 [0,4194304] 0 2024-04-06T12:23:47.868 INFO:tasks.workunit.client.0.smithi152.stdout:4/298: dwrite d7/d16/d22/d30/f50 [0,4194304] 0 2024-04-06T12:23:47.869 INFO:tasks.workunit.client.0.smithi152.stdout:9/232: mknod d5/d39/d3f/d42/c4f 0 2024-04-06T12:23:47.872 INFO:tasks.workunit.client.0.smithi152.stdout:4/299: write d7/d16/f1a [2342365,128129] 0 2024-04-06T12:23:47.874 INFO:tasks.workunit.client.0.smithi152.stdout:4/300: chown d7/d16/d55 1 1 2024-04-06T12:23:47.877 INFO:tasks.workunit.client.0.smithi152.stdout:6/344: dread d7/d19/d1b/d31/f3c [0,4194304] 0 2024-04-06T12:23:47.880 INFO:tasks.workunit.client.0.smithi152.stdout:7/248: read d8/dc/f23 [205264,71091] 0 2024-04-06T12:23:47.880 INFO:tasks.workunit.client.0.smithi152.stdout:2/363: write d0/d40/d26/f2a [4369274,20913] 0 2024-04-06T12:23:47.880 INFO:tasks.workunit.client.0.smithi152.stdout:9/233: dwrite d5/f1d [4194304,4194304] 0 2024-04-06T12:23:47.883 INFO:tasks.workunit.client.0.smithi152.stdout:2/364: write d0/d2/d5/fe [1193762,42458] 0 2024-04-06T12:23:47.889 INFO:tasks.workunit.client.0.smithi152.stdout:4/301: dwrite d7/fb [0,4194304] 0 2024-04-06T12:23:47.892 INFO:tasks.workunit.client.0.smithi152.stdout:6/345: creat d7/d19/d3e/d70/f77 x:0 0 0 2024-04-06T12:23:47.897 INFO:tasks.workunit.client.0.smithi152.stdout:7/249: dwrite d8/fb [0,4194304] 0 2024-04-06T12:23:47.897 INFO:tasks.workunit.client.0.smithi152.stdout:6/346: write d7/d9/f18 [1090275,39930] 0 2024-04-06T12:23:47.899 INFO:tasks.workunit.client.0.smithi152.stdout:2/365: dwrite d0/d15/d4d/f55 [4194304,4194304] 0 2024-04-06T12:23:47.900 INFO:tasks.workunit.client.0.smithi152.stdout:7/250: read d8/dc/f13 [2122646,44540] 0 2024-04-06T12:23:47.900 INFO:tasks.workunit.client.0.smithi152.stdout:4/302: mkdir d7/d29/d2e/d5b 0 2024-04-06T12:23:47.905 INFO:tasks.workunit.client.0.smithi152.stdout:4/303: write d7/d16/f1a [257899,103919] 0 2024-04-06T12:23:47.906 INFO:tasks.workunit.client.0.smithi152.stdout:7/251: write d8/d2a/d37/f47 [175390,122538] 0 2024-04-06T12:23:47.907 INFO:tasks.workunit.client.0.smithi152.stdout:9/234: creat d5/d6/f50 x:0 0 0 2024-04-06T12:23:47.908 INFO:tasks.workunit.client.0.smithi152.stdout:7/252: write d8/f16 [4232413,10991] 0 2024-04-06T12:23:47.910 INFO:tasks.workunit.client.0.smithi152.stdout:7/253: chown d8/d2a/d37/d43 12328854 1 2024-04-06T12:23:47.911 INFO:tasks.workunit.client.0.smithi152.stdout:9/235: dread d5/d6/f24 [0,4194304] 0 2024-04-06T12:23:47.916 INFO:tasks.workunit.client.0.smithi152.stdout:2/366: creat d0/d15/d24/d79/f7a x:0 0 0 2024-04-06T12:23:47.917 INFO:tasks.workunit.client.0.smithi152.stdout:4/304: dwrite d7/d16/f20 [0,4194304] 0 2024-04-06T12:23:47.919 INFO:tasks.workunit.client.0.smithi152.stdout:7/254: rename d8/dc/d17/d2c/f52 to d8/d2a/d42/f57 0 2024-04-06T12:23:47.920 INFO:tasks.workunit.client.0.smithi152.stdout:9/236: creat d5/d6/d15/d17/d23/d2d/f51 x:0 0 0 2024-04-06T12:23:47.922 INFO:tasks.workunit.client.0.smithi152.stdout:2/367: unlink d0/d2/fa 0 2024-04-06T12:23:47.926 INFO:tasks.workunit.client.0.smithi152.stdout:7/255: rename f6 to d8/dc/d17/d2c/d2d/f58 0 2024-04-06T12:23:47.928 INFO:tasks.workunit.client.0.smithi152.stdout:9/237: dwrite d5/d6/f49 [0,4194304] 0 2024-04-06T12:23:47.929 INFO:tasks.workunit.client.0.smithi152.stdout:7/256: read d8/dc/d17/f1a [491472,17470] 0 2024-04-06T12:23:47.933 INFO:tasks.workunit.client.0.smithi152.stdout:4/305: link d7/d16/d22/c3b d7/d16/d22/d3f/d47/c5c 0 2024-04-06T12:23:47.938 INFO:tasks.workunit.client.0.smithi152.stdout:7/257: mkdir d8/dc/d17/d2c/d59 0 2024-04-06T12:23:47.945 INFO:tasks.workunit.client.0.smithi152.stdout:2/368: link d0/d40/f3f d0/d40/d26/f7b 0 2024-04-06T12:23:47.948 INFO:tasks.workunit.client.0.smithi152.stdout:4/306: mknod d7/d29/d2e/c5d 0 2024-04-06T12:23:47.948 INFO:tasks.workunit.client.0.smithi152.stdout:4/307: chown l2 193033 1 2024-04-06T12:23:47.952 INFO:tasks.workunit.client.0.smithi152.stdout:7/258: write d8/dc/f13 [1268473,19798] 0 2024-04-06T12:23:47.953 INFO:tasks.workunit.client.0.smithi152.stdout:7/259: read - d8/df/d28/f4d zero size 2024-04-06T12:23:47.960 INFO:tasks.workunit.client.0.smithi152.stdout:6/347: dread d7/d19/d1b/d22/f29 [0,4194304] 0 2024-04-06T12:23:47.963 INFO:tasks.workunit.client.0.smithi152.stdout:4/308: creat d7/d29/f5e x:0 0 0 2024-04-06T12:23:47.963 INFO:tasks.workunit.client.0.smithi152.stdout:7/260: creat d8/df/d28/f5a x:0 0 0 2024-04-06T12:23:47.965 INFO:tasks.workunit.client.0.smithi152.stdout:2/369: creat d0/d40/d41/d28/d54/f7c x:0 0 0 2024-04-06T12:23:47.965 INFO:tasks.workunit.client.0.smithi152.stdout:9/238: truncate d5/d6/d15/d17/d23/d2d/d32/d36/f4c 3988988 0 2024-04-06T12:23:47.967 INFO:tasks.workunit.client.0.smithi152.stdout:4/309: mkdir d7/d29/d5f 0 2024-04-06T12:23:47.970 INFO:tasks.workunit.client.0.smithi152.stdout:7/261: mknod d8/dc/d3d/c5b 0 2024-04-06T12:23:47.971 INFO:tasks.workunit.client.0.smithi152.stdout:7/262: write d8/f3a [1821098,89543] 0 2024-04-06T12:23:47.974 INFO:tasks.workunit.client.0.smithi152.stdout:4/310: dwrite d7/d16/d22/f3e [4194304,4194304] 0 2024-04-06T12:23:47.977 INFO:tasks.workunit.client.0.smithi152.stdout:6/348: creat d7/f78 x:0 0 0 2024-04-06T12:23:47.981 INFO:tasks.workunit.client.0.smithi152.stdout:2/370: rename d0/d15/d24/d3d/f18 to d0/d15/d24/d3d/f7d 0 2024-04-06T12:23:47.983 INFO:tasks.workunit.client.0.smithi152.stdout:9/239: getdents d5/d6/d15/d17/d23/d2d/d32/d36 0 2024-04-06T12:23:47.983 INFO:tasks.workunit.client.0.smithi152.stdout:7/263: dwrite d8/df/d28/f4d [0,4194304] 0 2024-04-06T12:23:47.985 INFO:tasks.workunit.client.0.smithi152.stdout:6/349: rename d7/d19/d1b/d22/l75 to d7/d19/l79 0 2024-04-06T12:23:47.986 INFO:tasks.workunit.client.0.smithi152.stdout:2/371: rmdir d0/d15 39 2024-04-06T12:23:47.986 INFO:tasks.workunit.client.0.smithi152.stdout:4/311: dread d7/f4a [0,4194304] 0 2024-04-06T12:23:47.989 INFO:tasks.workunit.client.0.smithi152.stdout:4/312: write d7/f4f [2642069,51389] 0 2024-04-06T12:23:47.990 INFO:tasks.workunit.client.0.smithi152.stdout:9/240: truncate d5/d6/d15/d17/f46 1009570 0 2024-04-06T12:23:47.996 INFO:tasks.workunit.client.0.smithi152.stdout:9/241: stat d5/fb 0 2024-04-06T12:23:47.997 INFO:tasks.workunit.client.0.smithi152.stdout:7/264: dwrite d8/dc/d17/d2c/f38 [4194304,4194304] 0 2024-04-06T12:23:48.000 INFO:tasks.workunit.client.0.smithi152.stdout:2/372: rename d0/d40/d26/f71 to d0/d40/d41/d28/d54/f7e 0 2024-04-06T12:23:48.002 INFO:tasks.workunit.client.0.smithi152.stdout:3/249: sync 2024-04-06T12:23:48.002 INFO:tasks.workunit.client.0.smithi152.stdout:0/316: sync 2024-04-06T12:23:48.008 INFO:tasks.workunit.client.0.smithi152.stdout:3/250: dwrite d0/d10/d1e/f1d [0,4194304] 0 2024-04-06T12:23:48.064 INFO:tasks.workunit.client.0.smithi152.stdout:4/313: getdents d7/d29/d2e/d5b 0 2024-04-06T12:23:48.070 INFO:tasks.workunit.client.0.smithi152.stdout:4/314: dwrite d7/fb [0,4194304] 0 2024-04-06T12:23:48.071 INFO:tasks.workunit.client.0.smithi152.stdout:4/315: read d7/d16/d22/d3f/d5a/f39 [2359696,65352] 0 2024-04-06T12:23:48.088 INFO:tasks.workunit.client.0.smithi152.stdout:6/350: truncate d7/d19/f5e 581791 0 2024-04-06T12:23:48.088 INFO:tasks.workunit.client.0.smithi152.stdout:6/351: readlink d7/l3f 0 2024-04-06T12:23:48.094 INFO:tasks.workunit.client.0.smithi152.stdout:3/251: mknod d0/d10/c4c 0 2024-04-06T12:23:48.094 INFO:tasks.workunit.client.0.smithi152.stdout:2/373: dwrite d0/d15/d24/f6b [0,4194304] 0 2024-04-06T12:23:48.107 INFO:tasks.workunit.client.0.smithi152.stdout:0/317: creat d4/de/d28/f66 x:0 0 0 2024-04-06T12:23:48.108 INFO:tasks.workunit.client.0.smithi152.stdout:2/374: creat d0/d2/f7f x:0 0 0 2024-04-06T12:23:48.109 INFO:tasks.workunit.client.0.smithi152.stdout:4/316: rmdir d7/d29/d5f 0 2024-04-06T12:23:48.109 INFO:tasks.workunit.client.0.smithi152.stdout:2/375: truncate d0/d40/d41/d28/f61 32296 0 2024-04-06T12:23:48.111 INFO:tasks.workunit.client.0.smithi152.stdout:2/376: write d0/d15/d24/d3d/f6a [774902,42646] 0 2024-04-06T12:23:48.112 INFO:tasks.workunit.client.0.smithi152.stdout:0/318: mkdir d4/de/d67 0 2024-04-06T12:23:48.113 INFO:tasks.workunit.client.0.smithi152.stdout:2/377: write d0/d15/d24/f36 [4071433,86915] 0 2024-04-06T12:23:48.116 INFO:tasks.workunit.client.0.smithi152.stdout:4/317: dread d7/d16/d22/d30/f50 [0,4194304] 0 2024-04-06T12:23:48.121 INFO:tasks.workunit.client.0.smithi152.stdout:0/319: dwrite d4/de/d28/f22 [0,4194304] 0 2024-04-06T12:23:48.123 INFO:tasks.workunit.client.0.smithi152.stdout:2/378: unlink d0/d15/c5a 0 2024-04-06T12:23:48.126 INFO:tasks.workunit.client.0.smithi152.stdout:6/352: fdatasync d7/d19/f5e 0 2024-04-06T12:23:48.131 INFO:tasks.workunit.client.0.smithi152.stdout:6/353: unlink d7/d19/d1b/d31/d35/f60 0 2024-04-06T12:23:48.131 INFO:tasks.workunit.client.0.smithi152.stdout:2/379: dwrite d0/d40/d41/f75 [0,4194304] 0 2024-04-06T12:23:48.133 INFO:tasks.workunit.client.0.smithi152.stdout:6/354: read d7/d9/d26/d2e/f42 [3552675,128645] 0 2024-04-06T12:23:48.135 INFO:tasks.workunit.client.0.smithi152.stdout:2/380: mkdir d0/d15/d24/d79/d80 0 2024-04-06T12:23:48.138 INFO:tasks.workunit.client.0.smithi152.stdout:6/355: mknod d7/d9/d26/c7a 0 2024-04-06T12:23:48.139 INFO:tasks.workunit.client.0.smithi152.stdout:0/320: dwrite d4/de/d28/d18/f2c [4194304,4194304] 0 2024-04-06T12:23:48.141 INFO:tasks.workunit.client.0.smithi152.stdout:0/321: read d4/f52 [808563,34679] 0 2024-04-06T12:23:48.143 INFO:tasks.workunit.client.0.smithi152.stdout:6/356: mkdir d7/d9/d26/d4a/d7b 0 2024-04-06T12:23:48.147 INFO:tasks.workunit.client.0.smithi152.stdout:6/357: mkdir d7/d19/d1b/d31/d7c 0 2024-04-06T12:23:48.147 INFO:tasks.workunit.client.0.smithi152.stdout:0/322: dread - d4/de/d28/d18/d3b/d2e/f4b zero size 2024-04-06T12:23:48.148 INFO:tasks.workunit.client.0.smithi152.stdout:6/358: chown d7/d19/d1b/d31/f3c 318561 1 2024-04-06T12:23:48.151 INFO:tasks.workunit.client.0.smithi152.stdout:0/323: stat d4/de/d4a/l54 0 2024-04-06T12:23:48.153 INFO:tasks.workunit.client.0.smithi152.stdout:6/359: dread d7/d19/f33 [0,4194304] 0 2024-04-06T12:23:48.153 INFO:tasks.workunit.client.0.smithi152.stdout:0/324: write d4/de/d28/d18/d43/f5f [835516,107005] 0 2024-04-06T12:23:48.155 INFO:tasks.workunit.client.0.smithi152.stdout:6/360: fdatasync d7/d19/f23 0 2024-04-06T12:23:48.157 INFO:tasks.workunit.client.0.smithi152.stdout:0/325: write d4/f52 [327446,13618] 0 2024-04-06T12:23:48.163 INFO:tasks.workunit.client.0.smithi152.stdout:0/326: creat d4/de/f68 x:0 0 0 2024-04-06T12:23:48.165 INFO:tasks.workunit.client.0.smithi152.stdout:6/361: getdents d7/d19/d3e 0 2024-04-06T12:23:48.167 INFO:tasks.workunit.client.0.smithi152.stdout:0/327: rename d4/d31/f58 to d4/de/d28/d18/d43/d62/f69 0 2024-04-06T12:23:48.170 INFO:tasks.workunit.client.0.smithi152.stdout:6/362: symlink d7/d9/l7d 0 2024-04-06T12:23:48.172 INFO:tasks.workunit.client.0.smithi152.stdout:0/328: creat d4/de/d67/f6a x:0 0 0 2024-04-06T12:23:48.173 INFO:tasks.workunit.client.0.smithi152.stdout:6/363: creat d7/d19/d3e/d70/f7e x:0 0 0 2024-04-06T12:23:48.175 INFO:tasks.workunit.client.0.smithi152.stdout:0/329: creat d4/d31/f6b x:0 0 0 2024-04-06T12:23:48.180 INFO:tasks.workunit.client.0.smithi152.stdout:6/364: dwrite d7/d62/f63 [0,4194304] 0 2024-04-06T12:23:48.182 INFO:tasks.workunit.client.0.smithi152.stdout:0/330: dread d4/f32 [0,4194304] 0 2024-04-06T12:23:48.186 INFO:tasks.workunit.client.0.smithi152.stdout:6/365: creat d7/d19/d1b/f7f x:0 0 0 2024-04-06T12:23:48.187 INFO:tasks.workunit.client.0.smithi152.stdout:6/366: chown d7/d9/d26/d4a/f58 12489016 1 2024-04-06T12:23:48.187 INFO:tasks.workunit.client.0.smithi152.stdout:6/367: rename d7 to d7/d19/d3e/d70/d80 22 2024-04-06T12:23:48.192 INFO:tasks.workunit.client.0.smithi152.stdout:6/368: fdatasync d7/d9/d26/d2e/f42 0 2024-04-06T12:23:48.195 INFO:tasks.workunit.client.0.smithi152.stdout:6/369: creat d7/d19/f81 x:0 0 0 2024-04-06T12:23:48.201 INFO:tasks.workunit.client.0.smithi152.stdout:0/331: fsync d4/de/d67/f6a 0 2024-04-06T12:23:48.205 INFO:tasks.workunit.client.0.smithi152.stdout:0/332: write d4/d31/f34 [4879608,66094] 0 2024-04-06T12:23:48.210 INFO:tasks.workunit.client.0.smithi152.stdout:0/333: readlink d4/l6 0 2024-04-06T12:23:48.212 INFO:tasks.workunit.client.0.smithi152.stdout:0/334: write d4/de/d28/d18/f2c [1146985,22720] 0 2024-04-06T12:23:48.223 INFO:tasks.workunit.client.0.smithi152.stdout:0/335: write d4/f39 [7744417,56369] 0 2024-04-06T12:23:48.225 INFO:tasks.workunit.client.0.smithi152.stdout:6/370: dwrite d7/d9/d26/f74 [0,4194304] 0 2024-04-06T12:23:48.230 INFO:tasks.workunit.client.0.smithi152.stdout:0/336: creat d4/d31/d47/d51/f6c x:0 0 0 2024-04-06T12:23:48.234 INFO:tasks.workunit.client.0.smithi152.stdout:0/337: chown d4/de/d4a/d33/c44 3487244 1 2024-04-06T12:23:48.234 INFO:tasks.workunit.client.0.smithi152.stdout:6/371: dwrite d7/d19/d3e/f53 [0,4194304] 0 2024-04-06T12:23:48.244 INFO:tasks.workunit.client.0.smithi152.stdout:6/372: unlink d7/d19/d1b/d1f/d3d/l45 0 2024-04-06T12:23:48.245 INFO:tasks.workunit.client.0.smithi152.stdout:6/373: chown d7/d9/l21 526818 1 2024-04-06T12:23:48.245 INFO:tasks.workunit.client.0.smithi152.stdout:6/374: fsync d7/d19/d3e/d70/f7e 0 2024-04-06T12:23:48.249 INFO:tasks.workunit.client.0.smithi152.stdout:0/338: rename d4/de/l27 to d4/de/d28/l6d 0 2024-04-06T12:23:48.250 INFO:tasks.workunit.client.0.smithi152.stdout:0/339: chown d4/de/d28/d18/d43/c61 8629 1 2024-04-06T12:23:48.251 INFO:tasks.workunit.client.0.smithi152.stdout:6/375: dread d7/d19/d1b/d22/f29 [0,4194304] 0 2024-04-06T12:23:48.252 INFO:tasks.workunit.client.0.smithi152.stdout:6/376: write d7/fb [4373298,45149] 0 2024-04-06T12:23:48.254 INFO:tasks.workunit.client.0.smithi152.stdout:6/377: write d7/d19/f15 [5523499,51740] 0 2024-04-06T12:23:48.254 INFO:tasks.workunit.client.0.smithi152.stdout:1/272: sync 2024-04-06T12:23:48.257 INFO:tasks.workunit.client.0.smithi152.stdout:0/340: dwrite f3 [0,4194304] 0 2024-04-06T12:23:48.262 INFO:tasks.workunit.client.0.smithi152.stdout:6/378: rename d7/d19/d1b/d22/f68 to d7/d19/d1b/d31/f82 0 2024-04-06T12:23:48.262 INFO:tasks.workunit.client.0.smithi152.stdout:1/273: truncate d2/f10 1612198 0 2024-04-06T12:23:48.264 INFO:tasks.workunit.client.0.smithi152.stdout:6/379: chown d7/d19/f5e 1992291 1 2024-04-06T12:23:48.267 INFO:tasks.workunit.client.0.smithi152.stdout:0/341: dwrite d4/d19/f53 [0,4194304] 0 2024-04-06T12:23:48.267 INFO:tasks.workunit.client.0.smithi152.stdout:6/380: mknod d7/d9/d26/d4a/c83 0 2024-04-06T12:23:48.270 INFO:tasks.workunit.client.0.smithi152.stdout:1/274: creat d2/d1d/f67 x:0 0 0 2024-04-06T12:23:48.270 INFO:tasks.workunit.client.0.smithi152.stdout:0/342: write d4/de/d28/d18/f2c [6383391,94009] 0 2024-04-06T12:23:48.280 INFO:tasks.workunit.client.0.smithi152.stdout:6/381: mknod d7/c84 0 2024-04-06T12:23:48.283 INFO:tasks.workunit.client.0.smithi152.stdout:1/275: mknod d2/d61/c68 0 2024-04-06T12:23:48.285 INFO:tasks.workunit.client.0.smithi152.stdout:0/343: mkdir d4/d6e 0 2024-04-06T12:23:48.286 INFO:tasks.workunit.client.0.smithi152.stdout:0/344: truncate d4/f2b 2283715 0 2024-04-06T12:23:48.287 INFO:tasks.workunit.client.0.smithi152.stdout:0/345: fdatasync d4/de/d28/d18/d3b/f5a 0 2024-04-06T12:23:48.288 INFO:tasks.workunit.client.0.smithi152.stdout:6/382: rename d7/c27 to d7/d62/c85 0 2024-04-06T12:23:48.289 INFO:tasks.workunit.client.0.smithi152.stdout:6/383: chown d7/d9/f18 30 1 2024-04-06T12:23:48.293 INFO:tasks.workunit.client.0.smithi152.stdout:0/346: creat d4/d31/d47/d51/f6f x:0 0 0 2024-04-06T12:23:48.294 INFO:tasks.workunit.client.0.smithi152.stdout:0/347: read d4/de/d4a/d33/f48 [7033,33081] 0 2024-04-06T12:23:48.296 INFO:tasks.workunit.client.0.smithi152.stdout:0/348: read d4/d19/f4e [692194,51108] 0 2024-04-06T12:23:48.297 INFO:tasks.workunit.client.0.smithi152.stdout:1/276: dread d2/f12 [0,4194304] 0 2024-04-06T12:23:48.297 INFO:tasks.workunit.client.0.smithi152.stdout:0/349: write d4/d19/f41 [640230,82250] 0 2024-04-06T12:23:48.298 INFO:tasks.workunit.client.0.smithi152.stdout:6/384: write d7/d19/d1b/d22/f29 [2313822,95642] 0 2024-04-06T12:23:48.300 INFO:tasks.workunit.client.0.smithi152.stdout:0/350: truncate d4/de/d67/f6a 585225 0 2024-04-06T12:23:48.303 INFO:tasks.workunit.client.0.smithi152.stdout:1/277: dread - d2/d2f/d37/f4f zero size 2024-04-06T12:23:48.306 INFO:tasks.workunit.client.0.smithi152.stdout:6/385: mknod d7/d9/c86 0 2024-04-06T12:23:48.307 INFO:tasks.workunit.client.0.smithi152.stdout:6/386: read - d7/d19/d1b/f7f zero size 2024-04-06T12:23:48.307 INFO:tasks.workunit.client.0.smithi152.stdout:0/351: fdatasync d4/f32 0 2024-04-06T12:23:48.308 INFO:tasks.workunit.client.0.smithi152.stdout:6/387: rename d7/d19/d1b/d31 to d7/d19/d1b/d31/d87 22 2024-04-06T12:23:48.309 INFO:tasks.workunit.client.0.smithi152.stdout:6/388: truncate d7/d19/f81 1029929 0 2024-04-06T12:23:48.310 INFO:tasks.workunit.client.0.smithi152.stdout:6/389: fsync d7/d9/f56 0 2024-04-06T12:23:48.312 INFO:tasks.workunit.client.0.smithi152.stdout:6/390: write d7/d19/f5e [1503182,10923] 0 2024-04-06T12:23:48.314 INFO:tasks.workunit.client.0.smithi152.stdout:0/352: dwrite d4/d31/f3d [0,4194304] 0 2024-04-06T12:23:48.316 INFO:tasks.workunit.client.0.smithi152.stdout:0/353: chown d4/f39 586 1 2024-04-06T12:23:48.317 INFO:tasks.workunit.client.0.smithi152.stdout:0/354: read d4/f52 [559075,52658] 0 2024-04-06T12:23:48.318 INFO:tasks.workunit.client.0.smithi152.stdout:1/278: mknod d2/d1d/d21/c69 0 2024-04-06T12:23:48.320 INFO:tasks.workunit.client.0.smithi152.stdout:6/391: unlink d7/d9/d26/d2e/l64 0 2024-04-06T12:23:48.323 INFO:tasks.workunit.client.0.smithi152.stdout:1/279: dwrite d2/f11 [0,4194304] 0 2024-04-06T12:23:48.330 INFO:tasks.workunit.client.0.smithi152.stdout:6/392: readlink d7/d19/d1b/d22/l61 0 2024-04-06T12:23:48.331 INFO:tasks.workunit.client.0.smithi152.stdout:0/355: read d4/de/d28/d18/d3b/f2f [735149,79345] 0 2024-04-06T12:23:48.333 INFO:tasks.workunit.client.0.smithi152.stdout:6/393: symlink d7/d19/l88 0 2024-04-06T12:23:48.334 INFO:tasks.workunit.client.0.smithi152.stdout:0/356: symlink d4/de/d28/d18/d3b/l70 0 2024-04-06T12:23:48.335 INFO:tasks.workunit.client.0.smithi152.stdout:0/357: dread - d4/d31/d47/d51/f6c zero size 2024-04-06T12:23:48.336 INFO:tasks.workunit.client.0.smithi152.stdout:0/358: read d4/d19/f53 [2783798,53015] 0 2024-04-06T12:23:48.337 INFO:tasks.workunit.client.0.smithi152.stdout:0/359: chown d4/f32 4 1 2024-04-06T12:23:48.338 INFO:tasks.workunit.client.0.smithi152.stdout:1/280: rmdir d2/d1d 39 2024-04-06T12:23:48.338 INFO:tasks.workunit.client.0.smithi152.stdout:0/360: dread d4/de/d67/f6a [0,4194304] 0 2024-04-06T12:23:48.350 INFO:tasks.workunit.client.0.smithi152.stdout:6/394: dread d7/d9/f2b [0,4194304] 0 2024-04-06T12:23:48.350 INFO:tasks.workunit.client.0.smithi152.stdout:0/361: unlink d4/f52 0 2024-04-06T12:23:48.350 INFO:tasks.workunit.client.0.smithi152.stdout:0/362: dread - d4/de/f68 zero size 2024-04-06T12:23:48.356 INFO:tasks.workunit.client.0.smithi152.stdout:1/281: dread d2/d1d/f3e [0,4194304] 0 2024-04-06T12:23:48.359 INFO:tasks.workunit.client.0.smithi152.stdout:0/363: mknod d4/de/d28/d18/d43/c71 0 2024-04-06T12:23:48.362 INFO:tasks.workunit.client.0.smithi152.stdout:1/282: mkdir d2/d1d/d21/d28/d6a 0 2024-04-06T12:23:48.363 INFO:tasks.workunit.client.0.smithi152.stdout:1/283: truncate d2/d1d/f67 828134 0 2024-04-06T12:23:48.368 INFO:tasks.workunit.client.0.smithi152.stdout:0/364: dread d4/de/f30 [0,4194304] 0 2024-04-06T12:23:48.370 INFO:tasks.workunit.client.0.smithi152.stdout:0/365: mkdir d4/d36/d72 0 2024-04-06T12:23:48.371 INFO:tasks.workunit.client.0.smithi152.stdout:6/395: truncate d7/d9/f18 228308 0 2024-04-06T12:23:48.445 INFO:tasks.workunit.client.0.smithi152.stdout:6/396: mknod d7/d19/d1b/c89 0 2024-04-06T12:23:48.448 INFO:tasks.workunit.client.0.smithi152.stdout:0/366: link d4/de/d28/d18/d43/d62/l64 d4/d19/l73 0 2024-04-06T12:23:48.451 INFO:tasks.workunit.client.0.smithi152.stdout:6/397: link d7/d19/d3e/f72 d7/d19/d1b/f8a 0 2024-04-06T12:23:48.453 INFO:tasks.workunit.client.0.smithi152.stdout:0/367: dread d4/de/d4a/d33/f48 [0,4194304] 0 2024-04-06T12:23:48.454 INFO:tasks.workunit.client.0.smithi152.stdout:0/368: read d4/d31/f3d [550297,36983] 0 2024-04-06T12:23:48.454 INFO:tasks.workunit.client.0.smithi152.stdout:6/398: creat d7/d19/d3e/f8b x:0 0 0 2024-04-06T12:23:48.455 INFO:tasks.workunit.client.0.smithi152.stdout:6/399: chown d7/d19/c57 62716 1 2024-04-06T12:23:48.457 INFO:tasks.workunit.client.0.smithi152.stdout:6/400: mknod d7/d19/d3e/d70/c8c 0 2024-04-06T12:23:48.463 INFO:tasks.workunit.client.0.smithi152.stdout:6/401: write d7/d19/d3e/f72 [781740,97033] 0 2024-04-06T12:23:48.525 INFO:tasks.workunit.client.0.smithi152.stdout:0/369: dwrite d4/f32 [0,4194304] 0 2024-04-06T12:23:48.526 INFO:tasks.workunit.client.0.smithi152.stdout:5/310: sync 2024-04-06T12:23:48.526 INFO:tasks.workunit.client.0.smithi152.stdout:8/323: sync 2024-04-06T12:23:48.529 INFO:tasks.workunit.client.0.smithi152.stdout:5/311: write d3/de/f5b [712628,96180] 0 2024-04-06T12:23:48.532 INFO:tasks.workunit.client.0.smithi152.stdout:0/370: creat d4/d36/f74 x:0 0 0 2024-04-06T12:23:48.532 INFO:tasks.workunit.client.0.smithi152.stdout:6/402: write d7/d9/f2b [5470176,57102] 0 2024-04-06T12:23:48.535 INFO:tasks.workunit.client.0.smithi152.stdout:8/324: dwrite d4/f9 [4194304,4194304] 0 2024-04-06T12:23:48.538 INFO:tasks.workunit.client.0.smithi152.stdout:8/325: dread - d4/db/f58 zero size 2024-04-06T12:23:48.538 INFO:tasks.workunit.client.0.smithi152.stdout:5/312: write d3/f7 [5701775,75997] 0 2024-04-06T12:23:48.540 INFO:tasks.workunit.client.0.smithi152.stdout:0/371: read d4/de/d28/d18/d43/d62/f69 [127333,99727] 0 2024-04-06T12:23:48.541 INFO:tasks.workunit.client.0.smithi152.stdout:6/403: dwrite d7/d9/f56 [0,4194304] 0 2024-04-06T12:23:48.543 INFO:tasks.workunit.client.0.smithi152.stdout:6/404: truncate d7/d19/f5e 2498736 0 2024-04-06T12:23:48.547 INFO:tasks.workunit.client.0.smithi152.stdout:8/326: write d4/db/f27 [1865250,8211] 0 2024-04-06T12:23:48.548 INFO:tasks.workunit.client.0.smithi152.stdout:8/327: dread - d4/db/d39/f66 zero size 2024-04-06T12:23:48.549 INFO:tasks.workunit.client.0.smithi152.stdout:0/372: mknod d4/de/d28/d18/d43/c75 0 2024-04-06T12:23:48.555 INFO:tasks.workunit.client.0.smithi152.stdout:5/313: truncate d3/f16 1423372 0 2024-04-06T12:23:48.556 INFO:tasks.workunit.client.0.smithi152.stdout:0/373: dwrite d4/d36/f60 [0,4194304] 0 2024-04-06T12:23:48.557 INFO:tasks.workunit.client.0.smithi152.stdout:6/405: creat d7/d19/f8d x:0 0 0 2024-04-06T12:23:48.561 INFO:tasks.workunit.client.0.smithi152.stdout:8/328: symlink d4/db/d56/l71 0 2024-04-06T12:23:48.563 INFO:tasks.workunit.client.0.smithi152.stdout:8/329: write d4/dc/d10/d51/f61 [195849,112432] 0 2024-04-06T12:23:48.564 INFO:tasks.workunit.client.0.smithi152.stdout:8/330: write d4/db/d39/f4f [923284,56331] 0 2024-04-06T12:23:48.569 INFO:tasks.workunit.client.0.smithi152.stdout:0/374: dread d4/fa [0,4194304] 0 2024-04-06T12:23:48.571 INFO:tasks.workunit.client.0.smithi152.stdout:5/314: mknod d3/da/d15/d2b/d4d/c63 0 2024-04-06T12:23:48.572 INFO:tasks.workunit.client.0.smithi152.stdout:8/331: creat d4/dc/d10/d49/f72 x:0 0 0 2024-04-06T12:23:48.574 INFO:tasks.workunit.client.0.smithi152.stdout:8/332: write d4/db/d56/f69 [766741,123521] 0 2024-04-06T12:23:48.574 INFO:tasks.workunit.client.0.smithi152.stdout:8/333: chown d4/db/d32/c63 6450 1 2024-04-06T12:23:48.578 INFO:tasks.workunit.client.0.smithi152.stdout:5/315: write d3/da/f47 [892664,109621] 0 2024-04-06T12:23:48.578 INFO:tasks.workunit.client.0.smithi152.stdout:5/316: stat d3/f1f 0 2024-04-06T12:23:48.583 INFO:tasks.workunit.client.0.smithi152.stdout:0/375: unlink d4/f3a 0 2024-04-06T12:23:48.584 INFO:tasks.workunit.client.0.smithi152.stdout:0/376: write d4/de/d28/d18/d3b/f42 [35015,65496] 0 2024-04-06T12:23:48.588 INFO:tasks.workunit.client.0.smithi152.stdout:5/317: symlink d3/da/d15/d2b/d3f/l64 0 2024-04-06T12:23:48.591 INFO:tasks.workunit.client.0.smithi152.stdout:0/377: unlink d4/f39 0 2024-04-06T12:23:48.598 INFO:tasks.workunit.client.0.smithi152.stdout:0/378: readlink d4/de/d28/d18/d43/d62/l64 0 2024-04-06T12:23:48.599 INFO:tasks.workunit.client.0.smithi152.stdout:0/379: write d4/d19/f41 [368354,3503] 0 2024-04-06T12:23:48.599 INFO:tasks.workunit.client.0.smithi152.stdout:0/380: chown f1 103228 1 2024-04-06T12:23:48.606 INFO:tasks.workunit.client.0.smithi152.stdout:5/318: link d3/da/cd d3/da/d15/d40/c65 0 2024-04-06T12:23:48.607 INFO:tasks.workunit.client.0.smithi152.stdout:5/319: write d3/da/d15/d40/d4e/f5d [567453,68263] 0 2024-04-06T12:23:48.607 INFO:tasks.workunit.client.0.smithi152.stdout:0/381: creat d4/d6e/f76 x:0 0 0 2024-04-06T12:23:48.608 INFO:tasks.workunit.client.0.smithi152.stdout:0/382: dread - d4/de/f68 zero size 2024-04-06T12:23:48.614 INFO:tasks.workunit.client.0.smithi152.stdout:0/383: dwrite d4/d19/f4e [0,4194304] 0 2024-04-06T12:23:48.617 INFO:tasks.workunit.client.0.smithi152.stdout:5/320: link d3/da/d15/d2b/d3f/f43 d3/da/d15/d40/d4f/f66 0 2024-04-06T12:23:48.619 INFO:tasks.workunit.client.0.smithi152.stdout:5/321: fdatasync d3/d9/fb 0 2024-04-06T12:23:48.625 INFO:tasks.workunit.client.0.smithi152.stdout:0/384: rmdir d4/de/d67 39 2024-04-06T12:23:48.626 INFO:tasks.workunit.client.0.smithi152.stdout:5/322: rename d3/f31 to d3/da/d15/d2b/d3f/d4c/f67 0 2024-04-06T12:23:48.635 INFO:tasks.workunit.client.0.smithi152.stdout:8/334: truncate d4/db/d32/f4b 1243522 0 2024-04-06T12:23:48.637 INFO:tasks.workunit.client.0.smithi152.stdout:5/323: mkdir d3/da/d15/d2b/d3f/d68 0 2024-04-06T12:23:48.637 INFO:tasks.workunit.client.0.smithi152.stdout:5/324: chown d3/da/d15/l2c 3 1 2024-04-06T12:23:48.646 INFO:tasks.workunit.client.0.smithi152.stdout:0/385: creat d4/de/d67/f77 x:0 0 0 2024-04-06T12:23:48.648 INFO:tasks.workunit.client.0.smithi152.stdout:0/386: truncate d4/d31/f6b 904667 0 2024-04-06T12:23:48.654 INFO:tasks.workunit.client.0.smithi152.stdout:0/387: dwrite d4/d19/f41 [0,4194304] 0 2024-04-06T12:23:48.655 INFO:tasks.workunit.client.0.smithi152.stdout:8/335: mknod d4/db/d2a/d6e/c73 0 2024-04-06T12:23:48.656 INFO:tasks.workunit.client.0.smithi152.stdout:0/388: chown d4/de/d4a/d33/c44 2231189 1 2024-04-06T12:23:48.663 INFO:tasks.workunit.client.0.smithi152.stdout:0/389: dwrite f1 [0,4194304] 0 2024-04-06T12:23:48.664 INFO:tasks.workunit.client.0.smithi152.stdout:0/390: chown d4/de/d28/d18/d43 13515 1 2024-04-06T12:23:48.664 INFO:tasks.workunit.client.0.smithi152.stdout:8/336: fsync d4/dc/d10/d49/f70 0 2024-04-06T12:23:48.666 INFO:tasks.workunit.client.0.smithi152.stdout:8/337: write d4/dc/f19 [296272,19031] 0 2024-04-06T12:23:48.676 INFO:tasks.workunit.client.0.smithi152.stdout:8/338: unlink d4/db/d2a/l6d 0 2024-04-06T12:23:48.681 INFO:tasks.workunit.client.0.smithi152.stdout:8/339: mkdir d4/dc/d10/d74 0 2024-04-06T12:23:48.682 INFO:tasks.workunit.client.0.smithi152.stdout:8/340: dread - d4/db/f58 zero size 2024-04-06T12:23:48.683 INFO:tasks.workunit.client.0.smithi152.stdout:8/341: write d4/db/d39/f66 [83626,35412] 0 2024-04-06T12:23:48.688 INFO:tasks.workunit.client.0.smithi152.stdout:8/342: rename d4/db/f27 to d4/d2c/d54/f75 0 2024-04-06T12:23:48.694 INFO:tasks.workunit.client.0.smithi152.stdout:5/325: write d3/da/d15/f21 [293355,82189] 0 2024-04-06T12:23:48.695 INFO:tasks.workunit.client.0.smithi152.stdout:5/326: truncate d3/da/d53/f60 626426 0 2024-04-06T12:23:48.697 INFO:tasks.workunit.client.0.smithi152.stdout:5/327: stat d3/da/d15/c36 0 2024-04-06T12:23:48.698 INFO:tasks.workunit.client.0.smithi152.stdout:5/328: read d3/d37/f45 [3888441,90938] 0 2024-04-06T12:23:48.705 INFO:tasks.workunit.client.0.smithi152.stdout:5/329: dwrite d3/da/d53/f60 [0,4194304] 0 2024-04-06T12:23:48.706 INFO:tasks.workunit.client.0.smithi152.stdout:0/391: dwrite d4/de/d28/d18/d3b/f2f [0,4194304] 0 2024-04-06T12:23:48.709 INFO:tasks.workunit.client.0.smithi152.stdout:9/242: sync 2024-04-06T12:23:48.709 INFO:tasks.workunit.client.0.smithi152.stdout:7/265: sync 2024-04-06T12:23:48.709 INFO:tasks.workunit.client.0.smithi152.stdout:9/243: readlink d5/d6/la 0 2024-04-06T12:23:48.710 INFO:tasks.workunit.client.0.smithi152.stdout:7/266: write d8/dc/d17/d2c/f36 [1599155,34921] 0 2024-04-06T12:23:48.712 INFO:tasks.workunit.client.0.smithi152.stdout:7/267: write d8/dc/d17/f54 [250006,18630] 0 2024-04-06T12:23:48.713 INFO:tasks.workunit.client.0.smithi152.stdout:7/268: chown d8/df/d34 0 1 2024-04-06T12:23:48.717 INFO:tasks.workunit.client.0.smithi152.stdout:5/330: mknod d3/d37/c69 0 2024-04-06T12:23:48.717 INFO:tasks.workunit.client.0.smithi152.stdout:9/244: dwrite d5/d39/f3d [0,4194304] 0 2024-04-06T12:23:48.719 INFO:tasks.workunit.client.0.smithi152.stdout:0/392: chown d4/cc 323 1 2024-04-06T12:23:48.720 INFO:tasks.workunit.client.0.smithi152.stdout:0/393: chown d4/de/d4a 77 1 2024-04-06T12:23:48.720 INFO:tasks.workunit.client.0.smithi152.stdout:8/343: rmdir d4/d2c/d54 39 2024-04-06T12:23:48.720 INFO:tasks.workunit.client.0.smithi152.stdout:0/394: chown d4/d6e 244 1 2024-04-06T12:23:48.725 INFO:tasks.workunit.client.0.smithi152.stdout:0/395: dread d4/d19/f41 [0,4194304] 0 2024-04-06T12:23:48.731 INFO:tasks.workunit.client.0.smithi152.stdout:5/331: symlink d3/da/d15/d2b/d4d/l6a 0 2024-04-06T12:23:48.733 INFO:tasks.workunit.client.0.smithi152.stdout:5/332: chown d3/d9/f4b 997858 1 2024-04-06T12:23:48.733 INFO:tasks.workunit.client.0.smithi152.stdout:9/245: symlink d5/d6/d15/d17/d23/d2d/d4b/l52 0 2024-04-06T12:23:48.733 INFO:tasks.workunit.client.0.smithi152.stdout:0/396: dwrite d4/d31/f34 [4194304,4194304] 0 2024-04-06T12:23:48.735 INFO:tasks.workunit.client.0.smithi152.stdout:5/333: fsync d3/d9/f2a 0 2024-04-06T12:23:48.736 INFO:tasks.workunit.client.0.smithi152.stdout:8/344: fsync f0 0 2024-04-06T12:23:48.738 INFO:tasks.workunit.client.0.smithi152.stdout:5/334: fsync d3/da/d53/f60 0 2024-04-06T12:23:48.740 INFO:tasks.workunit.client.0.smithi152.stdout:9/246: read d5/f10 [2133739,74466] 0 2024-04-06T12:23:48.740 INFO:tasks.workunit.client.0.smithi152.stdout:8/345: write d4/dc/d10/d49/f72 [183167,86042] 0 2024-04-06T12:23:48.746 INFO:tasks.workunit.client.0.smithi152.stdout:5/335: creat d3/da/d15/d40/d46/f6b x:0 0 0 2024-04-06T12:23:48.749 INFO:tasks.workunit.client.0.smithi152.stdout:5/336: chown d3/d9/f2a 28998715 1 2024-04-06T12:23:48.750 INFO:tasks.workunit.client.0.smithi152.stdout:8/346: rename d4/f35 to d4/db/d39/f76 0 2024-04-06T12:23:48.751 INFO:tasks.workunit.client.0.smithi152.stdout:0/397: dwrite d4/de/d28/f40 [0,4194304] 0 2024-04-06T12:23:48.758 INFO:tasks.workunit.client.0.smithi152.stdout:7/269: dwrite d8/f1b [0,4194304] 0 2024-04-06T12:23:48.758 INFO:tasks.workunit.client.0.smithi152.stdout:5/337: creat d3/da/d15/d2b/d3f/f6c x:0 0 0 2024-04-06T12:23:48.765 INFO:tasks.workunit.client.0.smithi152.stdout:5/338: mkdir d3/da/d15/d2b/d3f/d6d 0 2024-04-06T12:23:48.767 INFO:tasks.workunit.client.0.smithi152.stdout:7/270: dread d8/dc/f13 [0,4194304] 0 2024-04-06T12:23:48.767 INFO:tasks.workunit.client.0.smithi152.stdout:0/398: mkdir d4/de/d28/d18/d3b/d2e/d78 0 2024-04-06T12:23:48.772 INFO:tasks.workunit.client.0.smithi152.stdout:8/347: rename d4/db/d39/f4f to d4/f77 0 2024-04-06T12:23:48.775 INFO:tasks.workunit.client.0.smithi152.stdout:9/247: dwrite d5/d6/f16 [4194304,4194304] 0 2024-04-06T12:23:48.780 INFO:tasks.workunit.client.0.smithi152.stdout:5/339: dwrite d3/f1f [0,4194304] 0 2024-04-06T12:23:48.785 INFO:tasks.workunit.client.0.smithi152.stdout:7/271: write f3 [1719520,64609] 0 2024-04-06T12:23:48.792 INFO:tasks.workunit.client.0.smithi152.stdout:9/248: mknod d5/d6/d15/d17/d23/d2d/d4b/c53 0 2024-04-06T12:23:48.797 INFO:tasks.workunit.client.0.smithi152.stdout:5/340: dwrite d3/da/d15/d40/d46/f6b [0,4194304] 0 2024-04-06T12:23:48.797 INFO:tasks.workunit.client.0.smithi152.stdout:5/341: readlink d3/l4 0 2024-04-06T12:23:48.797 INFO:tasks.workunit.client.0.smithi152.stdout:8/348: dread f0 [0,4194304] 0 2024-04-06T12:23:48.797 INFO:tasks.workunit.client.0.smithi152.stdout:7/272: fdatasync d8/dc/d17/d2c/d2d/f58 0 2024-04-06T12:23:48.798 INFO:tasks.workunit.client.0.smithi152.stdout:0/399: truncate d4/de/f30 2448493 0 2024-04-06T12:23:48.802 INFO:tasks.workunit.client.0.smithi152.stdout:8/349: mknod d4/d5f/c78 0 2024-04-06T12:23:48.803 INFO:tasks.workunit.client.0.smithi152.stdout:9/249: dwrite d5/d6/d15/d17/f22 [0,4194304] 0 2024-04-06T12:23:48.808 INFO:tasks.workunit.client.0.smithi152.stdout:8/350: dread d4/db/d39/f76 [0,4194304] 0 2024-04-06T12:23:48.809 INFO:tasks.workunit.client.0.smithi152.stdout:8/351: write d4/f9 [10115526,46451] 0 2024-04-06T12:23:48.809 INFO:tasks.workunit.client.0.smithi152.stdout:9/250: mknod d5/d39/d3f/c54 0 2024-04-06T12:23:48.811 INFO:tasks.workunit.client.0.smithi152.stdout:9/251: fsync d5/d6/d15/d17/d23/d2d/f51 0 2024-04-06T12:23:48.814 INFO:tasks.workunit.client.0.smithi152.stdout:0/400: creat d4/de/d28/d18/d3b/d2e/d78/f79 x:0 0 0 2024-04-06T12:23:48.820 INFO:tasks.workunit.client.0.smithi152.stdout:8/352: dwrite d4/f77 [0,4194304] 0 2024-04-06T12:23:48.827 INFO:tasks.workunit.client.0.smithi152.stdout:7/273: truncate d8/dc/d17/f54 116300 0 2024-04-06T12:23:48.839 INFO:tasks.workunit.client.0.smithi152.stdout:9/252: dwrite d5/d6/d15/d17/d37/f41 [0,4194304] 0 2024-04-06T12:23:48.847 INFO:tasks.workunit.client.0.smithi152.stdout:8/353: dread d4/dc/fd [0,4194304] 0 2024-04-06T12:23:48.849 INFO:tasks.workunit.client.0.smithi152.stdout:7/274: dread d8/dc/d17/d2c/f36 [0,4194304] 0 2024-04-06T12:23:48.861 INFO:tasks.workunit.client.0.smithi152.stdout:7/275: mkdir d8/df/d34/d5c 0 2024-04-06T12:23:48.863 INFO:tasks.workunit.client.0.smithi152.stdout:9/253: write d5/fb [638181,40884] 0 2024-04-06T12:23:48.865 INFO:tasks.workunit.client.0.smithi152.stdout:9/254: readlink d5/l40 0 2024-04-06T12:23:48.868 INFO:tasks.workunit.client.0.smithi152.stdout:7/276: dread d8/dc/fe [0,4194304] 0 2024-04-06T12:23:48.874 INFO:tasks.workunit.client.0.smithi152.stdout:9/255: truncate d5/f10 2245696 0 2024-04-06T12:23:48.876 INFO:tasks.workunit.client.0.smithi152.stdout:9/256: write d5/d6/f16 [6897913,115045] 0 2024-04-06T12:23:48.883 INFO:tasks.workunit.client.0.smithi152.stdout:7/277: write d8/dc/d17/f54 [787883,68299] 0 2024-04-06T12:23:48.883 INFO:tasks.workunit.client.0.smithi152.stdout:7/278: readlink d8/l45 0 2024-04-06T12:23:48.885 INFO:tasks.workunit.client.0.smithi152.stdout:9/257: rmdir d5 39 2024-04-06T12:23:48.888 INFO:tasks.workunit.client.0.smithi152.stdout:7/279: symlink d8/l5d 0 2024-04-06T12:23:48.896 INFO:tasks.workunit.client.0.smithi152.stdout:9/258: symlink d5/d6/d15/d17/d23/d2d/d32/d36/l55 0 2024-04-06T12:23:48.899 INFO:tasks.workunit.client.0.smithi152.stdout:9/259: fdatasync d5/d6/f7 0 2024-04-06T12:23:48.901 INFO:tasks.workunit.client.0.smithi152.stdout:7/280: dwrite d8/df/f25 [0,4194304] 0 2024-04-06T12:23:48.906 INFO:tasks.workunit.client.0.smithi152.stdout:9/260: creat d5/d6/d15/d17/d23/d2d/f56 x:0 0 0 2024-04-06T12:23:48.910 INFO:tasks.workunit.client.0.smithi152.stdout:7/281: dread d8/dc/d3d/f39 [0,4194304] 0 2024-04-06T12:23:48.915 INFO:tasks.workunit.client.0.smithi152.stdout:7/282: creat d8/df/f5e x:0 0 0 2024-04-06T12:23:48.915 INFO:tasks.workunit.client.0.smithi152.stdout:7/283: write d8/df/d28/f5a [963613,75196] 0 2024-04-06T12:23:48.917 INFO:tasks.workunit.client.0.smithi152.stdout:7/284: chown d8/dc/d3d/l35 114648270 1 2024-04-06T12:23:48.921 INFO:tasks.workunit.client.0.smithi152.stdout:7/285: mknod d8/dc/d4b/d56/c5f 0 2024-04-06T12:23:48.922 INFO:tasks.workunit.client.0.smithi152.stdout:7/286: truncate d8/f1b 4949980 0 2024-04-06T12:23:48.923 INFO:tasks.workunit.client.0.smithi152.stdout:7/287: truncate d8/dc/d4b/f4e 278087 0 2024-04-06T12:23:48.924 INFO:tasks.workunit.client.0.smithi152.stdout:9/261: write d5/d6/f14 [3617198,2219] 0 2024-04-06T12:23:48.927 INFO:tasks.workunit.client.0.smithi152.stdout:7/288: unlink d8/df/d28/c51 0 2024-04-06T12:23:48.927 INFO:tasks.workunit.client.0.smithi152.stdout:7/289: chown d8/d2a/d42 264396743 1 2024-04-06T12:23:48.928 INFO:tasks.workunit.client.0.smithi152.stdout:7/290: write d8/df/d28/f4d [1142413,12645] 0 2024-04-06T12:23:48.933 INFO:tasks.workunit.client.0.smithi152.stdout:7/291: mknod d8/df/d28/d41/d48/c60 0 2024-04-06T12:23:48.940 INFO:tasks.workunit.client.0.smithi152.stdout:9/262: dread d5/d6/fd [0,4194304] 0 2024-04-06T12:23:48.941 INFO:tasks.workunit.client.0.smithi152.stdout:9/263: write d5/d6/f49 [3995834,117364] 0 2024-04-06T12:23:48.946 INFO:tasks.workunit.client.0.smithi152.stdout:7/292: rename d8/dc to d8/df/d61 0 2024-04-06T12:23:48.948 INFO:tasks.workunit.client.0.smithi152.stdout:9/264: dwrite d5/d6/f49 [0,4194304] 0 2024-04-06T12:23:48.953 INFO:tasks.workunit.client.0.smithi152.stdout:7/293: dwrite d8/df/d61/d17/d2c/f38 [0,4194304] 0 2024-04-06T12:23:48.955 INFO:tasks.workunit.client.0.smithi152.stdout:9/265: creat d5/d6/d15/d17/d23/d2d/d32/f57 x:0 0 0 2024-04-06T12:23:48.956 INFO:tasks.workunit.client.0.smithi152.stdout:9/266: fsync d5/d6/f50 0 2024-04-06T12:23:48.957 INFO:tasks.workunit.client.0.smithi152.stdout:9/267: chown d5/d6/d15/d17/d23/d2d/d32/d36/l55 1978 1 2024-04-06T12:23:48.958 INFO:tasks.workunit.client.0.smithi152.stdout:7/294: mknod d8/df/d28/c62 0 2024-04-06T12:23:48.964 INFO:tasks.workunit.client.0.smithi152.stdout:7/295: mkdir d8/df/d34/d63 0 2024-04-06T12:23:48.965 INFO:tasks.workunit.client.0.smithi152.stdout:7/296: chown d8/df/d28/d41/d48 43 1 2024-04-06T12:23:48.970 INFO:tasks.workunit.client.0.smithi152.stdout:7/297: creat d8/df/d4a/f64 x:0 0 0 2024-04-06T12:23:48.971 INFO:tasks.workunit.client.0.smithi152.stdout:9/268: getdents d5/d6/d15/d17/d37 0 2024-04-06T12:23:48.972 INFO:tasks.workunit.client.0.smithi152.stdout:7/298: truncate d8/df/d4a/f64 673255 0 2024-04-06T12:23:48.973 INFO:tasks.workunit.client.0.smithi152.stdout:9/269: dread d5/d6/d15/d17/f46 [0,4194304] 0 2024-04-06T12:23:48.975 INFO:tasks.workunit.client.0.smithi152.stdout:3/252: sync 2024-04-06T12:23:48.975 INFO:tasks.workunit.client.0.smithi152.stdout:4/318: sync 2024-04-06T12:23:48.975 INFO:tasks.workunit.client.0.smithi152.stdout:7/299: rmdir d8/df/d61/d3d 39 2024-04-06T12:23:48.977 INFO:tasks.workunit.client.0.smithi152.stdout:7/300: truncate d8/df/d61/d4b/f4e 742446 0 2024-04-06T12:23:48.979 INFO:tasks.workunit.client.0.smithi152.stdout:9/270: truncate d5/d6/f24 687365 0 2024-04-06T12:23:48.983 INFO:tasks.workunit.client.0.smithi152.stdout:4/319: mkdir d7/d16/d22/d30/d60 0 2024-04-06T12:23:48.984 INFO:tasks.workunit.client.0.smithi152.stdout:4/320: write d7/f2c [1705685,17512] 0 2024-04-06T12:23:48.986 INFO:tasks.workunit.client.0.smithi152.stdout:7/301: mkdir d8/df/d4a/d65 0 2024-04-06T12:23:48.988 INFO:tasks.workunit.client.0.smithi152.stdout:3/253: dread d0/d10/d13/f17 [0,4194304] 0 2024-04-06T12:23:48.993 INFO:tasks.workunit.client.0.smithi152.stdout:9/271: dread d5/d39/d3f/d42/f48 [0,4194304] 0 2024-04-06T12:23:48.995 INFO:tasks.workunit.client.0.smithi152.stdout:9/272: fdatasync d5/d6/f28 0 2024-04-06T12:23:48.996 INFO:tasks.workunit.client.0.smithi152.stdout:7/302: dwrite d8/df/d28/f5a [0,4194304] 0 2024-04-06T12:23:48.997 INFO:tasks.workunit.client.0.smithi152.stdout:3/254: getdents d0/d1f/d44 0 2024-04-06T12:23:49.002 INFO:tasks.workunit.client.0.smithi152.stdout:4/321: dread d7/f4a [0,4194304] 0 2024-04-06T12:23:49.005 INFO:tasks.workunit.client.0.smithi152.stdout:9/273: symlink d5/d6/d15/d17/l58 0 2024-04-06T12:23:49.007 INFO:tasks.workunit.client.0.smithi152.stdout:7/303: mkdir d8/df/d61/d17/d2c/d66 0 2024-04-06T12:23:49.007 INFO:tasks.workunit.client.0.smithi152.stdout:9/274: readlink d5/d39/d3f/d42/l4e 0 2024-04-06T12:23:49.007 INFO:tasks.workunit.client.0.smithi152.stdout:3/255: dwrite d0/ff [0,4194304] 0 2024-04-06T12:23:49.009 INFO:tasks.workunit.client.0.smithi152.stdout:7/304: write d8/df/d61/d17/f1a [4773259,90812] 0 2024-04-06T12:23:49.016 INFO:tasks.workunit.client.0.smithi152.stdout:4/322: rename d7/l8 to d7/d16/d22/d30/l61 0 2024-04-06T12:23:49.020 INFO:tasks.workunit.client.0.smithi152.stdout:7/305: creat d8/df/d34/f67 x:0 0 0 2024-04-06T12:23:49.022 INFO:tasks.workunit.client.0.smithi152.stdout:3/256: symlink d0/d1f/d4a/l4d 0 2024-04-06T12:23:49.023 INFO:tasks.workunit.client.0.smithi152.stdout:3/257: chown d0/d10/d1e/d39/d3d 230 1 2024-04-06T12:23:49.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:47.582585+0000 mgr.smithi195.ausetj (mgr.24375) 78 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 587 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 3.4 MiB/s rd, 38 MiB/s wr, 116 op/s 2024-04-06T12:23:49.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:23:47.788302+0000 mon.smithi195 (mon.1) 63 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:23:49.030 INFO:tasks.workunit.client.0.smithi152.stdout:9/275: creat d5/d6/d15/d17/d23/f59 x:0 0 0 2024-04-06T12:23:49.031 INFO:tasks.workunit.client.0.smithi152.stdout:7/306: creat d8/df/d34/d5c/f68 x:0 0 0 2024-04-06T12:23:49.036 INFO:tasks.workunit.client.0.smithi152.stdout:3/258: dread d0/d10/d13/f1a [0,4194304] 0 2024-04-06T12:23:49.037 INFO:tasks.workunit.client.0.smithi152.stdout:7/307: creat d8/df/d61/d4b/f69 x:0 0 0 2024-04-06T12:23:49.042 INFO:tasks.workunit.client.0.smithi152.stdout:7/308: dwrite d8/fb [0,4194304] 0 2024-04-06T12:23:49.042 INFO:tasks.workunit.client.0.smithi152.stdout:7/309: chown d8/d44 11069 1 2024-04-06T12:23:49.046 INFO:tasks.workunit.client.0.smithi152.stdout:3/259: mknod d0/d10/d1e/d39/d49/c4e 0 2024-04-06T12:23:49.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:47.582585+0000 mgr.smithi195.ausetj (mgr.24375) 78 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 587 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 3.4 MiB/s rd, 38 MiB/s wr, 116 op/s 2024-04-06T12:23:49.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:23:47.788302+0000 mon.smithi195 (mon.1) 63 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:23:49.053 INFO:tasks.workunit.client.0.smithi152.stdout:7/310: mknod d8/d44/c6a 0 2024-04-06T12:23:49.055 INFO:tasks.workunit.client.0.smithi152.stdout:3/260: rename d0/d1f/l40 to d0/d10/d1e/d39/d49/l4f 0 2024-04-06T12:23:49.056 INFO:tasks.workunit.client.0.smithi152.stdout:7/311: creat d8/d2a/d42/f6b x:0 0 0 2024-04-06T12:23:49.059 INFO:tasks.workunit.client.0.smithi152.stdout:4/323: truncate d7/f17 1331826 0 2024-04-06T12:23:49.062 INFO:tasks.workunit.client.0.smithi152.stdout:7/312: symlink d8/d2a/d37/d43/l6c 0 2024-04-06T12:23:49.066 INFO:tasks.workunit.client.0.smithi152.stdout:4/324: creat d7/d16/d22/d3f/d5a/d33/d53/d59/f62 x:0 0 0 2024-04-06T12:23:49.069 INFO:tasks.workunit.client.0.smithi152.stdout:7/313: dwrite d8/df/d61/d17/f1a [4194304,4194304] 0 2024-04-06T12:23:49.071 INFO:tasks.workunit.client.0.smithi152.stdout:3/261: getdents d0/d35/d43 0 2024-04-06T12:23:49.071 INFO:tasks.workunit.client.0.smithi152.stdout:7/314: write d8/f16 [606491,69134] 0 2024-04-06T12:23:49.073 INFO:tasks.workunit.client.0.smithi152.stdout:4/325: symlink d7/d29/d2e/l63 0 2024-04-06T12:23:49.074 INFO:tasks.workunit.client.0.smithi152.stdout:9/276: dwrite d5/f35 [0,4194304] 0 2024-04-06T12:23:49.076 INFO:tasks.workunit.client.0.smithi152.stdout:7/315: fsync d8/df/d61/d17/d2c/d2d/f32 0 2024-04-06T12:23:49.084 INFO:tasks.workunit.client.0.smithi152.stdout:9/277: dread d5/d39/f3d [0,4194304] 0 2024-04-06T12:23:49.085 INFO:tasks.workunit.client.0.smithi152.stdout:9/278: read d5/d6/f7 [2493363,76485] 0 2024-04-06T12:23:49.094 INFO:tasks.workunit.client.0.smithi152.stdout:3/262: mknod d0/c50 0 2024-04-06T12:23:49.094 INFO:tasks.workunit.client.0.smithi152.stdout:3/263: fdatasync d0/f3c 0 2024-04-06T12:23:49.095 INFO:tasks.workunit.client.0.smithi152.stdout:3/264: fsync d0/ff 0 2024-04-06T12:23:49.098 INFO:tasks.workunit.client.0.smithi152.stdout:4/326: rmdir d7/d16/d22/d3f/d5a/d33/d53/d59 39 2024-04-06T12:23:49.101 INFO:tasks.workunit.client.0.smithi152.stdout:7/316: mkdir d8/df/d61/d6d 0 2024-04-06T12:23:49.106 INFO:tasks.workunit.client.0.smithi152.stdout:3/265: creat d0/d10/d13/d2a/f51 x:0 0 0 2024-04-06T12:23:49.106 INFO:tasks.workunit.client.0.smithi152.stdout:3/266: chown d0/d10/d13 4183620 1 2024-04-06T12:23:49.107 INFO:tasks.workunit.client.0.smithi152.stdout:3/267: write d0/d10/d13/d2a/f51 [769270,56599] 0 2024-04-06T12:23:49.110 INFO:tasks.workunit.client.0.smithi152.stdout:4/327: mknod d7/d16/d55/c64 0 2024-04-06T12:23:49.115 INFO:tasks.workunit.client.0.smithi152.stdout:4/328: chown d7/d16/d22/d3f/d5a/d33/l48 658420 1 2024-04-06T12:23:49.118 INFO:tasks.workunit.client.0.smithi152.stdout:7/317: mkdir d8/df/d61/d3d/d6e 0 2024-04-06T12:23:49.119 INFO:tasks.workunit.client.0.smithi152.stdout:3/268: mknod d0/d10/d13/d2a/d4b/c52 0 2024-04-06T12:23:49.119 INFO:tasks.workunit.client.0.smithi152.stdout:7/318: read d8/df/d61/d3d/f39 [34072,71851] 0 2024-04-06T12:23:49.120 INFO:tasks.workunit.client.0.smithi152.stdout:7/319: truncate d8/df/d4a/f64 1426150 0 2024-04-06T12:23:49.123 INFO:tasks.workunit.client.0.smithi152.stdout:3/269: symlink d0/d35/l53 0 2024-04-06T12:23:49.127 INFO:tasks.workunit.client.0.smithi152.stdout:3/270: creat d0/d1f/d4a/f54 x:0 0 0 2024-04-06T12:23:49.131 INFO:tasks.workunit.client.0.smithi152.stdout:7/320: link d8/df/d61/f24 d8/f6f 0 2024-04-06T12:23:49.132 INFO:tasks.workunit.client.0.smithi152.stdout:3/271: mknod d0/d1f/c55 0 2024-04-06T12:23:49.132 INFO:tasks.workunit.client.0.smithi152.stdout:7/321: write d8/f3a [1127260,37819] 0 2024-04-06T12:23:49.135 INFO:tasks.workunit.client.0.smithi152.stdout:4/329: dread d7/f4f [0,4194304] 0 2024-04-06T12:23:49.137 INFO:tasks.workunit.client.0.smithi152.stdout:7/322: unlink d8/df/l31 0 2024-04-06T12:23:49.141 INFO:tasks.workunit.client.0.smithi152.stdout:3/272: dwrite d0/d10/d13/d2a/f51 [0,4194304] 0 2024-04-06T12:23:49.141 INFO:tasks.workunit.client.0.smithi152.stdout:9/279: truncate d5/d6/d15/d17/f22 916013 0 2024-04-06T12:23:49.145 INFO:tasks.workunit.client.0.smithi152.stdout:7/323: truncate d8/df/d61/f23 41264 0 2024-04-06T12:23:49.146 INFO:tasks.workunit.client.0.smithi152.stdout:9/280: mkdir d5/d6/d15/d17/d23/d2d/d4b/d5a 0 2024-04-06T12:23:49.150 INFO:tasks.workunit.client.0.smithi152.stdout:7/324: rename d8/d2a/d37/d43/l6c to d8/df/d61/d17/d2c/d2d/l70 0 2024-04-06T12:23:49.151 INFO:tasks.workunit.client.0.smithi152.stdout:9/281: rmdir d5/d39/d3f/d42 39 2024-04-06T12:23:49.154 INFO:tasks.workunit.client.0.smithi152.stdout:3/273: creat d0/d35/d43/d48/f56 x:0 0 0 2024-04-06T12:23:49.158 INFO:tasks.workunit.client.0.smithi152.stdout:3/274: dread d0/d10/d45/f47 [0,4194304] 0 2024-04-06T12:23:49.159 INFO:tasks.workunit.client.0.smithi152.stdout:9/282: dwrite d5/d6/d15/d17/d23/f59 [0,4194304] 0 2024-04-06T12:23:49.165 INFO:tasks.workunit.client.0.smithi152.stdout:3/275: mknod d0/d2d/c57 0 2024-04-06T12:23:49.172 INFO:tasks.workunit.client.0.smithi152.stdout:3/276: mknod d0/c58 0 2024-04-06T12:23:49.172 INFO:tasks.workunit.client.0.smithi152.stdout:3/277: dread - d0/d10/d1e/f46 zero size 2024-04-06T12:23:49.173 INFO:tasks.workunit.client.0.smithi152.stdout:3/278: readlink d0/d10/l24 0 2024-04-06T12:23:49.174 INFO:tasks.workunit.client.0.smithi152.stdout:3/279: write d0/d10/d1e/f46 [293568,68199] 0 2024-04-06T12:23:49.175 INFO:tasks.workunit.client.0.smithi152.stdout:9/283: dread d5/f1d [4194304,4194304] 0 2024-04-06T12:23:49.176 INFO:tasks.workunit.client.0.smithi152.stdout:3/280: truncate d0/d10/d1e/f46 572601 0 2024-04-06T12:23:49.179 INFO:tasks.workunit.client.0.smithi152.stdout:3/281: creat d0/d10/d13/d2a/f59 x:0 0 0 2024-04-06T12:23:49.182 INFO:tasks.workunit.client.0.smithi152.stdout:3/282: mkdir d0/d35/d43/d48/d5a 0 2024-04-06T12:23:49.182 INFO:tasks.workunit.client.0.smithi152.stdout:3/283: readlink d0/d10/l3b 0 2024-04-06T12:23:49.185 INFO:tasks.workunit.client.0.smithi152.stdout:9/284: getdents d5/d39 0 2024-04-06T12:23:49.193 INFO:tasks.workunit.client.0.smithi152.stdout:9/285: creat d5/d39/d3f/d42/f5b x:0 0 0 2024-04-06T12:23:49.195 INFO:tasks.workunit.client.0.smithi152.stdout:3/284: dread d0/d10/d1e/f1d [0,4194304] 0 2024-04-06T12:23:49.210 INFO:tasks.workunit.client.0.smithi152.stdout:7/325: unlink d8/df/d61/f23 0 2024-04-06T12:23:49.215 INFO:tasks.workunit.client.0.smithi152.stdout:4/330: truncate d7/d16/f1a 2052792 0 2024-04-06T12:23:49.220 INFO:tasks.workunit.client.0.smithi152.stdout:4/331: dwrite d7/d16/f20 [0,4194304] 0 2024-04-06T12:23:49.229 INFO:tasks.workunit.client.0.smithi152.stdout:4/332: dwrite d7/d16/d22/d30/f50 [0,4194304] 0 2024-04-06T12:23:49.233 INFO:tasks.workunit.client.0.smithi152.stdout:4/333: creat d7/d29/f65 x:0 0 0 2024-04-06T12:23:49.234 INFO:tasks.workunit.client.0.smithi152.stdout:4/334: write d7/f2c [96277,6861] 0 2024-04-06T12:23:49.242 INFO:tasks.workunit.client.0.smithi152.stdout:4/335: dwrite d7/d16/d22/d30/f50 [0,4194304] 0 2024-04-06T12:23:49.244 INFO:tasks.workunit.client.0.smithi152.stdout:4/336: write d7/d16/d22/d30/f43 [1173454,71971] 0 2024-04-06T12:23:49.245 INFO:tasks.workunit.client.0.smithi152.stdout:4/337: write d7/f2c [237855,45870] 0 2024-04-06T12:23:49.251 INFO:tasks.workunit.client.0.smithi152.stdout:4/338: mknod d7/d16/d22/d3f/d5a/d33/c66 0 2024-04-06T12:23:49.256 INFO:tasks.workunit.client.0.smithi152.stdout:4/339: truncate d7/f17 101401 0 2024-04-06T12:23:49.263 INFO:tasks.workunit.client.0.smithi152.stdout:4/340: creat d7/d16/d22/d3f/d5a/d33/d53/f67 x:0 0 0 2024-04-06T12:23:49.272 INFO:tasks.workunit.client.0.smithi152.stdout:4/341: unlink d7/d16/d22/d3f/d5a/d33/c66 0 2024-04-06T12:23:49.285 INFO:tasks.workunit.client.0.smithi152.stdout:4/342: creat d7/d16/f68 x:0 0 0 2024-04-06T12:23:49.294 INFO:tasks.workunit.client.0.smithi152.stdout:4/343: dwrite d7/d16/d22/d3f/d5a/d33/d53/d59/f62 [0,4194304] 0 2024-04-06T12:23:49.346 INFO:tasks.workunit.client.0.smithi152.stdout:1/284: sync 2024-04-06T12:23:49.346 INFO:tasks.workunit.client.0.smithi152.stdout:2/381: sync 2024-04-06T12:23:49.348 INFO:tasks.workunit.client.0.smithi152.stdout:1/285: read - d2/d2f/d37/f4f zero size 2024-04-06T12:23:49.387 INFO:tasks.workunit.client.0.smithi152.stdout:4/344: creat d7/d16/d22/f69 x:0 0 0 2024-04-06T12:23:49.391 INFO:tasks.workunit.client.0.smithi152.stdout:4/345: mkdir d7/d16/d6a 0 2024-04-06T12:23:49.393 INFO:tasks.workunit.client.0.smithi152.stdout:4/346: stat d7/d16/d22/d30/f50 0 2024-04-06T12:23:49.394 INFO:tasks.workunit.client.0.smithi152.stdout:2/382: dread d0/d2/d5/f1f [0,4194304] 0 2024-04-06T12:23:49.394 INFO:tasks.workunit.client.0.smithi152.stdout:9/286: dwrite d5/d6/d15/d17/f46 [0,4194304] 0 2024-04-06T12:23:49.402 INFO:tasks.workunit.client.0.smithi152.stdout:3/285: dwrite d0/d10/d13/f17 [0,4194304] 0 2024-04-06T12:23:49.404 INFO:tasks.workunit.client.0.smithi152.stdout:4/347: dwrite d7/d16/d22/d3f/d5a/d33/f44 [0,4194304] 0 2024-04-06T12:23:49.405 INFO:tasks.workunit.client.0.smithi152.stdout:9/287: getdents d5/d6/d15/d17/d23/d2d/d4b/d5a 0 2024-04-06T12:23:49.406 INFO:tasks.workunit.client.0.smithi152.stdout:4/348: write d7/d16/d22/d30/f50 [1258075,127923] 0 2024-04-06T12:23:49.408 INFO:tasks.workunit.client.0.smithi152.stdout:3/286: symlink d0/d2d/l5b 0 2024-04-06T12:23:49.411 INFO:tasks.workunit.client.0.smithi152.stdout:9/288: mknod d5/d6/d15/d17/d23/d2d/c5c 0 2024-04-06T12:23:49.414 INFO:tasks.workunit.client.0.smithi152.stdout:4/349: creat d7/d16/d22/d3f/d5a/d33/f6b x:0 0 0 2024-04-06T12:23:49.419 INFO:tasks.workunit.client.0.smithi152.stdout:9/289: dwrite d5/d6/d15/d17/f46 [0,4194304] 0 2024-04-06T12:23:49.421 INFO:tasks.workunit.client.0.smithi152.stdout:9/290: readlink d5/l25 0 2024-04-06T12:23:49.430 INFO:tasks.workunit.client.0.smithi152.stdout:9/291: mkdir d5/d6/d15/d17/d37/d5d 0 2024-04-06T12:23:49.430 INFO:tasks.workunit.client.0.smithi152.stdout:4/350: symlink d7/d29/d2e/d5b/l6c 0 2024-04-06T12:23:49.432 INFO:tasks.workunit.client.0.smithi152.stdout:9/292: write d5/d6/d15/d17/d23/d2d/f56 [379152,96309] 0 2024-04-06T12:23:49.442 INFO:tasks.workunit.client.0.smithi152.stdout:9/293: link d5/d6/la d5/d6/d15/d17/d23/d2d/d4b/l5e 0 2024-04-06T12:23:49.442 INFO:tasks.workunit.client.0.smithi152.stdout:9/294: readlink d5/d6/d15/d17/d23/l43 0 2024-04-06T12:23:49.504 INFO:tasks.workunit.client.0.smithi152.stdout:4/351: write d7/f4f [5897172,115305] 0 2024-04-06T12:23:49.508 INFO:tasks.workunit.client.0.smithi152.stdout:4/352: creat d7/d29/f6d x:0 0 0 2024-04-06T12:23:49.521 INFO:tasks.workunit.client.0.smithi152.stdout:4/353: write d7/f17 [204923,47500] 0 2024-04-06T12:23:49.523 INFO:tasks.workunit.client.0.smithi152.stdout:4/354: chown d7/d29/d2e/l35 221 1 2024-04-06T12:23:49.526 INFO:tasks.workunit.client.0.smithi152.stdout:4/355: rmdir d7/d29/d2e 39 2024-04-06T12:23:49.526 INFO:tasks.workunit.client.0.smithi152.stdout:4/356: chown d7/le 133961684 1 2024-04-06T12:23:49.528 INFO:tasks.workunit.client.0.smithi152.stdout:4/357: creat d7/d16/f6e x:0 0 0 2024-04-06T12:23:49.531 INFO:tasks.workunit.client.0.smithi152.stdout:3/287: rename d0/c22 to d0/d1f/c5c 0 2024-04-06T12:23:49.532 INFO:tasks.workunit.client.0.smithi152.stdout:3/288: read d0/f3c [2366016,62995] 0 2024-04-06T12:23:49.534 INFO:tasks.workunit.client.0.smithi152.stdout:3/289: write d0/d1f/d4a/f54 [64974,92181] 0 2024-04-06T12:23:49.536 INFO:tasks.workunit.client.0.smithi152.stdout:9/295: rename d5/d6/d15 to d5/d39/d3f/d42/d5f 0 2024-04-06T12:23:49.537 INFO:tasks.workunit.client.0.smithi152.stdout:3/290: mknod d0/d35/d43/d48/c5d 0 2024-04-06T12:23:49.537 INFO:tasks.workunit.client.0.smithi152.stdout:9/296: stat d5/d39/d3f/d42/d5f/d17/d37/d5d 0 2024-04-06T12:23:49.538 INFO:tasks.workunit.client.0.smithi152.stdout:3/291: write d0/d1f/d4a/f54 [109430,13809] 0 2024-04-06T12:23:49.541 INFO:tasks.workunit.client.0.smithi152.stdout:1/286: link d2/d1d/d21/d28/f30 d2/f6b 0 2024-04-06T12:23:49.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/358: dread d7/fb [0,4194304] 0 2024-04-06T12:23:49.542 INFO:tasks.workunit.client.0.smithi152.stdout:3/292: dread d0/f3c [0,4194304] 0 2024-04-06T12:23:49.543 INFO:tasks.workunit.client.0.smithi152.stdout:3/293: readlink d0/d1f/l33 0 2024-04-06T12:23:49.544 INFO:tasks.workunit.client.0.smithi152.stdout:1/287: creat d2/d61/f6c x:0 0 0 2024-04-06T12:23:49.544 INFO:tasks.workunit.client.0.smithi152.stdout:3/294: chown d0/d1f/l33 497 1 2024-04-06T12:23:49.546 INFO:tasks.workunit.client.0.smithi152.stdout:4/359: symlink d7/d16/d22/d3f/d5a/d33/d53/l6f 0 2024-04-06T12:23:49.547 INFO:tasks.workunit.client.0.smithi152.stdout:3/295: symlink d0/d10/d1e/d39/l5e 0 2024-04-06T12:23:49.553 INFO:tasks.workunit.client.0.smithi152.stdout:1/288: getdents d2/d1d/d3b 0 2024-04-06T12:23:49.555 INFO:tasks.workunit.client.0.smithi152.stdout:1/289: chown d2/d1d/f2d 378 1 2024-04-06T12:23:49.556 INFO:tasks.workunit.client.0.smithi152.stdout:4/360: rename d7/d16/d55/c58 to d7/c70 0 2024-04-06T12:23:49.556 INFO:tasks.workunit.client.0.smithi152.stdout:3/296: dwrite d0/d10/d1e/f1d [0,4194304] 0 2024-04-06T12:23:49.558 INFO:tasks.workunit.client.0.smithi152.stdout:1/290: chown d2/f10 31 1 2024-04-06T12:23:49.563 INFO:tasks.workunit.client.0.smithi152.stdout:3/297: unlink d0/d1f/l27 0 2024-04-06T12:23:49.564 INFO:tasks.workunit.client.0.smithi152.stdout:4/361: dwrite d7/d16/d22/d30/f37 [0,4194304] 0 2024-04-06T12:23:49.568 INFO:tasks.workunit.client.0.smithi152.stdout:1/291: unlink d2/d1d/d21/d28/c51 0 2024-04-06T12:23:49.569 INFO:tasks.workunit.client.0.smithi152.stdout:3/298: rmdir d0/d10/d1e/d39 39 2024-04-06T12:23:49.572 INFO:tasks.workunit.client.0.smithi152.stdout:4/362: creat d7/d16/d22/d3f/d5a/d33/f71 x:0 0 0 2024-04-06T12:23:49.573 INFO:tasks.workunit.client.0.smithi152.stdout:1/292: mkdir d2/d5d/d6d 0 2024-04-06T12:23:49.574 INFO:tasks.workunit.client.0.smithi152.stdout:3/299: unlink d0/d35/d43/d48/f56 0 2024-04-06T12:23:49.579 INFO:tasks.workunit.client.0.smithi152.stdout:4/363: symlink d7/d29/d2e/d5b/l72 0 2024-04-06T12:23:49.580 INFO:tasks.workunit.client.0.smithi152.stdout:1/293: getdents d2/d1d/d3b 0 2024-04-06T12:23:49.581 INFO:tasks.workunit.client.0.smithi152.stdout:3/300: dwrite d0/d10/d13/f1a [0,4194304] 0 2024-04-06T12:23:49.584 INFO:tasks.workunit.client.0.smithi152.stdout:4/364: creat d7/d16/d22/d30/f73 x:0 0 0 2024-04-06T12:23:49.586 INFO:tasks.workunit.client.0.smithi152.stdout:1/294: mknod d2/d2f/d45/c6e 0 2024-04-06T12:23:49.587 INFO:tasks.workunit.client.0.smithi152.stdout:4/365: rmdir d7/d16/d22/d3f/d47 39 2024-04-06T12:23:49.589 INFO:tasks.workunit.client.0.smithi152.stdout:3/301: dwrite d0/f3c [0,4194304] 0 2024-04-06T12:23:49.591 INFO:tasks.workunit.client.0.smithi152.stdout:4/366: creat d7/d16/d22/d3f/d5a/d33/f74 x:0 0 0 2024-04-06T12:23:49.591 INFO:tasks.workunit.client.0.smithi152.stdout:1/295: chown d2/d1d/d21/d28/c60 44798 1 2024-04-06T12:23:49.604 INFO:tasks.workunit.client.0.smithi152.stdout:3/302: getdents d0/d10/d1e/d39/d3d 0 2024-04-06T12:23:49.606 INFO:tasks.workunit.client.0.smithi152.stdout:3/303: write d0/d10/d13/f1a [532743,62291] 0 2024-04-06T12:23:49.615 INFO:tasks.workunit.client.0.smithi152.stdout:3/304: write d0/d10/d13/f32 [1646332,11784] 0 2024-04-06T12:23:49.618 INFO:tasks.workunit.client.0.smithi152.stdout:4/367: dread d7/d29/f2b [0,4194304] 0 2024-04-06T12:23:49.620 INFO:tasks.workunit.client.0.smithi152.stdout:1/296: dwrite d2/f20 [0,4194304] 0 2024-04-06T12:23:49.625 INFO:tasks.workunit.client.0.smithi152.stdout:4/368: symlink d7/d16/d22/d3f/d5a/d33/d53/l75 0 2024-04-06T12:23:49.626 INFO:tasks.workunit.client.0.smithi152.stdout:3/305: dwrite d0/d10/d13/d2a/f59 [0,4194304] 0 2024-04-06T12:23:49.628 INFO:tasks.workunit.client.0.smithi152.stdout:1/297: unlink d2/c4 0 2024-04-06T12:23:49.635 INFO:tasks.workunit.client.0.smithi152.stdout:4/369: creat d7/d16/d22/d3f/d5a/d33/d53/d59/f76 x:0 0 0 2024-04-06T12:23:49.643 INFO:tasks.workunit.client.0.smithi152.stdout:1/298: dwrite d2/f10 [0,4194304] 0 2024-04-06T12:23:49.651 INFO:tasks.workunit.client.0.smithi152.stdout:4/370: creat d7/d29/d2e/d5b/f77 x:0 0 0 2024-04-06T12:23:49.652 INFO:tasks.workunit.client.0.smithi152.stdout:4/371: dread - d7/d16/d22/d3f/d5a/d33/f71 zero size 2024-04-06T12:23:49.658 INFO:tasks.workunit.client.0.smithi152.stdout:4/372: dwrite d7/d16/d22/d30/f50 [0,4194304] 0 2024-04-06T12:23:49.662 INFO:tasks.workunit.client.0.smithi152.stdout:4/373: dread d7/f4f [0,4194304] 0 2024-04-06T12:23:49.665 INFO:tasks.workunit.client.0.smithi152.stdout:3/306: truncate d0/d10/d13/d2a/f51 471972 0 2024-04-06T12:23:49.670 INFO:tasks.workunit.client.0.smithi152.stdout:4/374: dwrite d7/d16/d22/d3f/d5a/d33/f44 [0,4194304] 0 2024-04-06T12:23:49.670 INFO:tasks.workunit.client.0.smithi152.stdout:4/375: chown d7 0 1 2024-04-06T12:23:49.674 INFO:tasks.workunit.client.0.smithi152.stdout:4/376: fsync d7/f4a 0 2024-04-06T12:23:49.675 INFO:tasks.workunit.client.0.smithi152.stdout:4/377: read d7/d16/d22/d30/f50 [3496045,28114] 0 2024-04-06T12:23:49.677 INFO:tasks.workunit.client.0.smithi152.stdout:4/378: dread - d7/d16/d22/d30/f73 zero size 2024-04-06T12:23:49.681 INFO:tasks.workunit.client.0.smithi152.stdout:3/307: write d0/d10/d13/d2a/f51 [846571,122556] 0 2024-04-06T12:23:49.684 INFO:tasks.workunit.client.0.smithi152.stdout:4/379: dwrite d7/d16/d22/d30/f50 [4194304,4194304] 0 2024-04-06T12:23:49.685 INFO:tasks.workunit.client.0.smithi152.stdout:4/380: stat d7/d16/d22 0 2024-04-06T12:23:49.687 INFO:tasks.workunit.client.0.smithi152.stdout:4/381: readlink d7/d16/d22/d3f/d5a/d33/d53/d59/l3a 0 2024-04-06T12:23:49.687 INFO:tasks.workunit.client.0.smithi152.stdout:3/308: creat d0/d10/d1e/d39/f5f x:0 0 0 2024-04-06T12:23:49.688 INFO:tasks.workunit.client.0.smithi152.stdout:3/309: stat d0/c50 0 2024-04-06T12:23:49.691 INFO:tasks.workunit.client.0.smithi152.stdout:3/310: creat d0/d1f/f60 x:0 0 0 2024-04-06T12:23:49.693 INFO:tasks.workunit.client.0.smithi152.stdout:3/311: rmdir d0/d10/d1e/d39/d49 39 2024-04-06T12:23:49.696 INFO:tasks.workunit.client.0.smithi152.stdout:4/382: rename d7/d16/d22/d3f/d5a to d7/d29/d78 0 2024-04-06T12:23:49.698 INFO:tasks.workunit.client.0.smithi152.stdout:3/312: symlink d0/d1f/d4a/l61 0 2024-04-06T12:23:49.701 INFO:tasks.workunit.client.0.smithi152.stdout:3/313: dread d0/d10/d13/d2a/f51 [0,4194304] 0 2024-04-06T12:23:49.702 INFO:tasks.workunit.client.0.smithi152.stdout:4/383: symlink d7/l79 0 2024-04-06T12:23:49.708 INFO:tasks.workunit.client.0.smithi152.stdout:3/314: dwrite d0/d10/d13/f32 [0,4194304] 0 2024-04-06T12:23:49.712 INFO:tasks.workunit.client.0.smithi152.stdout:4/384: rename d7/l79 to d7/d16/d22/d3f/d47/l7a 0 2024-04-06T12:23:49.713 INFO:tasks.workunit.client.0.smithi152.stdout:3/315: dwrite d0/ff [0,4194304] 0 2024-04-06T12:23:49.714 INFO:tasks.workunit.client.0.smithi152.stdout:3/316: stat d0/d1f/l33 0 2024-04-06T12:23:49.715 INFO:tasks.workunit.client.0.smithi152.stdout:3/317: chown d0/d2d/c37 283133 1 2024-04-06T12:23:49.721 INFO:tasks.workunit.client.0.smithi152.stdout:4/385: rmdir d7/d16/d6a 0 2024-04-06T12:23:49.722 INFO:tasks.workunit.client.0.smithi152.stdout:5/342: sync 2024-04-06T12:23:49.722 INFO:tasks.workunit.client.0.smithi152.stdout:3/318: dread d0/d10/d13/f1a [0,4194304] 0 2024-04-06T12:23:49.724 INFO:tasks.workunit.client.0.smithi152.stdout:5/343: dread - d3/da/d15/d40/d4f/f66 zero size 2024-04-06T12:23:49.724 INFO:tasks.workunit.client.0.smithi152.stdout:4/386: mkdir d7/d29/d2e/d7b 0 2024-04-06T12:23:49.725 INFO:tasks.workunit.client.0.smithi152.stdout:6/406: sync 2024-04-06T12:23:49.725 INFO:tasks.workunit.client.0.smithi152.stdout:3/319: dread d0/d1f/d4a/f54 [0,4194304] 0 2024-04-06T12:23:49.732 INFO:tasks.workunit.client.0.smithi152.stdout:6/407: dwrite d7/d19/d3e/f53 [4194304,4194304] 0 2024-04-06T12:23:49.734 INFO:tasks.workunit.client.0.smithi152.stdout:4/387: creat d7/d29/d78/f7c x:0 0 0 2024-04-06T12:23:49.738 INFO:tasks.workunit.client.0.smithi152.stdout:3/320: symlink d0/d1f/d4a/l62 0 2024-04-06T12:23:49.755 INFO:tasks.workunit.client.0.smithi152.stdout:4/388: mknod d7/d16/d22/c7d 0 2024-04-06T12:23:49.759 INFO:tasks.workunit.client.0.smithi152.stdout:6/408: rmdir d7/d9/d26/d4a/d6e 0 2024-04-06T12:23:49.760 INFO:tasks.workunit.client.0.smithi152.stdout:3/321: dwrite d0/d1f/d4a/f54 [0,4194304] 0 2024-04-06T12:23:49.760 INFO:tasks.workunit.client.0.smithi152.stdout:6/409: chown d7/c13 1 1 2024-04-06T12:23:49.765 INFO:tasks.workunit.client.0.smithi152.stdout:5/344: getdents d3/da/d15 0 2024-04-06T12:23:49.765 INFO:tasks.workunit.client.0.smithi152.stdout:3/322: mknod d0/d35/c63 0 2024-04-06T12:23:49.769 INFO:tasks.workunit.client.0.smithi152.stdout:6/410: creat d7/d19/d1b/d1f/d3d/f8e x:0 0 0 2024-04-06T12:23:49.774 INFO:tasks.workunit.client.0.smithi152.stdout:3/323: symlink d0/d1f/d28/l64 0 2024-04-06T12:23:49.775 INFO:tasks.workunit.client.0.smithi152.stdout:6/411: dwrite d7/d19/d3e/f40 [0,4194304] 0 2024-04-06T12:23:49.776 INFO:tasks.workunit.client.0.smithi152.stdout:3/324: truncate d0/d10/d13/f32 4249562 0 2024-04-06T12:23:49.778 INFO:tasks.workunit.client.0.smithi152.stdout:4/389: rename d7/d29/d78/d33/d53 to d7/d29/d7e 0 2024-04-06T12:23:49.781 INFO:tasks.workunit.client.0.smithi152.stdout:5/345: link d3/da/fc d3/d37/f6e 0 2024-04-06T12:23:49.783 INFO:tasks.workunit.client.0.smithi152.stdout:6/412: creat d7/d19/d1b/d1f/f8f x:0 0 0 2024-04-06T12:23:49.787 INFO:tasks.workunit.client.0.smithi152.stdout:4/390: read d7/d16/f1a [792099,23154] 0 2024-04-06T12:23:49.788 INFO:tasks.workunit.client.0.smithi152.stdout:5/346: mknod d3/da/d15/d40/d50/c6f 0 2024-04-06T12:23:49.790 INFO:tasks.workunit.client.0.smithi152.stdout:5/347: write d3/da/d15/d40/d4e/f52 [1092477,126792] 0 2024-04-06T12:23:49.791 INFO:tasks.workunit.client.0.smithi152.stdout:5/348: chown d3/da/d15/d2b/d4d/l5c 8018 1 2024-04-06T12:23:49.792 INFO:tasks.workunit.client.0.smithi152.stdout:5/349: readlink d3/da/d15/d2b/l30 0 2024-04-06T12:23:49.793 INFO:tasks.workunit.client.0.smithi152.stdout:5/350: chown d3/da/d15/c36 26980 1 2024-04-06T12:23:49.794 INFO:tasks.workunit.client.0.smithi152.stdout:5/351: chown d3/da/d15/d40/d4f/f66 18 1 2024-04-06T12:23:49.794 INFO:tasks.workunit.client.0.smithi152.stdout:5/352: stat d3/da/c59 0 2024-04-06T12:23:49.799 INFO:tasks.workunit.client.0.smithi152.stdout:4/391: link d7/d16/d22/d3f/d47/l4e d7/d29/d7e/d59/l7f 0 2024-04-06T12:23:49.799 INFO:tasks.workunit.client.0.smithi152.stdout:4/392: fdatasync d7/d16/d22/f69 0 2024-04-06T12:23:49.800 INFO:tasks.workunit.client.0.smithi152.stdout:4/393: fdatasync d7/d29/d7e/d59/f62 0 2024-04-06T12:23:49.803 INFO:tasks.workunit.client.0.smithi152.stdout:4/394: rename d7/l10 to d7/d16/d22/d30/l80 0 2024-04-06T12:23:49.804 INFO:tasks.workunit.client.0.smithi152.stdout:4/395: chown d7/d29/f6d 676 1 2024-04-06T12:23:49.804 INFO:tasks.workunit.client.0.smithi152.stdout:4/396: stat d7/d29/d78/d33/f74 0 2024-04-06T12:23:49.806 INFO:tasks.workunit.client.0.smithi152.stdout:4/397: write d7/d29/d78/d33/f44 [3731451,23658] 0 2024-04-06T12:23:49.807 INFO:tasks.workunit.client.0.smithi152.stdout:4/398: dread - d7/d29/f65 zero size 2024-04-06T12:23:49.830 INFO:tasks.workunit.client.0.smithi152.stdout:4/399: dwrite d7/d29/d78/f39 [0,4194304] 0 2024-04-06T12:23:49.835 INFO:tasks.workunit.client.0.smithi152.stdout:4/400: creat d7/d16/d22/d3f/f81 x:0 0 0 2024-04-06T12:23:49.837 INFO:tasks.workunit.client.0.smithi152.stdout:4/401: mkdir d7/d82 0 2024-04-06T12:23:49.838 INFO:tasks.workunit.client.0.smithi152.stdout:4/402: dread - d7/d29/d78/d33/f6b zero size 2024-04-06T12:23:49.840 INFO:tasks.workunit.client.0.smithi152.stdout:4/403: rmdir d7/d29/d2e/d5b 39 2024-04-06T12:23:49.841 INFO:tasks.workunit.client.0.smithi152.stdout:4/404: read d7/d29/d78/d33/f44 [461828,116083] 0 2024-04-06T12:23:49.849 INFO:tasks.workunit.client.0.smithi152.stdout:4/405: creat d7/d16/f83 x:0 0 0 2024-04-06T12:23:49.852 INFO:tasks.workunit.client.0.smithi152.stdout:0/401: sync 2024-04-06T12:23:49.852 INFO:tasks.workunit.client.0.smithi152.stdout:8/354: sync 2024-04-06T12:23:49.853 INFO:tasks.workunit.client.0.smithi152.stdout:8/355: truncate d4/dc/d10/d49/f64 4947 0 2024-04-06T12:23:49.854 INFO:tasks.workunit.client.0.smithi152.stdout:4/406: symlink d7/d29/d2e/d7b/l84 0 2024-04-06T12:23:49.858 INFO:tasks.workunit.client.0.smithi152.stdout:8/356: creat d4/db/d2a/f79 x:0 0 0 2024-04-06T12:23:49.859 INFO:tasks.workunit.client.0.smithi152.stdout:4/407: creat d7/d29/d7e/d59/f85 x:0 0 0 2024-04-06T12:23:49.860 INFO:tasks.workunit.client.0.smithi152.stdout:4/408: readlink d7/d16/l4d 0 2024-04-06T12:23:49.860 INFO:tasks.workunit.client.0.smithi152.stdout:4/409: chown d7/d29/d7e 14733271 1 2024-04-06T12:23:49.864 INFO:tasks.workunit.client.0.smithi152.stdout:8/357: rename d4/l3c to d4/dc/l7a 0 2024-04-06T12:23:49.867 INFO:tasks.workunit.client.0.smithi152.stdout:8/358: mknod d4/d2c/d2b/c7b 0 2024-04-06T12:23:49.867 INFO:tasks.workunit.client.0.smithi152.stdout:8/359: fdatasync d4/db/f22 0 2024-04-06T12:23:49.868 INFO:tasks.workunit.client.0.smithi152.stdout:0/402: getdents d4/de/d28 0 2024-04-06T12:23:49.869 INFO:tasks.workunit.client.0.smithi152.stdout:0/403: truncate d4/de/d28/d18/d3b/f5a 451651 0 2024-04-06T12:23:49.871 INFO:tasks.workunit.client.0.smithi152.stdout:8/360: read d4/dc/f1f [463719,2613] 0 2024-04-06T12:23:49.871 INFO:tasks.workunit.client.0.smithi152.stdout:8/361: readlink d4/dc/lf 0 2024-04-06T12:23:49.872 INFO:tasks.workunit.client.0.smithi152.stdout:4/410: rename d7/d16/d22/d30/f73 to d7/d29/d7e/f86 0 2024-04-06T12:23:49.878 INFO:tasks.workunit.client.0.smithi152.stdout:4/411: dwrite d7/d29/d7e/f67 [0,4194304] 0 2024-04-06T12:23:49.878 INFO:tasks.workunit.client.0.smithi152.stdout:8/362: write d4/d2c/d54/f75 [4452119,9748] 0 2024-04-06T12:23:49.879 INFO:tasks.workunit.client.0.smithi152.stdout:4/412: chown d7/d29/f65 7928997 1 2024-04-06T12:23:49.883 INFO:tasks.workunit.client.0.smithi152.stdout:0/404: link d4/d36/f74 d4/de/f7a 0 2024-04-06T12:23:49.883 INFO:tasks.workunit.client.0.smithi152.stdout:0/405: dread - d4/de/f68 zero size 2024-04-06T12:23:49.884 INFO:tasks.workunit.client.0.smithi152.stdout:8/363: symlink d4/db/d2a/l7c 0 2024-04-06T12:23:49.885 INFO:tasks.workunit.client.0.smithi152.stdout:0/406: write d4/f4c [3791658,90237] 0 2024-04-06T12:23:49.886 INFO:tasks.workunit.client.0.smithi152.stdout:0/407: readlink d4/de/d28/d18/d43/l55 0 2024-04-06T12:23:49.893 INFO:tasks.workunit.client.0.smithi152.stdout:0/408: fdatasync d4/de/f1e 0 2024-04-06T12:23:49.894 INFO:tasks.workunit.client.0.smithi152.stdout:4/413: creat d7/d16/d22/d30/d60/f87 x:0 0 0 2024-04-06T12:23:49.895 INFO:tasks.workunit.client.0.smithi152.stdout:4/414: dread - d7/d29/f5e zero size 2024-04-06T12:23:49.896 INFO:tasks.workunit.client.0.smithi152.stdout:4/415: fdatasync d7/d16/d22/d30/f43 0 2024-04-06T12:23:49.897 INFO:tasks.workunit.client.0.smithi152.stdout:4/416: dread - d7/d29/d78/d33/f74 zero size 2024-04-06T12:23:49.904 INFO:tasks.workunit.client.0.smithi152.stdout:4/417: mkdir d7/d16/d22/d88 0 2024-04-06T12:23:49.909 INFO:tasks.workunit.client.0.smithi152.stdout:0/409: getdents d4/de/d4a 0 2024-04-06T12:23:49.910 INFO:tasks.workunit.client.0.smithi152.stdout:0/410: chown d4/d36/f60 15094 1 2024-04-06T12:23:49.911 INFO:tasks.workunit.client.0.smithi152.stdout:4/418: dwrite d7/d16/d22/f69 [0,4194304] 0 2024-04-06T12:23:49.911 INFO:tasks.workunit.client.0.smithi152.stdout:0/411: chown d4/d31/f3d 262275318 1 2024-04-06T12:23:49.912 INFO:tasks.workunit.client.0.smithi152.stdout:4/419: dread - d7/d29/f65 zero size 2024-04-06T12:23:49.920 INFO:tasks.workunit.client.0.smithi152.stdout:4/420: mknod d7/d82/c89 0 2024-04-06T12:23:49.921 INFO:tasks.workunit.client.0.smithi152.stdout:0/412: read f0 [6230457,74418] 0 2024-04-06T12:23:49.922 INFO:tasks.workunit.client.0.smithi152.stdout:8/364: write d4/f4a [950894,90959] 0 2024-04-06T12:23:49.926 INFO:tasks.workunit.client.0.smithi152.stdout:8/365: creat d4/db/d2a/f7d x:0 0 0 2024-04-06T12:23:49.929 INFO:tasks.workunit.client.0.smithi152.stdout:0/413: rename d4/f32 to d4/d31/d47/d51/f7b 0 2024-04-06T12:23:49.932 INFO:tasks.workunit.client.0.smithi152.stdout:8/366: mknod d4/db/d32/c7e 0 2024-04-06T12:23:49.933 INFO:tasks.workunit.client.0.smithi152.stdout:4/421: rmdir d7/d16/d22 39 2024-04-06T12:23:49.935 INFO:tasks.workunit.client.0.smithi152.stdout:4/422: truncate d7/d29/d7e/d59/f76 252459 0 2024-04-06T12:23:49.936 INFO:tasks.workunit.client.0.smithi152.stdout:0/414: rmdir d4/d19 39 2024-04-06T12:23:49.938 INFO:tasks.workunit.client.0.smithi152.stdout:8/367: creat d4/db/d2a/f7f x:0 0 0 2024-04-06T12:23:49.939 INFO:tasks.workunit.client.0.smithi152.stdout:8/368: write d4/f77 [4644857,20987] 0 2024-04-06T12:23:49.941 INFO:tasks.workunit.client.0.smithi152.stdout:8/369: fdatasync d4/dc/d10/d51/f61 0 2024-04-06T12:23:49.943 INFO:tasks.workunit.client.0.smithi152.stdout:8/370: chown d4/db/d39/f76 73082 1 2024-04-06T12:23:49.944 INFO:tasks.workunit.client.0.smithi152.stdout:8/371: read - d4/dc/d10/d55/f6f zero size 2024-04-06T12:23:49.945 INFO:tasks.workunit.client.0.smithi152.stdout:4/423: dwrite d7/d29/d7e/f86 [0,4194304] 0 2024-04-06T12:23:49.952 INFO:tasks.workunit.client.0.smithi152.stdout:8/372: creat d4/d2c/f80 x:0 0 0 2024-04-06T12:23:49.953 INFO:tasks.workunit.client.0.smithi152.stdout:0/415: write d4/de/d67/f6a [949057,49079] 0 2024-04-06T12:23:49.959 INFO:tasks.workunit.client.0.smithi152.stdout:4/424: creat d7/d29/d2e/f8a x:0 0 0 2024-04-06T12:23:49.961 INFO:tasks.workunit.client.0.smithi152.stdout:8/373: dwrite d4/db/f58 [0,4194304] 0 2024-04-06T12:23:49.961 INFO:tasks.workunit.client.0.smithi152.stdout:4/425: truncate d7/d29/d7e/d59/f76 378992 0 2024-04-06T12:23:49.962 INFO:tasks.workunit.client.0.smithi152.stdout:8/374: write d4/db/f22 [4157537,125183] 0 2024-04-06T12:23:49.963 INFO:tasks.workunit.client.0.smithi152.stdout:0/416: mkdir d4/d36/d72/d7c 0 2024-04-06T12:23:49.967 INFO:tasks.workunit.client.0.smithi152.stdout:4/426: unlink d7/c70 0 2024-04-06T12:23:49.970 INFO:tasks.workunit.client.0.smithi152.stdout:4/427: read - d7/d16/d22/d30/d60/f87 zero size 2024-04-06T12:23:49.971 INFO:tasks.workunit.client.0.smithi152.stdout:4/428: dread - d7/d16/f68 zero size 2024-04-06T12:23:49.976 INFO:tasks.workunit.client.0.smithi152.stdout:4/429: symlink d7/d82/l8b 0 2024-04-06T12:23:49.976 INFO:tasks.workunit.client.0.smithi152.stdout:8/375: getdents d4/d2c/d54 0 2024-04-06T12:23:49.977 INFO:tasks.workunit.client.0.smithi152.stdout:4/430: read d7/f4a [2944902,29940] 0 2024-04-06T12:23:49.978 INFO:tasks.workunit.client.0.smithi152.stdout:0/417: link d4/de/d4a/d33/c44 d4/de/d28/d18/d43/d62/c7d 0 2024-04-06T12:23:49.980 INFO:tasks.workunit.client.0.smithi152.stdout:8/376: stat d4/d2c/d2b 0 2024-04-06T12:23:49.980 INFO:tasks.workunit.client.0.smithi152.stdout:4/431: symlink d7/d16/d22/d30/d60/l8c 0 2024-04-06T12:23:49.981 INFO:tasks.workunit.client.0.smithi152.stdout:0/418: mkdir d4/d31/d47/d7e 0 2024-04-06T12:23:49.984 INFO:tasks.workunit.client.0.smithi152.stdout:4/432: mknod d7/d16/d22/d3f/c8d 0 2024-04-06T12:23:49.985 INFO:tasks.workunit.client.0.smithi152.stdout:4/433: stat d7/d16/d22/d3f/f81 0 2024-04-06T12:23:49.994 INFO:tasks.workunit.client.0.smithi152.stdout:0/419: dread f0 [4194304,4194304] 0 2024-04-06T12:23:49.999 INFO:tasks.workunit.client.0.smithi152.stdout:0/420: mkdir d4/de/d7f 0 2024-04-06T12:23:50.006 INFO:tasks.workunit.client.0.smithi152.stdout:4/434: truncate d7/f17 172673 0 2024-04-06T12:23:50.008 INFO:tasks.workunit.client.0.smithi152.stdout:4/435: write d7/f2c [833677,51816] 0 2024-04-06T12:23:50.013 INFO:tasks.workunit.client.0.smithi152.stdout:0/421: write d4/d19/f4e [142017,19487] 0 2024-04-06T12:23:50.015 INFO:tasks.workunit.client.0.smithi152.stdout:4/436: unlink d7/f4f 0 2024-04-06T12:23:50.021 INFO:tasks.workunit.client.0.smithi152.stdout:4/437: rmdir d7/d16/d55 39 2024-04-06T12:23:50.027 INFO:tasks.workunit.client.0.smithi152.stdout:4/438: symlink d7/d29/d2e/d5b/l8e 0 2024-04-06T12:23:50.030 INFO:tasks.workunit.client.0.smithi152.stdout:0/422: dwrite d4/de/d28/d18/d3b/d2e/f4b [0,4194304] 0 2024-04-06T12:23:50.034 INFO:tasks.workunit.client.0.smithi152.stdout:4/439: dread d7/d29/f2b [0,4194304] 0 2024-04-06T12:23:50.034 INFO:tasks.workunit.client.0.smithi152.stdout:0/423: mknod d4/d31/d47/d51/c80 0 2024-04-06T12:23:50.034 INFO:tasks.workunit.client.0.smithi152.stdout:4/440: chown d7/cd 242 1 2024-04-06T12:23:50.037 INFO:tasks.workunit.client.0.smithi152.stdout:0/424: truncate d4/d19/f53 3215013 0 2024-04-06T12:23:50.038 INFO:tasks.workunit.client.0.smithi152.stdout:0/425: write d4/d36/f60 [5134132,84232] 0 2024-04-06T12:23:50.057 INFO:tasks.workunit.client.0.smithi152.stdout:4/441: truncate d7/d29/d7e/f67 2408151 0 2024-04-06T12:23:50.058 INFO:tasks.workunit.client.0.smithi152.stdout:0/426: write d4/d31/f3d [800225,90134] 0 2024-04-06T12:23:50.060 INFO:tasks.workunit.client.0.smithi152.stdout:4/442: rename d7/le to d7/d29/d7e/d59/l8f 0 2024-04-06T12:23:50.061 INFO:tasks.workunit.client.0.smithi152.stdout:4/443: stat d7/d29/d2e/d5b/f77 0 2024-04-06T12:23:50.064 INFO:tasks.workunit.client.0.smithi152.stdout:4/444: creat d7/d29/d7e/d59/f90 x:0 0 0 2024-04-06T12:23:50.064 INFO:tasks.workunit.client.0.smithi152.stdout:0/427: dwrite d4/de/f1e [0,4194304] 0 2024-04-06T12:23:50.066 INFO:tasks.workunit.client.0.smithi152.stdout:0/428: read d4/de/d28/d18/d3b/d2e/f4b [154368,1243] 0 2024-04-06T12:23:50.071 INFO:tasks.workunit.client.0.smithi152.stdout:0/429: mkdir d4/de/d28/d18/d43/d81 0 2024-04-06T12:23:50.072 INFO:tasks.workunit.client.0.smithi152.stdout:0/430: fsync d4/d31/f3d 0 2024-04-06T12:23:50.075 INFO:tasks.workunit.client.0.smithi152.stdout:4/445: symlink d7/d16/l91 0 2024-04-06T12:23:50.080 INFO:tasks.workunit.client.0.smithi152.stdout:0/431: mknod d4/de/d28/d18/c82 0 2024-04-06T12:23:50.083 INFO:tasks.workunit.client.0.smithi152.stdout:4/446: symlink d7/d29/d78/d33/l92 0 2024-04-06T12:23:50.088 INFO:tasks.workunit.client.0.smithi152.stdout:4/447: creat d7/d29/d7e/f93 x:0 0 0 2024-04-06T12:23:50.089 INFO:tasks.workunit.client.0.smithi152.stdout:4/448: write d7/d29/d7e/d59/f85 [449785,83114] 0 2024-04-06T12:23:50.092 INFO:tasks.workunit.client.0.smithi152.stdout:4/449: unlink d7/c9 0 2024-04-06T12:23:50.092 INFO:tasks.workunit.client.0.smithi152.stdout:4/450: chown d7/d29/d2e/f8a 32299135 1 2024-04-06T12:23:50.093 INFO:tasks.workunit.client.0.smithi152.stdout:0/432: truncate d4/d31/f3d 3266276 0 2024-04-06T12:23:50.095 INFO:tasks.workunit.client.0.smithi152.stdout:0/433: write d4/de/d28/d18/d3b/f5a [1456097,120889] 0 2024-04-06T12:23:50.101 INFO:tasks.workunit.client.0.smithi152.stdout:4/451: creat d7/d16/d22/d3f/d47/f94 x:0 0 0 2024-04-06T12:23:50.106 INFO:tasks.workunit.client.0.smithi152.stdout:0/434: rename d4/de/d4a/d33/c44 to d4/d36/c83 0 2024-04-06T12:23:50.118 INFO:tasks.workunit.client.0.smithi152.stdout:0/435: dread d4/f4c [0,4194304] 0 2024-04-06T12:23:50.120 INFO:tasks.workunit.client.0.smithi152.stdout:0/436: read d4/de/d28/d18/d3b/d2e/f4b [2287580,89182] 0 2024-04-06T12:23:50.128 INFO:tasks.workunit.client.0.smithi152.stdout:0/437: dread d4/de/d28/f22 [0,4194304] 0 2024-04-06T12:23:50.131 INFO:tasks.workunit.client.0.smithi152.stdout:0/438: creat d4/de/d67/f84 x:0 0 0 2024-04-06T12:23:50.399 INFO:tasks.workunit.client.0.smithi152.stdout:7/326: sync 2024-04-06T12:23:50.412 INFO:tasks.workunit.client.0.smithi152.stdout:7/327: dread d8/df/d61/d17/f1a [0,4194304] 0 2024-04-06T12:23:50.421 INFO:tasks.workunit.client.0.smithi152.stdout:7/328: dread d8/df/d28/f4d [0,4194304] 0 2024-04-06T12:23:50.433 INFO:tasks.workunit.client.0.smithi152.stdout:7/329: dread d8/d2a/d42/f57 [0,4194304] 0 2024-04-06T12:23:50.482 INFO:tasks.workunit.client.0.smithi152.stdout:7/330: creat d8/df/d34/d63/f71 x:0 0 0 2024-04-06T12:23:50.486 INFO:tasks.workunit.client.0.smithi152.stdout:7/331: creat d8/df/d61/d17/f72 x:0 0 0 2024-04-06T12:23:50.491 INFO:tasks.workunit.client.0.smithi152.stdout:7/332: rename d8/df/d61/d17/d2c/f36 to d8/df/d61/d17/f73 0 2024-04-06T12:23:50.493 INFO:tasks.workunit.client.0.smithi152.stdout:7/333: mkdir d8/d74 0 2024-04-06T12:23:50.494 INFO:tasks.workunit.client.0.smithi152.stdout:7/334: write d8/df/d61/d17/f54 [417369,16315] 0 2024-04-06T12:23:50.616 INFO:tasks.workunit.client.0.smithi152.stdout:2/383: sync 2024-04-06T12:23:50.621 INFO:tasks.workunit.client.0.smithi152.stdout:2/384: rename d0/f13 to d0/d40/d41/d28/d5f/f81 0 2024-04-06T12:23:50.626 INFO:tasks.workunit.client.0.smithi152.stdout:2/385: dwrite d0/d15/d24/d3d/f4f [0,4194304] 0 2024-04-06T12:23:50.629 INFO:tasks.workunit.client.0.smithi152.stdout:2/386: symlink d0/d40/l82 0 2024-04-06T12:23:50.629 INFO:tasks.workunit.client.0.smithi152.stdout:2/387: stat d0/d40/d41/d28/l5e 0 2024-04-06T12:23:50.630 INFO:tasks.workunit.client.0.smithi152.stdout:2/388: write d0/d40/d41/f75 [624842,108042] 0 2024-04-06T12:23:50.637 INFO:tasks.workunit.client.0.smithi152.stdout:2/389: rmdir d0/d2/d6f 39 2024-04-06T12:23:50.639 INFO:tasks.workunit.client.0.smithi152.stdout:2/390: truncate d0/d2/d5/f42 4868479 0 2024-04-06T12:23:50.639 INFO:tasks.workunit.client.0.smithi152.stdout:2/391: readlink d0/d40/d41/d28/l5e 0 2024-04-06T12:23:50.656 INFO:tasks.workunit.client.0.smithi152.stdout:2/392: dread d0/d40/f56 [0,4194304] 0 2024-04-06T12:23:50.657 INFO:tasks.workunit.client.0.smithi152.stdout:2/393: write d0/d2/d5/fe [1627603,40990] 0 2024-04-06T12:23:50.760 INFO:tasks.workunit.client.0.smithi152.stdout:2/394: write d0/d2/d5/f1f [2299565,37131] 0 2024-04-06T12:23:50.762 INFO:tasks.workunit.client.0.smithi152.stdout:2/395: creat d0/d40/d26/f83 x:0 0 0 2024-04-06T12:23:50.774 INFO:tasks.workunit.client.0.smithi152.stdout:2/396: dread d0/d40/d26/f2a [0,4194304] 0 2024-04-06T12:23:50.777 INFO:tasks.workunit.client.0.smithi152.stdout:2/397: truncate d0/d15/d24/d3d/f7d 427052 0 2024-04-06T12:23:50.778 INFO:tasks.workunit.client.0.smithi152.stdout:2/398: rmdir d0/d15/d24/d3d 39 2024-04-06T12:23:50.779 INFO:tasks.workunit.client.0.smithi152.stdout:2/399: chown d0/d40/d41/c3c 3 1 2024-04-06T12:23:50.779 INFO:tasks.workunit.client.0.smithi152.stdout:2/400: chown d0/d15/f5d 106334 1 2024-04-06T12:23:50.782 INFO:tasks.workunit.client.0.smithi152.stdout:2/401: dread d0/d2/d5/f1f [0,4194304] 0 2024-04-06T12:23:50.785 INFO:tasks.workunit.client.0.smithi152.stdout:2/402: symlink d0/d2/d5/d3a/l84 0 2024-04-06T12:23:50.790 INFO:tasks.workunit.client.0.smithi152.stdout:2/403: dread d0/f11 [0,4194304] 0 2024-04-06T12:23:50.790 INFO:tasks.workunit.client.0.smithi152.stdout:2/404: readlink d0/d40/d26/l78 0 2024-04-06T12:23:50.791 INFO:tasks.workunit.client.0.smithi152.stdout:2/405: chown d0/d15/d4d/f76 7771658 1 2024-04-06T12:23:50.797 INFO:tasks.workunit.client.0.smithi152.stdout:2/406: dwrite d0/d15/d4d/f76 [0,4194304] 0 2024-04-06T12:23:50.798 INFO:tasks.workunit.client.0.smithi152.stdout:2/407: chown d0/d2/d6f 402564025 1 2024-04-06T12:23:50.799 INFO:tasks.workunit.client.0.smithi152.stdout:2/408: stat d0/d40/d41 0 2024-04-06T12:23:50.799 INFO:tasks.workunit.client.0.smithi152.stdout:2/409: stat d0/d15/d4d/f76 0 2024-04-06T12:23:50.799 INFO:tasks.workunit.client.0.smithi152.stdout:2/410: dread - d0/d40/f51 zero size 2024-04-06T12:23:50.803 INFO:tasks.workunit.client.0.smithi152.stdout:2/411: symlink d0/d40/d41/d63/l85 0 2024-04-06T12:23:50.805 INFO:tasks.workunit.client.0.smithi152.stdout:2/412: write d0/d40/d41/d28/d5f/f81 [4306024,99149] 0 2024-04-06T12:23:50.806 INFO:tasks.workunit.client.0.smithi152.stdout:2/413: fsync d0/d40/d41/f6c 0 2024-04-06T12:23:50.807 INFO:tasks.workunit.client.0.smithi152.stdout:2/414: chown d0/d15/d4d/f4e 7 1 2024-04-06T12:23:50.811 INFO:tasks.workunit.client.0.smithi152.stdout:2/415: creat d0/d15/d24/d3d/f86 x:0 0 0 2024-04-06T12:23:50.813 INFO:tasks.workunit.client.0.smithi152.stdout:2/416: rmdir d0/d40/d41 39 2024-04-06T12:23:50.813 INFO:tasks.workunit.client.0.smithi152.stdout:2/417: fdatasync d0/d2/f2c 0 2024-04-06T12:23:50.814 INFO:tasks.workunit.client.0.smithi152.stdout:2/418: chown d0/d15/d24/l31 0 1 2024-04-06T12:23:50.816 INFO:tasks.workunit.client.0.smithi152.stdout:2/419: dread - d0/d40/d41/d28/d54/f7e zero size 2024-04-06T12:23:50.819 INFO:tasks.workunit.client.0.smithi152.stdout:2/420: truncate d0/f1c 1730475 0 2024-04-06T12:23:50.824 INFO:tasks.workunit.client.0.smithi152.stdout:2/421: getdents d0/d40 0 2024-04-06T12:23:50.825 INFO:tasks.workunit.client.0.smithi152.stdout:9/297: sync 2024-04-06T12:23:50.827 INFO:tasks.workunit.client.0.smithi152.stdout:2/422: mkdir d0/d2/d5/d3a/d87 0 2024-04-06T12:23:50.827 INFO:tasks.workunit.client.0.smithi152.stdout:9/298: write d5/d39/d3f/d42/d5f/d17/d23/d2d/f56 [271965,6078] 0 2024-04-06T12:23:50.828 INFO:tasks.workunit.client.0.smithi152.stdout:9/299: readlink d5/d6/l2f 0 2024-04-06T12:23:50.851 INFO:tasks.workunit.client.0.smithi152.stdout:2/423: write d0/d40/d26/f2b [3973658,50972] 0 2024-04-06T12:23:50.857 INFO:tasks.workunit.client.0.smithi152.stdout:9/300: dwrite d5/d6/f2c [0,4194304] 0 2024-04-06T12:23:50.859 INFO:tasks.workunit.client.0.smithi152.stdout:2/424: creat d0/d2/f88 x:0 0 0 2024-04-06T12:23:50.866 INFO:tasks.workunit.client.0.smithi152.stdout:2/425: symlink d0/d2/d5/d3a/d87/l89 0 2024-04-06T12:23:50.868 INFO:tasks.workunit.client.0.smithi152.stdout:9/301: link d5/d6/c12 d5/d39/d3f/d42/d5f/d17/d23/c60 0 2024-04-06T12:23:50.869 INFO:tasks.workunit.client.0.smithi152.stdout:2/426: creat d0/d2/d5/d3a/f8a x:0 0 0 2024-04-06T12:23:50.870 INFO:tasks.workunit.client.0.smithi152.stdout:9/302: chown d5/d39/d3f/d42/d5f/d17/d23/d2d/d4b/c53 0 1 2024-04-06T12:23:50.871 INFO:tasks.workunit.client.0.smithi152.stdout:2/427: creat d0/d40/d41/d28/d5f/f8b x:0 0 0 2024-04-06T12:23:50.874 INFO:tasks.workunit.client.0.smithi152.stdout:2/428: mkdir d0/d40/d41/d28/d8c 0 2024-04-06T12:23:50.877 INFO:tasks.workunit.client.0.smithi152.stdout:2/429: mkdir d0/d15/d24/d79/d80/d8d 0 2024-04-06T12:23:50.878 INFO:tasks.workunit.client.0.smithi152.stdout:2/430: readlink d0/d2/d5/d3a/l84 0 2024-04-06T12:23:50.885 INFO:tasks.workunit.client.0.smithi152.stdout:2/431: dwrite d0/d40/f62 [0,4194304] 0 2024-04-06T12:23:50.886 INFO:tasks.workunit.client.0.smithi152.stdout:2/432: dread - d0/d40/d26/f7b zero size 2024-04-06T12:23:50.893 INFO:tasks.workunit.client.0.smithi152.stdout:2/433: unlink d0/d40/f39 0 2024-04-06T12:23:50.906 INFO:tasks.workunit.client.0.smithi152.stdout:2/434: link d0/d40/f62 d0/d15/d24/f8e 0 2024-04-06T12:23:50.909 INFO:tasks.workunit.client.0.smithi152.stdout:2/435: creat d0/d40/d26/f8f x:0 0 0 2024-04-06T12:23:50.910 INFO:tasks.workunit.client.0.smithi152.stdout:2/436: chown d0/d40/d41/f6c 92 1 2024-04-06T12:23:50.918 INFO:tasks.workunit.client.0.smithi152.stdout:2/437: dwrite d0/d40/f51 [0,4194304] 0 2024-04-06T12:23:50.919 INFO:tasks.workunit.client.0.smithi152.stdout:5/353: sync 2024-04-06T12:23:50.919 INFO:tasks.workunit.client.0.smithi152.stdout:3/325: sync 2024-04-06T12:23:50.919 INFO:tasks.workunit.client.0.smithi152.stdout:1/299: sync 2024-04-06T12:23:50.919 INFO:tasks.workunit.client.0.smithi152.stdout:6/413: sync 2024-04-06T12:23:50.920 INFO:tasks.workunit.client.0.smithi152.stdout:0/439: sync 2024-04-06T12:23:50.920 INFO:tasks.workunit.client.0.smithi152.stdout:4/452: sync 2024-04-06T12:23:50.920 INFO:tasks.workunit.client.0.smithi152.stdout:7/335: sync 2024-04-06T12:23:50.920 INFO:tasks.workunit.client.0.smithi152.stdout:8/377: sync 2024-04-06T12:23:50.922 INFO:tasks.workunit.client.0.smithi152.stdout:5/354: chown d3/da/d15/d40/d4e/f5d 513 1 2024-04-06T12:23:50.922 INFO:tasks.workunit.client.0.smithi152.stdout:7/336: write d8/df/f25 [3918854,95111] 0 2024-04-06T12:23:50.923 INFO:tasks.workunit.client.0.smithi152.stdout:2/438: unlink d0/d15/d4d/f6e 0 2024-04-06T12:23:50.923 INFO:tasks.workunit.client.0.smithi152.stdout:2/439: chown d0/d15/d24 332 1 2024-04-06T12:23:50.924 INFO:tasks.workunit.client.0.smithi152.stdout:2/440: stat d0/d40/d41/c3c 0 2024-04-06T12:23:50.926 INFO:tasks.workunit.client.0.smithi152.stdout:0/440: readlink d4/de/l5e 0 2024-04-06T12:23:50.927 INFO:tasks.workunit.client.0.smithi152.stdout:1/300: dread - d2/d1d/d21/f34 zero size 2024-04-06T12:23:50.930 INFO:tasks.workunit.client.0.smithi152.stdout:7/337: mkdir d8/df/d28/d75 0 2024-04-06T12:23:50.931 INFO:tasks.workunit.client.0.smithi152.stdout:3/326: dwrite d0/d10/d1e/d39/f5f [0,4194304] 0 2024-04-06T12:23:50.932 INFO:tasks.workunit.client.0.smithi152.stdout:3/327: stat d0 0 2024-04-06T12:23:50.933 INFO:tasks.workunit.client.0.smithi152.stdout:8/378: mkdir d4/d81 0 2024-04-06T12:23:50.934 INFO:tasks.workunit.client.0.smithi152.stdout:2/441: rename d0/d40/d41/d28/d5f to d0/d2/d6f/d90 0 2024-04-06T12:23:50.939 INFO:tasks.workunit.client.0.smithi152.stdout:4/453: mkdir d7/d16/d22/d95 0 2024-04-06T12:23:50.942 INFO:tasks.workunit.client.0.smithi152.stdout:1/301: creat d2/d1d/d21/d28/f6f x:0 0 0 2024-04-06T12:23:50.942 INFO:tasks.workunit.client.0.smithi152.stdout:0/441: dwrite d4/de/d28/d18/d3b/d2e/d78/f79 [0,4194304] 0 2024-04-06T12:23:50.944 INFO:tasks.workunit.client.0.smithi152.stdout:1/302: dread - d2/d2f/d37/f4f zero size 2024-04-06T12:23:50.945 INFO:tasks.workunit.client.0.smithi152.stdout:7/338: dwrite d8/d2a/d37/f47 [0,4194304] 0 2024-04-06T12:23:50.952 INFO:tasks.workunit.client.0.smithi152.stdout:7/339: dread d8/df/d4a/f64 [0,4194304] 0 2024-04-06T12:23:50.952 INFO:tasks.workunit.client.0.smithi152.stdout:0/442: mknod d4/de/d28/c85 0 2024-04-06T12:23:50.954 INFO:tasks.workunit.client.0.smithi152.stdout:3/328: mknod d0/c65 0 2024-04-06T12:23:50.961 INFO:tasks.workunit.client.0.smithi152.stdout:3/329: creat d0/d10/f66 x:0 0 0 2024-04-06T12:23:50.961 INFO:tasks.workunit.client.0.smithi152.stdout:8/379: link d4/d2c/d2b/f44 d4/dc/f82 0 2024-04-06T12:23:50.963 INFO:tasks.workunit.client.0.smithi152.stdout:3/330: readlink d0/d1f/d28/l36 0 2024-04-06T12:23:50.964 INFO:tasks.workunit.client.0.smithi152.stdout:4/454: creat d7/d16/f96 x:0 0 0 2024-04-06T12:23:50.966 INFO:tasks.workunit.client.0.smithi152.stdout:3/331: fsync d0/f3c 0 2024-04-06T12:23:50.966 INFO:tasks.workunit.client.0.smithi152.stdout:8/380: read d4/db/f13 [12731,93498] 0 2024-04-06T12:23:50.968 INFO:tasks.workunit.client.0.smithi152.stdout:7/340: dwrite d8/df/d61/d3d/f39 [0,4194304] 0 2024-04-06T12:23:50.970 INFO:tasks.workunit.client.0.smithi152.stdout:3/332: write d0/d1f/f60 [258079,79020] 0 2024-04-06T12:23:50.970 INFO:tasks.workunit.client.0.smithi152.stdout:4/455: write d7/d29/d78/f7c [393826,117533] 0 2024-04-06T12:23:50.971 INFO:tasks.workunit.client.0.smithi152.stdout:1/303: dread d2/f3 [4194304,4194304] 0 2024-04-06T12:23:50.973 INFO:tasks.workunit.client.0.smithi152.stdout:7/341: truncate d8/d2a/d42/f6b 662440 0 2024-04-06T12:23:50.974 INFO:tasks.workunit.client.0.smithi152.stdout:2/442: truncate d0/d40/d26/f2b 1729996 0 2024-04-06T12:23:50.974 INFO:tasks.workunit.client.0.smithi152.stdout:4/456: dread - d7/d29/d78/d33/f6b zero size 2024-04-06T12:23:50.984 INFO:tasks.workunit.client.0.smithi152.stdout:0/443: rename d4/de/d28/d18/f2c to d4/de/d4a/d33/f86 0 2024-04-06T12:23:50.984 INFO:tasks.workunit.client.0.smithi152.stdout:3/333: dwrite d0/d1f/d4a/f54 [0,4194304] 0 2024-04-06T12:23:50.985 INFO:tasks.workunit.client.0.smithi152.stdout:2/443: dwrite d0/d2/f88 [0,4194304] 0 2024-04-06T12:23:50.989 INFO:tasks.workunit.client.0.smithi152.stdout:0/444: write d4/d31/d47/d51/f6c [466639,64326] 0 2024-04-06T12:23:50.989 INFO:tasks.workunit.client.0.smithi152.stdout:4/457: dread d7/f17 [0,4194304] 0 2024-04-06T12:23:50.990 INFO:tasks.workunit.client.0.smithi152.stdout:1/304: mknod d2/d2f/d54/c70 0 2024-04-06T12:23:50.992 INFO:tasks.workunit.client.0.smithi152.stdout:1/305: chown d2/d5d/d6d 30228 1 2024-04-06T12:23:50.994 INFO:tasks.workunit.client.0.smithi152.stdout:8/381: dread d4/dc/fd [0,4194304] 0 2024-04-06T12:23:50.999 INFO:tasks.workunit.client.0.smithi152.stdout:4/458: dwrite d7/d16/f20 [0,4194304] 0 2024-04-06T12:23:51.000 INFO:tasks.workunit.client.0.smithi152.stdout:2/444: creat d0/d15/d24/d3d/f91 x:0 0 0 2024-04-06T12:23:51.002 INFO:tasks.workunit.client.0.smithi152.stdout:2/445: truncate d0/d40/d26/f2a 4707754 0 2024-04-06T12:23:51.003 INFO:tasks.workunit.client.0.smithi152.stdout:2/446: stat d0/d15/d24/f72 0 2024-04-06T12:23:51.005 INFO:tasks.workunit.client.0.smithi152.stdout:2/447: chown d0/d15/d24/d79 3 1 2024-04-06T12:23:51.008 INFO:tasks.workunit.client.0.smithi152.stdout:3/334: rename d0/d10/d1e/d39/l5e to d0/d1f/d4a/l67 0 2024-04-06T12:23:51.010 INFO:tasks.workunit.client.0.smithi152.stdout:1/306: dread d2/fb [0,4194304] 0 2024-04-06T12:23:51.010 INFO:tasks.workunit.client.0.smithi152.stdout:3/335: write d0/d1f/f23 [1549284,76998] 0 2024-04-06T12:23:51.011 INFO:tasks.workunit.client.0.smithi152.stdout:1/307: chown d2/f36 6738686 1 2024-04-06T12:23:51.019 INFO:tasks.workunit.client.0.smithi152.stdout:1/308: dwrite d2/d2f/f32 [4194304,4194304] 0 2024-04-06T12:23:51.019 INFO:tasks.workunit.client.0.smithi152.stdout:8/382: mkdir d4/d2c/d2b/d83 0 2024-04-06T12:23:51.020 INFO:tasks.workunit.client.0.smithi152.stdout:7/342: truncate d8/f16 5378597 0 2024-04-06T12:23:51.022 INFO:tasks.workunit.client.0.smithi152.stdout:7/343: write d8/df/d61/d17/f72 [202340,31987] 0 2024-04-06T12:23:51.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:49.583039+0000 mgr.smithi195.ausetj (mgr.24375) 79 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 916 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 18 MiB/s rd, 94 MiB/s wr, 226 op/s 2024-04-06T12:23:51.030 INFO:tasks.workunit.client.0.smithi152.stdout:2/448: dwrite d0/d2/d5/f42 [0,4194304] 0 2024-04-06T12:23:51.031 INFO:tasks.workunit.client.0.smithi152.stdout:2/449: stat d0/d40/d26/f2a 0 2024-04-06T12:23:51.034 INFO:tasks.workunit.client.0.smithi152.stdout:0/445: write d4/de/d28/f22 [4530476,7886] 0 2024-04-06T12:23:51.041 INFO:tasks.workunit.client.0.smithi152.stdout:0/446: dread d4/de/d28/d18/d3b/d2e/f4b [0,4194304] 0 2024-04-06T12:23:51.041 INFO:tasks.workunit.client.0.smithi152.stdout:3/336: unlink d0/d1f/c5c 0 2024-04-06T12:23:51.041 INFO:tasks.workunit.client.0.smithi152.stdout:7/344: mkdir d8/df/d61/d76 0 2024-04-06T12:23:51.042 INFO:tasks.workunit.client.0.smithi152.stdout:0/447: fsync d4/de/d28/d18/d3b/f5a 0 2024-04-06T12:23:51.044 INFO:tasks.workunit.client.0.smithi152.stdout:2/450: mkdir d0/d2/d5/d92 0 2024-04-06T12:23:51.045 INFO:tasks.workunit.client.0.smithi152.stdout:3/337: dread d0/d10/d1e/f46 [0,4194304] 0 2024-04-06T12:23:51.045 INFO:tasks.workunit.client.0.smithi152.stdout:2/451: chown d0/d40/d26/c4c 1860476541 1 2024-04-06T12:23:51.046 INFO:tasks.workunit.client.0.smithi152.stdout:8/383: creat d4/dc/d10/f84 x:0 0 0 2024-04-06T12:23:51.048 INFO:tasks.workunit.client.0.smithi152.stdout:8/384: read d4/db/d39/f3f [7953646,55452] 0 2024-04-06T12:23:51.048 INFO:tasks.workunit.client.0.smithi152.stdout:4/459: link d7/lf d7/d29/d78/l97 0 2024-04-06T12:23:51.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:49.583039+0000 mgr.smithi195.ausetj (mgr.24375) 79 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 916 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 18 MiB/s rd, 94 MiB/s wr, 226 op/s 2024-04-06T12:23:51.049 INFO:tasks.workunit.client.0.smithi152.stdout:8/385: fsync d4/db/d39/f50 0 2024-04-06T12:23:51.051 INFO:tasks.workunit.client.0.smithi152.stdout:1/309: truncate d2/d1d/f2d 3318090 0 2024-04-06T12:23:51.055 INFO:tasks.workunit.client.0.smithi152.stdout:3/338: unlink d0/d10/d13/l19 0 2024-04-06T12:23:51.059 INFO:tasks.workunit.client.0.smithi152.stdout:4/460: creat d7/d29/d2e/d5b/f98 x:0 0 0 2024-04-06T12:23:51.059 INFO:tasks.workunit.client.0.smithi152.stdout:3/339: dread d0/d1f/d4a/f54 [0,4194304] 0 2024-04-06T12:23:51.066 INFO:tasks.workunit.client.0.smithi152.stdout:3/340: dwrite d0/d10/d1e/d39/f5f [0,4194304] 0 2024-04-06T12:23:51.074 INFO:tasks.workunit.client.0.smithi152.stdout:0/448: rename d4/de/d67 to d4/de/d87 0 2024-04-06T12:23:51.154 INFO:tasks.workunit.client.0.smithi152.stdout:1/310: write d2/f39 [832262,85645] 0 2024-04-06T12:23:51.154 INFO:tasks.workunit.client.0.smithi152.stdout:2/452: write d0/d15/d4d/f52 [310166,57099] 0 2024-04-06T12:23:51.156 INFO:tasks.workunit.client.0.smithi152.stdout:8/386: truncate d4/db/d2a/f3e 84515 0 2024-04-06T12:23:51.160 INFO:tasks.workunit.client.0.smithi152.stdout:0/449: dwrite d4/de/d87/f84 [0,4194304] 0 2024-04-06T12:23:51.162 INFO:tasks.workunit.client.0.smithi152.stdout:1/311: dread - d2/d1d/d21/d28/f6f zero size 2024-04-06T12:23:51.164 INFO:tasks.workunit.client.0.smithi152.stdout:2/453: chown d0/d15/d24/d3d/f4f 470243 1 2024-04-06T12:23:51.164 INFO:tasks.workunit.client.0.smithi152.stdout:3/341: dread d0/d10/d1e/f46 [0,4194304] 0 2024-04-06T12:23:51.165 INFO:tasks.workunit.client.0.smithi152.stdout:0/450: write d4/de/d28/d18/d43/f5f [1456290,92806] 0 2024-04-06T12:23:51.221 INFO:tasks.workunit.client.0.smithi152.stdout:4/461: link d7/d29/f2b d7/d16/d55/f99 0 2024-04-06T12:23:51.225 INFO:tasks.workunit.client.0.smithi152.stdout:4/462: write d7/d16/d22/d3f/d47/f94 [566070,73515] 0 2024-04-06T12:23:51.225 INFO:tasks.workunit.client.0.smithi152.stdout:1/312: mkdir d2/d2f/d54/d71 0 2024-04-06T12:23:51.228 INFO:tasks.workunit.client.0.smithi152.stdout:8/387: truncate d4/dc/d10/d18/f26 986778 0 2024-04-06T12:23:51.234 INFO:tasks.workunit.client.0.smithi152.stdout:1/313: dread d2/fb [0,4194304] 0 2024-04-06T12:23:51.238 INFO:tasks.workunit.client.0.smithi152.stdout:3/342: creat d0/d10/f68 x:0 0 0 2024-04-06T12:23:51.238 INFO:tasks.workunit.client.0.smithi152.stdout:0/451: stat d4/de/d28/c50 0 2024-04-06T12:23:51.239 INFO:tasks.workunit.client.0.smithi152.stdout:0/452: readlink d4/de/d28/d18/d3b/l46 0 2024-04-06T12:23:51.240 INFO:tasks.workunit.client.0.smithi152.stdout:0/453: stat d4/de/d4a/l54 0 2024-04-06T12:23:51.242 INFO:tasks.workunit.client.0.smithi152.stdout:8/388: mkdir d4/db/d56/d85 0 2024-04-06T12:23:51.253 INFO:tasks.workunit.client.0.smithi152.stdout:2/454: creat d0/d40/f93 x:0 0 0 2024-04-06T12:23:51.255 INFO:tasks.workunit.client.0.smithi152.stdout:4/463: creat d7/d29/d2e/f9a x:0 0 0 2024-04-06T12:23:51.258 INFO:tasks.workunit.client.0.smithi152.stdout:2/455: truncate d0/d15/d24/f72 712684 0 2024-04-06T12:23:51.258 INFO:tasks.workunit.client.0.smithi152.stdout:4/464: truncate d7/d16/f96 328385 0 2024-04-06T12:23:51.258 INFO:tasks.workunit.client.0.smithi152.stdout:3/343: rmdir d0/d35/d43/d48/d5a 0 2024-04-06T12:23:51.258 INFO:tasks.workunit.client.0.smithi152.stdout:1/314: dread d2/d1d/f23 [0,4194304] 0 2024-04-06T12:23:51.259 INFO:tasks.workunit.client.0.smithi152.stdout:2/456: fsync d0/d15/d24/d3d/f86 0 2024-04-06T12:23:51.259 INFO:tasks.workunit.client.0.smithi152.stdout:0/454: rename d4/de/d28/d18/l26 to d4/de/d28/l88 0 2024-04-06T12:23:51.261 INFO:tasks.workunit.client.0.smithi152.stdout:1/315: symlink d2/d2f/d54/l72 0 2024-04-06T12:23:51.264 INFO:tasks.workunit.client.0.smithi152.stdout:2/457: symlink d0/d15/d24/d3d/l94 0 2024-04-06T12:23:51.265 INFO:tasks.workunit.client.0.smithi152.stdout:0/455: mkdir d4/d31/d47/d89 0 2024-04-06T12:23:51.265 INFO:tasks.workunit.client.0.smithi152.stdout:1/316: creat d2/d61/f73 x:0 0 0 2024-04-06T12:23:51.269 INFO:tasks.workunit.client.0.smithi152.stdout:0/456: mkdir d4/de/d28/d18/d43/d8a 0 2024-04-06T12:23:51.270 INFO:tasks.workunit.client.0.smithi152.stdout:4/465: link d7/d16/d22/l27 d7/d16/l9b 0 2024-04-06T12:23:51.271 INFO:tasks.workunit.client.0.smithi152.stdout:0/457: chown d4/de/d28/d18/d43/l55 148441780 1 2024-04-06T12:23:51.271 INFO:tasks.workunit.client.0.smithi152.stdout:1/317: symlink d2/d1d/d21/l74 0 2024-04-06T12:23:51.271 INFO:tasks.workunit.client.0.smithi152.stdout:4/466: truncate d7/d29/d2e/f9a 852314 0 2024-04-06T12:23:51.272 INFO:tasks.workunit.client.0.smithi152.stdout:0/458: read d4/de/d28/d18/d3b/d2e/f4b [2678147,24253] 0 2024-04-06T12:23:51.273 INFO:tasks.workunit.client.0.smithi152.stdout:4/467: dread d7/d16/f96 [0,4194304] 0 2024-04-06T12:23:51.276 INFO:tasks.workunit.client.0.smithi152.stdout:4/468: mknod d7/c9c 0 2024-04-06T12:23:51.278 INFO:tasks.workunit.client.0.smithi152.stdout:1/318: dwrite d2/d1d/f2e [0,4194304] 0 2024-04-06T12:23:51.281 INFO:tasks.workunit.client.0.smithi152.stdout:4/469: mknod d7/d16/d22/d30/d60/c9d 0 2024-04-06T12:23:51.287 INFO:tasks.workunit.client.0.smithi152.stdout:0/459: link d4/de/d4a/c4d d4/de/d28/d18/d3b/d2e/c8b 0 2024-04-06T12:23:51.287 INFO:tasks.workunit.client.0.smithi152.stdout:4/470: rename d7/d16/f20 to d7/d16/d22/d30/d60/f9e 0 2024-04-06T12:23:51.288 INFO:tasks.workunit.client.0.smithi152.stdout:4/471: chown d7/d16/d22/d3f 10539 1 2024-04-06T12:23:51.290 INFO:tasks.workunit.client.0.smithi152.stdout:1/319: unlink d2/d5d/c63 0 2024-04-06T12:23:51.291 INFO:tasks.workunit.client.0.smithi152.stdout:1/320: chown d2/d61 5 1 2024-04-06T12:23:51.293 INFO:tasks.workunit.client.0.smithi152.stdout:0/460: mknod d4/de/d28/d18/d43/d81/c8c 0 2024-04-06T12:23:51.295 INFO:tasks.workunit.client.0.smithi152.stdout:4/472: truncate d7/d16/d22/d30/f43 3088023 0 2024-04-06T12:23:51.299 INFO:tasks.workunit.client.0.smithi152.stdout:1/321: dwrite d2/d1d/d3b/f56 [0,4194304] 0 2024-04-06T12:23:51.302 INFO:tasks.workunit.client.0.smithi152.stdout:0/461: getdents d4/de/d87 0 2024-04-06T12:23:51.304 INFO:tasks.workunit.client.0.smithi152.stdout:0/462: chown d4/c1b 1327449 1 2024-04-06T12:23:51.322 INFO:tasks.workunit.client.0.smithi152.stdout:0/463: dread d4/d31/f34 [4194304,4194304] 0 2024-04-06T12:23:51.327 INFO:tasks.workunit.client.0.smithi152.stdout:0/464: getdents d4/de/d28/d18/d3b 0 2024-04-06T12:23:51.333 INFO:tasks.workunit.client.0.smithi152.stdout:0/465: dwrite d4/de/d28/d18/d3b/d2e/d78/f79 [0,4194304] 0 2024-04-06T12:23:51.339 INFO:tasks.workunit.client.0.smithi152.stdout:0/466: mkdir d4/d36/d72/d7c/d8d 0 2024-04-06T12:23:51.348 INFO:tasks.workunit.client.0.smithi152.stdout:8/389: dwrite d4/db/f13 [0,4194304] 0 2024-04-06T12:23:51.353 INFO:tasks.workunit.client.0.smithi152.stdout:8/390: readlink d4/db/d32/l5a 0 2024-04-06T12:23:51.354 INFO:tasks.workunit.client.0.smithi152.stdout:8/391: stat d4/dc/f5b 0 2024-04-06T12:23:51.355 INFO:tasks.workunit.client.0.smithi152.stdout:8/392: stat d4/db/c5e 0 2024-04-06T12:23:51.360 INFO:tasks.workunit.client.0.smithi152.stdout:3/344: dwrite d0/d10/d45/f47 [0,4194304] 0 2024-04-06T12:23:51.362 INFO:tasks.workunit.client.0.smithi152.stdout:8/393: read d4/dc/d10/d51/f23 [1070969,54854] 0 2024-04-06T12:23:51.363 INFO:tasks.workunit.client.0.smithi152.stdout:8/394: readlink d4/dc/d10/d51/l1a 0 2024-04-06T12:23:51.365 INFO:tasks.workunit.client.0.smithi152.stdout:3/345: creat d0/d1f/d44/f69 x:0 0 0 2024-04-06T12:23:51.367 INFO:tasks.workunit.client.0.smithi152.stdout:3/346: truncate d0/d10/d1e/d39/f5f 4365075 0 2024-04-06T12:23:51.371 INFO:tasks.workunit.client.0.smithi152.stdout:8/395: dread d4/db/d2a/f3e [0,4194304] 0 2024-04-06T12:23:51.375 INFO:tasks.workunit.client.0.smithi152.stdout:8/396: rename d4/db/f22 to d4/db/d56/f86 0 2024-04-06T12:23:51.376 INFO:tasks.workunit.client.0.smithi152.stdout:4/473: write d7/d29/d7e/f67 [616828,68378] 0 2024-04-06T12:23:51.377 INFO:tasks.workunit.client.0.smithi152.stdout:1/322: truncate d2/f39 633058 0 2024-04-06T12:23:51.379 INFO:tasks.workunit.client.0.smithi152.stdout:8/397: mknod d4/db/d56/c87 0 2024-04-06T12:23:51.381 INFO:tasks.workunit.client.0.smithi152.stdout:1/323: rename d2/d2f/d45/l52 to d2/d2f/d54/d71/l75 0 2024-04-06T12:23:51.383 INFO:tasks.workunit.client.0.smithi152.stdout:4/474: link d7/d16/d22/d3f/f81 d7/d29/d2e/d7b/f9f 0 2024-04-06T12:23:51.384 INFO:tasks.workunit.client.0.smithi152.stdout:8/398: mkdir d4/db/d2a/d6e/d88 0 2024-04-06T12:23:51.385 INFO:tasks.workunit.client.0.smithi152.stdout:8/399: dread d4/dc/d10/d49/f64 [0,4194304] 0 2024-04-06T12:23:51.386 INFO:tasks.workunit.client.0.smithi152.stdout:8/400: chown f0 1917139410 1 2024-04-06T12:23:51.391 INFO:tasks.workunit.client.0.smithi152.stdout:4/475: rename d7/d16/d22/d3f/d47 to d7/d16/d55/da0 0 2024-04-06T12:23:51.397 INFO:tasks.workunit.client.0.smithi152.stdout:3/347: truncate d0/d10/d13/f32 1987545 0 2024-04-06T12:23:51.398 INFO:tasks.workunit.client.0.smithi152.stdout:4/476: mknod d7/d29/d7e/d59/ca1 0 2024-04-06T12:23:51.405 INFO:tasks.workunit.client.0.smithi152.stdout:1/324: creat d2/f76 x:0 0 0 2024-04-06T12:23:51.409 INFO:tasks.workunit.client.0.smithi152.stdout:1/325: creat d2/d2f/d45/f77 x:0 0 0 2024-04-06T12:23:51.410 INFO:tasks.workunit.client.0.smithi152.stdout:1/326: fsync d2/d2f/f65 0 2024-04-06T12:23:51.416 INFO:tasks.workunit.client.0.smithi152.stdout:1/327: write d2/f7 [4329712,102898] 0 2024-04-06T12:23:51.418 INFO:tasks.workunit.client.0.smithi152.stdout:4/477: rename d7/d29/d2e/d5b/f98 to d7/d16/d22/d3f/fa2 0 2024-04-06T12:23:51.419 INFO:tasks.workunit.client.0.smithi152.stdout:8/401: dwrite d4/dc/d10/f2d [0,4194304] 0 2024-04-06T12:23:51.423 INFO:tasks.workunit.client.0.smithi152.stdout:3/348: getdents d0/d2d 0 2024-04-06T12:23:51.425 INFO:tasks.workunit.client.0.smithi152.stdout:1/328: dwrite d2/d1d/d3b/f56 [0,4194304] 0 2024-04-06T12:23:51.432 INFO:tasks.workunit.client.0.smithi152.stdout:9/303: sync 2024-04-06T12:23:51.433 INFO:tasks.workunit.client.0.smithi152.stdout:8/402: creat d4/dc/d10/d55/f89 x:0 0 0 2024-04-06T12:23:51.434 INFO:tasks.workunit.client.0.smithi152.stdout:8/403: chown d4/dc/f40 32 1 2024-04-06T12:23:51.436 INFO:tasks.workunit.client.0.smithi152.stdout:4/478: dread d7/d29/d7e/d59/f62 [0,4194304] 0 2024-04-06T12:23:51.437 INFO:tasks.workunit.client.0.smithi152.stdout:3/349: mkdir d0/d10/d13/d2a/d4b/d6a 0 2024-04-06T12:23:51.438 INFO:tasks.workunit.client.0.smithi152.stdout:3/350: chown d0/d10/d1e 1 1 2024-04-06T12:23:51.439 INFO:tasks.workunit.client.0.smithi152.stdout:1/329: mknod d2/d1d/d21/d28/c78 0 2024-04-06T12:23:51.441 INFO:tasks.workunit.client.0.smithi152.stdout:1/330: stat d2/d2f/d45/c66 0 2024-04-06T12:23:51.441 INFO:tasks.workunit.client.0.smithi152.stdout:3/351: write d0/ff [1666618,21619] 0 2024-04-06T12:23:51.445 INFO:tasks.workunit.client.0.smithi152.stdout:4/479: dwrite d7/d29/d7e/f93 [0,4194304] 0 2024-04-06T12:23:51.448 INFO:tasks.workunit.client.0.smithi152.stdout:9/304: rmdir d5/d39/d3f/d42/d5f/d17/d37 39 2024-04-06T12:23:51.448 INFO:tasks.workunit.client.0.smithi152.stdout:1/331: dread d2/d1d/f23 [0,4194304] 0 2024-04-06T12:23:51.453 INFO:tasks.workunit.client.0.smithi152.stdout:3/352: creat d0/d10/d45/f6b x:0 0 0 2024-04-06T12:23:51.457 INFO:tasks.workunit.client.0.smithi152.stdout:1/332: fdatasync d2/f16 0 2024-04-06T12:23:51.459 INFO:tasks.workunit.client.0.smithi152.stdout:8/404: mknod d4/d2c/d2b/d83/c8a 0 2024-04-06T12:23:51.464 INFO:tasks.workunit.client.0.smithi152.stdout:4/480: symlink d7/d16/d22/d88/la3 0 2024-04-06T12:23:51.466 INFO:tasks.workunit.client.0.smithi152.stdout:8/405: creat d4/db/d2a/d6e/f8b x:0 0 0 2024-04-06T12:23:51.469 INFO:tasks.workunit.client.0.smithi152.stdout:9/305: rename d5/d39/d3f/d42/d5f/d17/d23/d2d/d32/d36/f4c to d5/d39/d3f/d42/d5f/d17/d37/f61 0 2024-04-06T12:23:51.470 INFO:tasks.workunit.client.0.smithi152.stdout:3/353: symlink d0/l6c 0 2024-04-06T12:23:51.471 INFO:tasks.workunit.client.0.smithi152.stdout:1/333: getdents d2/d1d/d21/d28/d6a 0 2024-04-06T12:23:51.473 INFO:tasks.workunit.client.0.smithi152.stdout:3/354: write d0/d1f/f60 [112017,45668] 0 2024-04-06T12:23:51.473 INFO:tasks.workunit.client.0.smithi152.stdout:8/406: dwrite d4/f9 [8388608,4194304] 0 2024-04-06T12:23:51.478 INFO:tasks.workunit.client.0.smithi152.stdout:4/481: mknod d7/d29/d7e/ca4 0 2024-04-06T12:23:51.479 INFO:tasks.workunit.client.0.smithi152.stdout:9/306: write d5/d6/f16 [3580923,17795] 0 2024-04-06T12:23:51.483 INFO:tasks.workunit.client.0.smithi152.stdout:1/334: dwrite d2/f11 [0,4194304] 0 2024-04-06T12:23:51.483 INFO:tasks.workunit.client.0.smithi152.stdout:4/482: fsync d7/d16/f96 0 2024-04-06T12:23:51.483 INFO:tasks.workunit.client.0.smithi152.stdout:8/407: getdents d4/d81 0 2024-04-06T12:23:51.485 INFO:tasks.workunit.client.0.smithi152.stdout:4/483: chown d7/d16/l4d 6 1 2024-04-06T12:23:51.485 INFO:tasks.workunit.client.0.smithi152.stdout:8/408: write d4/db/d39/f50 [1943390,125467] 0 2024-04-06T12:23:51.488 INFO:tasks.workunit.client.0.smithi152.stdout:4/484: write d7/d29/d7e/f86 [3343059,127478] 0 2024-04-06T12:23:51.488 INFO:tasks.workunit.client.0.smithi152.stdout:9/307: truncate d5/d6/f7 1205295 0 2024-04-06T12:23:51.499 INFO:tasks.workunit.client.0.smithi152.stdout:3/355: write d0/d10/d1e/f46 [1177178,118314] 0 2024-04-06T12:23:51.506 INFO:tasks.workunit.client.0.smithi152.stdout:9/308: symlink d5/d39/d3f/d42/d5f/d17/d23/l62 0 2024-04-06T12:23:51.507 INFO:tasks.workunit.client.0.smithi152.stdout:3/356: fdatasync d0/d1f/d4a/f54 0 2024-04-06T12:23:51.509 INFO:tasks.workunit.client.0.smithi152.stdout:1/335: write d2/d1d/f2d [3950702,85728] 0 2024-04-06T12:23:51.510 INFO:tasks.workunit.client.0.smithi152.stdout:8/409: write d4/d2c/d2b/f44 [580135,129757] 0 2024-04-06T12:23:51.513 INFO:tasks.workunit.client.0.smithi152.stdout:3/357: creat d0/d10/d13/f6d x:0 0 0 2024-04-06T12:23:51.514 INFO:tasks.workunit.client.0.smithi152.stdout:4/485: link d7/d16/d55/da0/l4e d7/d16/d22/d30/la5 0 2024-04-06T12:23:51.518 INFO:tasks.workunit.client.0.smithi152.stdout:8/410: mknod d4/d81/c8c 0 2024-04-06T12:23:51.519 INFO:tasks.workunit.client.0.smithi152.stdout:8/411: dread - d4/db/d2a/f7d zero size 2024-04-06T12:23:51.520 INFO:tasks.workunit.client.0.smithi152.stdout:8/412: chown d4/d2c/d54/f5d 27352841 1 2024-04-06T12:23:51.521 INFO:tasks.workunit.client.0.smithi152.stdout:1/336: getdents d2/d2f/d45 0 2024-04-06T12:23:51.522 INFO:tasks.workunit.client.0.smithi152.stdout:1/337: truncate d2/d2f/d37/f4a 1129397 0 2024-04-06T12:23:51.523 INFO:tasks.workunit.client.0.smithi152.stdout:4/486: creat d7/d16/d22/d3f/fa6 x:0 0 0 2024-04-06T12:23:51.524 INFO:tasks.workunit.client.0.smithi152.stdout:1/338: read d2/f7 [5357847,112922] 0 2024-04-06T12:23:51.524 INFO:tasks.workunit.client.0.smithi152.stdout:4/487: read d7/f2a [390621,5182] 0 2024-04-06T12:23:51.526 INFO:tasks.workunit.client.0.smithi152.stdout:3/358: dread d0/fb [0,4194304] 0 2024-04-06T12:23:51.532 INFO:tasks.workunit.client.0.smithi152.stdout:4/488: unlink d7/d29/d2e/l63 0 2024-04-06T12:23:51.533 INFO:tasks.workunit.client.0.smithi152.stdout:8/413: creat d4/dc/d10/d74/f8d x:0 0 0 2024-04-06T12:23:51.533 INFO:tasks.workunit.client.0.smithi152.stdout:4/489: write d7/d29/d7e/d59/f76 [616038,118386] 0 2024-04-06T12:23:51.534 INFO:tasks.workunit.client.0.smithi152.stdout:8/414: chown d4/db/d2a/d6e/d88 2 1 2024-04-06T12:23:51.536 INFO:tasks.workunit.client.0.smithi152.stdout:1/339: mknod d2/d5d/d6d/c79 0 2024-04-06T12:23:51.538 INFO:tasks.workunit.client.0.smithi152.stdout:1/340: write d2/d2f/d37/f5f [274168,116157] 0 2024-04-06T12:23:51.539 INFO:tasks.workunit.client.0.smithi152.stdout:8/415: dread d4/dc/fd [0,4194304] 0 2024-04-06T12:23:51.541 INFO:tasks.workunit.client.0.smithi152.stdout:4/490: rename d7/d16/f1a to d7/d16/d55/fa7 0 2024-04-06T12:23:51.541 INFO:tasks.workunit.client.0.smithi152.stdout:8/416: read d4/db/d39/f76 [50827,1988] 0 2024-04-06T12:23:51.542 INFO:tasks.workunit.client.0.smithi152.stdout:1/341: write d2/f7 [5135854,9744] 0 2024-04-06T12:23:51.544 INFO:tasks.workunit.client.0.smithi152.stdout:3/359: link d0/d1f/c42 d0/d1f/d28/c6e 0 2024-04-06T12:23:51.547 INFO:tasks.workunit.client.0.smithi152.stdout:8/417: mknod d4/dc/d10/d55/c8e 0 2024-04-06T12:23:51.548 INFO:tasks.workunit.client.0.smithi152.stdout:1/342: symlink d2/d2f/d54/d71/l7a 0 2024-04-06T12:23:51.549 INFO:tasks.workunit.client.0.smithi152.stdout:1/343: fsync d2/f58 0 2024-04-06T12:23:51.549 INFO:tasks.workunit.client.0.smithi152.stdout:1/344: chown d2/d1d/d21/d28 0 1 2024-04-06T12:23:51.550 INFO:tasks.workunit.client.0.smithi152.stdout:1/345: chown d2/c3d 255 1 2024-04-06T12:23:51.551 INFO:tasks.workunit.client.0.smithi152.stdout:4/491: symlink d7/d16/d22/d3f/la8 0 2024-04-06T12:23:51.552 INFO:tasks.workunit.client.0.smithi152.stdout:3/360: creat d0/d10/d13/f6f x:0 0 0 2024-04-06T12:23:51.553 INFO:tasks.workunit.client.0.smithi152.stdout:3/361: fdatasync d0/d10/d13/f6d 0 2024-04-06T12:23:51.556 INFO:tasks.workunit.client.0.smithi152.stdout:1/346: symlink d2/d5d/l7b 0 2024-04-06T12:23:51.559 INFO:tasks.workunit.client.0.smithi152.stdout:4/492: creat d7/d16/d55/da0/fa9 x:0 0 0 2024-04-06T12:23:51.560 INFO:tasks.workunit.client.0.smithi152.stdout:3/362: rename d0/d10/d13/d2a/f59 to d0/d10/d13/f70 0 2024-04-06T12:23:51.560 INFO:tasks.workunit.client.0.smithi152.stdout:4/493: write d7/d29/d7e/d59/f76 [1108837,36219] 0 2024-04-06T12:23:51.568 INFO:tasks.workunit.client.0.smithi152.stdout:4/494: write d7/fb [2855301,125027] 0 2024-04-06T12:23:51.568 INFO:tasks.workunit.client.0.smithi152.stdout:8/418: link d4/dc/f25 d4/dc/d10/d51/f8f 0 2024-04-06T12:23:51.660 INFO:tasks.workunit.client.0.smithi152.stdout:3/363: mkdir d0/d10/d1e/d71 0 2024-04-06T12:23:51.661 INFO:tasks.workunit.client.0.smithi152.stdout:3/364: chown d0/f3c 16392190 1 2024-04-06T12:23:51.667 INFO:tasks.workunit.client.0.smithi152.stdout:7/345: sync 2024-04-06T12:23:51.668 INFO:tasks.workunit.client.0.smithi152.stdout:5/355: sync 2024-04-06T12:23:51.668 INFO:tasks.workunit.client.0.smithi152.stdout:6/414: sync 2024-04-06T12:23:51.668 INFO:tasks.workunit.client.0.smithi152.stdout:6/415: fsync d7/f1e 0 2024-04-06T12:23:51.669 INFO:tasks.workunit.client.0.smithi152.stdout:8/419: unlink d4/dc/d10/d18/c46 0 2024-04-06T12:23:51.688 INFO:tasks.workunit.client.0.smithi152.stdout:1/347: rename d2/d1d/d21/d28/d6a to d2/d1d/d7c 0 2024-04-06T12:23:51.690 INFO:tasks.workunit.client.0.smithi152.stdout:6/416: rmdir d7/d9/d26/d4a 39 2024-04-06T12:23:51.691 INFO:tasks.workunit.client.0.smithi152.stdout:6/417: readlink d7/d9/l6a 0 2024-04-06T12:23:51.692 INFO:tasks.workunit.client.0.smithi152.stdout:8/420: symlink d4/dc/l90 0 2024-04-06T12:23:51.693 INFO:tasks.workunit.client.0.smithi152.stdout:8/421: chown d4/dc/f1f 386 1 2024-04-06T12:23:51.694 INFO:tasks.workunit.client.0.smithi152.stdout:8/422: write d4/dc/d10/d74/f8d [583033,29657] 0 2024-04-06T12:23:51.695 INFO:tasks.workunit.client.0.smithi152.stdout:1/348: write d2/d2f/d54/f57 [61461,60416] 0 2024-04-06T12:23:51.696 INFO:tasks.workunit.client.0.smithi152.stdout:5/356: symlink d3/l70 0 2024-04-06T12:23:51.699 INFO:tasks.workunit.client.0.smithi152.stdout:8/423: dread d4/db/f13 [0,4194304] 0 2024-04-06T12:23:51.700 INFO:tasks.workunit.client.0.smithi152.stdout:6/418: unlink d7/d19/d1b/d1f/f4c 0 2024-04-06T12:23:51.700 INFO:tasks.workunit.client.0.smithi152.stdout:8/424: chown d4/dc/d10/d51/l1b 7 1 2024-04-06T12:23:51.702 INFO:tasks.workunit.client.0.smithi152.stdout:3/365: rename d0/d35/l3e to d0/d2d/l72 0 2024-04-06T12:23:51.703 INFO:tasks.workunit.client.0.smithi152.stdout:3/366: read - d0/d1f/d44/f69 zero size 2024-04-06T12:23:51.705 INFO:tasks.workunit.client.0.smithi152.stdout:1/349: write d2/f1b [8856040,6888] 0 2024-04-06T12:23:51.706 INFO:tasks.workunit.client.0.smithi152.stdout:1/350: write d2/d2f/d37/f4f [835041,113342] 0 2024-04-06T12:23:51.706 INFO:tasks.workunit.client.0.smithi152.stdout:5/357: fsync d3/da/d15/d40/d4f/f66 0 2024-04-06T12:23:51.707 INFO:tasks.workunit.client.0.smithi152.stdout:1/351: fdatasync d2/f11 0 2024-04-06T12:23:51.708 INFO:tasks.workunit.client.0.smithi152.stdout:8/425: mkdir d4/dc/d10/d55/d91 0 2024-04-06T12:23:51.709 INFO:tasks.workunit.client.0.smithi152.stdout:5/358: chown d3/da/d15/d2b/d3f/d4c/f67 698 1 2024-04-06T12:23:51.710 INFO:tasks.workunit.client.0.smithi152.stdout:6/419: rename d7/d9/d26/c7a to d7/d19/d3e/c90 0 2024-04-06T12:23:51.712 INFO:tasks.workunit.client.0.smithi152.stdout:3/367: mknod d0/d35/d43/c73 0 2024-04-06T12:23:51.714 INFO:tasks.workunit.client.0.smithi152.stdout:1/352: mkdir d2/d5d/d6d/d7d 0 2024-04-06T12:23:51.715 INFO:tasks.workunit.client.0.smithi152.stdout:1/353: chown d2/d1d/d21/f34 14916426 1 2024-04-06T12:23:51.717 INFO:tasks.workunit.client.0.smithi152.stdout:8/426: mkdir d4/d81/d92 0 2024-04-06T12:23:51.721 INFO:tasks.workunit.client.0.smithi152.stdout:3/368: creat d0/d1f/d28/f74 x:0 0 0 2024-04-06T12:23:51.722 INFO:tasks.workunit.client.0.smithi152.stdout:7/346: truncate d8/df/f25 2052373 0 2024-04-06T12:23:51.723 INFO:tasks.workunit.client.0.smithi152.stdout:7/347: read d8/df/d61/d3d/f39 [1373195,2804] 0 2024-04-06T12:23:51.724 INFO:tasks.workunit.client.0.smithi152.stdout:7/348: dread - d8/df/d34/f67 zero size 2024-04-06T12:23:51.725 INFO:tasks.workunit.client.0.smithi152.stdout:3/369: dread d0/fb [0,4194304] 0 2024-04-06T12:23:51.725 INFO:tasks.workunit.client.0.smithi152.stdout:7/349: chown d8/l5d 120 1 2024-04-06T12:23:51.727 INFO:tasks.workunit.client.0.smithi152.stdout:3/370: write d0/d10/d45/f6b [226522,113356] 0 2024-04-06T12:23:51.732 INFO:tasks.workunit.client.0.smithi152.stdout:8/427: mknod d4/db/c93 0 2024-04-06T12:23:51.736 INFO:tasks.workunit.client.0.smithi152.stdout:5/359: write d3/da/d15/f1c [4531551,76625] 0 2024-04-06T12:23:51.738 INFO:tasks.workunit.client.0.smithi152.stdout:6/420: write d7/d9/d26/f52 [777487,109601] 0 2024-04-06T12:23:51.743 INFO:tasks.workunit.client.0.smithi152.stdout:7/350: mknod d8/df/d28/d75/c77 0 2024-04-06T12:23:51.747 INFO:tasks.workunit.client.0.smithi152.stdout:8/428: dread d4/dc/d10/d18/f26 [0,4194304] 0 2024-04-06T12:23:51.747 INFO:tasks.workunit.client.0.smithi152.stdout:5/360: rename d3/d9/f2a to d3/da/f71 0 2024-04-06T12:23:51.748 INFO:tasks.workunit.client.0.smithi152.stdout:5/361: stat d3/da/d15/d40/d50/l41 0 2024-04-06T12:23:51.749 INFO:tasks.workunit.client.0.smithi152.stdout:1/354: getdents d2/d5d 0 2024-04-06T12:23:51.752 INFO:tasks.workunit.client.0.smithi152.stdout:3/371: write d0/d10/d13/f32 [691029,91176] 0 2024-04-06T12:23:51.752 INFO:tasks.workunit.client.0.smithi152.stdout:7/351: readlink d8/df/d61/l2f 0 2024-04-06T12:23:51.755 INFO:tasks.workunit.client.0.smithi152.stdout:7/352: write d8/d2a/d42/f4c [1725759,1567] 0 2024-04-06T12:23:51.755 INFO:tasks.workunit.client.0.smithi152.stdout:5/362: dread d3/f5a [0,4194304] 0 2024-04-06T12:23:51.756 INFO:tasks.workunit.client.0.smithi152.stdout:1/355: dread - d2/f50 zero size 2024-04-06T12:23:51.759 INFO:tasks.workunit.client.0.smithi152.stdout:5/363: chown d3/da/d53 1742 1 2024-04-06T12:23:51.760 INFO:tasks.workunit.client.0.smithi152.stdout:7/353: stat d8/df/d61/d3d/c5b 0 2024-04-06T12:23:51.761 INFO:tasks.workunit.client.0.smithi152.stdout:8/429: dwrite d4/db/d2a/f7d [0,4194304] 0 2024-04-06T12:23:51.771 INFO:tasks.workunit.client.0.smithi152.stdout:2/458: sync 2024-04-06T12:23:51.771 INFO:tasks.workunit.client.0.smithi152.stdout:0/467: sync 2024-04-06T12:23:51.776 INFO:tasks.workunit.client.0.smithi152.stdout:6/421: dwrite d7/d9/d26/d4a/f32 [0,4194304] 0 2024-04-06T12:23:51.777 INFO:tasks.workunit.client.0.smithi152.stdout:8/430: link d4/dc/c31 d4/db/d2a/d6e/d88/c94 0 2024-04-06T12:23:51.780 INFO:tasks.workunit.client.0.smithi152.stdout:8/431: write d4/dc/d10/d49/f70 [640032,60353] 0 2024-04-06T12:23:51.783 INFO:tasks.workunit.client.0.smithi152.stdout:2/459: truncate d0/f43 811647 0 2024-04-06T12:23:51.784 INFO:tasks.workunit.client.0.smithi152.stdout:0/468: getdents d4/de/d28/d18/d3b 0 2024-04-06T12:23:51.787 INFO:tasks.workunit.client.0.smithi152.stdout:1/356: truncate d2/d2f/d37/f49 35449 0 2024-04-06T12:23:51.789 INFO:tasks.workunit.client.0.smithi152.stdout:8/432: mknod d4/c95 0 2024-04-06T12:23:51.790 INFO:tasks.workunit.client.0.smithi152.stdout:3/372: dread d0/d10/d1e/f1d [0,4194304] 0 2024-04-06T12:23:51.791 INFO:tasks.workunit.client.0.smithi152.stdout:7/354: dread d8/df/d61/d17/d2c/f38 [0,4194304] 0 2024-04-06T12:23:51.792 INFO:tasks.workunit.client.0.smithi152.stdout:0/469: mkdir d4/d6e/d8e 0 2024-04-06T12:23:51.794 INFO:tasks.workunit.client.0.smithi152.stdout:0/470: fdatasync d4/de/d87/f77 0 2024-04-06T12:23:51.798 INFO:tasks.workunit.client.0.smithi152.stdout:1/357: dread d2/f39 [0,4194304] 0 2024-04-06T12:23:51.803 INFO:tasks.workunit.client.0.smithi152.stdout:8/433: rename d4/f77 to d4/d5f/f96 0 2024-04-06T12:23:51.804 INFO:tasks.workunit.client.0.smithi152.stdout:0/471: dwrite d4/d31/d47/d51/f6f [0,4194304] 0 2024-04-06T12:23:51.805 INFO:tasks.workunit.client.0.smithi152.stdout:5/364: dread d3/da/f29 [0,4194304] 0 2024-04-06T12:23:51.807 INFO:tasks.workunit.client.0.smithi152.stdout:0/472: stat d4/d36/d72 0 2024-04-06T12:23:51.807 INFO:tasks.workunit.client.0.smithi152.stdout:7/355: truncate d8/df/d4a/f64 975876 0 2024-04-06T12:23:51.808 INFO:tasks.workunit.client.0.smithi152.stdout:3/373: mkdir d0/d35/d75 0 2024-04-06T12:23:51.815 INFO:tasks.workunit.client.0.smithi152.stdout:0/473: rename d4/d6e/f76 to d4/de/d87/f8f 0 2024-04-06T12:23:51.815 INFO:tasks.workunit.client.0.smithi152.stdout:2/460: dread d0/d2/f21 [0,4194304] 0 2024-04-06T12:23:51.817 INFO:tasks.workunit.client.0.smithi152.stdout:5/365: rename d3 to d3/da/d15/d40/d46/d72 22 2024-04-06T12:23:51.817 INFO:tasks.workunit.client.0.smithi152.stdout:0/474: chown d4/d31/d47/d51/f6c 70458 1 2024-04-06T12:23:51.818 INFO:tasks.workunit.client.0.smithi152.stdout:2/461: fsync d0/d15/d24/d3d/f6a 0 2024-04-06T12:23:51.819 INFO:tasks.workunit.client.0.smithi152.stdout:3/374: dread d0/fb [0,4194304] 0 2024-04-06T12:23:51.820 INFO:tasks.workunit.client.0.smithi152.stdout:3/375: stat d0/d1f/d28/c38 0 2024-04-06T12:23:51.823 INFO:tasks.workunit.client.0.smithi152.stdout:0/475: write d4/de/d28/f66 [882171,90993] 0 2024-04-06T12:23:51.827 INFO:tasks.workunit.client.0.smithi152.stdout:5/366: rename d3/de/c3e to d3/da/d15/d40/d4f/d5f/c73 0 2024-04-06T12:23:51.829 INFO:tasks.workunit.client.0.smithi152.stdout:5/367: truncate d3/da/f13 5959664 0 2024-04-06T12:23:51.830 INFO:tasks.workunit.client.0.smithi152.stdout:7/356: getdents d8/df/d61/d17/d2c/d66 0 2024-04-06T12:23:51.835 INFO:tasks.workunit.client.0.smithi152.stdout:0/476: dwrite d4/de/f30 [0,4194304] 0 2024-04-06T12:23:51.840 INFO:tasks.workunit.client.0.smithi152.stdout:3/376: rename d0/f3c to d0/d1f/d28/f76 0 2024-04-06T12:23:51.840 INFO:tasks.workunit.client.0.smithi152.stdout:2/462: rmdir d0/d40/d41 39 2024-04-06T12:23:51.841 INFO:tasks.workunit.client.0.smithi152.stdout:1/358: dwrite d2/ff [0,4194304] 0 2024-04-06T12:23:51.845 INFO:tasks.workunit.client.0.smithi152.stdout:5/368: creat d3/da/d15/d40/d46/f74 x:0 0 0 2024-04-06T12:23:51.850 INFO:tasks.workunit.client.0.smithi152.stdout:3/377: rename d0/d2d/c57 to d0/d2d/c77 0 2024-04-06T12:23:51.854 INFO:tasks.workunit.client.0.smithi152.stdout:0/477: dread d4/de/d28/f22 [0,4194304] 0 2024-04-06T12:23:51.858 INFO:tasks.workunit.client.0.smithi152.stdout:1/359: rename l0 to d2/d5d/d6d/l7e 0 2024-04-06T12:23:51.859 INFO:tasks.workunit.client.0.smithi152.stdout:5/369: rmdir d3/da/d15/d40/d4e 39 2024-04-06T12:23:51.860 INFO:tasks.workunit.client.0.smithi152.stdout:5/370: chown d3/d37/f56 31 1 2024-04-06T12:23:51.863 INFO:tasks.workunit.client.0.smithi152.stdout:3/378: creat d0/d2d/f78 x:0 0 0 2024-04-06T12:23:51.864 INFO:tasks.workunit.client.0.smithi152.stdout:0/478: creat d4/d36/f90 x:0 0 0 2024-04-06T12:23:51.865 INFO:tasks.workunit.client.0.smithi152.stdout:3/379: write d0/d1f/d28/f74 [599048,83941] 0 2024-04-06T12:23:51.867 INFO:tasks.workunit.client.0.smithi152.stdout:3/380: write d0/d10/d1e/f46 [212696,27082] 0 2024-04-06T12:23:51.870 INFO:tasks.workunit.client.0.smithi152.stdout:3/381: read d0/d1f/d28/f76 [1134267,96308] 0 2024-04-06T12:23:51.871 INFO:tasks.workunit.client.0.smithi152.stdout:3/382: chown d0/d2d/f78 59577 1 2024-04-06T12:23:51.875 INFO:tasks.workunit.client.0.smithi152.stdout:5/371: dread d3/da/d15/d2b/d3f/d4c/f67 [0,4194304] 0 2024-04-06T12:23:51.876 INFO:tasks.workunit.client.0.smithi152.stdout:5/372: stat d3/de/l33 0 2024-04-06T12:23:51.877 INFO:tasks.workunit.client.0.smithi152.stdout:7/357: getdents d8/d2a 0 2024-04-06T12:23:51.877 INFO:tasks.workunit.client.0.smithi152.stdout:7/358: stat d8/df/d28/d41/d48 0 2024-04-06T12:23:51.878 INFO:tasks.workunit.client.0.smithi152.stdout:1/360: write d2/f13 [727415,93397] 0 2024-04-06T12:23:51.882 INFO:tasks.workunit.client.0.smithi152.stdout:0/479: creat d4/de/d28/d18/d43/d81/f91 x:0 0 0 2024-04-06T12:23:51.884 INFO:tasks.workunit.client.0.smithi152.stdout:5/373: dwrite d3/de/f5b [0,4194304] 0 2024-04-06T12:23:51.886 INFO:tasks.workunit.client.0.smithi152.stdout:2/463: getdents d0/d15/d24/d79 0 2024-04-06T12:23:51.887 INFO:tasks.workunit.client.0.smithi152.stdout:3/383: write d0/d10/d1e/f1d [822060,34937] 0 2024-04-06T12:23:51.891 INFO:tasks.workunit.client.0.smithi152.stdout:7/359: dread d8/d2a/d37/f47 [0,4194304] 0 2024-04-06T12:23:51.894 INFO:tasks.workunit.client.0.smithi152.stdout:1/361: dwrite d2/d2f/d45/f62 [0,4194304] 0 2024-04-06T12:23:51.894 INFO:tasks.workunit.client.0.smithi152.stdout:3/384: chown d0/d10/d45/f6b 407655 1 2024-04-06T12:23:51.899 INFO:tasks.workunit.client.0.smithi152.stdout:5/374: creat d3/da/d15/d40/d46/f75 x:0 0 0 2024-04-06T12:23:51.900 INFO:tasks.workunit.client.0.smithi152.stdout:5/375: write d3/da/f13 [2608413,69248] 0 2024-04-06T12:23:51.902 INFO:tasks.workunit.client.0.smithi152.stdout:7/360: unlink d8/df/d61/f3c 0 2024-04-06T12:23:51.904 INFO:tasks.workunit.client.0.smithi152.stdout:0/480: dwrite d4/f2b [0,4194304] 0 2024-04-06T12:23:51.904 INFO:tasks.workunit.client.0.smithi152.stdout:1/362: fsync d2/f50 0 2024-04-06T12:23:51.904 INFO:tasks.workunit.client.0.smithi152.stdout:5/376: write d3/da/d53/f60 [346049,22213] 0 2024-04-06T12:23:51.908 INFO:tasks.workunit.client.0.smithi152.stdout:3/385: dread d0/d10/d1e/d39/f5f [0,4194304] 0 2024-04-06T12:23:51.915 INFO:tasks.workunit.client.0.smithi152.stdout:7/361: fdatasync d8/df/d61/d17/f1a 0 2024-04-06T12:23:51.915 INFO:tasks.workunit.client.0.smithi152.stdout:7/362: chown d8/df/d61/fe 1872865505 1 2024-04-06T12:23:51.917 INFO:tasks.workunit.client.0.smithi152.stdout:5/377: creat d3/d37/f76 x:0 0 0 2024-04-06T12:23:51.923 INFO:tasks.workunit.client.0.smithi152.stdout:1/363: creat d2/d2f/d54/f7f x:0 0 0 2024-04-06T12:23:51.925 INFO:tasks.workunit.client.0.smithi152.stdout:7/363: dread d8/df/d61/d17/f1a [0,4194304] 0 2024-04-06T12:23:51.932 INFO:tasks.workunit.client.0.smithi152.stdout:7/364: write d8/df/d61/f13 [3269162,39474] 0 2024-04-06T12:23:51.932 INFO:tasks.workunit.client.0.smithi152.stdout:8/434: sync 2024-04-06T12:23:51.932 INFO:tasks.workunit.client.0.smithi152.stdout:4/495: sync 2024-04-06T12:23:51.932 INFO:tasks.workunit.client.0.smithi152.stdout:9/309: sync 2024-04-06T12:23:51.933 INFO:tasks.workunit.client.0.smithi152.stdout:6/422: sync 2024-04-06T12:23:51.934 INFO:tasks.workunit.client.0.smithi152.stdout:6/423: chown f3 108108 1 2024-04-06T12:23:51.937 INFO:tasks.workunit.client.0.smithi152.stdout:5/378: dread d3/da/fc [0,4194304] 0 2024-04-06T12:23:51.937 INFO:tasks.workunit.client.0.smithi152.stdout:6/424: write d7/fb [1329001,104343] 0 2024-04-06T12:23:51.938 INFO:tasks.workunit.client.0.smithi152.stdout:0/481: getdents d4/de/d28/d18/d43 0 2024-04-06T12:23:51.943 INFO:tasks.workunit.client.0.smithi152.stdout:9/310: dwrite d5/d6/f49 [4194304,4194304] 0 2024-04-06T12:23:51.944 INFO:tasks.workunit.client.0.smithi152.stdout:9/311: chown d5/d6 29613 1 2024-04-06T12:23:51.949 INFO:tasks.workunit.client.0.smithi152.stdout:3/386: truncate d0/d1f/f23 618306 0 2024-04-06T12:23:51.950 INFO:tasks.workunit.client.0.smithi152.stdout:3/387: write d0/d10/d13/f6f [326029,106561] 0 2024-04-06T12:23:51.950 INFO:tasks.workunit.client.0.smithi152.stdout:7/365: unlink d8/df/d61/d3d/c5b 0 2024-04-06T12:23:51.951 INFO:tasks.workunit.client.0.smithi152.stdout:6/425: mknod d7/d19/d1b/d1f/c91 0 2024-04-06T12:23:51.959 INFO:tasks.workunit.client.0.smithi152.stdout:6/426: rmdir d7/d19/d1b/d1f/d3d 39 2024-04-06T12:23:51.971 INFO:tasks.workunit.client.0.smithi152.stdout:3/388: creat d0/d10/d1e/d71/f79 x:0 0 0 2024-04-06T12:23:51.975 INFO:tasks.workunit.client.0.smithi152.stdout:9/312: creat d5/d6/f63 x:0 0 0 2024-04-06T12:23:51.977 INFO:tasks.workunit.client.0.smithi152.stdout:4/496: rename d7/l11 to d7/d16/d22/laa 0 2024-04-06T12:23:51.979 INFO:tasks.workunit.client.0.smithi152.stdout:3/389: dread d0/d10/d13/f32 [0,4194304] 0 2024-04-06T12:23:51.983 INFO:tasks.workunit.client.0.smithi152.stdout:7/366: dwrite d8/df/d61/d3d/f39 [0,4194304] 0 2024-04-06T12:23:51.985 INFO:tasks.workunit.client.0.smithi152.stdout:0/482: truncate d4/de/d28/d18/d3b/f2f 3261118 0 2024-04-06T12:23:51.987 INFO:tasks.workunit.client.0.smithi152.stdout:6/427: rename d7/fc to d7/d62/f92 0 2024-04-06T12:23:51.988 INFO:tasks.workunit.client.0.smithi152.stdout:3/390: mknod d0/d10/c7a 0 2024-04-06T12:23:51.989 INFO:tasks.workunit.client.0.smithi152.stdout:3/391: chown d0/c50 12257151 1 2024-04-06T12:23:51.993 INFO:tasks.workunit.client.0.smithi152.stdout:4/497: symlink d7/lab 0 2024-04-06T12:23:51.995 INFO:tasks.workunit.client.0.smithi152.stdout:6/428: dwrite d7/d19/f5e [0,4194304] 0 2024-04-06T12:23:51.998 INFO:tasks.workunit.client.0.smithi152.stdout:7/367: unlink d8/df/d61/d4b/f4e 0 2024-04-06T12:23:52.000 INFO:tasks.workunit.client.0.smithi152.stdout:0/483: creat d4/de/d28/d18/d3b/f92 x:0 0 0 2024-04-06T12:23:52.004 INFO:tasks.workunit.client.0.smithi152.stdout:3/392: dwrite d0/d10/d13/f6f [0,4194304] 0 2024-04-06T12:23:52.009 INFO:tasks.workunit.client.0.smithi152.stdout:3/393: truncate d0/d10/d13/f70 4739239 0 2024-04-06T12:23:52.010 INFO:tasks.workunit.client.0.smithi152.stdout:6/429: dwrite d7/d9/d26/f74 [0,4194304] 0 2024-04-06T12:23:52.011 INFO:tasks.workunit.client.0.smithi152.stdout:6/430: chown d7/d19/d1b/d31/d7c 7492463 1 2024-04-06T12:23:52.013 INFO:tasks.workunit.client.0.smithi152.stdout:6/431: dread d7/d19/d1b/d31/d35/f54 [0,4194304] 0 2024-04-06T12:23:52.015 INFO:tasks.workunit.client.0.smithi152.stdout:6/432: fdatasync d7/d19/d1b/d22/f76 0 2024-04-06T12:23:52.015 INFO:tasks.workunit.client.0.smithi152.stdout:7/368: creat d8/df/d61/d3d/d53/f78 x:0 0 0 2024-04-06T12:23:52.017 INFO:tasks.workunit.client.0.smithi152.stdout:6/433: truncate d7/d19/f8d 196290 0 2024-04-06T12:23:52.018 INFO:tasks.workunit.client.0.smithi152.stdout:3/394: unlink d0/d1f/d4a/l62 0 2024-04-06T12:23:52.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:50.749518+0000 mon.smithi152 (mon.0) 697 : cluster [DBG] mgrmap e25: smithi195.ausetj(active, since 93s), standbys: smithi152.lynahm 2024-04-06T12:23:52.027 INFO:tasks.workunit.client.0.smithi152.stdout:7/369: mkdir d8/d2a/d37/d79 0 2024-04-06T12:23:52.028 INFO:tasks.workunit.client.0.smithi152.stdout:0/484: dread d4/de/f1e [0,4194304] 0 2024-04-06T12:23:52.029 INFO:tasks.workunit.client.0.smithi152.stdout:0/485: chown d4/d31/c3e 6 1 2024-04-06T12:23:52.032 INFO:tasks.workunit.client.0.smithi152.stdout:6/434: unlink d7/d9/d26/d4a/c83 0 2024-04-06T12:23:52.033 INFO:tasks.workunit.client.0.smithi152.stdout:6/435: chown d7/d9/d26/d4a/d7b 31260 1 2024-04-06T12:23:52.034 INFO:tasks.workunit.client.0.smithi152.stdout:3/395: creat d0/d1f/d44/f7b x:0 0 0 2024-04-06T12:23:52.034 INFO:tasks.workunit.client.0.smithi152.stdout:3/396: fsync d0/d10/d13/f6f 0 2024-04-06T12:23:52.037 INFO:tasks.workunit.client.0.smithi152.stdout:4/498: getdents d7/d16/d22/d88 0 2024-04-06T12:23:52.041 INFO:tasks.workunit.client.0.smithi152.stdout:7/370: mkdir d8/df/d61/d17/d2c/d2d/d7a 0 2024-04-06T12:23:52.041 INFO:tasks.workunit.client.0.smithi152.stdout:7/371: dread - d8/df/d34/f67 zero size 2024-04-06T12:23:52.046 INFO:tasks.workunit.client.0.smithi152.stdout:6/436: truncate d7/d19/d1b/d1f/f2a 3359313 0 2024-04-06T12:23:52.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:50.749518+0000 mon.smithi152 (mon.0) 697 : cluster [DBG] mgrmap e25: smithi195.ausetj(active, since 93s), standbys: smithi152.lynahm 2024-04-06T12:23:52.050 INFO:tasks.workunit.client.0.smithi152.stdout:3/397: mkdir d0/d1f/d44/d7c 0 2024-04-06T12:23:52.054 INFO:tasks.workunit.client.0.smithi152.stdout:0/486: symlink d4/de/d7f/l93 0 2024-04-06T12:23:52.055 INFO:tasks.workunit.client.0.smithi152.stdout:7/372: dread d8/df/d28/f5a [0,4194304] 0 2024-04-06T12:23:52.057 INFO:tasks.workunit.client.0.smithi152.stdout:0/487: dread - d4/d36/f90 zero size 2024-04-06T12:23:52.058 INFO:tasks.workunit.client.0.smithi152.stdout:0/488: readlink d4/l6 0 2024-04-06T12:23:52.058 INFO:tasks.workunit.client.0.smithi152.stdout:3/398: dwrite d0/d10/d1e/d71/f79 [0,4194304] 0 2024-04-06T12:23:52.060 INFO:tasks.workunit.client.0.smithi152.stdout:6/437: mknod d7/d9/d26/d2e/c93 0 2024-04-06T12:23:52.061 INFO:tasks.workunit.client.0.smithi152.stdout:6/438: write d7/d9/d26/f52 [572558,11340] 0 2024-04-06T12:23:52.072 INFO:tasks.workunit.client.0.smithi152.stdout:0/489: rmdir d4/de/d28/d18/d3b 39 2024-04-06T12:23:52.076 INFO:tasks.workunit.client.0.smithi152.stdout:3/399: rename d0/d10/l3b to d0/d35/d43/l7d 0 2024-04-06T12:23:52.080 INFO:tasks.workunit.client.0.smithi152.stdout:3/400: dread d0/d10/d13/f6f [0,4194304] 0 2024-04-06T12:23:52.082 INFO:tasks.workunit.client.0.smithi152.stdout:7/373: mkdir d8/d2a/d37/d49/d7b 0 2024-04-06T12:23:52.087 INFO:tasks.workunit.client.0.smithi152.stdout:0/490: rename d4/d31/d47/d51 to d4/de/d87/d94 0 2024-04-06T12:23:52.098 INFO:tasks.workunit.client.0.smithi152.stdout:6/439: rmdir d7/d9/d26/d2e 39 2024-04-06T12:23:52.098 INFO:tasks.workunit.client.0.smithi152.stdout:4/499: write d7/d16/d55/fa7 [1174927,61780] 0 2024-04-06T12:23:52.101 INFO:tasks.workunit.client.0.smithi152.stdout:4/500: read d7/d29/d78/f7c [498919,93913] 0 2024-04-06T12:23:52.103 INFO:tasks.workunit.client.0.smithi152.stdout:6/440: creat d7/d19/d1b/d22/f94 x:0 0 0 2024-04-06T12:23:52.108 INFO:tasks.workunit.client.0.smithi152.stdout:4/501: unlink l6 0 2024-04-06T12:23:52.120 INFO:tasks.workunit.client.0.smithi152.stdout:0/491: link d4/de/d28/f22 d4/de/d28/f95 0 2024-04-06T12:23:52.120 INFO:tasks.workunit.client.0.smithi152.stdout:0/492: chown d4/fa 18735 1 2024-04-06T12:23:52.126 INFO:tasks.workunit.client.0.smithi152.stdout:4/502: creat d7/d29/d7e/d59/fac x:0 0 0 2024-04-06T12:23:52.129 INFO:tasks.workunit.client.0.smithi152.stdout:6/441: creat d7/d9/d73/f95 x:0 0 0 2024-04-06T12:23:52.130 INFO:tasks.workunit.client.0.smithi152.stdout:6/442: chown d7/d9/d26/l67 29 1 2024-04-06T12:23:52.130 INFO:tasks.workunit.client.0.smithi152.stdout:3/401: write d0/d10/d13/f32 [2379234,7661] 0 2024-04-06T12:23:52.137 INFO:tasks.workunit.client.0.smithi152.stdout:3/402: dread d0/d10/d1e/f1d [0,4194304] 0 2024-04-06T12:23:52.137 INFO:tasks.workunit.client.0.smithi152.stdout:6/443: symlink d7/d9/d73/l96 0 2024-04-06T12:23:52.139 INFO:tasks.workunit.client.0.smithi152.stdout:7/374: dwrite d8/f1b [0,4194304] 0 2024-04-06T12:23:52.144 INFO:tasks.workunit.client.0.smithi152.stdout:6/444: unlink d7/d19/f15 0 2024-04-06T12:23:52.150 INFO:tasks.workunit.client.0.smithi152.stdout:7/375: unlink d8/c27 0 2024-04-06T12:23:52.152 INFO:tasks.workunit.client.0.smithi152.stdout:0/493: creat d4/de/d28/d18/d3b/d2e/f96 x:0 0 0 2024-04-06T12:23:52.154 INFO:tasks.workunit.client.0.smithi152.stdout:0/494: chown d4/d36/d72/d7c/d8d 109850 1 2024-04-06T12:23:52.158 INFO:tasks.workunit.client.0.smithi152.stdout:6/445: dread d7/d19/d3e/f4f [0,4194304] 0 2024-04-06T12:23:52.159 INFO:tasks.workunit.client.0.smithi152.stdout:6/446: chown d7/d19/f81 0 1 2024-04-06T12:23:52.159 INFO:tasks.workunit.client.0.smithi152.stdout:1/364: sync 2024-04-06T12:23:52.162 INFO:tasks.workunit.client.0.smithi152.stdout:7/376: link d8/df/c19 d8/d2a/d42/c7c 0 2024-04-06T12:23:52.162 INFO:tasks.workunit.client.0.smithi152.stdout:6/447: write d7/d19/f55 [932571,37641] 0 2024-04-06T12:23:52.162 INFO:tasks.workunit.client.0.smithi152.stdout:7/377: fdatasync d8/df/f5e 0 2024-04-06T12:23:52.163 INFO:tasks.workunit.client.0.smithi152.stdout:0/495: creat d4/de/d28/f97 x:0 0 0 2024-04-06T12:23:52.164 INFO:tasks.workunit.client.0.smithi152.stdout:7/378: chown d8/df/d61/f13 10322282 1 2024-04-06T12:23:52.168 INFO:tasks.workunit.client.0.smithi152.stdout:7/379: unlink d8/df/d28/c50 0 2024-04-06T12:23:52.169 INFO:tasks.workunit.client.0.smithi152.stdout:1/365: dwrite d2/d1d/f2d [0,4194304] 0 2024-04-06T12:23:52.173 INFO:tasks.workunit.client.0.smithi152.stdout:4/503: write d7/d16/f96 [14533,18810] 0 2024-04-06T12:23:52.176 INFO:tasks.workunit.client.0.smithi152.stdout:6/448: dwrite f3 [0,4194304] 0 2024-04-06T12:23:52.180 INFO:tasks.workunit.client.0.smithi152.stdout:0/496: dwrite d4/de/d28/d18/d3b/d2e/d78/f79 [0,4194304] 0 2024-04-06T12:23:52.188 INFO:tasks.workunit.client.0.smithi152.stdout:7/380: dwrite d8/df/d61/d17/d2c/f38 [4194304,4194304] 0 2024-04-06T12:23:52.192 INFO:tasks.workunit.client.0.smithi152.stdout:1/366: getdents d2/d1d 0 2024-04-06T12:23:52.194 INFO:tasks.workunit.client.0.smithi152.stdout:0/497: dwrite d4/d36/f60 [0,4194304] 0 2024-04-06T12:23:52.196 INFO:tasks.workunit.client.0.smithi152.stdout:7/381: rmdir d8/df/d61/d4b/d56 39 2024-04-06T12:23:52.198 INFO:tasks.workunit.client.0.smithi152.stdout:7/382: stat d8/d44/c6a 0 2024-04-06T12:23:52.205 INFO:tasks.workunit.client.0.smithi152.stdout:3/403: dwrite d0/d1f/d4a/f54 [4194304,4194304] 0 2024-04-06T12:23:52.205 INFO:tasks.workunit.client.0.smithi152.stdout:7/383: truncate d8/df/d61/d17/d2c/d2d/f58 2232635 0 2024-04-06T12:23:52.211 INFO:tasks.workunit.client.0.smithi152.stdout:6/449: getdents d7/d9/d26/d2e 0 2024-04-06T12:23:52.212 INFO:tasks.workunit.client.0.smithi152.stdout:6/450: chown d7/d9/d26/d2e 61 1 2024-04-06T12:23:52.213 INFO:tasks.workunit.client.0.smithi152.stdout:1/367: creat d2/f80 x:0 0 0 2024-04-06T12:23:52.221 INFO:tasks.workunit.client.0.smithi152.stdout:3/404: mknod d0/d10/d13/d2a/d4b/c7e 0 2024-04-06T12:23:52.222 INFO:tasks.workunit.client.0.smithi152.stdout:6/451: rmdir d7/d9/d26/d4a 39 2024-04-06T12:23:52.232 INFO:tasks.workunit.client.0.smithi152.stdout:3/405: dread d0/d10/d1e/d39/f5f [0,4194304] 0 2024-04-06T12:23:52.232 INFO:tasks.workunit.client.0.smithi152.stdout:3/406: fsync d0/d10/f66 0 2024-04-06T12:23:52.238 INFO:tasks.workunit.client.0.smithi152.stdout:1/368: dread d2/f20 [0,4194304] 0 2024-04-06T12:23:52.239 INFO:tasks.workunit.client.0.smithi152.stdout:1/369: write d2/ff [1774765,62718] 0 2024-04-06T12:23:52.240 INFO:tasks.workunit.client.0.smithi152.stdout:1/370: dread - d2/d2f/d37/f64 zero size 2024-04-06T12:23:52.241 INFO:tasks.workunit.client.0.smithi152.stdout:7/384: getdents d8/d2a/d37 0 2024-04-06T12:23:52.245 INFO:tasks.workunit.client.0.smithi152.stdout:3/407: dread d0/d1f/f23 [0,4194304] 0 2024-04-06T12:23:52.246 INFO:tasks.workunit.client.0.smithi152.stdout:3/408: write d0/d1f/d28/f74 [54226,81439] 0 2024-04-06T12:23:52.247 INFO:tasks.workunit.client.0.smithi152.stdout:3/409: readlink d0/l6c 0 2024-04-06T12:23:52.247 INFO:tasks.workunit.client.0.smithi152.stdout:3/410: readlink d0/d2d/l5b 0 2024-04-06T12:23:52.248 INFO:tasks.workunit.client.0.smithi152.stdout:1/371: creat d2/d2f/d54/f81 x:0 0 0 2024-04-06T12:23:52.248 INFO:tasks.workunit.client.0.smithi152.stdout:3/411: write d0/d10/d1e/f46 [2260955,77349] 0 2024-04-06T12:23:52.249 INFO:tasks.workunit.client.0.smithi152.stdout:6/452: getdents d7/d9/d26 0 2024-04-06T12:23:52.251 INFO:tasks.workunit.client.0.smithi152.stdout:6/453: dread - d7/d19/d3e/f5d zero size 2024-04-06T12:23:52.255 INFO:tasks.workunit.client.0.smithi152.stdout:4/504: write d7/d29/d78/d33/f44 [4491618,82969] 0 2024-04-06T12:23:52.255 INFO:tasks.workunit.client.0.smithi152.stdout:3/412: write d0/ff [93878,88175] 0 2024-04-06T12:23:52.257 INFO:tasks.workunit.client.0.smithi152.stdout:1/372: rename d2/d2f/d54/d71/l7a to d2/d5d/l82 0 2024-04-06T12:23:52.259 INFO:tasks.workunit.client.0.smithi152.stdout:6/454: rmdir d7 39 2024-04-06T12:23:52.262 INFO:tasks.workunit.client.0.smithi152.stdout:4/505: creat d7/d29/d2e/d7b/fad x:0 0 0 2024-04-06T12:23:52.262 INFO:tasks.workunit.client.0.smithi152.stdout:1/373: read d2/f16 [1599018,47752] 0 2024-04-06T12:23:52.262 INFO:tasks.workunit.client.0.smithi152.stdout:3/413: fsync d0/d10/d1e/f1d 0 2024-04-06T12:23:52.263 INFO:tasks.workunit.client.0.smithi152.stdout:1/374: dread - d2/d2f/f65 zero size 2024-04-06T12:23:52.264 INFO:tasks.workunit.client.0.smithi152.stdout:4/506: write d7/d29/d7e/d59/f90 [361647,17522] 0 2024-04-06T12:23:52.264 INFO:tasks.workunit.client.0.smithi152.stdout:3/414: dread - d0/d10/d13/f6d zero size 2024-04-06T12:23:52.267 INFO:tasks.workunit.client.0.smithi152.stdout:1/375: symlink d2/d1d/d21/d28/l83 0 2024-04-06T12:23:52.269 INFO:tasks.workunit.client.0.smithi152.stdout:4/507: unlink d7/d16/d22/f3e 0 2024-04-06T12:23:52.271 INFO:tasks.workunit.client.0.smithi152.stdout:6/455: mknod d7/d9/d26/d4a/c97 0 2024-04-06T12:23:52.273 INFO:tasks.workunit.client.0.smithi152.stdout:3/415: dwrite d0/d10/d13/f6d [0,4194304] 0 2024-04-06T12:23:52.273 INFO:tasks.workunit.client.0.smithi152.stdout:4/508: truncate d7/d29/d2e/f9a 902987 0 2024-04-06T12:23:52.281 INFO:tasks.workunit.client.0.smithi152.stdout:3/416: mkdir d0/d2d/d7f 0 2024-04-06T12:23:52.284 INFO:tasks.workunit.client.0.smithi152.stdout:3/417: read d0/d1f/d4a/f54 [4093545,59196] 0 2024-04-06T12:23:52.284 INFO:tasks.workunit.client.0.smithi152.stdout:0/498: write d4/de/d28/f95 [3777230,55113] 0 2024-04-06T12:23:52.285 INFO:tasks.workunit.client.0.smithi152.stdout:1/376: dread d2/d2f/f32 [0,4194304] 0 2024-04-06T12:23:52.285 INFO:tasks.workunit.client.0.smithi152.stdout:4/509: stat d7/d16/d55/da0/l4e 0 2024-04-06T12:23:52.285 INFO:tasks.workunit.client.0.smithi152.stdout:0/499: chown f1 1590600836 1 2024-04-06T12:23:52.288 INFO:tasks.workunit.client.0.smithi152.stdout:6/456: link d7/d9/f56 d7/d19/d3e/f98 0 2024-04-06T12:23:52.289 INFO:tasks.workunit.client.0.smithi152.stdout:6/457: read d7/d19/f81 [785454,24657] 0 2024-04-06T12:23:52.291 INFO:tasks.workunit.client.0.smithi152.stdout:6/458: write d7/d19/d1b/f8a [437064,49842] 0 2024-04-06T12:23:52.293 INFO:tasks.workunit.client.0.smithi152.stdout:6/459: fsync d7/d19/d3e/d70/f7e 0 2024-04-06T12:23:52.295 INFO:tasks.workunit.client.0.smithi152.stdout:3/418: rename d0/d1f/d28/l64 to d0/d10/d45/l80 0 2024-04-06T12:23:52.298 INFO:tasks.workunit.client.0.smithi152.stdout:1/377: dread d2/fb [0,4194304] 0 2024-04-06T12:23:52.301 INFO:tasks.workunit.client.0.smithi152.stdout:0/500: mkdir d4/d98 0 2024-04-06T12:23:52.302 INFO:tasks.workunit.client.0.smithi152.stdout:6/460: creat d7/d19/d3e/d70/f99 x:0 0 0 2024-04-06T12:23:52.302 INFO:tasks.workunit.client.0.smithi152.stdout:0/501: read f1 [617632,99073] 0 2024-04-06T12:23:52.303 INFO:tasks.workunit.client.0.smithi152.stdout:0/502: write d4/d31/f5c [287243,1609] 0 2024-04-06T12:23:52.305 INFO:tasks.workunit.client.0.smithi152.stdout:4/510: link d7/d29/d78/d33/f44 d7/d29/d78/d33/fae 0 2024-04-06T12:23:52.306 INFO:tasks.workunit.client.0.smithi152.stdout:3/419: chown d0/d2d/l72 3 1 2024-04-06T12:23:52.307 INFO:tasks.workunit.client.0.smithi152.stdout:4/511: dread d7/d29/d2e/f9a [0,4194304] 0 2024-04-06T12:23:52.309 INFO:tasks.workunit.client.0.smithi152.stdout:1/378: fsync d2/f50 0 2024-04-06T12:23:52.314 INFO:tasks.workunit.client.0.smithi152.stdout:6/461: creat d7/d19/d3e/f9a x:0 0 0 2024-04-06T12:23:52.320 INFO:tasks.workunit.client.0.smithi152.stdout:4/512: dread d7/d29/f2b [0,4194304] 0 2024-04-06T12:23:52.320 INFO:tasks.workunit.client.0.smithi152.stdout:6/462: dwrite d7/ff [0,4194304] 0 2024-04-06T12:23:52.323 INFO:tasks.workunit.client.0.smithi152.stdout:3/420: write d0/d10/d13/f70 [2494593,42026] 0 2024-04-06T12:23:52.333 INFO:tasks.workunit.client.0.smithi152.stdout:0/503: mkdir d4/de/d28/d99 0 2024-04-06T12:23:52.333 INFO:tasks.workunit.client.0.smithi152.stdout:0/504: chown d4/de 729130683 1 2024-04-06T12:23:52.337 INFO:tasks.workunit.client.0.smithi152.stdout:4/513: symlink d7/d29/d7e/d59/laf 0 2024-04-06T12:23:52.343 INFO:tasks.workunit.client.0.smithi152.stdout:3/421: fsync d0/d10/d1e/f1d 0 2024-04-06T12:23:52.351 INFO:tasks.workunit.client.0.smithi152.stdout:3/422: dwrite d0/d1f/d44/f69 [0,4194304] 0 2024-04-06T12:23:52.354 INFO:tasks.workunit.client.0.smithi152.stdout:6/463: creat d7/d19/d1b/d31/d7c/f9b x:0 0 0 2024-04-06T12:23:52.354 INFO:tasks.workunit.client.0.smithi152.stdout:6/464: chown d7/d9/d73 20626419 1 2024-04-06T12:23:52.357 INFO:tasks.workunit.client.0.smithi152.stdout:3/423: dread d0/fb [0,4194304] 0 2024-04-06T12:23:52.369 INFO:tasks.workunit.client.0.smithi152.stdout:4/514: rename d7/d29/d7e/d59/laf to d7/d29/d2e/lb0 0 2024-04-06T12:23:52.373 INFO:tasks.workunit.client.0.smithi152.stdout:3/424: creat d0/d10/d1e/d39/d49/f81 x:0 0 0 2024-04-06T12:23:52.374 INFO:tasks.workunit.client.0.smithi152.stdout:3/425: stat d0/d10/d13/f32 0 2024-04-06T12:23:52.375 INFO:tasks.workunit.client.0.smithi152.stdout:0/505: getdents d4/de/d28/d18/d3b/d2e 0 2024-04-06T12:23:52.376 INFO:tasks.workunit.client.0.smithi152.stdout:0/506: readlink d4/d31/l38 0 2024-04-06T12:23:52.378 INFO:tasks.workunit.client.0.smithi152.stdout:3/426: dread d0/d10/d13/f32 [0,4194304] 0 2024-04-06T12:23:52.382 INFO:tasks.workunit.client.0.smithi152.stdout:4/515: dread d7/d16/d22/d30/f37 [0,4194304] 0 2024-04-06T12:23:52.384 INFO:tasks.workunit.client.0.smithi152.stdout:4/516: read d7/f4a [2270165,38211] 0 2024-04-06T12:23:52.388 INFO:tasks.workunit.client.0.smithi152.stdout:4/517: mkdir d7/d82/db1 0 2024-04-06T12:23:52.391 INFO:tasks.workunit.client.0.smithi152.stdout:8/435: sync 2024-04-06T12:23:52.391 INFO:tasks.workunit.client.0.smithi152.stdout:9/313: sync 2024-04-06T12:23:52.391 INFO:tasks.workunit.client.0.smithi152.stdout:2/464: sync 2024-04-06T12:23:52.391 INFO:tasks.workunit.client.0.smithi152.stdout:5/379: sync 2024-04-06T12:23:52.392 INFO:tasks.workunit.client.0.smithi152.stdout:4/518: mkdir d7/d29/d2e/d5b/db2 0 2024-04-06T12:23:52.393 INFO:tasks.workunit.client.0.smithi152.stdout:5/380: chown d3/f58 892804952 1 2024-04-06T12:23:52.393 INFO:tasks.workunit.client.0.smithi152.stdout:0/507: link d4/de/d28/c50 d4/de/d28/d18/d43/d81/c9a 0 2024-04-06T12:23:52.399 INFO:tasks.workunit.client.0.smithi152.stdout:2/465: mknod d0/d15/d24/d79/d80/c95 0 2024-04-06T12:23:52.399 INFO:tasks.workunit.client.0.smithi152.stdout:4/519: dwrite d7/d29/d7e/f86 [0,4194304] 0 2024-04-06T12:23:52.409 INFO:tasks.workunit.client.0.smithi152.stdout:4/520: creat d7/d29/d2e/d5b/fb3 x:0 0 0 2024-04-06T12:23:52.410 INFO:tasks.workunit.client.0.smithi152.stdout:4/521: write d7/d29/d7e/d59/fac [650343,56599] 0 2024-04-06T12:23:52.411 INFO:tasks.workunit.client.0.smithi152.stdout:2/466: symlink d0/d2/d5/d3a/d87/l96 0 2024-04-06T12:23:52.417 INFO:tasks.workunit.client.0.smithi152.stdout:0/508: link d4/de/d28/d18/d3b/f92 d4/de/d28/d18/d3b/f9b 0 2024-04-06T12:23:52.417 INFO:tasks.workunit.client.0.smithi152.stdout:4/522: dwrite d7/d16/d22/d30/f50 [4194304,4194304] 0 2024-04-06T12:23:52.418 INFO:tasks.workunit.client.0.smithi152.stdout:0/509: write d4/de/d87/d94/f6c [819367,27357] 0 2024-04-06T12:23:52.420 INFO:tasks.workunit.client.0.smithi152.stdout:0/510: readlink d4/de/d87/d94/l65 0 2024-04-06T12:23:52.426 INFO:tasks.workunit.client.0.smithi152.stdout:2/467: symlink d0/d15/d24/d3d/l97 0 2024-04-06T12:23:52.434 INFO:tasks.workunit.client.0.smithi152.stdout:8/436: getdents d4/dc/d10/d55 0 2024-04-06T12:23:52.443 INFO:tasks.workunit.client.0.smithi152.stdout:9/314: link d5/d6/c12 d5/d6/c64 0 2024-04-06T12:23:52.450 INFO:tasks.workunit.client.0.smithi152.stdout:8/437: mkdir d4/dc/d10/d49/d97 0 2024-04-06T12:23:52.451 INFO:tasks.workunit.client.0.smithi152.stdout:2/468: dread d0/d15/d24/d3d/f4f [0,4194304] 0 2024-04-06T12:23:52.453 INFO:tasks.workunit.client.0.smithi152.stdout:4/523: rename d7/d16/d22/d30 to d7/d16/d22/d3f/db4 0 2024-04-06T12:23:52.458 INFO:tasks.workunit.client.0.smithi152.stdout:8/438: mkdir d4/d5f/d98 0 2024-04-06T12:23:52.464 INFO:tasks.workunit.client.0.smithi152.stdout:9/315: symlink d5/d39/d3f/d42/d5f/l65 0 2024-04-06T12:23:52.468 INFO:tasks.workunit.client.0.smithi152.stdout:8/439: rename d4/dc/d10/d18/c47 to d4/d2c/d54/c99 0 2024-04-06T12:23:52.472 INFO:tasks.workunit.client.0.smithi152.stdout:2/469: creat d0/d15/d24/f98 x:0 0 0 2024-04-06T12:23:52.480 INFO:tasks.workunit.client.0.smithi152.stdout:2/470: symlink d0/d15/d24/d79/l99 0 2024-04-06T12:23:52.491 INFO:tasks.workunit.client.0.smithi152.stdout:2/471: stat d0/d2/d5/c66 0 2024-04-06T12:23:52.492 INFO:tasks.workunit.client.0.smithi152.stdout:4/524: link d7/d29/d78/d33/f44 d7/fb5 0 2024-04-06T12:23:52.502 INFO:tasks.workunit.client.0.smithi152.stdout:9/316: rename d5/d6/c64 to d5/d39/d3f/d42/d5f/d17/d23/c66 0 2024-04-06T12:23:52.514 INFO:tasks.workunit.client.0.smithi152.stdout:9/317: link d5/d6/cc d5/d39/d3f/d42/d5f/d17/c67 0 2024-04-06T12:23:52.515 INFO:tasks.workunit.client.0.smithi152.stdout:9/318: dread - d5/d39/d3f/d42/f5b zero size 2024-04-06T12:23:52.520 INFO:tasks.workunit.client.0.smithi152.stdout:9/319: getdents d5/d39/d3f/d42/d5f/d17/d23/d2d/d4b/d5a 0 2024-04-06T12:23:52.522 INFO:tasks.workunit.client.0.smithi152.stdout:9/320: read - d5/d39/d3f/d42/d5f/d17/d23/d2d/d32/f57 zero size 2024-04-06T12:23:52.523 INFO:tasks.workunit.client.0.smithi152.stdout:9/321: rename d5/d39 to d5/d39/d3f/d42/d5f/d17/d37/d5d/d68 22 2024-04-06T12:23:52.526 INFO:tasks.workunit.client.0.smithi152.stdout:9/322: mkdir d5/d39/d3f/d42/d5f/d69 0 2024-04-06T12:23:52.530 INFO:tasks.workunit.client.0.smithi152.stdout:1/379: dwrite d2/f42 [0,4194304] 0 2024-04-06T12:23:52.532 INFO:tasks.workunit.client.0.smithi152.stdout:1/380: read d2/f7 [7994563,95970] 0 2024-04-06T12:23:52.534 INFO:tasks.workunit.client.0.smithi152.stdout:9/323: creat d5/d39/d3f/f6a x:0 0 0 2024-04-06T12:23:52.538 INFO:tasks.workunit.client.0.smithi152.stdout:9/324: creat d5/d39/d3f/d42/d5f/d17/d23/d2d/f6b x:0 0 0 2024-04-06T12:23:52.540 INFO:tasks.workunit.client.0.smithi152.stdout:1/381: dwrite d2/d2f/d54/f57 [0,4194304] 0 2024-04-06T12:23:52.541 INFO:tasks.workunit.client.0.smithi152.stdout:1/382: chown d2/d1d/d21/d28 85953 1 2024-04-06T12:23:52.543 INFO:tasks.workunit.client.0.smithi152.stdout:3/427: fsync d0/d10/d1e/d39/d49/f81 0 2024-04-06T12:23:52.546 INFO:tasks.workunit.client.0.smithi152.stdout:3/428: write d0/d10/d13/f1a [2795060,1003] 0 2024-04-06T12:23:52.548 INFO:tasks.workunit.client.0.smithi152.stdout:3/429: truncate d0/d10/d1e/f46 3149786 0 2024-04-06T12:23:52.550 INFO:tasks.workunit.client.0.smithi152.stdout:9/325: rename d5/d39/d3f/d42/d5f/c1b to d5/d39/d3f/d42/d5f/c6c 0 2024-04-06T12:23:52.552 INFO:tasks.workunit.client.0.smithi152.stdout:3/430: rename d0/d10/d13/f17 to d0/d35/f82 0 2024-04-06T12:23:52.554 INFO:tasks.workunit.client.0.smithi152.stdout:9/326: dread d5/d6/f28 [0,4194304] 0 2024-04-06T12:23:52.554 INFO:tasks.workunit.client.0.smithi152.stdout:9/327: chown d5 1172930267 1 2024-04-06T12:23:52.555 INFO:tasks.workunit.client.0.smithi152.stdout:3/431: unlink d0/d1f/d28/c6e 0 2024-04-06T12:23:52.556 INFO:tasks.workunit.client.0.smithi152.stdout:9/328: chown d5/d39/d3f/d42/d5f/d17/l58 720992 1 2024-04-06T12:23:52.557 INFO:tasks.workunit.client.0.smithi152.stdout:9/329: dread - d5/d39/d3f/d42/f5b zero size 2024-04-06T12:23:52.562 INFO:tasks.workunit.client.0.smithi152.stdout:3/432: getdents d0/d10/d13/d2a/d4b 0 2024-04-06T12:23:52.669 INFO:tasks.workunit.client.0.smithi152.stdout:9/330: creat d5/d39/d3f/d42/d5f/d17/d23/d2d/d4b/d5a/f6d x:0 0 0 2024-04-06T12:23:52.669 INFO:tasks.workunit.client.0.smithi152.stdout:3/433: mkdir d0/d35/d43/d48/d83 0 2024-04-06T12:23:52.692 INFO:tasks.workunit.client.0.smithi152.stdout:3/434: creat d0/d2d/f84 x:0 0 0 2024-04-06T12:23:52.693 INFO:tasks.workunit.client.0.smithi152.stdout:9/331: creat d5/d39/d3f/d42/d5f/d17/d23/d2d/d4b/f6e x:0 0 0 2024-04-06T12:23:52.694 INFO:tasks.workunit.client.0.smithi152.stdout:9/332: dread - d5/d39/d3f/d42/f5b zero size 2024-04-06T12:23:52.696 INFO:tasks.workunit.client.0.smithi152.stdout:3/435: creat d0/d35/d75/f85 x:0 0 0 2024-04-06T12:23:52.697 INFO:tasks.workunit.client.0.smithi152.stdout:9/333: truncate d5/d6/fd 1130940 0 2024-04-06T12:23:52.698 INFO:tasks.workunit.client.0.smithi152.stdout:3/436: creat d0/d1f/d28/f86 x:0 0 0 2024-04-06T12:23:52.699 INFO:tasks.workunit.client.0.smithi152.stdout:9/334: write d5/d39/d3f/d42/d5f/d17/d23/d2d/f6b [696533,3325] 0 2024-04-06T12:23:52.700 INFO:tasks.workunit.client.0.smithi152.stdout:3/437: stat d0/d1f/d4a/l67 0 2024-04-06T12:23:52.701 INFO:tasks.workunit.client.0.smithi152.stdout:3/438: stat d0/d35/d43/c73 0 2024-04-06T12:23:52.701 INFO:tasks.workunit.client.0.smithi152.stdout:3/439: stat d0/c58 0 2024-04-06T12:23:52.702 INFO:tasks.workunit.client.0.smithi152.stdout:3/440: stat d0/d10/l24 0 2024-04-06T12:23:52.703 INFO:tasks.workunit.client.0.smithi152.stdout:3/441: chown d0/d10/d13/f32 2309516 1 2024-04-06T12:23:52.704 INFO:tasks.workunit.client.0.smithi152.stdout:3/442: write d0/d10/d45/f47 [278608,81482] 0 2024-04-06T12:23:52.705 INFO:tasks.workunit.client.0.smithi152.stdout:3/443: write d0/d10/d1e/d71/f79 [4030784,108463] 0 2024-04-06T12:23:52.712 INFO:tasks.workunit.client.0.smithi152.stdout:0/511: write d4/d19/f53 [811119,89845] 0 2024-04-06T12:23:52.715 INFO:tasks.workunit.client.0.smithi152.stdout:0/512: rename d4/d36/f60 to d4/d31/d47/f9c 0 2024-04-06T12:23:52.722 INFO:tasks.workunit.client.0.smithi152.stdout:8/440: write d4/dc/d10/d18/f34 [232926,122981] 0 2024-04-06T12:23:52.725 INFO:tasks.workunit.client.0.smithi152.stdout:8/441: truncate d4/db/d39/f3f 7063107 0 2024-04-06T12:23:52.729 INFO:tasks.workunit.client.0.smithi152.stdout:2/472: dwrite d0/f11 [0,4194304] 0 2024-04-06T12:23:52.738 INFO:tasks.workunit.client.0.smithi152.stdout:2/473: dwrite d0/fd [4194304,4194304] 0 2024-04-06T12:23:52.745 INFO:tasks.workunit.client.0.smithi152.stdout:2/474: symlink d0/d2/d5/d3a/l9a 0 2024-04-06T12:23:52.751 INFO:tasks.workunit.client.0.smithi152.stdout:2/475: mknod d0/d2/d5/d92/c9b 0 2024-04-06T12:23:52.752 INFO:tasks.workunit.client.0.smithi152.stdout:2/476: chown d0/d2 199 1 2024-04-06T12:23:52.753 INFO:tasks.workunit.client.0.smithi152.stdout:1/383: dwrite d2/d1d/d21/f34 [0,4194304] 0 2024-04-06T12:23:52.755 INFO:tasks.workunit.client.0.smithi152.stdout:2/477: write d0/d2/d6f/d90/f8b [955681,105466] 0 2024-04-06T12:23:52.756 INFO:tasks.workunit.client.0.smithi152.stdout:1/384: write d2/d61/f73 [369594,11631] 0 2024-04-06T12:23:52.758 INFO:tasks.workunit.client.0.smithi152.stdout:1/385: dread - d2/d61/f6c zero size 2024-04-06T12:23:52.758 INFO:tasks.workunit.client.0.smithi152.stdout:1/386: stat d2/f12 0 2024-04-06T12:23:52.761 INFO:tasks.workunit.client.0.smithi152.stdout:2/478: creat d0/d15/d24/d3d/f9c x:0 0 0 2024-04-06T12:23:52.763 INFO:tasks.workunit.client.0.smithi152.stdout:1/387: creat d2/d5d/d6d/f84 x:0 0 0 2024-04-06T12:23:52.763 INFO:tasks.workunit.client.0.smithi152.stdout:1/388: dread - d2/d2f/d45/f77 zero size 2024-04-06T12:23:52.766 INFO:tasks.workunit.client.0.smithi152.stdout:2/479: creat d0/d15/d4d/f9d x:0 0 0 2024-04-06T12:23:52.769 INFO:tasks.workunit.client.0.smithi152.stdout:2/480: mkdir d0/d2/d6f/d90/d9e 0 2024-04-06T12:23:52.778 INFO:tasks.workunit.client.0.smithi152.stdout:2/481: dread d0/d15/d24/d3d/f7d [0,4194304] 0 2024-04-06T12:23:52.788 INFO:tasks.workunit.client.0.smithi152.stdout:3/444: dwrite d0/d10/d13/d2a/f51 [0,4194304] 0 2024-04-06T12:23:52.789 INFO:tasks.workunit.client.0.smithi152.stdout:2/482: mknod d0/d40/d41/d28/d8c/c9f 0 2024-04-06T12:23:52.789 INFO:tasks.workunit.client.0.smithi152.stdout:0/513: write d4/de/d4a/d33/f48 [556205,69547] 0 2024-04-06T12:23:52.795 INFO:tasks.workunit.client.0.smithi152.stdout:2/483: truncate d0/d2/d5/f1f 4269868 0 2024-04-06T12:23:52.799 INFO:tasks.workunit.client.0.smithi152.stdout:3/445: mkdir d0/d10/d1e/d87 0 2024-04-06T12:23:52.800 INFO:tasks.workunit.client.0.smithi152.stdout:8/442: dwrite f3 [0,4194304] 0 2024-04-06T12:23:52.803 INFO:tasks.workunit.client.0.smithi152.stdout:7/385: sync 2024-04-06T12:23:52.803 INFO:tasks.workunit.client.0.smithi152.stdout:2/484: rename d0/d15/d24/d3d/f6a to d0/d15/d24/d79/d80/fa0 0 2024-04-06T12:23:52.806 INFO:tasks.workunit.client.0.smithi152.stdout:3/446: creat d0/d35/f88 x:0 0 0 2024-04-06T12:23:52.813 INFO:tasks.workunit.client.0.smithi152.stdout:0/514: dread d4/d31/f34 [0,4194304] 0 2024-04-06T12:23:52.819 INFO:tasks.workunit.client.0.smithi152.stdout:2/485: write d0/d15/d24/d3d/f4f [3875864,121415] 0 2024-04-06T12:23:52.820 INFO:tasks.workunit.client.0.smithi152.stdout:3/447: rename d0/d35/l53 to d0/d10/d13/d2a/d4b/d6a/l89 0 2024-04-06T12:23:52.824 INFO:tasks.workunit.client.0.smithi152.stdout:2/486: symlink d0/d40/d41/d28/d54/la1 0 2024-04-06T12:23:52.827 INFO:tasks.workunit.client.0.smithi152.stdout:7/386: dread d8/df/f25 [0,4194304] 0 2024-04-06T12:23:52.828 INFO:tasks.workunit.client.0.smithi152.stdout:3/448: symlink d0/d1f/d44/l8a 0 2024-04-06T12:23:52.832 INFO:tasks.workunit.client.0.smithi152.stdout:1/389: truncate d2/d1d/d21/d28/f3a 858391 0 2024-04-06T12:23:52.832 INFO:tasks.workunit.client.0.smithi152.stdout:8/443: link d4/c12 d4/d2c/d2b/c9a 0 2024-04-06T12:23:52.832 INFO:tasks.workunit.client.0.smithi152.stdout:3/449: dread d0/d1f/f60 [0,4194304] 0 2024-04-06T12:23:52.834 INFO:tasks.workunit.client.0.smithi152.stdout:0/515: mknod d4/de/d28/d18/c9d 0 2024-04-06T12:23:52.836 INFO:tasks.workunit.client.0.smithi152.stdout:7/387: dwrite d8/df/d61/d4b/f69 [0,4194304] 0 2024-04-06T12:23:52.839 INFO:tasks.workunit.client.0.smithi152.stdout:2/487: symlink d0/d2/d5/d92/la2 0 2024-04-06T12:23:52.839 INFO:tasks.workunit.client.0.smithi152.stdout:9/335: write d5/d6/fd [1265815,80873] 0 2024-04-06T12:23:52.844 INFO:tasks.workunit.client.0.smithi152.stdout:1/390: unlink d2/d2f/d45/c6e 0 2024-04-06T12:23:52.845 INFO:tasks.workunit.client.0.smithi152.stdout:1/391: chown d2/f50 146473 1 2024-04-06T12:23:52.847 INFO:tasks.workunit.client.0.smithi152.stdout:8/444: symlink d4/dc/d10/d51/l9b 0 2024-04-06T12:23:52.859 INFO:tasks.workunit.client.0.smithi152.stdout:9/336: creat d5/d39/d3f/d42/d5f/d17/d23/d2d/d4b/d5a/f6f x:0 0 0 2024-04-06T12:23:52.861 INFO:tasks.workunit.client.0.smithi152.stdout:1/392: mkdir d2/d61/d85 0 2024-04-06T12:23:52.864 INFO:tasks.workunit.client.0.smithi152.stdout:0/516: dread d4/de/d28/f40 [0,4194304] 0 2024-04-06T12:23:52.866 INFO:tasks.workunit.client.0.smithi152.stdout:9/337: dwrite d5/d39/d3f/d42/d5f/d17/f46 [0,4194304] 0 2024-04-06T12:23:52.867 INFO:tasks.workunit.client.0.smithi152.stdout:3/450: symlink d0/d2d/d7f/l8b 0 2024-04-06T12:23:52.870 INFO:tasks.workunit.client.0.smithi152.stdout:3/451: chown d0/d35/d43/d48/c5d 104300620 1 2024-04-06T12:23:52.873 INFO:tasks.workunit.client.0.smithi152.stdout:3/452: write d0/d1f/d28/f86 [649860,69304] 0 2024-04-06T12:23:52.875 INFO:tasks.workunit.client.0.smithi152.stdout:9/338: dwrite d5/d6/f63 [0,4194304] 0 2024-04-06T12:23:52.877 INFO:tasks.workunit.client.0.smithi152.stdout:3/453: chown d0/d1f/d4a/l4d 14269 1 2024-04-06T12:23:52.878 INFO:tasks.workunit.client.0.smithi152.stdout:9/339: readlink d5/l13 0 2024-04-06T12:23:52.884 INFO:tasks.workunit.client.0.smithi152.stdout:8/445: dwrite d4/db/d56/f86 [4194304,4194304] 0 2024-04-06T12:23:52.884 INFO:tasks.workunit.client.0.smithi152.stdout:0/517: creat d4/d31/f9e x:0 0 0 2024-04-06T12:23:52.891 INFO:tasks.workunit.client.0.smithi152.stdout:2/488: rename d0/d2/d5/c1d to d0/d2/d5/ca3 0 2024-04-06T12:23:52.892 INFO:tasks.workunit.client.0.smithi152.stdout:3/454: fdatasync d0/d10/d13/f32 0 2024-04-06T12:23:52.895 INFO:tasks.workunit.client.0.smithi152.stdout:9/340: symlink d5/d39/d3f/d42/d5f/d17/d23/d2d/d32/d36/l70 0 2024-04-06T12:23:52.896 INFO:tasks.workunit.client.0.smithi152.stdout:8/446: fsync d4/d5f/f96 0 2024-04-06T12:23:52.899 INFO:tasks.workunit.client.0.smithi152.stdout:0/518: unlink d4/d31/f9e 0 2024-04-06T12:23:52.903 INFO:tasks.workunit.client.0.smithi152.stdout:9/341: dwrite d5/d39/d3f/d42/d5f/d17/d23/d2d/f6b [0,4194304] 0 2024-04-06T12:23:52.907 INFO:tasks.workunit.client.0.smithi152.stdout:8/447: truncate d4/dc/d10/d49/f64 98004 0 2024-04-06T12:23:52.907 INFO:tasks.workunit.client.0.smithi152.stdout:0/519: dread d4/d31/d47/f9c [0,4194304] 0 2024-04-06T12:23:52.907 INFO:tasks.workunit.client.0.smithi152.stdout:8/448: stat d4/d5f 0 2024-04-06T12:23:52.913 INFO:tasks.workunit.client.0.smithi152.stdout:8/449: mkdir d4/d81/d9c 0 2024-04-06T12:23:52.917 INFO:tasks.workunit.client.0.smithi152.stdout:0/520: creat d4/de/d28/d99/f9f x:0 0 0 2024-04-06T12:23:52.920 INFO:tasks.workunit.client.0.smithi152.stdout:7/388: dwrite d8/df/d4a/f64 [0,4194304] 0 2024-04-06T12:23:52.929 INFO:tasks.workunit.client.0.smithi152.stdout:0/521: creat d4/de/d28/d99/fa0 x:0 0 0 2024-04-06T12:23:52.929 INFO:tasks.workunit.client.0.smithi152.stdout:9/342: dread d5/f35 [0,4194304] 0 2024-04-06T12:23:52.931 INFO:tasks.workunit.client.0.smithi152.stdout:3/455: write d0/fb [5001748,94873] 0 2024-04-06T12:23:52.934 INFO:tasks.workunit.client.0.smithi152.stdout:7/389: rename d8/df/l30 to d8/df/d61/d3d/l7d 0 2024-04-06T12:23:52.937 INFO:tasks.workunit.client.0.smithi152.stdout:0/522: creat d4/d6e/fa1 x:0 0 0 2024-04-06T12:23:52.939 INFO:tasks.workunit.client.0.smithi152.stdout:9/343: truncate d5/d39/d3f/d42/d5f/d17/d23/d2d/d4b/d5a/f6d 453931 0 2024-04-06T12:23:52.941 INFO:tasks.workunit.client.0.smithi152.stdout:0/523: read d4/f4c [468818,97555] 0 2024-04-06T12:23:52.942 INFO:tasks.workunit.client.0.smithi152.stdout:9/344: stat d5/d39/d3f/d42/d5f/d17/d23 0 2024-04-06T12:23:52.942 INFO:tasks.workunit.client.0.smithi152.stdout:3/456: dwrite d0/d1f/d28/f74 [0,4194304] 0 2024-04-06T12:23:52.947 INFO:tasks.workunit.client.0.smithi152.stdout:7/390: rename d8/df/d61/d17 to d8/df/d61/d76/d7e 0 2024-04-06T12:23:52.951 INFO:tasks.workunit.client.0.smithi152.stdout:8/450: dwrite d4/db/d32/f52 [0,4194304] 0 2024-04-06T12:23:52.952 INFO:tasks.workunit.client.0.smithi152.stdout:3/457: readlink d0/d10/d13/d2a/d4b/d6a/l89 0 2024-04-06T12:23:52.953 INFO:tasks.workunit.client.0.smithi152.stdout:3/458: fsync d0/d10/d1e/d39/d49/f81 0 2024-04-06T12:23:52.954 INFO:tasks.workunit.client.0.smithi152.stdout:3/459: stat d0/d10/d13/c30 0 2024-04-06T12:23:52.958 INFO:tasks.workunit.client.0.smithi152.stdout:3/460: truncate d0/d35/d75/f85 1042590 0 2024-04-06T12:23:52.959 INFO:tasks.workunit.client.0.smithi152.stdout:1/393: write d2/d1d/d21/d28/f3a [1195771,66460] 0 2024-04-06T12:23:52.959 INFO:tasks.workunit.client.0.smithi152.stdout:7/391: creat d8/d2a/d42/f7f x:0 0 0 2024-04-06T12:23:52.964 INFO:tasks.workunit.client.0.smithi152.stdout:9/345: mknod d5/d39/d3f/d42/d5f/d17/c71 0 2024-04-06T12:23:52.969 INFO:tasks.workunit.client.0.smithi152.stdout:3/461: mkdir d0/d2d/d7f/d8c 0 2024-04-06T12:23:52.975 INFO:tasks.workunit.client.0.smithi152.stdout:7/392: dwrite d8/df/d61/d76/d7e/f73 [0,4194304] 0 2024-04-06T12:23:52.977 INFO:tasks.workunit.client.0.smithi152.stdout:9/346: symlink d5/d39/d3f/d42/d5f/d17/d23/d2d/d32/d36/l72 0 2024-04-06T12:23:52.978 INFO:tasks.workunit.client.0.smithi152.stdout:0/524: truncate d4/de/d4a/d33/f86 6956776 0 2024-04-06T12:23:52.979 INFO:tasks.workunit.client.0.smithi152.stdout:8/451: dwrite d4/dc/d10/d49/f4c [0,4194304] 0 2024-04-06T12:23:52.980 INFO:tasks.workunit.client.0.smithi152.stdout:8/452: fsync d4/db/d56/f69 0 2024-04-06T12:23:52.981 INFO:tasks.workunit.client.0.smithi152.stdout:8/453: stat d4/db/d2a/l7c 0 2024-04-06T12:23:52.993 INFO:tasks.workunit.client.0.smithi152.stdout:8/454: rename d4/dc/d10/d74 to d4/d81/d92/d9d 0 2024-04-06T12:23:52.997 INFO:tasks.workunit.client.0.smithi152.stdout:9/347: truncate d5/d6/f7 2145733 0 2024-04-06T12:23:52.999 INFO:tasks.workunit.client.0.smithi152.stdout:1/394: truncate d2/d1d/d21/f34 3514478 0 2024-04-06T12:23:52.999 INFO:tasks.workunit.client.0.smithi152.stdout:8/455: dread d4/d2c/d2b/f44 [0,4194304] 0 2024-04-06T12:23:53.001 INFO:tasks.workunit.client.0.smithi152.stdout:3/462: truncate d0/d10/d1e/d71/f79 165066 0 2024-04-06T12:23:53.005 INFO:tasks.workunit.client.0.smithi152.stdout:7/393: write d8/f16 [1576741,116932] 0 2024-04-06T12:23:53.010 INFO:tasks.workunit.client.0.smithi152.stdout:8/456: mknod d4/d81/d92/d9d/c9e 0 2024-04-06T12:23:53.014 INFO:tasks.workunit.client.0.smithi152.stdout:7/394: dwrite d8/df/f5e [0,4194304] 0 2024-04-06T12:23:53.017 INFO:tasks.workunit.client.0.smithi152.stdout:9/348: unlink d5/d39/d3f/d42/d5f/d17/f22 0 2024-04-06T12:23:53.021 INFO:tasks.workunit.client.0.smithi152.stdout:8/457: dwrite d4/dc/d10/f84 [0,4194304] 0 2024-04-06T12:23:53.024 INFO:tasks.workunit.client.0.smithi152.stdout:9/349: truncate d5/d39/d3f/d42/d5f/d17/d23/d2d/d4b/d5a/f6f 29732 0 2024-04-06T12:23:53.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:51.583542+0000 mgr.smithi195.ausetj (mgr.24375) 80 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 916 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 93 MiB/s wr, 187 op/s 2024-04-06T12:23:53.032 INFO:tasks.workunit.client.0.smithi152.stdout:8/458: dread - d4/dc/d10/d51/f67 zero size 2024-04-06T12:23:53.036 INFO:tasks.workunit.client.0.smithi152.stdout:1/395: rename d2/c35 to d2/d1d/d21/c86 0 2024-04-06T12:23:53.038 INFO:tasks.workunit.client.0.smithi152.stdout:1/396: fdatasync d2/d2f/d54/f81 0 2024-04-06T12:23:53.038 INFO:tasks.workunit.client.0.smithi152.stdout:8/459: creat d4/d81/f9f x:0 0 0 2024-04-06T12:23:53.039 INFO:tasks.workunit.client.0.smithi152.stdout:3/463: dwrite d0/d1f/f60 [0,4194304] 0 2024-04-06T12:23:53.039 INFO:tasks.workunit.client.0.smithi152.stdout:1/397: read - d2/f80 zero size 2024-04-06T12:23:53.047 INFO:tasks.workunit.client.0.smithi152.stdout:7/395: rename d8/df/d61/d76/d7e/f73 to d8/d2a/d37/d49/f80 0 2024-04-06T12:23:53.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:51.583542+0000 mgr.smithi195.ausetj (mgr.24375) 80 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 916 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 93 MiB/s wr, 187 op/s 2024-04-06T12:23:53.049 INFO:tasks.workunit.client.0.smithi152.stdout:3/464: dread d0/d1f/d44/f69 [0,4194304] 0 2024-04-06T12:23:53.053 INFO:tasks.workunit.client.0.smithi152.stdout:1/398: creat d2/d2f/d54/d71/f87 x:0 0 0 2024-04-06T12:23:53.061 INFO:tasks.workunit.client.0.smithi152.stdout:3/465: mkdir d0/d10/d1e/d39/d49/d8d 0 2024-04-06T12:23:53.064 INFO:tasks.workunit.client.0.smithi152.stdout:1/399: write d2/d2f/f32 [3216576,112790] 0 2024-04-06T12:23:53.066 INFO:tasks.workunit.client.0.smithi152.stdout:8/460: dread d4/dc/d10/d49/f70 [0,4194304] 0 2024-04-06T12:23:53.068 INFO:tasks.workunit.client.0.smithi152.stdout:3/466: symlink d0/d10/d1e/d39/d49/l8e 0 2024-04-06T12:23:53.071 INFO:tasks.workunit.client.0.smithi152.stdout:8/461: dread d4/dc/d10/d18/f26 [0,4194304] 0 2024-04-06T12:23:53.072 INFO:tasks.workunit.client.0.smithi152.stdout:9/350: rename d5/d39/d3f/d42/d5f/d17/d23/f59 to d5/d6/f73 0 2024-04-06T12:23:53.073 INFO:tasks.workunit.client.0.smithi152.stdout:9/351: fdatasync d5/d6/f2c 0 2024-04-06T12:23:53.073 INFO:tasks.workunit.client.0.smithi152.stdout:8/462: read d4/db/d2a/f3e [69051,50580] 0 2024-04-06T12:23:53.074 INFO:tasks.workunit.client.0.smithi152.stdout:9/352: write d5/d6/fd [1014191,60376] 0 2024-04-06T12:23:53.075 INFO:tasks.workunit.client.0.smithi152.stdout:3/467: creat d0/d1f/d44/d7c/f8f x:0 0 0 2024-04-06T12:23:53.077 INFO:tasks.workunit.client.0.smithi152.stdout:7/396: rename d8/d44 to d8/d2a/d37/d79/d81 0 2024-04-06T12:23:53.088 INFO:tasks.workunit.client.0.smithi152.stdout:3/468: creat d0/d1f/d28/f90 x:0 0 0 2024-04-06T12:23:53.090 INFO:tasks.workunit.client.0.smithi152.stdout:1/400: rename d2/d1d/d21 to d2/d2f/d54/d88 0 2024-04-06T12:23:53.090 INFO:tasks.workunit.client.0.smithi152.stdout:8/463: dwrite d4/dc/d10/d55/f6f [0,4194304] 0 2024-04-06T12:23:53.091 INFO:tasks.workunit.client.0.smithi152.stdout:1/401: write d2/f58 [1016138,86768] 0 2024-04-06T12:23:53.096 INFO:tasks.workunit.client.0.smithi152.stdout:9/353: stat d5/d39/d3f/d42/d5f/d17/d23/d2d/f6b 0 2024-04-06T12:23:53.098 INFO:tasks.workunit.client.0.smithi152.stdout:3/469: symlink d0/d1f/d4a/l91 0 2024-04-06T12:23:53.101 INFO:tasks.workunit.client.0.smithi152.stdout:9/354: write d5/d6/f28 [971500,125190] 0 2024-04-06T12:23:53.103 INFO:tasks.workunit.client.0.smithi152.stdout:9/355: stat d5/d6/f63 0 2024-04-06T12:23:53.108 INFO:tasks.workunit.client.0.smithi152.stdout:1/402: dwrite d2/f11 [0,4194304] 0 2024-04-06T12:23:53.111 INFO:tasks.workunit.client.0.smithi152.stdout:9/356: dread - d5/d39/d3f/d42/d5f/d17/d23/d2d/d32/f57 zero size 2024-04-06T12:23:53.114 INFO:tasks.workunit.client.0.smithi152.stdout:3/470: dwrite d0/d1f/d28/f76 [0,4194304] 0 2024-04-06T12:23:53.115 INFO:tasks.workunit.client.0.smithi152.stdout:7/397: dwrite d8/df/d28/f4d [0,4194304] 0 2024-04-06T12:23:53.117 INFO:tasks.workunit.client.0.smithi152.stdout:8/464: dread d4/db/d56/f86 [0,4194304] 0 2024-04-06T12:23:53.119 INFO:tasks.workunit.client.0.smithi152.stdout:8/465: write d4/d5f/f96 [5059011,76263] 0 2024-04-06T12:23:53.120 INFO:tasks.workunit.client.0.smithi152.stdout:8/466: fdatasync d4/dc/d10/d49/f72 0 2024-04-06T12:23:53.132 INFO:tasks.workunit.client.0.smithi152.stdout:3/471: mknod d0/d10/d1e/d39/d3d/c92 0 2024-04-06T12:23:53.133 INFO:tasks.workunit.client.0.smithi152.stdout:7/398: creat d8/df/d34/d5c/f82 x:0 0 0 2024-04-06T12:23:53.133 INFO:tasks.workunit.client.0.smithi152.stdout:3/472: write d0/d10/d1e/f46 [32793,111586] 0 2024-04-06T12:23:53.136 INFO:tasks.workunit.client.0.smithi152.stdout:1/403: getdents d2/d2f/d54/d88 0 2024-04-06T12:23:53.139 INFO:tasks.workunit.client.0.smithi152.stdout:9/357: rename d5/d39/d3f/d42/d5f to d5/d6/d74 0 2024-04-06T12:23:53.172 INFO:tasks.workunit.client.0.smithi152.stdout:1/404: mknod d2/d2f/d54/d88/c89 0 2024-04-06T12:23:53.177 INFO:tasks.workunit.client.0.smithi152.stdout:7/399: creat d8/df/d61/d4b/d56/f83 x:0 0 0 2024-04-06T12:23:53.183 INFO:tasks.workunit.client.0.smithi152.stdout:7/400: dread d8/df/d61/d76/d7e/d2c/d2d/f58 [0,4194304] 0 2024-04-06T12:23:53.183 INFO:tasks.workunit.client.0.smithi152.stdout:7/401: chown d8/df/d4a 13644733 1 2024-04-06T12:23:53.187 INFO:tasks.workunit.client.0.smithi152.stdout:8/467: getdents d4/db/d2a/d6e/d88 0 2024-04-06T12:23:53.189 INFO:tasks.workunit.client.0.smithi152.stdout:9/358: creat d5/d6/d74/d17/f75 x:0 0 0 2024-04-06T12:23:53.190 INFO:tasks.workunit.client.0.smithi152.stdout:8/468: dread f3 [0,4194304] 0 2024-04-06T12:23:53.193 INFO:tasks.workunit.client.0.smithi152.stdout:7/402: symlink d8/df/d61/d76/d7e/d2c/l84 0 2024-04-06T12:23:53.198 INFO:tasks.workunit.client.0.smithi152.stdout:9/359: creat d5/d6/d74/d17/d37/f76 x:0 0 0 2024-04-06T12:23:53.200 INFO:tasks.workunit.client.0.smithi152.stdout:7/403: dwrite d8/df/f5e [4194304,4194304] 0 2024-04-06T12:23:53.200 INFO:tasks.workunit.client.0.smithi152.stdout:7/404: read d8/df/f5e [469418,32314] 0 2024-04-06T12:23:53.203 INFO:tasks.workunit.client.0.smithi152.stdout:7/405: write d8/df/d61/d76/d7e/f54 [1219365,96247] 0 2024-04-06T12:23:53.220 INFO:tasks.workunit.client.0.smithi152.stdout:7/406: mkdir d8/df/d61/d6d/d85 0 2024-04-06T12:23:53.222 INFO:tasks.workunit.client.0.smithi152.stdout:7/407: truncate d8/df/d61/d3d/f39 4714433 0 2024-04-06T12:23:53.225 INFO:tasks.workunit.client.0.smithi152.stdout:8/469: getdents d4/db/d56 0 2024-04-06T12:23:53.227 INFO:tasks.workunit.client.0.smithi152.stdout:9/360: creat d5/d6/d74/d17/f77 x:0 0 0 2024-04-06T12:23:53.227 INFO:tasks.workunit.client.0.smithi152.stdout:1/405: link d2/d2f/d54/d88/f40 d2/d61/d85/f8a 0 2024-04-06T12:23:53.230 INFO:tasks.workunit.client.0.smithi152.stdout:7/408: dwrite d8/df/d61/d4b/d56/f83 [0,4194304] 0 2024-04-06T12:23:53.232 INFO:tasks.workunit.client.0.smithi152.stdout:2/489: sync 2024-04-06T12:23:53.232 INFO:tasks.workunit.client.0.smithi152.stdout:4/525: sync 2024-04-06T12:23:53.232 INFO:tasks.workunit.client.0.smithi152.stdout:5/381: sync 2024-04-06T12:23:53.232 INFO:tasks.workunit.client.0.smithi152.stdout:6/465: sync 2024-04-06T12:23:53.234 INFO:tasks.workunit.client.0.smithi152.stdout:8/470: rename d4/dc/d10/d55 to d4/dc/d10/d49/da0 0 2024-04-06T12:23:53.239 INFO:tasks.workunit.client.0.smithi152.stdout:2/490: stat d0/d2/d5/c1a 0 2024-04-06T12:23:53.242 INFO:tasks.workunit.client.0.smithi152.stdout:6/466: write d7/d62/f6f [8413605,110149] 0 2024-04-06T12:23:53.243 INFO:tasks.workunit.client.0.smithi152.stdout:4/526: read d7/d29/d78/f7c [133937,116028] 0 2024-04-06T12:23:53.244 INFO:tasks.workunit.client.0.smithi152.stdout:6/467: dread - d7/d19/d1b/d31/d35/f5c zero size 2024-04-06T12:23:53.244 INFO:tasks.workunit.client.0.smithi152.stdout:4/527: chown d7/d29/d2e/c5d 29 1 2024-04-06T12:23:53.245 INFO:tasks.workunit.client.0.smithi152.stdout:4/528: write d7/fb [3625388,106] 0 2024-04-06T12:23:53.246 INFO:tasks.workunit.client.0.smithi152.stdout:6/468: write d7/d9/d73/f95 [410946,59482] 0 2024-04-06T12:23:53.246 INFO:tasks.workunit.client.0.smithi152.stdout:5/382: creat d3/da/d15/d2b/d3f/d4c/f77 x:0 0 0 2024-04-06T12:23:53.247 INFO:tasks.workunit.client.0.smithi152.stdout:6/469: chown d7/d9/d26/d2e/l47 1103 1 2024-04-06T12:23:53.249 INFO:tasks.workunit.client.0.smithi152.stdout:6/470: write d7/ff [5156080,81286] 0 2024-04-06T12:23:53.249 INFO:tasks.workunit.client.0.smithi152.stdout:1/406: unlink d2/d2f/d54/d88/d28/c5c 0 2024-04-06T12:23:53.250 INFO:tasks.workunit.client.0.smithi152.stdout:8/471: mknod d4/d81/d92/ca1 0 2024-04-06T12:23:53.253 INFO:tasks.workunit.client.0.smithi152.stdout:8/472: write d4/f4a [220011,108450] 0 2024-04-06T12:23:53.255 INFO:tasks.workunit.client.0.smithi152.stdout:4/529: dwrite d7/d29/d7e/f86 [0,4194304] 0 2024-04-06T12:23:53.256 INFO:tasks.workunit.client.0.smithi152.stdout:7/409: mknod d8/df/d61/d76/d7e/c86 0 2024-04-06T12:23:53.262 INFO:tasks.workunit.client.0.smithi152.stdout:6/471: dwrite d7/d19/d3e/d70/f7e [0,4194304] 0 2024-04-06T12:23:53.268 INFO:tasks.workunit.client.0.smithi152.stdout:4/530: dwrite d7/d29/d7e/d59/fac [0,4194304] 0 2024-04-06T12:23:53.268 INFO:tasks.workunit.client.0.smithi152.stdout:7/410: dread d8/d2a/d37/d49/f80 [0,4194304] 0 2024-04-06T12:23:53.274 INFO:tasks.workunit.client.0.smithi152.stdout:9/361: link d5/d6/d74/d17/c71 d5/d39/d3f/d42/c78 0 2024-04-06T12:23:53.275 INFO:tasks.workunit.client.0.smithi152.stdout:5/383: creat d3/da/d15/d40/d4f/d5f/f78 x:0 0 0 2024-04-06T12:23:53.279 INFO:tasks.workunit.client.0.smithi152.stdout:8/473: rename d4/dc/d10/d49/d97 to d4/dc/d10/d49/da2 0 2024-04-06T12:23:53.281 INFO:tasks.workunit.client.0.smithi152.stdout:8/474: truncate d4/db/d2a/f7d 4945550 0 2024-04-06T12:23:53.287 INFO:tasks.workunit.client.0.smithi152.stdout:7/411: unlink d8/f3a 0 2024-04-06T12:23:53.293 INFO:tasks.workunit.client.0.smithi152.stdout:6/472: dwrite d7/d19/d1b/d1f/d3d/f8e [0,4194304] 0 2024-04-06T12:23:53.297 INFO:tasks.workunit.client.0.smithi152.stdout:2/491: link d0/d2/d5/c66 d0/d40/d41/d28/d8c/ca4 0 2024-04-06T12:23:53.299 INFO:tasks.workunit.client.0.smithi152.stdout:9/362: dread d5/d6/f24 [0,4194304] 0 2024-04-06T12:23:53.300 INFO:tasks.workunit.client.0.smithi152.stdout:7/412: dread d8/df/d4a/f64 [0,4194304] 0 2024-04-06T12:23:53.302 INFO:tasks.workunit.client.0.smithi152.stdout:1/407: link d2/d2f/d45/c4d d2/d61/c8b 0 2024-04-06T12:23:53.304 INFO:tasks.workunit.client.0.smithi152.stdout:5/384: dread d3/da/f29 [0,4194304] 0 2024-04-06T12:23:53.304 INFO:tasks.workunit.client.0.smithi152.stdout:8/475: mkdir d4/d81/d9c/da3 0 2024-04-06T12:23:53.305 INFO:tasks.workunit.client.0.smithi152.stdout:6/473: symlink d7/d9/l9c 0 2024-04-06T12:23:53.306 INFO:tasks.workunit.client.0.smithi152.stdout:6/474: readlink d7/d19/l88 0 2024-04-06T12:23:53.307 INFO:tasks.workunit.client.0.smithi152.stdout:8/476: dread d4/db/d39/f66 [0,4194304] 0 2024-04-06T12:23:53.310 INFO:tasks.workunit.client.0.smithi152.stdout:7/413: mkdir d8/df/d28/d87 0 2024-04-06T12:23:53.310 INFO:tasks.workunit.client.0.smithi152.stdout:1/408: stat d2/d2f/d54/d88/c69 0 2024-04-06T12:23:53.314 INFO:tasks.workunit.client.0.smithi152.stdout:6/475: creat d7/d19/f9d x:0 0 0 2024-04-06T12:23:53.316 INFO:tasks.workunit.client.0.smithi152.stdout:6/476: chown d7/d9/d26/d4a/f58 33555706 1 2024-04-06T12:23:53.316 INFO:tasks.workunit.client.0.smithi152.stdout:6/477: fdatasync d7/f1e 0 2024-04-06T12:23:53.319 INFO:tasks.workunit.client.0.smithi152.stdout:9/363: fsync d5/d39/f3d 0 2024-04-06T12:23:53.320 INFO:tasks.workunit.client.0.smithi152.stdout:6/478: read d7/d19/d3e/f72 [150622,64470] 0 2024-04-06T12:23:53.320 INFO:tasks.workunit.client.0.smithi152.stdout:9/364: chown d5/d6/f16 5261530 1 2024-04-06T12:23:53.321 INFO:tasks.workunit.client.0.smithi152.stdout:1/409: mkdir d2/d2f/d54/d88/d28/d8c 0 2024-04-06T12:23:53.328 INFO:tasks.workunit.client.0.smithi152.stdout:7/414: dread d8/df/d4a/f64 [0,4194304] 0 2024-04-06T12:23:53.332 INFO:tasks.workunit.client.0.smithi152.stdout:1/410: rmdir d2/d2f/d54/d71 39 2024-04-06T12:23:53.334 INFO:tasks.workunit.client.0.smithi152.stdout:3/473: sync 2024-04-06T12:23:53.334 INFO:tasks.workunit.client.0.smithi152.stdout:5/385: dread d3/d37/f56 [0,4194304] 0 2024-04-06T12:23:53.335 INFO:tasks.workunit.client.0.smithi152.stdout:0/525: sync 2024-04-06T12:23:53.336 INFO:tasks.workunit.client.0.smithi152.stdout:6/479: dwrite d7/d62/f63 [0,4194304] 0 2024-04-06T12:23:53.340 INFO:tasks.workunit.client.0.smithi152.stdout:8/477: rename d4/f9 to d4/d2c/fa4 0 2024-04-06T12:23:53.340 INFO:tasks.workunit.client.0.smithi152.stdout:2/492: getdents d0/d15/d24/d3d 0 2024-04-06T12:23:53.341 INFO:tasks.workunit.client.0.smithi152.stdout:8/478: dread - d4/d2c/f80 zero size 2024-04-06T12:23:53.344 INFO:tasks.workunit.client.0.smithi152.stdout:2/493: chown d0/fd 209846356 1 2024-04-06T12:23:53.346 INFO:tasks.workunit.client.0.smithi152.stdout:9/365: mkdir d5/d39/d79 0 2024-04-06T12:23:53.347 INFO:tasks.workunit.client.0.smithi152.stdout:1/411: creat d2/d5d/f8d x:0 0 0 2024-04-06T12:23:53.351 INFO:tasks.workunit.client.0.smithi152.stdout:0/526: dwrite d4/de/f68 [0,4194304] 0 2024-04-06T12:23:53.351 INFO:tasks.workunit.client.0.smithi152.stdout:5/386: creat d3/da/d15/d2b/d3f/d4c/f79 x:0 0 0 2024-04-06T12:23:53.355 INFO:tasks.workunit.client.0.smithi152.stdout:3/474: rename d0/d10/d1e/d39 to d0/d10/d13/d2a/d93 0 2024-04-06T12:23:53.363 INFO:tasks.workunit.client.0.smithi152.stdout:7/415: dread d8/d2a/d42/f4c [0,4194304] 0 2024-04-06T12:23:53.364 INFO:tasks.workunit.client.0.smithi152.stdout:2/494: creat d0/d2/d6f/d90/fa5 x:0 0 0 2024-04-06T12:23:53.367 INFO:tasks.workunit.client.0.smithi152.stdout:6/480: mknod d7/d19/d1b/c9e 0 2024-04-06T12:23:53.368 INFO:tasks.workunit.client.0.smithi152.stdout:6/481: chown c4 0 1 2024-04-06T12:23:53.371 INFO:tasks.workunit.client.0.smithi152.stdout:6/482: fsync d7/d9/d26/f74 0 2024-04-06T12:23:53.371 INFO:tasks.workunit.client.0.smithi152.stdout:5/387: dwrite d3/da/d15/d2b/d3f/d4c/f77 [0,4194304] 0 2024-04-06T12:23:53.373 INFO:tasks.workunit.client.0.smithi152.stdout:8/479: unlink d4/d2c/d54/c99 0 2024-04-06T12:23:53.375 INFO:tasks.workunit.client.0.smithi152.stdout:0/527: dread d4/de/d28/f95 [0,4194304] 0 2024-04-06T12:23:53.379 INFO:tasks.workunit.client.0.smithi152.stdout:1/412: mknod d2/d2f/d54/d88/c8e 0 2024-04-06T12:23:53.383 INFO:tasks.workunit.client.0.smithi152.stdout:7/416: creat d8/df/d34/f88 x:0 0 0 2024-04-06T12:23:53.384 INFO:tasks.workunit.client.0.smithi152.stdout:7/417: chown d8/df/d28/d41/d48/l55 14774 1 2024-04-06T12:23:53.386 INFO:tasks.workunit.client.0.smithi152.stdout:2/495: rename d0/d40/d41/f5c to d0/d2/d6f/d90/fa6 0 2024-04-06T12:23:53.388 INFO:tasks.workunit.client.0.smithi152.stdout:2/496: chown d0/d40/d41/d28/d54/f7e 37401680 1 2024-04-06T12:23:53.389 INFO:tasks.workunit.client.0.smithi152.stdout:0/528: symlink d4/de/d28/d18/d3b/d2e/la2 0 2024-04-06T12:23:53.391 INFO:tasks.workunit.client.0.smithi152.stdout:1/413: mkdir d2/d61/d8f 0 2024-04-06T12:23:53.391 INFO:tasks.workunit.client.0.smithi152.stdout:1/414: chown d2/d61/f6c 2 1 2024-04-06T12:23:53.392 INFO:tasks.workunit.client.0.smithi152.stdout:3/475: link d0/d10/d13/d2a/d4b/c52 d0/d35/d43/d48/c94 0 2024-04-06T12:23:53.396 INFO:tasks.workunit.client.0.smithi152.stdout:8/480: creat d4/d5f/d98/fa5 x:0 0 0 2024-04-06T12:23:53.397 INFO:tasks.workunit.client.0.smithi152.stdout:7/418: dread d8/fb [0,4194304] 0 2024-04-06T12:23:53.399 INFO:tasks.workunit.client.0.smithi152.stdout:6/483: rename d7/d9/d26/d4a/f32 to d7/d9/d26/f9f 0 2024-04-06T12:23:53.399 INFO:tasks.workunit.client.0.smithi152.stdout:5/388: rename d3/da to d3/da/d15/d2b/d7a 22 2024-04-06T12:23:53.400 INFO:tasks.workunit.client.0.smithi152.stdout:6/484: chown d7/d19/d1b/d1f/d3d/f8e 127 1 2024-04-06T12:23:53.403 INFO:tasks.workunit.client.0.smithi152.stdout:3/476: mknod d0/d35/d43/c95 0 2024-04-06T12:23:53.405 INFO:tasks.workunit.client.0.smithi152.stdout:4/531: truncate d7/d16/d22/d3f/db4/f37 3430461 0 2024-04-06T12:23:53.405 INFO:tasks.workunit.client.0.smithi152.stdout:3/477: read d0/d1f/d28/f86 [220269,59876] 0 2024-04-06T12:23:53.407 INFO:tasks.workunit.client.0.smithi152.stdout:3/478: write d0/d1f/d28/f74 [1823026,56498] 0 2024-04-06T12:23:53.408 INFO:tasks.workunit.client.0.smithi152.stdout:8/481: dread d4/dc/f82 [0,4194304] 0 2024-04-06T12:23:53.412 INFO:tasks.workunit.client.0.smithi152.stdout:0/529: dread d4/d31/f3d [0,4194304] 0 2024-04-06T12:23:53.416 INFO:tasks.workunit.client.0.smithi152.stdout:6/485: creat d7/d19/d1b/d1f/d3d/fa0 x:0 0 0 2024-04-06T12:23:53.426 INFO:tasks.workunit.client.0.smithi152.stdout:3/479: rename d0/d35/d43/c95 to d0/d10/d13/d2a/d4b/d6a/c96 0 2024-04-06T12:23:53.427 INFO:tasks.workunit.client.0.smithi152.stdout:8/482: mknod d4/db/d56/ca6 0 2024-04-06T12:23:53.431 INFO:tasks.workunit.client.0.smithi152.stdout:2/497: creat d0/fa7 x:0 0 0 2024-04-06T12:23:53.433 INFO:tasks.workunit.client.0.smithi152.stdout:3/480: dwrite d0/d1f/d28/f76 [0,4194304] 0 2024-04-06T12:23:53.437 INFO:tasks.workunit.client.0.smithi152.stdout:3/481: write d0/d10/d45/f6b [1206872,80606] 0 2024-04-06T12:23:53.441 INFO:tasks.workunit.client.0.smithi152.stdout:8/483: dread d4/dc/d10/d51/f23 [0,4194304] 0 2024-04-06T12:23:53.444 INFO:tasks.workunit.client.0.smithi152.stdout:1/415: creat d2/d2f/d54/d88/f90 x:0 0 0 2024-04-06T12:23:53.444 INFO:tasks.workunit.client.0.smithi152.stdout:4/532: mkdir d7/d82/db1/db6 0 2024-04-06T12:23:53.448 INFO:tasks.workunit.client.0.smithi152.stdout:4/533: read d7/d29/d7e/d59/f85 [257088,52032] 0 2024-04-06T12:23:53.452 INFO:tasks.workunit.client.0.smithi152.stdout:0/530: mknod d4/de/d28/ca3 0 2024-04-06T12:23:53.458 INFO:tasks.workunit.client.0.smithi152.stdout:3/482: rename d0/d2d/d7f/l8b to d0/d1f/d28/l97 0 2024-04-06T12:23:53.461 INFO:tasks.workunit.client.0.smithi152.stdout:8/484: mkdir d4/d5f/da7 0 2024-04-06T12:23:53.467 INFO:tasks.workunit.client.0.smithi152.stdout:1/416: fsync d2/d2f/d54/d88/d28/f6f 0 2024-04-06T12:23:53.467 INFO:tasks.workunit.client.0.smithi152.stdout:7/419: getdents d8/d2a/d37/d43 0 2024-04-06T12:23:53.476 INFO:tasks.workunit.client.0.smithi152.stdout:0/531: rename d4/de/d28/d18/d43/c71 to d4/d19/ca4 0 2024-04-06T12:23:53.491 INFO:tasks.workunit.client.0.smithi152.stdout:8/485: rename d4/db/d2a/d6e/c73 to d4/d2c/d2b/ca8 0 2024-04-06T12:23:53.493 INFO:tasks.workunit.client.0.smithi152.stdout:7/420: link d8/df/d34/d5c/f68 d8/df/d4a/d65/f89 0 2024-04-06T12:23:53.496 INFO:tasks.workunit.client.0.smithi152.stdout:0/532: symlink d4/d6e/d8e/la5 0 2024-04-06T12:23:53.500 INFO:tasks.workunit.client.0.smithi152.stdout:8/486: unlink d4/d2c/f80 0 2024-04-06T12:23:53.505 INFO:tasks.workunit.client.0.smithi152.stdout:1/417: rename d2/d2f/d54/d71 to d2/d2f/d37/d91 0 2024-04-06T12:23:53.507 INFO:tasks.workunit.client.0.smithi152.stdout:0/533: chown d4/de/d28/c16 58 1 2024-04-06T12:23:53.509 INFO:tasks.workunit.client.0.smithi152.stdout:8/487: rename d4/db/f58 to d4/db/d56/fa9 0 2024-04-06T12:23:53.510 INFO:tasks.workunit.client.0.smithi152.stdout:1/418: creat d2/d5d/f92 x:0 0 0 2024-04-06T12:23:53.513 INFO:tasks.workunit.client.0.smithi152.stdout:0/534: creat d4/de/d4a/d33/fa6 x:0 0 0 2024-04-06T12:23:53.517 INFO:tasks.workunit.client.0.smithi152.stdout:8/488: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:23:53.517 INFO:tasks.workunit.client.0.smithi152.stdout:0/535: fdatasync d4/fa 0 2024-04-06T12:23:53.519 INFO:tasks.workunit.client.0.smithi152.stdout:2/498: rmdir d0/d2 39 2024-04-06T12:23:53.521 INFO:tasks.workunit.client.0.smithi152.stdout:0/536: dread - d4/de/d28/d18/d43/d81/f91 zero size 2024-04-06T12:23:53.525 INFO:tasks.workunit.client.0.smithi152.stdout:8/489: mknod d4/db/d56/d85/caa 0 2024-04-06T12:23:53.525 INFO:tasks.workunit.client.0.smithi152.stdout:0/537: getdents d4/d98 0 2024-04-06T12:23:53.526 INFO:tasks.workunit.client.0.smithi152.stdout:8/490: fsync d4/db/d39/f50 0 2024-04-06T12:23:53.527 INFO:tasks.workunit.client.0.smithi152.stdout:2/499: mkdir d0/d2/da8 0 2024-04-06T12:23:53.528 INFO:tasks.workunit.client.0.smithi152.stdout:8/491: truncate d4/dc/d10/d18/f34 1003489 0 2024-04-06T12:23:53.538 INFO:tasks.workunit.client.0.smithi152.stdout:0/538: getdents d4/de/d28/d18 0 2024-04-06T12:23:53.540 INFO:tasks.workunit.client.0.smithi152.stdout:0/539: mkdir d4/de/da7 0 2024-04-06T12:23:53.541 INFO:tasks.workunit.client.0.smithi152.stdout:0/540: dread - d4/de/d28/d18/d3b/f9b zero size 2024-04-06T12:23:53.542 INFO:tasks.workunit.client.0.smithi152.stdout:0/541: write d4/de/d28/f66 [1587979,43378] 0 2024-04-06T12:23:53.545 INFO:tasks.workunit.client.0.smithi152.stdout:0/542: truncate d4/de/d28/f40 3666950 0 2024-04-06T12:23:53.547 INFO:tasks.workunit.client.0.smithi152.stdout:0/543: creat d4/d19/fa8 x:0 0 0 2024-04-06T12:23:53.550 INFO:tasks.workunit.client.0.smithi152.stdout:0/544: stat d4/de/d28/f40 0 2024-04-06T12:23:53.553 INFO:tasks.workunit.client.0.smithi152.stdout:5/389: truncate d3/da/d15/f1c 2289198 0 2024-04-06T12:23:53.555 INFO:tasks.workunit.client.0.smithi152.stdout:5/390: creat d3/d9/f7b x:0 0 0 2024-04-06T12:23:53.560 INFO:tasks.workunit.client.0.smithi152.stdout:6/486: write d7/d62/f92 [5263443,32390] 0 2024-04-06T12:23:53.562 INFO:tasks.workunit.client.0.smithi152.stdout:6/487: chown d7/d9/d73/l96 192 1 2024-04-06T12:23:53.562 INFO:tasks.workunit.client.0.smithi152.stdout:0/545: dread d4/de/f1e [0,4194304] 0 2024-04-06T12:23:53.565 INFO:tasks.workunit.client.0.smithi152.stdout:0/546: symlink d4/d36/d72/la9 0 2024-04-06T12:23:53.570 INFO:tasks.workunit.client.0.smithi152.stdout:3/483: truncate d0/d1f/d4a/f54 538442 0 2024-04-06T12:23:53.574 INFO:tasks.workunit.client.0.smithi152.stdout:6/488: dwrite d7/d19/d1b/d31/d35/f5c [0,4194304] 0 2024-04-06T12:23:53.575 INFO:tasks.workunit.client.0.smithi152.stdout:5/391: dread d3/da/d15/d40/d46/f6b [0,4194304] 0 2024-04-06T12:23:53.575 INFO:tasks.workunit.client.0.smithi152.stdout:3/484: fdatasync d0/d10/d13/d2a/d93/d49/f81 0 2024-04-06T12:23:53.576 INFO:tasks.workunit.client.0.smithi152.stdout:6/489: readlink d7/d19/d1b/l3b 0 2024-04-06T12:23:53.576 INFO:tasks.workunit.client.0.smithi152.stdout:4/534: dwrite d7/d29/d78/f39 [0,4194304] 0 2024-04-06T12:23:53.585 INFO:tasks.workunit.client.0.smithi152.stdout:5/392: symlink d3/da/d53/l7c 0 2024-04-06T12:23:53.587 INFO:tasks.workunit.client.0.smithi152.stdout:3/485: creat d0/d1f/d4a/f98 x:0 0 0 2024-04-06T12:23:53.588 INFO:tasks.workunit.client.0.smithi152.stdout:4/535: truncate d7/d29/f2b 4825251 0 2024-04-06T12:23:53.591 INFO:tasks.workunit.client.0.smithi152.stdout:6/490: dread - d7/d9/d26/f3a zero size 2024-04-06T12:23:53.593 INFO:tasks.workunit.client.0.smithi152.stdout:5/393: creat d3/da/f7d x:0 0 0 2024-04-06T12:23:53.594 INFO:tasks.workunit.client.0.smithi152.stdout:1/419: write d2/f7 [1313233,68780] 0 2024-04-06T12:23:53.596 INFO:tasks.workunit.client.0.smithi152.stdout:1/420: write d2/d2f/d37/f4f [408947,57394] 0 2024-04-06T12:23:53.599 INFO:tasks.workunit.client.0.smithi152.stdout:5/394: creat d3/da/d15/d40/d50/f7e x:0 0 0 2024-04-06T12:23:53.601 INFO:tasks.workunit.client.0.smithi152.stdout:8/492: write d4/db/d39/f66 [907682,79800] 0 2024-04-06T12:23:53.602 INFO:tasks.workunit.client.0.smithi152.stdout:3/486: mknod d0/d10/d13/d2a/d93/c99 0 2024-04-06T12:23:53.602 INFO:tasks.workunit.client.0.smithi152.stdout:8/493: stat d4/db/d2a/l37 0 2024-04-06T12:23:53.607 INFO:tasks.workunit.client.0.smithi152.stdout:4/536: mknod d7/d29/d2e/cb7 0 2024-04-06T12:23:53.608 INFO:tasks.workunit.client.0.smithi152.stdout:2/500: dwrite d0/d40/d26/f7b [0,4194304] 0 2024-04-06T12:23:53.612 INFO:tasks.workunit.client.0.smithi152.stdout:6/491: symlink d7/d19/d1b/d1f/la1 0 2024-04-06T12:23:53.614 INFO:tasks.workunit.client.0.smithi152.stdout:5/395: mkdir d3/da/d15/d7f 0 2024-04-06T12:23:53.620 INFO:tasks.workunit.client.0.smithi152.stdout:8/494: rmdir d4/db/d2a 39 2024-04-06T12:23:53.624 INFO:tasks.workunit.client.0.smithi152.stdout:0/547: write d4/d31/f3d [2004332,78714] 0 2024-04-06T12:23:53.629 INFO:tasks.workunit.client.0.smithi152.stdout:2/501: symlink d0/d40/d26/la9 0 2024-04-06T12:23:53.630 INFO:tasks.workunit.client.0.smithi152.stdout:2/502: write d0/d15/d24/d3d/f91 [560009,12136] 0 2024-04-06T12:23:53.637 INFO:tasks.workunit.client.0.smithi152.stdout:8/495: unlink d4/c95 0 2024-04-06T12:23:53.638 INFO:tasks.workunit.client.0.smithi152.stdout:3/487: creat d0/d35/d43/d48/d83/f9a x:0 0 0 2024-04-06T12:23:53.642 INFO:tasks.workunit.client.0.smithi152.stdout:0/548: mkdir d4/de/d28/d18/d43/d62/daa 0 2024-04-06T12:23:53.653 INFO:tasks.workunit.client.0.smithi152.stdout:3/488: symlink d0/d2d/d7f/l9b 0 2024-04-06T12:23:53.654 INFO:tasks.workunit.client.0.smithi152.stdout:8/496: dread d4/dc/fd [0,4194304] 0 2024-04-06T12:23:53.657 INFO:tasks.workunit.client.0.smithi152.stdout:1/421: write d2/f39 [1636737,98482] 0 2024-04-06T12:23:53.666 INFO:tasks.workunit.client.0.smithi152.stdout:8/497: dread d4/db/d56/f69 [0,4194304] 0 2024-04-06T12:23:53.682 INFO:tasks.workunit.client.0.smithi152.stdout:6/492: write d7/d19/d1b/d1f/f2a [2782772,85581] 0 2024-04-06T12:23:53.695 INFO:tasks.workunit.client.0.smithi152.stdout:3/489: creat d0/d1f/f9c x:0 0 0 2024-04-06T12:23:53.696 INFO:tasks.workunit.client.0.smithi152.stdout:4/537: rename l4 to d7/d29/lb8 0 2024-04-06T12:23:53.703 INFO:tasks.workunit.client.0.smithi152.stdout:6/493: unlink d7/d19/d1b/d22/f76 0 2024-04-06T12:23:53.703 INFO:tasks.workunit.client.0.smithi152.stdout:6/494: readlink d7/d19/l88 0 2024-04-06T12:23:53.704 INFO:tasks.workunit.client.0.smithi152.stdout:0/549: rmdir d4/de/d28/d18/d3b/d2e 39 2024-04-06T12:23:53.705 INFO:tasks.workunit.client.0.smithi152.stdout:3/490: fdatasync d0/d35/f82 0 2024-04-06T12:23:53.708 INFO:tasks.workunit.client.0.smithi152.stdout:4/538: mknod d7/d82/cb9 0 2024-04-06T12:23:53.712 INFO:tasks.workunit.client.0.smithi152.stdout:6/495: creat d7/d19/d1b/d22/fa2 x:0 0 0 2024-04-06T12:23:53.713 INFO:tasks.workunit.client.0.smithi152.stdout:6/496: fdatasync d7/d9/d73/f95 0 2024-04-06T12:23:53.713 INFO:tasks.workunit.client.0.smithi152.stdout:0/550: creat d4/d19/fab x:0 0 0 2024-04-06T12:23:53.714 INFO:tasks.workunit.client.0.smithi152.stdout:3/491: mkdir d0/d35/d43/d48/d83/d9d 0 2024-04-06T12:23:53.716 INFO:tasks.workunit.client.0.smithi152.stdout:5/396: rename d3/da/d15/d40/d4e to d3/de/d80 0 2024-04-06T12:23:53.717 INFO:tasks.workunit.client.0.smithi152.stdout:2/503: fsync d0/d2/d5/f1f 0 2024-04-06T12:23:53.718 INFO:tasks.workunit.client.0.smithi152.stdout:4/539: creat d7/d29/d7e/d59/fba x:0 0 0 2024-04-06T12:23:53.723 INFO:tasks.workunit.client.0.smithi152.stdout:2/504: dread d0/d2/d6f/d90/f8b [0,4194304] 0 2024-04-06T12:23:53.724 INFO:tasks.workunit.client.0.smithi152.stdout:6/497: symlink d7/d19/d3e/la3 0 2024-04-06T12:23:53.724 INFO:tasks.workunit.client.0.smithi152.stdout:8/498: write d4/dc/d10/d51/f67 [424570,17063] 0 2024-04-06T12:23:53.727 INFO:tasks.workunit.client.0.smithi152.stdout:8/499: read d4/f4a [254267,117137] 0 2024-04-06T12:23:53.728 INFO:tasks.workunit.client.0.smithi152.stdout:5/397: write d3/da/f29 [4894912,55489] 0 2024-04-06T12:23:53.728 INFO:tasks.workunit.client.0.smithi152.stdout:5/398: dread - d3/d37/f76 zero size 2024-04-06T12:23:53.731 INFO:tasks.workunit.client.0.smithi152.stdout:8/500: dread d4/dc/d10/d51/f61 [0,4194304] 0 2024-04-06T12:23:53.731 INFO:tasks.workunit.client.0.smithi152.stdout:4/540: creat d7/d16/d22/d88/fbb x:0 0 0 2024-04-06T12:23:53.734 INFO:tasks.workunit.client.0.smithi152.stdout:2/505: creat d0/d40/d41/d28/d8c/faa x:0 0 0 2024-04-06T12:23:53.735 INFO:tasks.workunit.client.0.smithi152.stdout:2/506: dread - d0/d15/d4d/f4e zero size 2024-04-06T12:23:53.738 INFO:tasks.workunit.client.0.smithi152.stdout:3/492: mkdir d0/d10/d13/d2a/d93/d49/d8d/d9e 0 2024-04-06T12:23:53.740 INFO:tasks.workunit.client.0.smithi152.stdout:4/541: dwrite d7/f2c [0,4194304] 0 2024-04-06T12:23:53.741 INFO:tasks.workunit.client.0.smithi152.stdout:3/493: read - d0/d35/f88 zero size 2024-04-06T12:23:53.743 INFO:tasks.workunit.client.0.smithi152.stdout:4/542: write d7/f2c [3275374,83142] 0 2024-04-06T12:23:53.746 INFO:tasks.workunit.client.0.smithi152.stdout:1/422: dwrite d2/d1d/f23 [0,4194304] 0 2024-04-06T12:23:53.747 INFO:tasks.workunit.client.0.smithi152.stdout:4/543: write d7/d29/f6d [568455,116443] 0 2024-04-06T12:23:53.753 INFO:tasks.workunit.client.0.smithi152.stdout:4/544: write d7/d16/f6e [1042286,39969] 0 2024-04-06T12:23:53.755 INFO:tasks.workunit.client.0.smithi152.stdout:0/551: dwrite d4/de/d28/d18/d3b/f2f [0,4194304] 0 2024-04-06T12:23:53.758 INFO:tasks.workunit.client.0.smithi152.stdout:0/552: write d4/de/d28/f66 [1972455,102194] 0 2024-04-06T12:23:53.763 INFO:tasks.workunit.client.0.smithi152.stdout:2/507: dread d0/d2/d5/f42 [0,4194304] 0 2024-04-06T12:23:53.765 INFO:tasks.workunit.client.0.smithi152.stdout:3/494: fsync d0/d1f/f23 0 2024-04-06T12:23:53.774 INFO:tasks.workunit.client.0.smithi152.stdout:5/399: dwrite d3/da/f47 [4194304,4194304] 0 2024-04-06T12:23:53.779 INFO:tasks.workunit.client.0.smithi152.stdout:8/501: truncate d4/db/d56/f86 3245031 0 2024-04-06T12:23:53.780 INFO:tasks.workunit.client.0.smithi152.stdout:8/502: stat d4/dc/d10/d49/da2 0 2024-04-06T12:23:53.782 INFO:tasks.workunit.client.0.smithi152.stdout:6/498: getdents d7/d9/d73 0 2024-04-06T12:23:53.789 INFO:tasks.workunit.client.0.smithi152.stdout:5/400: write d3/da/fc [3104003,4574] 0 2024-04-06T12:23:53.793 INFO:tasks.workunit.client.0.smithi152.stdout:8/503: symlink d4/dc/d10/d49/da2/lab 0 2024-04-06T12:23:53.796 INFO:tasks.workunit.client.0.smithi152.stdout:5/401: dwrite d3/da/d53/f60 [4194304,4194304] 0 2024-04-06T12:23:53.802 INFO:tasks.workunit.client.0.smithi152.stdout:8/504: dwrite d4/dc/d10/d49/f4c [0,4194304] 0 2024-04-06T12:23:53.807 INFO:tasks.workunit.client.0.smithi152.stdout:4/545: creat d7/fbc x:0 0 0 2024-04-06T12:23:53.807 INFO:tasks.workunit.client.0.smithi152.stdout:0/553: creat d4/de/d28/d18/d3b/fac x:0 0 0 2024-04-06T12:23:53.808 INFO:tasks.workunit.client.0.smithi152.stdout:0/554: readlink d4/de/d28/d18/d3b/l70 0 2024-04-06T12:23:53.816 INFO:tasks.workunit.client.0.smithi152.stdout:1/423: link d2/d2f/d54/d88/d28/f4e d2/d1d/d7c/f93 0 2024-04-06T12:23:53.817 INFO:tasks.workunit.client.0.smithi152.stdout:1/424: chown d2/d2f/d54/d88/d28/l38 6 1 2024-04-06T12:23:53.817 INFO:tasks.workunit.client.0.smithi152.stdout:6/499: symlink d7/la4 0 2024-04-06T12:23:53.819 INFO:tasks.workunit.client.0.smithi152.stdout:3/495: rename d0/d35/d43/c73 to d0/d10/d13/d2a/d93/c9f 0 2024-04-06T12:23:53.822 INFO:tasks.workunit.client.0.smithi152.stdout:8/505: creat d4/db/d56/fac x:0 0 0 2024-04-06T12:23:53.825 INFO:tasks.workunit.client.0.smithi152.stdout:2/508: link d0/f60 d0/d40/d41/d28/fab 0 2024-04-06T12:23:53.826 INFO:tasks.workunit.client.0.smithi152.stdout:2/509: readlink d0/d15/d24/d3d/l97 0 2024-04-06T12:23:53.827 INFO:tasks.workunit.client.0.smithi152.stdout:0/555: dwrite d4/d31/f34 [0,4194304] 0 2024-04-06T12:23:53.829 INFO:tasks.workunit.client.0.smithi152.stdout:1/425: symlink d2/d2f/d45/l94 0 2024-04-06T12:23:53.833 INFO:tasks.workunit.client.0.smithi152.stdout:5/402: rename d3/d37 to d3/da/d15/d2b/d3f/d68/d81 0 2024-04-06T12:23:53.837 INFO:tasks.workunit.client.0.smithi152.stdout:8/506: unlink d4/d5f/f96 0 2024-04-06T12:23:53.841 INFO:tasks.workunit.client.0.smithi152.stdout:0/556: fdatasync f3 0 2024-04-06T12:23:53.850 INFO:tasks.workunit.client.0.smithi152.stdout:3/496: getdents d0/d35/d43/d48/d83/d9d 0 2024-04-06T12:23:53.856 INFO:tasks.workunit.client.0.smithi152.stdout:3/497: dwrite d0/d1f/f60 [0,4194304] 0 2024-04-06T12:23:53.870 INFO:tasks.workunit.client.0.smithi152.stdout:5/403: write d3/da/d15/d40/d4f/f51 [597591,33000] 0 2024-04-06T12:23:53.873 INFO:tasks.workunit.client.0.smithi152.stdout:2/510: dwrite d0/d2/f7f [0,4194304] 0 2024-04-06T12:23:53.873 INFO:tasks.workunit.client.0.smithi152.stdout:3/498: unlink d0/d35/c63 0 2024-04-06T12:23:53.875 INFO:tasks.workunit.client.0.smithi152.stdout:1/426: creat d2/d2f/d54/f95 x:0 0 0 2024-04-06T12:23:53.878 INFO:tasks.workunit.client.0.smithi152.stdout:4/546: rename d7/f17 to d7/d29/fbd 0 2024-04-06T12:23:53.882 INFO:tasks.workunit.client.0.smithi152.stdout:5/404: dwrite d3/da/d15/f21 [0,4194304] 0 2024-04-06T12:23:53.883 INFO:tasks.workunit.client.0.smithi152.stdout:4/547: write d7/d29/d78/d33/f74 [211973,19921] 0 2024-04-06T12:23:53.884 INFO:tasks.workunit.client.0.smithi152.stdout:8/507: dwrite f3 [0,4194304] 0 2024-04-06T12:23:53.886 INFO:tasks.workunit.client.0.smithi152.stdout:5/405: chown d3/da/f29 1882780 1 2024-04-06T12:23:53.888 INFO:tasks.workunit.client.0.smithi152.stdout:4/548: write d7/d29/d7e/d59/fac [1057982,63151] 0 2024-04-06T12:23:53.889 INFO:tasks.workunit.client.0.smithi152.stdout:2/511: rmdir d0/d15/d24/d79 39 2024-04-06T12:23:53.891 INFO:tasks.workunit.client.0.smithi152.stdout:4/549: truncate d7/d29/d7e/d59/f76 1788172 0 2024-04-06T12:23:53.896 INFO:tasks.workunit.client.0.smithi152.stdout:1/427: write d2/f20 [4915143,39036] 0 2024-04-06T12:23:53.904 INFO:tasks.workunit.client.0.smithi152.stdout:1/428: dwrite d2/f39 [0,4194304] 0 2024-04-06T12:23:53.908 INFO:tasks.workunit.client.0.smithi152.stdout:3/499: truncate d0/d10/d13/f70 3318975 0 2024-04-06T12:23:53.913 INFO:tasks.workunit.client.0.smithi152.stdout:0/557: rename d4/de/d28/d18/d3b/f92 to d4/de/d28/d18/d3b/d2e/fad 0 2024-04-06T12:23:53.914 INFO:tasks.workunit.client.0.smithi152.stdout:0/558: fdatasync d4/d19/f53 0 2024-04-06T12:23:53.916 INFO:tasks.workunit.client.0.smithi152.stdout:8/508: truncate d4/dc/d10/d51/f21 670050 0 2024-04-06T12:23:53.919 INFO:tasks.workunit.client.0.smithi152.stdout:3/500: dwrite d0/d1f/d44/d7c/f8f [0,4194304] 0 2024-04-06T12:23:53.919 INFO:tasks.workunit.client.0.smithi152.stdout:4/550: dread d7/d16/d22/d3f/db4/f50 [4194304,4194304] 0 2024-04-06T12:23:53.919 INFO:tasks.workunit.client.0.smithi152.stdout:1/429: unlink d2/d2f/d37/f44 0 2024-04-06T12:23:53.920 INFO:tasks.workunit.client.0.smithi152.stdout:3/501: fdatasync d0/d2d/f78 0 2024-04-06T12:23:53.920 INFO:tasks.workunit.client.0.smithi152.stdout:1/430: dread - d2/f76 zero size 2024-04-06T12:23:53.926 INFO:tasks.workunit.client.0.smithi152.stdout:2/512: truncate d0/f11 2663640 0 2024-04-06T12:23:53.934 INFO:tasks.workunit.client.0.smithi152.stdout:5/406: link c1 d3/da/d15/d2b/d3f/d4c/c82 0 2024-04-06T12:23:53.937 INFO:tasks.workunit.client.0.smithi152.stdout:2/513: rename d0/d2/f88 to d0/d2/da8/fac 0 2024-04-06T12:23:53.937 INFO:tasks.workunit.client.0.smithi152.stdout:2/514: read - d0/d40/d41/d28/d8c/faa zero size 2024-04-06T12:23:53.938 INFO:tasks.workunit.client.0.smithi152.stdout:2/515: chown d0/d15/d4d/c53 8190 1 2024-04-06T12:23:53.939 INFO:tasks.workunit.client.0.smithi152.stdout:0/559: fsync d4/de/d28/d18/d3b/d2e/d78/f79 0 2024-04-06T12:23:53.941 INFO:tasks.workunit.client.0.smithi152.stdout:0/560: dread d4/d31/f6b [0,4194304] 0 2024-04-06T12:23:53.947 INFO:tasks.workunit.client.0.smithi152.stdout:1/431: link d2/f11 d2/d5d/f96 0 2024-04-06T12:23:53.963 INFO:tasks.workunit.client.0.smithi152.stdout:3/502: truncate d0/fb 1957502 0 2024-04-06T12:23:53.971 INFO:tasks.workunit.client.0.smithi152.stdout:1/432: mknod d2/d2f/d37/d91/c97 0 2024-04-06T12:23:53.985 INFO:tasks.workunit.client.0.smithi152.stdout:8/509: getdents d4/d81/d92/d9d 0 2024-04-06T12:23:53.987 INFO:tasks.workunit.client.0.smithi152.stdout:3/503: rename d0/d1f/d28/l36 to d0/d10/d13/d2a/d93/d49/d8d/la0 0 2024-04-06T12:23:53.988 INFO:tasks.workunit.client.0.smithi152.stdout:3/504: fdatasync d0/d35/d75/f85 0 2024-04-06T12:23:53.988 INFO:tasks.workunit.client.0.smithi152.stdout:3/505: read - d0/d10/f68 zero size 2024-04-06T12:23:53.989 INFO:tasks.workunit.client.0.smithi152.stdout:3/506: write d0/d1f/d28/f74 [3195877,121319] 0 2024-04-06T12:23:53.991 INFO:tasks.workunit.client.0.smithi152.stdout:4/551: getdents d7/d16 0 2024-04-06T12:23:53.991 INFO:tasks.workunit.client.0.smithi152.stdout:5/407: link d3/de/l33 d3/d9/l83 0 2024-04-06T12:23:53.993 INFO:tasks.workunit.client.0.smithi152.stdout:5/408: chown d3/da/d15/d2b/d3f/d68/d81/c69 434 1 2024-04-06T12:23:53.994 INFO:tasks.workunit.client.0.smithi152.stdout:0/561: truncate d4/d19/f4e 3638133 0 2024-04-06T12:23:53.997 INFO:tasks.workunit.client.0.smithi152.stdout:8/510: creat d4/dc/d10/d18/fad x:0 0 0 2024-04-06T12:23:53.998 INFO:tasks.workunit.client.0.smithi152.stdout:8/511: chown d4/dc/f1f 79494653 1 2024-04-06T12:23:53.998 INFO:tasks.workunit.client.0.smithi152.stdout:8/512: fsync d4/d81/f9f 0 2024-04-06T12:23:54.003 INFO:tasks.workunit.client.0.smithi152.stdout:5/409: mknod d3/da/d15/d2b/d3f/d4c/c84 0 2024-04-06T12:23:54.006 INFO:tasks.workunit.client.0.smithi152.stdout:2/516: link d0/d2/d5/d92/la2 d0/d15/d24/d79/lad 0 2024-04-06T12:23:54.011 INFO:tasks.workunit.client.0.smithi152.stdout:8/513: dread - d4/db/f3a zero size 2024-04-06T12:23:54.018 INFO:tasks.workunit.client.0.smithi152.stdout:5/410: creat d3/da/d15/d40/d46/f85 x:0 0 0 2024-04-06T12:23:54.020 INFO:tasks.workunit.client.0.smithi152.stdout:5/411: truncate d3/da/d15/d40/d4f/d5f/f78 370455 0 2024-04-06T12:23:54.021 INFO:tasks.workunit.client.0.smithi152.stdout:5/412: dread - d3/da/f7d zero size 2024-04-06T12:23:54.022 INFO:tasks.workunit.client.0.smithi152.stdout:5/413: chown d3/da/d15/d2b/c42 4 1 2024-04-06T12:23:54.023 INFO:tasks.workunit.client.0.smithi152.stdout:8/514: mkdir d4/dc/d10/d49/dae 0 2024-04-06T12:23:54.024 INFO:tasks.workunit.client.0.smithi152.stdout:4/552: link d7/d16/d22/d3f/db4/d60/l8c d7/d16/d55/lbe 0 2024-04-06T12:23:54.027 INFO:tasks.workunit.client.0.smithi152.stdout:3/507: dwrite d0/d10/d13/d2a/d93/f5f [0,4194304] 0 2024-04-06T12:23:54.028 INFO:tasks.workunit.client.0.smithi152.stdout:0/562: rmdir d4/d98 0 2024-04-06T12:23:54.034 INFO:tasks.workunit.client.0.smithi152.stdout:8/515: creat d4/d2c/d54/faf x:0 0 0 2024-04-06T12:23:54.035 INFO:tasks.workunit.client.0.smithi152.stdout:5/414: rename d3/da/d15/d2b/d4d/c63 to d3/da/d15/d2b/d3f/c86 0 2024-04-06T12:23:54.036 INFO:tasks.workunit.client.0.smithi152.stdout:4/553: mknod d7/d29/d78/cbf 0 2024-04-06T12:23:54.037 INFO:tasks.workunit.client.0.smithi152.stdout:0/563: dwrite d4/de/d28/d99/f9f [0,4194304] 0 2024-04-06T12:23:54.041 INFO:tasks.workunit.client.0.smithi152.stdout:3/508: unlink d0/d1f/l33 0 2024-04-06T12:23:54.047 INFO:tasks.workunit.client.0.smithi152.stdout:5/415: rmdir d3/da/d53 39 2024-04-06T12:23:54.050 INFO:tasks.workunit.client.0.smithi152.stdout:3/509: dwrite d0/d10/d13/d2a/d93/d49/f81 [0,4194304] 0 2024-04-06T12:23:54.053 INFO:tasks.workunit.client.0.smithi152.stdout:2/517: getdents d0/d2 0 2024-04-06T12:23:54.057 INFO:tasks.workunit.client.0.smithi152.stdout:8/516: unlink d4/db/d2a/f7f 0 2024-04-06T12:23:54.075 INFO:tasks.workunit.client.0.smithi152.stdout:2/518: dwrite d0/d2/f21 [0,4194304] 0 2024-04-06T12:23:54.081 INFO:tasks.workunit.client.0.smithi152.stdout:5/416: rename d3/da/f7d to d3/da/d53/f87 0 2024-04-06T12:23:54.085 INFO:tasks.workunit.client.0.smithi152.stdout:3/510: creat d0/d10/d1e/d87/fa1 x:0 0 0 2024-04-06T12:23:54.088 INFO:tasks.workunit.client.0.smithi152.stdout:8/517: mkdir d4/d2c/db0 0 2024-04-06T12:23:54.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/511: dwrite d0/d1f/d28/f74 [0,4194304] 0 2024-04-06T12:23:54.093 INFO:tasks.workunit.client.0.smithi152.stdout:0/564: truncate d4/de/d28/d99/f9f 3403369 0 2024-04-06T12:23:54.093 INFO:tasks.workunit.client.0.smithi152.stdout:3/512: write d0/d10/d13/f6f [5237850,3129] 0 2024-04-06T12:23:54.095 INFO:tasks.workunit.client.0.smithi152.stdout:3/513: chown d0/d10/d13/d2a/d93/d49/c4e 20 1 2024-04-06T12:23:54.099 INFO:tasks.workunit.client.0.smithi152.stdout:4/554: getdents d7/d29/d2e/d7b 0 2024-04-06T12:23:54.100 INFO:tasks.workunit.client.0.smithi152.stdout:4/555: dread - d7/d16/d22/d3f/f81 zero size 2024-04-06T12:23:54.101 INFO:tasks.workunit.client.0.smithi152.stdout:4/556: chown d7/d16/d22/d3f/db4/c40 216 1 2024-04-06T12:23:54.103 INFO:tasks.workunit.client.0.smithi152.stdout:4/557: dread - d7/d16/f68 zero size 2024-04-06T12:23:54.103 INFO:tasks.workunit.client.0.smithi152.stdout:4/558: fsync d7/d29/d7e/d59/fba 0 2024-04-06T12:23:54.105 INFO:tasks.workunit.client.0.smithi152.stdout:2/519: mkdir d0/dae 0 2024-04-06T12:23:54.109 INFO:tasks.workunit.client.0.smithi152.stdout:0/565: rename d4/c1b to d4/de/da7/cae 0 2024-04-06T12:23:54.111 INFO:tasks.workunit.client.0.smithi152.stdout:3/514: fsync d0/d1f/f23 0 2024-04-06T12:23:54.118 INFO:tasks.workunit.client.0.smithi152.stdout:3/515: dwrite d0/d10/d13/f6d [0,4194304] 0 2024-04-06T12:23:54.210 INFO:tasks.workunit.client.0.smithi152.stdout:9/366: sync 2024-04-06T12:23:54.210 INFO:tasks.workunit.client.0.smithi152.stdout:7/421: sync 2024-04-06T12:23:54.211 INFO:tasks.workunit.client.0.smithi152.stdout:7/422: chown d8/df/d28/d41/d48/l55 28387086 1 2024-04-06T12:23:54.213 INFO:tasks.workunit.client.0.smithi152.stdout:4/559: symlink d7/lc0 0 2024-04-06T12:23:54.214 INFO:tasks.workunit.client.0.smithi152.stdout:4/560: read - d7/d16/d55/da0/fa9 zero size 2024-04-06T12:23:54.216 INFO:tasks.workunit.client.0.smithi152.stdout:4/561: fsync d7/d29/d78/d33/f6b 0 2024-04-06T12:23:54.216 INFO:tasks.workunit.client.0.smithi152.stdout:7/423: dread d8/df/d61/d4b/d56/f83 [0,4194304] 0 2024-04-06T12:23:54.216 INFO:tasks.workunit.client.0.smithi152.stdout:8/518: write d4/dc/d10/d51/f21 [234222,128654] 0 2024-04-06T12:23:54.217 INFO:tasks.workunit.client.0.smithi152.stdout:2/520: fdatasync d0/f1c 0 2024-04-06T12:23:54.230 INFO:tasks.workunit.client.0.smithi152.stdout:4/562: symlink d7/d82/db1/lc1 0 2024-04-06T12:23:54.232 INFO:tasks.workunit.client.0.smithi152.stdout:7/424: mkdir d8/d2a/d37/d43/d8a 0 2024-04-06T12:23:54.238 INFO:tasks.workunit.client.0.smithi152.stdout:2/521: creat d0/d40/d41/faf x:0 0 0 2024-04-06T12:23:54.240 INFO:tasks.workunit.client.0.smithi152.stdout:0/566: creat d4/de/faf x:0 0 0 2024-04-06T12:23:54.241 INFO:tasks.workunit.client.0.smithi152.stdout:0/567: readlink d4/de/l5e 0 2024-04-06T12:23:54.248 INFO:tasks.workunit.client.0.smithi152.stdout:2/522: chown d0/d40/l82 896889 1 2024-04-06T12:23:54.254 INFO:tasks.workunit.client.0.smithi152.stdout:2/523: readlink d0/l74 0 2024-04-06T12:23:54.255 INFO:tasks.workunit.client.0.smithi152.stdout:0/568: symlink d4/de/d28/lb0 0 2024-04-06T12:23:54.261 INFO:tasks.workunit.client.0.smithi152.stdout:9/367: rename d5/d6/d74/d17/d23/c60 to d5/c7a 0 2024-04-06T12:23:54.265 INFO:tasks.workunit.client.0.smithi152.stdout:3/516: truncate d0/d10/d1e/f46 976878 0 2024-04-06T12:23:54.266 INFO:tasks.workunit.client.0.smithi152.stdout:3/517: stat d0/d35/d75 0 2024-04-06T12:23:54.266 INFO:tasks.workunit.client.0.smithi152.stdout:0/569: mknod d4/de/d28/d18/d43/d81/cb1 0 2024-04-06T12:23:54.270 INFO:tasks.workunit.client.0.smithi152.stdout:4/563: getdents d7 0 2024-04-06T12:23:54.271 INFO:tasks.workunit.client.0.smithi152.stdout:2/524: fdatasync d0/d2/d6f/d90/fa6 0 2024-04-06T12:23:54.273 INFO:tasks.workunit.client.0.smithi152.stdout:0/570: chown d4/de/d28/c25 526911 1 2024-04-06T12:23:54.275 INFO:tasks.workunit.client.0.smithi152.stdout:0/571: write d4/de/d4a/d33/fa6 [639191,23971] 0 2024-04-06T12:23:54.276 INFO:tasks.workunit.client.0.smithi152.stdout:2/525: symlink d0/d15/d24/d3d/lb0 0 2024-04-06T12:23:54.277 INFO:tasks.workunit.client.0.smithi152.stdout:3/518: truncate d0/fb 1462660 0 2024-04-06T12:23:54.279 INFO:tasks.workunit.client.0.smithi152.stdout:0/572: rmdir d4/d31 39 2024-04-06T12:23:54.282 INFO:tasks.workunit.client.0.smithi152.stdout:3/519: mkdir d0/d10/d1e/d71/da2 0 2024-04-06T12:23:54.285 INFO:tasks.workunit.client.0.smithi152.stdout:0/573: symlink d4/de/d28/d18/d3b/d2e/d78/lb2 0 2024-04-06T12:23:54.285 INFO:tasks.workunit.client.0.smithi152.stdout:4/564: link d7/d29/d7e/l6f d7/d16/d22/d3f/db4/d60/lc2 0 2024-04-06T12:23:54.287 INFO:tasks.workunit.client.0.smithi152.stdout:4/565: chown d7/d29/d2e/d7b/f9f 606664094 1 2024-04-06T12:23:54.289 INFO:tasks.workunit.client.0.smithi152.stdout:0/574: truncate d4/de/d28/d18/d43/d62/f69 862707 0 2024-04-06T12:23:54.289 INFO:tasks.workunit.client.0.smithi152.stdout:3/520: link d0/d35/d43/d48/c5d d0/d35/d43/ca3 0 2024-04-06T12:23:54.292 INFO:tasks.workunit.client.0.smithi152.stdout:0/575: rmdir d4/de/d28/d18/d43 39 2024-04-06T12:23:54.293 INFO:tasks.workunit.client.0.smithi152.stdout:8/519: dwrite d4/dc/d10/d51/f8f [0,4194304] 0 2024-04-06T12:23:54.295 INFO:tasks.workunit.client.0.smithi152.stdout:3/521: creat d0/d2d/d7f/fa4 x:0 0 0 2024-04-06T12:23:54.297 INFO:tasks.workunit.client.0.smithi152.stdout:3/522: write d0/ff [545049,17590] 0 2024-04-06T12:23:54.298 INFO:tasks.workunit.client.0.smithi152.stdout:8/520: creat d4/db/d56/fb1 x:0 0 0 2024-04-06T12:23:54.299 INFO:tasks.workunit.client.0.smithi152.stdout:4/566: dread d7/d29/d7e/f67 [0,4194304] 0 2024-04-06T12:23:54.304 INFO:tasks.workunit.client.0.smithi152.stdout:3/523: unlink d0/d10/d13/f70 0 2024-04-06T12:23:54.306 INFO:tasks.workunit.client.0.smithi152.stdout:4/567: getdents d7/d29/d2e/d7b 0 2024-04-06T12:23:54.306 INFO:tasks.workunit.client.0.smithi152.stdout:3/524: chown d0/d1f/d28/f76 393 1 2024-04-06T12:23:54.306 INFO:tasks.workunit.client.0.smithi152.stdout:8/521: dwrite d4/dc/d10/d51/f8f [0,4194304] 0 2024-04-06T12:23:54.309 INFO:tasks.workunit.client.0.smithi152.stdout:9/368: rmdir d5/d6 39 2024-04-06T12:23:54.310 INFO:tasks.workunit.client.0.smithi152.stdout:8/522: fsync d4/dc/d10/d49/da0/f89 0 2024-04-06T12:23:54.315 INFO:tasks.workunit.client.0.smithi152.stdout:3/525: rmdir d0/d35/d43 39 2024-04-06T12:23:54.316 INFO:tasks.workunit.client.0.smithi152.stdout:4/568: dwrite d7/d16/f68 [0,4194304] 0 2024-04-06T12:23:54.323 INFO:tasks.workunit.client.0.smithi152.stdout:8/523: dwrite d4/dc/d10/d51/f67 [0,4194304] 0 2024-04-06T12:23:54.327 INFO:tasks.workunit.client.0.smithi152.stdout:3/526: mkdir d0/d10/d1e/d71/da2/da5 0 2024-04-06T12:23:54.328 INFO:tasks.workunit.client.0.smithi152.stdout:8/524: mkdir d4/d81/d9c/db2 0 2024-04-06T12:23:54.330 INFO:tasks.workunit.client.0.smithi152.stdout:8/525: dread - d4/db/d2a/d6e/f8b zero size 2024-04-06T12:23:54.336 INFO:tasks.workunit.client.0.smithi152.stdout:3/527: dwrite d0/d35/f88 [0,4194304] 0 2024-04-06T12:23:54.338 INFO:tasks.workunit.client.0.smithi152.stdout:3/528: write d0/d1f/d28/f90 [785099,88405] 0 2024-04-06T12:23:54.340 INFO:tasks.workunit.client.0.smithi152.stdout:3/529: write d0/d10/d1e/d87/fa1 [59544,50610] 0 2024-04-06T12:23:54.346 INFO:tasks.workunit.client.0.smithi152.stdout:2/526: truncate d0/d40/d26/f2a 2120353 0 2024-04-06T12:23:54.354 INFO:tasks.workunit.client.0.smithi152.stdout:2/527: rename d0/f43 to d0/d40/d41/d28/d54/fb1 0 2024-04-06T12:23:54.377 INFO:tasks.workunit.client.0.smithi152.stdout:6/500: sync 2024-04-06T12:23:54.382 INFO:tasks.workunit.client.0.smithi152.stdout:6/501: creat d7/d19/d1b/d1f/d3d/fa5 x:0 0 0 2024-04-06T12:23:54.387 INFO:tasks.workunit.client.0.smithi152.stdout:6/502: write d7/d9/d26/d2e/f42 [1918396,28977] 0 2024-04-06T12:23:54.394 INFO:tasks.workunit.client.0.smithi152.stdout:6/503: fdatasync d7/d19/d3e/f4f 0 2024-04-06T12:23:54.423 INFO:tasks.workunit.client.0.smithi152.stdout:4/569: write d7/d16/d22/d3f/db4/f43 [2712656,11235] 0 2024-04-06T12:23:54.428 INFO:tasks.workunit.client.0.smithi152.stdout:4/570: truncate d7/d29/d78/d33/f71 744519 0 2024-04-06T12:23:54.431 INFO:tasks.workunit.client.0.smithi152.stdout:8/526: truncate d4/d2c/fa4 7317924 0 2024-04-06T12:23:54.435 INFO:tasks.workunit.client.0.smithi152.stdout:4/571: dread d7/d16/d22/d3f/db4/f50 [4194304,4194304] 0 2024-04-06T12:23:54.437 INFO:tasks.workunit.client.0.smithi152.stdout:8/527: symlink d4/dc/d10/d51/lb3 0 2024-04-06T12:23:54.438 INFO:tasks.workunit.client.0.smithi152.stdout:8/528: chown d4/d81/d9c/db2 681687 1 2024-04-06T12:23:54.441 INFO:tasks.workunit.client.0.smithi152.stdout:4/572: symlink d7/d82/db1/db6/lc3 0 2024-04-06T12:23:54.445 INFO:tasks.workunit.client.0.smithi152.stdout:8/529: creat d4/d2c/d2b/d83/fb4 x:0 0 0 2024-04-06T12:23:54.528 INFO:tasks.workunit.client.0.smithi152.stdout:4/573: write d7/d29/d2e/d7b/f9f [67053,128247] 0 2024-04-06T12:23:54.529 INFO:tasks.workunit.client.0.smithi152.stdout:4/574: chown d7/d16/d22/d3f/db4/d60/f9e 53672 1 2024-04-06T12:23:54.529 INFO:tasks.workunit.client.0.smithi152.stdout:4/575: readlink l2 0 2024-04-06T12:23:54.531 INFO:tasks.workunit.client.0.smithi152.stdout:4/576: write d7/d16/d55/da0/f94 [1371780,110313] 0 2024-04-06T12:23:54.532 INFO:tasks.workunit.client.0.smithi152.stdout:4/577: write d7/d29/d2e/d5b/f77 [51829,123278] 0 2024-04-06T12:23:54.535 INFO:tasks.workunit.client.0.smithi152.stdout:8/530: write d4/dc/d10/d49/f64 [1070723,127178] 0 2024-04-06T12:23:54.538 INFO:tasks.workunit.client.0.smithi152.stdout:4/578: getdents d7/d29/d2e/d7b 0 2024-04-06T12:23:54.539 INFO:tasks.workunit.client.0.smithi152.stdout:8/531: creat d4/dc/d10/d51/fb5 x:0 0 0 2024-04-06T12:23:54.543 INFO:tasks.workunit.client.0.smithi152.stdout:4/579: dwrite d7/d29/d7e/f86 [0,4194304] 0 2024-04-06T12:23:54.543 INFO:tasks.workunit.client.0.smithi152.stdout:8/532: read d4/dc/f40 [141122,38765] 0 2024-04-06T12:23:54.546 INFO:tasks.workunit.client.0.smithi152.stdout:4/580: truncate d7/d29/d2e/f8a 1040338 0 2024-04-06T12:23:54.546 INFO:tasks.workunit.client.0.smithi152.stdout:8/533: dread d4/f8 [0,4194304] 0 2024-04-06T12:23:54.553 INFO:tasks.workunit.client.0.smithi152.stdout:8/534: unlink d4/dc/d10/d49/da0/f6f 0 2024-04-06T12:23:54.554 INFO:tasks.workunit.client.0.smithi152.stdout:8/535: fsync d4/d2c/d2b/d83/fb4 0 2024-04-06T12:23:54.554 INFO:tasks.workunit.client.0.smithi152.stdout:8/536: fsync d4/db/d56/fac 0 2024-04-06T12:23:54.556 INFO:tasks.workunit.client.0.smithi152.stdout:8/537: read d4/d2c/d54/f75 [1448494,115644] 0 2024-04-06T12:23:54.557 INFO:tasks.workunit.client.0.smithi152.stdout:8/538: stat d4/d2c/d54 0 2024-04-06T12:23:54.562 INFO:tasks.workunit.client.0.smithi152.stdout:8/539: mkdir d4/d81/d92/db6 0 2024-04-06T12:23:54.565 INFO:tasks.workunit.client.0.smithi152.stdout:8/540: creat d4/dc/fb7 x:0 0 0 2024-04-06T12:23:54.575 INFO:tasks.workunit.client.0.smithi152.stdout:6/504: unlink d7/d19/d3e/la3 0 2024-04-06T12:23:54.577 INFO:tasks.workunit.client.0.smithi152.stdout:8/541: dread d4/dc/d10/d49/f70 [0,4194304] 0 2024-04-06T12:23:54.578 INFO:tasks.workunit.client.0.smithi152.stdout:6/505: symlink d7/d19/d1b/d31/la6 0 2024-04-06T12:23:54.578 INFO:tasks.workunit.client.0.smithi152.stdout:8/542: readlink d4/dc/d10/d51/l1b 0 2024-04-06T12:23:54.582 INFO:tasks.workunit.client.0.smithi152.stdout:6/506: fsync d7/d19/d3e/d70/f77 0 2024-04-06T12:23:54.587 INFO:tasks.workunit.client.0.smithi152.stdout:4/581: rmdir d7/d29/d7e 39 2024-04-06T12:23:54.587 INFO:tasks.workunit.client.0.smithi152.stdout:4/582: readlink d7/lab 0 2024-04-06T12:23:54.588 INFO:tasks.workunit.client.0.smithi152.stdout:4/583: write d7/d29/d78/f39 [5346232,9976] 0 2024-04-06T12:23:54.590 INFO:tasks.workunit.client.0.smithi152.stdout:4/584: write d7/d29/d78/f39 [5582474,72808] 0 2024-04-06T12:23:54.604 INFO:tasks.workunit.client.0.smithi152.stdout:4/585: truncate d7/d16/d55/f99 3065816 0 2024-04-06T12:23:54.607 INFO:tasks.workunit.client.0.smithi152.stdout:6/507: link d7/d19/f81 d7/d19/d1b/d1f/d3d/fa7 0 2024-04-06T12:23:54.610 INFO:tasks.workunit.client.0.smithi152.stdout:4/586: fdatasync d7/d29/d7e/f86 0 2024-04-06T12:23:54.610 INFO:tasks.workunit.client.0.smithi152.stdout:6/508: truncate d7/d9/f10 261709 0 2024-04-06T12:23:54.610 INFO:tasks.workunit.client.0.smithi152.stdout:4/587: fsync d7/fb 0 2024-04-06T12:23:54.616 INFO:tasks.workunit.client.0.smithi152.stdout:6/509: chown d7/d19/l79 22039 1 2024-04-06T12:23:54.617 INFO:tasks.workunit.client.0.smithi152.stdout:4/588: mkdir d7/d16/d22/d3f/db4/d60/dc4 0 2024-04-06T12:23:54.629 INFO:tasks.workunit.client.0.smithi152.stdout:4/589: dread d7/d29/d7e/d59/fac [0,4194304] 0 2024-04-06T12:23:54.630 INFO:tasks.workunit.client.0.smithi152.stdout:4/590: chown d7/c9c 0 1 2024-04-06T12:23:54.630 INFO:tasks.workunit.client.0.smithi152.stdout:1/433: sync 2024-04-06T12:23:54.631 INFO:tasks.workunit.client.0.smithi152.stdout:6/510: link d7/f78 d7/fa8 0 2024-04-06T12:23:54.631 INFO:tasks.workunit.client.0.smithi152.stdout:4/591: write d7/d16/d55/fa7 [1338546,98054] 0 2024-04-06T12:23:54.633 INFO:tasks.workunit.client.0.smithi152.stdout:4/592: dread - d7/d16/d22/d3f/fa2 zero size 2024-04-06T12:23:54.636 INFO:tasks.workunit.client.0.smithi152.stdout:4/593: write d7/d29/d2e/f8a [298418,104239] 0 2024-04-06T12:23:54.645 INFO:tasks.workunit.client.0.smithi152.stdout:4/594: truncate d7/d16/d22/d3f/db4/f37 849291 0 2024-04-06T12:23:54.646 INFO:tasks.workunit.client.0.smithi152.stdout:4/595: chown d7/d16/l4d 933 1 2024-04-06T12:23:54.647 INFO:tasks.workunit.client.0.smithi152.stdout:4/596: write d7/d29/f65 [748401,117680] 0 2024-04-06T12:23:54.654 INFO:tasks.workunit.client.0.smithi152.stdout:8/543: write d4/db/d39/f3f [841256,51632] 0 2024-04-06T12:23:54.655 INFO:tasks.workunit.client.0.smithi152.stdout:4/597: dread d7/d29/d78/f7c [0,4194304] 0 2024-04-06T12:23:54.662 INFO:tasks.workunit.client.0.smithi152.stdout:8/544: dwrite d4/dc/d10/d51/fb5 [0,4194304] 0 2024-04-06T12:23:54.682 INFO:tasks.workunit.client.0.smithi152.stdout:8/545: creat d4/d5f/fb8 x:0 0 0 2024-04-06T12:23:54.683 INFO:tasks.workunit.client.0.smithi152.stdout:8/546: readlink d4/db/d2a/l7c 0 2024-04-06T12:23:54.687 INFO:tasks.workunit.client.0.smithi152.stdout:8/547: rename d4/dc/d10/d51/f21 to d4/d81/d9c/da3/fb9 0 2024-04-06T12:23:54.689 INFO:tasks.workunit.client.0.smithi152.stdout:8/548: mkdir d4/d81/d9c/db2/dba 0 2024-04-06T12:23:54.692 INFO:tasks.workunit.client.0.smithi152.stdout:8/549: fsync d4/f36 0 2024-04-06T12:23:54.697 INFO:tasks.workunit.client.0.smithi152.stdout:1/434: dwrite d2/f36 [0,4194304] 0 2024-04-06T12:23:54.698 INFO:tasks.workunit.client.0.smithi152.stdout:6/511: dwrite d7/d9/f2b [0,4194304] 0 2024-04-06T12:23:54.723 INFO:tasks.workunit.client.0.smithi152.stdout:6/512: write d7/d19/d3e/f8b [104446,84779] 0 2024-04-06T12:23:54.724 INFO:tasks.workunit.client.0.smithi152.stdout:1/435: truncate d2/fb 1054572 0 2024-04-06T12:23:54.726 INFO:tasks.workunit.client.0.smithi152.stdout:4/598: stat d7/d29/f2b 0 2024-04-06T12:23:54.727 INFO:tasks.workunit.client.0.smithi152.stdout:8/550: dwrite d4/dc/d10/d51/f23 [0,4194304] 0 2024-04-06T12:23:54.728 INFO:tasks.workunit.client.0.smithi152.stdout:8/551: readlink d4/dc/d10/d51/lb3 0 2024-04-06T12:23:54.729 INFO:tasks.workunit.client.0.smithi152.stdout:1/436: mknod d2/d61/c98 0 2024-04-06T12:23:54.729 INFO:tasks.workunit.client.0.smithi152.stdout:8/552: fsync d4/db/d2a/f7d 0 2024-04-06T12:23:54.731 INFO:tasks.workunit.client.0.smithi152.stdout:4/599: rmdir d7/d29/d78 39 2024-04-06T12:23:54.733 INFO:tasks.workunit.client.0.smithi152.stdout:6/513: symlink d7/d19/d1b/d1f/la9 0 2024-04-06T12:23:54.739 INFO:tasks.workunit.client.0.smithi152.stdout:4/600: fsync d7/d29/d78/f39 0 2024-04-06T12:23:54.740 INFO:tasks.workunit.client.0.smithi152.stdout:6/514: dread - d7/d19/d1b/f7f zero size 2024-04-06T12:23:54.743 INFO:tasks.workunit.client.0.smithi152.stdout:4/601: dread d7/f2c [0,4194304] 0 2024-04-06T12:23:54.749 INFO:tasks.workunit.client.0.smithi152.stdout:8/553: creat d4/fbb x:0 0 0 2024-04-06T12:23:54.751 INFO:tasks.workunit.client.0.smithi152.stdout:8/554: write d4/db/d56/f69 [1337044,95966] 0 2024-04-06T12:23:54.754 INFO:tasks.workunit.client.0.smithi152.stdout:4/602: fdatasync d7/d29/d7e/f67 0 2024-04-06T12:23:54.755 INFO:tasks.workunit.client.0.smithi152.stdout:4/603: fdatasync d7/d29/f65 0 2024-04-06T12:23:54.758 INFO:tasks.workunit.client.0.smithi152.stdout:8/555: dwrite d4/dc/d10/d49/f4c [0,4194304] 0 2024-04-06T12:23:54.759 INFO:tasks.workunit.client.0.smithi152.stdout:8/556: write d4/db/d56/fac [34597,111946] 0 2024-04-06T12:23:54.760 INFO:tasks.workunit.client.0.smithi152.stdout:6/515: getdents d7/d9/d73 0 2024-04-06T12:23:54.765 INFO:tasks.workunit.client.0.smithi152.stdout:8/557: creat d4/d2c/d2b/d83/fbc x:0 0 0 2024-04-06T12:23:54.769 INFO:tasks.workunit.client.0.smithi152.stdout:6/516: symlink d7/d9/d26/d2e/laa 0 2024-04-06T12:23:54.771 INFO:tasks.workunit.client.0.smithi152.stdout:4/604: dwrite d7/d16/d22/d3f/db4/f50 [4194304,4194304] 0 2024-04-06T12:23:54.776 INFO:tasks.workunit.client.0.smithi152.stdout:8/558: dwrite d4/db/d32/f52 [4194304,4194304] 0 2024-04-06T12:23:54.783 INFO:tasks.workunit.client.0.smithi152.stdout:8/559: chown d4/d2c/d2b/ca8 792 1 2024-04-06T12:23:54.785 INFO:tasks.workunit.client.0.smithi152.stdout:6/517: dwrite d7/d19/d1b/d1f/f2a [0,4194304] 0 2024-04-06T12:23:54.787 INFO:tasks.workunit.client.0.smithi152.stdout:4/605: dwrite d7/d29/f65 [0,4194304] 0 2024-04-06T12:23:54.798 INFO:tasks.workunit.client.0.smithi152.stdout:6/518: dwrite d7/d19/d1b/d1f/d3d/f8e [0,4194304] 0 2024-04-06T12:23:54.799 INFO:tasks.workunit.client.0.smithi152.stdout:6/519: dread - d7/d19/f9d zero size 2024-04-06T12:23:54.800 INFO:tasks.workunit.client.0.smithi152.stdout:8/560: link d4/db/d2a/l7c d4/d81/d92/db6/lbd 0 2024-04-06T12:23:54.803 INFO:tasks.workunit.client.0.smithi152.stdout:8/561: read d4/dc/d10/d49/f72 [129858,19527] 0 2024-04-06T12:23:54.811 INFO:tasks.workunit.client.0.smithi152.stdout:8/562: dwrite d4/db/d39/f3f [4194304,4194304] 0 2024-04-06T12:23:54.812 INFO:tasks.workunit.client.0.smithi152.stdout:6/520: link d7/d9/d26/d2e/c93 d7/d19/d1b/d22/cab 0 2024-04-06T12:23:54.813 INFO:tasks.workunit.client.0.smithi152.stdout:8/563: chown d4/d2c/d2b 314140088 1 2024-04-06T12:23:54.821 INFO:tasks.workunit.client.0.smithi152.stdout:6/521: dwrite d7/d62/f6f [0,4194304] 0 2024-04-06T12:23:54.834 INFO:tasks.workunit.client.0.smithi152.stdout:6/522: dwrite d7/d19/d3e/d70/f7e [0,4194304] 0 2024-04-06T12:23:54.842 INFO:tasks.workunit.client.0.smithi152.stdout:6/523: dread d7/d19/f55 [0,4194304] 0 2024-04-06T12:23:54.848 INFO:tasks.workunit.client.0.smithi152.stdout:6/524: read - d7/d19/d1b/d31/f37 zero size 2024-04-06T12:23:54.848 INFO:tasks.workunit.client.0.smithi152.stdout:6/525: mknod d7/d19/d3e/cac 0 2024-04-06T12:23:54.855 INFO:tasks.workunit.client.0.smithi152.stdout:6/526: dwrite d7/d19/d1b/d31/d7c/f9b [0,4194304] 0 2024-04-06T12:23:54.861 INFO:tasks.workunit.client.0.smithi152.stdout:8/564: write d4/db/d56/f86 [3297307,34137] 0 2024-04-06T12:23:54.864 INFO:tasks.workunit.client.0.smithi152.stdout:6/527: creat d7/fad x:0 0 0 2024-04-06T12:23:54.868 INFO:tasks.workunit.client.0.smithi152.stdout:6/528: creat d7/d9/d26/d2e/fae x:0 0 0 2024-04-06T12:23:54.874 INFO:tasks.workunit.client.0.smithi152.stdout:5/417: sync 2024-04-06T12:23:54.874 INFO:tasks.workunit.client.0.smithi152.stdout:7/425: sync 2024-04-06T12:23:54.875 INFO:tasks.workunit.client.0.smithi152.stdout:7/426: write d8/df/d34/d5c/f82 [317666,119258] 0 2024-04-06T12:23:54.878 INFO:tasks.workunit.client.0.smithi152.stdout:5/418: read d3/de/f22 [55268,78513] 0 2024-04-06T12:23:54.882 INFO:tasks.workunit.client.0.smithi152.stdout:5/419: read - d3/da/d15/d40/d46/f85 zero size 2024-04-06T12:23:54.884 INFO:tasks.workunit.client.0.smithi152.stdout:8/565: dwrite d4/dc/d10/d18/f26 [0,4194304] 0 2024-04-06T12:23:54.887 INFO:tasks.workunit.client.0.smithi152.stdout:7/427: dwrite d8/df/f5e [8388608,4194304] 0 2024-04-06T12:23:54.888 INFO:tasks.workunit.client.0.smithi152.stdout:8/566: write d4/db/d56/f86 [288647,73537] 0 2024-04-06T12:23:54.896 INFO:tasks.workunit.client.0.smithi152.stdout:7/428: creat d8/d2a/d37/d49/d7b/f8b x:0 0 0 2024-04-06T12:23:54.898 INFO:tasks.workunit.client.0.smithi152.stdout:8/567: truncate d4/f8 236421 0 2024-04-06T12:23:54.903 INFO:tasks.workunit.client.0.smithi152.stdout:8/568: rename d4/dc/d10/d18 to d4/d81/d92/d9d/dbe 0 2024-04-06T12:23:54.906 INFO:tasks.workunit.client.0.smithi152.stdout:8/569: rmdir d4/d2c/d2b 39 2024-04-06T12:23:54.908 INFO:tasks.workunit.client.0.smithi152.stdout:5/420: dread d3/d9/fb [0,4194304] 0 2024-04-06T12:23:54.910 INFO:tasks.workunit.client.0.smithi152.stdout:8/570: rename d4/d81/d9c to d4/d2c/dbf 0 2024-04-06T12:23:54.916 INFO:tasks.workunit.client.0.smithi152.stdout:5/421: getdents d3/da/d15/d40/d4f/d5f 0 2024-04-06T12:23:54.917 INFO:tasks.workunit.client.0.smithi152.stdout:7/429: truncate d8/df/d61/d4b/f69 2267188 0 2024-04-06T12:23:54.918 INFO:tasks.workunit.client.0.smithi152.stdout:5/422: symlink d3/da/d15/d2b/d4d/l88 0 2024-04-06T12:23:54.920 INFO:tasks.workunit.client.0.smithi152.stdout:8/571: rename d4/d81/d92 to d4/dc/d10/d49/da0/dc0 0 2024-04-06T12:23:54.922 INFO:tasks.workunit.client.0.smithi152.stdout:5/423: symlink d3/de/d80/l89 0 2024-04-06T12:23:54.922 INFO:tasks.workunit.client.0.smithi152.stdout:5/424: chown d3/da/d15/d2b/d3f 0 1 2024-04-06T12:23:54.929 INFO:tasks.workunit.client.0.smithi152.stdout:5/425: symlink d3/da/d53/l8a 0 2024-04-06T12:23:54.932 INFO:tasks.workunit.client.0.smithi152.stdout:8/572: creat d4/dc/d10/d49/dae/fc1 x:0 0 0 2024-04-06T12:23:54.933 INFO:tasks.workunit.client.0.smithi152.stdout:7/430: truncate d8/df/f5e 9304759 0 2024-04-06T12:23:54.934 INFO:tasks.workunit.client.0.smithi152.stdout:8/573: write d4/db/d32/f52 [3524012,109936] 0 2024-04-06T12:23:54.938 INFO:tasks.workunit.client.0.smithi152.stdout:8/574: creat d4/d2c/dbf/fc2 x:0 0 0 2024-04-06T12:23:54.939 INFO:tasks.workunit.client.0.smithi152.stdout:5/426: dread d3/de/d80/f5d [0,4194304] 0 2024-04-06T12:23:54.940 INFO:tasks.workunit.client.0.smithi152.stdout:7/431: rename d8/df/d61/d76/d7e/d2c to d8/d2a/d37/d8c 0 2024-04-06T12:23:54.941 INFO:tasks.workunit.client.0.smithi152.stdout:5/427: dread - d3/da/d15/d2b/d3f/d4c/f79 zero size 2024-04-06T12:23:54.943 INFO:tasks.workunit.client.0.smithi152.stdout:8/575: rmdir d4/db/d2a/d6e/d88 39 2024-04-06T12:23:54.947 INFO:tasks.workunit.client.0.smithi152.stdout:5/428: chown c1 25 1 2024-04-06T12:23:54.949 INFO:tasks.workunit.client.0.smithi152.stdout:8/576: chown d4/dc/f19 95413 1 2024-04-06T12:23:54.950 INFO:tasks.workunit.client.0.smithi152.stdout:7/432: mkdir d8/df/d61/d3d/d6e/d8d 0 2024-04-06T12:23:54.953 INFO:tasks.workunit.client.0.smithi152.stdout:5/429: rmdir d3/de/d80 39 2024-04-06T12:23:54.954 INFO:tasks.workunit.client.0.smithi152.stdout:5/430: chown d3/da/d15 3 1 2024-04-06T12:23:54.955 INFO:tasks.workunit.client.0.smithi152.stdout:5/431: chown d3/da/d15/d40/d50/f61 594859 1 2024-04-06T12:23:54.956 INFO:tasks.workunit.client.0.smithi152.stdout:5/432: fsync d3/da/d15/d2b/d3f/d4c/f79 0 2024-04-06T12:23:54.957 INFO:tasks.workunit.client.0.smithi152.stdout:8/577: creat d4/dc/d10/d49/da0/dc0/db6/fc3 x:0 0 0 2024-04-06T12:23:54.962 INFO:tasks.workunit.client.0.smithi152.stdout:5/433: symlink d3/de/d80/l8b 0 2024-04-06T12:23:54.962 INFO:tasks.workunit.client.0.smithi152.stdout:7/433: getdents d8/d2a 0 2024-04-06T12:23:54.963 INFO:tasks.workunit.client.0.smithi152.stdout:7/434: write d8/df/d34/d63/f71 [50736,130252] 0 2024-04-06T12:23:54.964 INFO:tasks.workunit.client.0.smithi152.stdout:7/435: chown d8/f6f 21934 1 2024-04-06T12:23:54.967 INFO:tasks.workunit.client.0.smithi152.stdout:8/578: link d4/db/d2a/f7d d4/dc/d10/fc4 0 2024-04-06T12:23:54.968 INFO:tasks.workunit.client.0.smithi152.stdout:8/579: truncate d4/dc/fb7 476135 0 2024-04-06T12:23:54.968 INFO:tasks.workunit.client.0.smithi152.stdout:7/436: creat d8/df/d34/d5c/f8e x:0 0 0 2024-04-06T12:23:54.970 INFO:tasks.workunit.client.0.smithi152.stdout:5/434: mkdir d3/de/d8c 0 2024-04-06T12:23:54.974 INFO:tasks.workunit.client.0.smithi152.stdout:5/435: creat d3/da/d15/d2b/d3f/d4c/f8d x:0 0 0 2024-04-06T12:23:54.977 INFO:tasks.workunit.client.0.smithi152.stdout:7/437: rename d8/c1f to d8/c8f 0 2024-04-06T12:23:54.979 INFO:tasks.workunit.client.0.smithi152.stdout:8/580: link d4/d2c/d2b/d83/fb4 d4/d2c/db0/fc5 0 2024-04-06T12:23:54.980 INFO:tasks.workunit.client.0.smithi152.stdout:5/436: dwrite d3/da/d15/d40/d4f/d5f/f78 [0,4194304] 0 2024-04-06T12:23:54.984 INFO:tasks.workunit.client.0.smithi152.stdout:7/438: mknod d8/d2a/c90 0 2024-04-06T12:23:54.985 INFO:tasks.workunit.client.0.smithi152.stdout:7/439: dread - d8/df/d4a/d65/f89 zero size 2024-04-06T12:23:54.985 INFO:tasks.workunit.client.0.smithi152.stdout:7/440: stat d8/df/d28/d75 0 2024-04-06T12:23:54.986 INFO:tasks.workunit.client.0.smithi152.stdout:8/581: rmdir d4/dc/d10/d49/da0 39 2024-04-06T12:23:54.987 INFO:tasks.workunit.client.0.smithi152.stdout:8/582: readlink d4/dc/d10/l42 0 2024-04-06T12:23:54.990 INFO:tasks.workunit.client.0.smithi152.stdout:8/583: dread d4/dc/d10/d49/f72 [0,4194304] 0 2024-04-06T12:23:54.990 INFO:tasks.workunit.client.0.smithi152.stdout:5/437: rmdir d3/de/d80 39 2024-04-06T12:23:54.992 INFO:tasks.workunit.client.0.smithi152.stdout:5/438: dread - d3/da/d15/d2b/d3f/d68/d81/f76 zero size 2024-04-06T12:23:54.999 INFO:tasks.workunit.client.0.smithi152.stdout:8/584: symlink d4/db/d32/lc6 0 2024-04-06T12:23:55.003 INFO:tasks.workunit.client.0.smithi152.stdout:7/441: symlink d8/df/d61/d4b/l91 0 2024-04-06T12:23:55.004 INFO:tasks.workunit.client.0.smithi152.stdout:5/439: dwrite d3/da/d15/d40/d46/f6b [0,4194304] 0 2024-04-06T12:23:55.006 INFO:tasks.workunit.client.0.smithi152.stdout:8/585: unlink d4/db/d56/l71 0 2024-04-06T12:23:55.017 INFO:tasks.workunit.client.0.smithi152.stdout:7/442: rename d8/d2a/d37/d8c/d2d/f58 to d8/df/d34/d63/f92 0 2024-04-06T12:23:55.019 INFO:tasks.workunit.client.0.smithi152.stdout:8/586: creat d4/dc/d10/d51/fc7 x:0 0 0 2024-04-06T12:23:55.025 INFO:tasks.workunit.client.0.smithi152.stdout:8/587: dwrite d4/db/d39/f66 [0,4194304] 0 2024-04-06T12:23:55.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:53.584001+0000 mgr.smithi195.ausetj (mgr.24375) 81 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 916 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 93 MiB/s wr, 187 op/s 2024-04-06T12:23:55.027 INFO:tasks.workunit.client.0.smithi152.stdout:7/443: link d8/d2a/d37/f47 d8/df/d61/d6d/f93 0 2024-04-06T12:23:55.030 INFO:tasks.workunit.client.0.smithi152.stdout:8/588: fsync d4/db/d2a/f3e 0 2024-04-06T12:23:55.033 INFO:tasks.workunit.client.0.smithi152.stdout:7/444: readlink d8/df/d61/d3d/l7d 0 2024-04-06T12:23:55.033 INFO:tasks.workunit.client.0.smithi152.stdout:7/445: chown d8/la 90 1 2024-04-06T12:23:55.033 INFO:tasks.workunit.client.0.smithi152.stdout:5/440: write d3/f1f [3985826,1816] 0 2024-04-06T12:23:55.039 INFO:tasks.workunit.client.0.smithi152.stdout:8/589: rmdir d4/d2c/dbf 39 2024-04-06T12:23:55.042 INFO:tasks.workunit.client.0.smithi152.stdout:5/441: rmdir d3/da/d15/d40 39 2024-04-06T12:23:55.045 INFO:tasks.workunit.client.0.smithi152.stdout:7/446: mknod d8/df/d61/d3d/d6e/d8d/c94 0 2024-04-06T12:23:55.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:53.584001+0000 mgr.smithi195.ausetj (mgr.24375) 81 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 916 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 93 MiB/s wr, 187 op/s 2024-04-06T12:23:55.088 INFO:tasks.workunit.client.0.smithi152.stdout:8/590: chown d4/db/d2a/d6e/d88/c94 2 1 2024-04-06T12:23:55.090 INFO:tasks.workunit.client.0.smithi152.stdout:7/447: creat d8/d2a/d37/d79/d81/f95 x:0 0 0 2024-04-06T12:23:55.092 INFO:tasks.workunit.client.0.smithi152.stdout:8/591: chown d4/dc/d10/d49/da0 13265 1 2024-04-06T12:23:55.093 INFO:tasks.workunit.client.0.smithi152.stdout:7/448: symlink d8/l96 0 2024-04-06T12:23:55.096 INFO:tasks.workunit.client.0.smithi152.stdout:7/449: creat d8/d74/f97 x:0 0 0 2024-04-06T12:23:55.099 INFO:tasks.workunit.client.0.smithi152.stdout:8/592: dwrite d4/dc/d10/d51/f61 [0,4194304] 0 2024-04-06T12:23:55.105 INFO:tasks.workunit.client.0.smithi152.stdout:7/450: dwrite d8/df/d34/f67 [0,4194304] 0 2024-04-06T12:23:55.107 INFO:tasks.workunit.client.0.smithi152.stdout:8/593: symlink d4/d2c/dbf/db2/lc8 0 2024-04-06T12:23:55.109 INFO:tasks.workunit.client.0.smithi152.stdout:8/594: truncate d4/db/d2a/f79 718752 0 2024-04-06T12:23:55.113 INFO:tasks.workunit.client.0.smithi152.stdout:7/451: mkdir d8/df/d61/d98 0 2024-04-06T12:23:55.114 INFO:tasks.workunit.client.0.smithi152.stdout:7/452: chown d8/df/d61/d76/d7e/f54 1777 1 2024-04-06T12:23:55.119 INFO:tasks.workunit.client.0.smithi152.stdout:7/453: creat d8/d2a/d37/d8c/d2d/d7a/f99 x:0 0 0 2024-04-06T12:23:55.122 INFO:tasks.workunit.client.0.smithi152.stdout:7/454: unlink d8/df/d28/d41/d48/c60 0 2024-04-06T12:23:55.124 INFO:tasks.workunit.client.0.smithi152.stdout:7/455: write f3 [8016863,16918] 0 2024-04-06T12:23:55.125 INFO:tasks.workunit.client.0.smithi152.stdout:7/456: chown d8/f16 0 1 2024-04-06T12:23:55.125 INFO:tasks.workunit.client.0.smithi152.stdout:8/595: truncate d4/dc/d10/d51/fb5 1829755 0 2024-04-06T12:23:55.130 INFO:tasks.workunit.client.0.smithi152.stdout:8/596: creat d4/dc/d10/fc9 x:0 0 0 2024-04-06T12:23:55.131 INFO:tasks.workunit.client.0.smithi152.stdout:8/597: chown d4/ce 752601 1 2024-04-06T12:23:55.131 INFO:tasks.workunit.client.0.smithi152.stdout:7/457: dread d8/d2a/d37/d8c/d2d/f32 [0,4194304] 0 2024-04-06T12:23:55.132 INFO:tasks.workunit.client.0.smithi152.stdout:9/369: sync 2024-04-06T12:23:55.132 INFO:tasks.workunit.client.0.smithi152.stdout:7/458: dread - d8/d74/f97 zero size 2024-04-06T12:23:55.132 INFO:tasks.workunit.client.0.smithi152.stdout:0/576: sync 2024-04-06T12:23:55.133 INFO:tasks.workunit.client.0.smithi152.stdout:3/530: sync 2024-04-06T12:23:55.136 INFO:tasks.workunit.client.0.smithi152.stdout:0/577: mknod d4/de/d87/d94/cb3 0 2024-04-06T12:23:55.137 INFO:tasks.workunit.client.0.smithi152.stdout:3/531: mknod d0/d10/d45/ca6 0 2024-04-06T12:23:55.143 INFO:tasks.workunit.client.0.smithi152.stdout:7/459: dwrite d8/d2a/d37/d8c/d2d/d7a/f99 [0,4194304] 0 2024-04-06T12:23:55.145 INFO:tasks.workunit.client.0.smithi152.stdout:3/532: mknod d0/d10/d45/ca7 0 2024-04-06T12:23:55.146 INFO:tasks.workunit.client.0.smithi152.stdout:8/598: dread d4/d2c/d54/f75 [0,4194304] 0 2024-04-06T12:23:55.146 INFO:tasks.workunit.client.0.smithi152.stdout:8/599: stat d4/dc/d10/d51/l9b 0 2024-04-06T12:23:55.155 INFO:tasks.workunit.client.0.smithi152.stdout:7/460: rmdir d8/d2a/d37/d43 39 2024-04-06T12:23:55.157 INFO:tasks.workunit.client.0.smithi152.stdout:3/533: mkdir d0/d10/d1e/d87/da8 0 2024-04-06T12:23:55.158 INFO:tasks.workunit.client.0.smithi152.stdout:3/534: write d0/d1f/d44/d7c/f8f [4400230,53242] 0 2024-04-06T12:23:55.159 INFO:tasks.workunit.client.0.smithi152.stdout:8/600: rmdir d4/d81 39 2024-04-06T12:23:55.160 INFO:tasks.workunit.client.0.smithi152.stdout:3/535: chown d0/d10/d13/d2a/d93/d49/d8d 2 1 2024-04-06T12:23:55.170 INFO:tasks.workunit.client.0.smithi152.stdout:3/536: creat d0/d1f/d28/fa9 x:0 0 0 2024-04-06T12:23:55.170 INFO:tasks.workunit.client.0.smithi152.stdout:9/370: truncate d5/d6/f73 2134776 0 2024-04-06T12:23:55.179 INFO:tasks.workunit.client.0.smithi152.stdout:9/371: rmdir d5/d6/d74/d17/d23/d2d/d32 39 2024-04-06T12:23:55.186 INFO:tasks.workunit.client.0.smithi152.stdout:7/461: write d8/df/d61/d4b/f69 [3088082,69842] 0 2024-04-06T12:23:55.191 INFO:tasks.workunit.client.0.smithi152.stdout:8/601: getdents d4/db/d56 0 2024-04-06T12:23:55.194 INFO:tasks.workunit.client.0.smithi152.stdout:0/578: rename d4/de/d4a/d33/f86 to d4/de/d28/d18/d3b/fb4 0 2024-04-06T12:23:55.195 INFO:tasks.workunit.client.0.smithi152.stdout:0/579: dread d4/fa [0,4194304] 0 2024-04-06T12:23:55.196 INFO:tasks.workunit.client.0.smithi152.stdout:8/602: dread - d4/d81/f9f zero size 2024-04-06T12:23:55.199 INFO:tasks.workunit.client.0.smithi152.stdout:7/462: rename d8/la to d8/d2a/d37/d49/d7b/l9a 0 2024-04-06T12:23:55.203 INFO:tasks.workunit.client.0.smithi152.stdout:8/603: mknod d4/dc/d10/d49/dae/cca 0 2024-04-06T12:23:55.208 INFO:tasks.workunit.client.0.smithi152.stdout:7/463: dwrite d8/d74/f97 [0,4194304] 0 2024-04-06T12:23:55.210 INFO:tasks.workunit.client.0.smithi152.stdout:0/580: dread d4/de/f68 [0,4194304] 0 2024-04-06T12:23:55.216 INFO:tasks.workunit.client.0.smithi152.stdout:8/604: dwrite d4/db/d39/f3f [4194304,4194304] 0 2024-04-06T12:23:55.217 INFO:tasks.workunit.client.0.smithi152.stdout:8/605: readlink d4/db/d32/l5a 0 2024-04-06T12:23:55.226 INFO:tasks.workunit.client.0.smithi152.stdout:9/372: rename d5/d6/d74/d17/d23/d2d/d4b/l5e to d5/d6/d74/d17/d23/d2d/d32/d36/l7b 0 2024-04-06T12:23:55.227 INFO:tasks.workunit.client.0.smithi152.stdout:0/581: creat d4/de/d28/d99/fb5 x:0 0 0 2024-04-06T12:23:55.228 INFO:tasks.workunit.client.0.smithi152.stdout:7/464: creat d8/d2a/d37/d43/f9b x:0 0 0 2024-04-06T12:23:55.229 INFO:tasks.workunit.client.0.smithi152.stdout:9/373: write d5/d6/d74/d17/f75 [270113,83865] 0 2024-04-06T12:23:55.231 INFO:tasks.workunit.client.0.smithi152.stdout:8/606: rename d4/db/d2a to d4/db/d56/dcb 0 2024-04-06T12:23:55.237 INFO:tasks.workunit.client.0.smithi152.stdout:9/374: creat d5/d39/d79/f7c x:0 0 0 2024-04-06T12:23:55.238 INFO:tasks.workunit.client.0.smithi152.stdout:0/582: dwrite d4/de/d28/d18/d3b/f5a [0,4194304] 0 2024-04-06T12:23:55.239 INFO:tasks.workunit.client.0.smithi152.stdout:7/465: dwrite d8/d2a/d37/d8c/d2d/d7a/f99 [0,4194304] 0 2024-04-06T12:23:55.245 INFO:tasks.workunit.client.0.smithi152.stdout:8/607: symlink d4/d2c/dbf/da3/lcc 0 2024-04-06T12:23:55.246 INFO:tasks.workunit.client.0.smithi152.stdout:8/608: chown d4/ce 4412 1 2024-04-06T12:23:55.250 INFO:tasks.workunit.client.0.smithi152.stdout:7/466: unlink d8/d2a/c90 0 2024-04-06T12:23:55.256 INFO:tasks.workunit.client.0.smithi152.stdout:0/583: dread d4/de/d28/d18/d43/f5f [0,4194304] 0 2024-04-06T12:23:55.259 INFO:tasks.workunit.client.0.smithi152.stdout:8/609: dread d4/db/d32/f4b [0,4194304] 0 2024-04-06T12:23:55.260 INFO:tasks.workunit.client.0.smithi152.stdout:7/467: dwrite d8/d2a/d37/d49/d7b/f8b [0,4194304] 0 2024-04-06T12:23:55.262 INFO:tasks.workunit.client.0.smithi152.stdout:0/584: read d4/d19/f53 [2035233,113247] 0 2024-04-06T12:23:55.265 INFO:tasks.workunit.client.0.smithi152.stdout:9/375: getdents d5 0 2024-04-06T12:23:55.266 INFO:tasks.workunit.client.0.smithi152.stdout:0/585: fdatasync d4/de/d87/f6a 0 2024-04-06T12:23:55.267 INFO:tasks.workunit.client.0.smithi152.stdout:7/468: write d8/df/d61/d4b/f69 [3557151,98497] 0 2024-04-06T12:23:55.269 INFO:tasks.workunit.client.0.smithi152.stdout:9/376: stat c1 0 2024-04-06T12:23:55.270 INFO:tasks.workunit.client.0.smithi152.stdout:0/586: truncate d4/de/faf 295904 0 2024-04-06T12:23:55.271 INFO:tasks.workunit.client.0.smithi152.stdout:8/610: dwrite d4/dc/f25 [0,4194304] 0 2024-04-06T12:23:55.276 INFO:tasks.workunit.client.0.smithi152.stdout:0/587: creat d4/de/d4a/fb6 x:0 0 0 2024-04-06T12:23:55.283 INFO:tasks.workunit.client.0.smithi152.stdout:7/469: truncate d8/df/f5e 9670552 0 2024-04-06T12:23:55.284 INFO:tasks.workunit.client.0.smithi152.stdout:7/470: write d8/d2a/d42/f57 [1955837,124714] 0 2024-04-06T12:23:55.285 INFO:tasks.workunit.client.0.smithi152.stdout:0/588: mkdir d4/de/d7f/db7 0 2024-04-06T12:23:55.285 INFO:tasks.workunit.client.0.smithi152.stdout:7/471: stat d8/df/d61/ld 0 2024-04-06T12:23:55.289 INFO:tasks.workunit.client.0.smithi152.stdout:7/472: dread d8/df/d34/d5c/f82 [0,4194304] 0 2024-04-06T12:23:55.297 INFO:tasks.workunit.client.0.smithi152.stdout:7/473: truncate d8/df/d61/d6d/f93 1430554 0 2024-04-06T12:23:55.297 INFO:tasks.workunit.client.0.smithi152.stdout:9/377: dread d5/d6/f2c [0,4194304] 0 2024-04-06T12:23:55.300 INFO:tasks.workunit.client.0.smithi152.stdout:0/589: dread d4/de/f30 [0,4194304] 0 2024-04-06T12:23:55.304 INFO:tasks.workunit.client.0.smithi152.stdout:7/474: dwrite d8/df/d34/d5c/f8e [0,4194304] 0 2024-04-06T12:23:55.305 INFO:tasks.workunit.client.0.smithi152.stdout:7/475: stat d8/df/f25 0 2024-04-06T12:23:55.307 INFO:tasks.workunit.client.0.smithi152.stdout:7/476: write d8/df/d61/fe [1927751,7413] 0 2024-04-06T12:23:55.345 INFO:tasks.workunit.client.0.smithi152.stdout:2/528: sync 2024-04-06T12:23:55.345 INFO:tasks.workunit.client.0.smithi152.stdout:1/437: sync 2024-04-06T12:23:55.345 INFO:tasks.workunit.client.0.smithi152.stdout:4/606: sync 2024-04-06T12:23:55.355 INFO:tasks.workunit.client.0.smithi152.stdout:8/611: write d4/d2c/dbf/da3/fb9 [1020013,4770] 0 2024-04-06T12:23:55.357 INFO:tasks.workunit.client.0.smithi152.stdout:7/477: write d8/df/d4a/f64 [4117981,17505] 0 2024-04-06T12:23:55.359 INFO:tasks.workunit.client.0.smithi152.stdout:2/529: write d0/d15/d24/d3d/f4f [1434525,7738] 0 2024-04-06T12:23:55.364 INFO:tasks.workunit.client.0.smithi152.stdout:7/478: dread d8/df/d34/d63/f71 [0,4194304] 0 2024-04-06T12:23:55.366 INFO:tasks.workunit.client.0.smithi152.stdout:0/590: dwrite d4/de/d28/d18/d3b/f42 [0,4194304] 0 2024-04-06T12:23:55.366 INFO:tasks.workunit.client.0.smithi152.stdout:7/479: stat d8/df/d28 0 2024-04-06T12:23:55.372 INFO:tasks.workunit.client.0.smithi152.stdout:7/480: chown d8/df/d34/f88 0 1 2024-04-06T12:23:55.378 INFO:tasks.workunit.client.0.smithi152.stdout:0/591: dread d4/de/d28/d18/d3b/f5a [0,4194304] 0 2024-04-06T12:23:55.379 INFO:tasks.workunit.client.0.smithi152.stdout:2/530: rename d0/d2/da8 to d0/d15/d4d/db2 0 2024-04-06T12:23:55.381 INFO:tasks.workunit.client.0.smithi152.stdout:4/607: unlink d7/d29/d78/d33/f44 0 2024-04-06T12:23:55.387 INFO:tasks.workunit.client.0.smithi152.stdout:1/438: creat d2/f99 x:0 0 0 2024-04-06T12:23:55.391 INFO:tasks.workunit.client.0.smithi152.stdout:0/592: symlink d4/de/d28/d18/d43/d81/lb8 0 2024-04-06T12:23:55.397 INFO:tasks.workunit.client.0.smithi152.stdout:0/593: chown d4/de/d87/d94/f6c 10980100 1 2024-04-06T12:23:55.398 INFO:tasks.workunit.client.0.smithi152.stdout:4/608: mkdir d7/d29/d2e/d5b/dc5 0 2024-04-06T12:23:55.401 INFO:tasks.workunit.client.0.smithi152.stdout:4/609: chown d7/fb 1338629 1 2024-04-06T12:23:55.405 INFO:tasks.workunit.client.0.smithi152.stdout:7/481: rename d8/df/d61/d6d/f93 to d8/df/d34/d5c/f9c 0 2024-04-06T12:23:55.406 INFO:tasks.workunit.client.0.smithi152.stdout:7/482: stat d8/d2a/d42/f6b 0 2024-04-06T12:23:55.409 INFO:tasks.workunit.client.0.smithi152.stdout:1/439: dwrite d2/d2f/d45/f77 [0,4194304] 0 2024-04-06T12:23:55.416 INFO:tasks.workunit.client.0.smithi152.stdout:1/440: symlink d2/d2f/d37/l9a 0 2024-04-06T12:23:55.418 INFO:tasks.workunit.client.0.smithi152.stdout:0/594: mkdir d4/d31/d47/d7e/db9 0 2024-04-06T12:23:55.420 INFO:tasks.workunit.client.0.smithi152.stdout:1/441: chown d2/d1d/l31 370 1 2024-04-06T12:23:55.421 INFO:tasks.workunit.client.0.smithi152.stdout:1/442: readlink d2/d2f/d54/d88/d28/l2c 0 2024-04-06T12:23:55.426 INFO:tasks.workunit.client.0.smithi152.stdout:0/595: dwrite d4/de/d4a/d33/fa6 [0,4194304] 0 2024-04-06T12:23:55.427 INFO:tasks.workunit.client.0.smithi152.stdout:0/596: chown d4/de/d28/d18/d43 210 1 2024-04-06T12:23:55.433 INFO:tasks.workunit.client.0.smithi152.stdout:7/483: dread d8/df/d61/d76/d7e/f1a [4194304,4194304] 0 2024-04-06T12:23:55.436 INFO:tasks.workunit.client.0.smithi152.stdout:1/443: link d2/d61/d85/f8a d2/d2f/f9b 0 2024-04-06T12:23:55.436 INFO:tasks.workunit.client.0.smithi152.stdout:1/444: chown d2/d2f/f65 1347701 1 2024-04-06T12:23:55.437 INFO:tasks.workunit.client.0.smithi152.stdout:0/597: rename d4/de/d28/d18/c82 to d4/de/da7/cba 0 2024-04-06T12:23:55.438 INFO:tasks.workunit.client.0.smithi152.stdout:0/598: stat d4/de/d28/d18 0 2024-04-06T12:23:55.441 INFO:tasks.workunit.client.0.smithi152.stdout:0/599: mknod d4/de/d28/d18/d43/cbb 0 2024-04-06T12:23:55.443 INFO:tasks.workunit.client.0.smithi152.stdout:1/445: mkdir d2/d2f/d54/d88/d9c 0 2024-04-06T12:23:55.444 INFO:tasks.workunit.client.0.smithi152.stdout:1/446: read d2/d2f/f32 [7099997,5548] 0 2024-04-06T12:23:55.447 INFO:tasks.workunit.client.0.smithi152.stdout:0/600: symlink d4/de/d7f/db7/lbc 0 2024-04-06T12:23:55.448 INFO:tasks.workunit.client.0.smithi152.stdout:0/601: chown d4/d6e/d8e/la5 1 1 2024-04-06T12:23:55.450 INFO:tasks.workunit.client.0.smithi152.stdout:0/602: mkdir d4/d19/dbd 0 2024-04-06T12:23:55.452 INFO:tasks.workunit.client.0.smithi152.stdout:1/447: mknod d2/c9d 0 2024-04-06T12:23:55.453 INFO:tasks.workunit.client.0.smithi152.stdout:1/448: stat d2/d2f/d54/f7f 0 2024-04-06T12:23:55.467 INFO:tasks.workunit.client.0.smithi152.stdout:8/612: dwrite d4/db/f68 [0,4194304] 0 2024-04-06T12:23:55.470 INFO:tasks.workunit.client.0.smithi152.stdout:8/613: mkdir d4/db/d56/d85/dcd 0 2024-04-06T12:23:55.473 INFO:tasks.workunit.client.0.smithi152.stdout:8/614: mkdir d4/db/d56/d85/dce 0 2024-04-06T12:23:55.473 INFO:tasks.workunit.client.0.smithi152.stdout:8/615: write f3 [2382172,91987] 0 2024-04-06T12:23:55.478 INFO:tasks.workunit.client.0.smithi152.stdout:2/531: write d0/d15/d24/f5b [1395743,102319] 0 2024-04-06T12:23:55.502 INFO:tasks.workunit.client.0.smithi152.stdout:8/616: truncate d4/db/d56/f86 3098333 0 2024-04-06T12:23:55.503 INFO:tasks.workunit.client.0.smithi152.stdout:8/617: write d4/d2c/d54/faf [1031588,62094] 0 2024-04-06T12:23:55.510 INFO:tasks.workunit.client.0.smithi152.stdout:2/532: dwrite d0/d2/d5/d3a/f58 [0,4194304] 0 2024-04-06T12:23:55.512 INFO:tasks.workunit.client.0.smithi152.stdout:8/618: dwrite d4/dc/d10/d49/f70 [0,4194304] 0 2024-04-06T12:23:55.532 INFO:tasks.workunit.client.0.smithi152.stdout:8/619: dwrite d4/dc/f5b [0,4194304] 0 2024-04-06T12:23:55.539 INFO:tasks.workunit.client.0.smithi152.stdout:5/442: sync 2024-04-06T12:23:55.539 INFO:tasks.workunit.client.0.smithi152.stdout:6/529: sync 2024-04-06T12:23:55.547 INFO:tasks.workunit.client.0.smithi152.stdout:6/530: dwrite d7/d19/d1b/d31/d35/f5c [0,4194304] 0 2024-04-06T12:23:55.551 INFO:tasks.workunit.client.0.smithi152.stdout:6/531: stat d7/d19/d1b/d1f/d3d/f8e 0 2024-04-06T12:23:55.555 INFO:tasks.workunit.client.0.smithi152.stdout:8/620: write d4/dc/f40 [285532,25359] 0 2024-04-06T12:23:55.561 INFO:tasks.workunit.client.0.smithi152.stdout:5/443: dread d3/da/f71 [4194304,4194304] 0 2024-04-06T12:23:55.569 INFO:tasks.workunit.client.0.smithi152.stdout:8/621: mknod d4/d5f/da7/ccf 0 2024-04-06T12:23:55.573 INFO:tasks.workunit.client.0.smithi152.stdout:8/622: dread d4/dc/d10/d49/f4c [0,4194304] 0 2024-04-06T12:23:55.575 INFO:tasks.workunit.client.0.smithi152.stdout:5/444: mkdir d3/de/d8e 0 2024-04-06T12:23:55.576 INFO:tasks.workunit.client.0.smithi152.stdout:6/532: truncate d7/d9/d26/f52 456783 0 2024-04-06T12:23:55.577 INFO:tasks.workunit.client.0.smithi152.stdout:6/533: read d7/d19/f55 [20783,64325] 0 2024-04-06T12:23:55.578 INFO:tasks.workunit.client.0.smithi152.stdout:6/534: readlink d7/d19/l79 0 2024-04-06T12:23:55.579 INFO:tasks.workunit.client.0.smithi152.stdout:8/623: creat d4/d2c/d2b/fd0 x:0 0 0 2024-04-06T12:23:55.583 INFO:tasks.workunit.client.0.smithi152.stdout:6/535: creat d7/d9/d26/d2e/faf x:0 0 0 2024-04-06T12:23:55.587 INFO:tasks.workunit.client.0.smithi152.stdout:8/624: creat d4/d2c/d2b/d83/fd1 x:0 0 0 2024-04-06T12:23:55.589 INFO:tasks.workunit.client.0.smithi152.stdout:5/445: dread d3/da/f13 [0,4194304] 0 2024-04-06T12:23:55.590 INFO:tasks.workunit.client.0.smithi152.stdout:5/446: read d3/da/f13 [1354043,9061] 0 2024-04-06T12:23:55.592 INFO:tasks.workunit.client.0.smithi152.stdout:8/625: mknod d4/db/d56/dcb/d6e/d88/cd2 0 2024-04-06T12:23:55.601 INFO:tasks.workunit.client.0.smithi152.stdout:6/536: link d7/d19/d1b/f7f d7/fb0 0 2024-04-06T12:23:55.604 INFO:tasks.workunit.client.0.smithi152.stdout:8/626: creat d4/db/d56/d85/dce/fd3 x:0 0 0 2024-04-06T12:23:55.612 INFO:tasks.workunit.client.0.smithi152.stdout:8/627: mkdir d4/db/d56/dcb/d6e/dd4 0 2024-04-06T12:23:55.613 INFO:tasks.workunit.client.0.smithi152.stdout:8/628: read d4/dc/d10/d49/f70 [4539509,91267] 0 2024-04-06T12:23:55.614 INFO:tasks.workunit.client.0.smithi152.stdout:8/629: write d4/d2c/d2b/d83/fd1 [603268,74015] 0 2024-04-06T12:23:55.616 INFO:tasks.workunit.client.0.smithi152.stdout:8/630: dread d4/dc/fb7 [0,4194304] 0 2024-04-06T12:23:55.624 INFO:tasks.workunit.client.0.smithi152.stdout:8/631: mkdir d4/db/d56/dcb/dd5 0 2024-04-06T12:23:55.628 INFO:tasks.workunit.client.0.smithi152.stdout:5/447: dwrite d3/da/d15/d2b/d3f/d68/d81/f45 [4194304,4194304] 0 2024-04-06T12:23:55.639 INFO:tasks.workunit.client.0.smithi152.stdout:6/537: dwrite d7/d9/f48 [0,4194304] 0 2024-04-06T12:23:55.642 INFO:tasks.workunit.client.0.smithi152.stdout:5/448: mkdir d3/de/d80/d8f 0 2024-04-06T12:23:55.646 INFO:tasks.workunit.client.0.smithi152.stdout:6/538: mknod d7/d9/d73/cb1 0 2024-04-06T12:23:55.652 INFO:tasks.workunit.client.0.smithi152.stdout:6/539: dwrite d7/d19/d3e/f40 [0,4194304] 0 2024-04-06T12:23:55.654 INFO:tasks.workunit.client.0.smithi152.stdout:6/540: write d7/d19/d1b/d22/fa2 [639376,5563] 0 2024-04-06T12:23:55.665 INFO:tasks.workunit.client.0.smithi152.stdout:8/632: dwrite d4/d2c/db0/fc5 [0,4194304] 0 2024-04-06T12:23:55.693 INFO:tasks.workunit.client.0.smithi152.stdout:8/633: write d4/db/d32/f4b [1504967,125492] 0 2024-04-06T12:23:55.698 INFO:tasks.workunit.client.0.smithi152.stdout:6/541: dwrite d7/d19/d1b/d1f/d3d/fa7 [0,4194304] 0 2024-04-06T12:23:55.699 INFO:tasks.workunit.client.0.smithi152.stdout:8/634: rename d4/dc/d10/f2d to d4/db/d56/d85/fd6 0 2024-04-06T12:23:55.719 INFO:tasks.workunit.client.0.smithi152.stdout:6/542: write d7/d19/f23 [4560153,103715] 0 2024-04-06T12:23:55.724 INFO:tasks.workunit.client.0.smithi152.stdout:8/635: truncate d4/db/d39/f3f 6256035 0 2024-04-06T12:23:55.728 INFO:tasks.workunit.client.0.smithi152.stdout:8/636: dread d4/dc/d10/d51/f8f [0,4194304] 0 2024-04-06T12:23:55.734 INFO:tasks.workunit.client.0.smithi152.stdout:3/537: sync 2024-04-06T12:23:55.734 INFO:tasks.workunit.client.0.smithi152.stdout:9/378: sync 2024-04-06T12:23:55.734 INFO:tasks.workunit.client.0.smithi152.stdout:8/637: rmdir d4/db/d56/dcb/d6e 39 2024-04-06T12:23:55.735 INFO:tasks.workunit.client.0.smithi152.stdout:8/638: dread - d4/dc/d10/fc9 zero size 2024-04-06T12:23:55.737 INFO:tasks.workunit.client.0.smithi152.stdout:6/543: write d7/f78 [460100,129479] 0 2024-04-06T12:23:55.738 INFO:tasks.workunit.client.0.smithi152.stdout:6/544: dread - d7/d19/d3e/f9a zero size 2024-04-06T12:23:55.740 INFO:tasks.workunit.client.0.smithi152.stdout:9/379: symlink d5/l7d 0 2024-04-06T12:23:55.744 INFO:tasks.workunit.client.0.smithi152.stdout:6/545: dwrite f6 [0,4194304] 0 2024-04-06T12:23:55.744 INFO:tasks.workunit.client.0.smithi152.stdout:8/639: mknod d4/d2c/db0/cd7 0 2024-04-06T12:23:55.748 INFO:tasks.workunit.client.0.smithi152.stdout:3/538: symlink d0/d10/d1e/d71/da2/da5/laa 0 2024-04-06T12:23:55.757 INFO:tasks.workunit.client.0.smithi152.stdout:6/546: mkdir d7/d19/d1b/db2 0 2024-04-06T12:23:55.760 INFO:tasks.workunit.client.0.smithi152.stdout:8/640: creat d4/dc/d10/d49/da0/d91/fd8 x:0 0 0 2024-04-06T12:23:55.762 INFO:tasks.workunit.client.0.smithi152.stdout:3/539: rename d0/d1f/d4a/f54 to d0/d2d/d7f/d8c/fab 0 2024-04-06T12:23:55.763 INFO:tasks.workunit.client.0.smithi152.stdout:8/641: truncate d4/db/d56/fb1 3094 0 2024-04-06T12:23:55.764 INFO:tasks.workunit.client.0.smithi152.stdout:3/540: stat d0/d10/d1e/l29 0 2024-04-06T12:23:55.764 INFO:tasks.workunit.client.0.smithi152.stdout:6/547: symlink d7/d19/d1b/d31/lb3 0 2024-04-06T12:23:55.766 INFO:tasks.workunit.client.0.smithi152.stdout:3/541: chown d0/d2d/d7f 5890 1 2024-04-06T12:23:55.766 INFO:tasks.workunit.client.0.smithi152.stdout:9/380: dwrite d5/d6/d74/d17/d37/f76 [0,4194304] 0 2024-04-06T12:23:55.767 INFO:tasks.workunit.client.0.smithi152.stdout:8/642: mknod d4/d2c/d2b/cd9 0 2024-04-06T12:23:55.767 INFO:tasks.workunit.client.0.smithi152.stdout:9/381: stat d5/d6/d74/d17/c2b 0 2024-04-06T12:23:55.770 INFO:tasks.workunit.client.0.smithi152.stdout:3/542: creat d0/d35/d75/fac x:0 0 0 2024-04-06T12:23:55.771 INFO:tasks.workunit.client.0.smithi152.stdout:3/543: stat d0/d35/f82 0 2024-04-06T12:23:55.774 INFO:tasks.workunit.client.0.smithi152.stdout:9/382: symlink d5/d6/d74/d17/d23/d2d/d32/l7e 0 2024-04-06T12:23:55.775 INFO:tasks.workunit.client.0.smithi152.stdout:9/383: fdatasync d5/d6/d74/d17/d23/d2d/d4b/d5a/f6d 0 2024-04-06T12:23:55.777 INFO:tasks.workunit.client.0.smithi152.stdout:3/544: chown d0/d35/d43/d48/d83/d9d 28060195 1 2024-04-06T12:23:55.785 INFO:tasks.workunit.client.0.smithi152.stdout:9/384: dwrite d5/d6/d74/d17/f75 [0,4194304] 0 2024-04-06T12:23:55.786 INFO:tasks.workunit.client.0.smithi152.stdout:3/545: dwrite d0/ff [4194304,4194304] 0 2024-04-06T12:23:55.786 INFO:tasks.workunit.client.0.smithi152.stdout:6/548: link d7/d19/d3e/f4f d7/d19/d1b/fb4 0 2024-04-06T12:23:55.787 INFO:tasks.workunit.client.0.smithi152.stdout:9/385: chown d5/d6/d74/d17/d37/l3a 42 1 2024-04-06T12:23:55.790 INFO:tasks.workunit.client.0.smithi152.stdout:8/643: creat d4/db/d56/dcb/d6e/fda x:0 0 0 2024-04-06T12:23:55.794 INFO:tasks.workunit.client.0.smithi152.stdout:6/549: mknod d7/d9/d26/cb5 0 2024-04-06T12:23:55.798 INFO:tasks.workunit.client.0.smithi152.stdout:8/644: dread d4/dc/d10/d51/f8f [0,4194304] 0 2024-04-06T12:23:55.798 INFO:tasks.workunit.client.0.smithi152.stdout:6/550: symlink d7/d19/d1b/d22/lb6 0 2024-04-06T12:23:55.801 INFO:tasks.workunit.client.0.smithi152.stdout:9/386: getdents d5/d6/d74/d17/d23 0 2024-04-06T12:23:55.807 INFO:tasks.workunit.client.0.smithi152.stdout:6/551: link d7/d19/d1b/c25 d7/d19/d1b/d31/d7c/cb7 0 2024-04-06T12:23:55.809 INFO:tasks.workunit.client.0.smithi152.stdout:8/645: getdents d4/dc/d10/d51 0 2024-04-06T12:23:55.809 INFO:tasks.workunit.client.0.smithi152.stdout:9/387: dwrite d5/d6/f28 [0,4194304] 0 2024-04-06T12:23:55.811 INFO:tasks.workunit.client.0.smithi152.stdout:9/388: readlink d5/d6/d74/d17/d23/l43 0 2024-04-06T12:23:55.817 INFO:tasks.workunit.client.0.smithi152.stdout:6/552: chown d7/d9/d26/d4a/l59 7491821 1 2024-04-06T12:23:55.818 INFO:tasks.workunit.client.0.smithi152.stdout:6/553: write d7/d62/f63 [5008789,19872] 0 2024-04-06T12:23:55.819 INFO:tasks.workunit.client.0.smithi152.stdout:8/646: mkdir d4/db/d56/dcb/ddb 0 2024-04-06T12:23:55.826 INFO:tasks.workunit.client.0.smithi152.stdout:9/389: dread d5/d39/d3f/d42/f48 [0,4194304] 0 2024-04-06T12:23:55.826 INFO:tasks.workunit.client.0.smithi152.stdout:6/554: unlink d7/ff 0 2024-04-06T12:23:55.832 INFO:tasks.workunit.client.0.smithi152.stdout:6/555: dwrite d7/fa8 [0,4194304] 0 2024-04-06T12:23:55.833 INFO:tasks.workunit.client.0.smithi152.stdout:6/556: chown d7/d62/f92 5620 1 2024-04-06T12:23:55.841 INFO:tasks.workunit.client.0.smithi152.stdout:8/647: creat d4/db/d56/dcb/d6e/fdc x:0 0 0 2024-04-06T12:23:55.845 INFO:tasks.workunit.client.0.smithi152.stdout:8/648: mkdir d4/dc/d10/d49/da0/dc0/d9d/dbe/ddd 0 2024-04-06T12:23:55.845 INFO:tasks.workunit.client.0.smithi152.stdout:9/390: write d5/d6/d74/d17/f19 [8666385,112124] 0 2024-04-06T12:23:55.847 INFO:tasks.workunit.client.0.smithi152.stdout:9/391: write d5/d6/d74/d17/f77 [300736,41605] 0 2024-04-06T12:23:55.850 INFO:tasks.workunit.client.0.smithi152.stdout:8/649: dread d4/dc/d10/d49/da0/dc0/d9d/dbe/f34 [0,4194304] 0 2024-04-06T12:23:55.852 INFO:tasks.workunit.client.0.smithi152.stdout:9/392: creat d5/d39/d79/f7f x:0 0 0 2024-04-06T12:23:55.859 INFO:tasks.workunit.client.0.smithi152.stdout:9/393: fdatasync d5/f1d 0 2024-04-06T12:23:55.866 INFO:tasks.workunit.client.0.smithi152.stdout:9/394: chown d5/d6/la 121122 1 2024-04-06T12:23:55.868 INFO:tasks.workunit.client.0.smithi152.stdout:8/650: dwrite d4/dc/f1f [0,4194304] 0 2024-04-06T12:23:55.870 INFO:tasks.workunit.client.0.smithi152.stdout:9/395: stat d5/l13 0 2024-04-06T12:23:55.871 INFO:tasks.workunit.client.0.smithi152.stdout:9/396: write d5/d39/d79/f7c [971003,125738] 0 2024-04-06T12:23:55.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/651: rename d4/dc/l90 to d4/dc/d10/d49/da0/dc0/db6/lde 0 2024-04-06T12:23:55.875 INFO:tasks.workunit.client.0.smithi152.stdout:8/652: mknod d4/db/cdf 0 2024-04-06T12:23:55.890 INFO:tasks.workunit.client.0.smithi152.stdout:9/397: dread d5/d6/f63 [0,4194304] 0 2024-04-06T12:23:55.895 INFO:tasks.workunit.client.0.smithi152.stdout:8/653: dread d4/dc/d10/f84 [0,4194304] 0 2024-04-06T12:23:55.899 INFO:tasks.workunit.client.0.smithi152.stdout:8/654: rmdir d4/d2c 39 2024-04-06T12:23:55.900 INFO:tasks.workunit.client.0.smithi152.stdout:8/655: write d4/dc/f5b [3591221,53515] 0 2024-04-06T12:23:55.901 INFO:tasks.workunit.client.0.smithi152.stdout:8/656: write d4/dc/d10/d51/f61 [4828527,83868] 0 2024-04-06T12:23:55.906 INFO:tasks.workunit.client.0.smithi152.stdout:8/657: dread d4/dc/f19 [0,4194304] 0 2024-04-06T12:23:55.909 INFO:tasks.workunit.client.0.smithi152.stdout:9/398: dwrite d5/d6/f3c [4194304,4194304] 0 2024-04-06T12:23:55.916 INFO:tasks.workunit.client.0.smithi152.stdout:9/399: dread d5/d39/d3f/d42/f48 [0,4194304] 0 2024-04-06T12:23:55.916 INFO:tasks.workunit.client.0.smithi152.stdout:8/658: dwrite d4/dc/d10/d51/f23 [4194304,4194304] 0 2024-04-06T12:23:55.921 INFO:tasks.workunit.client.0.smithi152.stdout:9/400: rmdir d5/d39/d3f/d42 39 2024-04-06T12:23:55.922 INFO:tasks.workunit.client.0.smithi152.stdout:9/401: chown d5/d6/d74/d17/d23/d2d/d32/d36 50383270 1 2024-04-06T12:23:55.923 INFO:tasks.workunit.client.0.smithi152.stdout:9/402: chown d5/d39/d3f/f6a 9568748 1 2024-04-06T12:23:55.924 INFO:tasks.workunit.client.0.smithi152.stdout:8/659: mkdir d4/dc/d10/d49/da0/de0 0 2024-04-06T12:23:55.925 INFO:tasks.workunit.client.0.smithi152.stdout:9/403: read d5/d6/d74/d17/d23/d2d/f6b [3715550,57380] 0 2024-04-06T12:23:55.928 INFO:tasks.workunit.client.0.smithi152.stdout:8/660: creat d4/db/d56/fe1 x:0 0 0 2024-04-06T12:23:55.929 INFO:tasks.workunit.client.0.smithi152.stdout:8/661: truncate d4/db/d39/f66 4346476 0 2024-04-06T12:23:55.930 INFO:tasks.workunit.client.0.smithi152.stdout:8/662: chown d4/dc/d10/d49/da0/dc0/db6/fc3 474829 1 2024-04-06T12:23:55.931 INFO:tasks.workunit.client.0.smithi152.stdout:9/404: rmdir d5/d6/d74/d17/d37 39 2024-04-06T12:23:55.935 INFO:tasks.workunit.client.0.smithi152.stdout:8/663: symlink d4/db/d56/dcb/d6e/d88/le2 0 2024-04-06T12:23:55.936 INFO:tasks.workunit.client.0.smithi152.stdout:8/664: chown d4/dc/d10/d51/lb3 74 1 2024-04-06T12:23:55.937 INFO:tasks.workunit.client.0.smithi152.stdout:9/405: symlink d5/d6/d74/d17/d23/d2d/d4b/d5a/l80 0 2024-04-06T12:23:55.937 INFO:tasks.workunit.client.0.smithi152.stdout:8/665: chown d4/dc/d10/d49/da2/lab 4 1 2024-04-06T12:23:55.939 INFO:tasks.workunit.client.0.smithi152.stdout:9/406: chown d5/d6/d74/d17/c67 1438 1 2024-04-06T12:23:55.940 INFO:tasks.workunit.client.0.smithi152.stdout:8/666: creat d4/db/d56/dcb/d6e/d88/fe3 x:0 0 0 2024-04-06T12:23:55.941 INFO:tasks.workunit.client.0.smithi152.stdout:8/667: read d4/dc/d10/d49/f72 [91455,23339] 0 2024-04-06T12:23:55.942 INFO:tasks.workunit.client.0.smithi152.stdout:9/407: rmdir d5/d6/d74/d17/d23/d2d/d4b 39 2024-04-06T12:23:55.944 INFO:tasks.workunit.client.0.smithi152.stdout:8/668: mknod d4/dc/d10/d49/ce4 0 2024-04-06T12:23:55.946 INFO:tasks.workunit.client.0.smithi152.stdout:8/669: symlink d4/dc/d10/d49/da0/dc0/db6/le5 0 2024-04-06T12:23:55.948 INFO:tasks.workunit.client.0.smithi152.stdout:8/670: mknod d4/dc/d10/d51/ce6 0 2024-04-06T12:23:55.948 INFO:tasks.workunit.client.0.smithi152.stdout:8/671: stat d4/dc/d10/d49/da0/dc0/d9d/dbe/ddd 0 2024-04-06T12:23:55.950 INFO:tasks.workunit.client.0.smithi152.stdout:8/672: unlink d4/dc/d10/d51/lb3 0 2024-04-06T12:23:55.951 INFO:tasks.workunit.client.0.smithi152.stdout:8/673: dread - d4/d2c/d2b/d83/fbc zero size 2024-04-06T12:23:55.992 INFO:tasks.workunit.client.0.smithi152.stdout:4/610: sync 2024-04-06T12:23:55.992 INFO:tasks.workunit.client.0.smithi152.stdout:7/484: sync 2024-04-06T12:23:55.993 INFO:tasks.workunit.client.0.smithi152.stdout:7/485: write d8/d2a/d42/f7f [11823,15196] 0 2024-04-06T12:23:55.993 INFO:tasks.workunit.client.0.smithi152.stdout:7/486: write d8/f1b [2212803,81208] 0 2024-04-06T12:23:55.994 INFO:tasks.workunit.client.0.smithi152.stdout:7/487: fsync d8/df/d61/d3d/f39 0 2024-04-06T12:23:56.029 INFO:tasks.workunit.client.0.smithi152.stdout:8/674: creat d4/d2c/dbf/db2/dba/fe7 x:0 0 0 2024-04-06T12:23:56.031 INFO:tasks.workunit.client.0.smithi152.stdout:7/488: mkdir d8/d2a/d37/d43/d8a/d9d 0 2024-04-06T12:23:56.032 INFO:tasks.workunit.client.0.smithi152.stdout:7/489: stat d8/df/d34/d63 0 2024-04-06T12:23:56.033 INFO:tasks.workunit.client.0.smithi152.stdout:8/675: creat d4/db/d56/fe8 x:0 0 0 2024-04-06T12:23:56.035 INFO:tasks.workunit.client.0.smithi152.stdout:7/490: truncate d8/d2a/d42/f7f 459071 0 2024-04-06T12:23:56.036 INFO:tasks.workunit.client.0.smithi152.stdout:4/611: dwrite d7/d29/f6d [0,4194304] 0 2024-04-06T12:23:56.037 INFO:tasks.workunit.client.0.smithi152.stdout:8/676: mknod d4/db/ce9 0 2024-04-06T12:23:56.041 INFO:tasks.workunit.client.0.smithi152.stdout:8/677: truncate d4/d2c/dbf/da3/fb9 471593 0 2024-04-06T12:23:56.042 INFO:tasks.workunit.client.0.smithi152.stdout:8/678: chown d4/db/ce9 624245 1 2024-04-06T12:23:56.052 INFO:tasks.workunit.client.0.smithi152.stdout:8/679: link d4/d81/c8c d4/d2c/dbf/db2/dba/cea 0 2024-04-06T12:23:56.062 INFO:tasks.workunit.client.0.smithi152.stdout:7/491: dwrite d8/f6f [0,4194304] 0 2024-04-06T12:23:56.067 INFO:tasks.workunit.client.0.smithi152.stdout:4/612: dwrite d7/d29/fbd [0,4194304] 0 2024-04-06T12:23:56.073 INFO:tasks.workunit.client.0.smithi152.stdout:4/613: stat d7/d16/d22/d3f/db4/d60/f9e 0 2024-04-06T12:23:56.080 INFO:tasks.workunit.client.0.smithi152.stdout:4/614: creat d7/d16/d22/d88/fc6 x:0 0 0 2024-04-06T12:23:56.082 INFO:tasks.workunit.client.0.smithi152.stdout:8/680: dwrite d4/dc/f19 [0,4194304] 0 2024-04-06T12:23:56.083 INFO:tasks.workunit.client.0.smithi152.stdout:7/492: getdents d8/df/d61/d3d 0 2024-04-06T12:23:56.086 INFO:tasks.workunit.client.0.smithi152.stdout:8/681: truncate d4/db/d56/dcb/d6e/fda 1026500 0 2024-04-06T12:23:56.090 INFO:tasks.workunit.client.0.smithi152.stdout:8/682: rmdir d4/d2c/d2b/d83 39 2024-04-06T12:23:56.091 INFO:tasks.workunit.client.0.smithi152.stdout:8/683: readlink d4/d5f/l62 0 2024-04-06T12:23:56.093 INFO:tasks.workunit.client.0.smithi152.stdout:4/615: mkdir d7/d16/d22/dc7 0 2024-04-06T12:23:56.098 INFO:tasks.workunit.client.0.smithi152.stdout:8/684: dwrite d4/dc/f1f [0,4194304] 0 2024-04-06T12:23:56.100 INFO:tasks.workunit.client.0.smithi152.stdout:7/493: dread d8/df/d61/d76/d7e/f1a [0,4194304] 0 2024-04-06T12:23:56.106 INFO:tasks.workunit.client.0.smithi152.stdout:7/494: symlink d8/d2a/d37/l9e 0 2024-04-06T12:23:56.106 INFO:tasks.workunit.client.0.smithi152.stdout:4/616: dwrite d7/d29/f2b [0,4194304] 0 2024-04-06T12:23:56.108 INFO:tasks.workunit.client.0.smithi152.stdout:4/617: write d7/d16/d22/d88/fc6 [211261,20709] 0 2024-04-06T12:23:56.112 INFO:tasks.workunit.client.0.smithi152.stdout:8/685: truncate d4/db/d56/f69 1990105 0 2024-04-06T12:23:56.116 INFO:tasks.workunit.client.0.smithi152.stdout:4/618: rename d7/d16/d22/d88 to d7/d16/d22/dc7/dc8 0 2024-04-06T12:23:56.118 INFO:tasks.workunit.client.0.smithi152.stdout:7/495: dwrite d8/d74/f97 [4194304,4194304] 0 2024-04-06T12:23:56.124 INFO:tasks.workunit.client.0.smithi152.stdout:8/686: creat d4/db/d56/dcb/dd5/feb x:0 0 0 2024-04-06T12:23:56.127 INFO:tasks.workunit.client.0.smithi152.stdout:7/496: symlink d8/df/d28/d41/d48/l9f 0 2024-04-06T12:23:56.129 INFO:tasks.workunit.client.0.smithi152.stdout:8/687: write d4/db/d56/fa9 [2752039,70546] 0 2024-04-06T12:23:56.131 INFO:tasks.workunit.client.0.smithi152.stdout:7/497: dread d8/df/d34/d63/f71 [0,4194304] 0 2024-04-06T12:23:56.135 INFO:tasks.workunit.client.0.smithi152.stdout:4/619: getdents d7/d16/d22/d3f 0 2024-04-06T12:23:56.137 INFO:tasks.workunit.client.0.smithi152.stdout:4/620: write d7/d16/d22/dc7/dc8/fbb [205437,87168] 0 2024-04-06T12:23:56.140 INFO:tasks.workunit.client.0.smithi152.stdout:4/621: dread d7/d29/d78/d33/f74 [0,4194304] 0 2024-04-06T12:23:56.141 INFO:tasks.workunit.client.0.smithi152.stdout:7/498: link d8/l96 d8/d2a/d37/d8c/d66/la0 0 2024-04-06T12:23:56.142 INFO:tasks.workunit.client.0.smithi152.stdout:8/688: dread d4/db/d32/f52 [0,4194304] 0 2024-04-06T12:23:56.144 INFO:tasks.workunit.client.0.smithi152.stdout:7/499: symlink d8/df/d61/d76/la1 0 2024-04-06T12:23:56.147 INFO:tasks.workunit.client.0.smithi152.stdout:8/689: rename d4/db/d56/dcb/d6e/d88/c94 to d4/dc/cec 0 2024-04-06T12:23:56.147 INFO:tasks.workunit.client.0.smithi152.stdout:2/533: sync 2024-04-06T12:23:56.148 INFO:tasks.workunit.client.0.smithi152.stdout:5/449: sync 2024-04-06T12:23:56.148 INFO:tasks.workunit.client.0.smithi152.stdout:6/557: sync 2024-04-06T12:23:56.148 INFO:tasks.workunit.client.0.smithi152.stdout:0/603: sync 2024-04-06T12:23:56.148 INFO:tasks.workunit.client.0.smithi152.stdout:3/546: sync 2024-04-06T12:23:56.148 INFO:tasks.workunit.client.0.smithi152.stdout:1/449: sync 2024-04-06T12:23:56.148 INFO:tasks.workunit.client.0.smithi152.stdout:4/622: mknod d7/d82/db1/db6/cc9 0 2024-04-06T12:23:56.150 INFO:tasks.workunit.client.0.smithi152.stdout:8/690: stat d4/dc/d10/d49/da0/dc0/d9d 0 2024-04-06T12:23:56.152 INFO:tasks.workunit.client.0.smithi152.stdout:7/500: mknod d8/df/d61/d76/ca2 0 2024-04-06T12:23:56.152 INFO:tasks.workunit.client.0.smithi152.stdout:0/604: dread d4/de/faf [0,4194304] 0 2024-04-06T12:23:56.157 INFO:tasks.workunit.client.0.smithi152.stdout:5/450: creat d3/da/d15/d2b/d3f/d68/d81/f90 x:0 0 0 2024-04-06T12:23:56.162 INFO:tasks.workunit.client.0.smithi152.stdout:1/450: rename d2/d2f/d54/f81 to d2/d1d/d7c/f9e 0 2024-04-06T12:23:56.170 INFO:tasks.workunit.client.0.smithi152.stdout:0/605: rename d4/d6e to d4/d31/d47/d7e/dbe 0 2024-04-06T12:23:56.171 INFO:tasks.workunit.client.0.smithi152.stdout:0/606: chown d4/de/d28/d18/d43/d62 1033855 1 2024-04-06T12:23:56.172 INFO:tasks.workunit.client.0.smithi152.stdout:4/623: getdents d7/d29/d2e/d5b/dc5 0 2024-04-06T12:23:56.173 INFO:tasks.workunit.client.0.smithi152.stdout:0/607: truncate d4/de/d28/f97 90299 0 2024-04-06T12:23:56.173 INFO:tasks.workunit.client.0.smithi152.stdout:6/558: creat d7/fb8 x:0 0 0 2024-04-06T12:23:56.177 INFO:tasks.workunit.client.0.smithi152.stdout:1/451: mkdir d2/d5d/d6d/d7d/d9f 0 2024-04-06T12:23:56.183 INFO:tasks.workunit.client.0.smithi152.stdout:8/691: rename d4/d81/c8c to d4/dc/d10/d49/da0/dc0/d9d/dbe/ced 0 2024-04-06T12:23:56.185 INFO:tasks.workunit.client.0.smithi152.stdout:4/624: symlink d7/d16/d22/lca 0 2024-04-06T12:23:56.186 INFO:tasks.workunit.client.0.smithi152.stdout:0/608: dread d4/de/d87/d94/f6f [0,4194304] 0 2024-04-06T12:23:56.188 INFO:tasks.workunit.client.0.smithi152.stdout:0/609: read d4/de/d87/d94/f7b [990842,91051] 0 2024-04-06T12:23:56.189 INFO:tasks.workunit.client.0.smithi152.stdout:0/610: write d4/de/d87/f77 [512413,97254] 0 2024-04-06T12:23:56.194 INFO:tasks.workunit.client.0.smithi152.stdout:7/501: rename d8/df/d4a to d8/d2a/d37/d8c/d2d/da3 0 2024-04-06T12:23:56.197 INFO:tasks.workunit.client.0.smithi152.stdout:0/611: mknod d4/de/d28/d18/d43/cbf 0 2024-04-06T12:23:56.198 INFO:tasks.workunit.client.0.smithi152.stdout:7/502: rmdir d8/df 39 2024-04-06T12:23:56.199 INFO:tasks.workunit.client.0.smithi152.stdout:7/503: dread - d8/d2a/d37/d43/f9b zero size 2024-04-06T12:23:56.200 INFO:tasks.workunit.client.0.smithi152.stdout:1/452: getdents d2/d2f 0 2024-04-06T12:23:56.203 INFO:tasks.workunit.client.0.smithi152.stdout:3/547: truncate d0/d35/f88 316970 0 2024-04-06T12:23:56.205 INFO:tasks.workunit.client.0.smithi152.stdout:3/548: fsync d0/d10/d13/f1a 0 2024-04-06T12:23:56.205 INFO:tasks.workunit.client.0.smithi152.stdout:5/451: dwrite d3/da/f24 [0,4194304] 0 2024-04-06T12:23:56.209 INFO:tasks.workunit.client.0.smithi152.stdout:7/504: readlink d8/df/d61/d76/la1 0 2024-04-06T12:23:56.210 INFO:tasks.workunit.client.0.smithi152.stdout:1/453: symlink d2/d61/la0 0 2024-04-06T12:23:56.214 INFO:tasks.workunit.client.0.smithi152.stdout:0/612: dread d4/f2b [0,4194304] 0 2024-04-06T12:23:56.220 INFO:tasks.workunit.client.0.smithi152.stdout:6/559: getdents d7/d19/d1b/d31/d35 0 2024-04-06T12:23:56.226 INFO:tasks.workunit.client.0.smithi152.stdout:8/692: dwrite d4/f4a [0,4194304] 0 2024-04-06T12:23:56.227 INFO:tasks.workunit.client.0.smithi152.stdout:3/549: creat d0/d10/d13/d2a/d93/d49/fad x:0 0 0 2024-04-06T12:23:56.230 INFO:tasks.workunit.client.0.smithi152.stdout:7/505: rmdir d8/df/d61/d3d/d6e/d8d 39 2024-04-06T12:23:56.237 INFO:tasks.workunit.client.0.smithi152.stdout:5/452: mknod d3/da/d15/d2b/d3f/d6d/c91 0 2024-04-06T12:23:56.239 INFO:tasks.workunit.client.0.smithi152.stdout:6/560: dread d7/d19/f81 [0,4194304] 0 2024-04-06T12:23:56.240 INFO:tasks.workunit.client.0.smithi152.stdout:8/693: creat d4/d2c/dbf/da3/fee x:0 0 0 2024-04-06T12:23:56.241 INFO:tasks.workunit.client.0.smithi152.stdout:3/550: mknod d0/d35/d43/d48/d83/cae 0 2024-04-06T12:23:56.244 INFO:tasks.workunit.client.0.smithi152.stdout:8/694: dread d4/dc/f1f [0,4194304] 0 2024-04-06T12:23:56.244 INFO:tasks.workunit.client.0.smithi152.stdout:7/506: creat d8/df/d28/d41/fa4 x:0 0 0 2024-04-06T12:23:56.246 INFO:tasks.workunit.client.0.smithi152.stdout:0/613: unlink d4/de/d28/d18/d43/d62/f69 0 2024-04-06T12:23:56.250 INFO:tasks.workunit.client.0.smithi152.stdout:6/561: creat d7/d19/d1b/d31/fb9 x:0 0 0 2024-04-06T12:23:56.252 INFO:tasks.workunit.client.0.smithi152.stdout:3/551: mkdir d0/d10/daf 0 2024-04-06T12:23:56.253 INFO:tasks.workunit.client.0.smithi152.stdout:8/695: read d4/d2c/d2b/d83/fd1 [247760,10223] 0 2024-04-06T12:23:56.259 INFO:tasks.workunit.client.0.smithi152.stdout:0/614: creat d4/d31/d47/d7e/dbe/fc0 x:0 0 0 2024-04-06T12:23:56.259 INFO:tasks.workunit.client.0.smithi152.stdout:0/615: dread - d4/d36/f74 zero size 2024-04-06T12:23:56.261 INFO:tasks.workunit.client.0.smithi152.stdout:6/562: rmdir d7/d9 39 2024-04-06T12:23:56.263 INFO:tasks.workunit.client.0.smithi152.stdout:1/454: truncate d2/f36 3537473 0 2024-04-06T12:23:56.264 INFO:tasks.workunit.client.0.smithi152.stdout:1/455: chown d2/d2f/c59 182 1 2024-04-06T12:23:56.271 INFO:tasks.workunit.client.0.smithi152.stdout:9/408: sync 2024-04-06T12:23:56.272 INFO:tasks.workunit.client.0.smithi152.stdout:8/696: dwrite d4/db/d39/f76 [0,4194304] 0 2024-04-06T12:23:56.274 INFO:tasks.workunit.client.0.smithi152.stdout:0/616: dread d4/de/d28/d18/d3b/f2f [0,4194304] 0 2024-04-06T12:23:56.276 INFO:tasks.workunit.client.0.smithi152.stdout:0/617: readlink d4/de/d7f/db7/lbc 0 2024-04-06T12:23:56.278 INFO:tasks.workunit.client.0.smithi152.stdout:6/563: read d7/d19/d3e/d70/f7e [1920442,64842] 0 2024-04-06T12:23:56.289 INFO:tasks.workunit.client.0.smithi152.stdout:5/453: rename d3/da/d15/d40/d4f/d5f to d3/da/d15/d40/d92 0 2024-04-06T12:23:56.289 INFO:tasks.workunit.client.0.smithi152.stdout:3/552: rename d0 to d0/d1f/d44/d7c/db0 22 2024-04-06T12:23:56.290 INFO:tasks.workunit.client.0.smithi152.stdout:0/618: chown d4/de/d28/d18/d3b/d2e/f4b 23 1 2024-04-06T12:23:56.290 INFO:tasks.workunit.client.0.smithi152.stdout:5/454: read - d3/da/d53/f87 zero size 2024-04-06T12:23:56.292 INFO:tasks.workunit.client.0.smithi152.stdout:5/455: stat d3/da/d15/d2b/d3f/d68/d81/f45 0 2024-04-06T12:23:56.346 INFO:tasks.workunit.client.0.smithi152.stdout:1/456: rename d2/d2f/d54/d88/d28/l83 to d2/d5d/d6d/la1 0 2024-04-06T12:23:56.347 INFO:tasks.workunit.client.0.smithi152.stdout:0/619: write d4/f4c [1148266,13134] 0 2024-04-06T12:23:56.350 INFO:tasks.workunit.client.0.smithi152.stdout:9/409: link d5/d6/f63 d5/f81 0 2024-04-06T12:23:56.352 INFO:tasks.workunit.client.0.smithi152.stdout:5/456: symlink d3/da/d15/d2b/d3f/d6d/l93 0 2024-04-06T12:23:56.353 INFO:tasks.workunit.client.0.smithi152.stdout:5/457: fsync d3/da/f47 0 2024-04-06T12:23:56.354 INFO:tasks.workunit.client.0.smithi152.stdout:5/458: chown d3/da/d15/d40/d4f 397 1 2024-04-06T12:23:56.354 INFO:tasks.workunit.client.0.smithi152.stdout:6/564: rename d7/fb8 to d7/d9/d73/fba 0 2024-04-06T12:23:56.355 INFO:tasks.workunit.client.0.smithi152.stdout:5/459: stat d3/da/d15/d40/d92/f78 0 2024-04-06T12:23:56.357 INFO:tasks.workunit.client.0.smithi152.stdout:5/460: stat d3/da/f47 0 2024-04-06T12:23:56.357 INFO:tasks.workunit.client.0.smithi152.stdout:6/565: truncate d7/d19/d3e/d70/f99 684161 0 2024-04-06T12:23:56.358 INFO:tasks.workunit.client.0.smithi152.stdout:5/461: write d3/da/fc [4260538,42056] 0 2024-04-06T12:23:56.358 INFO:tasks.workunit.client.0.smithi152.stdout:6/566: dread - d7/fad zero size 2024-04-06T12:23:56.361 INFO:tasks.workunit.client.0.smithi152.stdout:0/620: mkdir d4/de/d28/d18/d3b/d2e/d78/dc1 0 2024-04-06T12:23:56.362 INFO:tasks.workunit.client.0.smithi152.stdout:7/507: truncate d8/d2a/d42/f4c 1765519 0 2024-04-06T12:23:56.362 INFO:tasks.workunit.client.0.smithi152.stdout:6/567: dread d7/fa8 [0,4194304] 0 2024-04-06T12:23:56.364 INFO:tasks.workunit.client.0.smithi152.stdout:8/697: getdents d4/d5f 0 2024-04-06T12:23:56.364 INFO:tasks.workunit.client.0.smithi152.stdout:8/698: readlink d4/d2c/d2b/l2f 0 2024-04-06T12:23:56.368 INFO:tasks.workunit.client.0.smithi152.stdout:5/462: symlink d3/da/d15/d40/d50/l94 0 2024-04-06T12:23:56.369 INFO:tasks.workunit.client.0.smithi152.stdout:0/621: write d4/f2b [5185556,58464] 0 2024-04-06T12:23:56.371 INFO:tasks.workunit.client.0.smithi152.stdout:0/622: write d4/f2b [642291,130986] 0 2024-04-06T12:23:56.373 INFO:tasks.workunit.client.0.smithi152.stdout:6/568: creat d7/d62/fbb x:0 0 0 2024-04-06T12:23:56.373 INFO:tasks.workunit.client.0.smithi152.stdout:9/410: creat d5/d6/d74/d17/d23/d2d/d32/d36/f82 x:0 0 0 2024-04-06T12:23:56.373 INFO:tasks.workunit.client.0.smithi152.stdout:0/623: readlink d4/de/d28/d18/d43/d62/l64 0 2024-04-06T12:23:56.374 INFO:tasks.workunit.client.0.smithi152.stdout:8/699: chown d4/c12 2547 1 2024-04-06T12:23:56.377 INFO:tasks.workunit.client.0.smithi152.stdout:5/463: rename d3/f58 to d3/da/d15/d40/d50/f95 0 2024-04-06T12:23:56.378 INFO:tasks.workunit.client.0.smithi152.stdout:5/464: chown d3/da/d15/d2b/d4d/l6a 90301900 1 2024-04-06T12:23:56.380 INFO:tasks.workunit.client.0.smithi152.stdout:6/569: chown d7/d9/d26/c34 10737 1 2024-04-06T12:23:56.382 INFO:tasks.workunit.client.0.smithi152.stdout:0/624: stat d4/de/d28/f40 0 2024-04-06T12:23:56.383 INFO:tasks.workunit.client.0.smithi152.stdout:8/700: symlink d4/db/d56/dcb/d6e/d88/lef 0 2024-04-06T12:23:56.384 INFO:tasks.workunit.client.0.smithi152.stdout:1/457: link d2/d2f/d54/d88/l24 d2/d5d/la2 0 2024-04-06T12:23:56.386 INFO:tasks.workunit.client.0.smithi152.stdout:0/625: dread d4/de/f30 [0,4194304] 0 2024-04-06T12:23:56.386 INFO:tasks.workunit.client.0.smithi152.stdout:5/465: truncate d3/da/d15/d2b/d3f/f6c 933785 0 2024-04-06T12:23:56.387 INFO:tasks.workunit.client.0.smithi152.stdout:0/626: stat d4/de/d87/d94/cb3 0 2024-04-06T12:23:56.389 INFO:tasks.workunit.client.0.smithi152.stdout:8/701: symlink d4/d2c/d54/lf0 0 2024-04-06T12:23:56.412 INFO:tasks.workunit.client.0.smithi152.stdout:7/508: link d8/df/f5e d8/df/d61/d4b/fa5 0 2024-04-06T12:23:56.412 INFO:tasks.workunit.client.0.smithi152.stdout:7/509: write d8/d2a/d37/d8c/f38 [110699,11966] 0 2024-04-06T12:23:56.415 INFO:tasks.workunit.client.0.smithi152.stdout:0/627: mknod d4/de/d28/d18/d3b/d2e/d78/dc1/cc2 0 2024-04-06T12:23:56.417 INFO:tasks.workunit.client.0.smithi152.stdout:0/628: write d4/de/d28/d18/d43/d81/f91 [174028,20243] 0 2024-04-06T12:23:56.418 INFO:tasks.workunit.client.0.smithi152.stdout:0/629: read - d4/d31/d47/d7e/dbe/fa1 zero size 2024-04-06T12:23:56.419 INFO:tasks.workunit.client.0.smithi152.stdout:1/458: creat d2/d2f/d54/fa3 x:0 0 0 2024-04-06T12:23:56.423 INFO:tasks.workunit.client.0.smithi152.stdout:8/702: rename d4/dc/f1f to d4/db/d56/dcb/d6e/ff1 0 2024-04-06T12:23:56.424 INFO:tasks.workunit.client.0.smithi152.stdout:3/553: truncate d0/d10/d13/f6f 1160764 0 2024-04-06T12:23:56.428 INFO:tasks.workunit.client.0.smithi152.stdout:8/703: mknod d4/d5f/da7/cf2 0 2024-04-06T12:23:56.432 INFO:tasks.workunit.client.0.smithi152.stdout:3/554: creat d0/d35/d43/fb1 x:0 0 0 2024-04-06T12:23:56.433 INFO:tasks.workunit.client.0.smithi152.stdout:1/459: mkdir d2/d2f/d54/d88/da4 0 2024-04-06T12:23:56.436 INFO:tasks.workunit.client.0.smithi152.stdout:1/460: chown d2/d2f/d54/d88/c89 2763 1 2024-04-06T12:23:56.439 INFO:tasks.workunit.client.0.smithi152.stdout:1/461: stat d2/f20 0 2024-04-06T12:23:56.443 INFO:tasks.workunit.client.0.smithi152.stdout:7/510: creat d8/df/d61/fa6 x:0 0 0 2024-04-06T12:23:56.444 INFO:tasks.workunit.client.0.smithi152.stdout:3/555: dwrite d0/d10/d45/f47 [4194304,4194304] 0 2024-04-06T12:23:56.446 INFO:tasks.workunit.client.0.smithi152.stdout:0/630: getdents d4/de/d7f/db7 0 2024-04-06T12:23:56.449 INFO:tasks.workunit.client.0.smithi152.stdout:3/556: rmdir d0/d35/d75 39 2024-04-06T12:23:56.454 INFO:tasks.workunit.client.0.smithi152.stdout:1/462: unlink d2/d5d/f92 0 2024-04-06T12:23:56.460 INFO:tasks.workunit.client.0.smithi152.stdout:0/631: unlink d4/f2b 0 2024-04-06T12:23:56.468 INFO:tasks.workunit.client.0.smithi152.stdout:8/704: dread d4/d2c/fa4 [0,4194304] 0 2024-04-06T12:23:56.468 INFO:tasks.workunit.client.0.smithi152.stdout:9/411: write d5/d6/f24 [1615886,27510] 0 2024-04-06T12:23:56.469 INFO:tasks.workunit.client.0.smithi152.stdout:8/705: stat d4/db/d39/l43 0 2024-04-06T12:23:56.477 INFO:tasks.workunit.client.0.smithi152.stdout:3/557: truncate d0/d10/d1e/d71/f79 385612 0 2024-04-06T12:23:56.481 INFO:tasks.workunit.client.0.smithi152.stdout:3/558: truncate d0/d10/d13/d2a/d93/d49/fad 87877 0 2024-04-06T12:23:56.482 INFO:tasks.workunit.client.0.smithi152.stdout:7/511: creat d8/d2a/d37/fa7 x:0 0 0 2024-04-06T12:23:56.490 INFO:tasks.workunit.client.0.smithi152.stdout:6/570: write d7/d19/d1b/f7f [884782,124136] 0 2024-04-06T12:23:56.490 INFO:tasks.workunit.client.0.smithi152.stdout:5/466: write d3/da/d15/d2b/d3f/d68/d81/f56 [3236723,7608] 0 2024-04-06T12:23:56.491 INFO:tasks.workunit.client.0.smithi152.stdout:2/534: sync 2024-04-06T12:23:56.495 INFO:tasks.workunit.client.0.smithi152.stdout:2/535: dread d0/d2/d6f/d90/fa6 [0,4194304] 0 2024-04-06T12:23:56.496 INFO:tasks.workunit.client.0.smithi152.stdout:2/536: stat d0/d15/d24 0 2024-04-06T12:23:56.498 INFO:tasks.workunit.client.0.smithi152.stdout:6/571: mkdir d7/d19/d1b/d31/d35/dbc 0 2024-04-06T12:23:56.498 INFO:tasks.workunit.client.0.smithi152.stdout:3/559: dread d0/d1f/f23 [0,4194304] 0 2024-04-06T12:23:56.498 INFO:tasks.workunit.client.0.smithi152.stdout:5/467: fsync d3/da/d53/f87 0 2024-04-06T12:23:56.499 INFO:tasks.workunit.client.0.smithi152.stdout:3/560: chown d0/d2d 0 1 2024-04-06T12:23:56.500 INFO:tasks.workunit.client.0.smithi152.stdout:5/468: readlink d3/da/d15/d2b/d4d/l6a 0 2024-04-06T12:23:56.504 INFO:tasks.workunit.client.0.smithi152.stdout:3/561: mkdir d0/d10/d1e/d71/db2 0 2024-04-06T12:23:56.507 INFO:tasks.workunit.client.0.smithi152.stdout:7/512: dread d8/df/d61/d4b/d56/f83 [0,4194304] 0 2024-04-06T12:23:56.507 INFO:tasks.workunit.client.0.smithi152.stdout:5/469: rmdir d3/da/d15/d2b/d3f/d68/d81 39 2024-04-06T12:23:56.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/562: dread d0/d1f/d28/f76 [4194304,4194304] 0 2024-04-06T12:23:56.509 INFO:tasks.workunit.client.0.smithi152.stdout:6/572: getdents d7/d19/d1b/d31/d35/dbc 0 2024-04-06T12:23:56.513 INFO:tasks.workunit.client.0.smithi152.stdout:7/513: write d8/fb [1040837,46229] 0 2024-04-06T12:23:56.515 INFO:tasks.workunit.client.0.smithi152.stdout:7/514: write d8/d74/f97 [9248713,56160] 0 2024-04-06T12:23:56.517 INFO:tasks.workunit.client.0.smithi152.stdout:6/573: creat d7/d19/d1b/d31/d35/fbd x:0 0 0 2024-04-06T12:23:56.519 INFO:tasks.workunit.client.0.smithi152.stdout:3/563: rename d0/d1f/d44/f69 to d0/d10/d13/d2a/d93/d49/d8d/d9e/fb3 0 2024-04-06T12:23:56.520 INFO:tasks.workunit.client.0.smithi152.stdout:3/564: chown d0/d10/d13/d2a/f51 42107525 1 2024-04-06T12:23:56.522 INFO:tasks.workunit.client.0.smithi152.stdout:2/537: getdents d0/d15 0 2024-04-06T12:23:56.522 INFO:tasks.workunit.client.0.smithi152.stdout:2/538: chown d0/d40/f93 1904 1 2024-04-06T12:23:56.529 INFO:tasks.workunit.client.0.smithi152.stdout:6/574: rename d7/d19/d1b/d1f/d3d/fa0 to d7/d19/d1b/d31/d35/fbe 0 2024-04-06T12:23:56.532 INFO:tasks.workunit.client.0.smithi152.stdout:5/470: creat d3/da/d15/d40/f96 x:0 0 0 2024-04-06T12:23:56.535 INFO:tasks.workunit.client.0.smithi152.stdout:7/515: symlink d8/df/d61/d6d/d85/la8 0 2024-04-06T12:23:56.541 INFO:tasks.workunit.client.0.smithi152.stdout:5/471: fsync d3/d9/f27 0 2024-04-06T12:23:56.542 INFO:tasks.workunit.client.0.smithi152.stdout:5/472: fsync d3/da/d15/d2b/d3f/d4c/f77 0 2024-04-06T12:23:56.545 INFO:tasks.workunit.client.0.smithi152.stdout:1/463: write d2/d1d/d7c/f93 [708852,92890] 0 2024-04-06T12:23:56.545 INFO:tasks.workunit.client.0.smithi152.stdout:7/516: rmdir d8/df/d61/d76/d7e 39 2024-04-06T12:23:56.546 INFO:tasks.workunit.client.0.smithi152.stdout:7/517: chown d8/df/d34/f88 244 1 2024-04-06T12:23:56.547 INFO:tasks.workunit.client.0.smithi152.stdout:6/575: mkdir d7/d19/dbf 0 2024-04-06T12:23:56.548 INFO:tasks.workunit.client.0.smithi152.stdout:7/518: write d8/df/d28/d41/fa4 [372160,10583] 0 2024-04-06T12:23:56.550 INFO:tasks.workunit.client.0.smithi152.stdout:7/519: stat d8/df/d61/d6d 0 2024-04-06T12:23:56.550 INFO:tasks.workunit.client.0.smithi152.stdout:0/632: write d4/de/f30 [2127840,127907] 0 2024-04-06T12:23:56.551 INFO:tasks.workunit.client.0.smithi152.stdout:0/633: stat d4/d36/f5b 0 2024-04-06T12:23:56.553 INFO:tasks.workunit.client.0.smithi152.stdout:9/412: write d5/f10 [2647919,19713] 0 2024-04-06T12:23:56.554 INFO:tasks.workunit.client.0.smithi152.stdout:5/473: rmdir d3/da/d15/d2b 39 2024-04-06T12:23:56.562 INFO:tasks.workunit.client.0.smithi152.stdout:0/634: creat d4/de/d7f/db7/fc3 x:0 0 0 2024-04-06T12:23:56.569 INFO:tasks.workunit.client.0.smithi152.stdout:1/464: unlink d2/d1d/c43 0 2024-04-06T12:23:56.573 INFO:tasks.workunit.client.0.smithi152.stdout:6/576: rename d7/d19/f5e to d7/d19/d1b/d1f/d3d/fc0 0 2024-04-06T12:23:56.578 INFO:tasks.workunit.client.0.smithi152.stdout:9/413: rmdir d5/d39/d3f 39 2024-04-06T12:23:56.583 INFO:tasks.workunit.client.0.smithi152.stdout:1/465: mknod d2/d2f/d37/ca5 0 2024-04-06T12:23:56.583 INFO:tasks.workunit.client.0.smithi152.stdout:4/625: sync 2024-04-06T12:23:56.585 INFO:tasks.workunit.client.0.smithi152.stdout:4/626: write d7/d16/d55/da0/f94 [1046842,19710] 0 2024-04-06T12:23:56.591 INFO:tasks.workunit.client.0.smithi152.stdout:4/627: dread d7/d16/d55/da0/f94 [0,4194304] 0 2024-04-06T12:23:56.592 INFO:tasks.workunit.client.0.smithi152.stdout:4/628: read d7/d29/d7e/d59/f76 [1463227,73284] 0 2024-04-06T12:23:56.594 INFO:tasks.workunit.client.0.smithi152.stdout:2/539: write d0/d40/d41/d28/fab [1633010,44706] 0 2024-04-06T12:23:56.595 INFO:tasks.workunit.client.0.smithi152.stdout:7/520: rename d8/df/d61/d4b/l91 to d8/df/d61/d4b/la9 0 2024-04-06T12:23:56.600 INFO:tasks.workunit.client.0.smithi152.stdout:2/540: dwrite d0/d40/d26/f7b [0,4194304] 0 2024-04-06T12:23:56.621 INFO:tasks.workunit.client.0.smithi152.stdout:7/521: chown d8/df/d61/d76/d7e/c86 8678 1 2024-04-06T12:23:56.621 INFO:tasks.workunit.client.0.smithi152.stdout:9/414: symlink d5/d6/d74/d17/d23/d2d/d4b/d5a/l83 0 2024-04-06T12:23:56.624 INFO:tasks.workunit.client.0.smithi152.stdout:5/474: dwrite d3/f16 [0,4194304] 0 2024-04-06T12:23:56.625 INFO:tasks.workunit.client.0.smithi152.stdout:2/541: read - d0/d15/d24/d79/f7a zero size 2024-04-06T12:23:56.626 INFO:tasks.workunit.client.0.smithi152.stdout:2/542: chown d0/d15/d24/d3d/f91 340484 1 2024-04-06T12:23:56.627 INFO:tasks.workunit.client.0.smithi152.stdout:0/635: write d4/de/d28/d18/d3b/d2e/fad [428689,66863] 0 2024-04-06T12:23:56.633 INFO:tasks.workunit.client.0.smithi152.stdout:6/577: creat d7/d19/d1b/fc1 x:0 0 0 2024-04-06T12:23:56.635 INFO:tasks.workunit.client.0.smithi152.stdout:5/475: dwrite d3/da/d15/d40/f96 [0,4194304] 0 2024-04-06T12:23:56.637 INFO:tasks.workunit.client.0.smithi152.stdout:5/476: write d3/da/f24 [3372521,5144] 0 2024-04-06T12:23:56.641 INFO:tasks.workunit.client.0.smithi152.stdout:9/415: dread d5/d6/f3c [0,4194304] 0 2024-04-06T12:23:56.652 INFO:tasks.workunit.client.0.smithi152.stdout:3/565: dread d0/d10/d13/f6f [0,4194304] 0 2024-04-06T12:23:56.652 INFO:tasks.workunit.client.0.smithi152.stdout:0/636: write d4/de/d87/d94/f7b [2407370,100495] 0 2024-04-06T12:23:56.658 INFO:tasks.workunit.client.0.smithi152.stdout:1/466: truncate d2/d2f/d45/f62 2437190 0 2024-04-06T12:23:56.665 INFO:tasks.workunit.client.0.smithi152.stdout:5/477: rmdir d3 39 2024-04-06T12:23:56.666 INFO:tasks.workunit.client.0.smithi152.stdout:0/637: dwrite d4/de/d7f/db7/fc3 [0,4194304] 0 2024-04-06T12:23:56.673 INFO:tasks.workunit.client.0.smithi152.stdout:2/543: write d0/d15/d4d/f55 [8441532,90672] 0 2024-04-06T12:23:56.679 INFO:tasks.workunit.client.0.smithi152.stdout:1/467: creat d2/d61/fa6 x:0 0 0 2024-04-06T12:23:56.682 INFO:tasks.workunit.client.0.smithi152.stdout:2/544: dwrite d0/d40/d41/d28/d8c/faa [0,4194304] 0 2024-04-06T12:23:56.692 INFO:tasks.workunit.client.0.smithi152.stdout:7/522: write d8/d2a/d37/f47 [1016806,111319] 0 2024-04-06T12:23:56.693 INFO:tasks.workunit.client.0.smithi152.stdout:6/578: dwrite d7/d19/d3e/f98 [0,4194304] 0 2024-04-06T12:23:56.696 INFO:tasks.workunit.client.0.smithi152.stdout:1/468: dwrite d2/f58 [0,4194304] 0 2024-04-06T12:23:56.710 INFO:tasks.workunit.client.0.smithi152.stdout:7/523: dwrite d8/d2a/d37/d8c/d2d/d7a/f99 [0,4194304] 0 2024-04-06T12:23:56.732 INFO:tasks.workunit.client.0.smithi152.stdout:4/629: link d7/d29/d7e/d59/l8f d7/d29/d2e/d5b/lcb 0 2024-04-06T12:23:56.733 INFO:tasks.workunit.client.0.smithi152.stdout:0/638: truncate d4/d19/f41 1044907 0 2024-04-06T12:23:56.740 INFO:tasks.workunit.client.0.smithi152.stdout:6/579: mkdir d7/d19/d1b/d1f/d3d/dc2 0 2024-04-06T12:23:56.741 INFO:tasks.workunit.client.0.smithi152.stdout:6/580: chown d7/d19/d1b/d31/f3c 951071 1 2024-04-06T12:23:56.744 INFO:tasks.workunit.client.0.smithi152.stdout:1/469: rename d2/d5d/d6d/c79 to d2/d2f/d37/ca7 0 2024-04-06T12:23:56.748 INFO:tasks.workunit.client.0.smithi152.stdout:5/478: stat d3/da/d15/d40/d50/l3d 0 2024-04-06T12:23:56.755 INFO:tasks.workunit.client.0.smithi152.stdout:1/470: rename d2/f99 to d2/d2f/d45/fa8 0 2024-04-06T12:23:56.756 INFO:tasks.workunit.client.0.smithi152.stdout:1/471: chown d2/d2f/d37/ca5 3066302 1 2024-04-06T12:23:56.758 INFO:tasks.workunit.client.0.smithi152.stdout:7/524: mkdir d8/d2a/d37/d8c/d59/daa 0 2024-04-06T12:23:56.763 INFO:tasks.workunit.client.0.smithi152.stdout:7/525: dwrite d8/fb [0,4194304] 0 2024-04-06T12:23:56.766 INFO:tasks.workunit.client.0.smithi152.stdout:0/639: truncate d4/de/d87/f6a 688814 0 2024-04-06T12:23:56.768 INFO:tasks.workunit.client.0.smithi152.stdout:2/545: creat d0/d2/fb3 x:0 0 0 2024-04-06T12:23:56.772 INFO:tasks.workunit.client.0.smithi152.stdout:6/581: creat d7/d9/d26/d4a/d7b/fc3 x:0 0 0 2024-04-06T12:23:56.774 INFO:tasks.workunit.client.0.smithi152.stdout:6/582: dread d7/d19/d3e/d70/f99 [0,4194304] 0 2024-04-06T12:23:56.775 INFO:tasks.workunit.client.0.smithi152.stdout:0/640: dwrite d4/de/d28/f22 [0,4194304] 0 2024-04-06T12:23:56.777 INFO:tasks.workunit.client.0.smithi152.stdout:6/583: truncate d7/d19/d1b/d31/d35/fbd 119959 0 2024-04-06T12:23:56.781 INFO:tasks.workunit.client.0.smithi152.stdout:4/630: creat d7/d29/d2e/fcc x:0 0 0 2024-04-06T12:23:56.782 INFO:tasks.workunit.client.0.smithi152.stdout:4/631: read - d7/d29/d2e/d5b/fb3 zero size 2024-04-06T12:23:56.790 INFO:tasks.workunit.client.0.smithi152.stdout:2/546: mkdir d0/d40/d26/db4 0 2024-04-06T12:23:56.794 INFO:tasks.workunit.client.0.smithi152.stdout:1/472: creat d2/d2f/d54/d88/d28/d8c/fa9 x:0 0 0 2024-04-06T12:23:56.798 INFO:tasks.workunit.client.0.smithi152.stdout:6/584: creat d7/d19/d3e/fc4 x:0 0 0 2024-04-06T12:23:56.799 INFO:tasks.workunit.client.0.smithi152.stdout:5/479: rmdir d3/da/d15/d2b/d3f/d68/d81 39 2024-04-06T12:23:56.802 INFO:tasks.workunit.client.0.smithi152.stdout:4/632: symlink d7/d16/d55/da0/lcd 0 2024-04-06T12:23:56.803 INFO:tasks.workunit.client.0.smithi152.stdout:7/526: mknod d8/df/d28/d87/cab 0 2024-04-06T12:23:56.812 INFO:tasks.workunit.client.0.smithi152.stdout:5/480: rmdir d3/da/d53 39 2024-04-06T12:23:56.815 INFO:tasks.workunit.client.0.smithi152.stdout:4/633: read d7/d16/d55/da0/f94 [178810,71361] 0 2024-04-06T12:23:56.817 INFO:tasks.workunit.client.0.smithi152.stdout:1/473: truncate d2/d2f/f9b 2134133 0 2024-04-06T12:23:56.821 INFO:tasks.workunit.client.0.smithi152.stdout:5/481: rmdir d3/da 39 2024-04-06T12:23:56.829 INFO:tasks.workunit.client.0.smithi152.stdout:1/474: mkdir d2/d2f/daa 0 2024-04-06T12:23:56.830 INFO:tasks.workunit.client.0.smithi152.stdout:1/475: fsync d2/f42 0 2024-04-06T12:23:56.830 INFO:tasks.workunit.client.0.smithi152.stdout:1/476: stat d2/f39 0 2024-04-06T12:23:56.831 INFO:tasks.workunit.client.0.smithi152.stdout:0/641: rename d4/de/d28/d18/d43/d62/c7d to d4/de/d28/d18/d3b/d2e/cc4 0 2024-04-06T12:23:56.833 INFO:tasks.workunit.client.0.smithi152.stdout:0/642: read d4/d31/f34 [4676072,70663] 0 2024-04-06T12:23:56.837 INFO:tasks.workunit.client.0.smithi152.stdout:6/585: rmdir d7/d19/d3e 39 2024-04-06T12:23:56.842 INFO:tasks.workunit.client.0.smithi152.stdout:2/547: rename d0/d2/d5 to d0/d2/d6f/d90/d9e/db5 0 2024-04-06T12:23:56.852 INFO:tasks.workunit.client.0.smithi152.stdout:0/643: fdatasync d4/d31/d47/f9c 0 2024-04-06T12:23:56.856 INFO:tasks.workunit.client.0.smithi152.stdout:6/586: truncate d7/d19/d1b/d31/d35/f54 1536762 0 2024-04-06T12:23:56.858 INFO:tasks.workunit.client.0.smithi152.stdout:1/477: fsync d2/d1d/f3e 0 2024-04-06T12:23:56.859 INFO:tasks.workunit.client.0.smithi152.stdout:1/478: write d2/d2f/d54/d88/d28/d8c/fa9 [933992,37019] 0 2024-04-06T12:23:56.860 INFO:tasks.workunit.client.0.smithi152.stdout:2/548: chown d0/d40/f3f 60913 1 2024-04-06T12:23:56.860 INFO:tasks.workunit.client.0.smithi152.stdout:4/634: write d7/d29/f65 [4706991,51783] 0 2024-04-06T12:23:56.863 INFO:tasks.workunit.client.0.smithi152.stdout:5/482: dread - d3/da/d53/f62 zero size 2024-04-06T12:23:56.866 INFO:tasks.workunit.client.0.smithi152.stdout:6/587: creat d7/d9/d73/fc5 x:0 0 0 2024-04-06T12:23:56.870 INFO:tasks.workunit.client.0.smithi152.stdout:1/479: rename d2/f18 to d2/d2f/d54/d88/da4/fab 0 2024-04-06T12:23:56.872 INFO:tasks.workunit.client.0.smithi152.stdout:5/483: creat d3/da/d15/d2b/d4d/f97 x:0 0 0 2024-04-06T12:23:56.875 INFO:tasks.workunit.client.0.smithi152.stdout:4/635: creat d7/d16/d22/d95/fce x:0 0 0 2024-04-06T12:23:56.876 INFO:tasks.workunit.client.0.smithi152.stdout:1/480: symlink d2/d5d/d6d/d7d/lac 0 2024-04-06T12:23:56.878 INFO:tasks.workunit.client.0.smithi152.stdout:1/481: write d2/d2f/d54/d88/d28/d8c/fa9 [1349431,47001] 0 2024-04-06T12:23:56.882 INFO:tasks.workunit.client.0.smithi152.stdout:0/644: write d4/d36/f5b [866040,112338] 0 2024-04-06T12:23:56.884 INFO:tasks.workunit.client.0.smithi152.stdout:4/636: mkdir d7/d16/d22/d95/dcf 0 2024-04-06T12:23:56.889 INFO:tasks.workunit.client.0.smithi152.stdout:0/645: dwrite d4/de/d87/f77 [0,4194304] 0 2024-04-06T12:23:56.893 INFO:tasks.workunit.client.0.smithi152.stdout:6/588: truncate d7/d9/f48 3707882 0 2024-04-06T12:23:56.896 INFO:tasks.workunit.client.0.smithi152.stdout:1/482: rename d2/d2f/d54/d88/d28 to d2/d2f/d37/d91/dad 0 2024-04-06T12:23:56.899 INFO:tasks.workunit.client.0.smithi152.stdout:5/484: dwrite d3/da/d15/d40/d4f/f66 [0,4194304] 0 2024-04-06T12:23:56.905 INFO:tasks.workunit.client.0.smithi152.stdout:6/589: dwrite d7/d19/d1b/d1f/d3d/f8e [4194304,4194304] 0 2024-04-06T12:23:56.906 INFO:tasks.workunit.client.0.smithi152.stdout:6/590: write d7/d9/f56 [4261406,55051] 0 2024-04-06T12:23:56.913 INFO:tasks.workunit.client.0.smithi152.stdout:5/485: stat d3/d9/c2f 0 2024-04-06T12:23:56.918 INFO:tasks.workunit.client.0.smithi152.stdout:6/591: dread d7/fa8 [0,4194304] 0 2024-04-06T12:23:56.920 INFO:tasks.workunit.client.0.smithi152.stdout:0/646: rename d4/de/d28/c24 to d4/d36/cc5 0 2024-04-06T12:23:56.925 INFO:tasks.workunit.client.0.smithi152.stdout:4/637: creat d7/d16/d22/fd0 x:0 0 0 2024-04-06T12:23:56.925 INFO:tasks.workunit.client.0.smithi152.stdout:5/486: mkdir d3/de/d80/d98 0 2024-04-06T12:23:56.927 INFO:tasks.workunit.client.0.smithi152.stdout:6/592: dwrite d7/d19/d1b/d1f/f2a [4194304,4194304] 0 2024-04-06T12:23:56.928 INFO:tasks.workunit.client.0.smithi152.stdout:5/487: write d3/da/d15/d2b/d3f/d4c/f79 [577555,125964] 0 2024-04-06T12:23:56.929 INFO:tasks.workunit.client.0.smithi152.stdout:0/647: creat d4/de/d7f/db7/fc6 x:0 0 0 2024-04-06T12:23:56.936 INFO:tasks.workunit.client.0.smithi152.stdout:1/483: dread d2/d1d/d3b/f56 [0,4194304] 0 2024-04-06T12:23:56.937 INFO:tasks.workunit.client.0.smithi152.stdout:1/484: dread - d2/d2f/d37/d91/f87 zero size 2024-04-06T12:23:57.043 INFO:tasks.workunit.client.0.smithi152.stdout:8/706: sync 2024-04-06T12:23:57.046 INFO:tasks.workunit.client.0.smithi152.stdout:0/648: chown d4/de/d28/c50 25 1 2024-04-06T12:23:57.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:55.584467+0000 mgr.smithi195.ausetj (mgr.24375) 82 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 1.2 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 41 MiB/s rd, 142 MiB/s wr, 311 op/s 2024-04-06T12:23:57.050 INFO:tasks.workunit.client.0.smithi152.stdout:8/707: symlink d4/d5f/lf3 0 2024-04-06T12:23:57.050 INFO:tasks.workunit.client.0.smithi152.stdout:6/593: mknod d7/d19/d1b/d1f/cc6 0 2024-04-06T12:23:57.053 INFO:tasks.workunit.client.0.smithi152.stdout:0/649: symlink d4/d31/d47/d89/lc7 0 2024-04-06T12:23:57.054 INFO:tasks.workunit.client.0.smithi152.stdout:4/638: write d7/d16/d22/d3f/db4/d60/f87 [514887,6735] 0 2024-04-06T12:23:57.054 INFO:tasks.workunit.client.0.smithi152.stdout:0/650: fdatasync d4/d31/f3d 0 2024-04-06T12:23:57.057 INFO:tasks.workunit.client.0.smithi152.stdout:0/651: write d4/de/d28/d18/d3b/f42 [4934933,98437] 0 2024-04-06T12:23:57.060 INFO:tasks.workunit.client.0.smithi152.stdout:5/488: getdents d3/da/d15/d2b/d3f/d4c 0 2024-04-06T12:23:57.065 INFO:tasks.workunit.client.0.smithi152.stdout:4/639: dwrite d7/d16/d22/dc7/dc8/fc6 [0,4194304] 0 2024-04-06T12:23:57.065 INFO:tasks.workunit.client.0.smithi152.stdout:8/708: dread d4/db/d56/d85/fd6 [0,4194304] 0 2024-04-06T12:23:57.069 INFO:tasks.workunit.client.0.smithi152.stdout:5/489: mkdir d3/da/d15/d40/d50/d99 0 2024-04-06T12:23:57.069 INFO:tasks.workunit.client.0.smithi152.stdout:6/594: link d7/d9/l6a d7/d19/d3e/d70/lc7 0 2024-04-06T12:23:57.073 INFO:tasks.workunit.client.0.smithi152.stdout:8/709: mknod d4/d2c/d2b/d83/cf4 0 2024-04-06T12:23:57.076 INFO:tasks.workunit.client.0.smithi152.stdout:6/595: dwrite d7/d19/d1b/d31/fb9 [0,4194304] 0 2024-04-06T12:23:57.077 INFO:tasks.workunit.client.0.smithi152.stdout:8/710: write d4/dc/d10/d49/da0/dc0/d9d/dbe/fad [952832,38668] 0 2024-04-06T12:23:57.090 INFO:tasks.workunit.client.0.smithi152.stdout:8/711: dread d4/dc/d10/d49/da0/dc0/d9d/dbe/f26 [0,4194304] 0 2024-04-06T12:23:57.149 INFO:tasks.workunit.client.0.smithi152.stdout:0/652: write d4/d31/f34 [5741032,105871] 0 2024-04-06T12:23:57.150 INFO:tasks.workunit.client.0.smithi152.stdout:5/490: rmdir d3/da/d15/d2b 39 2024-04-06T12:23:57.151 INFO:tasks.workunit.client.0.smithi152.stdout:4/640: write d7/d29/f5e [826555,108717] 0 2024-04-06T12:23:57.155 INFO:tasks.workunit.client.0.smithi152.stdout:8/712: mkdir d4/dc/df5 0 2024-04-06T12:23:57.160 INFO:tasks.workunit.client.0.smithi152.stdout:6/596: symlink d7/d19/lc8 0 2024-04-06T12:23:57.162 INFO:tasks.workunit.client.0.smithi152.stdout:0/653: dread d4/d31/f34 [0,4194304] 0 2024-04-06T12:23:57.164 INFO:tasks.workunit.client.0.smithi152.stdout:8/713: rename d4/dc/d10/d51/ce6 to d4/db/d56/dcb/d6e/d88/cf6 0 2024-04-06T12:23:57.166 INFO:tasks.workunit.client.0.smithi152.stdout:5/491: creat d3/da/d15/d2b/d3f/d4c/f9a x:0 0 0 2024-04-06T12:23:57.171 INFO:tasks.workunit.client.0.smithi152.stdout:0/654: mknod d4/de/d7f/cc8 0 2024-04-06T12:23:57.171 INFO:tasks.workunit.client.0.smithi152.stdout:8/714: dwrite d4/db/d56/fac [0,4194304] 0 2024-04-06T12:23:57.177 INFO:tasks.workunit.client.0.smithi152.stdout:5/492: truncate d3/da/d15/d2b/d3f/d68/d81/f76 991237 0 2024-04-06T12:23:57.178 INFO:tasks.workunit.client.0.smithi152.stdout:5/493: read - d3/da/d53/f62 zero size 2024-04-06T12:23:57.178 INFO:tasks.workunit.client.0.smithi152.stdout:5/494: readlink d3/da/d15/d40/d50/l3d 0 2024-04-06T12:23:57.181 INFO:tasks.workunit.client.0.smithi152.stdout:8/715: rename d4/dc/d10/d49/da0/c8e to d4/d2c/dbf/da3/cf7 0 2024-04-06T12:23:57.184 INFO:tasks.workunit.client.0.smithi152.stdout:4/641: write d7/d16/d22/d3f/db4/f37 [299814,64341] 0 2024-04-06T12:23:57.185 INFO:tasks.workunit.client.0.smithi152.stdout:6/597: write d7/d19/d1b/d1f/f8f [748643,121190] 0 2024-04-06T12:23:57.187 INFO:tasks.workunit.client.0.smithi152.stdout:6/598: write d7/d62/fbb [972636,88856] 0 2024-04-06T12:23:57.188 INFO:tasks.workunit.client.0.smithi152.stdout:6/599: chown d7/la4 47 1 2024-04-06T12:23:57.189 INFO:tasks.workunit.client.0.smithi152.stdout:5/495: creat d3/de/d8e/f9b x:0 0 0 2024-04-06T12:23:57.190 INFO:tasks.workunit.client.0.smithi152.stdout:8/716: creat d4/db/d56/dcb/d6e/dd4/ff8 x:0 0 0 2024-04-06T12:23:57.192 INFO:tasks.workunit.client.0.smithi152.stdout:8/717: write d4/dc/d10/fc9 [85701,117919] 0 2024-04-06T12:23:57.197 INFO:tasks.workunit.client.0.smithi152.stdout:0/655: dread d4/de/d28/d18/d3b/d2e/f4b [0,4194304] 0 2024-04-06T12:23:57.199 INFO:tasks.workunit.client.0.smithi152.stdout:8/718: dwrite d4/db/d56/fac [0,4194304] 0 2024-04-06T12:23:57.200 INFO:tasks.workunit.client.0.smithi152.stdout:8/719: chown d4/db/d56/dcb/dd5/feb 60 1 2024-04-06T12:23:57.202 INFO:tasks.workunit.client.0.smithi152.stdout:6/600: creat d7/d19/d1b/d31/d35/dbc/fc9 x:0 0 0 2024-04-06T12:23:57.210 INFO:tasks.workunit.client.0.smithi152.stdout:6/601: mknod d7/d19/d3e/d70/cca 0 2024-04-06T12:23:57.213 INFO:tasks.workunit.client.0.smithi152.stdout:5/496: write d3/f11 [2023153,103882] 0 2024-04-06T12:23:57.213 INFO:tasks.workunit.client.0.smithi152.stdout:8/720: dread d4/dc/d10/d49/da0/dc0/d9d/dbe/f34 [0,4194304] 0 2024-04-06T12:23:57.217 INFO:tasks.workunit.client.0.smithi152.stdout:4/642: dwrite d7/d29/d7e/d59/f85 [0,4194304] 0 2024-04-06T12:23:57.233 INFO:tasks.workunit.client.0.smithi152.stdout:0/656: write d4/de/d28/d18/d3b/fb4 [2850318,52789] 0 2024-04-06T12:23:57.242 INFO:tasks.workunit.client.0.smithi152.stdout:0/657: dwrite d4/d36/f90 [0,4194304] 0 2024-04-06T12:23:57.246 INFO:tasks.workunit.client.0.smithi152.stdout:6/602: write d7/d9/f10 [1202396,27977] 0 2024-04-06T12:23:57.252 INFO:tasks.workunit.client.0.smithi152.stdout:4/643: write d7/d29/d78/f7c [109138,59119] 0 2024-04-06T12:23:57.255 INFO:tasks.workunit.client.0.smithi152.stdout:0/658: dread d4/de/d28/f66 [0,4194304] 0 2024-04-06T12:23:57.256 INFO:tasks.workunit.client.0.smithi152.stdout:5/497: dwrite d3/de/d80/f52 [0,4194304] 0 2024-04-06T12:23:57.261 INFO:tasks.workunit.client.0.smithi152.stdout:5/498: write d3/da/f47 [3911648,729] 0 2024-04-06T12:23:57.261 INFO:tasks.workunit.client.0.smithi152.stdout:0/659: chown d4/de/d4a/l54 241 1 2024-04-06T12:23:57.263 INFO:tasks.workunit.client.0.smithi152.stdout:8/721: dwrite d4/dc/d10/d49/f70 [4194304,4194304] 0 2024-04-06T12:23:57.266 INFO:tasks.workunit.client.0.smithi152.stdout:5/499: rmdir d3/da/d15 39 2024-04-06T12:23:57.266 INFO:tasks.workunit.client.0.smithi152.stdout:6/603: dwrite d7/d19/d3e/f9a [0,4194304] 0 2024-04-06T12:23:57.269 INFO:tasks.workunit.client.0.smithi152.stdout:0/660: chown d4/de/d28/d18/d43/d62/daa 457 1 2024-04-06T12:23:57.273 INFO:tasks.workunit.client.0.smithi152.stdout:8/722: dread - d4/db/d56/dcb/d6e/fdc zero size 2024-04-06T12:23:57.273 INFO:tasks.workunit.client.0.smithi152.stdout:4/644: dwrite d7/d16/f6e [0,4194304] 0 2024-04-06T12:23:57.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:55.584467+0000 mgr.smithi195.ausetj (mgr.24375) 82 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 1.2 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 41 MiB/s rd, 142 MiB/s wr, 311 op/s 2024-04-06T12:23:57.277 INFO:tasks.workunit.client.0.smithi152.stdout:0/661: symlink d4/d36/d72/d7c/lc9 0 2024-04-06T12:23:57.277 INFO:tasks.workunit.client.0.smithi152.stdout:4/645: write d7/d29/d7e/f67 [169923,59946] 0 2024-04-06T12:23:57.279 INFO:tasks.workunit.client.0.smithi152.stdout:0/662: write d4/d31/f5c [1383014,30571] 0 2024-04-06T12:23:57.283 INFO:tasks.workunit.client.0.smithi152.stdout:8/723: mkdir d4/d2c/df9 0 2024-04-06T12:23:57.284 INFO:tasks.workunit.client.0.smithi152.stdout:6/604: dwrite f6 [4194304,4194304] 0 2024-04-06T12:23:57.287 INFO:tasks.workunit.client.0.smithi152.stdout:6/605: dread - d7/d19/d1b/d31/d35/dbc/fc9 zero size 2024-04-06T12:23:57.288 INFO:tasks.workunit.client.0.smithi152.stdout:6/606: write d7/d19/d3e/f40 [4692772,22341] 0 2024-04-06T12:23:57.291 INFO:tasks.workunit.client.0.smithi152.stdout:8/724: creat d4/db/d56/dcb/dd5/ffa x:0 0 0 2024-04-06T12:23:57.293 INFO:tasks.workunit.client.0.smithi152.stdout:8/725: chown d4/db/d56/dcb/l37 45 1 2024-04-06T12:23:57.294 INFO:tasks.workunit.client.0.smithi152.stdout:0/663: rename d4/d19/f41 to d4/de/d4a/d33/fca 0 2024-04-06T12:23:57.295 INFO:tasks.workunit.client.0.smithi152.stdout:6/607: dread d7/d19/d1b/f7f [0,4194304] 0 2024-04-06T12:23:57.296 INFO:tasks.workunit.client.0.smithi152.stdout:8/726: mknod d4/d81/cfb 0 2024-04-06T12:23:57.299 INFO:tasks.workunit.client.0.smithi152.stdout:6/608: mkdir d7/d19/d3e/d70/dcb 0 2024-04-06T12:23:57.302 INFO:tasks.workunit.client.0.smithi152.stdout:9/416: sync 2024-04-06T12:23:57.304 INFO:tasks.workunit.client.0.smithi152.stdout:0/664: dwrite d4/de/d28/d18/d43/f5f [0,4194304] 0 2024-04-06T12:23:57.306 INFO:tasks.workunit.client.0.smithi152.stdout:6/609: mkdir d7/d9/d26/dcc 0 2024-04-06T12:23:57.306 INFO:tasks.workunit.client.0.smithi152.stdout:0/665: chown d4/de/d28/d18/d43/d81/c9a 6749 1 2024-04-06T12:23:57.315 INFO:tasks.workunit.client.0.smithi152.stdout:8/727: getdents d4/db/d56/dcb/d6e/d88 0 2024-04-06T12:23:57.319 INFO:tasks.workunit.client.0.smithi152.stdout:0/666: mkdir d4/de/d28/d18/d3b/d2e/dcb 0 2024-04-06T12:23:57.320 INFO:tasks.workunit.client.0.smithi152.stdout:0/667: read d4/d36/f5b [946332,89376] 0 2024-04-06T12:23:57.322 INFO:tasks.workunit.client.0.smithi152.stdout:5/500: write d3/da/d15/d2b/d3f/f6c [18851,35864] 0 2024-04-06T12:23:57.324 INFO:tasks.workunit.client.0.smithi152.stdout:0/668: dread d4/de/faf [0,4194304] 0 2024-04-06T12:23:57.327 INFO:tasks.workunit.client.0.smithi152.stdout:5/501: symlink d3/da/d15/d2b/l9c 0 2024-04-06T12:23:57.329 INFO:tasks.workunit.client.0.smithi152.stdout:5/502: chown d3/da/f29 1589 1 2024-04-06T12:23:57.331 INFO:tasks.workunit.client.0.smithi152.stdout:0/669: dwrite d4/d31/f3d [0,4194304] 0 2024-04-06T12:23:57.333 INFO:tasks.workunit.client.0.smithi152.stdout:5/503: symlink d3/da/d15/d40/d50/l9d 0 2024-04-06T12:23:57.333 INFO:tasks.workunit.client.0.smithi152.stdout:5/504: fdatasync d3/de/f35 0 2024-04-06T12:23:57.337 INFO:tasks.workunit.client.0.smithi152.stdout:5/505: creat d3/da/d15/d2b/d3f/d68/d81/f9e x:0 0 0 2024-04-06T12:23:57.344 INFO:tasks.workunit.client.0.smithi152.stdout:5/506: truncate d3/da/d15/f1c 2294380 0 2024-04-06T12:23:57.344 INFO:tasks.workunit.client.0.smithi152.stdout:0/670: dread d4/de/f68 [0,4194304] 0 2024-04-06T12:23:57.345 INFO:tasks.workunit.client.0.smithi152.stdout:5/507: fsync d3/da/d15/d2b/d3f/d68/d81/f6e 0 2024-04-06T12:23:57.349 INFO:tasks.workunit.client.0.smithi152.stdout:0/671: mkdir d4/d31/d47/d7e/db9/dcc 0 2024-04-06T12:23:57.351 INFO:tasks.workunit.client.0.smithi152.stdout:0/672: write d4/de/d28/f95 [2291450,82922] 0 2024-04-06T12:23:57.351 INFO:tasks.workunit.client.0.smithi152.stdout:5/508: mkdir d3/da/d15/d40/d4f/d9f 0 2024-04-06T12:23:57.357 INFO:tasks.workunit.client.0.smithi152.stdout:0/673: dwrite d4/de/d28/f22 [0,4194304] 0 2024-04-06T12:23:57.360 INFO:tasks.workunit.client.0.smithi152.stdout:5/509: rename d3/d9/lf to d3/da/d15/d40/d46/la0 0 2024-04-06T12:23:57.360 INFO:tasks.workunit.client.0.smithi152.stdout:5/510: readlink d3/da/l25 0 2024-04-06T12:23:57.362 INFO:tasks.workunit.client.0.smithi152.stdout:5/511: write d3/de/f35 [4105883,58196] 0 2024-04-06T12:23:57.362 INFO:tasks.workunit.client.0.smithi152.stdout:6/610: write d7/d9/d26/f3a [1032608,55015] 0 2024-04-06T12:23:57.368 INFO:tasks.workunit.client.0.smithi152.stdout:6/611: rmdir d7/d19/d3e 39 2024-04-06T12:23:57.369 INFO:tasks.workunit.client.0.smithi152.stdout:5/512: dwrite d3/da/d15/d40/f96 [0,4194304] 0 2024-04-06T12:23:57.379 INFO:tasks.workunit.client.0.smithi152.stdout:0/674: rename d4/d36/d72/d7c/lc9 to d4/de/d28/d18/d3b/d2e/lcd 0 2024-04-06T12:23:57.381 INFO:tasks.workunit.client.0.smithi152.stdout:0/675: fsync d4/d31/f3d 0 2024-04-06T12:23:57.383 INFO:tasks.workunit.client.0.smithi152.stdout:0/676: chown d4/de/d4a/d33/c37 1168615420 1 2024-04-06T12:23:57.383 INFO:tasks.workunit.client.0.smithi152.stdout:9/417: dwrite d5/d39/d3f/d42/f48 [0,4194304] 0 2024-04-06T12:23:57.385 INFO:tasks.workunit.client.0.smithi152.stdout:0/677: write d4/de/d4a/fb6 [729891,68049] 0 2024-04-06T12:23:57.386 INFO:tasks.workunit.client.0.smithi152.stdout:0/678: read - d4/de/d28/d99/fb5 zero size 2024-04-06T12:23:57.391 INFO:tasks.workunit.client.0.smithi152.stdout:6/612: getdents d7/d19/d1b 0 2024-04-06T12:23:57.391 INFO:tasks.workunit.client.0.smithi152.stdout:9/418: read d5/f81 [3475462,43265] 0 2024-04-06T12:23:57.391 INFO:tasks.workunit.client.0.smithi152.stdout:6/613: stat d7/d19/d1b/d31/d7c 0 2024-04-06T12:23:57.393 INFO:tasks.workunit.client.0.smithi152.stdout:0/679: mknod d4/de/d28/d18/d3b/d2e/dcb/cce 0 2024-04-06T12:23:57.402 INFO:tasks.workunit.client.0.smithi152.stdout:0/680: link d4/de/d28/d18/d3b/f9b d4/d36/d72/d7c/d8d/fcf 0 2024-04-06T12:23:57.409 INFO:tasks.workunit.client.0.smithi152.stdout:0/681: dwrite d4/de/d28/d18/d43/d81/f91 [0,4194304] 0 2024-04-06T12:23:57.416 INFO:tasks.workunit.client.0.smithi152.stdout:0/682: rename d4/de/c23 to d4/de/d28/d99/cd0 0 2024-04-06T12:23:57.436 INFO:tasks.workunit.client.0.smithi152.stdout:5/513: dwrite d3/de/f2e [0,4194304] 0 2024-04-06T12:23:57.437 INFO:tasks.workunit.client.0.smithi152.stdout:0/683: dread d4/de/d28/d18/d3b/fb4 [4194304,4194304] 0 2024-04-06T12:23:57.439 INFO:tasks.workunit.client.0.smithi152.stdout:6/614: write d7/f78 [1810159,79196] 0 2024-04-06T12:23:57.445 INFO:tasks.workunit.client.0.smithi152.stdout:9/419: dwrite d5/d39/f3d [0,4194304] 0 2024-04-06T12:23:57.451 INFO:tasks.workunit.client.0.smithi152.stdout:9/420: truncate d5/d6/d74/d17/d23/d2d/d4b/f6e 618436 0 2024-04-06T12:23:57.451 INFO:tasks.workunit.client.0.smithi152.stdout:5/514: unlink c1 0 2024-04-06T12:23:57.456 INFO:tasks.workunit.client.0.smithi152.stdout:0/684: unlink d4/de/da7/cba 0 2024-04-06T12:23:57.456 INFO:tasks.workunit.client.0.smithi152.stdout:6/615: stat d7/d19/d3e/d70/c8c 0 2024-04-06T12:23:57.457 INFO:tasks.workunit.client.0.smithi152.stdout:5/515: mknod d3/da/d15/d2b/ca1 0 2024-04-06T12:23:57.460 INFO:tasks.workunit.client.0.smithi152.stdout:6/616: write d7/d19/d3e/f9a [199814,31803] 0 2024-04-06T12:23:57.473 INFO:tasks.workunit.client.0.smithi152.stdout:6/617: unlink d7/d19/d1b/f7f 0 2024-04-06T12:23:57.473 INFO:tasks.workunit.client.0.smithi152.stdout:0/685: dwrite d4/de/d28/f22 [0,4194304] 0 2024-04-06T12:23:57.477 INFO:tasks.workunit.client.0.smithi152.stdout:9/421: getdents d5/d39/d3f/d42 0 2024-04-06T12:23:57.477 INFO:tasks.workunit.client.0.smithi152.stdout:0/686: chown d4/d31/f34 1 1 2024-04-06T12:23:57.482 INFO:tasks.workunit.client.0.smithi152.stdout:6/618: write d7/d19/d3e/f8b [658551,26874] 0 2024-04-06T12:23:57.486 INFO:tasks.workunit.client.0.smithi152.stdout:0/687: write d4/de/d87/f8f [764666,20500] 0 2024-04-06T12:23:57.491 INFO:tasks.workunit.client.0.smithi152.stdout:5/516: dread d3/da/d15/f21 [0,4194304] 0 2024-04-06T12:23:57.495 INFO:tasks.workunit.client.0.smithi152.stdout:9/422: unlink d5/d39/d3f/d42/c78 0 2024-04-06T12:23:57.504 INFO:tasks.workunit.client.0.smithi152.stdout:0/688: dwrite d4/d19/fab [0,4194304] 0 2024-04-06T12:23:57.506 INFO:tasks.workunit.client.0.smithi152.stdout:6/619: dwrite d7/d19/f8d [0,4194304] 0 2024-04-06T12:23:57.510 INFO:tasks.workunit.client.0.smithi152.stdout:5/517: truncate d3/d9/f27 1004792 0 2024-04-06T12:23:57.519 INFO:tasks.workunit.client.0.smithi152.stdout:0/689: mkdir d4/de/d28/d18/d43/dd1 0 2024-04-06T12:23:57.532 INFO:tasks.workunit.client.0.smithi152.stdout:0/690: rename d4/de/d28/d99/f9f to d4/de/d28/d18/d43/fd2 0 2024-04-06T12:23:57.534 INFO:tasks.workunit.client.0.smithi152.stdout:5/518: dread d3/f1f [0,4194304] 0 2024-04-06T12:23:57.534 INFO:tasks.workunit.client.0.smithi152.stdout:0/691: read d4/de/f30 [1030087,121966] 0 2024-04-06T12:23:57.536 INFO:tasks.workunit.client.0.smithi152.stdout:0/692: dread - d4/d31/d47/d7e/dbe/fc0 zero size 2024-04-06T12:23:57.536 INFO:tasks.workunit.client.0.smithi152.stdout:0/693: chown d4 245992 1 2024-04-06T12:23:57.537 INFO:tasks.workunit.client.0.smithi152.stdout:9/423: write d5/f1d [52319,85610] 0 2024-04-06T12:23:57.539 INFO:tasks.workunit.client.0.smithi152.stdout:9/424: read d5/f81 [1100435,360] 0 2024-04-06T12:23:57.542 INFO:tasks.workunit.client.0.smithi152.stdout:0/694: fsync d4/de/f68 0 2024-04-06T12:23:57.544 INFO:tasks.workunit.client.0.smithi152.stdout:6/620: dwrite d7/d9/f18 [0,4194304] 0 2024-04-06T12:23:57.545 INFO:tasks.workunit.client.0.smithi152.stdout:0/695: truncate d4/d31/d47/d7e/dbe/fc0 491222 0 2024-04-06T12:23:57.550 INFO:tasks.workunit.client.0.smithi152.stdout:9/425: creat d5/d6/d74/d17/f84 x:0 0 0 2024-04-06T12:23:57.555 INFO:tasks.workunit.client.0.smithi152.stdout:5/519: link d3/da/d15/d40/d50/l3d d3/de/la2 0 2024-04-06T12:23:57.563 INFO:tasks.workunit.client.0.smithi152.stdout:0/696: dread d4/de/d28/d18/d3b/fb4 [0,4194304] 0 2024-04-06T12:23:57.563 INFO:tasks.workunit.client.0.smithi152.stdout:7/527: sync 2024-04-06T12:23:57.563 INFO:tasks.workunit.client.0.smithi152.stdout:3/566: sync 2024-04-06T12:23:57.563 INFO:tasks.workunit.client.0.smithi152.stdout:2/549: sync 2024-04-06T12:23:57.563 INFO:tasks.workunit.client.0.smithi152.stdout:1/485: sync 2024-04-06T12:23:57.569 INFO:tasks.workunit.client.0.smithi152.stdout:5/520: mkdir d3/de/d80/d98/da3 0 2024-04-06T12:23:57.572 INFO:tasks.workunit.client.0.smithi152.stdout:0/697: dwrite d4/d31/f5c [0,4194304] 0 2024-04-06T12:23:57.574 INFO:tasks.workunit.client.0.smithi152.stdout:3/567: dwrite d0/d10/d13/d2a/f51 [0,4194304] 0 2024-04-06T12:23:57.574 INFO:tasks.workunit.client.0.smithi152.stdout:9/426: write d5/d6/f63 [679008,52096] 0 2024-04-06T12:23:57.578 INFO:tasks.workunit.client.0.smithi152.stdout:7/528: mkdir d8/df/d61/d3d/dac 0 2024-04-06T12:23:57.581 INFO:tasks.workunit.client.0.smithi152.stdout:3/568: dread - d0/d2d/f78 zero size 2024-04-06T12:23:57.583 INFO:tasks.workunit.client.0.smithi152.stdout:1/486: chown d2/d2f/d45/c4d 64065 1 2024-04-06T12:23:57.584 INFO:tasks.workunit.client.0.smithi152.stdout:2/550: mknod d0/dae/cb6 0 2024-04-06T12:23:57.585 INFO:tasks.workunit.client.0.smithi152.stdout:9/427: dread - d5/d6/d74/d17/d23/d2d/d32/f57 zero size 2024-04-06T12:23:57.586 INFO:tasks.workunit.client.0.smithi152.stdout:6/621: dwrite d7/d19/d1b/d31/f3c [4194304,4194304] 0 2024-04-06T12:23:57.588 INFO:tasks.workunit.client.0.smithi152.stdout:6/622: fdatasync d7/d19/d1b/d31/fb9 0 2024-04-06T12:23:57.592 INFO:tasks.workunit.client.0.smithi152.stdout:1/487: mkdir d2/d2f/d37/dae 0 2024-04-06T12:23:57.600 INFO:tasks.workunit.client.0.smithi152.stdout:7/529: mkdir d8/df/d61/d76/dad 0 2024-04-06T12:23:57.605 INFO:tasks.workunit.client.0.smithi152.stdout:1/488: dread d2/d2f/d37/d91/dad/f3a [0,4194304] 0 2024-04-06T12:23:57.606 INFO:tasks.workunit.client.0.smithi152.stdout:1/489: read - d2/d61/f6c zero size 2024-04-06T12:23:57.607 INFO:tasks.workunit.client.0.smithi152.stdout:1/490: dread - d2/d2f/d45/fa8 zero size 2024-04-06T12:23:57.608 INFO:tasks.workunit.client.0.smithi152.stdout:1/491: read d2/f1b [3934914,35448] 0 2024-04-06T12:23:57.610 INFO:tasks.workunit.client.0.smithi152.stdout:6/623: symlink d7/d9/d73/lcd 0 2024-04-06T12:23:57.614 INFO:tasks.workunit.client.0.smithi152.stdout:9/428: link d5/d39/d3f/d42/f5b d5/d6/d74/d17/d23/d2d/d32/d36/f85 0 2024-04-06T12:23:57.617 INFO:tasks.workunit.client.0.smithi152.stdout:2/551: write d0/d40/d26/f2b [2540082,107067] 0 2024-04-06T12:23:57.621 INFO:tasks.workunit.client.0.smithi152.stdout:0/698: getdents d4/d31/d47 0 2024-04-06T12:23:57.622 INFO:tasks.workunit.client.0.smithi152.stdout:0/699: write d4/de/d28/d99/fb5 [111426,4312] 0 2024-04-06T12:23:57.626 INFO:tasks.workunit.client.0.smithi152.stdout:6/624: dread d7/fb0 [0,4194304] 0 2024-04-06T12:23:57.628 INFO:tasks.workunit.client.0.smithi152.stdout:5/521: truncate d3/da/d15/d2b/d3f/d4c/f67 2795734 0 2024-04-06T12:23:57.629 INFO:tasks.workunit.client.0.smithi152.stdout:7/530: mkdir d8/d2a/d37/d43/d8a/d9d/dae 0 2024-04-06T12:23:57.630 INFO:tasks.workunit.client.0.smithi152.stdout:7/531: write d8/d2a/d42/f7f [1130053,51277] 0 2024-04-06T12:23:57.631 INFO:tasks.workunit.client.0.smithi152.stdout:2/552: rmdir d0/d2/d6f/d90/d9e/db5/d92 39 2024-04-06T12:23:57.632 INFO:tasks.workunit.client.0.smithi152.stdout:3/569: getdents d0/d10/d1e/d71/da2 0 2024-04-06T12:23:57.638 INFO:tasks.workunit.client.0.smithi152.stdout:2/553: dwrite d0/d40/d41/faf [0,4194304] 0 2024-04-06T12:23:57.641 INFO:tasks.workunit.client.0.smithi152.stdout:9/429: mkdir d5/d6/d74/d17/d86 0 2024-04-06T12:23:57.651 INFO:tasks.workunit.client.0.smithi152.stdout:3/570: chown d0/fb 20560 1 2024-04-06T12:23:57.656 INFO:tasks.workunit.client.0.smithi152.stdout:0/700: unlink d4/de/d28/l88 0 2024-04-06T12:23:57.663 INFO:tasks.workunit.client.0.smithi152.stdout:9/430: unlink d5/d6/c2a 0 2024-04-06T12:23:57.671 INFO:tasks.workunit.client.0.smithi152.stdout:1/492: dwrite d2/d2f/d54/d88/da4/fab [8388608,4194304] 0 2024-04-06T12:23:57.672 INFO:tasks.workunit.client.0.smithi152.stdout:2/554: dwrite d0/d15/d4d/db2/fac [0,4194304] 0 2024-04-06T12:23:57.674 INFO:tasks.workunit.client.0.smithi152.stdout:3/571: rmdir d0/d10/d1e/d71/da2/da5 39 2024-04-06T12:23:57.677 INFO:tasks.workunit.client.0.smithi152.stdout:6/625: dwrite d7/d19/f81 [0,4194304] 0 2024-04-06T12:23:57.682 INFO:tasks.workunit.client.0.smithi152.stdout:0/701: dwrite d4/de/d28/d18/d3b/fb4 [0,4194304] 0 2024-04-06T12:23:57.688 INFO:tasks.workunit.client.0.smithi152.stdout:5/522: truncate d3/da/d15/d2b/d3f/d68/d81/f56 3458887 0 2024-04-06T12:23:57.691 INFO:tasks.workunit.client.0.smithi152.stdout:7/532: write d8/df/f5e [3946282,103538] 0 2024-04-06T12:23:57.701 INFO:tasks.workunit.client.0.smithi152.stdout:4/646: sync 2024-04-06T12:23:57.713 INFO:tasks.workunit.client.0.smithi152.stdout:1/493: mkdir d2/d2f/daf 0 2024-04-06T12:23:57.718 INFO:tasks.workunit.client.0.smithi152.stdout:0/702: mkdir d4/de/d87/d94/dd3 0 2024-04-06T12:23:57.720 INFO:tasks.workunit.client.0.smithi152.stdout:7/533: mkdir d8/d2a/d37/d8c/daf 0 2024-04-06T12:23:57.721 INFO:tasks.workunit.client.0.smithi152.stdout:0/703: chown d4/d31/d47/d7e/dbe/d8e/la5 2130349 1 2024-04-06T12:23:57.722 INFO:tasks.workunit.client.0.smithi152.stdout:4/647: creat d7/d16/d22/dc7/fd1 x:0 0 0 2024-04-06T12:23:57.724 INFO:tasks.workunit.client.0.smithi152.stdout:2/555: dwrite d0/d15/d4d/f4e [0,4194304] 0 2024-04-06T12:23:57.728 INFO:tasks.workunit.client.0.smithi152.stdout:3/572: mknod d0/d10/daf/cb4 0 2024-04-06T12:23:57.735 INFO:tasks.workunit.client.0.smithi152.stdout:7/534: mknod d8/d2a/d37/d8c/d2d/d7a/cb0 0 2024-04-06T12:23:57.736 INFO:tasks.workunit.client.0.smithi152.stdout:0/704: mkdir d4/de/d28/d18/d43/d62/dd4 0 2024-04-06T12:23:57.738 INFO:tasks.workunit.client.0.smithi152.stdout:6/626: rename d7/d62/l6c to d7/d19/d3e/d70/dcb/lce 0 2024-04-06T12:23:57.741 INFO:tasks.workunit.client.0.smithi152.stdout:1/494: link d2/c19 d2/d61/cb0 0 2024-04-06T12:23:57.741 INFO:tasks.workunit.client.0.smithi152.stdout:2/556: fdatasync d0/d15/d4d/f4e 0 2024-04-06T12:23:57.742 INFO:tasks.workunit.client.0.smithi152.stdout:2/557: chown d0/d40 9 1 2024-04-06T12:23:57.755 INFO:tasks.workunit.client.0.smithi152.stdout:9/431: getdents d5/d6/d74/d17/d23/d2d/d32 0 2024-04-06T12:23:57.757 INFO:tasks.workunit.client.0.smithi152.stdout:7/535: unlink d8/df/d34/d63/f71 0 2024-04-06T12:23:57.761 INFO:tasks.workunit.client.0.smithi152.stdout:6/627: unlink d7/d19/d1b/d31/d35/f5c 0 2024-04-06T12:23:57.766 INFO:tasks.workunit.client.0.smithi152.stdout:3/573: symlink d0/d35/d75/lb5 0 2024-04-06T12:23:57.767 INFO:tasks.workunit.client.0.smithi152.stdout:2/558: unlink d0/d15/d4d/f55 0 2024-04-06T12:23:57.771 INFO:tasks.workunit.client.0.smithi152.stdout:8/728: sync 2024-04-06T12:23:57.775 INFO:tasks.workunit.client.0.smithi152.stdout:0/705: mkdir d4/d31/d47/d7e/db9/dcc/dd5 0 2024-04-06T12:23:57.775 INFO:tasks.workunit.client.0.smithi152.stdout:4/648: write d7/fb5 [2163619,87031] 0 2024-04-06T12:23:57.777 INFO:tasks.workunit.client.0.smithi152.stdout:4/649: truncate d7/d16/d22/dc7/fd1 924312 0 2024-04-06T12:23:57.779 INFO:tasks.workunit.client.0.smithi152.stdout:4/650: write d7/d29/d78/f39 [883103,4305] 0 2024-04-06T12:23:57.780 INFO:tasks.workunit.client.0.smithi152.stdout:4/651: write d7/d16/d55/da0/fa9 [279921,28962] 0 2024-04-06T12:23:57.781 INFO:tasks.workunit.client.0.smithi152.stdout:4/652: write d7/d16/d22/d3f/db4/f43 [2526182,54466] 0 2024-04-06T12:23:57.927 INFO:tasks.workunit.client.0.smithi152.stdout:3/574: mkdir d0/d10/d13/d2a/db6 0 2024-04-06T12:23:57.928 INFO:tasks.workunit.client.0.smithi152.stdout:5/523: write d3/da/d15/d2b/d3f/d4c/f67 [2128314,105828] 0 2024-04-06T12:23:57.928 INFO:tasks.workunit.client.0.smithi152.stdout:9/432: mknod d5/d6/d74/d17/d23/d2d/c87 0 2024-04-06T12:23:57.929 INFO:tasks.workunit.client.0.smithi152.stdout:4/653: mknod d7/d29/d7e/d59/cd2 0 2024-04-06T12:23:57.932 INFO:tasks.workunit.client.0.smithi152.stdout:1/495: creat d2/d1d/fb1 x:0 0 0 2024-04-06T12:23:57.932 INFO:tasks.workunit.client.0.smithi152.stdout:5/524: stat d3/da/d15/d40/d4f/f57 0 2024-04-06T12:23:57.933 INFO:tasks.workunit.client.0.smithi152.stdout:4/654: read - d7/d16/d22/d3f/fa2 zero size 2024-04-06T12:23:57.933 INFO:tasks.workunit.client.0.smithi152.stdout:2/559: symlink d0/d15/d24/lb7 0 2024-04-06T12:23:57.938 INFO:tasks.workunit.client.0.smithi152.stdout:7/536: dwrite d8/df/d34/d63/f92 [0,4194304] 0 2024-04-06T12:23:57.938 INFO:tasks.workunit.client.0.smithi152.stdout:3/575: dwrite d0/d1f/d28/f74 [0,4194304] 0 2024-04-06T12:23:57.940 INFO:tasks.workunit.client.0.smithi152.stdout:7/537: write d8/d2a/d37/fa7 [962769,116813] 0 2024-04-06T12:23:57.957 INFO:tasks.workunit.client.0.smithi152.stdout:6/628: dread d7/d19/d3e/f53 [0,4194304] 0 2024-04-06T12:23:58.054 INFO:tasks.workunit.client.0.smithi152.stdout:9/433: unlink d5/d6/d74/d17/d23/d2d/d4b/f6e 0 2024-04-06T12:23:58.055 INFO:tasks.workunit.client.0.smithi152.stdout:9/434: write d5/d6/d74/d17/f75 [1343025,103079] 0 2024-04-06T12:23:58.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/435: dwrite d5/d6/d74/d17/f77 [0,4194304] 0 2024-04-06T12:23:58.062 INFO:tasks.workunit.client.0.smithi152.stdout:4/655: truncate d7/d16/f96 234899 0 2024-04-06T12:23:58.064 INFO:tasks.workunit.client.0.smithi152.stdout:3/576: chown d0/d10/d1e/f46 17844950 1 2024-04-06T12:23:58.068 INFO:tasks.workunit.client.0.smithi152.stdout:4/656: dread d7/d16/d22/dc7/dc8/fbb [0,4194304] 0 2024-04-06T12:23:58.082 INFO:tasks.workunit.client.0.smithi152.stdout:1/496: mkdir d2/db2 0 2024-04-06T12:23:58.084 INFO:tasks.workunit.client.0.smithi152.stdout:5/525: mknod d3/de/d8c/ca4 0 2024-04-06T12:23:58.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/577: creat d0/d10/d1e/d71/fb7 x:0 0 0 2024-04-06T12:23:58.097 INFO:tasks.workunit.client.0.smithi152.stdout:3/578: dread d0/fb [0,4194304] 0 2024-04-06T12:23:58.098 INFO:tasks.workunit.client.0.smithi152.stdout:3/579: truncate d0/d1f/d28/fa9 228568 0 2024-04-06T12:23:58.099 INFO:tasks.workunit.client.0.smithi152.stdout:3/580: write d0/d35/d43/fb1 [610948,28520] 0 2024-04-06T12:23:58.101 INFO:tasks.workunit.client.0.smithi152.stdout:3/581: dread d0/d35/d75/f85 [0,4194304] 0 2024-04-06T12:23:58.101 INFO:tasks.workunit.client.0.smithi152.stdout:0/706: getdents d4/d31/d47/d7e/db9/dcc 0 2024-04-06T12:23:58.103 INFO:tasks.workunit.client.0.smithi152.stdout:3/582: truncate d0/d10/d45/f6b 1524150 0 2024-04-06T12:23:58.104 INFO:tasks.workunit.client.0.smithi152.stdout:0/707: dread d4/de/d28/d99/fb5 [0,4194304] 0 2024-04-06T12:23:58.113 INFO:tasks.workunit.client.0.smithi152.stdout:4/657: mknod d7/d29/cd3 0 2024-04-06T12:23:58.116 INFO:tasks.workunit.client.0.smithi152.stdout:6/629: unlink d7/d19/d1b/d22/c24 0 2024-04-06T12:23:58.126 INFO:tasks.workunit.client.0.smithi152.stdout:1/497: mkdir d2/d2f/d54/d88/d9c/db3 0 2024-04-06T12:23:58.126 INFO:tasks.workunit.client.0.smithi152.stdout:1/498: readlink d2/d5d/d6d/d7d/lac 0 2024-04-06T12:23:58.136 INFO:tasks.workunit.client.0.smithi152.stdout:3/583: rename d0/d10/d1e/d71/da2/da5 to d0/d1f/d44/d7c/db8 0 2024-04-06T12:23:58.139 INFO:tasks.workunit.client.0.smithi152.stdout:0/708: mknod d4/de/d28/d18/d43/d62/daa/cd6 0 2024-04-06T12:23:58.144 INFO:tasks.workunit.client.0.smithi152.stdout:4/658: mknod d7/d16/d22/d3f/db4/d60/dc4/cd4 0 2024-04-06T12:23:58.145 INFO:tasks.workunit.client.0.smithi152.stdout:6/630: rmdir d7/d19/d1b/d1f/d3d 39 2024-04-06T12:23:58.150 INFO:tasks.workunit.client.0.smithi152.stdout:0/709: mknod d4/d31/d47/d7e/dbe/d8e/cd7 0 2024-04-06T12:23:58.153 INFO:tasks.workunit.client.0.smithi152.stdout:1/499: creat d2/d61/d85/fb4 x:0 0 0 2024-04-06T12:23:58.155 INFO:tasks.workunit.client.0.smithi152.stdout:4/659: symlink d7/d16/d55/da0/ld5 0 2024-04-06T12:23:58.156 INFO:tasks.workunit.client.0.smithi152.stdout:1/500: dread d2/d61/f73 [0,4194304] 0 2024-04-06T12:23:58.158 INFO:tasks.workunit.client.0.smithi152.stdout:6/631: truncate d7/d19/d3e/d70/f99 416911 0 2024-04-06T12:23:58.164 INFO:tasks.workunit.client.0.smithi152.stdout:0/710: truncate d4/d36/f74 360317 0 2024-04-06T12:23:58.166 INFO:tasks.workunit.client.0.smithi152.stdout:0/711: read d4/de/d28/d18/d3b/d2e/fad [446998,46208] 0 2024-04-06T12:23:58.167 INFO:tasks.workunit.client.0.smithi152.stdout:0/712: write d4/de/d87/f77 [578873,35988] 0 2024-04-06T12:23:58.169 INFO:tasks.workunit.client.0.smithi152.stdout:4/660: creat d7/d16/d22/dc7/fd6 x:0 0 0 2024-04-06T12:23:58.174 INFO:tasks.workunit.client.0.smithi152.stdout:3/584: link d0/l3a d0/d10/d13/d2a/d4b/lb9 0 2024-04-06T12:23:58.175 INFO:tasks.workunit.client.0.smithi152.stdout:3/585: readlink d0/d10/d1e/l29 0 2024-04-06T12:23:58.177 INFO:tasks.workunit.client.0.smithi152.stdout:6/632: dread d7/d19/f23 [4194304,4194304] 0 2024-04-06T12:23:58.177 INFO:tasks.workunit.client.0.smithi152.stdout:6/633: readlink d7/d9/l9c 0 2024-04-06T12:23:58.179 INFO:tasks.workunit.client.0.smithi152.stdout:3/586: dread d0/d1f/d28/f74 [0,4194304] 0 2024-04-06T12:23:58.186 INFO:tasks.workunit.client.0.smithi152.stdout:9/436: dwrite d5/d6/d74/d17/d23/d2d/d32/d36/f85 [0,4194304] 0 2024-04-06T12:23:58.186 INFO:tasks.workunit.client.0.smithi152.stdout:0/713: chown d4/de/d28/d18/c9d 24351460 1 2024-04-06T12:23:58.186 INFO:tasks.workunit.client.0.smithi152.stdout:9/437: stat d5/d6/l2f 0 2024-04-06T12:23:58.187 INFO:tasks.workunit.client.0.smithi152.stdout:1/501: mkdir d2/d2f/d37/dae/db5 0 2024-04-06T12:23:58.187 INFO:tasks.workunit.client.0.smithi152.stdout:7/538: truncate d8/f6f 682566 0 2024-04-06T12:23:58.190 INFO:tasks.workunit.client.0.smithi152.stdout:4/661: truncate d7/d29/d78/d33/f74 603609 0 2024-04-06T12:23:58.190 INFO:tasks.workunit.client.0.smithi152.stdout:9/438: dread d5/d6/d74/d17/d23/d2d/d4b/d5a/f6f [0,4194304] 0 2024-04-06T12:23:58.199 INFO:tasks.workunit.client.0.smithi152.stdout:9/439: dwrite d5/d39/d79/f7f [0,4194304] 0 2024-04-06T12:23:58.202 INFO:tasks.workunit.client.0.smithi152.stdout:3/587: symlink d0/d10/daf/lba 0 2024-04-06T12:23:58.203 INFO:tasks.workunit.client.0.smithi152.stdout:3/588: write d0/d35/d43/fb1 [538670,62386] 0 2024-04-06T12:23:58.213 INFO:tasks.workunit.client.0.smithi152.stdout:7/539: rmdir d8/d2a/d37/d43/d8a/d9d 39 2024-04-06T12:23:58.215 INFO:tasks.workunit.client.0.smithi152.stdout:5/526: dwrite d3/da/d15/d40/d50/f95 [0,4194304] 0 2024-04-06T12:23:58.215 INFO:tasks.workunit.client.0.smithi152.stdout:0/714: dwrite d4/de/d28/d18/d43/fd2 [0,4194304] 0 2024-04-06T12:23:58.217 INFO:tasks.workunit.client.0.smithi152.stdout:7/540: dread d8/f1b [4194304,4194304] 0 2024-04-06T12:23:58.217 INFO:tasks.workunit.client.0.smithi152.stdout:5/527: stat d3/da/d15/d2b/d3f/d68/d81/f45 0 2024-04-06T12:23:58.219 INFO:tasks.workunit.client.0.smithi152.stdout:7/541: dread - d8/df/d34/f88 zero size 2024-04-06T12:23:58.238 INFO:tasks.workunit.client.0.smithi152.stdout:5/528: dread d3/da/d15/d40/d46/f6b [0,4194304] 0 2024-04-06T12:23:58.300 INFO:tasks.workunit.client.0.smithi152.stdout:8/729: sync 2024-04-06T12:23:58.301 INFO:tasks.workunit.client.0.smithi152.stdout:8/730: chown d4/db/d56/dcb/c45 779 1 2024-04-06T12:23:58.310 INFO:tasks.workunit.client.0.smithi152.stdout:3/589: read - d0/d1f/d44/f7b zero size 2024-04-06T12:23:58.310 INFO:tasks.workunit.client.0.smithi152.stdout:3/590: readlink d0/d10/daf/lba 0 2024-04-06T12:23:58.317 INFO:tasks.workunit.client.0.smithi152.stdout:8/731: dread d4/db/d56/d85/fd6 [0,4194304] 0 2024-04-06T12:23:58.317 INFO:tasks.workunit.client.0.smithi152.stdout:3/591: dwrite d0/d2d/f84 [0,4194304] 0 2024-04-06T12:23:58.320 INFO:tasks.workunit.client.0.smithi152.stdout:3/592: dread d0/d35/d75/f85 [0,4194304] 0 2024-04-06T12:23:58.327 INFO:tasks.workunit.client.0.smithi152.stdout:0/715: unlink d4/d31/c3e 0 2024-04-06T12:23:58.335 INFO:tasks.workunit.client.0.smithi152.stdout:4/662: unlink d7/d29/lb8 0 2024-04-06T12:23:58.338 INFO:tasks.workunit.client.0.smithi152.stdout:5/529: symlink d3/da/d15/d40/d4f/la5 0 2024-04-06T12:23:58.339 INFO:tasks.workunit.client.0.smithi152.stdout:5/530: write d3/da/d15/d40/f96 [1394300,15551] 0 2024-04-06T12:23:58.340 INFO:tasks.workunit.client.0.smithi152.stdout:5/531: chown d3/da/d15/d2b/d3f/d68/d81/f45 11 1 2024-04-06T12:23:58.341 INFO:tasks.workunit.client.0.smithi152.stdout:5/532: stat d3/da/d15/d2b/d3f/d4c 0 2024-04-06T12:23:58.342 INFO:tasks.workunit.client.0.smithi152.stdout:5/533: stat d3/da/d15/d2b/d3f 0 2024-04-06T12:23:58.344 INFO:tasks.workunit.client.0.smithi152.stdout:1/502: rename d2/f6b to d2/fb6 0 2024-04-06T12:23:58.355 INFO:tasks.workunit.client.0.smithi152.stdout:0/716: mknod d4/d31/d47/d7e/dbe/d8e/cd8 0 2024-04-06T12:23:58.360 INFO:tasks.workunit.client.0.smithi152.stdout:7/542: symlink d8/df/d61/d3d/d6e/lb1 0 2024-04-06T12:23:58.361 INFO:tasks.workunit.client.0.smithi152.stdout:7/543: truncate d8/df/d28/d41/fa4 984554 0 2024-04-06T12:23:58.362 INFO:tasks.workunit.client.0.smithi152.stdout:7/544: chown d8/df/c15 7610308 1 2024-04-06T12:23:58.367 INFO:tasks.workunit.client.0.smithi152.stdout:5/534: mknod d3/da/d53/ca6 0 2024-04-06T12:23:58.369 INFO:tasks.workunit.client.0.smithi152.stdout:8/732: getdents d4/db/d56/d85/dcd 0 2024-04-06T12:23:58.371 INFO:tasks.workunit.client.0.smithi152.stdout:3/593: mkdir d0/d10/d1e/d71/db2/dbb 0 2024-04-06T12:23:58.374 INFO:tasks.workunit.client.0.smithi152.stdout:0/717: creat d4/de/d28/d99/fd9 x:0 0 0 2024-04-06T12:23:58.374 INFO:tasks.workunit.client.0.smithi152.stdout:0/718: chown d4/de/d87/d94/dd3 114 1 2024-04-06T12:23:58.376 INFO:tasks.workunit.client.0.smithi152.stdout:7/545: symlink d8/df/d34/lb2 0 2024-04-06T12:23:58.376 INFO:tasks.workunit.client.0.smithi152.stdout:0/719: write d4/de/d87/f77 [1288084,123433] 0 2024-04-06T12:23:58.376 INFO:tasks.workunit.client.0.smithi152.stdout:6/634: write d7/d19/f30 [1955100,1313] 0 2024-04-06T12:23:58.377 INFO:tasks.workunit.client.0.smithi152.stdout:7/546: write f3 [2781996,51856] 0 2024-04-06T12:23:58.379 INFO:tasks.workunit.client.0.smithi152.stdout:5/535: mknod d3/da/d15/d2b/d3f/ca7 0 2024-04-06T12:23:58.383 INFO:tasks.workunit.client.0.smithi152.stdout:3/594: creat d0/d35/d43/d48/fbc x:0 0 0 2024-04-06T12:23:58.390 INFO:tasks.workunit.client.0.smithi152.stdout:6/635: rmdir d7/d19/d1b/d22 39 2024-04-06T12:23:58.403 INFO:tasks.workunit.client.0.smithi152.stdout:6/636: unlink d7/d9/f2b 0 2024-04-06T12:23:58.406 INFO:tasks.workunit.client.0.smithi152.stdout:5/536: getdents d3/da/d15/d40/d50/d99 0 2024-04-06T12:23:58.406 INFO:tasks.workunit.client.0.smithi152.stdout:7/547: dread d8/d2a/d42/f57 [0,4194304] 0 2024-04-06T12:23:58.406 INFO:tasks.workunit.client.0.smithi152.stdout:8/733: link d4/d5f/l62 d4/dc/d10/d49/da0/dc0/db6/lfc 0 2024-04-06T12:23:58.410 INFO:tasks.workunit.client.0.smithi152.stdout:3/595: getdents d0/d10/d1e/d87/da8 0 2024-04-06T12:23:58.410 INFO:tasks.workunit.client.0.smithi152.stdout:5/537: dread d3/da/d15/d40/d50/f95 [0,4194304] 0 2024-04-06T12:23:58.411 INFO:tasks.workunit.client.0.smithi152.stdout:3/596: write d0/d2d/f78 [792570,110957] 0 2024-04-06T12:23:58.411 INFO:tasks.workunit.client.0.smithi152.stdout:5/538: readlink d3/de/l26 0 2024-04-06T12:23:58.414 INFO:tasks.workunit.client.0.smithi152.stdout:3/597: dread d0/d35/d43/fb1 [0,4194304] 0 2024-04-06T12:23:58.418 INFO:tasks.workunit.client.0.smithi152.stdout:7/548: truncate d8/d2a/d37/d8c/d2d/da3/d65/f89 635216 0 2024-04-06T12:23:58.419 INFO:tasks.workunit.client.0.smithi152.stdout:7/549: write d8/df/d61/fa6 [690609,52588] 0 2024-04-06T12:23:58.426 INFO:tasks.workunit.client.0.smithi152.stdout:7/550: dwrite d8/d2a/d37/d79/d81/f95 [0,4194304] 0 2024-04-06T12:23:58.427 INFO:tasks.workunit.client.0.smithi152.stdout:7/551: fdatasync d8/df/d34/f88 0 2024-04-06T12:23:58.429 INFO:tasks.workunit.client.0.smithi152.stdout:7/552: chown d8/df/d61/d6d/d85/la8 308 1 2024-04-06T12:23:58.429 INFO:tasks.workunit.client.0.smithi152.stdout:3/598: rename d0/d1f/d4a/l67 to d0/d10/d13/d2a/db6/lbd 0 2024-04-06T12:23:58.430 INFO:tasks.workunit.client.0.smithi152.stdout:7/553: write d8/df/d61/d76/d7e/f1a [6275347,55108] 0 2024-04-06T12:23:58.448 INFO:tasks.workunit.client.0.smithi152.stdout:5/539: getdents d3/de/d8c 0 2024-04-06T12:23:58.450 INFO:tasks.workunit.client.0.smithi152.stdout:7/554: rmdir d8/df/d61 39 2024-04-06T12:23:58.453 INFO:tasks.workunit.client.0.smithi152.stdout:7/555: chown d8/df/d61/d76/d7e/f72 37 1 2024-04-06T12:23:58.454 INFO:tasks.workunit.client.0.smithi152.stdout:5/540: mknod d3/ca8 0 2024-04-06T12:23:58.458 INFO:tasks.workunit.client.0.smithi152.stdout:7/556: creat d8/d2a/d37/d8c/daf/fb3 x:0 0 0 2024-04-06T12:23:58.460 INFO:tasks.workunit.client.0.smithi152.stdout:2/560: sync 2024-04-06T12:23:58.461 INFO:tasks.workunit.client.0.smithi152.stdout:4/663: dwrite d7/d29/d7e/d59/f62 [0,4194304] 0 2024-04-06T12:23:58.462 INFO:tasks.workunit.client.0.smithi152.stdout:2/561: fsync d0/d40/d41/d28/d8c/faa 0 2024-04-06T12:23:58.464 INFO:tasks.workunit.client.0.smithi152.stdout:7/557: mknod d8/d2a/d37/d8c/daf/cb4 0 2024-04-06T12:23:58.470 INFO:tasks.workunit.client.0.smithi152.stdout:1/503: write d2/fb6 [1636292,111130] 0 2024-04-06T12:23:58.471 INFO:tasks.workunit.client.0.smithi152.stdout:5/541: dread d3/da/d15/d2b/d3f/d68/d81/f56 [0,4194304] 0 2024-04-06T12:23:58.471 INFO:tasks.workunit.client.0.smithi152.stdout:4/664: unlink d7/d82/l8b 0 2024-04-06T12:23:58.472 INFO:tasks.workunit.client.0.smithi152.stdout:5/542: chown d3/de/d80/d8f 850705430 1 2024-04-06T12:23:58.474 INFO:tasks.workunit.client.0.smithi152.stdout:4/665: truncate d7/d29/d78/d33/f6b 477581 0 2024-04-06T12:23:58.480 INFO:tasks.workunit.client.0.smithi152.stdout:5/543: truncate d3/da/d15/d2b/d3f/d68/d81/f56 1118169 0 2024-04-06T12:23:58.483 INFO:tasks.workunit.client.0.smithi152.stdout:1/504: getdents d2/d1d/d3b 0 2024-04-06T12:23:58.488 INFO:tasks.workunit.client.0.smithi152.stdout:4/666: mkdir d7/d29/d2e/d5b/db2/dd7 0 2024-04-06T12:23:58.491 INFO:tasks.workunit.client.0.smithi152.stdout:2/562: symlink d0/d15/d24/lb8 0 2024-04-06T12:23:58.493 INFO:tasks.workunit.client.0.smithi152.stdout:1/505: mknod d2/d2f/d45/cb7 0 2024-04-06T12:23:58.496 INFO:tasks.workunit.client.0.smithi152.stdout:2/563: mknod d0/d15/d24/d79/d80/cb9 0 2024-04-06T12:23:58.496 INFO:tasks.workunit.client.0.smithi152.stdout:7/558: dread d8/df/f5e [4194304,4194304] 0 2024-04-06T12:23:58.503 INFO:tasks.workunit.client.0.smithi152.stdout:2/564: mknod d0/d15/d24/d3d/cba 0 2024-04-06T12:23:58.506 INFO:tasks.workunit.client.0.smithi152.stdout:0/720: write f0 [3963101,89235] 0 2024-04-06T12:23:58.508 INFO:tasks.workunit.client.0.smithi152.stdout:4/667: link d7/d16/d22/dc7/fd6 d7/d29/fd8 0 2024-04-06T12:23:58.509 INFO:tasks.workunit.client.0.smithi152.stdout:4/668: chown d7/d82/db1/db6/cc9 492155 1 2024-04-06T12:23:58.510 INFO:tasks.workunit.client.0.smithi152.stdout:4/669: write d7/d29/d2e/d5b/fb3 [306192,105578] 0 2024-04-06T12:23:58.516 INFO:tasks.workunit.client.0.smithi152.stdout:4/670: symlink d7/d16/ld9 0 2024-04-06T12:23:58.520 INFO:tasks.workunit.client.0.smithi152.stdout:7/559: mknod d8/d2a/d37/d43/d8a/d9d/dae/cb5 0 2024-04-06T12:23:58.521 INFO:tasks.workunit.client.0.smithi152.stdout:4/671: dread d7/d16/d22/d3f/db4/f37 [0,4194304] 0 2024-04-06T12:23:58.522 INFO:tasks.workunit.client.0.smithi152.stdout:0/721: mknod d4/d19/dbd/cda 0 2024-04-06T12:23:58.523 INFO:tasks.workunit.client.0.smithi152.stdout:2/565: dread d0/d15/d4d/f76 [0,4194304] 0 2024-04-06T12:23:58.523 INFO:tasks.workunit.client.0.smithi152.stdout:0/722: chown d4/d36/d72/d7c/d8d/fcf 3184724 1 2024-04-06T12:23:58.526 INFO:tasks.workunit.client.0.smithi152.stdout:4/672: stat d7/c1e 0 2024-04-06T12:23:58.529 INFO:tasks.workunit.client.0.smithi152.stdout:0/723: dwrite d4/d19/fab [4194304,4194304] 0 2024-04-06T12:23:58.537 INFO:tasks.workunit.client.0.smithi152.stdout:2/566: rename d0/d15/d24/d3d/f4f to d0/d2/d6f/fbb 0 2024-04-06T12:23:58.537 INFO:tasks.workunit.client.0.smithi152.stdout:2/567: chown d0/d40/d26/la9 3 1 2024-04-06T12:23:58.538 INFO:tasks.workunit.client.0.smithi152.stdout:2/568: dread - d0/d2/d6f/d90/fa5 zero size 2024-04-06T12:23:58.539 INFO:tasks.workunit.client.0.smithi152.stdout:2/569: read d0/d40/d26/f2a [1619767,107399] 0 2024-04-06T12:23:58.541 INFO:tasks.workunit.client.0.smithi152.stdout:4/673: mkdir d7/d16/d22/d95/dda 0 2024-04-06T12:23:58.542 INFO:tasks.workunit.client.0.smithi152.stdout:7/560: mknod d8/d2a/d37/d8c/d66/cb6 0 2024-04-06T12:23:58.555 INFO:tasks.workunit.client.0.smithi152.stdout:4/674: creat d7/d16/d22/d95/dda/fdb x:0 0 0 2024-04-06T12:23:58.557 INFO:tasks.workunit.client.0.smithi152.stdout:4/675: write d7/d29/d78/d33/fae [734109,20082] 0 2024-04-06T12:23:58.564 INFO:tasks.workunit.client.0.smithi152.stdout:4/676: truncate d7/d29/d2e/d5b/fb3 1158874 0 2024-04-06T12:23:58.565 INFO:tasks.workunit.client.0.smithi152.stdout:2/570: creat d0/d40/fbc x:0 0 0 2024-04-06T12:23:58.572 INFO:tasks.workunit.client.0.smithi152.stdout:0/724: getdents d4/de/d28/d18 0 2024-04-06T12:23:58.576 INFO:tasks.workunit.client.0.smithi152.stdout:7/561: link d8/df/d61/c10 d8/d2a/d37/d8c/d59/cb7 0 2024-04-06T12:23:58.577 INFO:tasks.workunit.client.0.smithi152.stdout:2/571: creat d0/d40/d41/d28/fbd x:0 0 0 2024-04-06T12:23:58.580 INFO:tasks.workunit.client.0.smithi152.stdout:0/725: symlink d4/de/d28/d18/d43/d62/ldb 0 2024-04-06T12:23:58.582 INFO:tasks.workunit.client.0.smithi152.stdout:4/677: dwrite d7/d16/d22/d3f/db4/f43 [0,4194304] 0 2024-04-06T12:23:58.586 INFO:tasks.workunit.client.0.smithi152.stdout:4/678: dread - d7/d16/d22/d3f/fa2 zero size 2024-04-06T12:23:58.586 INFO:tasks.workunit.client.0.smithi152.stdout:7/562: mkdir d8/df/d61/d4b/d56/db8 0 2024-04-06T12:23:58.587 INFO:tasks.workunit.client.0.smithi152.stdout:2/572: creat d0/d40/d41/d28/fbe x:0 0 0 2024-04-06T12:23:58.597 INFO:tasks.workunit.client.0.smithi152.stdout:7/563: dwrite d8/df/d61/d76/d7e/f1a [0,4194304] 0 2024-04-06T12:23:58.597 INFO:tasks.workunit.client.0.smithi152.stdout:2/573: chown d0/d2/c57 32 1 2024-04-06T12:23:58.600 INFO:tasks.workunit.client.0.smithi152.stdout:8/734: dwrite d4/db/d56/f86 [0,4194304] 0 2024-04-06T12:23:58.603 INFO:tasks.workunit.client.0.smithi152.stdout:4/679: rename d7/d16/d22/dc7/dc8/fbb to d7/d16/d55/da0/fdc 0 2024-04-06T12:23:58.609 INFO:tasks.workunit.client.0.smithi152.stdout:3/599: write d0/d1f/d28/f86 [74035,78675] 0 2024-04-06T12:23:58.610 INFO:tasks.workunit.client.0.smithi152.stdout:3/600: stat d0/d10 0 2024-04-06T12:23:58.615 INFO:tasks.workunit.client.0.smithi152.stdout:2/574: dread d0/d15/d24/f5b [0,4194304] 0 2024-04-06T12:23:58.621 INFO:tasks.workunit.client.0.smithi152.stdout:3/601: dwrite d0/d2d/f78 [0,4194304] 0 2024-04-06T12:23:58.622 INFO:tasks.workunit.client.0.smithi152.stdout:3/602: readlink d0/d1f/d4a/l4d 0 2024-04-06T12:23:58.626 INFO:tasks.workunit.client.0.smithi152.stdout:8/735: rename d4/dc/d10/l14 to d4/dc/d10/lfd 0 2024-04-06T12:23:58.636 INFO:tasks.workunit.client.0.smithi152.stdout:4/680: rmdir d7/d29/d2e/d5b/dc5 0 2024-04-06T12:23:58.638 INFO:tasks.workunit.client.0.smithi152.stdout:3/603: unlink d0/d10/d45/f6b 0 2024-04-06T12:23:58.639 INFO:tasks.workunit.client.0.smithi152.stdout:8/736: symlink d4/db/d56/dcb/d6e/dd4/lfe 0 2024-04-06T12:23:58.644 INFO:tasks.workunit.client.0.smithi152.stdout:2/575: fsync d0/d2/f45 0 2024-04-06T12:23:58.644 INFO:tasks.workunit.client.0.smithi152.stdout:4/681: dwrite d7/d29/d78/d33/fae [0,4194304] 0 2024-04-06T12:23:58.645 INFO:tasks.workunit.client.0.smithi152.stdout:4/682: stat d7/d16/f83 0 2024-04-06T12:23:58.649 INFO:tasks.workunit.client.0.smithi152.stdout:3/604: chown d0/d10/d13/d2a/d93/d49/d8d/la0 69 1 2024-04-06T12:23:58.650 INFO:tasks.workunit.client.0.smithi152.stdout:3/605: stat d0/d2d 0 2024-04-06T12:23:58.655 INFO:tasks.workunit.client.0.smithi152.stdout:4/683: unlink d7/d29/cd3 0 2024-04-06T12:23:58.657 INFO:tasks.workunit.client.0.smithi152.stdout:8/737: dread d4/db/d39/f66 [0,4194304] 0 2024-04-06T12:23:58.659 INFO:tasks.workunit.client.0.smithi152.stdout:8/738: truncate d4/db/d56/dcb/dd5/ffa 778457 0 2024-04-06T12:23:58.663 INFO:tasks.workunit.client.0.smithi152.stdout:4/684: mkdir d7/d16/d22/dc7/dc8/ddd 0 2024-04-06T12:23:58.664 INFO:tasks.workunit.client.0.smithi152.stdout:2/576: creat d0/d2/d6f/d90/d9e/db5/fbf x:0 0 0 2024-04-06T12:23:58.665 INFO:tasks.workunit.client.0.smithi152.stdout:2/577: chown d0/d40/d26/f83 4 1 2024-04-06T12:23:58.670 INFO:tasks.workunit.client.0.smithi152.stdout:2/578: chown d0/d2/d6f/d90/d9e/db5/c66 3297536 1 2024-04-06T12:23:58.671 INFO:tasks.workunit.client.0.smithi152.stdout:2/579: stat d0/d15/d4d/f9d 0 2024-04-06T12:23:58.686 INFO:tasks.workunit.client.0.smithi152.stdout:5/544: write d3/da/d15/d40/d4f/f57 [517537,85724] 0 2024-04-06T12:23:58.687 INFO:tasks.workunit.client.0.smithi152.stdout:5/545: write d3/de/f35 [5219999,35240] 0 2024-04-06T12:23:58.688 INFO:tasks.workunit.client.0.smithi152.stdout:5/546: readlink d3/da/d15/l2c 0 2024-04-06T12:23:58.692 INFO:tasks.workunit.client.0.smithi152.stdout:9/440: sync 2024-04-06T12:23:58.692 INFO:tasks.workunit.client.0.smithi152.stdout:6/637: sync 2024-04-06T12:23:58.708 INFO:tasks.workunit.client.0.smithi152.stdout:1/506: dwrite d2/d2f/f65 [0,4194304] 0 2024-04-06T12:23:58.724 INFO:tasks.workunit.client.0.smithi152.stdout:4/685: link d7/d29/d78/cbf d7/d16/d22/d95/dda/cde 0 2024-04-06T12:23:58.726 INFO:tasks.workunit.client.0.smithi152.stdout:2/580: fdatasync d0/d15/d24/d79/f7a 0 2024-04-06T12:23:58.738 INFO:tasks.workunit.client.0.smithi152.stdout:1/507: rename d2/d2f/d54/fa3 to d2/d5d/d6d/d7d/d9f/fb8 0 2024-04-06T12:23:58.742 INFO:tasks.workunit.client.0.smithi152.stdout:5/547: mkdir d3/de/da9 0 2024-04-06T12:23:58.750 INFO:tasks.workunit.client.0.smithi152.stdout:4/686: rename d7/d16/d22/d3f/db4/f37 to d7/d82/db1/fdf 0 2024-04-06T12:23:58.751 INFO:tasks.workunit.client.0.smithi152.stdout:1/508: dread d2/f58 [0,4194304] 0 2024-04-06T12:23:58.758 INFO:tasks.workunit.client.0.smithi152.stdout:2/581: truncate d0/d15/d4d/f4e 1190520 0 2024-04-06T12:23:58.758 INFO:tasks.workunit.client.0.smithi152.stdout:1/509: dwrite d2/d2f/d37/d91/dad/f3a [0,4194304] 0 2024-04-06T12:23:58.759 INFO:tasks.workunit.client.0.smithi152.stdout:1/510: stat d2/d5d/d6d/d7d/lac 0 2024-04-06T12:23:58.763 INFO:tasks.workunit.client.0.smithi152.stdout:4/687: creat d7/d16/d22/d3f/db4/fe0 x:0 0 0 2024-04-06T12:23:58.771 INFO:tasks.workunit.client.0.smithi152.stdout:6/638: link d7/d19/d3e/fc4 d7/d19/d1b/d22/fcf 0 2024-04-06T12:23:58.771 INFO:tasks.workunit.client.0.smithi152.stdout:2/582: creat d0/d40/d41/d28/d8c/fc0 x:0 0 0 2024-04-06T12:23:58.774 INFO:tasks.workunit.client.0.smithi152.stdout:1/511: fsync d2/d1d/d7c/f9e 0 2024-04-06T12:23:58.775 INFO:tasks.workunit.client.0.smithi152.stdout:5/548: creat d3/da/d15/d40/d50/d99/faa x:0 0 0 2024-04-06T12:23:58.782 INFO:tasks.workunit.client.0.smithi152.stdout:4/688: dread d7/f2a [0,4194304] 0 2024-04-06T12:23:58.782 INFO:tasks.workunit.client.0.smithi152.stdout:2/583: write d0/d15/d4d/f52 [6566559,80427] 0 2024-04-06T12:23:58.786 INFO:tasks.workunit.client.0.smithi152.stdout:6/639: dwrite d7/d19/d1b/d31/d35/dbc/fc9 [0,4194304] 0 2024-04-06T12:23:58.788 INFO:tasks.workunit.client.0.smithi152.stdout:1/512: creat d2/d2f/d54/d88/d9c/db3/fb9 x:0 0 0 2024-04-06T12:23:58.793 INFO:tasks.workunit.client.0.smithi152.stdout:5/549: symlink d3/de/d80/d8f/lab 0 2024-04-06T12:23:58.793 INFO:tasks.workunit.client.0.smithi152.stdout:4/689: dwrite d7/d16/d22/d95/dda/fdb [0,4194304] 0 2024-04-06T12:23:58.796 INFO:tasks.workunit.client.0.smithi152.stdout:5/550: write d3/da/d15/d2b/d3f/d68/d81/f6e [4793292,88191] 0 2024-04-06T12:23:58.812 INFO:tasks.workunit.client.0.smithi152.stdout:6/640: creat d7/d19/dbf/fd0 x:0 0 0 2024-04-06T12:23:58.819 INFO:tasks.workunit.client.0.smithi152.stdout:6/641: dwrite d7/d9/d73/fc5 [0,4194304] 0 2024-04-06T12:23:58.823 INFO:tasks.workunit.client.0.smithi152.stdout:0/726: dwrite d4/de/f7a [0,4194304] 0 2024-04-06T12:23:58.825 INFO:tasks.workunit.client.0.smithi152.stdout:7/564: truncate d8/df/d61/fe 5914483 0 2024-04-06T12:23:58.826 INFO:tasks.workunit.client.0.smithi152.stdout:7/565: chown d8/df/d61/d76/ca2 749 1 2024-04-06T12:23:58.834 INFO:tasks.workunit.client.0.smithi152.stdout:0/727: symlink d4/de/d7f/ldc 0 2024-04-06T12:23:58.836 INFO:tasks.workunit.client.0.smithi152.stdout:1/513: rename d2/d61/cb0 to d2/d1d/cba 0 2024-04-06T12:23:58.840 INFO:tasks.workunit.client.0.smithi152.stdout:7/566: readlink d8/d2a/d37/d49/d7b/l9a 0 2024-04-06T12:23:58.845 INFO:tasks.workunit.client.0.smithi152.stdout:6/642: unlink d7/d19/c1a 0 2024-04-06T12:23:58.853 INFO:tasks.workunit.client.0.smithi152.stdout:3/606: write d0/d10/d1e/f1d [1061965,42948] 0 2024-04-06T12:23:58.854 INFO:tasks.workunit.client.0.smithi152.stdout:6/643: fsync d7/d19/d1b/d22/f94 0 2024-04-06T12:23:58.858 INFO:tasks.workunit.client.0.smithi152.stdout:4/690: getdents d7/d16/d22/dc7/dc8 0 2024-04-06T12:23:58.863 INFO:tasks.workunit.client.0.smithi152.stdout:8/739: write d4/dc/d10/d49/f4c [2985657,14206] 0 2024-04-06T12:23:58.865 INFO:tasks.workunit.client.0.smithi152.stdout:7/567: fsync d8/f6f 0 2024-04-06T12:23:58.874 INFO:tasks.workunit.client.0.smithi152.stdout:3/607: mkdir d0/d35/d43/dbe 0 2024-04-06T12:23:58.876 INFO:tasks.workunit.client.0.smithi152.stdout:3/608: write d0/d35/d75/f85 [1569795,39980] 0 2024-04-06T12:23:58.889 INFO:tasks.workunit.client.0.smithi152.stdout:0/728: getdents d4/de/d28/d18/d43/d62 0 2024-04-06T12:23:58.890 INFO:tasks.workunit.client.0.smithi152.stdout:6/644: dread d7/d19/d1b/d1f/f2a [0,4194304] 0 2024-04-06T12:23:58.901 INFO:tasks.workunit.client.0.smithi152.stdout:3/609: dread - d0/d35/d43/d48/d83/f9a zero size 2024-04-06T12:23:58.902 INFO:tasks.workunit.client.0.smithi152.stdout:4/691: creat d7/d16/d22/dc7/dc8/ddd/fe1 x:0 0 0 2024-04-06T12:23:58.904 INFO:tasks.workunit.client.0.smithi152.stdout:8/740: mknod d4/dc/d10/d49/da0/dc0/d9d/dbe/ddd/cff 0 2024-04-06T12:23:58.905 INFO:tasks.workunit.client.0.smithi152.stdout:4/692: truncate d7/d16/d22/d3f/db4/d60/f87 1516116 0 2024-04-06T12:23:58.908 INFO:tasks.workunit.client.0.smithi152.stdout:0/729: symlink d4/d31/d47/d7e/dbe/ldd 0 2024-04-06T12:23:58.919 INFO:tasks.workunit.client.0.smithi152.stdout:3/610: mknod d0/d1f/d44/d7c/cbf 0 2024-04-06T12:23:58.922 INFO:tasks.workunit.client.0.smithi152.stdout:4/693: creat d7/d16/d55/da0/fe2 x:0 0 0 2024-04-06T12:23:58.931 INFO:tasks.workunit.client.0.smithi152.stdout:6/645: fsync d7/d9/f48 0 2024-04-06T12:23:58.934 INFO:tasks.workunit.client.0.smithi152.stdout:3/611: symlink d0/d2d/d7f/d8c/lc0 0 2024-04-06T12:23:58.935 INFO:tasks.workunit.client.0.smithi152.stdout:3/612: write d0/d10/f68 [661670,87930] 0 2024-04-06T12:23:58.936 INFO:tasks.workunit.client.0.smithi152.stdout:3/613: chown d0/d1f/d4a/l61 4648834 1 2024-04-06T12:23:58.939 INFO:tasks.workunit.client.0.smithi152.stdout:4/694: creat d7/d16/d22/dc7/dc8/fe3 x:0 0 0 2024-04-06T12:23:58.940 INFO:tasks.workunit.client.0.smithi152.stdout:7/568: link d8/df/d61/d3d/l7d d8/lb9 0 2024-04-06T12:23:58.940 INFO:tasks.workunit.client.0.smithi152.stdout:4/695: write d7/d16/f68 [1123854,89453] 0 2024-04-06T12:23:58.947 INFO:tasks.workunit.client.0.smithi152.stdout:4/696: dwrite d7/d29/d2e/f8a [0,4194304] 0 2024-04-06T12:23:58.948 INFO:tasks.workunit.client.0.smithi152.stdout:4/697: readlink d7/d29/d2e/d7b/l84 0 2024-04-06T12:23:58.949 INFO:tasks.workunit.client.0.smithi152.stdout:8/741: link d4/dc/d10/d49/da0/dc0/d9d/dbe/c1c d4/db/d56/dcb/d6e/dd4/c100 0 2024-04-06T12:23:58.955 INFO:tasks.workunit.client.0.smithi152.stdout:8/742: dwrite d4/dc/f19 [0,4194304] 0 2024-04-06T12:23:58.957 INFO:tasks.workunit.client.0.smithi152.stdout:8/743: chown d4/dc/d10/d49/da0/dc0/d9d/dbe/f26 5244 1 2024-04-06T12:23:58.963 INFO:tasks.workunit.client.0.smithi152.stdout:7/569: dread d8/d2a/d37/d8c/d2d/da3/d65/f89 [0,4194304] 0 2024-04-06T12:23:58.963 INFO:tasks.workunit.client.0.smithi152.stdout:7/570: stat d8/d2a/d42/f6b 0 2024-04-06T12:23:58.968 INFO:tasks.workunit.client.0.smithi152.stdout:6/646: write d7/d19/d1b/d31/d7c/f9b [2367213,25896] 0 2024-04-06T12:23:58.971 INFO:tasks.workunit.client.0.smithi152.stdout:9/441: truncate d5/d39/f3d 1859706 0 2024-04-06T12:23:58.972 INFO:tasks.workunit.client.0.smithi152.stdout:4/698: truncate d7/d29/d7e/d59/f90 223070 0 2024-04-06T12:23:58.973 INFO:tasks.workunit.client.0.smithi152.stdout:4/699: stat d7/d29/d7e/d59/l3a 0 2024-04-06T12:23:58.978 INFO:tasks.workunit.client.0.smithi152.stdout:8/744: creat d4/db/d56/d85/dce/f101 x:0 0 0 2024-04-06T12:23:58.980 INFO:tasks.workunit.client.0.smithi152.stdout:8/745: write d4/db/d56/d85/dce/fd3 [466843,131060] 0 2024-04-06T12:23:58.985 INFO:tasks.workunit.client.0.smithi152.stdout:9/442: dread d5/d6/f2c [0,4194304] 0 2024-04-06T12:23:58.985 INFO:tasks.workunit.client.0.smithi152.stdout:4/700: write d7/d16/d22/d3f/db4/d60/f9e [4874203,75158] 0 2024-04-06T12:23:58.992 INFO:tasks.workunit.client.0.smithi152.stdout:6/647: unlink d7/d9/l6a 0 2024-04-06T12:23:58.998 INFO:tasks.workunit.client.0.smithi152.stdout:9/443: dread d5/d6/f28 [0,4194304] 0 2024-04-06T12:23:59.005 INFO:tasks.workunit.client.0.smithi152.stdout:4/701: symlink d7/le4 0 2024-04-06T12:23:59.010 INFO:tasks.workunit.client.0.smithi152.stdout:4/702: chown d7/l1d 415 1 2024-04-06T12:23:59.011 INFO:tasks.workunit.client.0.smithi152.stdout:2/584: write d0/d40/d26/f2a [295420,15486] 0 2024-04-06T12:23:59.014 INFO:tasks.workunit.client.0.smithi152.stdout:8/746: getdents d4/d2c/dbf/db2/dba 0 2024-04-06T12:23:59.015 INFO:tasks.workunit.client.0.smithi152.stdout:8/747: chown d4/d2c/db0/fc5 236089921 1 2024-04-06T12:23:59.015 INFO:tasks.workunit.client.0.smithi152.stdout:8/748: chown d4/d2c/dbf/db2/lc8 335728501 1 2024-04-06T12:23:59.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/585: link d0/d2/d6f/d90/d9e/db5/d3a/f58 d0/d40/d41/d63/fc1 0 2024-04-06T12:23:59.030 INFO:tasks.workunit.client.0.smithi152.stdout:4/703: dread d7/fb [0,4194304] 0 2024-04-06T12:23:59.033 INFO:tasks.workunit.client.0.smithi152.stdout:4/704: symlink d7/d16/d22/dc7/dc8/ddd/le5 0 2024-04-06T12:23:59.038 INFO:tasks.workunit.client.0.smithi152.stdout:4/705: mkdir d7/d16/d22/dc7/de6 0 2024-04-06T12:23:59.040 INFO:tasks.workunit.client.0.smithi152.stdout:2/586: dread d0/fd [4194304,4194304] 0 2024-04-06T12:23:59.041 INFO:tasks.workunit.client.0.smithi152.stdout:2/587: fdatasync d0/d40/d41/faf 0 2024-04-06T12:23:59.045 INFO:tasks.workunit.client.0.smithi152.stdout:4/706: dwrite d7/d16/d22/d3f/db4/d60/f87 [0,4194304] 0 2024-04-06T12:23:59.047 INFO:tasks.workunit.client.0.smithi152.stdout:2/588: chown d0/d2/d6f/d90/l68 753 1 2024-04-06T12:23:59.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:23:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:57.584770+0000 mgr.smithi195.ausetj (mgr.24375) 83 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 1.2 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 38 MiB/s rd, 105 MiB/s wr, 234 op/s 2024-04-06T12:23:59.050 INFO:tasks.workunit.client.0.smithi152.stdout:2/589: write d0/d15/d4d/db2/fac [1114859,105133] 0 2024-04-06T12:23:59.050 INFO:tasks.workunit.client.0.smithi152.stdout:4/707: readlink d7/d16/d22/d3f/db4/l61 0 2024-04-06T12:23:59.052 INFO:tasks.workunit.client.0.smithi152.stdout:1/514: truncate d2/f39 731700 0 2024-04-06T12:23:59.052 INFO:tasks.workunit.client.0.smithi152.stdout:4/708: write d7/d16/d22/dc7/fd1 [1560691,7217] 0 2024-04-06T12:23:59.054 INFO:tasks.workunit.client.0.smithi152.stdout:2/590: dread - d0/d40/d41/d28/d54/f7c zero size 2024-04-06T12:23:59.062 INFO:tasks.workunit.client.0.smithi152.stdout:2/591: dread - d0/d2/d6f/f77 zero size 2024-04-06T12:23:59.065 INFO:tasks.workunit.client.0.smithi152.stdout:1/515: mkdir d2/db2/dbb 0 2024-04-06T12:23:59.068 INFO:tasks.workunit.client.0.smithi152.stdout:2/592: fdatasync d0/d15/d24/d3d/f86 0 2024-04-06T12:23:59.089 INFO:tasks.workunit.client.0.smithi152.stdout:0/730: dwrite d4/de/d28/f40 [0,4194304] 0 2024-04-06T12:23:59.116 INFO:tasks.workunit.client.0.smithi152.stdout:3/614: write d0/d2d/d7f/d8c/fab [794841,52706] 0 2024-04-06T12:23:59.127 INFO:tasks.workunit.client.0.smithi152.stdout:3/615: getdents d0/d35/d43/d48/d83 0 2024-04-06T12:23:59.127 INFO:tasks.workunit.client.0.smithi152.stdout:3/616: readlink d0/d2d/d7f/l9b 0 2024-04-06T12:23:59.128 INFO:tasks.workunit.client.0.smithi152.stdout:3/617: write d0/d35/f82 [1135800,89416] 0 2024-04-06T12:23:59.138 INFO:tasks.workunit.client.0.smithi152.stdout:9/444: dwrite d5/d6/fd [0,4194304] 0 2024-04-06T12:23:59.147 INFO:tasks.workunit.client.0.smithi152.stdout:8/749: dwrite d4/dc/d10/d51/f8f [0,4194304] 0 2024-04-06T12:23:59.153 INFO:tasks.workunit.client.0.smithi152.stdout:9/445: rename d5/c31 to d5/d39/d79/c88 0 2024-04-06T12:23:59.157 INFO:tasks.workunit.client.0.smithi152.stdout:8/750: dwrite d4/db/d56/dcb/d6e/d88/fe3 [0,4194304] 0 2024-04-06T12:23:59.162 INFO:tasks.workunit.client.0.smithi152.stdout:9/446: rmdir d5/d39 39 2024-04-06T12:23:59.162 INFO:tasks.workunit.client.0.smithi152.stdout:8/751: dread d4/dc/d10/d51/f8f [0,4194304] 0 2024-04-06T12:23:59.163 INFO:tasks.workunit.client.0.smithi152.stdout:8/752: dread - d4/d2c/dbf/da3/fee zero size 2024-04-06T12:23:59.171 INFO:tasks.workunit.client.0.smithi152.stdout:9/447: creat d5/d39/d3f/d42/f89 x:0 0 0 2024-04-06T12:23:59.255 INFO:tasks.workunit.client.0.smithi152.stdout:9/448: fdatasync d5/d6/f73 0 2024-04-06T12:23:59.262 INFO:tasks.workunit.client.0.smithi152.stdout:5/551: write d3/da/d15/d2b/d3f/d68/d81/f56 [1297362,5968] 0 2024-04-06T12:23:59.263 INFO:tasks.workunit.client.0.smithi152.stdout:9/449: mknod d5/d6/d74/d17/d37/d5d/c8a 0 2024-04-06T12:23:59.264 INFO:tasks.workunit.client.0.smithi152.stdout:4/709: dwrite d7/d16/d55/da0/f94 [0,4194304] 0 2024-04-06T12:23:59.269 INFO:tasks.workunit.client.0.smithi152.stdout:5/552: creat d3/de/d8e/fac x:0 0 0 2024-04-06T12:23:59.269 INFO:tasks.workunit.client.0.smithi152.stdout:1/516: write d2/f11 [2043588,122591] 0 2024-04-06T12:23:59.271 INFO:tasks.workunit.client.0.smithi152.stdout:1/517: stat d2/d2f/d54/d88/da4/fab 0 2024-04-06T12:23:59.273 INFO:tasks.workunit.client.0.smithi152.stdout:1/518: write d2/d2f/d37/d91/dad/d8c/fa9 [708126,86973] 0 2024-04-06T12:23:59.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:23:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:57.584770+0000 mgr.smithi195.ausetj (mgr.24375) 83 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 1.2 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 38 MiB/s rd, 105 MiB/s wr, 234 op/s 2024-04-06T12:23:59.277 INFO:tasks.workunit.client.0.smithi152.stdout:9/450: mkdir d5/d6/d74/d17/d23/d2d/d32/d36/d8b 0 2024-04-06T12:23:59.279 INFO:tasks.workunit.client.0.smithi152.stdout:2/593: truncate d0/d2/d6f/d90/d9e/db5/f42 2381906 0 2024-04-06T12:23:59.281 INFO:tasks.workunit.client.0.smithi152.stdout:4/710: dread d7/d16/d22/d3f/db4/f50 [4194304,4194304] 0 2024-04-06T12:23:59.290 INFO:tasks.workunit.client.0.smithi152.stdout:9/451: mknod d5/d6/d74/d17/d23/d2d/d32/d36/c8c 0 2024-04-06T12:23:59.291 INFO:tasks.workunit.client.0.smithi152.stdout:2/594: mknod d0/d15/d24/d79/cc2 0 2024-04-06T12:23:59.294 INFO:tasks.workunit.client.0.smithi152.stdout:0/731: dwrite d4/de/d87/d94/f6c [0,4194304] 0 2024-04-06T12:23:59.313 INFO:tasks.workunit.client.0.smithi152.stdout:2/595: creat d0/dae/fc3 x:0 0 0 2024-04-06T12:23:59.317 INFO:tasks.workunit.client.0.smithi152.stdout:0/732: symlink d4/d19/dbd/lde 0 2024-04-06T12:23:59.321 INFO:tasks.workunit.client.0.smithi152.stdout:5/553: link d3/de/l33 d3/de/lad 0 2024-04-06T12:23:59.326 INFO:tasks.workunit.client.0.smithi152.stdout:3/618: write d0/d10/f66 [1041323,50259] 0 2024-04-06T12:23:59.332 INFO:tasks.workunit.client.0.smithi152.stdout:2/596: creat d0/d15/d24/d79/d80/fc4 x:0 0 0 2024-04-06T12:23:59.333 INFO:tasks.workunit.client.0.smithi152.stdout:0/733: write d4/de/d28/f66 [3089029,6776] 0 2024-04-06T12:23:59.339 INFO:tasks.workunit.client.0.smithi152.stdout:5/554: rename d3/de/d8e/fac to d3/de/d80/d8f/fae 0 2024-04-06T12:23:59.339 INFO:tasks.workunit.client.0.smithi152.stdout:5/555: dread - d3/da/d15/d40/d46/f85 zero size 2024-04-06T12:23:59.340 INFO:tasks.workunit.client.0.smithi152.stdout:5/556: stat d3/da/d15/d40/d4f/f54 0 2024-04-06T12:23:59.342 INFO:tasks.workunit.client.0.smithi152.stdout:9/452: link d5/d6/cc d5/d6/d74/d17/d23/d2d/d4b/d5a/c8d 0 2024-04-06T12:23:59.344 INFO:tasks.workunit.client.0.smithi152.stdout:2/597: read d0/d2/d6f/d90/f81 [732634,29022] 0 2024-04-06T12:23:59.346 INFO:tasks.workunit.client.0.smithi152.stdout:0/734: symlink d4/d36/ldf 0 2024-04-06T12:23:59.347 INFO:tasks.workunit.client.0.smithi152.stdout:0/735: fdatasync d4/d31/d47/d7e/dbe/fc0 0 2024-04-06T12:23:59.350 INFO:tasks.workunit.client.0.smithi152.stdout:3/619: mknod d0/d10/d13/d2a/d93/cc1 0 2024-04-06T12:23:59.351 INFO:tasks.workunit.client.0.smithi152.stdout:5/557: truncate d3/da/d15/d40/d4f/f54 788600 0 2024-04-06T12:23:59.352 INFO:tasks.workunit.client.0.smithi152.stdout:8/753: write d4/d5f/d98/fa5 [211614,94915] 0 2024-04-06T12:23:59.354 INFO:tasks.workunit.client.0.smithi152.stdout:0/736: dwrite d4/de/d28/d18/d43/fd2 [4194304,4194304] 0 2024-04-06T12:23:59.365 INFO:tasks.workunit.client.0.smithi152.stdout:0/737: dwrite d4/de/d87/d94/f6c [0,4194304] 0 2024-04-06T12:23:59.378 INFO:tasks.workunit.client.0.smithi152.stdout:2/598: truncate d0/d40/d26/f83 1011763 0 2024-04-06T12:23:59.410 INFO:tasks.workunit.client.0.smithi152.stdout:3/620: fdatasync d0/d1f/f23 0 2024-04-06T12:23:59.412 INFO:tasks.workunit.client.0.smithi152.stdout:3/621: truncate d0/d10/d1e/d87/fa1 728219 0 2024-04-06T12:23:59.412 INFO:tasks.workunit.client.0.smithi152.stdout:5/558: mknod d3/da/d15/d2b/d3f/caf 0 2024-04-06T12:23:59.416 INFO:tasks.workunit.client.0.smithi152.stdout:8/754: mkdir d4/dc/d10/d49/da0/d102 0 2024-04-06T12:23:59.420 INFO:tasks.workunit.client.0.smithi152.stdout:8/755: dread d4/d2c/dbf/da3/fb9 [0,4194304] 0 2024-04-06T12:23:59.423 INFO:tasks.workunit.client.0.smithi152.stdout:0/738: write d4/d31/f34 [6070042,95113] 0 2024-04-06T12:23:59.428 INFO:tasks.workunit.client.0.smithi152.stdout:8/756: dwrite d4/db/d56/fe1 [0,4194304] 0 2024-04-06T12:23:59.429 INFO:tasks.workunit.client.0.smithi152.stdout:0/739: dread d4/d36/d72/d7c/d8d/fcf [0,4194304] 0 2024-04-06T12:23:59.430 INFO:tasks.workunit.client.0.smithi152.stdout:2/599: symlink d0/d2/d6f/d90/d9e/db5/d3a/d87/lc5 0 2024-04-06T12:23:59.434 INFO:tasks.workunit.client.0.smithi152.stdout:1/519: write d2/f10 [404439,49362] 0 2024-04-06T12:23:59.436 INFO:tasks.workunit.client.0.smithi152.stdout:1/520: write d2/d1d/d7c/f93 [413522,39900] 0 2024-04-06T12:23:59.436 INFO:tasks.workunit.client.0.smithi152.stdout:5/559: symlink d3/de/d80/d8f/lb0 0 2024-04-06T12:23:59.439 INFO:tasks.workunit.client.0.smithi152.stdout:1/521: truncate d2/d2f/d37/d91/dad/f3a 4576109 0 2024-04-06T12:23:59.449 INFO:tasks.workunit.client.0.smithi152.stdout:4/711: dwrite d7/d16/d22/dc7/fd6 [0,4194304] 0 2024-04-06T12:23:59.451 INFO:tasks.workunit.client.0.smithi152.stdout:8/757: read d4/db/d39/f66 [1772675,123852] 0 2024-04-06T12:23:59.452 INFO:tasks.workunit.client.0.smithi152.stdout:8/758: fsync d4/db/d56/dcb/d6e/f8b 0 2024-04-06T12:23:59.456 INFO:tasks.workunit.client.0.smithi152.stdout:0/740: rename d4/de/d28/d99/fd9 to d4/d19/fe0 0 2024-04-06T12:23:59.460 INFO:tasks.workunit.client.0.smithi152.stdout:1/522: fsync d2/d2f/d54/f7f 0 2024-04-06T12:23:59.465 INFO:tasks.workunit.client.0.smithi152.stdout:4/712: symlink d7/d29/d7e/d59/le7 0 2024-04-06T12:23:59.467 INFO:tasks.workunit.client.0.smithi152.stdout:8/759: fsync d4/db/d32/f52 0 2024-04-06T12:23:59.468 INFO:tasks.workunit.client.0.smithi152.stdout:8/760: write d4/dc/d10/d49/f4c [2272356,43668] 0 2024-04-06T12:23:59.470 INFO:tasks.workunit.client.0.smithi152.stdout:0/741: creat d4/d31/fe1 x:0 0 0 2024-04-06T12:23:59.471 INFO:tasks.workunit.client.0.smithi152.stdout:5/560: getdents d3/de/d80/d98/da3 0 2024-04-06T12:23:59.477 INFO:tasks.workunit.client.0.smithi152.stdout:4/713: creat d7/d16/d22/d3f/fe8 x:0 0 0 2024-04-06T12:23:59.485 INFO:tasks.workunit.client.0.smithi152.stdout:5/561: rmdir d3/da/d15/d2b/d4d 39 2024-04-06T12:23:59.492 INFO:tasks.workunit.client.0.smithi152.stdout:5/562: chown d3/da/d15/d40/d46/la0 8042 1 2024-04-06T12:23:59.493 INFO:tasks.workunit.client.0.smithi152.stdout:5/563: write d3/da/d15/d40/d4f/f57 [1129318,116699] 0 2024-04-06T12:23:59.494 INFO:tasks.workunit.client.0.smithi152.stdout:5/564: fdatasync d3/da/d15/d40/d4f/f51 0 2024-04-06T12:23:59.501 INFO:tasks.workunit.client.0.smithi152.stdout:5/565: mkdir d3/da/d15/d2b/d3f/d6d/db1 0 2024-04-06T12:23:59.505 INFO:tasks.workunit.client.0.smithi152.stdout:5/566: symlink d3/da/d15/d40/d46/lb2 0 2024-04-06T12:23:59.508 INFO:tasks.workunit.client.0.smithi152.stdout:4/714: getdents d7/d82 0 2024-04-06T12:23:59.511 INFO:tasks.workunit.client.0.smithi152.stdout:5/567: dread d3/d9/f4b [0,4194304] 0 2024-04-06T12:23:59.512 INFO:tasks.workunit.client.0.smithi152.stdout:5/568: chown d3/da/d15/d2b/d3f/f6c 38032 1 2024-04-06T12:23:59.512 INFO:tasks.workunit.client.0.smithi152.stdout:5/569: chown d3/de/da9 13817 1 2024-04-06T12:23:59.514 INFO:tasks.workunit.client.0.smithi152.stdout:4/715: truncate d7/d29/d2e/f9a 1417462 0 2024-04-06T12:23:59.514 INFO:tasks.workunit.client.0.smithi152.stdout:5/570: write d3/da/d15/d40/d92/f78 [2922554,37090] 0 2024-04-06T12:23:59.514 INFO:tasks.workunit.client.0.smithi152.stdout:9/453: write d5/d6/d74/d17/d23/d2d/f6b [4928600,18529] 0 2024-04-06T12:23:59.520 INFO:tasks.workunit.client.0.smithi152.stdout:5/571: dwrite d3/da/fc [0,4194304] 0 2024-04-06T12:23:59.589 INFO:tasks.workunit.client.0.smithi152.stdout:1/523: creat d2/d1d/fbc x:0 0 0 2024-04-06T12:23:59.592 INFO:tasks.workunit.client.0.smithi152.stdout:1/524: mknod d2/d2f/d37/d91/cbd 0 2024-04-06T12:23:59.592 INFO:tasks.workunit.client.0.smithi152.stdout:1/525: chown d2/c9d 0 1 2024-04-06T12:23:59.707 INFO:tasks.workunit.client.0.smithi152.stdout:2/600: write d0/d15/d4d/f9d [792117,15545] 0 2024-04-06T12:23:59.719 INFO:tasks.workunit.client.0.smithi152.stdout:2/601: mknod d0/d15/d4d/db2/cc6 0 2024-04-06T12:23:59.720 INFO:tasks.workunit.client.0.smithi152.stdout:2/602: read d0/d2/d6f/d90/fa6 [333894,112136] 0 2024-04-06T12:23:59.743 INFO:tasks.workunit.client.0.smithi152.stdout:4/716: rmdir d7/d16/d22/d3f/db4/d60/dc4 39 2024-04-06T12:23:59.745 INFO:tasks.workunit.client.0.smithi152.stdout:4/717: truncate d7/d29/d7e/f93 1485965 0 2024-04-06T12:23:59.749 INFO:tasks.workunit.client.0.smithi152.stdout:0/742: write d4/de/d4a/d33/f48 [848373,23255] 0 2024-04-06T12:23:59.753 INFO:tasks.workunit.client.0.smithi152.stdout:0/743: mknod d4/d31/d47/d7e/db9/dcc/dd5/ce2 0 2024-04-06T12:23:59.754 INFO:tasks.workunit.client.0.smithi152.stdout:0/744: creat d4/de/d4a/d33/fe3 x:0 0 0 2024-04-06T12:23:59.758 INFO:tasks.workunit.client.0.smithi152.stdout:0/745: creat d4/de/d28/d18/d43/d62/dd4/fe4 x:0 0 0 2024-04-06T12:23:59.759 INFO:tasks.workunit.client.0.smithi152.stdout:0/746: stat d4/de/d28/d18/d43/c75 0 2024-04-06T12:23:59.766 INFO:tasks.workunit.client.0.smithi152.stdout:0/747: creat d4/de/d28/d18/d3b/fe5 x:0 0 0 2024-04-06T12:23:59.766 INFO:tasks.workunit.client.0.smithi152.stdout:0/748: readlink d4/de/d7f/l93 0 2024-04-06T12:23:59.769 INFO:tasks.workunit.client.0.smithi152.stdout:0/749: read d4/de/d28/d18/d3b/f5a [1974081,65970] 0 2024-04-06T12:23:59.803 INFO:tasks.workunit.client.0.smithi152.stdout:5/572: dwrite d3/da/d15/d40/d46/f48 [4194304,4194304] 0 2024-04-06T12:23:59.839 INFO:tasks.workunit.client.0.smithi152.stdout:1/526: creat d2/d2f/fbe x:0 0 0 2024-04-06T12:23:59.841 INFO:tasks.workunit.client.0.smithi152.stdout:1/527: creat d2/d2f/d37/dae/fbf x:0 0 0 2024-04-06T12:23:59.842 INFO:tasks.workunit.client.0.smithi152.stdout:1/528: write d2/d1d/d7c/f9e [364014,60370] 0 2024-04-06T12:23:59.845 INFO:tasks.workunit.client.0.smithi152.stdout:1/529: mknod d2/d1d/d7c/cc0 0 2024-04-06T12:23:59.932 INFO:tasks.workunit.client.0.smithi152.stdout:0/750: mknod d4/de/d4a/ce6 0 2024-04-06T12:23:59.933 INFO:tasks.workunit.client.0.smithi152.stdout:0/751: readlink d4/de/d28/d18/d3b/d2e/la2 0 2024-04-06T12:23:59.935 INFO:tasks.workunit.client.0.smithi152.stdout:0/752: creat d4/de/d28/d18/d43/d62/dd4/fe7 x:0 0 0 2024-04-06T12:23:59.937 INFO:tasks.workunit.client.0.smithi152.stdout:0/753: truncate d4/de/d28/d18/d43/d62/dd4/fe4 719377 0 2024-04-06T12:23:59.938 INFO:tasks.workunit.client.0.smithi152.stdout:0/754: write d4/de/d7f/db7/fc6 [510479,100208] 0 2024-04-06T12:23:59.941 INFO:tasks.workunit.client.0.smithi152.stdout:7/571: sync 2024-04-06T12:23:59.941 INFO:tasks.workunit.client.0.smithi152.stdout:6/648: sync 2024-04-06T12:23:59.942 INFO:tasks.workunit.client.0.smithi152.stdout:7/572: read d8/df/d61/fa6 [548250,87643] 0 2024-04-06T12:23:59.950 INFO:tasks.workunit.client.0.smithi152.stdout:7/573: creat d8/d2a/d37/d79/fba x:0 0 0 2024-04-06T12:23:59.953 INFO:tasks.workunit.client.0.smithi152.stdout:6/649: dwrite d7/d9/d26/f9f [0,4194304] 0 2024-04-06T12:23:59.958 INFO:tasks.workunit.client.0.smithi152.stdout:7/574: mkdir d8/d2a/d37/d8c/d2d/da3/dbb 0 2024-04-06T12:23:59.962 INFO:tasks.workunit.client.0.smithi152.stdout:6/650: rmdir d7/d19/d1b 39 2024-04-06T12:23:59.981 INFO:tasks.workunit.client.0.smithi152.stdout:6/651: dread d7/d19/d1b/d1f/d3d/f8e [4194304,4194304] 0 2024-04-06T12:23:59.986 INFO:tasks.workunit.client.0.smithi152.stdout:6/652: mknod d7/d9/d26/cd1 0 2024-04-06T12:23:59.989 INFO:tasks.workunit.client.0.smithi152.stdout:6/653: creat d7/d19/dbf/fd2 x:0 0 0 2024-04-06T12:23:59.998 INFO:tasks.workunit.client.0.smithi152.stdout:6/654: link d7/d19/f9d d7/d9/d73/fd3 0 2024-04-06T12:24:00.003 INFO:tasks.workunit.client.0.smithi152.stdout:6/655: mkdir d7/d19/d1b/d1f/d3d/dc2/dd4 0 2024-04-06T12:24:00.006 INFO:tasks.workunit.client.0.smithi152.stdout:6/656: dread - d7/fad zero size 2024-04-06T12:24:00.007 INFO:tasks.workunit.client.0.smithi152.stdout:2/603: dread d0/d2/f21 [0,4194304] 0 2024-04-06T12:24:00.009 INFO:tasks.workunit.client.0.smithi152.stdout:0/755: mknod d4/de/d87/ce8 0 2024-04-06T12:24:00.016 INFO:tasks.workunit.client.0.smithi152.stdout:6/657: fsync d7/d19/d1b/fb4 0 2024-04-06T12:24:00.016 INFO:tasks.workunit.client.0.smithi152.stdout:0/756: dwrite d4/de/d28/f22 [0,4194304] 0 2024-04-06T12:24:00.031 INFO:tasks.workunit.client.0.smithi152.stdout:6/658: unlink d7/c13 0 2024-04-06T12:24:00.033 INFO:tasks.workunit.client.0.smithi152.stdout:0/757: truncate d4/d31/f3d 1650033 0 2024-04-06T12:24:00.037 INFO:tasks.workunit.client.0.smithi152.stdout:6/659: write d7/f78 [2085373,53090] 0 2024-04-06T12:24:00.042 INFO:tasks.workunit.client.0.smithi152.stdout:0/758: creat d4/de/d28/d18/d3b/d2e/d78/dc1/fe9 x:0 0 0 2024-04-06T12:24:00.050 INFO:tasks.workunit.client.0.smithi152.stdout:0/759: mknod d4/de/d28/d18/d43/d62/cea 0 2024-04-06T12:24:00.054 INFO:tasks.workunit.client.0.smithi152.stdout:0/760: mknod d4/d31/d47/d7e/db9/dcc/ceb 0 2024-04-06T12:24:00.062 INFO:tasks.workunit.client.0.smithi152.stdout:6/660: creat d7/d19/d3e/d70/fd5 x:0 0 0 2024-04-06T12:24:00.066 INFO:tasks.workunit.client.0.smithi152.stdout:6/661: chown d7/d19/c57 0 1 2024-04-06T12:24:00.073 INFO:tasks.workunit.client.0.smithi152.stdout:6/662: mkdir d7/d9/d26/dd6 0 2024-04-06T12:24:00.075 INFO:tasks.workunit.client.0.smithi152.stdout:6/663: creat d7/d9/d26/d4a/d7b/fd7 x:0 0 0 2024-04-06T12:24:00.089 INFO:tasks.workunit.client.0.smithi152.stdout:6/664: dread d7/d19/d1b/d22/f29 [0,4194304] 0 2024-04-06T12:24:00.091 INFO:tasks.workunit.client.0.smithi152.stdout:6/665: creat d7/d62/fd8 x:0 0 0 2024-04-06T12:24:00.097 INFO:tasks.workunit.client.0.smithi152.stdout:6/666: unlink d7/d19/d1b/c89 0 2024-04-06T12:24:00.100 INFO:tasks.workunit.client.0.smithi152.stdout:5/573: rename d3/da/d15/d40/d4f/f57 to d3/da/d53/fb3 0 2024-04-06T12:24:00.105 INFO:tasks.workunit.client.0.smithi152.stdout:5/574: truncate d3/da/d15/d2b/d3f/d4c/f8d 197351 0 2024-04-06T12:24:00.107 INFO:tasks.workunit.client.0.smithi152.stdout:6/667: creat d7/d19/d1b/d31/d7c/fd9 x:0 0 0 2024-04-06T12:24:00.115 INFO:tasks.workunit.client.0.smithi152.stdout:6/668: symlink d7/d9/d26/dcc/lda 0 2024-04-06T12:24:00.116 INFO:tasks.workunit.client.0.smithi152.stdout:6/669: readlink d7/d19/d1b/d22/lb6 0 2024-04-06T12:24:00.116 INFO:tasks.workunit.client.0.smithi152.stdout:6/670: chown d7/d9/d26/d4a 42 1 2024-04-06T12:24:00.117 INFO:tasks.workunit.client.0.smithi152.stdout:5/575: dread d3/da/d15/d40/f96 [0,4194304] 0 2024-04-06T12:24:00.117 INFO:tasks.workunit.client.0.smithi152.stdout:6/671: dread - d7/d9/d26/d2e/fae zero size 2024-04-06T12:24:00.118 INFO:tasks.workunit.client.0.smithi152.stdout:9/454: sync 2024-04-06T12:24:00.118 INFO:tasks.workunit.client.0.smithi152.stdout:3/622: sync 2024-04-06T12:24:00.119 INFO:tasks.workunit.client.0.smithi152.stdout:3/623: chown d0/d2d/d7f/l9b 18168976 1 2024-04-06T12:24:00.119 INFO:tasks.workunit.client.0.smithi152.stdout:5/576: fsync d3/de/d80/f5d 0 2024-04-06T12:24:00.120 INFO:tasks.workunit.client.0.smithi152.stdout:5/577: fdatasync d3/f16 0 2024-04-06T12:24:00.122 INFO:tasks.workunit.client.0.smithi152.stdout:6/672: mkdir d7/d9/d26/dcc/ddb 0 2024-04-06T12:24:00.131 INFO:tasks.workunit.client.0.smithi152.stdout:3/624: fdatasync d0/d10/d13/d2a/d93/f5f 0 2024-04-06T12:24:00.144 INFO:tasks.workunit.client.0.smithi152.stdout:8/761: symlink d4/db/d56/l103 0 2024-04-06T12:24:00.151 INFO:tasks.workunit.client.0.smithi152.stdout:8/762: symlink d4/dc/d10/d49/dae/l104 0 2024-04-06T12:24:00.152 INFO:tasks.workunit.client.0.smithi152.stdout:5/578: link d3/da/d15/d2b/ca1 d3/de/d8c/cb4 0 2024-04-06T12:24:00.155 INFO:tasks.workunit.client.0.smithi152.stdout:8/763: mknod d4/dc/d10/d49/da0/dc0/db6/c105 0 2024-04-06T12:24:00.156 INFO:tasks.workunit.client.0.smithi152.stdout:5/579: mknod d3/da/d15/d2b/d3f/d6d/cb5 0 2024-04-06T12:24:00.157 INFO:tasks.workunit.client.0.smithi152.stdout:5/580: fsync d3/da/d15/d2b/d3f/d68/d81/f90 0 2024-04-06T12:24:00.160 INFO:tasks.workunit.client.0.smithi152.stdout:8/764: mknod d4/dc/d10/d49/da0/d91/c106 0 2024-04-06T12:24:00.165 INFO:tasks.workunit.client.0.smithi152.stdout:8/765: read d4/db/d39/f3f [1697481,47132] 0 2024-04-06T12:24:00.168 INFO:tasks.workunit.client.0.smithi152.stdout:8/766: rmdir d4/d2c/db0 39 2024-04-06T12:24:00.172 INFO:tasks.workunit.client.0.smithi152.stdout:5/581: getdents d3/da/d15/d40/d50 0 2024-04-06T12:24:00.176 INFO:tasks.workunit.client.0.smithi152.stdout:5/582: dread - d3/da/d15/d40/d46/f74 zero size 2024-04-06T12:24:00.178 INFO:tasks.workunit.client.0.smithi152.stdout:7/575: write d8/d2a/d42/f57 [266592,60775] 0 2024-04-06T12:24:00.181 INFO:tasks.workunit.client.0.smithi152.stdout:8/767: dread d4/dc/d10/d51/f23 [0,4194304] 0 2024-04-06T12:24:00.183 INFO:tasks.workunit.client.0.smithi152.stdout:7/576: symlink d8/df/d61/d4b/d56/lbc 0 2024-04-06T12:24:00.186 INFO:tasks.workunit.client.0.smithi152.stdout:8/768: dread d4/db/d56/dcb/d6e/d88/fe3 [0,4194304] 0 2024-04-06T12:24:00.187 INFO:tasks.workunit.client.0.smithi152.stdout:5/583: symlink d3/da/d15/d2b/d4d/lb6 0 2024-04-06T12:24:00.190 INFO:tasks.workunit.client.0.smithi152.stdout:7/577: dread d8/d2a/d37/fa7 [0,4194304] 0 2024-04-06T12:24:00.194 INFO:tasks.workunit.client.0.smithi152.stdout:5/584: dwrite d3/da/d15/d2b/d3f/d68/d81/f6e [0,4194304] 0 2024-04-06T12:24:00.201 INFO:tasks.workunit.client.0.smithi152.stdout:5/585: dwrite d3/de/d80/f52 [0,4194304] 0 2024-04-06T12:24:00.205 INFO:tasks.workunit.client.0.smithi152.stdout:7/578: mknod d8/d2a/d37/d43/cbd 0 2024-04-06T12:24:00.212 INFO:tasks.workunit.client.0.smithi152.stdout:8/769: mkdir d4/dc/d10/d107 0 2024-04-06T12:24:00.213 INFO:tasks.workunit.client.0.smithi152.stdout:8/770: chown d4/db/d39/f66 1 1 2024-04-06T12:24:00.226 INFO:tasks.workunit.client.0.smithi152.stdout:0/761: getdents d4/de/d87 0 2024-04-06T12:24:00.226 INFO:tasks.workunit.client.0.smithi152.stdout:0/762: dread - d4/de/d28/d18/d3b/fe5 zero size 2024-04-06T12:24:00.232 INFO:tasks.workunit.client.0.smithi152.stdout:2/604: dwrite d0/d15/d24/d3d/f91 [0,4194304] 0 2024-04-06T12:24:00.238 INFO:tasks.workunit.client.0.smithi152.stdout:0/763: creat d4/de/d28/d18/d3b/d2e/fec x:0 0 0 2024-04-06T12:24:00.244 INFO:tasks.workunit.client.0.smithi152.stdout:4/718: sync 2024-04-06T12:24:00.245 INFO:tasks.workunit.client.0.smithi152.stdout:0/764: unlink d4/de/d28/d18/d3b/d2e/fad 0 2024-04-06T12:24:00.246 INFO:tasks.workunit.client.0.smithi152.stdout:4/719: write d7/d29/f65 [4346866,96166] 0 2024-04-06T12:24:00.259 INFO:tasks.workunit.client.0.smithi152.stdout:0/765: dread d4/de/d28/d18/d43/f5f [0,4194304] 0 2024-04-06T12:24:00.262 INFO:tasks.workunit.client.0.smithi152.stdout:2/605: getdents d0 0 2024-04-06T12:24:00.263 INFO:tasks.workunit.client.0.smithi152.stdout:2/606: chown d0/l17 51734018 1 2024-04-06T12:24:00.268 INFO:tasks.workunit.client.0.smithi152.stdout:0/766: creat d4/de/d28/d18/d43/fed x:0 0 0 2024-04-06T12:24:00.269 INFO:tasks.workunit.client.0.smithi152.stdout:0/767: dread - d4/d31/d47/d7e/dbe/fa1 zero size 2024-04-06T12:24:00.278 INFO:tasks.workunit.client.0.smithi152.stdout:0/768: unlink d4/de/d28/d18/d3b/f42 0 2024-04-06T12:24:00.283 INFO:tasks.workunit.client.0.smithi152.stdout:6/673: rename d7/d9/d26/f52 to d7/d19/d3e/d70/dcb/fdc 0 2024-04-06T12:24:00.288 INFO:tasks.workunit.client.0.smithi152.stdout:0/769: creat d4/d31/d47/d89/fee x:0 0 0 2024-04-06T12:24:00.290 INFO:tasks.workunit.client.0.smithi152.stdout:0/770: truncate d4/de/d87/f8f 1531003 0 2024-04-06T12:24:00.294 INFO:tasks.workunit.client.0.smithi152.stdout:6/674: dread d7/d9/f56 [0,4194304] 0 2024-04-06T12:24:00.296 INFO:tasks.workunit.client.0.smithi152.stdout:0/771: truncate d4/d31/f6b 453079 0 2024-04-06T12:24:00.304 INFO:tasks.workunit.client.0.smithi152.stdout:0/772: unlink d4/c5 0 2024-04-06T12:24:00.305 INFO:tasks.workunit.client.0.smithi152.stdout:9/455: write d5/d6/f3c [8546723,52508] 0 2024-04-06T12:24:00.323 INFO:tasks.workunit.client.0.smithi152.stdout:3/625: write d0/d1f/d28/f76 [2499646,22793] 0 2024-04-06T12:24:00.324 INFO:tasks.workunit.client.0.smithi152.stdout:3/626: write d0/d10/d1e/d87/fa1 [855778,63019] 0 2024-04-06T12:24:00.325 INFO:tasks.workunit.client.0.smithi152.stdout:3/627: chown d0 755855207 1 2024-04-06T12:24:00.327 INFO:tasks.workunit.client.0.smithi152.stdout:3/628: read d0/d10/d1e/d87/fa1 [102710,122003] 0 2024-04-06T12:24:00.328 INFO:tasks.workunit.client.0.smithi152.stdout:3/629: write d0/d10/d1e/d71/fb7 [338047,63523] 0 2024-04-06T12:24:00.332 INFO:tasks.workunit.client.0.smithi152.stdout:3/630: creat d0/d10/d13/d2a/db6/fc2 x:0 0 0 2024-04-06T12:24:00.338 INFO:tasks.workunit.client.0.smithi152.stdout:3/631: dwrite d0/d10/f68 [0,4194304] 0 2024-04-06T12:24:00.351 INFO:tasks.workunit.client.0.smithi152.stdout:3/632: mkdir d0/d10/d13/d2a/d93/d3d/dc3 0 2024-04-06T12:24:00.356 INFO:tasks.workunit.client.0.smithi152.stdout:3/633: dread d0/d10/f68 [0,4194304] 0 2024-04-06T12:24:00.356 INFO:tasks.workunit.client.0.smithi152.stdout:3/634: chown d0/d1f/d28/f76 439816059 1 2024-04-06T12:24:00.368 INFO:tasks.workunit.client.0.smithi152.stdout:3/635: dread d0/d1f/d28/f76 [0,4194304] 0 2024-04-06T12:24:00.370 INFO:tasks.workunit.client.0.smithi152.stdout:3/636: write d0/d10/d1e/f1d [5060616,76772] 0 2024-04-06T12:24:00.374 INFO:tasks.workunit.client.0.smithi152.stdout:3/637: rmdir d0/d10/d13/d2a/d93 39 2024-04-06T12:24:00.379 INFO:tasks.workunit.client.0.smithi152.stdout:5/586: write d3/da/d15/d40/d46/f6b [3011653,19403] 0 2024-04-06T12:24:00.384 INFO:tasks.workunit.client.0.smithi152.stdout:3/638: creat d0/d10/d1e/fc4 x:0 0 0 2024-04-06T12:24:00.384 INFO:tasks.workunit.client.0.smithi152.stdout:7/579: dwrite d8/f6f [0,4194304] 0 2024-04-06T12:24:00.391 INFO:tasks.workunit.client.0.smithi152.stdout:8/771: dwrite d4/f36 [0,4194304] 0 2024-04-06T12:24:00.391 INFO:tasks.workunit.client.0.smithi152.stdout:8/772: readlink d4/db/d56/l103 0 2024-04-06T12:24:00.394 INFO:tasks.workunit.client.0.smithi152.stdout:3/639: unlink d0/d1f/c55 0 2024-04-06T12:24:00.404 INFO:tasks.workunit.client.0.smithi152.stdout:5/587: creat d3/da/d15/fb7 x:0 0 0 2024-04-06T12:24:00.408 INFO:tasks.workunit.client.0.smithi152.stdout:8/773: creat d4/db/d56/dcb/d6e/d88/f108 x:0 0 0 2024-04-06T12:24:00.413 INFO:tasks.workunit.client.0.smithi152.stdout:4/720: dwrite d7/d29/d2e/d7b/fad [0,4194304] 0 2024-04-06T12:24:00.422 INFO:tasks.workunit.client.0.smithi152.stdout:8/774: creat d4/dc/d10/d49/da0/f109 x:0 0 0 2024-04-06T12:24:00.431 INFO:tasks.workunit.client.0.smithi152.stdout:2/607: dwrite d0/d15/d4d/f4e [0,4194304] 0 2024-04-06T12:24:00.434 INFO:tasks.workunit.client.0.smithi152.stdout:5/588: creat d3/de/fb8 x:0 0 0 2024-04-06T12:24:00.439 INFO:tasks.workunit.client.0.smithi152.stdout:2/608: truncate d0/d15/d24/d3d/f9c 159822 0 2024-04-06T12:24:00.441 INFO:tasks.workunit.client.0.smithi152.stdout:5/589: mkdir d3/da/d15/d2b/d3f/db9 0 2024-04-06T12:24:00.449 INFO:tasks.workunit.client.0.smithi152.stdout:6/675: dwrite d7/d19/d1b/d31/f3c [0,4194304] 0 2024-04-06T12:24:00.450 INFO:tasks.workunit.client.0.smithi152.stdout:2/609: fdatasync d0/d40/d41/d28/d54/fb1 0 2024-04-06T12:24:00.451 INFO:tasks.workunit.client.0.smithi152.stdout:0/773: write d4/de/d87/f6a [932600,71268] 0 2024-04-06T12:24:00.455 INFO:tasks.workunit.client.0.smithi152.stdout:6/676: mkdir d7/d19/d1b/d1f/d3d/dc2/ddd 0 2024-04-06T12:24:00.456 INFO:tasks.workunit.client.0.smithi152.stdout:6/677: chown d7/d19/d1b/d1f/d3d/l41 7 1 2024-04-06T12:24:00.457 INFO:tasks.workunit.client.0.smithi152.stdout:6/678: write f3 [6428824,90119] 0 2024-04-06T12:24:00.468 INFO:tasks.workunit.client.0.smithi152.stdout:2/610: dwrite d0/d15/d24/d79/d80/fa0 [0,4194304] 0 2024-04-06T12:24:00.474 INFO:tasks.workunit.client.0.smithi152.stdout:6/679: mkdir d7/d19/dde 0 2024-04-06T12:24:00.478 INFO:tasks.workunit.client.0.smithi152.stdout:1/530: sync 2024-04-06T12:24:00.481 INFO:tasks.workunit.client.0.smithi152.stdout:2/611: rename d0/d40/fbc to d0/d15/d24/d3d/fc7 0 2024-04-06T12:24:00.485 INFO:tasks.workunit.client.0.smithi152.stdout:2/612: dread d0/d15/d24/f5b [0,4194304] 0 2024-04-06T12:24:00.487 INFO:tasks.workunit.client.0.smithi152.stdout:1/531: creat d2/d2f/d37/d91/fc1 x:0 0 0 2024-04-06T12:24:00.493 INFO:tasks.workunit.client.0.smithi152.stdout:1/532: chown d2/fb 35271063 1 2024-04-06T12:24:00.494 INFO:tasks.workunit.client.0.smithi152.stdout:6/680: rmdir d7/d19/d1b/d1f/d3d/dc2/dd4 0 2024-04-06T12:24:00.502 INFO:tasks.workunit.client.0.smithi152.stdout:2/613: link d0/d15/d24/f8e d0/d2/d6f/fc8 0 2024-04-06T12:24:00.506 INFO:tasks.workunit.client.0.smithi152.stdout:2/614: dread - d0/d15/d24/f98 zero size 2024-04-06T12:24:00.507 INFO:tasks.workunit.client.0.smithi152.stdout:6/681: rename d7/d9/d26/d2e/l47 to d7/d19/ldf 0 2024-04-06T12:24:00.512 INFO:tasks.workunit.client.0.smithi152.stdout:2/615: rename d0/d15/d24/d79/d80/d8d to d0/dc9 0 2024-04-06T12:24:00.513 INFO:tasks.workunit.client.0.smithi152.stdout:6/682: dwrite f6 [4194304,4194304] 0 2024-04-06T12:24:00.514 INFO:tasks.workunit.client.0.smithi152.stdout:6/683: dread - d7/d19/d3e/fc4 zero size 2024-04-06T12:24:00.525 INFO:tasks.workunit.client.0.smithi152.stdout:6/684: creat d7/d19/d3e/fe0 x:0 0 0 2024-04-06T12:24:00.528 INFO:tasks.workunit.client.0.smithi152.stdout:3/640: rename d0/d2d/d7f/d8c/lc0 to d0/d10/d13/d2a/d93/d3d/dc3/lc5 0 2024-04-06T12:24:00.529 INFO:tasks.workunit.client.0.smithi152.stdout:6/685: mkdir d7/d19/d1b/d22/de1 0 2024-04-06T12:24:00.536 INFO:tasks.workunit.client.0.smithi152.stdout:6/686: getdents d7/d19/d1b/d22/de1 0 2024-04-06T12:24:00.539 INFO:tasks.workunit.client.0.smithi152.stdout:6/687: truncate d7/d19/d1b/fb4 1485040 0 2024-04-06T12:24:00.540 INFO:tasks.workunit.client.0.smithi152.stdout:6/688: truncate d7/d19/d1b/d22/fa2 1689871 0 2024-04-06T12:24:00.541 INFO:tasks.workunit.client.0.smithi152.stdout:3/641: dread d0/d35/f82 [0,4194304] 0 2024-04-06T12:24:00.543 INFO:tasks.workunit.client.0.smithi152.stdout:6/689: unlink d7/d9/d73/lcd 0 2024-04-06T12:24:00.546 INFO:tasks.workunit.client.0.smithi152.stdout:3/642: rmdir d0/d35/d43 39 2024-04-06T12:24:00.550 INFO:tasks.workunit.client.0.smithi152.stdout:3/643: creat d0/d1f/d44/d7c/db8/fc6 x:0 0 0 2024-04-06T12:24:00.555 INFO:tasks.workunit.client.0.smithi152.stdout:3/644: creat d0/d1f/fc7 x:0 0 0 2024-04-06T12:24:00.556 INFO:tasks.workunit.client.0.smithi152.stdout:3/645: dread - d0/d1f/d44/d7c/db8/fc6 zero size 2024-04-06T12:24:00.561 INFO:tasks.workunit.client.0.smithi152.stdout:3/646: dwrite d0/d35/f82 [0,4194304] 0 2024-04-06T12:24:00.562 INFO:tasks.workunit.client.0.smithi152.stdout:3/647: write d0/d2d/f84 [4758000,27526] 0 2024-04-06T12:24:00.658 INFO:tasks.workunit.client.0.smithi152.stdout:3/648: link d0/c50 d0/d1f/d4a/cc8 0 2024-04-06T12:24:00.671 INFO:tasks.workunit.client.0.smithi152.stdout:7/580: dwrite d8/f16 [0,4194304] 0 2024-04-06T12:24:00.749 INFO:tasks.workunit.client.0.smithi152.stdout:5/590: write d3/da/d53/f60 [1675485,96179] 0 2024-04-06T12:24:00.753 INFO:tasks.workunit.client.0.smithi152.stdout:9/456: sync 2024-04-06T12:24:00.755 INFO:tasks.workunit.client.0.smithi152.stdout:9/457: fsync d5/d6/d74/d17/d23/d2d/d32/d36/f85 0 2024-04-06T12:24:00.762 INFO:tasks.workunit.client.0.smithi152.stdout:5/591: dread d3/da/d15/d40/d46/f6b [0,4194304] 0 2024-04-06T12:24:00.763 INFO:tasks.workunit.client.0.smithi152.stdout:5/592: stat d3/da/f24 0 2024-04-06T12:24:00.763 INFO:tasks.workunit.client.0.smithi152.stdout:0/774: fsync d4/de/d28/d18/d3b/f2f 0 2024-04-06T12:24:00.764 INFO:tasks.workunit.client.0.smithi152.stdout:7/581: getdents d8/df/d61/d3d/d6e/d8d 0 2024-04-06T12:24:00.765 INFO:tasks.workunit.client.0.smithi152.stdout:7/582: chown d8 0 1 2024-04-06T12:24:00.766 INFO:tasks.workunit.client.0.smithi152.stdout:0/775: truncate d4/d31/d47/d7e/dbe/fa1 15088 0 2024-04-06T12:24:00.766 INFO:tasks.workunit.client.0.smithi152.stdout:9/458: creat d5/d6/d74/d17/d86/f8e x:0 0 0 2024-04-06T12:24:00.768 INFO:tasks.workunit.client.0.smithi152.stdout:5/593: mknod d3/da/d53/cba 0 2024-04-06T12:24:00.769 INFO:tasks.workunit.client.0.smithi152.stdout:7/583: symlink d8/d2a/d37/d79/lbe 0 2024-04-06T12:24:00.770 INFO:tasks.workunit.client.0.smithi152.stdout:0/776: mknod d4/de/d4a/d33/cef 0 2024-04-06T12:24:00.773 INFO:tasks.workunit.client.0.smithi152.stdout:5/594: getdents d3/da/d15/d2b/d3f/db9 0 2024-04-06T12:24:00.774 INFO:tasks.workunit.client.0.smithi152.stdout:5/595: dread - d3/da/d15/d40/d50/d99/faa zero size 2024-04-06T12:24:00.775 INFO:tasks.workunit.client.0.smithi152.stdout:0/777: mkdir d4/de/d28/d18/d43/d62/daa/df0 0 2024-04-06T12:24:00.776 INFO:tasks.workunit.client.0.smithi152.stdout:0/778: chown d4/d31/d47/d7e/db9/dcc/dd5/ce2 0 1 2024-04-06T12:24:00.776 INFO:tasks.workunit.client.0.smithi152.stdout:7/584: unlink d8/l96 0 2024-04-06T12:24:00.777 INFO:tasks.workunit.client.0.smithi152.stdout:7/585: readlink d8/df/d28/l29 0 2024-04-06T12:24:00.779 INFO:tasks.workunit.client.0.smithi152.stdout:9/459: creat d5/d6/d74/d17/d23/d2d/f8f x:0 0 0 2024-04-06T12:24:00.781 INFO:tasks.workunit.client.0.smithi152.stdout:5/596: creat d3/de/d80/fbb x:0 0 0 2024-04-06T12:24:00.784 INFO:tasks.workunit.client.0.smithi152.stdout:9/460: rmdir d5/d6/d74/d17/d23 39 2024-04-06T12:24:00.785 INFO:tasks.workunit.client.0.smithi152.stdout:0/779: symlink d4/de/d28/d18/d3b/d2e/d78/lf1 0 2024-04-06T12:24:00.786 INFO:tasks.workunit.client.0.smithi152.stdout:7/586: mknod d8/df/d61/d3d/dac/cbf 0 2024-04-06T12:24:00.788 INFO:tasks.workunit.client.0.smithi152.stdout:5/597: rename d3/da/d15/d2b/d4d/lb6 to d3/da/d15/d40/d50/lbc 0 2024-04-06T12:24:00.792 INFO:tasks.workunit.client.0.smithi152.stdout:7/587: mknod d8/d2a/d37/d8c/d2d/cc0 0 2024-04-06T12:24:00.793 INFO:tasks.workunit.client.0.smithi152.stdout:5/598: rmdir d3/da/d15/d2b/d3f/d6d 39 2024-04-06T12:24:00.796 INFO:tasks.workunit.client.0.smithi152.stdout:7/588: unlink d8/d2a/d37/d8c/d2d/cc0 0 2024-04-06T12:24:00.799 INFO:tasks.workunit.client.0.smithi152.stdout:9/461: symlink d5/d6/d74/d17/d23/d2d/l90 0 2024-04-06T12:24:00.799 INFO:tasks.workunit.client.0.smithi152.stdout:0/780: link d4/de/faf d4/de/d28/d18/d43/d62/daa/df0/ff2 0 2024-04-06T12:24:00.800 INFO:tasks.workunit.client.0.smithi152.stdout:5/599: mkdir d3/da/d15/d2b/dbd 0 2024-04-06T12:24:00.800 INFO:tasks.workunit.client.0.smithi152.stdout:5/600: fdatasync d3/f16 0 2024-04-06T12:24:00.802 INFO:tasks.workunit.client.0.smithi152.stdout:5/601: readlink d3/de/d80/l89 0 2024-04-06T12:24:00.803 INFO:tasks.workunit.client.0.smithi152.stdout:7/589: mkdir d8/df/d61/d6d/d85/dc1 0 2024-04-06T12:24:00.804 INFO:tasks.workunit.client.0.smithi152.stdout:5/602: fsync d3/da/d15/d2b/d3f/f43 0 2024-04-06T12:24:00.805 INFO:tasks.workunit.client.0.smithi152.stdout:7/590: readlink d8/df/d61/ld 0 2024-04-06T12:24:00.806 INFO:tasks.workunit.client.0.smithi152.stdout:0/781: dwrite d4/d36/f74 [0,4194304] 0 2024-04-06T12:24:00.811 INFO:tasks.workunit.client.0.smithi152.stdout:1/533: write d2/d2f/d54/d88/f90 [815142,66214] 0 2024-04-06T12:24:00.814 INFO:tasks.workunit.client.0.smithi152.stdout:1/534: fdatasync d2/fb6 0 2024-04-06T12:24:00.815 INFO:tasks.workunit.client.0.smithi152.stdout:1/535: stat d2/f5a 0 2024-04-06T12:24:00.816 INFO:tasks.workunit.client.0.smithi152.stdout:0/782: rename f0 to d4/d31/d47/d7e/db9/dcc/dd5/ff3 0 2024-04-06T12:24:00.817 INFO:tasks.workunit.client.0.smithi152.stdout:4/721: sync 2024-04-06T12:24:00.817 INFO:tasks.workunit.client.0.smithi152.stdout:8/775: sync 2024-04-06T12:24:00.826 INFO:tasks.workunit.client.0.smithi152.stdout:8/776: rename d4/db/d56/fa9 to d4/dc/d10/d49/dae/f10a 0 2024-04-06T12:24:00.829 INFO:tasks.workunit.client.0.smithi152.stdout:0/783: dwrite d4/de/d7f/db7/fc3 [0,4194304] 0 2024-04-06T12:24:00.831 INFO:tasks.workunit.client.0.smithi152.stdout:8/777: rmdir d4/db/d56/dcb/d6e/d88 39 2024-04-06T12:24:00.832 INFO:tasks.workunit.client.0.smithi152.stdout:4/722: dwrite d7/d29/d2e/d7b/fad [0,4194304] 0 2024-04-06T12:24:00.839 INFO:tasks.workunit.client.0.smithi152.stdout:0/784: write d4/de/d28/d18/d3b/fe5 [1034533,98732] 0 2024-04-06T12:24:00.843 INFO:tasks.workunit.client.0.smithi152.stdout:2/616: creat d0/d15/d4d/fca x:0 0 0 2024-04-06T12:24:00.846 INFO:tasks.workunit.client.0.smithi152.stdout:4/723: dwrite d7/d16/d22/d3f/db4/fe0 [0,4194304] 0 2024-04-06T12:24:00.852 INFO:tasks.workunit.client.0.smithi152.stdout:0/785: write d4/de/d28/d18/d3b/fb4 [2171459,64911] 0 2024-04-06T12:24:00.864 INFO:tasks.workunit.client.0.smithi152.stdout:4/724: dwrite d7/d29/f65 [4194304,4194304] 0 2024-04-06T12:24:00.866 INFO:tasks.workunit.client.0.smithi152.stdout:0/786: dwrite d4/de/d28/d18/d3b/d2e/fec [0,4194304] 0 2024-04-06T12:24:00.870 INFO:tasks.workunit.client.0.smithi152.stdout:6/690: write d7/d19/d3e/d70/f99 [835606,17150] 0 2024-04-06T12:24:00.877 INFO:tasks.workunit.client.0.smithi152.stdout:0/787: truncate d4/de/f30 3972991 0 2024-04-06T12:24:00.880 INFO:tasks.workunit.client.0.smithi152.stdout:0/788: read d4/d31/d47/d7e/db9/dcc/dd5/ff3 [1982582,57150] 0 2024-04-06T12:24:00.890 INFO:tasks.workunit.client.0.smithi152.stdout:4/725: dread d7/d29/d7e/d59/f85 [0,4194304] 0 2024-04-06T12:24:00.890 INFO:tasks.workunit.client.0.smithi152.stdout:3/649: dwrite d0/d10/d13/d2a/d93/f5f [0,4194304] 0 2024-04-06T12:24:00.890 INFO:tasks.workunit.client.0.smithi152.stdout:0/789: truncate d4/d31/d47/f9c 2244023 0 2024-04-06T12:24:00.894 INFO:tasks.workunit.client.0.smithi152.stdout:4/726: creat d7/d29/d78/fe9 x:0 0 0 2024-04-06T12:24:00.895 INFO:tasks.workunit.client.0.smithi152.stdout:4/727: chown d7/d29/fd8 99612 1 2024-04-06T12:24:00.896 INFO:tasks.workunit.client.0.smithi152.stdout:0/790: mkdir d4/de/d7f/df4 0 2024-04-06T12:24:00.898 INFO:tasks.workunit.client.0.smithi152.stdout:3/650: chown d0/d35/d43/ca3 249275475 1 2024-04-06T12:24:00.903 INFO:tasks.workunit.client.0.smithi152.stdout:3/651: creat d0/d1f/d44/d7c/db8/fc9 x:0 0 0 2024-04-06T12:24:00.907 INFO:tasks.workunit.client.0.smithi152.stdout:0/791: dwrite d4/de/d28/d18/d43/d62/dd4/fe7 [0,4194304] 0 2024-04-06T12:24:00.909 INFO:tasks.workunit.client.0.smithi152.stdout:3/652: dread d0/ff [0,4194304] 0 2024-04-06T12:24:00.911 INFO:tasks.workunit.client.0.smithi152.stdout:3/653: dread - d0/d1f/d44/f7b zero size 2024-04-06T12:24:00.915 INFO:tasks.workunit.client.0.smithi152.stdout:3/654: dread d0/d10/f68 [0,4194304] 0 2024-04-06T12:24:00.915 INFO:tasks.workunit.client.0.smithi152.stdout:0/792: link d4/de/d28/d18/d43/d62/daa/cd6 d4/d19/dbd/cf5 0 2024-04-06T12:24:00.917 INFO:tasks.workunit.client.0.smithi152.stdout:3/655: write d0/d10/d13/f1a [1985732,39392] 0 2024-04-06T12:24:00.918 INFO:tasks.workunit.client.0.smithi152.stdout:4/728: dread d7/f2c [0,4194304] 0 2024-04-06T12:24:00.919 INFO:tasks.workunit.client.0.smithi152.stdout:3/656: write d0/d10/d13/d2a/f51 [4603655,113539] 0 2024-04-06T12:24:00.920 INFO:tasks.workunit.client.0.smithi152.stdout:0/793: unlink d4/de/d4a/d33/fe3 0 2024-04-06T12:24:00.925 INFO:tasks.workunit.client.0.smithi152.stdout:0/794: creat d4/de/d87/d94/ff6 x:0 0 0 2024-04-06T12:24:00.926 INFO:tasks.workunit.client.0.smithi152.stdout:3/657: symlink d0/d35/d43/d48/d83/d9d/lca 0 2024-04-06T12:24:00.927 INFO:tasks.workunit.client.0.smithi152.stdout:0/795: read d4/de/d4a/d33/fa6 [2150616,15034] 0 2024-04-06T12:24:00.930 INFO:tasks.workunit.client.0.smithi152.stdout:0/796: creat d4/d31/d47/d7e/db9/dcc/ff7 x:0 0 0 2024-04-06T12:24:00.931 INFO:tasks.workunit.client.0.smithi152.stdout:0/797: stat d4/de/d4a/d33 0 2024-04-06T12:24:00.934 INFO:tasks.workunit.client.0.smithi152.stdout:0/798: readlink d4/de/d28/d18/d3b/d2e/lcd 0 2024-04-06T12:24:00.937 INFO:tasks.workunit.client.0.smithi152.stdout:0/799: creat d4/de/d28/d18/d43/d8a/ff8 x:0 0 0 2024-04-06T12:24:00.942 INFO:tasks.workunit.client.0.smithi152.stdout:0/800: rename d4/de/d28/d99 to d4/d31/d47/d7e/db9/df9 0 2024-04-06T12:24:00.943 INFO:tasks.workunit.client.0.smithi152.stdout:0/801: write d4/d31/fe1 [696929,4715] 0 2024-04-06T12:24:00.950 INFO:tasks.workunit.client.0.smithi152.stdout:0/802: creat d4/de/d28/d18/d43/d62/daa/df0/ffa x:0 0 0 2024-04-06T12:24:00.955 INFO:tasks.workunit.client.0.smithi152.stdout:9/462: truncate d5/d6/d74/d17/f75 1508039 0 2024-04-06T12:24:00.955 INFO:tasks.workunit.client.0.smithi152.stdout:0/803: dwrite d4/de/d28/f22 [0,4194304] 0 2024-04-06T12:24:00.963 INFO:tasks.workunit.client.0.smithi152.stdout:7/591: dwrite d8/df/d61/fa6 [0,4194304] 0 2024-04-06T12:24:00.970 INFO:tasks.workunit.client.0.smithi152.stdout:1/536: dwrite d2/d2f/d45/f62 [0,4194304] 0 2024-04-06T12:24:00.973 INFO:tasks.workunit.client.0.smithi152.stdout:7/592: truncate d8/df/d34/f67 4570115 0 2024-04-06T12:24:00.977 INFO:tasks.workunit.client.0.smithi152.stdout:9/463: rmdir d5/d6/d74/d17/d23/d2d/d32/d36/d8b 0 2024-04-06T12:24:00.978 INFO:tasks.workunit.client.0.smithi152.stdout:9/464: write d5/d6/f14 [5410110,32386] 0 2024-04-06T12:24:00.981 INFO:tasks.workunit.client.0.smithi152.stdout:2/617: write d0/d2/f14 [1628231,105689] 0 2024-04-06T12:24:00.982 INFO:tasks.workunit.client.0.smithi152.stdout:2/618: dread - d0/d15/d24/d79/f7a zero size 2024-04-06T12:24:00.985 INFO:tasks.workunit.client.0.smithi152.stdout:9/465: creat d5/d39/d79/f91 x:0 0 0 2024-04-06T12:24:00.986 INFO:tasks.workunit.client.0.smithi152.stdout:9/466: stat d5/d6/d74/d17/d23/d2d/d32/d36/l55 0 2024-04-06T12:24:00.988 INFO:tasks.workunit.client.0.smithi152.stdout:1/537: mknod d2/d2f/d54/cc2 0 2024-04-06T12:24:00.989 INFO:tasks.workunit.client.0.smithi152.stdout:6/691: write d7/d19/d1b/d22/f94 [671115,123391] 0 2024-04-06T12:24:00.990 INFO:tasks.workunit.client.0.smithi152.stdout:1/538: fsync d2/d2f/d54/d88/da4/fab 0 2024-04-06T12:24:00.990 INFO:tasks.workunit.client.0.smithi152.stdout:6/692: chown d7/d9/l1d 376756261 1 2024-04-06T12:24:00.997 INFO:tasks.workunit.client.0.smithi152.stdout:9/467: symlink d5/d6/d74/d17/d23/l92 0 2024-04-06T12:24:00.998 INFO:tasks.workunit.client.0.smithi152.stdout:6/693: dwrite d7/d19/dbf/fd2 [0,4194304] 0 2024-04-06T12:24:00.999 INFO:tasks.workunit.client.0.smithi152.stdout:2/619: creat d0/dae/fcb x:0 0 0 2024-04-06T12:24:01.011 INFO:tasks.workunit.client.0.smithi152.stdout:4/729: dwrite d7/d29/d78/d33/f71 [0,4194304] 0 2024-04-06T12:24:01.013 INFO:tasks.workunit.client.0.smithi152.stdout:4/730: read d7/d29/d78/f7c [40837,15589] 0 2024-04-06T12:24:01.018 INFO:tasks.workunit.client.0.smithi152.stdout:6/694: creat d7/d19/d1b/d31/fe2 x:0 0 0 2024-04-06T12:24:01.018 INFO:tasks.workunit.client.0.smithi152.stdout:6/695: chown d7/d19/d3e/fe0 2 1 2024-04-06T12:24:01.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:23:59.585294+0000 mgr.smithi195.ausetj (mgr.24375) 84 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 55 MiB/s rd, 155 MiB/s wr, 361 op/s 2024-04-06T12:24:01.029 INFO:tasks.workunit.client.0.smithi152.stdout:0/804: write f1 [4432017,122979] 0 2024-04-06T12:24:01.030 INFO:tasks.workunit.client.0.smithi152.stdout:0/805: fsync d4/de/d28/d18/d43/fd2 0 2024-04-06T12:24:01.034 INFO:tasks.workunit.client.0.smithi152.stdout:4/731: rmdir d7/d16/d22/d95 39 2024-04-06T12:24:01.038 INFO:tasks.workunit.client.0.smithi152.stdout:6/696: unlink d7/d19/d1b/d31/d35/fbe 0 2024-04-06T12:24:01.039 INFO:tasks.workunit.client.0.smithi152.stdout:4/732: dread d7/d29/f5e [0,4194304] 0 2024-04-06T12:24:01.039 INFO:tasks.workunit.client.0.smithi152.stdout:4/733: fsync d7/d29/fd8 0 2024-04-06T12:24:01.042 INFO:tasks.workunit.client.0.smithi152.stdout:2/620: rmdir d0/d40/d41/d28 39 2024-04-06T12:24:01.044 INFO:tasks.workunit.client.0.smithi152.stdout:1/539: rmdir d2/d2f/daa 0 2024-04-06T12:24:01.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:23:59.585294+0000 mgr.smithi195.ausetj (mgr.24375) 84 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 55 MiB/s rd, 155 MiB/s wr, 361 op/s 2024-04-06T12:24:01.050 INFO:tasks.workunit.client.0.smithi152.stdout:0/806: truncate d4/de/f1e 4123114 0 2024-04-06T12:24:01.055 INFO:tasks.workunit.client.0.smithi152.stdout:6/697: creat d7/d19/d1b/d22/fe3 x:0 0 0 2024-04-06T12:24:01.060 INFO:tasks.workunit.client.0.smithi152.stdout:7/593: dwrite f3 [4194304,4194304] 0 2024-04-06T12:24:01.067 INFO:tasks.workunit.client.0.smithi152.stdout:1/540: fsync d2/ff 0 2024-04-06T12:24:01.071 INFO:tasks.workunit.client.0.smithi152.stdout:0/807: symlink d4/de/d28/d18/d43/lfb 0 2024-04-06T12:24:01.073 INFO:tasks.workunit.client.0.smithi152.stdout:6/698: dread d7/d19/f8d [0,4194304] 0 2024-04-06T12:24:01.082 INFO:tasks.workunit.client.0.smithi152.stdout:2/621: symlink d0/d15/d24/lcc 0 2024-04-06T12:24:01.084 INFO:tasks.workunit.client.0.smithi152.stdout:9/468: dwrite d5/d6/d74/d17/d23/d2d/f8f [0,4194304] 0 2024-04-06T12:24:01.089 INFO:tasks.workunit.client.0.smithi152.stdout:1/541: truncate d2/d1d/d3b/f56 982541 0 2024-04-06T12:24:01.097 INFO:tasks.workunit.client.0.smithi152.stdout:6/699: dread d7/d19/d3e/f72 [0,4194304] 0 2024-04-06T12:24:01.098 INFO:tasks.workunit.client.0.smithi152.stdout:6/700: write d7/d62/f63 [1431305,91486] 0 2024-04-06T12:24:01.102 INFO:tasks.workunit.client.0.smithi152.stdout:7/594: creat d8/d2a/d37/d8c/d2d/da3/dbb/fc2 x:0 0 0 2024-04-06T12:24:01.103 INFO:tasks.workunit.client.0.smithi152.stdout:7/595: write d8/d74/f97 [3402721,78044] 0 2024-04-06T12:24:01.104 INFO:tasks.workunit.client.0.smithi152.stdout:7/596: stat d8/c9 0 2024-04-06T12:24:01.105 INFO:tasks.workunit.client.0.smithi152.stdout:7/597: write d8/fb [1610861,34198] 0 2024-04-06T12:24:01.109 INFO:tasks.workunit.client.0.smithi152.stdout:4/734: write d7/d16/f6e [4229657,7966] 0 2024-04-06T12:24:01.113 INFO:tasks.workunit.client.0.smithi152.stdout:1/542: rename d2/d5d/d6d/d7d to d2/d1d/d3b/dc3 0 2024-04-06T12:24:01.114 INFO:tasks.workunit.client.0.smithi152.stdout:4/735: dread d7/d29/d2e/d7b/fad [0,4194304] 0 2024-04-06T12:24:01.115 INFO:tasks.workunit.client.0.smithi152.stdout:0/808: truncate d4/d31/f3d 1482344 0 2024-04-06T12:24:01.134 INFO:tasks.workunit.client.0.smithi152.stdout:6/701: rename d7/d9/l1d to d7/d19/dde/le4 0 2024-04-06T12:24:01.138 INFO:tasks.workunit.client.0.smithi152.stdout:7/598: dread d8/df/d34/d5c/f8e [0,4194304] 0 2024-04-06T12:24:01.139 INFO:tasks.workunit.client.0.smithi152.stdout:4/736: symlink d7/d29/d78/d33/lea 0 2024-04-06T12:24:01.143 INFO:tasks.workunit.client.0.smithi152.stdout:0/809: creat d4/de/d87/d94/ffc x:0 0 0 2024-04-06T12:24:01.144 INFO:tasks.workunit.client.0.smithi152.stdout:9/469: creat d5/d39/f93 x:0 0 0 2024-04-06T12:24:01.146 INFO:tasks.workunit.client.0.smithi152.stdout:7/599: dread d8/df/f25 [0,4194304] 0 2024-04-06T12:24:01.147 INFO:tasks.workunit.client.0.smithi152.stdout:8/778: sync 2024-04-06T12:24:01.147 INFO:tasks.workunit.client.0.smithi152.stdout:5/603: sync 2024-04-06T12:24:01.147 INFO:tasks.workunit.client.0.smithi152.stdout:3/658: sync 2024-04-06T12:24:01.148 INFO:tasks.workunit.client.0.smithi152.stdout:0/810: dread d4/de/d28/f95 [0,4194304] 0 2024-04-06T12:24:01.149 INFO:tasks.workunit.client.0.smithi152.stdout:7/600: stat d8/df/d61/d6d 0 2024-04-06T12:24:01.150 INFO:tasks.workunit.client.0.smithi152.stdout:7/601: chown d8/d74/f97 786 1 2024-04-06T12:24:01.153 INFO:tasks.workunit.client.0.smithi152.stdout:6/702: read - d7/d19/d3e/f5d zero size 2024-04-06T12:24:01.157 INFO:tasks.workunit.client.0.smithi152.stdout:3/659: dwrite d0/d35/d43/d48/fbc [0,4194304] 0 2024-04-06T12:24:01.158 INFO:tasks.workunit.client.0.smithi152.stdout:4/737: symlink d7/d16/d55/leb 0 2024-04-06T12:24:01.159 INFO:tasks.workunit.client.0.smithi152.stdout:4/738: chown d7/d16/d55/da0/lcd 5434842 1 2024-04-06T12:24:01.162 INFO:tasks.workunit.client.0.smithi152.stdout:4/739: truncate d7/d16/d22/d3f/fe8 1012918 0 2024-04-06T12:24:01.166 INFO:tasks.workunit.client.0.smithi152.stdout:2/622: getdents d0/d40/d41/d63 0 2024-04-06T12:24:01.169 INFO:tasks.workunit.client.0.smithi152.stdout:8/779: chown d4/dc/c31 0 1 2024-04-06T12:24:01.170 INFO:tasks.workunit.client.0.smithi152.stdout:4/740: dwrite d7/d29/d78/d33/fae [0,4194304] 0 2024-04-06T12:24:01.171 INFO:tasks.workunit.client.0.smithi152.stdout:4/741: write d7/d16/f68 [4267359,28089] 0 2024-04-06T12:24:01.172 INFO:tasks.workunit.client.0.smithi152.stdout:5/604: dread - d3/da/d15/d2b/d3f/d4c/f9a zero size 2024-04-06T12:24:01.174 INFO:tasks.workunit.client.0.smithi152.stdout:4/742: dread - d7/d16/d55/da0/fe2 zero size 2024-04-06T12:24:01.175 INFO:tasks.workunit.client.0.smithi152.stdout:4/743: dread - d7/d29/d78/fe9 zero size 2024-04-06T12:24:01.187 INFO:tasks.workunit.client.0.smithi152.stdout:0/811: dread d4/de/d28/d18/d3b/d2e/d78/f79 [0,4194304] 0 2024-04-06T12:24:01.188 INFO:tasks.workunit.client.0.smithi152.stdout:0/812: fdatasync d4/d31/fe1 0 2024-04-06T12:24:01.192 INFO:tasks.workunit.client.0.smithi152.stdout:2/623: mkdir d0/d15/d24/d79/dcd 0 2024-04-06T12:24:01.192 INFO:tasks.workunit.client.0.smithi152.stdout:2/624: chown d0/d15/d24/lcc 1 1 2024-04-06T12:24:01.194 INFO:tasks.workunit.client.0.smithi152.stdout:6/703: dread d7/d9/d26/d2e/f42 [0,4194304] 0 2024-04-06T12:24:01.200 INFO:tasks.workunit.client.0.smithi152.stdout:9/470: dwrite d5/d6/d74/d17/f46 [0,4194304] 0 2024-04-06T12:24:01.200 INFO:tasks.workunit.client.0.smithi152.stdout:5/605: truncate d3/da/d15/d2b/d3f/d68/d81/f3b 4521849 0 2024-04-06T12:24:01.206 INFO:tasks.workunit.client.0.smithi152.stdout:1/543: getdents d2/d2f/d37/d91 0 2024-04-06T12:24:01.210 INFO:tasks.workunit.client.0.smithi152.stdout:0/813: mknod d4/de/d28/d18/d43/d62/daa/cfd 0 2024-04-06T12:24:01.212 INFO:tasks.workunit.client.0.smithi152.stdout:2/625: mkdir d0/d15/d24/d79/d80/dce 0 2024-04-06T12:24:01.212 INFO:tasks.workunit.client.0.smithi152.stdout:8/780: symlink d4/db/d56/dcb/ddb/l10b 0 2024-04-06T12:24:01.214 INFO:tasks.workunit.client.0.smithi152.stdout:6/704: write d7/d19/d1b/d1f/d3d/f8e [6261434,87740] 0 2024-04-06T12:24:01.216 INFO:tasks.workunit.client.0.smithi152.stdout:6/705: fsync d7/d19/d3e/f8b 0 2024-04-06T12:24:01.216 INFO:tasks.workunit.client.0.smithi152.stdout:9/471: rmdir d5/d39/d3f/d42 39 2024-04-06T12:24:01.217 INFO:tasks.workunit.client.0.smithi152.stdout:6/706: chown d7/d19/d1b/d1f/d3d/fc0 2460693 1 2024-04-06T12:24:01.218 INFO:tasks.workunit.client.0.smithi152.stdout:6/707: fdatasync d7/d19/d3e/f8b 0 2024-04-06T12:24:01.219 INFO:tasks.workunit.client.0.smithi152.stdout:6/708: dread - d7/d19/d1b/d31/fe2 zero size 2024-04-06T12:24:01.220 INFO:tasks.workunit.client.0.smithi152.stdout:1/544: symlink d2/d1d/d3b/dc3/lc4 0 2024-04-06T12:24:01.222 INFO:tasks.workunit.client.0.smithi152.stdout:3/660: link d0/d1f/d44/l8a d0/d10/daf/lcb 0 2024-04-06T12:24:01.224 INFO:tasks.workunit.client.0.smithi152.stdout:0/814: creat d4/de/d4a/ffe x:0 0 0 2024-04-06T12:24:01.233 INFO:tasks.workunit.client.0.smithi152.stdout:1/545: dread d2/d2f/d37/d91/dad/f30 [0,4194304] 0 2024-04-06T12:24:01.235 INFO:tasks.workunit.client.0.smithi152.stdout:9/472: rename d5/d6/d74/d17/l58 to d5/d6/d74/d17/d23/d2d/d32/l94 0 2024-04-06T12:24:01.235 INFO:tasks.workunit.client.0.smithi152.stdout:9/473: chown d5/d6/f3c 664 1 2024-04-06T12:24:01.236 INFO:tasks.workunit.client.0.smithi152.stdout:5/606: creat d3/da/d15/d2b/d3f/db9/fbe x:0 0 0 2024-04-06T12:24:01.238 INFO:tasks.workunit.client.0.smithi152.stdout:3/661: fdatasync d0/d1f/d28/f76 0 2024-04-06T12:24:01.239 INFO:tasks.workunit.client.0.smithi152.stdout:3/662: fsync d0/d2d/f84 0 2024-04-06T12:24:01.240 INFO:tasks.workunit.client.0.smithi152.stdout:0/815: rmdir d4/d19 39 2024-04-06T12:24:01.244 INFO:tasks.workunit.client.0.smithi152.stdout:8/781: symlink d4/db/d56/dcb/l10c 0 2024-04-06T12:24:01.245 INFO:tasks.workunit.client.0.smithi152.stdout:2/626: creat d0/d15/d24/d79/d80/dce/fcf x:0 0 0 2024-04-06T12:24:01.246 INFO:tasks.workunit.client.0.smithi152.stdout:4/744: write d7/d29/d2e/f9a [2008335,36242] 0 2024-04-06T12:24:01.248 INFO:tasks.workunit.client.0.smithi152.stdout:3/663: dwrite d0/d10/d13/d2a/db6/fc2 [0,4194304] 0 2024-04-06T12:24:01.253 INFO:tasks.workunit.client.0.smithi152.stdout:5/607: readlink d3/d9/l83 0 2024-04-06T12:24:01.266 INFO:tasks.workunit.client.0.smithi152.stdout:4/745: creat d7/d16/d55/fec x:0 0 0 2024-04-06T12:24:01.272 INFO:tasks.workunit.client.0.smithi152.stdout:1/546: write d2/d2f/d37/f64 [836676,35078] 0 2024-04-06T12:24:01.274 INFO:tasks.workunit.client.0.smithi152.stdout:6/709: creat d7/d19/d1b/d1f/fe5 x:0 0 0 2024-04-06T12:24:01.276 INFO:tasks.workunit.client.0.smithi152.stdout:5/608: dread d3/da/d15/d40/d4f/f54 [0,4194304] 0 2024-04-06T12:24:01.278 INFO:tasks.workunit.client.0.smithi152.stdout:0/816: creat d4/d19/dbd/fff x:0 0 0 2024-04-06T12:24:01.282 INFO:tasks.workunit.client.0.smithi152.stdout:3/664: symlink d0/d35/lcc 0 2024-04-06T12:24:01.284 INFO:tasks.workunit.client.0.smithi152.stdout:8/782: dwrite d4/d2c/fa4 [0,4194304] 0 2024-04-06T12:24:01.286 INFO:tasks.workunit.client.0.smithi152.stdout:2/627: mknod d0/d2/d6f/d90/d9e/db5/cd0 0 2024-04-06T12:24:01.288 INFO:tasks.workunit.client.0.smithi152.stdout:9/474: creat d5/d6/f95 x:0 0 0 2024-04-06T12:24:01.292 INFO:tasks.workunit.client.0.smithi152.stdout:1/547: rename d2/d2f/d37/d91 to d2/d2f/d54/d88/d9c/dc5 0 2024-04-06T12:24:01.294 INFO:tasks.workunit.client.0.smithi152.stdout:0/817: dread d4/de/d28/f40 [0,4194304] 0 2024-04-06T12:24:01.296 INFO:tasks.workunit.client.0.smithi152.stdout:5/609: symlink d3/da/d15/d2b/d3f/db9/lbf 0 2024-04-06T12:24:01.300 INFO:tasks.workunit.client.0.smithi152.stdout:3/665: mknod d0/d10/daf/ccd 0 2024-04-06T12:24:01.304 INFO:tasks.workunit.client.0.smithi152.stdout:4/746: dwrite d7/d16/d22/f69 [4194304,4194304] 0 2024-04-06T12:24:01.305 INFO:tasks.workunit.client.0.smithi152.stdout:2/628: write d0/d40/d41/d28/fbe [1047896,78960] 0 2024-04-06T12:24:01.310 INFO:tasks.workunit.client.0.smithi152.stdout:1/548: symlink d2/d1d/d7c/lc6 0 2024-04-06T12:24:01.311 INFO:tasks.workunit.client.0.smithi152.stdout:0/818: mknod d4/de/d28/d18/d3b/d2e/dcb/c100 0 2024-04-06T12:24:01.312 INFO:tasks.workunit.client.0.smithi152.stdout:0/819: fdatasync d4/de/d87/f6a 0 2024-04-06T12:24:01.315 INFO:tasks.workunit.client.0.smithi152.stdout:5/610: creat d3/de/d80/d8f/fc0 x:0 0 0 2024-04-06T12:24:01.318 INFO:tasks.workunit.client.0.smithi152.stdout:3/666: symlink d0/d10/lce 0 2024-04-06T12:24:01.464 INFO:tasks.workunit.client.0.smithi152.stdout:4/747: rename d7/d29/d78/d33 to d7/d29/d78/ded 0 2024-04-06T12:24:01.467 INFO:tasks.workunit.client.0.smithi152.stdout:6/710: mkdir d7/d19/d1b/db2/de6 0 2024-04-06T12:24:01.471 INFO:tasks.workunit.client.0.smithi152.stdout:0/820: creat d4/d31/d47/d7e/db9/dcc/f101 x:0 0 0 2024-04-06T12:24:01.472 INFO:tasks.workunit.client.0.smithi152.stdout:5/611: mkdir d3/da/d15/d2b/d3f/d68/d81/dc1 0 2024-04-06T12:24:01.476 INFO:tasks.workunit.client.0.smithi152.stdout:8/783: link d4/dc/d10/d49/da0/dc0/db6/le5 d4/db/d39/l10d 0 2024-04-06T12:24:01.480 INFO:tasks.workunit.client.0.smithi152.stdout:8/784: read d4/dc/d10/d51/f61 [3161039,32932] 0 2024-04-06T12:24:01.480 INFO:tasks.workunit.client.0.smithi152.stdout:5/612: dwrite d3/de/d80/d8f/fc0 [0,4194304] 0 2024-04-06T12:24:01.482 INFO:tasks.workunit.client.0.smithi152.stdout:8/785: write d4/db/d56/f86 [332982,35858] 0 2024-04-06T12:24:01.483 INFO:tasks.workunit.client.0.smithi152.stdout:9/475: rename d5/d6/f63 to d5/d6/d74/f96 0 2024-04-06T12:24:01.487 INFO:tasks.workunit.client.0.smithi152.stdout:0/821: dread d4/de/d4a/d33/fa6 [0,4194304] 0 2024-04-06T12:24:01.489 INFO:tasks.workunit.client.0.smithi152.stdout:4/748: creat d7/d82/db1/db6/fee x:0 0 0 2024-04-06T12:24:01.491 INFO:tasks.workunit.client.0.smithi152.stdout:6/711: fdatasync d7/d9/d26/d2e/faf 0 2024-04-06T12:24:01.497 INFO:tasks.workunit.client.0.smithi152.stdout:2/629: dwrite d0/d15/d24/f98 [0,4194304] 0 2024-04-06T12:24:01.501 INFO:tasks.workunit.client.0.smithi152.stdout:3/667: truncate d0/d35/f88 15553 0 2024-04-06T12:24:01.501 INFO:tasks.workunit.client.0.smithi152.stdout:3/668: chown d0/d10/l24 0 1 2024-04-06T12:24:01.507 INFO:tasks.workunit.client.0.smithi152.stdout:0/822: creat d4/d36/f102 x:0 0 0 2024-04-06T12:24:01.514 INFO:tasks.workunit.client.0.smithi152.stdout:8/786: mknod d4/d2c/d2b/c10e 0 2024-04-06T12:24:01.515 INFO:tasks.workunit.client.0.smithi152.stdout:3/669: truncate d0/d35/d43/d48/d83/f9a 231000 0 2024-04-06T12:24:01.519 INFO:tasks.workunit.client.0.smithi152.stdout:0/823: rename d4/de/d28/d18/d3b/d2e/dcb/cce to d4/de/d28/d18/d43/c103 0 2024-04-06T12:24:01.522 INFO:tasks.workunit.client.0.smithi152.stdout:2/630: symlink d0/d40/d26/db4/ld1 0 2024-04-06T12:24:01.526 INFO:tasks.workunit.client.0.smithi152.stdout:8/787: unlink d4/l6a 0 2024-04-06T12:24:01.528 INFO:tasks.workunit.client.0.smithi152.stdout:3/670: unlink d0/d10/d13/f32 0 2024-04-06T12:24:01.530 INFO:tasks.workunit.client.0.smithi152.stdout:0/824: symlink d4/d31/d47/d7e/db9/dcc/l104 0 2024-04-06T12:24:01.530 INFO:tasks.workunit.client.0.smithi152.stdout:6/712: link d7/d19/c57 d7/d19/d1b/db2/ce7 0 2024-04-06T12:24:01.533 INFO:tasks.workunit.client.0.smithi152.stdout:5/613: link d3/da/d15/d2b/c42 d3/da/d15/d2b/cc2 0 2024-04-06T12:24:01.535 INFO:tasks.workunit.client.0.smithi152.stdout:3/671: rmdir d0/d2d 39 2024-04-06T12:24:01.536 INFO:tasks.workunit.client.0.smithi152.stdout:0/825: dwrite d4/d36/f74 [0,4194304] 0 2024-04-06T12:24:01.537 INFO:tasks.workunit.client.0.smithi152.stdout:3/672: write d0/d35/d43/d48/fbc [4715300,22532] 0 2024-04-06T12:24:01.540 INFO:tasks.workunit.client.0.smithi152.stdout:2/631: rename d0/d40/d41/d28/f61 to d0/dc9/fd2 0 2024-04-06T12:24:01.541 INFO:tasks.workunit.client.0.smithi152.stdout:5/614: rmdir d3/de 39 2024-04-06T12:24:01.584 INFO:tasks.workunit.client.0.smithi152.stdout:6/713: symlink d7/d19/d1b/db2/de6/le8 0 2024-04-06T12:24:01.585 INFO:tasks.workunit.client.0.smithi152.stdout:0/826: creat d4/de/d87/f105 x:0 0 0 2024-04-06T12:24:01.589 INFO:tasks.workunit.client.0.smithi152.stdout:5/615: rename d3/da/d53/l7c to d3/da/d15/d7f/lc3 0 2024-04-06T12:24:01.592 INFO:tasks.workunit.client.0.smithi152.stdout:6/714: creat d7/d19/dde/fe9 x:0 0 0 2024-04-06T12:24:01.594 INFO:tasks.workunit.client.0.smithi152.stdout:6/715: truncate d7/d19/d1b/d31/fe2 111577 0 2024-04-06T12:24:01.594 INFO:tasks.workunit.client.0.smithi152.stdout:0/827: creat d4/de/d28/d18/d43/d62/f106 x:0 0 0 2024-04-06T12:24:01.599 INFO:tasks.workunit.client.0.smithi152.stdout:5/616: fdatasync d3/da/d15/f21 0 2024-04-06T12:24:01.600 INFO:tasks.workunit.client.0.smithi152.stdout:5/617: fdatasync d3/da/d15/d2b/d3f/d68/d81/f90 0 2024-04-06T12:24:01.606 INFO:tasks.workunit.client.0.smithi152.stdout:6/716: creat d7/d9/d26/fea x:0 0 0 2024-04-06T12:24:01.607 INFO:tasks.workunit.client.0.smithi152.stdout:9/476: dwrite d5/d6/d74/d17/d23/d2d/d4b/d5a/f6f [0,4194304] 0 2024-04-06T12:24:01.607 INFO:tasks.workunit.client.0.smithi152.stdout:6/717: stat d7/d9/d26 0 2024-04-06T12:24:01.608 INFO:tasks.workunit.client.0.smithi152.stdout:0/828: rename d4/de/d28/d18/d3b/d2e/d78/dc1 to d4/d107 0 2024-04-06T12:24:01.610 INFO:tasks.workunit.client.0.smithi152.stdout:0/829: write d4/de/d87/d94/ff6 [649490,57020] 0 2024-04-06T12:24:01.613 INFO:tasks.workunit.client.0.smithi152.stdout:5/618: mkdir d3/da/d15/d2b/dc4 0 2024-04-06T12:24:01.621 INFO:tasks.workunit.client.0.smithi152.stdout:6/718: creat d7/d19/d1b/d1f/d3d/dc2/ddd/feb x:0 0 0 2024-04-06T12:24:01.625 INFO:tasks.workunit.client.0.smithi152.stdout:4/749: truncate d7/d16/d22/dc7/dc8/fc6 1221224 0 2024-04-06T12:24:01.628 INFO:tasks.workunit.client.0.smithi152.stdout:9/477: dread d5/d39/d3f/d42/f5b [0,4194304] 0 2024-04-06T12:24:01.629 INFO:tasks.workunit.client.0.smithi152.stdout:5/619: creat d3/da/d15/d2b/d3f/d6d/db1/fc5 x:0 0 0 2024-04-06T12:24:01.633 INFO:tasks.workunit.client.0.smithi152.stdout:6/719: symlink d7/d19/lec 0 2024-04-06T12:24:01.636 INFO:tasks.workunit.client.0.smithi152.stdout:4/750: creat d7/d16/d22/d3f/db4/d60/dc4/fef x:0 0 0 2024-04-06T12:24:01.638 INFO:tasks.workunit.client.0.smithi152.stdout:5/620: mkdir d3/da/d15/d2b/d3f/d6d/dc6 0 2024-04-06T12:24:01.642 INFO:tasks.workunit.client.0.smithi152.stdout:6/720: creat d7/d19/d1b/d1f/d3d/fed x:0 0 0 2024-04-06T12:24:01.644 INFO:tasks.workunit.client.0.smithi152.stdout:4/751: dread - d7/d16/f83 zero size 2024-04-06T12:24:01.647 INFO:tasks.workunit.client.0.smithi152.stdout:9/478: creat d5/d6/d74/f97 x:0 0 0 2024-04-06T12:24:01.647 INFO:tasks.workunit.client.0.smithi152.stdout:9/479: chown d5/d39/f93 85097128 1 2024-04-06T12:24:01.648 INFO:tasks.workunit.client.0.smithi152.stdout:9/480: write d5/d6/f24 [1240282,95190] 0 2024-04-06T12:24:01.650 INFO:tasks.workunit.client.0.smithi152.stdout:6/721: write d7/d9/d73/fba [175527,123082] 0 2024-04-06T12:24:01.657 INFO:tasks.workunit.client.0.smithi152.stdout:6/722: creat d7/d19/dde/fee x:0 0 0 2024-04-06T12:24:01.660 INFO:tasks.workunit.client.0.smithi152.stdout:5/621: rmdir d3/da/d15/d2b/dc4 0 2024-04-06T12:24:01.662 INFO:tasks.workunit.client.0.smithi152.stdout:8/788: write d4/db/d56/dcb/d6e/d88/fe3 [4067364,8840] 0 2024-04-06T12:24:01.663 INFO:tasks.workunit.client.0.smithi152.stdout:5/622: creat d3/d9/fc7 x:0 0 0 2024-04-06T12:24:01.666 INFO:tasks.workunit.client.0.smithi152.stdout:5/623: fdatasync d3/f1f 0 2024-04-06T12:24:01.669 INFO:tasks.workunit.client.0.smithi152.stdout:8/789: creat d4/d2c/df9/f10f x:0 0 0 2024-04-06T12:24:01.670 INFO:tasks.workunit.client.0.smithi152.stdout:6/723: dread d7/d19/d1b/d1f/d3d/fc0 [0,4194304] 0 2024-04-06T12:24:01.673 INFO:tasks.workunit.client.0.smithi152.stdout:8/790: mknod d4/dc/d10/d49/da0/dc0/c110 0 2024-04-06T12:24:01.675 INFO:tasks.workunit.client.0.smithi152.stdout:5/624: getdents d3/da/d15/d2b/d3f/d68 0 2024-04-06T12:24:01.675 INFO:tasks.workunit.client.0.smithi152.stdout:7/602: sync 2024-04-06T12:24:01.680 INFO:tasks.workunit.client.0.smithi152.stdout:2/632: write d0/d40/d26/f83 [1421690,106486] 0 2024-04-06T12:24:01.681 INFO:tasks.workunit.client.0.smithi152.stdout:5/625: creat d3/de/d80/d98/fc8 x:0 0 0 2024-04-06T12:24:01.682 INFO:tasks.workunit.client.0.smithi152.stdout:5/626: chown d3/da/d15/d2b/d3f/d6d/c91 487975 1 2024-04-06T12:24:01.683 INFO:tasks.workunit.client.0.smithi152.stdout:5/627: truncate d3/da/d15/d2b/d3f/d68/d81/f9e 474574 0 2024-04-06T12:24:01.803 INFO:tasks.workunit.client.0.smithi152.stdout:2/633: symlink d0/d2/d6f/ld3 0 2024-04-06T12:24:01.805 INFO:tasks.workunit.client.0.smithi152.stdout:5/628: mknod d3/de/d80/d8f/cc9 0 2024-04-06T12:24:01.834 INFO:tasks.workunit.client.0.smithi152.stdout:5/629: creat d3/da/d15/d40/d50/d99/fca x:0 0 0 2024-04-06T12:24:01.837 INFO:tasks.workunit.client.0.smithi152.stdout:5/630: creat d3/da/d15/d2b/d4d/fcb x:0 0 0 2024-04-06T12:24:01.844 INFO:tasks.workunit.client.0.smithi152.stdout:5/631: mknod d3/da/d15/d2b/d3f/d4c/ccc 0 2024-04-06T12:24:01.853 INFO:tasks.workunit.client.0.smithi152.stdout:5/632: mkdir d3/da/d15/d2b/d3f/db9/dcd 0 2024-04-06T12:24:01.857 INFO:tasks.workunit.client.0.smithi152.stdout:9/481: dwrite d5/d6/d74/d17/d37/f61 [4194304,4194304] 0 2024-04-06T12:24:01.857 INFO:tasks.workunit.client.0.smithi152.stdout:9/482: chown d5/d6/f95 3077 1 2024-04-06T12:24:01.865 INFO:tasks.workunit.client.0.smithi152.stdout:5/633: symlink d3/da/d15/d2b/lce 0 2024-04-06T12:24:01.867 INFO:tasks.workunit.client.0.smithi152.stdout:1/549: sync 2024-04-06T12:24:01.873 INFO:tasks.workunit.client.0.smithi152.stdout:9/483: mkdir d5/d6/d74/d17/d23/d2d/d98 0 2024-04-06T12:24:01.874 INFO:tasks.workunit.client.0.smithi152.stdout:1/550: symlink d2/d61/lc7 0 2024-04-06T12:24:01.874 INFO:tasks.workunit.client.0.smithi152.stdout:1/551: stat d2/d61/la0 0 2024-04-06T12:24:01.881 INFO:tasks.workunit.client.0.smithi152.stdout:1/552: write d2/d1d/d3b/dc3/d9f/fb8 [968974,55448] 0 2024-04-06T12:24:01.883 INFO:tasks.workunit.client.0.smithi152.stdout:9/484: dread - d5/d6/d74/d17/d23/d2d/d32/d36/f82 zero size 2024-04-06T12:24:01.885 INFO:tasks.workunit.client.0.smithi152.stdout:8/791: dwrite d4/fbb [0,4194304] 0 2024-04-06T12:24:01.886 INFO:tasks.workunit.client.0.smithi152.stdout:7/603: write d8/df/d61/d3d/d53/f78 [992390,27046] 0 2024-04-06T12:24:01.886 INFO:tasks.workunit.client.0.smithi152.stdout:5/634: creat d3/de/fcf x:0 0 0 2024-04-06T12:24:01.902 INFO:tasks.workunit.client.0.smithi152.stdout:1/553: rename d2/d2f/d37/f4f to d2/d2f/daf/fc8 0 2024-04-06T12:24:01.906 INFO:tasks.workunit.client.0.smithi152.stdout:7/604: dwrite d8/d74/f97 [0,4194304] 0 2024-04-06T12:24:01.910 INFO:tasks.workunit.client.0.smithi152.stdout:7/605: stat d8/df/d28/f4d 0 2024-04-06T12:24:01.911 INFO:tasks.workunit.client.0.smithi152.stdout:9/485: mkdir d5/d6/d74/d17/d23/d2d/d98/d99 0 2024-04-06T12:24:01.911 INFO:tasks.workunit.client.0.smithi152.stdout:5/635: dread d3/d9/f27 [0,4194304] 0 2024-04-06T12:24:01.913 INFO:tasks.workunit.client.0.smithi152.stdout:1/554: mknod d2/d2f/d54/d88/d9c/dc5/dad/d8c/cc9 0 2024-04-06T12:24:01.915 INFO:tasks.workunit.client.0.smithi152.stdout:9/486: rmdir d5/d6/d74/d17 39 2024-04-06T12:24:01.922 INFO:tasks.workunit.client.0.smithi152.stdout:1/555: mknod d2/d2f/d37/dae/cca 0 2024-04-06T12:24:01.923 INFO:tasks.workunit.client.0.smithi152.stdout:1/556: write d2/d61/f6c [783212,75747] 0 2024-04-06T12:24:01.925 INFO:tasks.workunit.client.0.smithi152.stdout:9/487: rmdir d5/d39/d3f 39 2024-04-06T12:24:01.929 INFO:tasks.workunit.client.0.smithi152.stdout:7/606: creat d8/fc3 x:0 0 0 2024-04-06T12:24:01.934 INFO:tasks.workunit.client.0.smithi152.stdout:7/607: dwrite d8/d2a/d42/f57 [0,4194304] 0 2024-04-06T12:24:01.937 INFO:tasks.workunit.client.0.smithi152.stdout:1/557: getdents d2/d2f/d54/d88/d9c/db3 0 2024-04-06T12:24:01.943 INFO:tasks.workunit.client.0.smithi152.stdout:7/608: mknod d8/df/d61/d3d/d6e/cc4 0 2024-04-06T12:24:01.956 INFO:tasks.workunit.client.0.smithi152.stdout:1/558: dread d2/d2f/d45/f77 [0,4194304] 0 2024-04-06T12:24:01.957 INFO:tasks.workunit.client.0.smithi152.stdout:2/634: write d0/d15/d24/d3d/f86 [310925,74918] 0 2024-04-06T12:24:01.958 INFO:tasks.workunit.client.0.smithi152.stdout:1/559: symlink d2/db2/lcb 0 2024-04-06T12:24:01.961 INFO:tasks.workunit.client.0.smithi152.stdout:1/560: creat d2/d2f/d37/fcc x:0 0 0 2024-04-06T12:24:01.965 INFO:tasks.workunit.client.0.smithi152.stdout:1/561: rename d2/d2f/d54/d88/d9c/dc5/dad/l38 to d2/d61/d8f/lcd 0 2024-04-06T12:24:01.966 INFO:tasks.workunit.client.0.smithi152.stdout:1/562: fdatasync d2/d2f/d54/d88/d9c/dc5/dad/f30 0 2024-04-06T12:24:01.968 INFO:tasks.workunit.client.0.smithi152.stdout:1/563: symlink d2/d2f/d54/d88/d9c/db3/lce 0 2024-04-06T12:24:01.970 INFO:tasks.workunit.client.0.smithi152.stdout:1/564: creat d2/d2f/d54/d88/d9c/dc5/dad/fcf x:0 0 0 2024-04-06T12:24:01.971 INFO:tasks.workunit.client.0.smithi152.stdout:1/565: read d2/d2f/d45/f77 [2307666,76136] 0 2024-04-06T12:24:01.971 INFO:tasks.workunit.client.0.smithi152.stdout:1/566: stat d2/d5d/l7b 0 2024-04-06T12:24:01.972 INFO:tasks.workunit.client.0.smithi152.stdout:1/567: readlink d2/d2f/l5e 0 2024-04-06T12:24:01.974 INFO:tasks.workunit.client.0.smithi152.stdout:1/568: mkdir d2/d2f/d54/d88/d9c/dc5/dd0 0 2024-04-06T12:24:01.981 INFO:tasks.workunit.client.0.smithi152.stdout:5/636: dwrite d3/da/d15/d40/d50/f7e [0,4194304] 0 2024-04-06T12:24:01.982 INFO:tasks.workunit.client.0.smithi152.stdout:1/569: dwrite d2/f10 [4194304,4194304] 0 2024-04-06T12:24:01.987 INFO:tasks.workunit.client.0.smithi152.stdout:7/609: truncate d8/df/f5e 796017 0 2024-04-06T12:24:01.990 INFO:tasks.workunit.client.0.smithi152.stdout:1/570: truncate d2/d2f/d45/f77 2289152 0 2024-04-06T12:24:01.991 INFO:tasks.workunit.client.0.smithi152.stdout:5/637: mknod d3/da/d15/d40/cd0 0 2024-04-06T12:24:01.994 INFO:tasks.workunit.client.0.smithi152.stdout:7/610: dread d8/df/d61/fa6 [0,4194304] 0 2024-04-06T12:24:01.997 INFO:tasks.workunit.client.0.smithi152.stdout:2/635: write d0/d2/d6f/d90/d9e/db5/f42 [4707,13208] 0 2024-04-06T12:24:02.001 INFO:tasks.workunit.client.0.smithi152.stdout:7/611: mknod d8/d2a/d37/d8c/d2d/da3/dbb/cc5 0 2024-04-06T12:24:02.005 INFO:tasks.workunit.client.0.smithi152.stdout:2/636: creat d0/d15/d24/d3d/fd4 x:0 0 0 2024-04-06T12:24:02.007 INFO:tasks.workunit.client.0.smithi152.stdout:2/637: dread - d0/d40/d41/d28/d54/f7c zero size 2024-04-06T12:24:02.008 INFO:tasks.workunit.client.0.smithi152.stdout:2/638: chown d0/d15/d24/d79/l99 1 1 2024-04-06T12:24:02.010 INFO:tasks.workunit.client.0.smithi152.stdout:1/571: creat d2/d2f/d54/d88/fd1 x:0 0 0 2024-04-06T12:24:02.011 INFO:tasks.workunit.client.0.smithi152.stdout:5/638: write d3/f5a [1524784,28565] 0 2024-04-06T12:24:02.011 INFO:tasks.workunit.client.0.smithi152.stdout:2/639: rmdir d0/dc9 39 2024-04-06T12:24:02.014 INFO:tasks.workunit.client.0.smithi152.stdout:7/612: creat d8/df/d61/d76/fc6 x:0 0 0 2024-04-06T12:24:02.016 INFO:tasks.workunit.client.0.smithi152.stdout:1/572: dread - d2/d2f/d54/d88/d9c/dc5/dad/f6f zero size 2024-04-06T12:24:02.021 INFO:tasks.workunit.client.0.smithi152.stdout:7/613: dwrite d8/d74/f97 [8388608,4194304] 0 2024-04-06T12:24:02.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/640: creat d0/dae/fd5 x:0 0 0 2024-04-06T12:24:02.029 INFO:tasks.workunit.client.0.smithi152.stdout:7/614: creat d8/df/d28/fc7 x:0 0 0 2024-04-06T12:24:02.030 INFO:tasks.workunit.client.0.smithi152.stdout:7/615: fsync d8/d2a/d37/d8c/d2d/da3/dbb/fc2 0 2024-04-06T12:24:02.030 INFO:tasks.workunit.client.0.smithi152.stdout:1/573: write d2/f50 [573672,38598] 0 2024-04-06T12:24:02.031 INFO:tasks.workunit.client.0.smithi152.stdout:1/574: stat d2/d61/f73 0 2024-04-06T12:24:02.033 INFO:tasks.workunit.client.0.smithi152.stdout:1/575: rmdir d2 39 2024-04-06T12:24:02.033 INFO:tasks.workunit.client.0.smithi152.stdout:2/641: write d0/d15/d4d/f4e [2407033,98433] 0 2024-04-06T12:24:02.038 INFO:tasks.workunit.client.0.smithi152.stdout:7/616: dread d8/d2a/d42/f7f [0,4194304] 0 2024-04-06T12:24:02.038 INFO:tasks.workunit.client.0.smithi152.stdout:1/576: fdatasync d2/d2f/d54/d88/d9c/dc5/f87 0 2024-04-06T12:24:02.039 INFO:tasks.workunit.client.0.smithi152.stdout:1/577: chown d2/l1c 83080896 1 2024-04-06T12:24:02.040 INFO:tasks.workunit.client.0.smithi152.stdout:7/617: truncate d8/df/d34/f88 400895 0 2024-04-06T12:24:02.046 INFO:tasks.workunit.client.0.smithi152.stdout:7/618: truncate d8/df/f25 2887000 0 2024-04-06T12:24:02.047 INFO:tasks.workunit.client.0.smithi152.stdout:1/578: dread d2/d1d/d3b/f56 [0,4194304] 0 2024-04-06T12:24:02.048 INFO:tasks.workunit.client.0.smithi152.stdout:2/642: creat d0/d2/d6f/d90/d9e/db5/d92/fd6 x:0 0 0 2024-04-06T12:24:02.048 INFO:tasks.workunit.client.0.smithi152.stdout:1/579: chown d2/d2f/d54/d88/d9c/db3/lce 118911909 1 2024-04-06T12:24:02.078 INFO:tasks.workunit.client.0.smithi152.stdout:3/673: sync 2024-04-06T12:24:02.080 INFO:tasks.workunit.client.0.smithi152.stdout:7/619: unlink d8/d2a/d37/d49/d7b/l9a 0 2024-04-06T12:24:02.081 INFO:tasks.workunit.client.0.smithi152.stdout:7/620: dread - d8/fc3 zero size 2024-04-06T12:24:02.083 INFO:tasks.workunit.client.0.smithi152.stdout:2/643: creat d0/d40/d26/db4/fd7 x:0 0 0 2024-04-06T12:24:02.084 INFO:tasks.workunit.client.0.smithi152.stdout:7/621: creat d8/d2a/d37/d8c/d2d/da3/fc8 x:0 0 0 2024-04-06T12:24:02.090 INFO:tasks.workunit.client.0.smithi152.stdout:3/674: creat d0/d10/d13/d2a/d93/d3d/fcf x:0 0 0 2024-04-06T12:24:02.097 INFO:tasks.workunit.client.0.smithi152.stdout:7/622: dread d8/df/d34/d63/f92 [0,4194304] 0 2024-04-06T12:24:02.104 INFO:tasks.workunit.client.0.smithi152.stdout:7/623: write d8/df/d61/fa6 [1530742,63598] 0 2024-04-06T12:24:02.105 INFO:tasks.workunit.client.0.smithi152.stdout:7/624: chown d8/df/d34/d5c/f68 262868303 1 2024-04-06T12:24:02.109 INFO:tasks.workunit.client.0.smithi152.stdout:7/625: mkdir d8/d2a/d37/d43/d8a/d9d/dc9 0 2024-04-06T12:24:02.114 INFO:tasks.workunit.client.0.smithi152.stdout:2/644: dwrite d0/d2/f2c [0,4194304] 0 2024-04-06T12:24:02.118 INFO:tasks.workunit.client.0.smithi152.stdout:7/626: dread d8/d2a/d37/d8c/d2d/f32 [0,4194304] 0 2024-04-06T12:24:02.119 INFO:tasks.workunit.client.0.smithi152.stdout:3/675: dwrite d0/d1f/f23 [0,4194304] 0 2024-04-06T12:24:02.129 INFO:tasks.workunit.client.0.smithi152.stdout:7/627: creat d8/d2a/d37/d8c/d2d/d7a/fca x:0 0 0 2024-04-06T12:24:02.133 INFO:tasks.workunit.client.0.smithi152.stdout:7/628: mknod d8/d2a/d37/d49/ccb 0 2024-04-06T12:24:02.135 INFO:tasks.workunit.client.0.smithi152.stdout:3/676: mknod d0/d10/d1e/d87/da8/cd0 0 2024-04-06T12:24:02.135 INFO:tasks.workunit.client.0.smithi152.stdout:2/645: dread d0/d2/d6f/fc8 [0,4194304] 0 2024-04-06T12:24:02.137 INFO:tasks.workunit.client.0.smithi152.stdout:2/646: read d0/d2/f14 [619034,98062] 0 2024-04-06T12:24:02.143 INFO:tasks.workunit.client.0.smithi152.stdout:2/647: unlink d0/d15/d24/d3d/f86 0 2024-04-06T12:24:02.145 INFO:tasks.workunit.client.0.smithi152.stdout:7/629: creat d8/d2a/d37/d8c/d66/fcc x:0 0 0 2024-04-06T12:24:02.147 INFO:tasks.workunit.client.0.smithi152.stdout:2/648: read - d0/d40/d26/f8f zero size 2024-04-06T12:24:02.147 INFO:tasks.workunit.client.0.smithi152.stdout:3/677: getdents d0/d10/d1e/d71 0 2024-04-06T12:24:02.150 INFO:tasks.workunit.client.0.smithi152.stdout:3/678: write d0/d1f/d28/f76 [3729556,41067] 0 2024-04-06T12:24:02.150 INFO:tasks.workunit.client.0.smithi152.stdout:2/649: getdents d0/d15/d24/d79/dcd 0 2024-04-06T12:24:02.152 INFO:tasks.workunit.client.0.smithi152.stdout:3/679: dread - d0/d1f/d4a/f98 zero size 2024-04-06T12:24:02.156 INFO:tasks.workunit.client.0.smithi152.stdout:3/680: creat d0/d2d/d7f/fd1 x:0 0 0 2024-04-06T12:24:02.158 INFO:tasks.workunit.client.0.smithi152.stdout:2/650: rename d0/d15/d24/d3d/l94 to d0/d40/d41/ld8 0 2024-04-06T12:24:02.166 INFO:tasks.workunit.client.0.smithi152.stdout:3/681: link d0/d35/f88 d0/d35/d43/d48/fd2 0 2024-04-06T12:24:02.170 INFO:tasks.workunit.client.0.smithi152.stdout:3/682: mkdir d0/d1f/d4a/dd3 0 2024-04-06T12:24:02.171 INFO:tasks.workunit.client.0.smithi152.stdout:2/651: write d0/d15/d24/f72 [372990,11366] 0 2024-04-06T12:24:02.172 INFO:tasks.workunit.client.0.smithi152.stdout:7/630: dwrite d8/d2a/d42/f6b [0,4194304] 0 2024-04-06T12:24:02.184 INFO:tasks.workunit.client.0.smithi152.stdout:3/683: symlink d0/d10/d1e/d71/db2/dbb/ld4 0 2024-04-06T12:24:02.186 INFO:tasks.workunit.client.0.smithi152.stdout:2/652: rename d0/d2/d6f/d90/d9e/db5/d92/la2 to d0/d15/d4d/ld9 0 2024-04-06T12:24:02.189 INFO:tasks.workunit.client.0.smithi152.stdout:3/684: creat d0/d35/d43/d48/d83/d9d/fd5 x:0 0 0 2024-04-06T12:24:02.193 INFO:tasks.workunit.client.0.smithi152.stdout:7/631: getdents d8/d2a 0 2024-04-06T12:24:02.195 INFO:tasks.workunit.client.0.smithi152.stdout:3/685: dread d0/d10/d13/f6f [0,4194304] 0 2024-04-06T12:24:02.196 INFO:tasks.workunit.client.0.smithi152.stdout:2/653: creat d0/d15/d24/fda x:0 0 0 2024-04-06T12:24:02.196 INFO:tasks.workunit.client.0.smithi152.stdout:3/686: chown d0/d10/d13/d2a/d93/f5f 5 1 2024-04-06T12:24:02.199 INFO:tasks.workunit.client.0.smithi152.stdout:2/654: fsync d0/d2/d6f/d90/f8b 0 2024-04-06T12:24:02.200 INFO:tasks.workunit.client.0.smithi152.stdout:3/687: creat d0/d10/fd6 x:0 0 0 2024-04-06T12:24:02.205 INFO:tasks.workunit.client.0.smithi152.stdout:2/655: symlink d0/d40/d26/ldb 0 2024-04-06T12:24:02.208 INFO:tasks.workunit.client.0.smithi152.stdout:2/656: write d0/dae/fd5 [944926,30164] 0 2024-04-06T12:24:02.209 INFO:tasks.workunit.client.0.smithi152.stdout:7/632: mkdir d8/df/d61/d4b/dcd 0 2024-04-06T12:24:02.209 INFO:tasks.workunit.client.0.smithi152.stdout:3/688: dwrite d0/d2d/d7f/fd1 [0,4194304] 0 2024-04-06T12:24:02.213 INFO:tasks.workunit.client.0.smithi152.stdout:7/633: stat d8/df/d28/d41/d48/l9f 0 2024-04-06T12:24:02.214 INFO:tasks.workunit.client.0.smithi152.stdout:3/689: write d0/d35/f82 [955859,28707] 0 2024-04-06T12:24:02.215 INFO:tasks.workunit.client.0.smithi152.stdout:2/657: read - d0/d40/d26/db4/fd7 zero size 2024-04-06T12:24:02.217 INFO:tasks.workunit.client.0.smithi152.stdout:7/634: symlink d8/df/d28/d41/d48/lce 0 2024-04-06T12:24:02.218 INFO:tasks.workunit.client.0.smithi152.stdout:2/658: creat d0/d40/d26/fdc x:0 0 0 2024-04-06T12:24:02.226 INFO:tasks.workunit.client.0.smithi152.stdout:2/659: getdents d0/d15/d24/d3d 0 2024-04-06T12:24:02.227 INFO:tasks.workunit.client.0.smithi152.stdout:2/660: dread - d0/d15/d24/d79/d80/dce/fcf zero size 2024-04-06T12:24:02.228 INFO:tasks.workunit.client.0.smithi152.stdout:7/635: truncate d8/f6f 1876945 0 2024-04-06T12:24:02.230 INFO:tasks.workunit.client.0.smithi152.stdout:2/661: symlink d0/d15/d4d/ldd 0 2024-04-06T12:24:02.236 INFO:tasks.workunit.client.0.smithi152.stdout:7/636: dwrite d8/d2a/d37/d79/fba [0,4194304] 0 2024-04-06T12:24:02.238 INFO:tasks.workunit.client.0.smithi152.stdout:7/637: read d8/d2a/d37/d8c/d2d/f32 [208546,28935] 0 2024-04-06T12:24:02.239 INFO:tasks.workunit.client.0.smithi152.stdout:2/662: rename d0/d2/d6f/d90/d9e/db5/d92/c9b to d0/d2/d6f/d90/d9e/db5/d3a/d87/cde 0 2024-04-06T12:24:02.242 INFO:tasks.workunit.client.0.smithi152.stdout:7/638: chown d8/df/d28/l2b 7778009 1 2024-04-06T12:24:02.251 INFO:tasks.workunit.client.0.smithi152.stdout:7/639: dwrite d8/df/d34/f88 [0,4194304] 0 2024-04-06T12:24:02.252 INFO:tasks.workunit.client.0.smithi152.stdout:2/663: dwrite d0/d2/d6f/fbb [0,4194304] 0 2024-04-06T12:24:02.254 INFO:tasks.workunit.client.0.smithi152.stdout:7/640: readlink d8/d2a/d37/l9e 0 2024-04-06T12:24:02.258 INFO:tasks.workunit.client.0.smithi152.stdout:2/664: unlink d0/d2/lb 0 2024-04-06T12:24:02.261 INFO:tasks.workunit.client.0.smithi152.stdout:7/641: mknod d8/df/d61/d76/ccf 0 2024-04-06T12:24:02.266 INFO:tasks.workunit.client.0.smithi152.stdout:7/642: rename d8/d74 to d8/d2a/d37/d43/d8a/d9d/dc9/dd0 0 2024-04-06T12:24:02.272 INFO:tasks.workunit.client.0.smithi152.stdout:7/643: dwrite d8/d2a/d42/f6b [0,4194304] 0 2024-04-06T12:24:02.284 INFO:tasks.workunit.client.0.smithi152.stdout:7/644: dwrite d8/d2a/d42/f7f [0,4194304] 0 2024-04-06T12:24:02.286 INFO:tasks.workunit.client.0.smithi152.stdout:2/665: dread d0/d15/d4d/f52 [0,4194304] 0 2024-04-06T12:24:02.294 INFO:tasks.workunit.client.0.smithi152.stdout:7/645: fdatasync d8/d2a/d42/f6b 0 2024-04-06T12:24:02.294 INFO:tasks.workunit.client.0.smithi152.stdout:2/666: dwrite d0/d40/d41/d28/d8c/fc0 [0,4194304] 0 2024-04-06T12:24:02.297 INFO:tasks.workunit.client.0.smithi152.stdout:2/667: write d0/d40/d26/db4/fd7 [579289,122975] 0 2024-04-06T12:24:02.302 INFO:tasks.workunit.client.0.smithi152.stdout:7/646: getdents d8/df/d61/d4b/dcd 0 2024-04-06T12:24:02.305 INFO:tasks.workunit.client.0.smithi152.stdout:2/668: dwrite d0/d40/d41/d28/fbe [0,4194304] 0 2024-04-06T12:24:02.311 INFO:tasks.workunit.client.0.smithi152.stdout:2/669: creat d0/d15/d24/d79/d80/dce/fdf x:0 0 0 2024-04-06T12:24:02.312 INFO:tasks.workunit.client.0.smithi152.stdout:7/647: creat d8/df/d61/d3d/fd1 x:0 0 0 2024-04-06T12:24:02.314 INFO:tasks.workunit.client.0.smithi152.stdout:2/670: symlink d0/d40/d26/le0 0 2024-04-06T12:24:02.315 INFO:tasks.workunit.client.0.smithi152.stdout:2/671: chown d0/d40/d41/d28/l5e 153141453 1 2024-04-06T12:24:02.316 INFO:tasks.workunit.client.0.smithi152.stdout:2/672: write d0/d40/d26/f83 [1172622,81139] 0 2024-04-06T12:24:02.333 INFO:tasks.workunit.client.0.smithi152.stdout:7/648: dwrite d8/d2a/d37/d49/d7b/f8b [0,4194304] 0 2024-04-06T12:24:02.336 INFO:tasks.workunit.client.0.smithi152.stdout:2/673: dwrite d0/d2/d6f/d90/d9e/db5/f1f [0,4194304] 0 2024-04-06T12:24:02.338 INFO:tasks.workunit.client.0.smithi152.stdout:2/674: write d0/d15/d4d/db2/fac [2232647,18190] 0 2024-04-06T12:24:02.352 INFO:tasks.workunit.client.0.smithi152.stdout:7/649: dwrite d8/d2a/d37/d8c/d2d/f32 [0,4194304] 0 2024-04-06T12:24:02.352 INFO:tasks.workunit.client.0.smithi152.stdout:2/675: dwrite d0/d40/d41/d63/fc1 [0,4194304] 0 2024-04-06T12:24:02.361 INFO:tasks.workunit.client.0.smithi152.stdout:2/676: fsync d0/d40/f62 0 2024-04-06T12:24:02.361 INFO:tasks.workunit.client.0.smithi152.stdout:7/650: creat d8/df/d28/d41/d48/fd2 x:0 0 0 2024-04-06T12:24:02.365 INFO:tasks.workunit.client.0.smithi152.stdout:7/651: truncate d8/d2a/d37/d79/d81/f95 4203382 0 2024-04-06T12:24:02.367 INFO:tasks.workunit.client.0.smithi152.stdout:2/677: dread d0/d40/d41/d63/fc1 [0,4194304] 0 2024-04-06T12:24:02.371 INFO:tasks.workunit.client.0.smithi152.stdout:2/678: mknod d0/d2/d6f/d90/d9e/db5/d92/ce1 0 2024-04-06T12:24:02.373 INFO:tasks.workunit.client.0.smithi152.stdout:7/652: dwrite d8/d2a/d37/d8c/d2d/da3/fc8 [0,4194304] 0 2024-04-06T12:24:02.376 INFO:tasks.workunit.client.0.smithi152.stdout:7/653: dread d8/df/d34/d5c/f68 [0,4194304] 0 2024-04-06T12:24:02.379 INFO:tasks.workunit.client.0.smithi152.stdout:7/654: chown d8/df/d28/d41/fa4 1742 1 2024-04-06T12:24:02.380 INFO:tasks.workunit.client.0.smithi152.stdout:2/679: dwrite d0/d15/d24/f72 [0,4194304] 0 2024-04-06T12:24:02.382 INFO:tasks.workunit.client.0.smithi152.stdout:2/680: readlink d0/d2/d6f/d90/d9e/db5/d3a/d87/l89 0 2024-04-06T12:24:02.388 INFO:tasks.workunit.client.0.smithi152.stdout:7/655: dwrite d8/d2a/d37/d8c/d2d/d7a/f99 [0,4194304] 0 2024-04-06T12:24:02.388 INFO:tasks.workunit.client.0.smithi152.stdout:2/681: rename d0/d15/d24/f6b to d0/d2/d6f/d90/d9e/db5/d92/fe2 0 2024-04-06T12:24:02.390 INFO:tasks.workunit.client.0.smithi152.stdout:0/830: sync 2024-04-06T12:24:02.390 INFO:tasks.workunit.client.0.smithi152.stdout:4/752: sync 2024-04-06T12:24:02.391 INFO:tasks.workunit.client.0.smithi152.stdout:0/831: dread - d4/d19/fe0 zero size 2024-04-06T12:24:02.395 INFO:tasks.workunit.client.0.smithi152.stdout:7/656: read d8/d2a/d37/d49/f80 [4053660,52853] 0 2024-04-06T12:24:02.397 INFO:tasks.workunit.client.0.smithi152.stdout:0/832: chown d4/d19/dbd/cf5 974166474 1 2024-04-06T12:24:02.398 INFO:tasks.workunit.client.0.smithi152.stdout:7/657: write d8/df/d61/d3d/d53/f78 [1419959,32158] 0 2024-04-06T12:24:02.403 INFO:tasks.workunit.client.0.smithi152.stdout:2/682: getdents d0/d15/d24/d79/d80/dce 0 2024-04-06T12:24:02.407 INFO:tasks.workunit.client.0.smithi152.stdout:0/833: dwrite d4/d31/d47/d7e/db9/dcc/dd5/ff3 [4194304,4194304] 0 2024-04-06T12:24:02.411 INFO:tasks.workunit.client.0.smithi152.stdout:2/683: rename d0/d15/d4d to d0/d15/d24/d3d/de3 0 2024-04-06T12:24:02.412 INFO:tasks.workunit.client.0.smithi152.stdout:7/658: link d8/d2a/d37/d43/cbd d8/d2a/d37/d8c/d2d/da3/dbb/cd3 0 2024-04-06T12:24:02.412 INFO:tasks.workunit.client.0.smithi152.stdout:7/659: chown d8/df/c15 15647710 1 2024-04-06T12:24:02.413 INFO:tasks.workunit.client.0.smithi152.stdout:2/684: truncate d0/d40/d26/db4/fd7 1403810 0 2024-04-06T12:24:02.417 INFO:tasks.workunit.client.0.smithi152.stdout:0/834: truncate d4/de/d28/d18/d3b/f2f 1110793 0 2024-04-06T12:24:02.421 INFO:tasks.workunit.client.0.smithi152.stdout:2/685: dwrite d0/d2/fb3 [0,4194304] 0 2024-04-06T12:24:02.426 INFO:tasks.workunit.client.0.smithi152.stdout:7/660: rename d8/d2a/d37 to d8/df/d28/d41/dd4 0 2024-04-06T12:24:02.432 INFO:tasks.workunit.client.0.smithi152.stdout:7/661: creat d8/df/d28/d41/dd4/d8c/d2d/fd5 x:0 0 0 2024-04-06T12:24:02.436 INFO:tasks.workunit.client.0.smithi152.stdout:2/686: rename d0/d40/d41/f75 to d0/d15/d24/fe4 0 2024-04-06T12:24:02.442 INFO:tasks.workunit.client.0.smithi152.stdout:7/662: link d8/df/d61/d3d/l35 d8/df/d28/d41/dd4/d43/d8a/d9d/ld6 0 2024-04-06T12:24:02.443 INFO:tasks.workunit.client.0.smithi152.stdout:2/687: dwrite d0/d15/d24/d79/d80/fa0 [0,4194304] 0 2024-04-06T12:24:02.444 INFO:tasks.workunit.client.0.smithi152.stdout:2/688: dread - d0/d15/d24/d3d/fd4 zero size 2024-04-06T12:24:02.615 INFO:tasks.workunit.client.0.smithi152.stdout:2/689: link d0/d2/d6f/d90/d9e/db5/c66 d0/d40/ce5 0 2024-04-06T12:24:02.640 INFO:tasks.workunit.client.0.smithi152.stdout:7/663: dwrite d8/df/d28/f4d [0,4194304] 0 2024-04-06T12:24:02.640 INFO:tasks.workunit.client.0.smithi152.stdout:7/664: dread d8/f1b [0,4194304] 0 2024-04-06T12:24:02.640 INFO:tasks.workunit.client.0.smithi152.stdout:2/690: dwrite d0/d40/d26/f2b [0,4194304] 0 2024-04-06T12:24:02.829 INFO:tasks.workunit.client.0.smithi152.stdout:8/792: sync 2024-04-06T12:24:02.830 INFO:tasks.workunit.client.0.smithi152.stdout:5/639: sync 2024-04-06T12:24:02.830 INFO:tasks.workunit.client.0.smithi152.stdout:9/488: sync 2024-04-06T12:24:02.830 INFO:tasks.workunit.client.0.smithi152.stdout:6/724: sync 2024-04-06T12:24:02.844 INFO:tasks.workunit.client.0.smithi152.stdout:5/640: rename d3/de/d80/d98 to d3/da/d15/d2b/d3f/d6d/dd1 0 2024-04-06T12:24:02.850 INFO:tasks.workunit.client.0.smithi152.stdout:6/725: dread d7/d62/f63 [0,4194304] 0 2024-04-06T12:24:02.857 INFO:tasks.workunit.client.0.smithi152.stdout:2/691: sync 2024-04-06T12:24:02.857 INFO:tasks.workunit.client.0.smithi152.stdout:3/690: sync 2024-04-06T12:24:02.857 INFO:tasks.workunit.client.0.smithi152.stdout:4/753: sync 2024-04-06T12:24:02.857 INFO:tasks.workunit.client.0.smithi152.stdout:0/835: sync 2024-04-06T12:24:02.857 INFO:tasks.workunit.client.0.smithi152.stdout:1/580: sync 2024-04-06T12:24:02.857 INFO:tasks.workunit.client.0.smithi152.stdout:7/665: sync 2024-04-06T12:24:02.859 INFO:tasks.workunit.client.0.smithi152.stdout:0/836: stat d4/d31/fe1 0 2024-04-06T12:24:02.860 INFO:tasks.workunit.client.0.smithi152.stdout:6/726: creat d7/d19/d1b/d1f/d3d/fef x:0 0 0 2024-04-06T12:24:02.863 INFO:tasks.workunit.client.0.smithi152.stdout:2/692: mkdir d0/d40/d26/db4/de6 0 2024-04-06T12:24:02.866 INFO:tasks.workunit.client.0.smithi152.stdout:2/693: write d0/d40/d26/f2a [2194540,41980] 0 2024-04-06T12:24:02.866 INFO:tasks.workunit.client.0.smithi152.stdout:9/489: link d5/d6/d74/d17/d23/d2d/d32/c33 d5/d6/d74/d17/d23/d2d/d98/c9a 0 2024-04-06T12:24:02.868 INFO:tasks.workunit.client.0.smithi152.stdout:4/754: creat d7/d82/db1/db6/ff0 x:0 0 0 2024-04-06T12:24:02.873 INFO:tasks.workunit.client.0.smithi152.stdout:1/581: dwrite d2/d1d/d7c/f9e [0,4194304] 0 2024-04-06T12:24:02.874 INFO:tasks.workunit.client.0.smithi152.stdout:5/641: dread d3/de/f5b [0,4194304] 0 2024-04-06T12:24:02.876 INFO:tasks.workunit.client.0.smithi152.stdout:0/837: mkdir d4/de/d87/d94/dd3/d108 0 2024-04-06T12:24:02.880 INFO:tasks.workunit.client.0.smithi152.stdout:9/490: mkdir d5/d39/d3f/d42/d9b 0 2024-04-06T12:24:02.881 INFO:tasks.workunit.client.0.smithi152.stdout:3/691: dread d0/d10/f68 [0,4194304] 0 2024-04-06T12:24:02.882 INFO:tasks.workunit.client.0.smithi152.stdout:8/793: dwrite d4/d2c/d2b/f44 [0,4194304] 0 2024-04-06T12:24:02.883 INFO:tasks.workunit.client.0.smithi152.stdout:3/692: chown d0/d1f/fc7 7 1 2024-04-06T12:24:02.888 INFO:tasks.workunit.client.0.smithi152.stdout:2/694: mkdir d0/d15/de7 0 2024-04-06T12:24:02.888 INFO:tasks.workunit.client.0.smithi152.stdout:6/727: getdents d7/d19/d3e/d70 0 2024-04-06T12:24:02.890 INFO:tasks.workunit.client.0.smithi152.stdout:4/755: symlink d7/d29/d2e/d5b/db2/dd7/lf1 0 2024-04-06T12:24:02.892 INFO:tasks.workunit.client.0.smithi152.stdout:2/695: write d0/d2/d6f/fbb [741820,9880] 0 2024-04-06T12:24:02.892 INFO:tasks.workunit.client.0.smithi152.stdout:1/582: fdatasync d2/d1d/d7c/f9e 0 2024-04-06T12:24:02.892 INFO:tasks.workunit.client.0.smithi152.stdout:1/583: write d2/d61/f6c [25073,1087] 0 2024-04-06T12:24:02.897 INFO:tasks.workunit.client.0.smithi152.stdout:2/696: dread d0/d15/d24/f5b [0,4194304] 0 2024-04-06T12:24:02.898 INFO:tasks.workunit.client.0.smithi152.stdout:2/697: chown d0/d40/d26/db4/fd7 24428156 1 2024-04-06T12:24:02.899 INFO:tasks.workunit.client.0.smithi152.stdout:2/698: dread - d0/d15/d24/d79/d80/dce/fdf zero size 2024-04-06T12:24:02.900 INFO:tasks.workunit.client.0.smithi152.stdout:8/794: symlink d4/d2c/d2b/d83/l111 0 2024-04-06T12:24:02.900 INFO:tasks.workunit.client.0.smithi152.stdout:9/491: dread d5/fb [0,4194304] 0 2024-04-06T12:24:02.901 INFO:tasks.workunit.client.0.smithi152.stdout:3/693: creat d0/d10/d13/d2a/db6/fd7 x:0 0 0 2024-04-06T12:24:02.901 INFO:tasks.workunit.client.0.smithi152.stdout:2/699: read d0/d40/d26/db4/fd7 [667342,81108] 0 2024-04-06T12:24:02.914 INFO:tasks.workunit.client.0.smithi152.stdout:5/642: write d3/da/d15/d2b/d3f/d68/d81/f3b [2999901,83947] 0 2024-04-06T12:24:02.915 INFO:tasks.workunit.client.0.smithi152.stdout:8/795: mknod d4/db/d32/c112 0 2024-04-06T12:24:02.917 INFO:tasks.workunit.client.0.smithi152.stdout:1/584: write d2/d2f/d54/f57 [3225877,55676] 0 2024-04-06T12:24:02.919 INFO:tasks.workunit.client.0.smithi152.stdout:9/492: fsync d5/d6/f49 0 2024-04-06T12:24:02.924 INFO:tasks.workunit.client.0.smithi152.stdout:3/694: mknod d0/d10/d1e/d87/da8/cd8 0 2024-04-06T12:24:02.928 INFO:tasks.workunit.client.0.smithi152.stdout:4/756: mkdir d7/d29/df2 0 2024-04-06T12:24:02.929 INFO:tasks.workunit.client.0.smithi152.stdout:6/728: write d7/d19/d1b/fb4 [1415929,8561] 0 2024-04-06T12:24:02.932 INFO:tasks.workunit.client.0.smithi152.stdout:0/838: creat d4/de/d28/d18/d3b/d2e/f109 x:0 0 0 2024-04-06T12:24:02.934 INFO:tasks.workunit.client.0.smithi152.stdout:5/643: rmdir d3/de/d8e 39 2024-04-06T12:24:02.936 INFO:tasks.workunit.client.0.smithi152.stdout:8/796: unlink d4/dc/d10/d49/da0/dc0/d9d/dbe/f26 0 2024-04-06T12:24:02.937 INFO:tasks.workunit.client.0.smithi152.stdout:2/700: dwrite d0/d15/d24/f8e [4194304,4194304] 0 2024-04-06T12:24:02.937 INFO:tasks.workunit.client.0.smithi152.stdout:0/839: dread d4/de/d87/f6a [0,4194304] 0 2024-04-06T12:24:02.939 INFO:tasks.workunit.client.0.smithi152.stdout:0/840: dread - d4/de/d28/d18/d3b/d2e/f109 zero size 2024-04-06T12:24:02.940 INFO:tasks.workunit.client.0.smithi152.stdout:0/841: chown d4/de/d87/f105 14 1 2024-04-06T12:24:02.941 INFO:tasks.workunit.client.0.smithi152.stdout:1/585: rename d2/f12 to d2/d2f/d54/d88/d9c/fd2 0 2024-04-06T12:24:02.944 INFO:tasks.workunit.client.0.smithi152.stdout:1/586: read - d2/d2f/d54/f7f zero size 2024-04-06T12:24:02.948 INFO:tasks.workunit.client.0.smithi152.stdout:6/729: symlink d7/d19/d1b/d31/lf0 0 2024-04-06T12:24:02.948 INFO:tasks.workunit.client.0.smithi152.stdout:2/701: dwrite d0/d40/d26/fdc [0,4194304] 0 2024-04-06T12:24:02.948 INFO:tasks.workunit.client.0.smithi152.stdout:4/757: read d7/d29/d78/ded/f74 [291300,228] 0 2024-04-06T12:24:02.952 INFO:tasks.workunit.client.0.smithi152.stdout:1/587: truncate d2/d2f/d54/d88/d9c/dc5/dad/fcf 71282 0 2024-04-06T12:24:02.952 INFO:tasks.workunit.client.0.smithi152.stdout:4/758: write d7/d29/d78/ded/f6b [1150908,76274] 0 2024-04-06T12:24:02.958 INFO:tasks.workunit.client.0.smithi152.stdout:3/695: mkdir d0/d1f/d4a/dd3/dd9 0 2024-04-06T12:24:02.961 INFO:tasks.workunit.client.0.smithi152.stdout:9/493: dread d5/f1d [0,4194304] 0 2024-04-06T12:24:02.961 INFO:tasks.workunit.client.0.smithi152.stdout:0/842: truncate d4/de/d28/d18/d3b/d2e/d78/f79 2502348 0 2024-04-06T12:24:02.963 INFO:tasks.workunit.client.0.smithi152.stdout:0/843: read - d4/de/d28/d18/d43/d8a/ff8 zero size 2024-04-06T12:24:02.974 INFO:tasks.workunit.client.0.smithi152.stdout:1/588: fdatasync d2/f16 0 2024-04-06T12:24:02.976 INFO:tasks.workunit.client.0.smithi152.stdout:4/759: symlink d7/d82/db1/lf3 0 2024-04-06T12:24:02.978 INFO:tasks.workunit.client.0.smithi152.stdout:3/696: fsync d0/d10/d1e/d87/fa1 0 2024-04-06T12:24:02.981 INFO:tasks.workunit.client.0.smithi152.stdout:8/797: dwrite d4/db/d39/f50 [0,4194304] 0 2024-04-06T12:24:02.983 INFO:tasks.workunit.client.0.smithi152.stdout:2/702: symlink d0/d15/le8 0 2024-04-06T12:24:02.983 INFO:tasks.workunit.client.0.smithi152.stdout:2/703: stat d0/dae 0 2024-04-06T12:24:02.987 INFO:tasks.workunit.client.0.smithi152.stdout:5/644: creat d3/fd2 x:0 0 0 2024-04-06T12:24:02.987 INFO:tasks.workunit.client.0.smithi152.stdout:6/730: rename d7/l6b to d7/d9/d26/d4a/lf1 0 2024-04-06T12:24:02.990 INFO:tasks.workunit.client.0.smithi152.stdout:1/589: mkdir d2/d2f/d54/d88/d9c/db3/dd3 0 2024-04-06T12:24:02.992 INFO:tasks.workunit.client.0.smithi152.stdout:4/760: creat d7/d16/d55/ff4 x:0 0 0 2024-04-06T12:24:02.992 INFO:tasks.workunit.client.0.smithi152.stdout:4/761: readlink d7/d16/d22/dc7/dc8/ddd/le5 0 2024-04-06T12:24:02.994 INFO:tasks.workunit.client.0.smithi152.stdout:4/762: read d7/fb [734509,23382] 0 2024-04-06T12:24:02.999 INFO:tasks.workunit.client.0.smithi152.stdout:3/697: symlink d0/d10/d1e/d71/db2/lda 0 2024-04-06T12:24:03.002 INFO:tasks.workunit.client.0.smithi152.stdout:8/798: creat d4/db/d56/dcb/ddb/f113 x:0 0 0 2024-04-06T12:24:03.006 INFO:tasks.workunit.client.0.smithi152.stdout:6/731: mkdir d7/d19/d3e/d70/df2 0 2024-04-06T12:24:03.007 INFO:tasks.workunit.client.0.smithi152.stdout:1/590: mknod d2/d1d/d3b/dc3/d9f/cd4 0 2024-04-06T12:24:03.009 INFO:tasks.workunit.client.0.smithi152.stdout:4/763: mknod d7/d16/d22/d3f/db4/d60/dc4/cf5 0 2024-04-06T12:24:03.010 INFO:tasks.workunit.client.0.smithi152.stdout:9/494: write d5/d6/d74/d17/f75 [1747540,63507] 0 2024-04-06T12:24:03.013 INFO:tasks.workunit.client.0.smithi152.stdout:3/698: mknod d0/d35/d43/d48/cdb 0 2024-04-06T12:24:03.014 INFO:tasks.workunit.client.0.smithi152.stdout:0/844: write d4/d31/f6b [355739,110930] 0 2024-04-06T12:24:03.016 INFO:tasks.workunit.client.0.smithi152.stdout:2/704: truncate d0/f11 906023 0 2024-04-06T12:24:03.020 INFO:tasks.workunit.client.0.smithi152.stdout:2/705: dread d0/d15/d24/f8e [0,4194304] 0 2024-04-06T12:24:03.022 INFO:tasks.workunit.client.0.smithi152.stdout:4/764: mkdir d7/d16/d55/da0/df6 0 2024-04-06T12:24:03.024 INFO:tasks.workunit.client.0.smithi152.stdout:3/699: mkdir d0/d10/d1e/d71/db2/ddc 0 2024-04-06T12:24:03.025 INFO:tasks.workunit.client.0.smithi152.stdout:0/845: truncate d4/de/d87/f84 794151 0 2024-04-06T12:24:03.029 INFO:tasks.workunit.client.0.smithi152.stdout:2/706: fsync d0/d40/d41/f6c 0 2024-04-06T12:24:03.031 INFO:tasks.workunit.client.0.smithi152.stdout:9/495: mknod d5/c9c 0 2024-04-06T12:24:03.032 INFO:tasks.workunit.client.0.smithi152.stdout:8/799: dwrite d4/db/d56/fb1 [0,4194304] 0 2024-04-06T12:24:03.032 INFO:tasks.workunit.client.0.smithi152.stdout:4/765: dwrite d7/d29/d78/ded/f6b [0,4194304] 0 2024-04-06T12:24:03.033 INFO:tasks.workunit.client.0.smithi152.stdout:8/800: stat d4/dc/cec 0 2024-04-06T12:24:03.034 INFO:tasks.workunit.client.0.smithi152.stdout:2/707: readlink d0/d15/d24/lb7 0 2024-04-06T12:24:03.037 INFO:tasks.workunit.client.0.smithi152.stdout:9/496: readlink d5/d6/d74/d17/d23/d2d/d4b/d5a/l83 0 2024-04-06T12:24:03.040 INFO:tasks.workunit.client.0.smithi152.stdout:3/700: rmdir d0/d35/d75 39 2024-04-06T12:24:03.047 INFO:tasks.workunit.client.0.smithi152.stdout:5/645: getdents d3/da 0 2024-04-06T12:24:03.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:01.585644+0000 mgr.smithi195.ausetj (mgr.24375) 85 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 100 MiB/s wr, 251 op/s 2024-04-06T12:24:03.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:02.789272+0000 mon.smithi195 (mon.1) 64 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:03.049 INFO:tasks.workunit.client.0.smithi152.stdout:0/846: truncate d4/de/d28/f95 2000290 0 2024-04-06T12:24:03.049 INFO:tasks.workunit.client.0.smithi152.stdout:3/701: dwrite d0/d1f/d28/f86 [0,4194304] 0 2024-04-06T12:24:03.049 INFO:tasks.workunit.client.0.smithi152.stdout:5/646: chown d3/da/l39 452 1 2024-04-06T12:24:03.050 INFO:tasks.workunit.client.0.smithi152.stdout:0/847: fsync d4/d31/d47/d7e/dbe/fa1 0 2024-04-06T12:24:03.115 INFO:tasks.workunit.client.0.smithi152.stdout:9/497: truncate d5/d39/d79/f7c 1278357 0 2024-04-06T12:24:03.118 INFO:tasks.workunit.client.0.smithi152.stdout:6/732: getdents d7/d19/d1b 0 2024-04-06T12:24:03.121 INFO:tasks.workunit.client.0.smithi152.stdout:8/801: mkdir d4/d2c/d114 0 2024-04-06T12:24:03.122 INFO:tasks.workunit.client.0.smithi152.stdout:4/766: write d7/d29/d7e/f67 [162557,58551] 0 2024-04-06T12:24:03.124 INFO:tasks.workunit.client.0.smithi152.stdout:3/702: rmdir d0/d10/d13/d2a/d4b 39 2024-04-06T12:24:03.126 INFO:tasks.workunit.client.0.smithi152.stdout:3/703: fdatasync d0/d10/f66 0 2024-04-06T12:24:03.126 INFO:tasks.workunit.client.0.smithi152.stdout:4/767: dread d7/d29/d78/ded/f74 [0,4194304] 0 2024-04-06T12:24:03.128 INFO:tasks.workunit.client.0.smithi152.stdout:0/848: mknod d4/de/d28/d18/d43/d81/c10a 0 2024-04-06T12:24:03.131 INFO:tasks.workunit.client.0.smithi152.stdout:5/647: write d3/de/d80/f5d [1651774,46089] 0 2024-04-06T12:24:03.135 INFO:tasks.workunit.client.0.smithi152.stdout:2/708: write d0/d2/d6f/d90/d9e/db5/f50 [2069931,85878] 0 2024-04-06T12:24:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:9/498: write d5/d39/d3f/d42/f48 [2172830,123331] 0 2024-04-06T12:24:03.142 INFO:tasks.workunit.client.0.smithi152.stdout:2/709: dwrite d0/d15/d24/d3d/f91 [0,4194304] 0 2024-04-06T12:24:03.147 INFO:tasks.workunit.client.0.smithi152.stdout:6/733: dwrite d7/d19/d1b/d22/f29 [0,4194304] 0 2024-04-06T12:24:03.153 INFO:tasks.workunit.client.0.smithi152.stdout:0/849: creat d4/de/d28/d18/d43/d81/f10b x:0 0 0 2024-04-06T12:24:03.155 INFO:tasks.workunit.client.0.smithi152.stdout:5/648: symlink d3/da/d15/d7f/ld3 0 2024-04-06T12:24:03.165 INFO:tasks.workunit.client.0.smithi152.stdout:3/704: truncate d0/d35/d43/d48/fd2 891575 0 2024-04-06T12:24:03.168 INFO:tasks.workunit.client.0.smithi152.stdout:0/850: chown d4/de/d4a/d33/fca 63 1 2024-04-06T12:24:03.169 INFO:tasks.workunit.client.0.smithi152.stdout:5/649: fdatasync d3/da/d15/d2b/d3f/d68/d81/f45 0 2024-04-06T12:24:03.170 INFO:tasks.workunit.client.0.smithi152.stdout:0/851: truncate d4/de/d28/d18/d43/d81/f10b 255722 0 2024-04-06T12:24:03.173 INFO:tasks.workunit.client.0.smithi152.stdout:2/710: mkdir d0/dc9/de9 0 2024-04-06T12:24:03.175 INFO:tasks.workunit.client.0.smithi152.stdout:4/768: rename d7/d29/d7e/ca4 to d7/d16/d22/d3f/db4/d60/cf7 0 2024-04-06T12:24:03.181 INFO:tasks.workunit.client.0.smithi152.stdout:0/852: rename d4/c5d to d4/de/d4a/c10c 0 2024-04-06T12:24:03.183 INFO:tasks.workunit.client.0.smithi152.stdout:6/734: mknod d7/d19/d3e/d70/df2/cf3 0 2024-04-06T12:24:03.185 INFO:tasks.workunit.client.0.smithi152.stdout:9/499: truncate d5/d6/f3c 5511936 0 2024-04-06T12:24:03.188 INFO:tasks.workunit.client.0.smithi152.stdout:0/853: creat d4/de/d28/d18/f10d x:0 0 0 2024-04-06T12:24:03.194 INFO:tasks.workunit.client.0.smithi152.stdout:5/650: dwrite d3/da/d53/fb3 [0,4194304] 0 2024-04-06T12:24:03.194 INFO:tasks.workunit.client.0.smithi152.stdout:4/769: getdents d7/d16/d22/d95/dcf 0 2024-04-06T12:24:03.196 INFO:tasks.workunit.client.0.smithi152.stdout:5/651: write d3/da/d15/d40/d50/d99/faa [762099,118355] 0 2024-04-06T12:24:03.199 INFO:tasks.workunit.client.0.smithi152.stdout:3/705: getdents d0/d10/d13/d2a/d93/d49 0 2024-04-06T12:24:03.200 INFO:tasks.workunit.client.0.smithi152.stdout:3/706: fsync d0/d10/d13/f1a 0 2024-04-06T12:24:03.200 INFO:tasks.workunit.client.0.smithi152.stdout:5/652: fdatasync d3/da/d15/d40/d92/f78 0 2024-04-06T12:24:03.201 INFO:tasks.workunit.client.0.smithi152.stdout:2/711: rename d0/d2/d6f/d90/d9e/db5/c65 to d0/cea 0 2024-04-06T12:24:03.203 INFO:tasks.workunit.client.0.smithi152.stdout:9/500: fdatasync d5/d39/d79/f7c 0 2024-04-06T12:24:03.203 INFO:tasks.workunit.client.0.smithi152.stdout:5/653: read d3/da/f13 [1336477,113842] 0 2024-04-06T12:24:03.213 INFO:tasks.workunit.client.0.smithi152.stdout:2/712: dwrite d0/d15/d24/d79/d80/fa0 [0,4194304] 0 2024-04-06T12:24:03.220 INFO:tasks.workunit.client.0.smithi152.stdout:0/854: rename d4/de/d87/ce8 to d4/de/d7f/df4/c10e 0 2024-04-06T12:24:03.220 INFO:tasks.workunit.client.0.smithi152.stdout:4/770: write d7/d29/d7e/d59/fba [296263,122792] 0 2024-04-06T12:24:03.222 INFO:tasks.workunit.client.0.smithi152.stdout:4/771: fsync d7/d16/d22/dc7/fd6 0 2024-04-06T12:24:03.222 INFO:tasks.workunit.client.0.smithi152.stdout:0/855: write d4/de/d28/d18/d43/d62/daa/df0/ffa [184982,126030] 0 2024-04-06T12:24:03.224 INFO:tasks.workunit.client.0.smithi152.stdout:9/501: creat d5/d6/d74/d17/d23/d2d/d32/d36/f9d x:0 0 0 2024-04-06T12:24:03.226 INFO:tasks.workunit.client.0.smithi152.stdout:5/654: rmdir d3/da/d15/d2b/d3f/d6d/db1 39 2024-04-06T12:24:03.229 INFO:tasks.workunit.client.0.smithi152.stdout:0/856: dwrite d4/de/d28/d18/d3b/fe5 [0,4194304] 0 2024-04-06T12:24:03.232 INFO:tasks.workunit.client.0.smithi152.stdout:2/713: creat d0/d2/d6f/d90/d9e/feb x:0 0 0 2024-04-06T12:24:03.239 INFO:tasks.workunit.client.0.smithi152.stdout:0/857: dwrite d4/de/d28/d18/d43/d8a/ff8 [0,4194304] 0 2024-04-06T12:24:03.240 INFO:tasks.workunit.client.0.smithi152.stdout:3/707: link d0/d1f/fc7 d0/d10/d13/d2a/d93/d3d/dc3/fdd 0 2024-04-06T12:24:03.242 INFO:tasks.workunit.client.0.smithi152.stdout:3/708: write d0/d35/f82 [4134394,65397] 0 2024-04-06T12:24:03.244 INFO:tasks.workunit.client.0.smithi152.stdout:4/772: creat d7/d82/ff8 x:0 0 0 2024-04-06T12:24:03.245 INFO:tasks.workunit.client.0.smithi152.stdout:4/773: chown d7/d16/d22/dc7/dc8/ddd/fe1 1370878 1 2024-04-06T12:24:03.248 INFO:tasks.workunit.client.0.smithi152.stdout:9/502: dread - d5/d39/d3f/f6a zero size 2024-04-06T12:24:03.249 INFO:tasks.workunit.client.0.smithi152.stdout:6/735: link d7/d19/d3e/d70/dcb/fdc d7/d19/d1b/d31/d35/dbc/ff4 0 2024-04-06T12:24:03.250 INFO:tasks.workunit.client.0.smithi152.stdout:6/736: write d7/d9/d26/d4a/d7b/fd7 [463076,24325] 0 2024-04-06T12:24:03.254 INFO:tasks.workunit.client.0.smithi152.stdout:2/714: rename d0/d40/d26/db4/ld1 to d0/d15/d24/d79/lec 0 2024-04-06T12:24:03.258 INFO:tasks.workunit.client.0.smithi152.stdout:0/858: unlink d4/de/d28/d18/d43/d62/daa/cfd 0 2024-04-06T12:24:03.261 INFO:tasks.workunit.client.0.smithi152.stdout:3/709: symlink d0/d35/d43/lde 0 2024-04-06T12:24:03.263 INFO:tasks.workunit.client.0.smithi152.stdout:4/774: read d7/d16/d55/fa7 [1955445,23640] 0 2024-04-06T12:24:03.266 INFO:tasks.workunit.client.0.smithi152.stdout:9/503: fdatasync d5/d39/d3f/f6a 0 2024-04-06T12:24:03.270 INFO:tasks.workunit.client.0.smithi152.stdout:6/737: readlink d7/d19/d1b/d22/l49 0 2024-04-06T12:24:03.271 INFO:tasks.workunit.client.0.smithi152.stdout:6/738: chown d7/d19/d3e/d70 11209 1 2024-04-06T12:24:03.271 INFO:tasks.workunit.client.0.smithi152.stdout:0/859: symlink d4/de/d28/d18/d3b/d2e/dcb/l10f 0 2024-04-06T12:24:03.275 INFO:tasks.workunit.client.0.smithi152.stdout:3/710: symlink d0/d1f/d28/ldf 0 2024-04-06T12:24:03.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:01.585644+0000 mgr.smithi195.ausetj (mgr.24375) 85 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 100 MiB/s wr, 251 op/s 2024-04-06T12:24:03.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:02.789272+0000 mon.smithi195 (mon.1) 64 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:03.280 INFO:tasks.workunit.client.0.smithi152.stdout:4/775: rename d7/fb to d7/d29/d2e/d5b/db2/dd7/ff9 0 2024-04-06T12:24:03.286 INFO:tasks.workunit.client.0.smithi152.stdout:6/739: truncate d7/d19/d1b/d31/fb9 703657 0 2024-04-06T12:24:03.289 INFO:tasks.workunit.client.0.smithi152.stdout:5/655: getdents d3/de/d80/d8f 0 2024-04-06T12:24:03.293 INFO:tasks.workunit.client.0.smithi152.stdout:4/776: unlink d7/d82/db1/db6/cc9 0 2024-04-06T12:24:03.295 INFO:tasks.workunit.client.0.smithi152.stdout:4/777: truncate d7/fb5 4813462 0 2024-04-06T12:24:03.297 INFO:tasks.workunit.client.0.smithi152.stdout:6/740: mknod d7/d19/d1b/db2/de6/cf5 0 2024-04-06T12:24:03.299 INFO:tasks.workunit.client.0.smithi152.stdout:9/504: dread d5/d6/f3c [0,4194304] 0 2024-04-06T12:24:03.300 INFO:tasks.workunit.client.0.smithi152.stdout:6/741: stat d7/d9/d26/d4a/f58 0 2024-04-06T12:24:03.302 INFO:tasks.workunit.client.0.smithi152.stdout:3/711: creat d0/d10/d13/d2a/fe0 x:0 0 0 2024-04-06T12:24:03.303 INFO:tasks.workunit.client.0.smithi152.stdout:3/712: readlink d0/d10/d1e/l20 0 2024-04-06T12:24:03.303 INFO:tasks.workunit.client.0.smithi152.stdout:0/860: getdents d4/de/da7 0 2024-04-06T12:24:03.305 INFO:tasks.workunit.client.0.smithi152.stdout:4/778: symlink d7/d29/df2/lfa 0 2024-04-06T12:24:03.307 INFO:tasks.workunit.client.0.smithi152.stdout:5/656: dread d3/f1f [0,4194304] 0 2024-04-06T12:24:03.307 INFO:tasks.workunit.client.0.smithi152.stdout:0/861: write d4/de/d28/d18/d3b/d2e/fec [3566932,87219] 0 2024-04-06T12:24:03.309 INFO:tasks.workunit.client.0.smithi152.stdout:6/742: symlink d7/d9/d26/d4a/d7b/lf6 0 2024-04-06T12:24:03.316 INFO:tasks.workunit.client.0.smithi152.stdout:5/657: dread d3/f1f [0,4194304] 0 2024-04-06T12:24:03.318 INFO:tasks.workunit.client.0.smithi152.stdout:9/505: mkdir d5/d6/d74/d9e 0 2024-04-06T12:24:03.319 INFO:tasks.workunit.client.0.smithi152.stdout:0/862: dwrite d4/de/d28/d18/d43/d81/f10b [0,4194304] 0 2024-04-06T12:24:03.319 INFO:tasks.workunit.client.0.smithi152.stdout:4/779: symlink d7/d29/d2e/d5b/lfb 0 2024-04-06T12:24:03.320 INFO:tasks.workunit.client.0.smithi152.stdout:5/658: stat d3/de/f2e 0 2024-04-06T12:24:03.325 INFO:tasks.workunit.client.0.smithi152.stdout:9/506: fdatasync d5/f10 0 2024-04-06T12:24:03.326 INFO:tasks.workunit.client.0.smithi152.stdout:0/863: fsync d4/de/f68 0 2024-04-06T12:24:03.329 INFO:tasks.workunit.client.0.smithi152.stdout:6/743: dread d7/d9/f56 [0,4194304] 0 2024-04-06T12:24:03.330 INFO:tasks.workunit.client.0.smithi152.stdout:6/744: write d7/d19/d1b/d22/f29 [4636643,113083] 0 2024-04-06T12:24:03.332 INFO:tasks.workunit.client.0.smithi152.stdout:6/745: truncate d7/d19/d3e/fe0 906836 0 2024-04-06T12:24:03.332 INFO:tasks.workunit.client.0.smithi152.stdout:6/746: dread - d7/d62/fd8 zero size 2024-04-06T12:24:03.374 INFO:tasks.workunit.client.0.smithi152.stdout:7/666: sync 2024-04-06T12:24:03.379 INFO:tasks.workunit.client.0.smithi152.stdout:3/713: truncate d0/d2d/f78 203561 0 2024-04-06T12:24:03.383 INFO:tasks.workunit.client.0.smithi152.stdout:0/864: symlink d4/d31/d47/l110 0 2024-04-06T12:24:03.383 INFO:tasks.workunit.client.0.smithi152.stdout:0/865: chown d4/de/d87/f77 2 1 2024-04-06T12:24:03.388 INFO:tasks.workunit.client.0.smithi152.stdout:7/667: rmdir d8/df/d28/d41/d48 39 2024-04-06T12:24:03.392 INFO:tasks.workunit.client.0.smithi152.stdout:4/780: dwrite d7/d16/d22/d95/fce [0,4194304] 0 2024-04-06T12:24:03.392 INFO:tasks.workunit.client.0.smithi152.stdout:5/659: mknod d3/da/d15/d2b/dbd/cd4 0 2024-04-06T12:24:03.395 INFO:tasks.workunit.client.0.smithi152.stdout:3/714: symlink d0/d1f/d4a/le1 0 2024-04-06T12:24:03.395 INFO:tasks.workunit.client.0.smithi152.stdout:0/866: dwrite d4/de/d28/d18/d43/fed [0,4194304] 0 2024-04-06T12:24:03.401 INFO:tasks.workunit.client.0.smithi152.stdout:9/507: mkdir d5/d6/d74/d17/d9f 0 2024-04-06T12:24:03.402 INFO:tasks.workunit.client.0.smithi152.stdout:9/508: write d5/d6/f14 [5896206,18260] 0 2024-04-06T12:24:03.412 INFO:tasks.workunit.client.0.smithi152.stdout:4/781: mknod d7/d82/db1/db6/cfc 0 2024-04-06T12:24:03.415 INFO:tasks.workunit.client.0.smithi152.stdout:0/867: unlink d4/de/d28/d18/d3b/fe5 0 2024-04-06T12:24:03.417 INFO:tasks.workunit.client.0.smithi152.stdout:9/509: stat d5/d6/d74/d17/d23/l43 0 2024-04-06T12:24:03.418 INFO:tasks.workunit.client.0.smithi152.stdout:9/510: chown d5/d6/d74/d17/d9f 1474 1 2024-04-06T12:24:03.421 INFO:tasks.workunit.client.0.smithi152.stdout:4/782: unlink d7/d16/d22/d3f/db4/la5 0 2024-04-06T12:24:03.426 INFO:tasks.workunit.client.0.smithi152.stdout:4/783: creat d7/d16/d22/dc7/dc8/ddd/ffd x:0 0 0 2024-04-06T12:24:03.427 INFO:tasks.workunit.client.0.smithi152.stdout:0/868: mknod d4/de/d28/d18/d3b/c111 0 2024-04-06T12:24:03.429 INFO:tasks.workunit.client.0.smithi152.stdout:6/747: dwrite d7/d19/d3e/d70/dcb/fdc [0,4194304] 0 2024-04-06T12:24:03.429 INFO:tasks.workunit.client.0.smithi152.stdout:9/511: mkdir d5/d6/d74/da0 0 2024-04-06T12:24:03.432 INFO:tasks.workunit.client.0.smithi152.stdout:9/512: read d5/d6/d74/d17/d23/d2d/f6b [1166169,46546] 0 2024-04-06T12:24:03.436 INFO:tasks.workunit.client.0.smithi152.stdout:6/748: truncate d7/d19/d3e/f9a 5038888 0 2024-04-06T12:24:03.437 INFO:tasks.workunit.client.0.smithi152.stdout:7/668: write d8/df/f5e [581887,73539] 0 2024-04-06T12:24:03.438 INFO:tasks.workunit.client.0.smithi152.stdout:3/715: dwrite d0/d1f/d28/f74 [0,4194304] 0 2024-04-06T12:24:03.444 INFO:tasks.workunit.client.0.smithi152.stdout:7/669: write d8/fc3 [952415,65801] 0 2024-04-06T12:24:03.447 INFO:tasks.workunit.client.0.smithi152.stdout:4/784: creat d7/d29/ffe x:0 0 0 2024-04-06T12:24:03.450 INFO:tasks.workunit.client.0.smithi152.stdout:9/513: creat d5/d6/d74/d17/d23/d2d/d98/d99/fa1 x:0 0 0 2024-04-06T12:24:03.451 INFO:tasks.workunit.client.0.smithi152.stdout:0/869: getdents d4/de/d28/d18 0 2024-04-06T12:24:03.452 INFO:tasks.workunit.client.0.smithi152.stdout:4/785: symlink d7/d16/lff 0 2024-04-06T12:24:03.453 INFO:tasks.workunit.client.0.smithi152.stdout:3/716: mknod d0/d10/d1e/ce2 0 2024-04-06T12:24:03.454 INFO:tasks.workunit.client.0.smithi152.stdout:7/670: symlink d8/df/ld7 0 2024-04-06T12:24:03.454 INFO:tasks.workunit.client.0.smithi152.stdout:9/514: fsync d5/d6/f49 0 2024-04-06T12:24:03.456 INFO:tasks.workunit.client.0.smithi152.stdout:9/515: fdatasync d5/d39/d79/f91 0 2024-04-06T12:24:03.458 INFO:tasks.workunit.client.0.smithi152.stdout:4/786: fsync d7/d29/d7e/d59/f76 0 2024-04-06T12:24:03.461 INFO:tasks.workunit.client.0.smithi152.stdout:6/749: dread d7/d19/d3e/f40 [0,4194304] 0 2024-04-06T12:24:03.461 INFO:tasks.workunit.client.0.smithi152.stdout:7/671: rmdir d8/df/d61/d4b/d56 39 2024-04-06T12:24:03.462 INFO:tasks.workunit.client.0.smithi152.stdout:6/750: read - d7/d19/d1b/d31/f82 zero size 2024-04-06T12:24:03.463 INFO:tasks.workunit.client.0.smithi152.stdout:3/717: mknod d0/d10/d1e/d87/da8/ce3 0 2024-04-06T12:24:03.464 INFO:tasks.workunit.client.0.smithi152.stdout:0/870: fsync d4/de/d28/d18/d3b/d2e/f4b 0 2024-04-06T12:24:03.468 INFO:tasks.workunit.client.0.smithi152.stdout:9/516: mkdir d5/d6/d74/d17/d23/d2d/d32/da2 0 2024-04-06T12:24:03.469 INFO:tasks.workunit.client.0.smithi152.stdout:9/517: dread - d5/d6/d74/f97 zero size 2024-04-06T12:24:03.475 INFO:tasks.workunit.client.0.smithi152.stdout:7/672: unlink d8/df/d28/d41/dd4/d8c/d2d/da3/dbb/fc2 0 2024-04-06T12:24:03.480 INFO:tasks.workunit.client.0.smithi152.stdout:3/718: symlink d0/d1f/d4a/le4 0 2024-04-06T12:24:03.482 INFO:tasks.workunit.client.0.smithi152.stdout:0/871: mknod d4/de/d28/d18/d3b/d2e/d78/c112 0 2024-04-06T12:24:03.485 INFO:tasks.workunit.client.0.smithi152.stdout:9/518: mkdir d5/d6/d74/d17/d23/d2d/d32/d36/da3 0 2024-04-06T12:24:03.486 INFO:tasks.workunit.client.0.smithi152.stdout:4/787: dwrite d7/d29/d78/ded/f74 [0,4194304] 0 2024-04-06T12:24:03.487 INFO:tasks.workunit.client.0.smithi152.stdout:9/519: read d5/f81 [3020025,11740] 0 2024-04-06T12:24:03.494 INFO:tasks.workunit.client.0.smithi152.stdout:6/751: truncate d7/d19/d1b/d31/d35/f54 1756834 0 2024-04-06T12:24:03.494 INFO:tasks.workunit.client.0.smithi152.stdout:3/719: unlink d0/l6c 0 2024-04-06T12:24:03.498 INFO:tasks.workunit.client.0.smithi152.stdout:0/872: symlink d4/d31/d47/d7e/dbe/d8e/l113 0 2024-04-06T12:24:03.499 INFO:tasks.workunit.client.0.smithi152.stdout:3/720: write d0/d10/fd6 [664927,105838] 0 2024-04-06T12:24:03.499 INFO:tasks.workunit.client.0.smithi152.stdout:4/788: dwrite d7/d29/d78/ded/f71 [0,4194304] 0 2024-04-06T12:24:03.500 INFO:tasks.workunit.client.0.smithi152.stdout:9/520: dwrite d5/d39/d3f/d42/f89 [0,4194304] 0 2024-04-06T12:24:03.510 INFO:tasks.workunit.client.0.smithi152.stdout:0/873: creat d4/de/d4a/f114 x:0 0 0 2024-04-06T12:24:03.520 INFO:tasks.workunit.client.0.smithi152.stdout:0/874: unlink d4/de/d4a/f114 0 2024-04-06T12:24:03.521 INFO:tasks.workunit.client.0.smithi152.stdout:9/521: dwrite d5/f81 [4194304,4194304] 0 2024-04-06T12:24:03.522 INFO:tasks.workunit.client.0.smithi152.stdout:3/721: mknod d0/d10/d1e/ce5 0 2024-04-06T12:24:03.528 INFO:tasks.workunit.client.0.smithi152.stdout:7/673: rename d8/df/d61/d6d/d85/la8 to d8/df/d61/ld8 0 2024-04-06T12:24:03.531 INFO:tasks.workunit.client.0.smithi152.stdout:6/752: dwrite d7/d9/d26/d2e/f42 [0,4194304] 0 2024-04-06T12:24:03.531 INFO:tasks.workunit.client.0.smithi152.stdout:0/875: dwrite d4/de/d28/d18/d43/fed [0,4194304] 0 2024-04-06T12:24:03.541 INFO:tasks.workunit.client.0.smithi152.stdout:9/522: mkdir d5/d6/d74/d17/d23/d2d/d98/da4 0 2024-04-06T12:24:03.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/789: write d7/d16/d22/d3f/fa6 [45483,83326] 0 2024-04-06T12:24:03.543 INFO:tasks.workunit.client.0.smithi152.stdout:4/790: readlink d7/d29/d2e/d5b/l8e 0 2024-04-06T12:24:03.544 INFO:tasks.workunit.client.0.smithi152.stdout:4/791: stat d7/d16 0 2024-04-06T12:24:03.570 INFO:tasks.workunit.client.0.smithi152.stdout:1/591: sync 2024-04-06T12:24:03.573 INFO:tasks.workunit.client.0.smithi152.stdout:4/792: chown d7/d29/d78/l97 1293 1 2024-04-06T12:24:03.578 INFO:tasks.workunit.client.0.smithi152.stdout:3/722: write d0/d10/d13/d2a/d93/d49/d8d/d9e/fb3 [4226046,46415] 0 2024-04-06T12:24:03.581 INFO:tasks.workunit.client.0.smithi152.stdout:9/523: symlink d5/d6/d74/d17/d23/d2d/d98/da4/la5 0 2024-04-06T12:24:03.582 INFO:tasks.workunit.client.0.smithi152.stdout:7/674: truncate d8/df/d34/f88 1099427 0 2024-04-06T12:24:03.585 INFO:tasks.workunit.client.0.smithi152.stdout:4/793: stat d7/cd 0 2024-04-06T12:24:03.585 INFO:tasks.workunit.client.0.smithi152.stdout:1/592: chown d2/d1d/f67 0 1 2024-04-06T12:24:03.586 INFO:tasks.workunit.client.0.smithi152.stdout:3/723: dwrite d0/d10/fd6 [0,4194304] 0 2024-04-06T12:24:03.588 INFO:tasks.workunit.client.0.smithi152.stdout:6/753: rename d7/d19/d3e/d70/dcb to d7/df7 0 2024-04-06T12:24:03.589 INFO:tasks.workunit.client.0.smithi152.stdout:3/724: chown d0/d1f/d44/d7c 63 1 2024-04-06T12:24:03.597 INFO:tasks.workunit.client.0.smithi152.stdout:1/593: truncate d2/d2f/f32 1877978 0 2024-04-06T12:24:03.599 INFO:tasks.workunit.client.0.smithi152.stdout:9/524: dwrite d5/d6/d74/d17/d23/d2d/d98/d99/fa1 [0,4194304] 0 2024-04-06T12:24:03.600 INFO:tasks.workunit.client.0.smithi152.stdout:4/794: dwrite d7/d82/db1/db6/ff0 [0,4194304] 0 2024-04-06T12:24:03.602 INFO:tasks.workunit.client.0.smithi152.stdout:1/594: chown d2/d2f/d54/d88/d9c/dc5/dad/c2b 11648685 1 2024-04-06T12:24:03.603 INFO:tasks.workunit.client.0.smithi152.stdout:4/795: fdatasync d7/d16/d55/da0/fe2 0 2024-04-06T12:24:03.603 INFO:tasks.workunit.client.0.smithi152.stdout:0/876: rename d4/f4c to d4/de/d28/d18/d43/dd1/f115 0 2024-04-06T12:24:03.606 INFO:tasks.workunit.client.0.smithi152.stdout:1/595: chown d2/d2f/d54/cc2 711 1 2024-04-06T12:24:03.612 INFO:tasks.workunit.client.0.smithi152.stdout:9/525: dwrite d5/d39/d3f/d42/f89 [0,4194304] 0 2024-04-06T12:24:03.613 INFO:tasks.workunit.client.0.smithi152.stdout:4/796: write d7/d16/d22/d3f/db4/d60/dc4/fef [481550,10395] 0 2024-04-06T12:24:03.618 INFO:tasks.workunit.client.0.smithi152.stdout:6/754: write d7/d19/d1b/d1f/d3d/fa7 [4958486,57193] 0 2024-04-06T12:24:03.628 INFO:tasks.workunit.client.0.smithi152.stdout:6/755: mknod d7/d19/d1b/d31/d35/dbc/cf8 0 2024-04-06T12:24:03.628 INFO:tasks.workunit.client.0.smithi152.stdout:6/756: stat d7/d9/d73/fd3 0 2024-04-06T12:24:03.630 INFO:tasks.workunit.client.0.smithi152.stdout:9/526: symlink d5/d6/d74/d17/la6 0 2024-04-06T12:24:03.633 INFO:tasks.workunit.client.0.smithi152.stdout:3/725: getdents d0/d2d 0 2024-04-06T12:24:03.634 INFO:tasks.workunit.client.0.smithi152.stdout:9/527: write d5/d6/d74/d17/d23/d2d/f8f [869895,11330] 0 2024-04-06T12:24:03.634 INFO:tasks.workunit.client.0.smithi152.stdout:6/757: chown d7/c84 1515055 1 2024-04-06T12:24:03.636 INFO:tasks.workunit.client.0.smithi152.stdout:0/877: creat d4/de/f116 x:0 0 0 2024-04-06T12:24:03.636 INFO:tasks.workunit.client.0.smithi152.stdout:1/596: write d2/d2f/d54/f7f [445222,51990] 0 2024-04-06T12:24:03.639 INFO:tasks.workunit.client.0.smithi152.stdout:7/675: rename d8/d2a/d42/c7c to d8/df/d61/d76/cd9 0 2024-04-06T12:24:03.642 INFO:tasks.workunit.client.0.smithi152.stdout:3/726: read d0/d10/d45/f47 [7643324,97195] 0 2024-04-06T12:24:03.643 INFO:tasks.workunit.client.0.smithi152.stdout:6/758: mknod d7/d19/d1b/db2/de6/cf9 0 2024-04-06T12:24:03.645 INFO:tasks.workunit.client.0.smithi152.stdout:7/676: dread d8/df/d61/d3d/d53/f78 [0,4194304] 0 2024-04-06T12:24:03.646 INFO:tasks.workunit.client.0.smithi152.stdout:1/597: chown d2/d1d/l25 428 1 2024-04-06T12:24:03.649 INFO:tasks.workunit.client.0.smithi152.stdout:9/528: dread d5/d39/f3d [0,4194304] 0 2024-04-06T12:24:03.651 INFO:tasks.workunit.client.0.smithi152.stdout:3/727: truncate d0/d2d/d7f/fa4 156942 0 2024-04-06T12:24:03.652 INFO:tasks.workunit.client.0.smithi152.stdout:6/759: symlink d7/d19/d1b/d31/lfa 0 2024-04-06T12:24:03.655 INFO:tasks.workunit.client.0.smithi152.stdout:7/677: rename d8/df/d34/d5c/f68 to d8/df/d28/d41/dd4/d43/fda 0 2024-04-06T12:24:03.663 INFO:tasks.workunit.client.0.smithi152.stdout:3/728: creat d0/d10/d1e/d71/db2/fe6 x:0 0 0 2024-04-06T12:24:03.664 INFO:tasks.workunit.client.0.smithi152.stdout:6/760: symlink d7/df7/lfb 0 2024-04-06T12:24:03.668 INFO:tasks.workunit.client.0.smithi152.stdout:1/598: rename d2/d2f/d54/d88/d9c/dc5/dad/d8c/cc9 to d2/db2/cd5 0 2024-04-06T12:24:03.670 INFO:tasks.workunit.client.0.smithi152.stdout:1/599: dread - d2/d2f/d54/d88/d9c/dc5/f87 zero size 2024-04-06T12:24:03.670 INFO:tasks.workunit.client.0.smithi152.stdout:6/761: dwrite d7/d19/d3e/fe0 [0,4194304] 0 2024-04-06T12:24:03.672 INFO:tasks.workunit.client.0.smithi152.stdout:6/762: chown d7/d19/f8d 548369268 1 2024-04-06T12:24:03.679 INFO:tasks.workunit.client.0.smithi152.stdout:0/878: write d4/d31/d47/f9c [1300445,77411] 0 2024-04-06T12:24:03.687 INFO:tasks.workunit.client.0.smithi152.stdout:6/763: symlink d7/d19/d1b/lfc 0 2024-04-06T12:24:03.689 INFO:tasks.workunit.client.0.smithi152.stdout:7/678: dread d8/df/d61/f13 [0,4194304] 0 2024-04-06T12:24:03.690 INFO:tasks.workunit.client.0.smithi152.stdout:0/879: mknod d4/de/d4a/d33/c117 0 2024-04-06T12:24:03.690 INFO:tasks.workunit.client.0.smithi152.stdout:9/529: write d5/f10 [82831,28771] 0 2024-04-06T12:24:03.691 INFO:tasks.workunit.client.0.smithi152.stdout:7/679: stat d8/df/d28/d41/dd4/d8c/d2d/d7a 0 2024-04-06T12:24:03.703 INFO:tasks.workunit.client.0.smithi152.stdout:0/880: rename d4/de/d28/c85 to d4/de/d4a/c118 0 2024-04-06T12:24:03.712 INFO:tasks.workunit.client.0.smithi152.stdout:3/729: write d0/d1f/d4a/f98 [898200,50275] 0 2024-04-06T12:24:03.734 INFO:tasks.workunit.client.0.smithi152.stdout:1/600: dwrite d2/d2f/d45/f77 [0,4194304] 0 2024-04-06T12:24:03.735 INFO:tasks.workunit.client.0.smithi152.stdout:1/601: chown d2/d5d/f96 29937120 1 2024-04-06T12:24:03.736 INFO:tasks.workunit.client.0.smithi152.stdout:7/680: rename d8/df/d61/d76/d7e/f1a to d8/df/d28/d41/dd4/d43/fdb 0 2024-04-06T12:24:03.747 INFO:tasks.workunit.client.0.smithi152.stdout:9/530: dwrite d5/d6/d74/d17/d23/d2d/d32/f57 [0,4194304] 0 2024-04-06T12:24:03.747 INFO:tasks.workunit.client.0.smithi152.stdout:7/681: mkdir d8/df/d28/d41/dd4/d8c/d2d/da3/d65/ddc 0 2024-04-06T12:24:03.747 INFO:tasks.workunit.client.0.smithi152.stdout:1/602: dwrite d2/d1d/d7c/f93 [0,4194304] 0 2024-04-06T12:24:03.752 INFO:tasks.workunit.client.0.smithi152.stdout:9/531: dread - d5/d39/d3f/f6a zero size 2024-04-06T12:24:03.761 INFO:tasks.workunit.client.0.smithi152.stdout:6/764: dwrite d7/d19/d3e/d70/f77 [0,4194304] 0 2024-04-06T12:24:03.764 INFO:tasks.workunit.client.0.smithi152.stdout:7/682: rename d8/d2a/c3b to d8/df/d28/d41/dd4/d49/cdd 0 2024-04-06T12:24:03.766 INFO:tasks.workunit.client.0.smithi152.stdout:9/532: dread d5/d39/f3d [0,4194304] 0 2024-04-06T12:24:03.770 INFO:tasks.workunit.client.0.smithi152.stdout:6/765: creat d7/d9/d26/d4a/ffd x:0 0 0 2024-04-06T12:24:03.770 INFO:tasks.workunit.client.0.smithi152.stdout:9/533: write d5/d6/fd [541141,119721] 0 2024-04-06T12:24:03.774 INFO:tasks.workunit.client.0.smithi152.stdout:7/683: creat d8/df/d61/d6d/fde x:0 0 0 2024-04-06T12:24:03.774 INFO:tasks.workunit.client.0.smithi152.stdout:1/603: symlink d2/d2f/d54/d88/d9c/db3/dd3/ld6 0 2024-04-06T12:24:03.835 INFO:tasks.workunit.client.0.smithi152.stdout:1/604: symlink d2/d2f/d45/ld7 0 2024-04-06T12:24:03.835 INFO:tasks.workunit.client.0.smithi152.stdout:6/766: write d7/d19/d1b/d1f/d3d/fed [704259,104182] 0 2024-04-06T12:24:03.838 INFO:tasks.workunit.client.0.smithi152.stdout:9/534: mkdir d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7 0 2024-04-06T12:24:03.838 INFO:tasks.workunit.client.0.smithi152.stdout:1/605: chown d2/d2f/d45/f77 1503 1 2024-04-06T12:24:03.839 INFO:tasks.workunit.client.0.smithi152.stdout:7/684: mknod d8/cdf 0 2024-04-06T12:24:03.843 INFO:tasks.workunit.client.0.smithi152.stdout:2/715: sync 2024-04-06T12:24:03.843 INFO:tasks.workunit.client.0.smithi152.stdout:8/802: sync 2024-04-06T12:24:03.848 INFO:tasks.workunit.client.0.smithi152.stdout:8/803: fsync d4/db/d56/dcb/d6e/d88/f108 0 2024-04-06T12:24:03.854 INFO:tasks.workunit.client.0.smithi152.stdout:2/716: dwrite d0/d2/d6f/d90/d9e/db5/f42 [0,4194304] 0 2024-04-06T12:24:03.863 INFO:tasks.workunit.client.0.smithi152.stdout:2/717: truncate d0/d40/d41/d28/d8c/faa 3900405 0 2024-04-06T12:24:03.866 INFO:tasks.workunit.client.0.smithi152.stdout:2/718: creat d0/d40/d41/d28/d8c/fed x:0 0 0 2024-04-06T12:24:03.869 INFO:tasks.workunit.client.0.smithi152.stdout:3/730: dwrite d0/d35/d75/fac [0,4194304] 0 2024-04-06T12:24:03.872 INFO:tasks.workunit.client.0.smithi152.stdout:2/719: mknod d0/d15/cee 0 2024-04-06T12:24:03.874 INFO:tasks.workunit.client.0.smithi152.stdout:3/731: mknod d0/d1f/d4a/dd3/dd9/ce7 0 2024-04-06T12:24:03.875 INFO:tasks.workunit.client.0.smithi152.stdout:2/720: creat d0/d40/d26/fef x:0 0 0 2024-04-06T12:24:03.882 INFO:tasks.workunit.client.0.smithi152.stdout:3/732: dwrite d0/d10/d13/d2a/d93/f5f [0,4194304] 0 2024-04-06T12:24:03.891 INFO:tasks.workunit.client.0.smithi152.stdout:9/535: write d5/d6/d74/d17/f84 [702397,122] 0 2024-04-06T12:24:03.891 INFO:tasks.workunit.client.0.smithi152.stdout:1/606: write d2/d2f/d45/fa8 [739048,81113] 0 2024-04-06T12:24:03.894 INFO:tasks.workunit.client.0.smithi152.stdout:7/685: write d8/df/d61/f24 [2162226,127795] 0 2024-04-06T12:24:03.898 INFO:tasks.workunit.client.0.smithi152.stdout:8/804: truncate d4/dc/d10/d49/f4c 2054162 0 2024-04-06T12:24:03.899 INFO:tasks.workunit.client.0.smithi152.stdout:8/805: read - d4/dc/d10/d49/da0/f109 zero size 2024-04-06T12:24:03.907 INFO:tasks.workunit.client.0.smithi152.stdout:3/733: dread d0/d10/d13/f1a [0,4194304] 0 2024-04-06T12:24:03.910 INFO:tasks.workunit.client.0.smithi152.stdout:7/686: unlink d8/c8f 0 2024-04-06T12:24:03.910 INFO:tasks.workunit.client.0.smithi152.stdout:8/806: dread d4/d2c/fa4 [4194304,4194304] 0 2024-04-06T12:24:03.911 INFO:tasks.workunit.client.0.smithi152.stdout:7/687: chown d8/df/d61/d76/ccf 40797080 1 2024-04-06T12:24:03.914 INFO:tasks.workunit.client.0.smithi152.stdout:9/536: creat d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fa8 x:0 0 0 2024-04-06T12:24:03.914 INFO:tasks.workunit.client.0.smithi152.stdout:8/807: dread d4/db/d56/fb1 [0,4194304] 0 2024-04-06T12:24:03.915 INFO:tasks.workunit.client.0.smithi152.stdout:1/607: getdents d2/d2f 0 2024-04-06T12:24:03.918 INFO:tasks.workunit.client.0.smithi152.stdout:3/734: mkdir d0/d1f/d44/d7c/de8 0 2024-04-06T12:24:03.919 INFO:tasks.workunit.client.0.smithi152.stdout:3/735: stat d0/d10/d13/d2a/d93/d49/d8d 0 2024-04-06T12:24:03.923 INFO:tasks.workunit.client.0.smithi152.stdout:7/688: write d8/df/d28/d41/d48/fd2 [385829,108415] 0 2024-04-06T12:24:03.926 INFO:tasks.workunit.client.0.smithi152.stdout:1/608: creat d2/d61/d8f/fd8 x:0 0 0 2024-04-06T12:24:03.927 INFO:tasks.workunit.client.0.smithi152.stdout:2/721: dwrite d0/d40/d41/d28/d54/f7c [0,4194304] 0 2024-04-06T12:24:03.927 INFO:tasks.workunit.client.0.smithi152.stdout:1/609: chown d2/d61 61 1 2024-04-06T12:24:03.931 INFO:tasks.workunit.client.0.smithi152.stdout:3/736: read d0/d35/d43/fb1 [425700,18651] 0 2024-04-06T12:24:03.937 INFO:tasks.workunit.client.0.smithi152.stdout:2/722: creat d0/dae/ff0 x:0 0 0 2024-04-06T12:24:03.948 INFO:tasks.workunit.client.0.smithi152.stdout:2/723: rmdir d0/d15/d24/d3d 39 2024-04-06T12:24:03.951 INFO:tasks.workunit.client.0.smithi152.stdout:9/537: rmdir d5/d6/d74/d17/d23/d2d/d32/da2 0 2024-04-06T12:24:03.952 INFO:tasks.workunit.client.0.smithi152.stdout:7/689: write d8/df/d61/d3d/d53/f78 [1251591,112840] 0 2024-04-06T12:24:03.953 INFO:tasks.workunit.client.0.smithi152.stdout:8/808: link d4/db/d56/dcb/f79 d4/d2c/f115 0 2024-04-06T12:24:03.955 INFO:tasks.workunit.client.0.smithi152.stdout:1/610: write d2/d1d/f23 [3058223,123838] 0 2024-04-06T12:24:03.963 INFO:tasks.workunit.client.0.smithi152.stdout:2/724: write d0/d15/d24/d3d/fc7 [489619,20856] 0 2024-04-06T12:24:03.964 INFO:tasks.workunit.client.0.smithi152.stdout:7/690: dwrite d8/df/d28/d41/dd4/d49/d7b/f8b [4194304,4194304] 0 2024-04-06T12:24:03.965 INFO:tasks.workunit.client.0.smithi152.stdout:3/737: dwrite d0/d1f/d44/f7b [0,4194304] 0 2024-04-06T12:24:03.967 INFO:tasks.workunit.client.0.smithi152.stdout:9/538: link d5/d39/d3f/d42/f48 d5/d6/d74/d17/d23/d2d/d4b/fa9 0 2024-04-06T12:24:03.971 INFO:tasks.workunit.client.0.smithi152.stdout:8/809: creat d4/d2c/d114/f116 x:0 0 0 2024-04-06T12:24:03.972 INFO:tasks.workunit.client.0.smithi152.stdout:8/810: chown d4/d2c/d54/l60 441351429 1 2024-04-06T12:24:03.977 INFO:tasks.workunit.client.0.smithi152.stdout:3/738: mknod d0/d10/ce9 0 2024-04-06T12:24:03.978 INFO:tasks.workunit.client.0.smithi152.stdout:9/539: mkdir d5/d39/d79/daa 0 2024-04-06T12:24:03.983 INFO:tasks.workunit.client.0.smithi152.stdout:8/811: mknod d4/db/d56/dcb/d6e/d88/c117 0 2024-04-06T12:24:03.984 INFO:tasks.workunit.client.0.smithi152.stdout:8/812: chown d4/dc/f40 671 1 2024-04-06T12:24:03.990 INFO:tasks.workunit.client.0.smithi152.stdout:7/691: link d8/df/d28/c62 d8/df/d28/d41/dd4/d49/ce0 0 2024-04-06T12:24:03.991 INFO:tasks.workunit.client.0.smithi152.stdout:7/692: chown d8/df/d61/d76/d7e 1472905 1 2024-04-06T12:24:03.991 INFO:tasks.workunit.client.0.smithi152.stdout:2/725: write d0/d15/d24/d79/f7a [1027006,3347] 0 2024-04-06T12:24:03.993 INFO:tasks.workunit.client.0.smithi152.stdout:1/611: getdents d2/d2f/d54/d88/d9c/db3/dd3 0 2024-04-06T12:24:03.996 INFO:tasks.workunit.client.0.smithi152.stdout:7/693: symlink d8/df/d28/d41/dd4/d8c/d2d/da3/le1 0 2024-04-06T12:24:04.000 INFO:tasks.workunit.client.0.smithi152.stdout:1/612: dwrite d2/d2f/d54/d88/d9c/dc5/fc1 [0,4194304] 0 2024-04-06T12:24:04.000 INFO:tasks.workunit.client.0.smithi152.stdout:8/813: creat d4/db/d56/dcb/f118 x:0 0 0 2024-04-06T12:24:04.004 INFO:tasks.workunit.client.0.smithi152.stdout:9/540: link d5/d6/f3c d5/d39/d3f/fab 0 2024-04-06T12:24:04.009 INFO:tasks.workunit.client.0.smithi152.stdout:1/613: chown d2/d2f/d54/d88/f34 88 1 2024-04-06T12:24:04.017 INFO:tasks.workunit.client.0.smithi152.stdout:2/726: rename d0/d40/d41/d63/l85 to d0/d15/lf1 0 2024-04-06T12:24:04.023 INFO:tasks.workunit.client.0.smithi152.stdout:7/694: rename d8/df/d28/l29 to d8/df/d28/d87/le2 0 2024-04-06T12:24:04.026 INFO:tasks.workunit.client.0.smithi152.stdout:9/541: getdents d5/d39/d3f/d42/d9b 0 2024-04-06T12:24:04.027 INFO:tasks.workunit.client.0.smithi152.stdout:9/542: chown d5/d6/d74/d17/d37/d5d/c8a 6771275 1 2024-04-06T12:24:04.028 INFO:tasks.workunit.client.0.smithi152.stdout:2/727: fsync d0/d40/d26/db4/fd7 0 2024-04-06T12:24:04.028 INFO:tasks.workunit.client.0.smithi152.stdout:9/543: fdatasync d5/d6/d74/d17/d23/d2d/d32/f57 0 2024-04-06T12:24:04.033 INFO:tasks.workunit.client.0.smithi152.stdout:1/614: rename d2/d2f/d54/d88/d9c/db3/dd3/ld6 to d2/d61/d8f/ld9 0 2024-04-06T12:24:04.034 INFO:tasks.workunit.client.0.smithi152.stdout:1/615: chown d2/d2f/d54/d88/d9c/dc5/l75 3 1 2024-04-06T12:24:04.036 INFO:tasks.workunit.client.0.smithi152.stdout:1/616: read d2/d2f/d54/f7f [62660,57273] 0 2024-04-06T12:24:04.046 INFO:tasks.workunit.client.0.smithi152.stdout:9/544: dread d5/d6/d74/d17/d23/d2d/d4b/d5a/f6f [0,4194304] 0 2024-04-06T12:24:04.046 INFO:tasks.workunit.client.0.smithi152.stdout:8/814: dwrite d4/dc/d10/d49/da0/dc0/d9d/dbe/f34 [0,4194304] 0 2024-04-06T12:24:04.052 INFO:tasks.workunit.client.0.smithi152.stdout:1/617: mkdir d2/d2f/d54/d88/da4/dda 0 2024-04-06T12:24:04.060 INFO:tasks.workunit.client.0.smithi152.stdout:9/545: mknod d5/d6/d74/d17/d23/d2d/d4b/cac 0 2024-04-06T12:24:04.062 INFO:tasks.workunit.client.0.smithi152.stdout:1/618: readlink d2/d5d/d6d/l7e 0 2024-04-06T12:24:04.063 INFO:tasks.workunit.client.0.smithi152.stdout:1/619: chown d2/d1d/d3b/f56 108 1 2024-04-06T12:24:04.065 INFO:tasks.workunit.client.0.smithi152.stdout:2/728: truncate d0/d40/d41/d63/fc1 84125 0 2024-04-06T12:24:04.066 INFO:tasks.workunit.client.0.smithi152.stdout:7/695: getdents d8/df/d61/d6d/d85 0 2024-04-06T12:24:04.067 INFO:tasks.workunit.client.0.smithi152.stdout:2/729: write d0/d40/d41/d28/d54/f7c [941874,84012] 0 2024-04-06T12:24:04.067 INFO:tasks.workunit.client.0.smithi152.stdout:7/696: stat d8/df/d28/d41/dd4/d43 0 2024-04-06T12:24:04.068 INFO:tasks.workunit.client.0.smithi152.stdout:2/730: readlink d0/d15/d24/d3d/l97 0 2024-04-06T12:24:04.069 INFO:tasks.workunit.client.0.smithi152.stdout:9/546: fsync d5/fb 0 2024-04-06T12:24:04.077 INFO:tasks.workunit.client.0.smithi152.stdout:9/547: dread d5/d6/d74/d17/f75 [0,4194304] 0 2024-04-06T12:24:04.078 INFO:tasks.workunit.client.0.smithi152.stdout:8/815: dwrite d4/d2c/f115 [0,4194304] 0 2024-04-06T12:24:04.078 INFO:tasks.workunit.client.0.smithi152.stdout:7/697: write d8/df/d34/d63/f92 [604642,34578] 0 2024-04-06T12:24:04.082 INFO:tasks.workunit.client.0.smithi152.stdout:2/731: mkdir d0/d15/d24/d3d/de3/db2/df2 0 2024-04-06T12:24:04.085 INFO:tasks.workunit.client.0.smithi152.stdout:1/620: mknod d2/db2/dbb/cdb 0 2024-04-06T12:24:04.092 INFO:tasks.workunit.client.0.smithi152.stdout:2/732: truncate d0/d15/d24/f8e 5197627 0 2024-04-06T12:24:04.093 INFO:tasks.workunit.client.0.smithi152.stdout:1/621: truncate d2/d61/d85/fb4 477005 0 2024-04-06T12:24:04.095 INFO:tasks.workunit.client.0.smithi152.stdout:7/698: mkdir d8/df/d61/d76/d7e/de3 0 2024-04-06T12:24:04.096 INFO:tasks.workunit.client.0.smithi152.stdout:9/548: dread d5/d6/fd [0,4194304] 0 2024-04-06T12:24:04.097 INFO:tasks.workunit.client.0.smithi152.stdout:2/733: creat d0/d40/d26/db4/de6/ff3 x:0 0 0 2024-04-06T12:24:04.099 INFO:tasks.workunit.client.0.smithi152.stdout:2/734: write d0/d15/d24/d79/d80/fc4 [348940,33349] 0 2024-04-06T12:24:04.100 INFO:tasks.workunit.client.0.smithi152.stdout:2/735: fdatasync d0/dae/fd5 0 2024-04-06T12:24:04.101 INFO:tasks.workunit.client.0.smithi152.stdout:2/736: chown d0/dae/fcb 176 1 2024-04-06T12:24:04.104 INFO:tasks.workunit.client.0.smithi152.stdout:9/549: rename d5/d6/d74/d17/d23/l92 to d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/lad 0 2024-04-06T12:24:04.105 INFO:tasks.workunit.client.0.smithi152.stdout:7/699: dread d8/df/d61/d76/d7e/f54 [0,4194304] 0 2024-04-06T12:24:04.106 INFO:tasks.workunit.client.0.smithi152.stdout:7/700: chown d8/df/d34/d5c/f82 506473929 1 2024-04-06T12:24:04.109 INFO:tasks.workunit.client.0.smithi152.stdout:1/622: write d2/f80 [594905,39742] 0 2024-04-06T12:24:04.117 INFO:tasks.workunit.client.0.smithi152.stdout:7/701: chown d8/df/d61/d3d/l35 1 1 2024-04-06T12:24:04.120 INFO:tasks.workunit.client.0.smithi152.stdout:1/623: mknod d2/d2f/d37/dae/cdc 0 2024-04-06T12:24:04.121 INFO:tasks.workunit.client.0.smithi152.stdout:9/550: creat d5/d39/d79/daa/fae x:0 0 0 2024-04-06T12:24:04.123 INFO:tasks.workunit.client.0.smithi152.stdout:9/551: read d5/d39/d3f/d42/f5b [2467587,123519] 0 2024-04-06T12:24:04.125 INFO:tasks.workunit.client.0.smithi152.stdout:2/737: rename d0/d2/d6f/d90/f81 to d0/ff4 0 2024-04-06T12:24:04.126 INFO:tasks.workunit.client.0.smithi152.stdout:2/738: write d0/d15/d24/d3d/de3/f9d [491023,52817] 0 2024-04-06T12:24:04.126 INFO:tasks.workunit.client.0.smithi152.stdout:7/702: rename d8/df/d28/d41/dd4/d8c/d2d/da3/d65 to d8/df/d28/d41/dd4/d8c/d2d/da3/de4 0 2024-04-06T12:24:04.128 INFO:tasks.workunit.client.0.smithi152.stdout:1/624: fdatasync d2/d1d/d3b/f56 0 2024-04-06T12:24:04.134 INFO:tasks.workunit.client.0.smithi152.stdout:7/703: creat d8/df/d61/d3d/dac/fe5 x:0 0 0 2024-04-06T12:24:04.139 INFO:tasks.workunit.client.0.smithi152.stdout:9/552: dread - d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fa8 zero size 2024-04-06T12:24:04.142 INFO:tasks.workunit.client.0.smithi152.stdout:1/625: truncate d2/f16 1547140 0 2024-04-06T12:24:04.143 INFO:tasks.workunit.client.0.smithi152.stdout:1/626: chown d2/d61/d85 20 1 2024-04-06T12:24:04.143 INFO:tasks.workunit.client.0.smithi152.stdout:1/627: write d2/d61/f6c [890891,85294] 0 2024-04-06T12:24:04.144 INFO:tasks.workunit.client.0.smithi152.stdout:1/628: chown d2/d1d/d7c/lc6 501 1 2024-04-06T12:24:04.147 INFO:tasks.workunit.client.0.smithi152.stdout:7/704: dread d8/df/d28/d41/dd4/d79/d81/f95 [0,4194304] 0 2024-04-06T12:24:04.155 INFO:tasks.workunit.client.0.smithi152.stdout:2/739: write d0/d40/d26/db4/fd7 [1038678,128211] 0 2024-04-06T12:24:04.162 INFO:tasks.workunit.client.0.smithi152.stdout:7/705: mknod d8/df/d28/d41/dd4/d8c/d59/daa/ce6 0 2024-04-06T12:24:04.166 INFO:tasks.workunit.client.0.smithi152.stdout:7/706: mknod d8/df/d34/d63/ce7 0 2024-04-06T12:24:04.169 INFO:tasks.workunit.client.0.smithi152.stdout:9/553: dwrite d5/d6/f49 [4194304,4194304] 0 2024-04-06T12:24:04.172 INFO:tasks.workunit.client.0.smithi152.stdout:7/707: stat d8/df/d61/d4b/d56/db8 0 2024-04-06T12:24:04.173 INFO:tasks.workunit.client.0.smithi152.stdout:2/740: creat d0/d2/d6f/d90/d9e/db5/ff5 x:0 0 0 2024-04-06T12:24:04.176 INFO:tasks.workunit.client.0.smithi152.stdout:1/629: dwrite d2/d2f/d54/f7f [0,4194304] 0 2024-04-06T12:24:04.182 INFO:tasks.workunit.client.0.smithi152.stdout:7/708: mkdir d8/df/d28/d75/de8 0 2024-04-06T12:24:04.183 INFO:tasks.workunit.client.0.smithi152.stdout:9/554: chown d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/lad 14 1 2024-04-06T12:24:04.188 INFO:tasks.workunit.client.0.smithi152.stdout:9/555: stat d5/d6/d74/d17/d37/c44 0 2024-04-06T12:24:04.188 INFO:tasks.workunit.client.0.smithi152.stdout:7/709: stat d8/df/d28/d41/dd4/d8c/d59/cb7 0 2024-04-06T12:24:04.189 INFO:tasks.workunit.client.0.smithi152.stdout:2/741: dwrite d0/d2/d6f/d90/d9e/db5/d92/fd6 [0,4194304] 0 2024-04-06T12:24:04.191 INFO:tasks.workunit.client.0.smithi152.stdout:2/742: readlink d0/d40/d26/le0 0 2024-04-06T12:24:04.193 INFO:tasks.workunit.client.0.smithi152.stdout:1/630: dwrite d2/d2f/d54/d88/d9c/dc5/fc1 [4194304,4194304] 0 2024-04-06T12:24:04.197 INFO:tasks.workunit.client.0.smithi152.stdout:1/631: symlink d2/d5d/ldd 0 2024-04-06T12:24:04.198 INFO:tasks.workunit.client.0.smithi152.stdout:7/710: symlink d8/df/d28/d41/dd4/d8c/d2d/d7a/le9 0 2024-04-06T12:24:04.200 INFO:tasks.workunit.client.0.smithi152.stdout:6/767: sync 2024-04-06T12:24:04.200 INFO:tasks.workunit.client.0.smithi152.stdout:0/881: sync 2024-04-06T12:24:04.200 INFO:tasks.workunit.client.0.smithi152.stdout:5/660: sync 2024-04-06T12:24:04.200 INFO:tasks.workunit.client.0.smithi152.stdout:4/797: sync 2024-04-06T12:24:04.203 INFO:tasks.workunit.client.0.smithi152.stdout:1/632: creat d2/d2f/d54/d88/da4/fde x:0 0 0 2024-04-06T12:24:04.203 INFO:tasks.workunit.client.0.smithi152.stdout:4/798: stat d7/d29/d78/c42 0 2024-04-06T12:24:04.204 INFO:tasks.workunit.client.0.smithi152.stdout:5/661: dread - d3/de/d80/fbb zero size 2024-04-06T12:24:04.206 INFO:tasks.workunit.client.0.smithi152.stdout:1/633: rmdir d2/d2f/d37 39 2024-04-06T12:24:04.208 INFO:tasks.workunit.client.0.smithi152.stdout:4/799: chown d7/d16/d22/d3f/db4/f50 110798 1 2024-04-06T12:24:04.209 INFO:tasks.workunit.client.0.smithi152.stdout:7/711: mkdir d8/df/d28/d75/dea 0 2024-04-06T12:24:04.211 INFO:tasks.workunit.client.0.smithi152.stdout:6/768: fdatasync d7/d19/d1b/d31/d35/fbd 0 2024-04-06T12:24:04.211 INFO:tasks.workunit.client.0.smithi152.stdout:9/556: dwrite d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fa8 [0,4194304] 0 2024-04-06T12:24:04.215 INFO:tasks.workunit.client.0.smithi152.stdout:9/557: write d5/d6/f95 [943154,112323] 0 2024-04-06T12:24:04.218 INFO:tasks.workunit.client.0.smithi152.stdout:5/662: symlink d3/de/da9/ld5 0 2024-04-06T12:24:04.219 INFO:tasks.workunit.client.0.smithi152.stdout:1/634: dwrite d2/d2f/d45/fa8 [0,4194304] 0 2024-04-06T12:24:04.220 INFO:tasks.workunit.client.0.smithi152.stdout:7/712: mknod d8/d2a/d42/ceb 0 2024-04-06T12:24:04.221 INFO:tasks.workunit.client.0.smithi152.stdout:1/635: readlink d2/d5d/ldd 0 2024-04-06T12:24:04.223 INFO:tasks.workunit.client.0.smithi152.stdout:9/558: write d5/d6/f14 [4339570,54979] 0 2024-04-06T12:24:04.225 INFO:tasks.workunit.client.0.smithi152.stdout:1/636: readlink d2/d2f/d54/d88/d9c/dc5/l75 0 2024-04-06T12:24:04.234 INFO:tasks.workunit.client.0.smithi152.stdout:5/663: rename d3/da/d15/d40/d4f/f66 to d3/d9/fd6 0 2024-04-06T12:24:04.237 INFO:tasks.workunit.client.0.smithi152.stdout:1/637: mkdir d2/d5d/ddf 0 2024-04-06T12:24:04.238 INFO:tasks.workunit.client.0.smithi152.stdout:5/664: read - d3/de/fb8 zero size 2024-04-06T12:24:04.242 INFO:tasks.workunit.client.0.smithi152.stdout:4/800: truncate d7/d82/db1/db6/ff0 29508 0 2024-04-06T12:24:04.242 INFO:tasks.workunit.client.0.smithi152.stdout:2/743: dwrite d0/d40/f62 [4194304,4194304] 0 2024-04-06T12:24:04.245 INFO:tasks.workunit.client.0.smithi152.stdout:0/882: dwrite d4/d19/f53 [0,4194304] 0 2024-04-06T12:24:04.245 INFO:tasks.workunit.client.0.smithi152.stdout:7/713: dwrite d8/df/d28/d41/dd4/d8c/d2d/d7a/fca [0,4194304] 0 2024-04-06T12:24:04.246 INFO:tasks.workunit.client.0.smithi152.stdout:1/638: chown d2/d2f/d54/d88/d9c/dc5/dad/d8c 1 1 2024-04-06T12:24:04.249 INFO:tasks.workunit.client.0.smithi152.stdout:9/559: rmdir d5/d6/d74/d9e 0 2024-04-06T12:24:04.252 INFO:tasks.workunit.client.0.smithi152.stdout:9/560: fdatasync d5/d6/f2c 0 2024-04-06T12:24:04.256 INFO:tasks.workunit.client.0.smithi152.stdout:6/769: dread d7/d19/d3e/f9a [0,4194304] 0 2024-04-06T12:24:04.259 INFO:tasks.workunit.client.0.smithi152.stdout:0/883: fsync d4/fa 0 2024-04-06T12:24:04.262 INFO:tasks.workunit.client.0.smithi152.stdout:3/739: sync 2024-04-06T12:24:04.263 INFO:tasks.workunit.client.0.smithi152.stdout:5/665: mkdir d3/da/d15/d40/d50/dd7 0 2024-04-06T12:24:04.265 INFO:tasks.workunit.client.0.smithi152.stdout:1/639: mknod d2/d61/d8f/ce0 0 2024-04-06T12:24:04.265 INFO:tasks.workunit.client.0.smithi152.stdout:2/744: dread d0/f60 [0,4194304] 0 2024-04-06T12:24:04.265 INFO:tasks.workunit.client.0.smithi152.stdout:7/714: dwrite d8/df/d61/fe [4194304,4194304] 0 2024-04-06T12:24:04.268 INFO:tasks.workunit.client.0.smithi152.stdout:3/740: write d0/d1f/d44/d7c/db8/fc9 [319314,114044] 0 2024-04-06T12:24:04.275 INFO:tasks.workunit.client.0.smithi152.stdout:1/640: symlink d2/d61/d85/le1 0 2024-04-06T12:24:04.280 INFO:tasks.workunit.client.0.smithi152.stdout:6/770: creat d7/d19/d1b/db2/de6/ffe x:0 0 0 2024-04-06T12:24:04.286 INFO:tasks.workunit.client.0.smithi152.stdout:5/666: write d3/da/d15/d40/d50/f95 [2461517,82054] 0 2024-04-06T12:24:04.291 INFO:tasks.workunit.client.0.smithi152.stdout:3/741: unlink d0/d35/d43/d48/fd2 0 2024-04-06T12:24:04.293 INFO:tasks.workunit.client.0.smithi152.stdout:7/715: dwrite d8/df/d61/d4b/f69 [0,4194304] 0 2024-04-06T12:24:04.293 INFO:tasks.workunit.client.0.smithi152.stdout:3/742: fdatasync d0/d1f/d44/f7b 0 2024-04-06T12:24:04.294 INFO:tasks.workunit.client.0.smithi152.stdout:6/771: dread d7/d9/f48 [0,4194304] 0 2024-04-06T12:24:04.294 INFO:tasks.workunit.client.0.smithi152.stdout:4/801: rename d7/d16/d22/c3b to d7/d29/c100 0 2024-04-06T12:24:04.297 INFO:tasks.workunit.client.0.smithi152.stdout:2/745: creat d0/d2/ff6 x:0 0 0 2024-04-06T12:24:04.297 INFO:tasks.workunit.client.0.smithi152.stdout:9/561: link d5/d39/d3f/d42/c4f d5/d6/d74/caf 0 2024-04-06T12:24:04.298 INFO:tasks.workunit.client.0.smithi152.stdout:5/667: mkdir d3/da/d15/d2b/d3f/d6d/dd1/dd8 0 2024-04-06T12:24:04.299 INFO:tasks.workunit.client.0.smithi152.stdout:2/746: fdatasync d0/d40/d41/d28/d8c/fed 0 2024-04-06T12:24:04.302 INFO:tasks.workunit.client.0.smithi152.stdout:4/802: dwrite d7/d29/d2e/f8a [0,4194304] 0 2024-04-06T12:24:04.302 INFO:tasks.workunit.client.0.smithi152.stdout:1/641: dread d2/d2f/d37/f4a [0,4194304] 0 2024-04-06T12:24:04.306 INFO:tasks.workunit.client.0.smithi152.stdout:7/716: creat d8/df/d28/d41/dd4/d49/fec x:0 0 0 2024-04-06T12:24:04.312 INFO:tasks.workunit.client.0.smithi152.stdout:9/562: dread d5/d6/f95 [0,4194304] 0 2024-04-06T12:24:04.321 INFO:tasks.workunit.client.0.smithi152.stdout:6/772: mkdir d7/d19/d1b/d31/d7c/dff 0 2024-04-06T12:24:04.324 INFO:tasks.workunit.client.0.smithi152.stdout:1/642: dread d2/d2f/f9b [0,4194304] 0 2024-04-06T12:24:04.333 INFO:tasks.workunit.client.0.smithi152.stdout:9/563: unlink d5/d6/l45 0 2024-04-06T12:24:04.334 INFO:tasks.workunit.client.0.smithi152.stdout:9/564: read - d5/d6/d74/f97 zero size 2024-04-06T12:24:04.337 INFO:tasks.workunit.client.0.smithi152.stdout:0/884: rename d4/d31/f6b to d4/de/d28/f119 0 2024-04-06T12:24:04.340 INFO:tasks.workunit.client.0.smithi152.stdout:2/747: write d0/f60 [421697,41105] 0 2024-04-06T12:24:04.341 INFO:tasks.workunit.client.0.smithi152.stdout:7/717: creat d8/df/d28/d41/dd4/d8c/d2d/da3/de4/ddc/fed x:0 0 0 2024-04-06T12:24:04.342 INFO:tasks.workunit.client.0.smithi152.stdout:7/718: fdatasync d8/df/d61/d3d/fd1 0 2024-04-06T12:24:04.342 INFO:tasks.workunit.client.0.smithi152.stdout:1/643: mkdir d2/d2f/daf/de2 0 2024-04-06T12:24:04.343 INFO:tasks.workunit.client.0.smithi152.stdout:1/644: chown d2/d2f/d45 115636059 1 2024-04-06T12:24:04.343 INFO:tasks.workunit.client.0.smithi152.stdout:7/719: chown d8/df/d28/d41/dd4/d43/d8a/d9d/dc9/dd0 22620 1 2024-04-06T12:24:04.345 INFO:tasks.workunit.client.0.smithi152.stdout:3/743: link d0/d2d/f78 d0/d35/d43/fea 0 2024-04-06T12:24:04.350 INFO:tasks.workunit.client.0.smithi152.stdout:9/565: readlink d5/d6/d74/d17/d23/l29 0 2024-04-06T12:24:04.352 INFO:tasks.workunit.client.0.smithi152.stdout:7/720: dwrite d8/f6f [0,4194304] 0 2024-04-06T12:24:04.354 INFO:tasks.workunit.client.0.smithi152.stdout:6/773: mknod d7/d19/d1b/d1f/c100 0 2024-04-06T12:24:04.354 INFO:tasks.workunit.client.0.smithi152.stdout:9/566: chown d5/d6/d74/d17/d23/d2d/d98 251069883 1 2024-04-06T12:24:04.357 INFO:tasks.workunit.client.0.smithi152.stdout:2/748: mkdir d0/dae/df7 0 2024-04-06T12:24:04.358 INFO:tasks.workunit.client.0.smithi152.stdout:5/668: dwrite d3/de/d8e/f9b [0,4194304] 0 2024-04-06T12:24:04.392 INFO:tasks.workunit.client.0.smithi152.stdout:3/744: dread d0/d1f/d28/f76 [4194304,4194304] 0 2024-04-06T12:24:04.425 INFO:tasks.workunit.client.0.smithi152.stdout:2/749: mknod d0/d40/d41/d28/d8c/cf8 0 2024-04-06T12:24:04.440 INFO:tasks.workunit.client.0.smithi152.stdout:6/774: dread d7/d19/d1b/d22/f29 [0,4194304] 0 2024-04-06T12:24:04.440 INFO:tasks.workunit.client.0.smithi152.stdout:5/669: dread d3/da/d15/d2b/d3f/d4c/f67 [0,4194304] 0 2024-04-06T12:24:04.447 INFO:tasks.workunit.client.0.smithi152.stdout:3/745: mkdir d0/d10/d13/d2a/d93/deb 0 2024-04-06T12:24:04.448 INFO:tasks.workunit.client.0.smithi152.stdout:3/746: dread - d0/d10/d1e/fc4 zero size 2024-04-06T12:24:04.448 INFO:tasks.workunit.client.0.smithi152.stdout:0/885: getdents d4/de/d28/d18/d43/d8a 0 2024-04-06T12:24:04.462 INFO:tasks.workunit.client.0.smithi152.stdout:0/886: symlink d4/d31/d47/d89/l11a 0 2024-04-06T12:24:04.464 INFO:tasks.workunit.client.0.smithi152.stdout:8/816: sync 2024-04-06T12:24:04.467 INFO:tasks.workunit.client.0.smithi152.stdout:6/775: mkdir d7/d9/d26/dd6/d101 0 2024-04-06T12:24:04.469 INFO:tasks.workunit.client.0.smithi152.stdout:5/670: mkdir d3/da/d15/d2b/d3f/d6d/dc6/dd9 0 2024-04-06T12:24:04.474 INFO:tasks.workunit.client.0.smithi152.stdout:2/750: creat d0/d2/ff9 x:0 0 0 2024-04-06T12:24:04.484 INFO:tasks.workunit.client.0.smithi152.stdout:5/671: symlink d3/da/d15/d2b/dbd/lda 0 2024-04-06T12:24:04.486 INFO:tasks.workunit.client.0.smithi152.stdout:5/672: write d3/de/d80/fbb [607225,26607] 0 2024-04-06T12:24:04.487 INFO:tasks.workunit.client.0.smithi152.stdout:2/751: dread d0/d40/d41/d63/fc1 [0,4194304] 0 2024-04-06T12:24:04.488 INFO:tasks.workunit.client.0.smithi152.stdout:2/752: readlink d0/d40/d26/l78 0 2024-04-06T12:24:04.489 INFO:tasks.workunit.client.0.smithi152.stdout:0/887: fdatasync d4/de/f1e 0 2024-04-06T12:24:04.490 INFO:tasks.workunit.client.0.smithi152.stdout:8/817: symlink d4/db/d56/dcb/l119 0 2024-04-06T12:24:04.492 INFO:tasks.workunit.client.0.smithi152.stdout:0/888: chown d4/de/d28/d18/d43/d81/c10a 1658 1 2024-04-06T12:24:04.492 INFO:tasks.workunit.client.0.smithi152.stdout:8/818: chown d4/db/d56/f86 5254824 1 2024-04-06T12:24:04.494 INFO:tasks.workunit.client.0.smithi152.stdout:3/747: rename d0/l3a to d0/lec 0 2024-04-06T12:24:04.498 INFO:tasks.workunit.client.0.smithi152.stdout:2/753: creat d0/d40/d41/d28/d54/ffa x:0 0 0 2024-04-06T12:24:04.501 INFO:tasks.workunit.client.0.smithi152.stdout:8/819: rmdir d4/d2c/dbf 39 2024-04-06T12:24:04.503 INFO:tasks.workunit.client.0.smithi152.stdout:0/889: read d4/de/d28/d18/d43/d62/daa/df0/ff2 [120584,110657] 0 2024-04-06T12:24:04.507 INFO:tasks.workunit.client.0.smithi152.stdout:3/748: truncate d0/d1f/f9c 177793 0 2024-04-06T12:24:04.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/749: write d0/d1f/d44/d7c/db8/fc9 [331095,16849] 0 2024-04-06T12:24:04.512 INFO:tasks.workunit.client.0.smithi152.stdout:0/890: mkdir d4/de/d28/d18/d43/d62/dd4/d11b 0 2024-04-06T12:24:04.516 INFO:tasks.workunit.client.0.smithi152.stdout:2/754: rename d0/d40/d41/d28/d8c/ca4 to d0/d40/d41/d63/cfb 0 2024-04-06T12:24:04.520 INFO:tasks.workunit.client.0.smithi152.stdout:0/891: symlink d4/de/d28/d18/d43/d8a/l11c 0 2024-04-06T12:24:04.522 INFO:tasks.workunit.client.0.smithi152.stdout:2/755: fsync d0/d40/d41/d28/d54/f7e 0 2024-04-06T12:24:04.523 INFO:tasks.workunit.client.0.smithi152.stdout:2/756: chown d0 27910 1 2024-04-06T12:24:04.524 INFO:tasks.workunit.client.0.smithi152.stdout:0/892: creat d4/de/d28/d18/d3b/d2e/dcb/f11d x:0 0 0 2024-04-06T12:24:04.529 INFO:tasks.workunit.client.0.smithi152.stdout:0/893: symlink d4/de/d28/d18/d43/d62/daa/df0/l11e 0 2024-04-06T12:24:04.532 INFO:tasks.workunit.client.0.smithi152.stdout:8/820: dread d4/d2c/dbf/da3/fb9 [0,4194304] 0 2024-04-06T12:24:04.538 INFO:tasks.workunit.client.0.smithi152.stdout:2/757: dread d0/fd [0,4194304] 0 2024-04-06T12:24:04.542 INFO:tasks.workunit.client.0.smithi152.stdout:0/894: dread d4/de/d28/f22 [0,4194304] 0 2024-04-06T12:24:04.542 INFO:tasks.workunit.client.0.smithi152.stdout:0/895: dread - d4/d107/fe9 zero size 2024-04-06T12:24:04.543 INFO:tasks.workunit.client.0.smithi152.stdout:9/567: dwrite d5/d6/d74/d17/d23/d2d/f6b [4194304,4194304] 0 2024-04-06T12:24:04.545 INFO:tasks.workunit.client.0.smithi152.stdout:8/821: mknod d4/d2c/dbf/c11a 0 2024-04-06T12:24:04.546 INFO:tasks.workunit.client.0.smithi152.stdout:9/568: read d5/d6/d74/d17/f75 [419650,590] 0 2024-04-06T12:24:04.546 INFO:tasks.workunit.client.0.smithi152.stdout:8/822: chown d4/db/d32/c112 16207632 1 2024-04-06T12:24:04.552 INFO:tasks.workunit.client.0.smithi152.stdout:5/673: creat d3/da/d15/d2b/d3f/fdb x:0 0 0 2024-04-06T12:24:04.553 INFO:tasks.workunit.client.0.smithi152.stdout:5/674: write d3/fd2 [1037724,13205] 0 2024-04-06T12:24:04.556 INFO:tasks.workunit.client.0.smithi152.stdout:2/758: dread d0/d40/f56 [0,4194304] 0 2024-04-06T12:24:04.558 INFO:tasks.workunit.client.0.smithi152.stdout:5/675: fsync d3/d9/fb 0 2024-04-06T12:24:04.559 INFO:tasks.workunit.client.0.smithi152.stdout:5/676: fsync d3/da/d15/d2b/d3f/db9/fbe 0 2024-04-06T12:24:04.561 INFO:tasks.workunit.client.0.smithi152.stdout:8/823: dread d4/db/d56/f69 [0,4194304] 0 2024-04-06T12:24:04.563 INFO:tasks.workunit.client.0.smithi152.stdout:5/677: mkdir d3/ddc 0 2024-04-06T12:24:04.564 INFO:tasks.workunit.client.0.smithi152.stdout:8/824: creat d4/dc/d10/d49/da0/dc0/d9d/f11b x:0 0 0 2024-04-06T12:24:04.564 INFO:tasks.workunit.client.0.smithi152.stdout:5/678: fdatasync d3/da/d15/d2b/d3f/d68/d81/f3b 0 2024-04-06T12:24:04.565 INFO:tasks.workunit.client.0.smithi152.stdout:2/759: dread d0/d40/d26/f83 [0,4194304] 0 2024-04-06T12:24:04.566 INFO:tasks.workunit.client.0.smithi152.stdout:2/760: stat d0/d40/d26/f8f 0 2024-04-06T12:24:04.568 INFO:tasks.workunit.client.0.smithi152.stdout:8/825: creat d4/d2c/dbf/da3/f11c x:0 0 0 2024-04-06T12:24:04.569 INFO:tasks.workunit.client.0.smithi152.stdout:2/761: creat d0/d40/d41/d28/d8c/ffc x:0 0 0 2024-04-06T12:24:04.570 INFO:tasks.workunit.client.0.smithi152.stdout:2/762: readlink d0/d15/d24/l31 0 2024-04-06T12:24:04.573 INFO:tasks.workunit.client.0.smithi152.stdout:2/763: truncate d0/d15/d24/d3d/fd4 671468 0 2024-04-06T12:24:04.574 INFO:tasks.workunit.client.0.smithi152.stdout:2/764: fsync d0/d40/d41/d28/fab 0 2024-04-06T12:24:04.575 INFO:tasks.workunit.client.0.smithi152.stdout:2/765: dread - d0/d40/d26/f8f zero size 2024-04-06T12:24:04.581 INFO:tasks.workunit.client.0.smithi152.stdout:2/766: fdatasync d0/d2/d6f/d90/d9e/db5/d3a/f8a 0 2024-04-06T12:24:04.581 INFO:tasks.workunit.client.0.smithi152.stdout:8/826: dread d4/d2c/d2b/f44 [0,4194304] 0 2024-04-06T12:24:04.583 INFO:tasks.workunit.client.0.smithi152.stdout:1/645: link d2/d2f/d37/dae/cdc d2/d2f/d54/d88/d9c/dc5/ce3 0 2024-04-06T12:24:04.586 INFO:tasks.workunit.client.0.smithi152.stdout:1/646: write d2/d2f/d54/d88/d9c/db3/fb9 [271684,53029] 0 2024-04-06T12:24:04.587 INFO:tasks.workunit.client.0.smithi152.stdout:6/776: dwrite d7/fb [0,4194304] 0 2024-04-06T12:24:04.591 INFO:tasks.workunit.client.0.smithi152.stdout:8/827: creat d4/d2c/d114/f11d x:0 0 0 2024-04-06T12:24:04.591 INFO:tasks.workunit.client.0.smithi152.stdout:2/767: mkdir d0/d2/dfd 0 2024-04-06T12:24:04.594 INFO:tasks.workunit.client.0.smithi152.stdout:2/768: chown d0/d40/d41/d28/d54/f7c 199001 1 2024-04-06T12:24:04.596 INFO:tasks.workunit.client.0.smithi152.stdout:1/647: dwrite d2/d2f/d54/f7f [0,4194304] 0 2024-04-06T12:24:04.598 INFO:tasks.workunit.client.0.smithi152.stdout:1/648: truncate d2/d2f/d54/d88/fd1 813248 0 2024-04-06T12:24:04.602 INFO:tasks.workunit.client.0.smithi152.stdout:9/569: creat d5/d39/fb0 x:0 0 0 2024-04-06T12:24:04.604 INFO:tasks.workunit.client.0.smithi152.stdout:8/828: mkdir d4/db/d11e 0 2024-04-06T12:24:04.610 INFO:tasks.workunit.client.0.smithi152.stdout:9/570: mkdir d5/d6/d74/d17/d23/d2d/d32/db1 0 2024-04-06T12:24:04.613 INFO:tasks.workunit.client.0.smithi152.stdout:8/829: mkdir d4/d5f/da7/d11f 0 2024-04-06T12:24:04.616 INFO:tasks.workunit.client.0.smithi152.stdout:9/571: creat d5/d39/d79/daa/fb2 x:0 0 0 2024-04-06T12:24:04.624 INFO:tasks.workunit.client.0.smithi152.stdout:5/679: write d3/d9/fb [151994,104387] 0 2024-04-06T12:24:04.625 INFO:tasks.workunit.client.0.smithi152.stdout:9/572: mknod d5/d6/d74/d17/d86/cb3 0 2024-04-06T12:24:04.634 INFO:tasks.workunit.client.0.smithi152.stdout:5/680: dwrite d3/da/d15/d2b/d3f/d6d/db1/fc5 [0,4194304] 0 2024-04-06T12:24:04.635 INFO:tasks.workunit.client.0.smithi152.stdout:5/681: read - d3/da/d15/fb7 zero size 2024-04-06T12:24:04.638 INFO:tasks.workunit.client.0.smithi152.stdout:8/830: getdents d4/d2c/d54 0 2024-04-06T12:24:04.642 INFO:tasks.workunit.client.0.smithi152.stdout:9/573: creat d5/d6/d74/fb4 x:0 0 0 2024-04-06T12:24:04.643 INFO:tasks.workunit.client.0.smithi152.stdout:9/574: chown d5 32 1 2024-04-06T12:24:04.648 INFO:tasks.workunit.client.0.smithi152.stdout:8/831: creat d4/dc/d10/d49/da2/f120 x:0 0 0 2024-04-06T12:24:04.655 INFO:tasks.workunit.client.0.smithi152.stdout:6/777: write d7/d9/d26/d4a/f58 [945499,73641] 0 2024-04-06T12:24:04.656 INFO:tasks.workunit.client.0.smithi152.stdout:6/778: readlink d7/d9/d26/dcc/lda 0 2024-04-06T12:24:04.657 INFO:tasks.workunit.client.0.smithi152.stdout:9/575: dread d5/d39/d79/f7c [0,4194304] 0 2024-04-06T12:24:04.660 INFO:tasks.workunit.client.0.smithi152.stdout:1/649: write d2/d61/fa6 [221587,33488] 0 2024-04-06T12:24:04.667 INFO:tasks.workunit.client.0.smithi152.stdout:2/769: dwrite d0/d15/d24/fe4 [0,4194304] 0 2024-04-06T12:24:04.673 INFO:tasks.workunit.client.0.smithi152.stdout:6/779: creat d7/d19/d3e/d70/f102 x:0 0 0 2024-04-06T12:24:04.674 INFO:tasks.workunit.client.0.smithi152.stdout:9/576: link d5/d6/d74/d17/d23/d2d/l90 d5/d39/d79/lb5 0 2024-04-06T12:24:04.674 INFO:tasks.workunit.client.0.smithi152.stdout:1/650: dread d2/f16 [0,4194304] 0 2024-04-06T12:24:04.676 INFO:tasks.workunit.client.0.smithi152.stdout:9/577: write d5/d6/f24 [663039,11029] 0 2024-04-06T12:24:04.680 INFO:tasks.workunit.client.0.smithi152.stdout:6/780: symlink d7/d19/d1b/d22/l103 0 2024-04-06T12:24:04.682 INFO:tasks.workunit.client.0.smithi152.stdout:6/781: dread - d7/d19/d1b/d31/d7c/fd9 zero size 2024-04-06T12:24:04.684 INFO:tasks.workunit.client.0.smithi152.stdout:1/651: dwrite d2/d2f/d37/dae/fbf [0,4194304] 0 2024-04-06T12:24:04.685 INFO:tasks.workunit.client.0.smithi152.stdout:6/782: stat d7/d19/d3e/f40 0 2024-04-06T12:24:04.686 INFO:tasks.workunit.client.0.smithi152.stdout:2/770: dread d0/d2/f2c [0,4194304] 0 2024-04-06T12:24:04.694 INFO:tasks.workunit.client.0.smithi152.stdout:9/578: mkdir d5/d39/d3f/d42/db6 0 2024-04-06T12:24:04.695 INFO:tasks.workunit.client.0.smithi152.stdout:6/783: dwrite f3 [4194304,4194304] 0 2024-04-06T12:24:04.695 INFO:tasks.workunit.client.0.smithi152.stdout:1/652: mknod d2/d61/d85/ce4 0 2024-04-06T12:24:04.697 INFO:tasks.workunit.client.0.smithi152.stdout:9/579: write d5/d6/d74/d17/d23/d2d/d32/d36/f9d [80815,39376] 0 2024-04-06T12:24:04.699 INFO:tasks.workunit.client.0.smithi152.stdout:2/771: dwrite d0/d2/d6f/fbb [4194304,4194304] 0 2024-04-06T12:24:04.700 INFO:tasks.workunit.client.0.smithi152.stdout:6/784: truncate d7/d9/d26/d4a/f58 1275886 0 2024-04-06T12:24:04.701 INFO:tasks.workunit.client.0.smithi152.stdout:2/772: chown d0/d15/d24/d79/d80/c95 7484538 1 2024-04-06T12:24:04.712 INFO:tasks.workunit.client.0.smithi152.stdout:1/653: rmdir d2/d2f 39 2024-04-06T12:24:04.713 INFO:tasks.workunit.client.0.smithi152.stdout:5/682: write d3/da/d15/d40/d50/f61 [246949,60946] 0 2024-04-06T12:24:04.713 INFO:tasks.workunit.client.0.smithi152.stdout:6/785: chown d7/d19/d3e/d70/f7e 53810 1 2024-04-06T12:24:04.725 INFO:tasks.workunit.client.0.smithi152.stdout:8/832: dwrite d4/db/f13 [0,4194304] 0 2024-04-06T12:24:04.729 INFO:tasks.workunit.client.0.smithi152.stdout:5/683: dread d3/da/d15/d40/d50/f7e [0,4194304] 0 2024-04-06T12:24:04.759 INFO:tasks.workunit.client.0.smithi152.stdout:2/773: creat d0/dae/df7/ffe x:0 0 0 2024-04-06T12:24:04.761 INFO:tasks.workunit.client.0.smithi152.stdout:2/774: dread - d0/d15/d24/fda zero size 2024-04-06T12:24:04.762 INFO:tasks.workunit.client.0.smithi152.stdout:1/654: mkdir d2/d61/de5 0 2024-04-06T12:24:04.762 INFO:tasks.workunit.client.0.smithi152.stdout:2/775: write d0/d2/d6f/fbb [4376447,129869] 0 2024-04-06T12:24:04.764 INFO:tasks.workunit.client.0.smithi152.stdout:2/776: write d0/d15/d24/f72 [857984,111768] 0 2024-04-06T12:24:04.768 INFO:tasks.workunit.client.0.smithi152.stdout:8/833: unlink d4/db/d56/dcb/ddb/f113 0 2024-04-06T12:24:04.769 INFO:tasks.workunit.client.0.smithi152.stdout:5/684: readlink d3/da/d15/d7f/lc3 0 2024-04-06T12:24:04.770 INFO:tasks.workunit.client.0.smithi152.stdout:9/580: creat d5/d39/fb7 x:0 0 0 2024-04-06T12:24:04.772 INFO:tasks.workunit.client.0.smithi152.stdout:1/655: truncate d2/d61/d8f/fd8 214098 0 2024-04-06T12:24:04.773 INFO:tasks.workunit.client.0.smithi152.stdout:9/581: fdatasync d5/d6/d74/d17/d23/d2d/f8f 0 2024-04-06T12:24:04.775 INFO:tasks.workunit.client.0.smithi152.stdout:5/685: read d3/d9/fd6 [2198803,45849] 0 2024-04-06T12:24:04.776 INFO:tasks.workunit.client.0.smithi152.stdout:2/777: truncate d0/d40/d26/db4/de6/ff3 210229 0 2024-04-06T12:24:04.777 INFO:tasks.workunit.client.0.smithi152.stdout:5/686: stat d3/da/d15/d40/d50/l9d 0 2024-04-06T12:24:04.780 INFO:tasks.workunit.client.0.smithi152.stdout:6/786: link d7/d9/d26/d4a/f58 d7/d62/f104 0 2024-04-06T12:24:04.783 INFO:tasks.workunit.client.0.smithi152.stdout:6/787: stat d7/d9/d73/l96 0 2024-04-06T12:24:04.785 INFO:tasks.workunit.client.0.smithi152.stdout:6/788: fdatasync f6 0 2024-04-06T12:24:04.789 INFO:tasks.workunit.client.0.smithi152.stdout:6/789: read f6 [4192247,110135] 0 2024-04-06T12:24:04.789 INFO:tasks.workunit.client.0.smithi152.stdout:8/834: symlink d4/d2c/l121 0 2024-04-06T12:24:04.790 INFO:tasks.workunit.client.0.smithi152.stdout:8/835: chown d4/db/c93 10859 1 2024-04-06T12:24:04.792 INFO:tasks.workunit.client.0.smithi152.stdout:5/687: mknod d3/da/d15/cdd 0 2024-04-06T12:24:04.795 INFO:tasks.workunit.client.0.smithi152.stdout:1/656: unlink d2/d2f/d54/d88/da4/fab 0 2024-04-06T12:24:04.795 INFO:tasks.workunit.client.0.smithi152.stdout:8/836: rmdir d4/dc/d10/d49/da0 39 2024-04-06T12:24:04.797 INFO:tasks.workunit.client.0.smithi152.stdout:6/790: symlink d7/l105 0 2024-04-06T12:24:04.798 INFO:tasks.workunit.client.0.smithi152.stdout:5/688: truncate d3/de/f2e 3713147 0 2024-04-06T12:24:04.800 INFO:tasks.workunit.client.0.smithi152.stdout:2/778: dread d0/d2/f7f [0,4194304] 0 2024-04-06T12:24:04.801 INFO:tasks.workunit.client.0.smithi152.stdout:2/779: readlink d0/d15/d24/d3d/lb0 0 2024-04-06T12:24:04.805 INFO:tasks.workunit.client.0.smithi152.stdout:1/657: link d2/d2f/d54/f57 d2/d61/d8f/fe6 0 2024-04-06T12:24:04.805 INFO:tasks.workunit.client.0.smithi152.stdout:8/837: chown d4/dc/d10/d49/da0/dc0/d9d/dbe/c1c 222526 1 2024-04-06T12:24:04.807 INFO:tasks.workunit.client.0.smithi152.stdout:2/780: creat d0/d2/d6f/d90/fff x:0 0 0 2024-04-06T12:24:04.808 INFO:tasks.workunit.client.0.smithi152.stdout:5/689: mkdir d3/de/dde 0 2024-04-06T12:24:04.811 INFO:tasks.workunit.client.0.smithi152.stdout:8/838: rename d4/dc/f40 to d4/dc/d10/d51/f122 0 2024-04-06T12:24:04.815 INFO:tasks.workunit.client.0.smithi152.stdout:1/658: dwrite d2/d1d/d3b/dc3/d9f/fb8 [0,4194304] 0 2024-04-06T12:24:04.815 INFO:tasks.workunit.client.0.smithi152.stdout:8/839: unlink d4/dc/fd 0 2024-04-06T12:24:04.818 INFO:tasks.workunit.client.0.smithi152.stdout:2/781: dwrite d0/d15/d24/d3d/fd4 [0,4194304] 0 2024-04-06T12:24:04.827 INFO:tasks.workunit.client.0.smithi152.stdout:1/659: mknod d2/d1d/d3b/dc3/ce7 0 2024-04-06T12:24:04.827 INFO:tasks.workunit.client.0.smithi152.stdout:2/782: mknod d0/d15/d24/d79/d80/c100 0 2024-04-06T12:24:04.828 INFO:tasks.workunit.client.0.smithi152.stdout:1/660: chown d2/fb6 539164 1 2024-04-06T12:24:04.829 INFO:tasks.workunit.client.0.smithi152.stdout:8/840: creat d4/dc/df5/f123 x:0 0 0 2024-04-06T12:24:04.829 INFO:tasks.workunit.client.0.smithi152.stdout:2/783: fsync d0/d15/d24/d3d/de3/db2/fac 0 2024-04-06T12:24:04.834 INFO:tasks.workunit.client.0.smithi152.stdout:2/784: creat d0/d2/dfd/f101 x:0 0 0 2024-04-06T12:24:04.835 INFO:tasks.workunit.client.0.smithi152.stdout:2/785: readlink d0/d15/d24/lb8 0 2024-04-06T12:24:04.837 INFO:tasks.workunit.client.0.smithi152.stdout:2/786: read d0/d15/d24/f98 [3863599,38817] 0 2024-04-06T12:24:04.838 INFO:tasks.workunit.client.0.smithi152.stdout:1/661: dread d2/f39 [0,4194304] 0 2024-04-06T12:24:04.839 INFO:tasks.workunit.client.0.smithi152.stdout:2/787: dread - d0/d40/d26/fef zero size 2024-04-06T12:24:04.877 INFO:tasks.workunit.client.0.smithi152.stdout:9/582: dwrite d5/d6/f50 [0,4194304] 0 2024-04-06T12:24:04.881 INFO:tasks.workunit.client.0.smithi152.stdout:4/803: sync 2024-04-06T12:24:04.889 INFO:tasks.workunit.client.0.smithi152.stdout:6/791: dwrite d7/d62/fbb [0,4194304] 0 2024-04-06T12:24:04.896 INFO:tasks.workunit.client.0.smithi152.stdout:6/792: dread - d7/d19/d1b/d1f/d3d/fa5 zero size 2024-04-06T12:24:04.897 INFO:tasks.workunit.client.0.smithi152.stdout:5/690: write d3/da/d15/d2b/d3f/d68/d81/f45 [8621358,26835] 0 2024-04-06T12:24:04.899 INFO:tasks.workunit.client.0.smithi152.stdout:4/804: mknod d7/d29/d7e/c101 0 2024-04-06T12:24:04.903 INFO:tasks.workunit.client.0.smithi152.stdout:9/583: dread d5/d6/d74/d17/f46 [0,4194304] 0 2024-04-06T12:24:04.905 INFO:tasks.workunit.client.0.smithi152.stdout:4/805: fdatasync d7/d29/d2e/d5b/fb3 0 2024-04-06T12:24:04.907 INFO:tasks.workunit.client.0.smithi152.stdout:6/793: dwrite d7/fad [0,4194304] 0 2024-04-06T12:24:04.907 INFO:tasks.workunit.client.0.smithi152.stdout:4/806: chown d7/d29/d7e 130241 1 2024-04-06T12:24:04.908 INFO:tasks.workunit.client.0.smithi152.stdout:8/841: write d4/d2c/d54/f75 [4095595,99979] 0 2024-04-06T12:24:04.917 INFO:tasks.workunit.client.0.smithi152.stdout:6/794: unlink d7/d9/f10 0 2024-04-06T12:24:04.918 INFO:tasks.workunit.client.0.smithi152.stdout:2/788: write d0/d40/f51 [1518150,18606] 0 2024-04-06T12:24:04.920 INFO:tasks.workunit.client.0.smithi152.stdout:4/807: unlink d7/d16/d22/f69 0 2024-04-06T12:24:04.920 INFO:tasks.workunit.client.0.smithi152.stdout:1/662: dwrite d2/f13 [0,4194304] 0 2024-04-06T12:24:04.922 INFO:tasks.workunit.client.0.smithi152.stdout:2/789: write d0/d15/d24/d79/f7a [457564,84518] 0 2024-04-06T12:24:04.931 INFO:tasks.workunit.client.0.smithi152.stdout:5/691: link d3/de/f22 d3/da/d15/d2b/d3f/d68/d81/fdf 0 2024-04-06T12:24:04.932 INFO:tasks.workunit.client.0.smithi152.stdout:5/692: chown d3/da/d15/d2b/d3f/d4c/f67 267265448 1 2024-04-06T12:24:04.941 INFO:tasks.workunit.client.0.smithi152.stdout:4/808: creat d7/d29/d2e/d5b/db2/f102 x:0 0 0 2024-04-06T12:24:04.942 INFO:tasks.workunit.client.0.smithi152.stdout:4/809: read - d7/d16/f83 zero size 2024-04-06T12:24:04.943 INFO:tasks.workunit.client.0.smithi152.stdout:2/790: mknod d0/d15/d24/d3d/de3/c102 0 2024-04-06T12:24:04.947 INFO:tasks.workunit.client.0.smithi152.stdout:9/584: creat d5/d39/d3f/fb8 x:0 0 0 2024-04-06T12:24:04.948 INFO:tasks.workunit.client.0.smithi152.stdout:5/693: readlink d3/da/d15/d40/d50/l3d 0 2024-04-06T12:24:04.952 INFO:tasks.workunit.client.0.smithi152.stdout:6/795: symlink d7/d19/d3e/d70/l106 0 2024-04-06T12:24:04.952 INFO:tasks.workunit.client.0.smithi152.stdout:9/585: dread d5/d6/f24 [0,4194304] 0 2024-04-06T12:24:04.953 INFO:tasks.workunit.client.0.smithi152.stdout:6/796: chown d7/d9/d26/dcc/lda 5043375 1 2024-04-06T12:24:04.953 INFO:tasks.workunit.client.0.smithi152.stdout:9/586: chown d5/d39/d79/daa/fae 422 1 2024-04-06T12:24:04.964 INFO:tasks.workunit.client.0.smithi152.stdout:6/797: symlink d7/d19/d1b/d31/l107 0 2024-04-06T12:24:04.967 INFO:tasks.workunit.client.0.smithi152.stdout:9/587: symlink d5/d6/d74/d17/d37/d5d/lb9 0 2024-04-06T12:24:04.968 INFO:tasks.workunit.client.0.smithi152.stdout:4/810: mknod d7/d16/d22/d3f/c103 0 2024-04-06T12:24:04.968 INFO:tasks.workunit.client.0.smithi152.stdout:8/842: write d4/db/d32/f52 [1059881,90682] 0 2024-04-06T12:24:04.970 INFO:tasks.workunit.client.0.smithi152.stdout:4/811: readlink d7/d29/d7e/d59/l54 0 2024-04-06T12:24:04.972 INFO:tasks.workunit.client.0.smithi152.stdout:9/588: dread d5/d6/d74/d17/f84 [0,4194304] 0 2024-04-06T12:24:04.973 INFO:tasks.workunit.client.0.smithi152.stdout:9/589: truncate d5/d39/fb7 430609 0 2024-04-06T12:24:04.978 INFO:tasks.workunit.client.0.smithi152.stdout:8/843: creat d4/db/d56/dcb/d6e/dd4/f124 x:0 0 0 2024-04-06T12:24:04.980 INFO:tasks.workunit.client.0.smithi152.stdout:2/791: rename d0/d40/d26/db4/de6/ff3 to d0/d15/f103 0 2024-04-06T12:24:04.981 INFO:tasks.workunit.client.0.smithi152.stdout:1/663: creat d2/d2f/daf/de2/fe8 x:0 0 0 2024-04-06T12:24:04.982 INFO:tasks.workunit.client.0.smithi152.stdout:9/590: creat d5/d6/d74/d17/d86/fba x:0 0 0 2024-04-06T12:24:04.987 INFO:tasks.workunit.client.0.smithi152.stdout:6/798: rename d7/d19/d1b/d31/lfa to d7/d9/d26/dd6/l108 0 2024-04-06T12:24:04.989 INFO:tasks.workunit.client.0.smithi152.stdout:2/792: chown d0/d15/d24/d79/lec 63516 1 2024-04-06T12:24:04.991 INFO:tasks.workunit.client.0.smithi152.stdout:9/591: rmdir d5/d6/d74/d17/d23/d2d/d98 39 2024-04-06T12:24:04.994 INFO:tasks.workunit.client.0.smithi152.stdout:8/844: rename d4/db/d32/l5a to d4/d5f/da7/d11f/l125 0 2024-04-06T12:24:04.998 INFO:tasks.workunit.client.0.smithi152.stdout:2/793: symlink d0/d2/d6f/d90/l104 0 2024-04-06T12:24:04.999 INFO:tasks.workunit.client.0.smithi152.stdout:9/592: mkdir d5/d6/d74/d17/d23/d2d/d32/dbb 0 2024-04-06T12:24:05.001 INFO:tasks.workunit.client.0.smithi152.stdout:4/812: getdents d7/d16/d22 0 2024-04-06T12:24:05.012 INFO:tasks.workunit.client.0.smithi152.stdout:8/845: mknod d4/dc/d10/d49/da0/d102/c126 0 2024-04-06T12:24:05.013 INFO:tasks.workunit.client.0.smithi152.stdout:1/664: getdents d2/d5d/d6d 0 2024-04-06T12:24:05.019 INFO:tasks.workunit.client.0.smithi152.stdout:6/799: dwrite d7/d19/d1b/d22/fcf [0,4194304] 0 2024-04-06T12:24:05.021 INFO:tasks.workunit.client.0.smithi152.stdout:4/813: rename d7/d16/d22/dc7/dc8/fc6 to d7/d16/d55/da0/f104 0 2024-04-06T12:24:05.021 INFO:tasks.workunit.client.0.smithi152.stdout:6/800: readlink d7/d19/d1b/d22/l49 0 2024-04-06T12:24:05.022 INFO:tasks.workunit.client.0.smithi152.stdout:2/794: dwrite d0/d40/f93 [0,4194304] 0 2024-04-06T12:24:05.026 INFO:tasks.workunit.client.0.smithi152.stdout:2/795: dread d0/d15/d24/d79/d80/fc4 [0,4194304] 0 2024-04-06T12:24:05.026 INFO:tasks.workunit.client.0.smithi152.stdout:1/665: truncate d2/d2f/fbe 581875 0 2024-04-06T12:24:05.029 INFO:tasks.workunit.client.0.smithi152.stdout:2/796: chown d0/d2/d6f/d90/d9e/db5/d92/fd6 126912375 1 2024-04-06T12:24:05.029 INFO:tasks.workunit.client.0.smithi152.stdout:9/593: rmdir d5/d39/d3f/d42/d9b 0 2024-04-06T12:24:05.031 INFO:tasks.workunit.client.0.smithi152.stdout:2/797: chown d0/d2/d6f/d90/d9e/db5 3 1 2024-04-06T12:24:05.034 INFO:tasks.workunit.client.0.smithi152.stdout:1/666: stat d2/d2f/d54/d88/d9c/db3 0 2024-04-06T12:24:05.047 INFO:tasks.workunit.client.0.smithi152.stdout:4/814: dread d7/d29/d7e/d59/fac [0,4194304] 0 2024-04-06T12:24:05.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:03.585955+0000 mgr.smithi195.ausetj (mgr.24375) 86 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 100 MiB/s wr, 251 op/s 2024-04-06T12:24:05.133 INFO:tasks.workunit.client.0.smithi152.stdout:7/721: sync 2024-04-06T12:24:05.136 INFO:tasks.workunit.client.0.smithi152.stdout:6/801: creat d7/f109 x:0 0 0 2024-04-06T12:24:05.137 INFO:tasks.workunit.client.0.smithi152.stdout:4/815: symlink d7/d29/d2e/d5b/l105 0 2024-04-06T12:24:05.137 INFO:tasks.workunit.client.0.smithi152.stdout:9/594: rmdir d5/d6/d74/d17/d23/d2d/d98 39 2024-04-06T12:24:05.138 INFO:tasks.workunit.client.0.smithi152.stdout:9/595: fdatasync d5/d39/fb7 0 2024-04-06T12:24:05.141 INFO:tasks.workunit.client.0.smithi152.stdout:1/667: fdatasync d2/d2f/d54/d88/f40 0 2024-04-06T12:24:05.142 INFO:tasks.workunit.client.0.smithi152.stdout:8/846: link d4/dc/d10/d49/da0/dc0/db6/lfc d4/db/d56/d85/dce/l127 0 2024-04-06T12:24:05.144 INFO:tasks.workunit.client.0.smithi152.stdout:1/668: dread d2/d2f/d54/d88/fd1 [0,4194304] 0 2024-04-06T12:24:05.146 INFO:tasks.workunit.client.0.smithi152.stdout:7/722: truncate d8/df/d61/d76/d7e/f54 1512224 0 2024-04-06T12:24:05.146 INFO:tasks.workunit.client.0.smithi152.stdout:1/669: truncate d2/d2f/d54/d88/d9c/dc5/f87 409433 0 2024-04-06T12:24:05.147 INFO:tasks.workunit.client.0.smithi152.stdout:6/802: fdatasync d7/d19/f8d 0 2024-04-06T12:24:05.151 INFO:tasks.workunit.client.0.smithi152.stdout:4/816: chown d7/d29/d7e/l6f 2620 1 2024-04-06T12:24:05.154 INFO:tasks.workunit.client.0.smithi152.stdout:9/596: creat d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fbc x:0 0 0 2024-04-06T12:24:05.156 INFO:tasks.workunit.client.0.smithi152.stdout:2/798: creat d0/d2/d6f/d90/d9e/db5/f105 x:0 0 0 2024-04-06T12:24:05.163 INFO:tasks.workunit.client.0.smithi152.stdout:7/723: mkdir d8/df/d61/d3d/d53/dee 0 2024-04-06T12:24:05.164 INFO:tasks.workunit.client.0.smithi152.stdout:7/724: write d8/df/d34/d63/f92 [52361,86805] 0 2024-04-06T12:24:05.166 INFO:tasks.workunit.client.0.smithi152.stdout:6/803: rmdir d7/d9/d26/d2e 39 2024-04-06T12:24:05.168 INFO:tasks.workunit.client.0.smithi152.stdout:6/804: readlink d7/d9/d26/dcc/lda 0 2024-04-06T12:24:05.171 INFO:tasks.workunit.client.0.smithi152.stdout:4/817: mkdir d7/d29/df2/d106 0 2024-04-06T12:24:05.171 INFO:tasks.workunit.client.0.smithi152.stdout:8/847: dread d4/dc/f5b [0,4194304] 0 2024-04-06T12:24:05.171 INFO:tasks.workunit.client.0.smithi152.stdout:4/818: chown d7/d82 3436541 1 2024-04-06T12:24:05.177 INFO:tasks.workunit.client.0.smithi152.stdout:8/848: dwrite d4/fbb [0,4194304] 0 2024-04-06T12:24:05.180 INFO:tasks.workunit.client.0.smithi152.stdout:7/725: dread d8/df/d28/d41/dd4/d79/fba [0,4194304] 0 2024-04-06T12:24:05.197 INFO:tasks.workunit.client.0.smithi152.stdout:2/799: fdatasync d0/d40/d41/d28/d8c/faa 0 2024-04-06T12:24:05.204 INFO:tasks.workunit.client.0.smithi152.stdout:1/670: mknod d2/d2f/d37/dae/db5/ce9 0 2024-04-06T12:24:05.207 INFO:tasks.workunit.client.0.smithi152.stdout:6/805: write d7/d19/f9d [79526,7676] 0 2024-04-06T12:24:05.208 INFO:tasks.workunit.client.0.smithi152.stdout:9/597: link d5/d6/d74/d17/d86/f8e d5/d6/d74/fbd 0 2024-04-06T12:24:05.209 INFO:tasks.workunit.client.0.smithi152.stdout:4/819: mkdir d7/d16/d22/d95/dcf/d107 0 2024-04-06T12:24:05.215 INFO:tasks.workunit.client.0.smithi152.stdout:9/598: dwrite d5/d6/d74/d17/d23/d2d/d32/d36/f9d [0,4194304] 0 2024-04-06T12:24:05.217 INFO:tasks.workunit.client.0.smithi152.stdout:8/849: symlink d4/d2c/db0/l128 0 2024-04-06T12:24:05.219 INFO:tasks.workunit.client.0.smithi152.stdout:1/671: rmdir d2/d2f/d54/d88/d9c 39 2024-04-06T12:24:05.224 INFO:tasks.workunit.client.0.smithi152.stdout:2/800: mkdir d0/dc9/de9/d106 0 2024-04-06T12:24:05.227 INFO:tasks.workunit.client.0.smithi152.stdout:1/672: dwrite d2/f13 [4194304,4194304] 0 2024-04-06T12:24:05.228 INFO:tasks.workunit.client.0.smithi152.stdout:1/673: read d2/d61/d8f/fd8 [155020,5671] 0 2024-04-06T12:24:05.231 INFO:tasks.workunit.client.0.smithi152.stdout:1/674: write d2/d2f/daf/de2/fe8 [567852,9319] 0 2024-04-06T12:24:05.232 INFO:tasks.workunit.client.0.smithi152.stdout:1/675: readlink d2/d5d/l7b 0 2024-04-06T12:24:05.272 INFO:tasks.workunit.client.0.smithi152.stdout:3/750: sync 2024-04-06T12:24:05.272 INFO:tasks.workunit.client.0.smithi152.stdout:0/896: sync 2024-04-06T12:24:05.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:03.585955+0000 mgr.smithi195.ausetj (mgr.24375) 86 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 40 MiB/s rd, 100 MiB/s wr, 251 op/s 2024-04-06T12:24:05.276 INFO:tasks.workunit.client.0.smithi152.stdout:7/726: rename d8/df/d28/d41/dd4/d49/d7b/f8b to d8/df/d28/d41/fef 0 2024-04-06T12:24:05.280 INFO:tasks.workunit.client.0.smithi152.stdout:3/751: dwrite d0/d1f/d44/d7c/db8/fc9 [0,4194304] 0 2024-04-06T12:24:05.287 INFO:tasks.workunit.client.0.smithi152.stdout:2/801: mknod d0/dae/c107 0 2024-04-06T12:24:05.292 INFO:tasks.workunit.client.0.smithi152.stdout:9/599: symlink d5/d6/d74/d17/d23/d2d/d98/d99/lbe 0 2024-04-06T12:24:05.295 INFO:tasks.workunit.client.0.smithi152.stdout:0/897: mkdir d4/d31/d47/d89/d11f 0 2024-04-06T12:24:05.296 INFO:tasks.workunit.client.0.smithi152.stdout:4/820: write d7/d29/d78/f7c [333607,111531] 0 2024-04-06T12:24:05.301 INFO:tasks.workunit.client.0.smithi152.stdout:7/727: chown d8/df/d61/l2f 4945 1 2024-04-06T12:24:05.304 INFO:tasks.workunit.client.0.smithi152.stdout:3/752: dread d0/d1f/d44/f7b [0,4194304] 0 2024-04-06T12:24:05.306 INFO:tasks.workunit.client.0.smithi152.stdout:3/753: fsync d0/d10/d13/d2a/db6/fd7 0 2024-04-06T12:24:05.308 INFO:tasks.workunit.client.0.smithi152.stdout:8/850: dwrite d4/f8 [0,4194304] 0 2024-04-06T12:24:05.308 INFO:tasks.workunit.client.0.smithi152.stdout:3/754: chown d0/d2d/d7f/d8c 2 1 2024-04-06T12:24:05.314 INFO:tasks.workunit.client.0.smithi152.stdout:4/821: dread d7/d16/f96 [0,4194304] 0 2024-04-06T12:24:05.319 INFO:tasks.workunit.client.0.smithi152.stdout:9/600: truncate d5/d6/f2c 2345384 0 2024-04-06T12:24:05.319 INFO:tasks.workunit.client.0.smithi152.stdout:8/851: dwrite d4/db/d56/dcb/f118 [0,4194304] 0 2024-04-06T12:24:05.330 INFO:tasks.workunit.client.0.smithi152.stdout:2/802: creat d0/d2/f108 x:0 0 0 2024-04-06T12:24:05.331 INFO:tasks.workunit.client.0.smithi152.stdout:9/601: dwrite d5/d6/d74/d17/d23/d2d/d32/d36/f85 [4194304,4194304] 0 2024-04-06T12:24:05.331 INFO:tasks.workunit.client.0.smithi152.stdout:4/822: unlink d7/d29/d2e/d7b/f9f 0 2024-04-06T12:24:05.334 INFO:tasks.workunit.client.0.smithi152.stdout:1/676: dwrite d2/d2f/f65 [0,4194304] 0 2024-04-06T12:24:05.334 INFO:tasks.workunit.client.0.smithi152.stdout:4/823: chown d7/d16/d55/c64 80820 1 2024-04-06T12:24:05.335 INFO:tasks.workunit.client.0.smithi152.stdout:0/898: creat d4/de/d28/d18/d3b/d2e/f120 x:0 0 0 2024-04-06T12:24:05.337 INFO:tasks.workunit.client.0.smithi152.stdout:0/899: write f1 [4014197,57890] 0 2024-04-06T12:24:05.338 INFO:tasks.workunit.client.0.smithi152.stdout:3/755: rename d0/d1f/d44/d7c/db8 to d0/d10/d13/d2a/d4b/ded 0 2024-04-06T12:24:05.343 INFO:tasks.workunit.client.0.smithi152.stdout:9/602: mknod d5/d6/d74/d17/d37/d5d/cbf 0 2024-04-06T12:24:05.343 INFO:tasks.workunit.client.0.smithi152.stdout:7/728: dwrite d8/df/d61/f13 [0,4194304] 0 2024-04-06T12:24:05.346 INFO:tasks.workunit.client.0.smithi152.stdout:9/603: dread d5/d39/fb7 [0,4194304] 0 2024-04-06T12:24:05.351 INFO:tasks.workunit.client.0.smithi152.stdout:0/900: mkdir d4/d31/d47/d7e/db9/dcc/dd5/d121 0 2024-04-06T12:24:05.355 INFO:tasks.workunit.client.0.smithi152.stdout:3/756: mkdir d0/d10/d13/d2a/d93/d49/dee 0 2024-04-06T12:24:05.358 INFO:tasks.workunit.client.0.smithi152.stdout:7/729: dwrite d8/df/d61/f13 [4194304,4194304] 0 2024-04-06T12:24:05.358 INFO:tasks.workunit.client.0.smithi152.stdout:9/604: write d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fbc [727746,80350] 0 2024-04-06T12:24:05.359 INFO:tasks.workunit.client.0.smithi152.stdout:2/803: dread d0/d15/d24/f5b [0,4194304] 0 2024-04-06T12:24:05.362 INFO:tasks.workunit.client.0.smithi152.stdout:8/852: link d4/d2c/d2b/d83/cf4 d4/db/d56/dcb/dd5/c129 0 2024-04-06T12:24:05.369 INFO:tasks.workunit.client.0.smithi152.stdout:7/730: dwrite d8/fb [0,4194304] 0 2024-04-06T12:24:05.372 INFO:tasks.workunit.client.0.smithi152.stdout:7/731: readlink d8/df/d28/d41/dd4/d43/d8a/d9d/ld6 0 2024-04-06T12:24:05.378 INFO:tasks.workunit.client.0.smithi152.stdout:4/824: creat d7/f108 x:0 0 0 2024-04-06T12:24:05.382 INFO:tasks.workunit.client.0.smithi152.stdout:8/853: symlink d4/d5f/d98/l12a 0 2024-04-06T12:24:05.384 INFO:tasks.workunit.client.0.smithi152.stdout:1/677: dwrite d2/d2f/d37/f5f [0,4194304] 0 2024-04-06T12:24:05.387 INFO:tasks.workunit.client.0.smithi152.stdout:9/605: unlink d5/c7a 0 2024-04-06T12:24:05.388 INFO:tasks.workunit.client.0.smithi152.stdout:7/732: symlink d8/df/d28/d41/dd4/d8c/d2d/d7a/lf0 0 2024-04-06T12:24:05.392 INFO:tasks.workunit.client.0.smithi152.stdout:0/901: dwrite d4/de/d4a/d33/fa6 [0,4194304] 0 2024-04-06T12:24:05.394 INFO:tasks.workunit.client.0.smithi152.stdout:3/757: dread d0/d1f/d28/f74 [0,4194304] 0 2024-04-06T12:24:05.394 INFO:tasks.workunit.client.0.smithi152.stdout:0/902: write d4/de/d7f/db7/fc3 [3362772,118065] 0 2024-04-06T12:24:05.395 INFO:tasks.workunit.client.0.smithi152.stdout:4/825: write d7/d29/d2e/d5b/db2/dd7/ff9 [1660972,75954] 0 2024-04-06T12:24:05.398 INFO:tasks.workunit.client.0.smithi152.stdout:3/758: fsync d0/d10/d13/d2a/d4b/ded/fc6 0 2024-04-06T12:24:05.398 INFO:tasks.workunit.client.0.smithi152.stdout:8/854: symlink d4/d2c/d54/l12b 0 2024-04-06T12:24:05.399 INFO:tasks.workunit.client.0.smithi152.stdout:0/903: dread - d4/d31/d47/d7e/db9/dcc/ff7 zero size 2024-04-06T12:24:05.401 INFO:tasks.workunit.client.0.smithi152.stdout:3/759: chown d0/d10/c4c 13 1 2024-04-06T12:24:05.403 INFO:tasks.workunit.client.0.smithi152.stdout:7/733: creat d8/df/d34/ff1 x:0 0 0 2024-04-06T12:24:05.404 INFO:tasks.workunit.client.0.smithi152.stdout:7/734: fdatasync d8/df/d28/fc7 0 2024-04-06T12:24:05.405 INFO:tasks.workunit.client.0.smithi152.stdout:9/606: truncate d5/d39/d79/f7f 2628905 0 2024-04-06T12:24:05.409 INFO:tasks.workunit.client.0.smithi152.stdout:3/760: dwrite d0/d10/d13/d2a/d93/d49/d8d/d9e/fb3 [0,4194304] 0 2024-04-06T12:24:05.409 INFO:tasks.workunit.client.0.smithi152.stdout:2/804: creat d0/d40/d41/f109 x:0 0 0 2024-04-06T12:24:05.411 INFO:tasks.workunit.client.0.smithi152.stdout:2/805: readlink d0/d2/d6f/d90/d9e/db5/d3a/d87/lc5 0 2024-04-06T12:24:05.415 INFO:tasks.workunit.client.0.smithi152.stdout:0/904: truncate d4/de/d28/f97 827750 0 2024-04-06T12:24:05.420 INFO:tasks.workunit.client.0.smithi152.stdout:8/855: dread - d4/d2c/d2b/d83/fbc zero size 2024-04-06T12:24:05.426 INFO:tasks.workunit.client.0.smithi152.stdout:1/678: write d2/f11 [1481538,130167] 0 2024-04-06T12:24:05.427 INFO:tasks.workunit.client.0.smithi152.stdout:9/607: creat d5/d39/d3f/d42/fc0 x:0 0 0 2024-04-06T12:24:05.430 INFO:tasks.workunit.client.0.smithi152.stdout:4/826: dread d7/d16/d55/da0/f94 [0,4194304] 0 2024-04-06T12:24:05.431 INFO:tasks.workunit.client.0.smithi152.stdout:4/827: fdatasync d7/d29/d7e/f67 0 2024-04-06T12:24:05.432 INFO:tasks.workunit.client.0.smithi152.stdout:2/806: fdatasync d0/d2/d6f/d90/d9e/db5/fe 0 2024-04-06T12:24:05.432 INFO:tasks.workunit.client.0.smithi152.stdout:4/828: fsync d7/d29/f65 0 2024-04-06T12:24:05.435 INFO:tasks.workunit.client.0.smithi152.stdout:0/905: mkdir d4/de/d28/d18/d122 0 2024-04-06T12:24:05.435 INFO:tasks.workunit.client.0.smithi152.stdout:0/906: fdatasync f1 0 2024-04-06T12:24:05.442 INFO:tasks.workunit.client.0.smithi152.stdout:8/856: dwrite d4/dc/d10/d51/f8f [4194304,4194304] 0 2024-04-06T12:24:05.444 INFO:tasks.workunit.client.0.smithi152.stdout:9/608: symlink d5/d6/d74/d17/d23/d2d/d98/lc1 0 2024-04-06T12:24:05.455 INFO:tasks.workunit.client.0.smithi152.stdout:3/761: write d0/d1f/fc7 [632203,80744] 0 2024-04-06T12:24:05.455 INFO:tasks.workunit.client.0.smithi152.stdout:4/829: creat d7/d16/d22/dc7/f109 x:0 0 0 2024-04-06T12:24:05.456 INFO:tasks.workunit.client.0.smithi152.stdout:4/830: stat d7/d16/d22/d3f/fe8 0 2024-04-06T12:24:05.457 INFO:tasks.workunit.client.0.smithi152.stdout:2/807: rename d0/d2/dfd to d0/dc9/de9/d106/d10a 0 2024-04-06T12:24:05.457 INFO:tasks.workunit.client.0.smithi152.stdout:4/831: fsync d7/d29/d2e/f9a 0 2024-04-06T12:24:05.465 INFO:tasks.workunit.client.0.smithi152.stdout:1/679: write d2/d61/d8f/fe6 [2018962,62334] 0 2024-04-06T12:24:05.467 INFO:tasks.workunit.client.0.smithi152.stdout:0/907: dread d4/d31/f3d [0,4194304] 0 2024-04-06T12:24:05.468 INFO:tasks.workunit.client.0.smithi152.stdout:1/680: truncate d2/d2f/daf/de2/fe8 936102 0 2024-04-06T12:24:05.474 INFO:tasks.workunit.client.0.smithi152.stdout:8/857: creat d4/dc/d10/d51/f12c x:0 0 0 2024-04-06T12:24:05.475 INFO:tasks.workunit.client.0.smithi152.stdout:8/858: write d4/dc/d10/d49/da2/f120 [62522,89913] 0 2024-04-06T12:24:05.482 INFO:tasks.workunit.client.0.smithi152.stdout:2/808: symlink d0/d2/d6f/d90/l10b 0 2024-04-06T12:24:05.486 INFO:tasks.workunit.client.0.smithi152.stdout:7/735: getdents d8/df/d61/d3d/d6e 0 2024-04-06T12:24:05.487 INFO:tasks.workunit.client.0.smithi152.stdout:1/681: creat d2/d2f/daf/fea x:0 0 0 2024-04-06T12:24:05.488 INFO:tasks.workunit.client.0.smithi152.stdout:0/908: truncate d4/de/d4a/fb6 179564 0 2024-04-06T12:24:05.490 INFO:tasks.workunit.client.0.smithi152.stdout:9/609: getdents d5/d6/d74/da0 0 2024-04-06T12:24:05.490 INFO:tasks.workunit.client.0.smithi152.stdout:0/909: chown d4/d31/d47/d7e/db9/dcc/dd5/ce2 1 1 2024-04-06T12:24:05.491 INFO:tasks.workunit.client.0.smithi152.stdout:9/610: dread - d5/d39/d3f/fb8 zero size 2024-04-06T12:24:05.496 INFO:tasks.workunit.client.0.smithi152.stdout:7/736: creat d8/df/d61/d6d/ff2 x:0 0 0 2024-04-06T12:24:05.505 INFO:tasks.workunit.client.0.smithi152.stdout:2/809: mkdir d0/d40/d41/d10c 0 2024-04-06T12:24:05.515 INFO:tasks.workunit.client.0.smithi152.stdout:7/737: mknod d8/df/d28/d41/dd4/d8c/cf3 0 2024-04-06T12:24:05.518 INFO:tasks.workunit.client.0.smithi152.stdout:3/762: dwrite d0/d2d/f78 [0,4194304] 0 2024-04-06T12:24:05.518 INFO:tasks.workunit.client.0.smithi152.stdout:5/694: sync 2024-04-06T12:24:05.523 INFO:tasks.workunit.client.0.smithi152.stdout:0/910: unlink d4/c10 0 2024-04-06T12:24:05.525 INFO:tasks.workunit.client.0.smithi152.stdout:3/763: dread d0/d10/d1e/f46 [0,4194304] 0 2024-04-06T12:24:05.526 INFO:tasks.workunit.client.0.smithi152.stdout:0/911: readlink d4/de/d28/d18/d3b/d2e/dcb/l10f 0 2024-04-06T12:24:05.531 INFO:tasks.workunit.client.0.smithi152.stdout:1/682: link d2/c3d d2/d2f/daf/de2/ceb 0 2024-04-06T12:24:05.535 INFO:tasks.workunit.client.0.smithi152.stdout:1/683: truncate d2/d2f/f65 4472549 0 2024-04-06T12:24:05.536 INFO:tasks.workunit.client.0.smithi152.stdout:9/611: dwrite d5/d6/d74/fbd [0,4194304] 0 2024-04-06T12:24:05.538 INFO:tasks.workunit.client.0.smithi152.stdout:9/612: chown d5/d39/d3f/d42/l4e 209 1 2024-04-06T12:24:05.539 INFO:tasks.workunit.client.0.smithi152.stdout:8/859: getdents d4/d81 0 2024-04-06T12:24:05.540 INFO:tasks.workunit.client.0.smithi152.stdout:8/860: fsync d4/d2c/d114/f116 0 2024-04-06T12:24:05.541 INFO:tasks.workunit.client.0.smithi152.stdout:8/861: write d4/db/d56/f86 [4951337,101410] 0 2024-04-06T12:24:05.542 INFO:tasks.workunit.client.0.smithi152.stdout:3/764: mkdir d0/d10/d13/d2a/d4b/d6a/def 0 2024-04-06T12:24:05.547 INFO:tasks.workunit.client.0.smithi152.stdout:4/832: rename d7/d16/d22/d95/dda/cde to d7/d16/d22/d3f/db4/d60/c10a 0 2024-04-06T12:24:05.549 INFO:tasks.workunit.client.0.smithi152.stdout:7/738: mkdir d8/df/d61/d3d/d53/dee/df4 0 2024-04-06T12:24:05.551 INFO:tasks.workunit.client.0.smithi152.stdout:5/695: unlink d3/de/f2e 0 2024-04-06T12:24:05.558 INFO:tasks.workunit.client.0.smithi152.stdout:1/684: chown d2/d2f/d45 2300221 1 2024-04-06T12:24:05.558 INFO:tasks.workunit.client.0.smithi152.stdout:9/613: dread d5/d39/d3f/d42/f5b [0,4194304] 0 2024-04-06T12:24:05.559 INFO:tasks.workunit.client.0.smithi152.stdout:1/685: chown d2/d2f/d37/dae 47112386 1 2024-04-06T12:24:05.561 INFO:tasks.workunit.client.0.smithi152.stdout:2/810: rmdir d0/d40/d26/db4/de6 0 2024-04-06T12:24:05.561 INFO:tasks.workunit.client.0.smithi152.stdout:1/686: read d2/f10 [2398232,42590] 0 2024-04-06T12:24:05.567 INFO:tasks.workunit.client.0.smithi152.stdout:8/862: rename d4/db/d39/f66 to d4/d2c/dbf/f12d 0 2024-04-06T12:24:05.568 INFO:tasks.workunit.client.0.smithi152.stdout:4/833: mkdir d7/d29/d2e/d7b/d10b 0 2024-04-06T12:24:05.570 INFO:tasks.workunit.client.0.smithi152.stdout:7/739: fdatasync d8/df/d61/d3d/f39 0 2024-04-06T12:24:05.571 INFO:tasks.workunit.client.0.smithi152.stdout:4/834: dread d7/d16/d22/d3f/fe8 [0,4194304] 0 2024-04-06T12:24:05.571 INFO:tasks.workunit.client.0.smithi152.stdout:5/696: mknod d3/de/da9/ce0 0 2024-04-06T12:24:05.571 INFO:tasks.workunit.client.0.smithi152.stdout:7/740: chown d8/df/d34/d63 67 1 2024-04-06T12:24:05.580 INFO:tasks.workunit.client.0.smithi152.stdout:1/687: unlink d2/d2f/d54/f95 0 2024-04-06T12:24:05.591 INFO:tasks.workunit.client.0.smithi152.stdout:8/863: rename d4/d2c/dbf/fc2 to d4/dc/d10/d107/f12e 0 2024-04-06T12:24:05.595 INFO:tasks.workunit.client.0.smithi152.stdout:3/765: truncate d0/d2d/f78 2282220 0 2024-04-06T12:24:05.597 INFO:tasks.workunit.client.0.smithi152.stdout:3/766: write d0/d10/d1e/d71/fb7 [1139125,23597] 0 2024-04-06T12:24:05.599 INFO:tasks.workunit.client.0.smithi152.stdout:7/741: rmdir d8/df/d28/d41/dd4/d8c/d2d/d7a 39 2024-04-06T12:24:05.605 INFO:tasks.workunit.client.0.smithi152.stdout:8/864: truncate d4/dc/d10/d49/f72 966831 0 2024-04-06T12:24:05.609 INFO:tasks.workunit.client.0.smithi152.stdout:9/614: creat d5/fc2 x:0 0 0 2024-04-06T12:24:05.611 INFO:tasks.workunit.client.0.smithi152.stdout:1/688: dread d2/d2f/d54/d88/d9c/dc5/dad/f30 [0,4194304] 0 2024-04-06T12:24:05.613 INFO:tasks.workunit.client.0.smithi152.stdout:4/835: dread d7/d16/d55/f99 [0,4194304] 0 2024-04-06T12:24:05.614 INFO:tasks.workunit.client.0.smithi152.stdout:2/811: creat d0/d40/f10d x:0 0 0 2024-04-06T12:24:05.617 INFO:tasks.workunit.client.0.smithi152.stdout:7/742: creat d8/df/d28/d41/dd4/d8c/d59/daa/ff5 x:0 0 0 2024-04-06T12:24:05.618 INFO:tasks.workunit.client.0.smithi152.stdout:7/743: fsync d8/df/d61/d6d/ff2 0 2024-04-06T12:24:05.619 INFO:tasks.workunit.client.0.smithi152.stdout:7/744: readlink d8/df/d28/d41/dd4/d79/lbe 0 2024-04-06T12:24:05.619 INFO:tasks.workunit.client.0.smithi152.stdout:8/865: fdatasync d4/d2c/dbf/db2/dba/fe7 0 2024-04-06T12:24:05.620 INFO:tasks.workunit.client.0.smithi152.stdout:8/866: readlink d4/l4d 0 2024-04-06T12:24:05.622 INFO:tasks.workunit.client.0.smithi152.stdout:5/697: creat d3/fe1 x:0 0 0 2024-04-06T12:24:05.639 INFO:tasks.workunit.client.0.smithi152.stdout:8/867: readlink d4/d5f/l62 0 2024-04-06T12:24:05.641 INFO:tasks.workunit.client.0.smithi152.stdout:5/698: symlink d3/da/d15/d2b/d3f/d68/le2 0 2024-04-06T12:24:05.644 INFO:tasks.workunit.client.0.smithi152.stdout:3/767: write d0/d10/d1e/f46 [1029078,92116] 0 2024-04-06T12:24:05.645 INFO:tasks.workunit.client.0.smithi152.stdout:9/615: symlink d5/d6/d74/d17/lc3 0 2024-04-06T12:24:05.646 INFO:tasks.workunit.client.0.smithi152.stdout:1/689: symlink d2/d1d/lec 0 2024-04-06T12:24:05.651 INFO:tasks.workunit.client.0.smithi152.stdout:8/868: truncate d4/db/d56/dcb/f3e 1054509 0 2024-04-06T12:24:05.654 INFO:tasks.workunit.client.0.smithi152.stdout:5/699: mknod d3/da/d15/d40/d50/ce3 0 2024-04-06T12:24:05.654 INFO:tasks.workunit.client.0.smithi152.stdout:5/700: readlink d3/de/lad 0 2024-04-06T12:24:05.655 INFO:tasks.workunit.client.0.smithi152.stdout:5/701: readlink d3/de/d80/l8b 0 2024-04-06T12:24:05.655 INFO:tasks.workunit.client.0.smithi152.stdout:3/768: truncate d0/fb 2263014 0 2024-04-06T12:24:05.658 INFO:tasks.workunit.client.0.smithi152.stdout:1/690: symlink d2/d2f/d54/d88/da4/led 0 2024-04-06T12:24:05.658 INFO:tasks.workunit.client.0.smithi152.stdout:4/836: write d7/d29/f2b [3692870,57398] 0 2024-04-06T12:24:05.659 INFO:tasks.workunit.client.0.smithi152.stdout:4/837: chown d7/d29/d78/f39 13300815 1 2024-04-06T12:24:05.664 INFO:tasks.workunit.client.0.smithi152.stdout:2/812: write d0/d15/d24/f36 [3030371,115463] 0 2024-04-06T12:24:05.668 INFO:tasks.workunit.client.0.smithi152.stdout:9/616: symlink d5/d39/d3f/lc4 0 2024-04-06T12:24:05.673 INFO:tasks.workunit.client.0.smithi152.stdout:4/838: creat d7/d29/df2/f10c x:0 0 0 2024-04-06T12:24:05.674 INFO:tasks.workunit.client.0.smithi152.stdout:8/869: dread d4/db/d56/fac [0,4194304] 0 2024-04-06T12:24:05.678 INFO:tasks.workunit.client.0.smithi152.stdout:2/813: unlink d0/d2/d6f/d90/d9e/db5/fe 0 2024-04-06T12:24:05.683 INFO:tasks.workunit.client.0.smithi152.stdout:9/617: rename d5/d6/d74/d17/l27 to d5/d6/d74/da0/lc5 0 2024-04-06T12:24:05.687 INFO:tasks.workunit.client.0.smithi152.stdout:4/839: rename d7/d29/d2e/d5b/lfb to d7/d29/d2e/d5b/l10d 0 2024-04-06T12:24:05.692 INFO:tasks.workunit.client.0.smithi152.stdout:8/870: rename d4/d2c/db0/cd7 to d4/db/d56/dcb/dd5/c12f 0 2024-04-06T12:24:05.693 INFO:tasks.workunit.client.0.smithi152.stdout:9/618: unlink d5/d6/d74/d17/d23/d2d/d98/d99/fa1 0 2024-04-06T12:24:05.694 INFO:tasks.workunit.client.0.smithi152.stdout:9/619: chown d5/d6/d74/d17/d23/d2d/d98/lc1 23329680 1 2024-04-06T12:24:05.696 INFO:tasks.workunit.client.0.smithi152.stdout:4/840: creat d7/d16/d22/d95/dda/f10e x:0 0 0 2024-04-06T12:24:05.700 INFO:tasks.workunit.client.0.smithi152.stdout:8/871: mknod d4/dc/d10/d49/da0/dc0/c130 0 2024-04-06T12:24:05.702 INFO:tasks.workunit.client.0.smithi152.stdout:6/806: sync 2024-04-06T12:24:05.702 INFO:tasks.workunit.client.0.smithi152.stdout:6/807: stat d7/d19/dde 0 2024-04-06T12:24:05.706 INFO:tasks.workunit.client.0.smithi152.stdout:8/872: creat d4/dc/d10/d49/da0/d102/f131 x:0 0 0 2024-04-06T12:24:05.709 INFO:tasks.workunit.client.0.smithi152.stdout:8/873: creat d4/d2c/d114/f132 x:0 0 0 2024-04-06T12:24:05.842 INFO:tasks.workunit.client.0.smithi152.stdout:6/808: mknod d7/d19/d1b/d31/d7c/c10a 0 2024-04-06T12:24:05.843 INFO:tasks.workunit.client.0.smithi152.stdout:8/874: mknod d4/dc/d10/d49/da0/d91/c133 0 2024-04-06T12:24:05.853 INFO:tasks.workunit.client.0.smithi152.stdout:5/702: dwrite d3/da/d53/f87 [0,4194304] 0 2024-04-06T12:24:05.856 INFO:tasks.workunit.client.0.smithi152.stdout:6/809: dread d7/df7/fdc [0,4194304] 0 2024-04-06T12:24:05.862 INFO:tasks.workunit.client.0.smithi152.stdout:1/691: dwrite d2/f7 [4194304,4194304] 0 2024-04-06T12:24:05.864 INFO:tasks.workunit.client.0.smithi152.stdout:1/692: read d2/f3 [4209755,115122] 0 2024-04-06T12:24:05.868 INFO:tasks.workunit.client.0.smithi152.stdout:3/769: truncate d0/d1f/fc7 291375 0 2024-04-06T12:24:05.870 INFO:tasks.workunit.client.0.smithi152.stdout:5/703: creat d3/de/da9/fe4 x:0 0 0 2024-04-06T12:24:05.874 INFO:tasks.workunit.client.0.smithi152.stdout:1/693: unlink d2/d2f/d54/f7f 0 2024-04-06T12:24:05.875 INFO:tasks.workunit.client.0.smithi152.stdout:1/694: stat d2/f16 0 2024-04-06T12:24:05.879 INFO:tasks.workunit.client.0.smithi152.stdout:3/770: creat d0/d10/d13/d2a/d4b/d6a/ff0 x:0 0 0 2024-04-06T12:24:05.889 INFO:tasks.workunit.client.0.smithi152.stdout:2/814: dwrite d0/d15/d24/d3d/f9c [0,4194304] 0 2024-04-06T12:24:05.891 INFO:tasks.workunit.client.0.smithi152.stdout:1/695: dread d2/d1d/f3e [0,4194304] 0 2024-04-06T12:24:05.891 INFO:tasks.workunit.client.0.smithi152.stdout:5/704: link d3/c8 d3/da/d15/d2b/d3f/d6d/dd1/ce5 0 2024-04-06T12:24:05.894 INFO:tasks.workunit.client.0.smithi152.stdout:5/705: rmdir d3/da/d15 39 2024-04-06T12:24:05.897 INFO:tasks.workunit.client.0.smithi152.stdout:2/815: symlink d0/d2/l10e 0 2024-04-06T12:24:05.904 INFO:tasks.workunit.client.0.smithi152.stdout:1/696: mknod d2/d2f/d54/d88/d9c/dc5/dad/d8c/cee 0 2024-04-06T12:24:05.904 INFO:tasks.workunit.client.0.smithi152.stdout:2/816: fdatasync d0/d40/d41/d28/fbe 0 2024-04-06T12:24:05.906 INFO:tasks.workunit.client.0.smithi152.stdout:2/817: write d0/d2/d6f/d90/d9e/feb [123666,27909] 0 2024-04-06T12:24:05.907 INFO:tasks.workunit.client.0.smithi152.stdout:5/706: dread - d3/da/d15/d2b/d3f/d4c/f9a zero size 2024-04-06T12:24:05.908 INFO:tasks.workunit.client.0.smithi152.stdout:2/818: write d0/dae/fcb [588117,7781] 0 2024-04-06T12:24:05.910 INFO:tasks.workunit.client.0.smithi152.stdout:2/819: chown d0/d2/d6f/d90/fa6 30 1 2024-04-06T12:24:05.912 INFO:tasks.workunit.client.0.smithi152.stdout:1/697: creat d2/d2f/d45/fef x:0 0 0 2024-04-06T12:24:05.912 INFO:tasks.workunit.client.0.smithi152.stdout:2/820: stat d0/d2/f21 0 2024-04-06T12:24:05.921 INFO:tasks.workunit.client.0.smithi152.stdout:1/698: unlink d2/d2f/d45/cb7 0 2024-04-06T12:24:05.928 INFO:tasks.workunit.client.0.smithi152.stdout:9/620: dwrite d5/d6/f2c [0,4194304] 0 2024-04-06T12:24:05.942 INFO:tasks.workunit.client.0.smithi152.stdout:5/707: write d3/da/d15/d2b/d3f/d68/d81/f3b [2394818,107637] 0 2024-04-06T12:24:05.943 INFO:tasks.workunit.client.0.smithi152.stdout:9/621: symlink d5/d6/d74/da0/lc6 0 2024-04-06T12:24:05.945 INFO:tasks.workunit.client.0.smithi152.stdout:1/699: dwrite d2/d2f/d54/d88/d9c/dc5/dad/f4e [0,4194304] 0 2024-04-06T12:24:05.955 INFO:tasks.workunit.client.0.smithi152.stdout:1/700: creat d2/d2f/d45/ff0 x:0 0 0 2024-04-06T12:24:05.955 INFO:tasks.workunit.client.0.smithi152.stdout:5/708: dwrite d3/f5a [0,4194304] 0 2024-04-06T12:24:05.958 INFO:tasks.workunit.client.0.smithi152.stdout:6/810: write d7/d62/f6f [6979993,5192] 0 2024-04-06T12:24:05.960 INFO:tasks.workunit.client.0.smithi152.stdout:1/701: stat d2/d61/d8f/lcd 0 2024-04-06T12:24:05.964 INFO:tasks.workunit.client.0.smithi152.stdout:6/811: creat d7/d19/d1b/d1f/d3d/dc2/f10b x:0 0 0 2024-04-06T12:24:05.968 INFO:tasks.workunit.client.0.smithi152.stdout:8/875: truncate d4/dc/f25 6814389 0 2024-04-06T12:24:05.974 INFO:tasks.workunit.client.0.smithi152.stdout:8/876: dread d4/dc/f19 [0,4194304] 0 2024-04-06T12:24:05.977 INFO:tasks.workunit.client.0.smithi152.stdout:6/812: getdents d7/d9 0 2024-04-06T12:24:05.983 INFO:tasks.workunit.client.0.smithi152.stdout:3/771: dwrite d0/d10/d45/f47 [4194304,4194304] 0 2024-04-06T12:24:05.984 INFO:tasks.workunit.client.0.smithi152.stdout:6/813: write d7/d19/d3e/d70/f99 [1098780,125986] 0 2024-04-06T12:24:05.986 INFO:tasks.workunit.client.0.smithi152.stdout:1/702: dread d2/d2f/d54/d88/d9c/dc5/dad/f3a [0,4194304] 0 2024-04-06T12:24:05.989 INFO:tasks.workunit.client.0.smithi152.stdout:1/703: write d2/d61/fa6 [549468,128354] 0 2024-04-06T12:24:05.990 INFO:tasks.workunit.client.0.smithi152.stdout:3/772: truncate d0/d1f/d28/fa9 1040261 0 2024-04-06T12:24:05.992 INFO:tasks.workunit.client.0.smithi152.stdout:8/877: dread d4/dc/d10/d51/f23 [4194304,4194304] 0 2024-04-06T12:24:06.001 INFO:tasks.workunit.client.0.smithi152.stdout:6/814: dread d7/d19/f81 [0,4194304] 0 2024-04-06T12:24:06.005 INFO:tasks.workunit.client.0.smithi152.stdout:3/773: rename d0/d10/d1e/l29 to d0/d10/d13/d2a/db6/lf1 0 2024-04-06T12:24:06.005 INFO:tasks.workunit.client.0.smithi152.stdout:1/704: dread d2/ff [0,4194304] 0 2024-04-06T12:24:06.007 INFO:tasks.workunit.client.0.smithi152.stdout:8/878: truncate d4/db/d56/dcb/d6e/f8b 719815 0 2024-04-06T12:24:06.007 INFO:tasks.workunit.client.0.smithi152.stdout:2/821: write d0/ff4 [1288059,76461] 0 2024-04-06T12:24:06.008 INFO:tasks.workunit.client.0.smithi152.stdout:2/822: chown d0/d15/d24/d3d/de3/db2 10255 1 2024-04-06T12:24:06.016 INFO:tasks.workunit.client.0.smithi152.stdout:8/879: readlink d4/db/d56/dcb/l37 0 2024-04-06T12:24:06.019 INFO:tasks.workunit.client.0.smithi152.stdout:9/622: dwrite d5/d39/d3f/d42/f5b [8388608,4194304] 0 2024-04-06T12:24:06.021 INFO:tasks.workunit.client.0.smithi152.stdout:6/815: unlink d7/d19/d1b/l3b 0 2024-04-06T12:24:06.032 INFO:tasks.workunit.client.0.smithi152.stdout:8/880: rmdir d4/db/d56/dcb/dd5 39 2024-04-06T12:24:06.034 INFO:tasks.workunit.client.0.smithi152.stdout:8/881: write d4/dc/df5/f123 [557095,48533] 0 2024-04-06T12:24:06.036 INFO:tasks.workunit.client.0.smithi152.stdout:3/774: dread d0/d1f/f60 [0,4194304] 0 2024-04-06T12:24:06.039 INFO:tasks.workunit.client.0.smithi152.stdout:6/816: symlink d7/d9/d26/dcc/l10c 0 2024-04-06T12:24:06.040 INFO:tasks.workunit.client.0.smithi152.stdout:6/817: chown d7/d19/d1b/db2/de6/ffe 114195332 1 2024-04-06T12:24:06.045 INFO:tasks.workunit.client.0.smithi152.stdout:9/623: mknod d5/d6/d74/d17/cc7 0 2024-04-06T12:24:06.046 INFO:tasks.workunit.client.0.smithi152.stdout:6/818: readlink d7/d9/d26/dd6/l108 0 2024-04-06T12:24:06.050 INFO:tasks.workunit.client.0.smithi152.stdout:9/624: rmdir d5/d6/d74/d17/d23/d2d/d4b 39 2024-04-06T12:24:06.053 INFO:tasks.workunit.client.0.smithi152.stdout:6/819: dwrite d7/d19/d1b/d31/fe2 [0,4194304] 0 2024-04-06T12:24:06.061 INFO:tasks.workunit.client.0.smithi152.stdout:6/820: write d7/d19/d1b/d1f/d3d/fa7 [4193038,51236] 0 2024-04-06T12:24:06.063 INFO:tasks.workunit.client.0.smithi152.stdout:2/823: write d0/d15/d24/d3d/f2e [1032709,59611] 0 2024-04-06T12:24:06.066 INFO:tasks.workunit.client.0.smithi152.stdout:1/705: dwrite d2/d5d/f8d [0,4194304] 0 2024-04-06T12:24:06.074 INFO:tasks.workunit.client.0.smithi152.stdout:2/824: symlink d0/dae/df7/l10f 0 2024-04-06T12:24:06.078 INFO:tasks.workunit.client.0.smithi152.stdout:6/821: symlink d7/d19/d1b/d22/l10d 0 2024-04-06T12:24:06.079 INFO:tasks.workunit.client.0.smithi152.stdout:8/882: getdents d4/db/d56/dcb/dd5 0 2024-04-06T12:24:06.087 INFO:tasks.workunit.client.0.smithi152.stdout:3/775: truncate d0/d1f/fc7 681662 0 2024-04-06T12:24:06.091 INFO:tasks.workunit.client.0.smithi152.stdout:6/822: mknod d7/d19/dde/c10e 0 2024-04-06T12:24:06.094 INFO:tasks.workunit.client.0.smithi152.stdout:0/912: sync 2024-04-06T12:24:06.094 INFO:tasks.workunit.client.0.smithi152.stdout:9/625: getdents d5/d6/d74 0 2024-04-06T12:24:06.099 INFO:tasks.workunit.client.0.smithi152.stdout:1/706: write d2/d61/d8f/fd8 [921736,12753] 0 2024-04-06T12:24:06.101 INFO:tasks.workunit.client.0.smithi152.stdout:0/913: dwrite d4/d19/f53 [0,4194304] 0 2024-04-06T12:24:06.101 INFO:tasks.workunit.client.0.smithi152.stdout:3/776: creat d0/d10/d13/d2a/d93/d49/dee/ff2 x:0 0 0 2024-04-06T12:24:06.102 INFO:tasks.workunit.client.0.smithi152.stdout:1/707: readlink d2/d5d/d6d/la1 0 2024-04-06T12:24:06.104 INFO:tasks.workunit.client.0.smithi152.stdout:8/883: getdents d4/dc/d10/d49/da0 0 2024-04-06T12:24:06.108 INFO:tasks.workunit.client.0.smithi152.stdout:1/708: chown d2/d2f/d37/ca7 38 1 2024-04-06T12:24:06.109 INFO:tasks.workunit.client.0.smithi152.stdout:2/825: write d0/d2/f21 [3616674,109588] 0 2024-04-06T12:24:06.110 INFO:tasks.workunit.client.0.smithi152.stdout:6/823: dread d7/d19/d3e/f53 [4194304,4194304] 0 2024-04-06T12:24:06.111 INFO:tasks.workunit.client.0.smithi152.stdout:0/914: mkdir d4/de/d28/d18/d43/d123 0 2024-04-06T12:24:06.112 INFO:tasks.workunit.client.0.smithi152.stdout:0/915: stat d4/d31/d47/d7e/db9 0 2024-04-06T12:24:06.114 INFO:tasks.workunit.client.0.smithi152.stdout:8/884: creat d4/db/d56/dcb/dd5/f134 x:0 0 0 2024-04-06T12:24:06.114 INFO:tasks.workunit.client.0.smithi152.stdout:1/709: rmdir d2 39 2024-04-06T12:24:06.115 INFO:tasks.workunit.client.0.smithi152.stdout:8/885: dread - d4/dc/d10/d49/da0/f89 zero size 2024-04-06T12:24:06.118 INFO:tasks.workunit.client.0.smithi152.stdout:0/916: mknod d4/de/d87/c124 0 2024-04-06T12:24:06.123 INFO:tasks.workunit.client.0.smithi152.stdout:8/886: mkdir d4/dc/d10/d49/da0/dc0/d9d/d135 0 2024-04-06T12:24:06.124 INFO:tasks.workunit.client.0.smithi152.stdout:2/826: write d0/d40/d41/d28/d8c/faa [4474384,55060] 0 2024-04-06T12:24:06.125 INFO:tasks.workunit.client.0.smithi152.stdout:6/824: truncate d7/d19/d1b/d31/fb9 1665442 0 2024-04-06T12:24:06.127 INFO:tasks.workunit.client.0.smithi152.stdout:3/777: dwrite d0/d10/d13/d2a/d93/d49/fad [0,4194304] 0 2024-04-06T12:24:06.135 INFO:tasks.workunit.client.0.smithi152.stdout:1/710: link d2/d2f/d54/d88/da4/fde d2/db2/ff1 0 2024-04-06T12:24:06.139 INFO:tasks.workunit.client.0.smithi152.stdout:0/917: dwrite d4/d36/f5b [0,4194304] 0 2024-04-06T12:24:06.142 INFO:tasks.workunit.client.0.smithi152.stdout:3/778: rename d0/d1f/d28/f74 to d0/d35/d75/ff3 0 2024-04-06T12:24:06.143 INFO:tasks.workunit.client.0.smithi152.stdout:3/779: write d0/d10/d13/d2a/fe0 [31059,75203] 0 2024-04-06T12:24:06.144 INFO:tasks.workunit.client.0.smithi152.stdout:8/887: symlink d4/l136 0 2024-04-06T12:24:06.144 INFO:tasks.workunit.client.0.smithi152.stdout:8/888: chown d4/dc/cec 335 1 2024-04-06T12:24:06.146 INFO:tasks.workunit.client.0.smithi152.stdout:6/825: mkdir d7/d9/d26/dd6/d101/d10f 0 2024-04-06T12:24:06.147 INFO:tasks.workunit.client.0.smithi152.stdout:6/826: write d7/d19/d1b/d22/fcf [1849802,127057] 0 2024-04-06T12:24:06.153 INFO:tasks.workunit.client.0.smithi152.stdout:1/711: fsync d2/d2f/d54/d88/d9c/dc5/dad/f6f 0 2024-04-06T12:24:06.153 INFO:tasks.workunit.client.0.smithi152.stdout:0/918: fdatasync d4/de/d28/f95 0 2024-04-06T12:24:06.153 INFO:tasks.workunit.client.0.smithi152.stdout:6/827: dread d7/d19/d1b/d31/fe2 [0,4194304] 0 2024-04-06T12:24:06.156 INFO:tasks.workunit.client.0.smithi152.stdout:6/828: read d7/d62/f63 [1084098,113869] 0 2024-04-06T12:24:06.158 INFO:tasks.workunit.client.0.smithi152.stdout:6/829: chown d7/d19/d1b/d22/fa2 356329 1 2024-04-06T12:24:06.165 INFO:tasks.workunit.client.0.smithi152.stdout:0/919: truncate d4/de/d28/f66 431023 0 2024-04-06T12:24:06.166 INFO:tasks.workunit.client.0.smithi152.stdout:0/920: fdatasync d4/d36/f5b 0 2024-04-06T12:24:06.169 INFO:tasks.workunit.client.0.smithi152.stdout:6/830: mkdir d7/d9/d26/d4a/d7b/d110 0 2024-04-06T12:24:06.170 INFO:tasks.workunit.client.0.smithi152.stdout:1/712: unlink d2/db2/cd5 0 2024-04-06T12:24:06.171 INFO:tasks.workunit.client.0.smithi152.stdout:1/713: dread d2/d1d/f67 [0,4194304] 0 2024-04-06T12:24:06.182 INFO:tasks.workunit.client.0.smithi152.stdout:1/714: creat d2/d2f/d54/d88/d9c/db3/ff2 x:0 0 0 2024-04-06T12:24:06.185 INFO:tasks.workunit.client.0.smithi152.stdout:8/889: getdents d4/dc/d10/d49/da0/dc0/d9d 0 2024-04-06T12:24:06.186 INFO:tasks.workunit.client.0.smithi152.stdout:8/890: write d4/d2c/df9/f10f [646336,128234] 0 2024-04-06T12:24:06.192 INFO:tasks.workunit.client.0.smithi152.stdout:1/715: rename d2/d2f/d45/f62 to d2/d5d/ddf/ff3 0 2024-04-06T12:24:06.192 INFO:tasks.workunit.client.0.smithi152.stdout:1/716: fdatasync d2/d2f/d54/f57 0 2024-04-06T12:24:06.193 INFO:tasks.workunit.client.0.smithi152.stdout:6/831: rmdir d7 39 2024-04-06T12:24:06.194 INFO:tasks.workunit.client.0.smithi152.stdout:6/832: chown c4 1540483709 1 2024-04-06T12:24:06.203 INFO:tasks.workunit.client.0.smithi152.stdout:0/921: getdents d4/d31/d47/d7e/dbe/d8e 0 2024-04-06T12:24:06.204 INFO:tasks.workunit.client.0.smithi152.stdout:0/922: chown d4/de/d28/lb0 7 1 2024-04-06T12:24:06.208 INFO:tasks.workunit.client.0.smithi152.stdout:8/891: dread d4/dc/d10/d51/f67 [0,4194304] 0 2024-04-06T12:24:06.212 INFO:tasks.workunit.client.0.smithi152.stdout:1/717: rename d2/d2f/d37/dae/cdc to d2/d61/d8f/cf4 0 2024-04-06T12:24:06.212 INFO:tasks.workunit.client.0.smithi152.stdout:0/923: fsync d4/de/d7f/db7/fc6 0 2024-04-06T12:24:06.222 INFO:tasks.workunit.client.0.smithi152.stdout:6/833: dread d7/d19/d3e/f53 [0,4194304] 0 2024-04-06T12:24:06.226 INFO:tasks.workunit.client.0.smithi152.stdout:0/924: truncate d4/de/d28/d18/d3b/fac 804314 0 2024-04-06T12:24:06.227 INFO:tasks.workunit.client.0.smithi152.stdout:0/925: write d4/de/d4a/d33/fa6 [747552,98741] 0 2024-04-06T12:24:06.230 INFO:tasks.workunit.client.0.smithi152.stdout:8/892: write d4/db/d56/d85/dce/fd3 [1171822,118203] 0 2024-04-06T12:24:06.232 INFO:tasks.workunit.client.0.smithi152.stdout:8/893: write f0 [1836202,120955] 0 2024-04-06T12:24:06.237 INFO:tasks.workunit.client.0.smithi152.stdout:6/834: dread d7/d62/f6f [0,4194304] 0 2024-04-06T12:24:06.238 INFO:tasks.workunit.client.0.smithi152.stdout:1/718: dwrite d2/f5a [0,4194304] 0 2024-04-06T12:24:06.238 INFO:tasks.workunit.client.0.smithi152.stdout:0/926: mknod d4/de/d28/c125 0 2024-04-06T12:24:06.245 INFO:tasks.workunit.client.0.smithi152.stdout:1/719: fsync d2/d61/d85/f8a 0 2024-04-06T12:24:06.254 INFO:tasks.workunit.client.0.smithi152.stdout:6/835: unlink d7/d19/d1b/fc1 0 2024-04-06T12:24:06.258 INFO:tasks.workunit.client.0.smithi152.stdout:8/894: dread d4/db/d56/dcb/d6e/d88/fe3 [0,4194304] 0 2024-04-06T12:24:06.263 INFO:tasks.workunit.client.0.smithi152.stdout:6/836: creat d7/d9/d26/dd6/d101/f111 x:0 0 0 2024-04-06T12:24:06.264 INFO:tasks.workunit.client.0.smithi152.stdout:6/837: fdatasync d7/d9/d26/fea 0 2024-04-06T12:24:06.266 INFO:tasks.workunit.client.0.smithi152.stdout:8/895: mkdir d4/dc/d10/d49/da0/dc0/d9d/dbe/ddd/d137 0 2024-04-06T12:24:06.268 INFO:tasks.workunit.client.0.smithi152.stdout:0/927: rmdir d4/d31/d47/d89/d11f 0 2024-04-06T12:24:06.268 INFO:tasks.workunit.client.0.smithi152.stdout:8/896: write d4/db/d56/dcb/f118 [266969,120461] 0 2024-04-06T12:24:06.277 INFO:tasks.workunit.client.0.smithi152.stdout:0/928: dwrite d4/de/d28/d18/d43/d62/f106 [0,4194304] 0 2024-04-06T12:24:06.278 INFO:tasks.workunit.client.0.smithi152.stdout:0/929: stat d4/de/d28/lb0 0 2024-04-06T12:24:06.284 INFO:tasks.workunit.client.0.smithi152.stdout:1/720: dwrite d2/d1d/f2d [0,4194304] 0 2024-04-06T12:24:06.285 INFO:tasks.workunit.client.0.smithi152.stdout:0/930: truncate d4/de/d28/d18/d3b/d2e/f4b 3949342 0 2024-04-06T12:24:06.287 INFO:tasks.workunit.client.0.smithi152.stdout:8/897: link d4/dc/d10/d49/da0/dc0/c130 d4/dc/d10/d49/da0/dc0/d9d/d135/c138 0 2024-04-06T12:24:06.289 INFO:tasks.workunit.client.0.smithi152.stdout:6/838: write d7/d19/f33 [1685680,43636] 0 2024-04-06T12:24:06.290 INFO:tasks.workunit.client.0.smithi152.stdout:6/839: fsync d7/d62/fd8 0 2024-04-06T12:24:06.293 INFO:tasks.workunit.client.0.smithi152.stdout:8/898: mkdir d4/d5f/d98/d139 0 2024-04-06T12:24:06.294 INFO:tasks.workunit.client.0.smithi152.stdout:1/721: getdents d2/d61/de5 0 2024-04-06T12:24:06.295 INFO:tasks.workunit.client.0.smithi152.stdout:6/840: mkdir d7/d9/d26/dd6/d101/d112 0 2024-04-06T12:24:06.295 INFO:tasks.workunit.client.0.smithi152.stdout:1/722: write d2/d2f/daf/fea [137474,72818] 0 2024-04-06T12:24:06.296 INFO:tasks.workunit.client.0.smithi152.stdout:8/899: fdatasync d4/dc/fb7 0 2024-04-06T12:24:06.299 INFO:tasks.workunit.client.0.smithi152.stdout:0/931: creat d4/de/d28/d18/d3b/f126 x:0 0 0 2024-04-06T12:24:06.302 INFO:tasks.workunit.client.0.smithi152.stdout:6/841: rename d7/d19/d1b/d31/d7c/dff to d7/d9/d26/dcc/d113 0 2024-04-06T12:24:06.304 INFO:tasks.workunit.client.0.smithi152.stdout:8/900: read d4/db/d56/dcb/d6e/fda [408126,78968] 0 2024-04-06T12:24:06.307 INFO:tasks.workunit.client.0.smithi152.stdout:0/932: dwrite d4/d31/d47/f9c [0,4194304] 0 2024-04-06T12:24:06.311 INFO:tasks.workunit.client.0.smithi152.stdout:6/842: fdatasync d7/d62/f6f 0 2024-04-06T12:24:06.312 INFO:tasks.workunit.client.0.smithi152.stdout:8/901: symlink d4/dc/d10/d49/da0/dc0/db6/l13a 0 2024-04-06T12:24:06.316 INFO:tasks.workunit.client.0.smithi152.stdout:1/723: dread d2/d61/d8f/fe6 [0,4194304] 0 2024-04-06T12:24:06.318 INFO:tasks.workunit.client.0.smithi152.stdout:6/843: chown d7/d9/d26/d2e/laa 570 1 2024-04-06T12:24:06.322 INFO:tasks.workunit.client.0.smithi152.stdout:0/933: truncate d4/de/d28/d18/d43/fd2 6751167 0 2024-04-06T12:24:06.326 INFO:tasks.workunit.client.0.smithi152.stdout:8/902: dread d4/db/d39/f3f [0,4194304] 0 2024-04-06T12:24:06.327 INFO:tasks.workunit.client.0.smithi152.stdout:7/745: sync 2024-04-06T12:24:06.327 INFO:tasks.workunit.client.0.smithi152.stdout:4/841: sync 2024-04-06T12:24:06.329 INFO:tasks.workunit.client.0.smithi152.stdout:7/746: write d8/df/d61/d3d/fd1 [891444,114366] 0 2024-04-06T12:24:06.332 INFO:tasks.workunit.client.0.smithi152.stdout:0/934: symlink d4/de/d28/d18/d43/d8a/l127 0 2024-04-06T12:24:06.335 INFO:tasks.workunit.client.0.smithi152.stdout:8/903: mknod d4/dc/df5/c13b 0 2024-04-06T12:24:06.339 INFO:tasks.workunit.client.0.smithi152.stdout:7/747: mkdir d8/df/d61/d6d/d85/df6 0 2024-04-06T12:24:06.341 INFO:tasks.workunit.client.0.smithi152.stdout:1/724: creat d2/d2f/d54/ff5 x:0 0 0 2024-04-06T12:24:06.342 INFO:tasks.workunit.client.0.smithi152.stdout:8/904: dwrite d4/dc/df5/f123 [0,4194304] 0 2024-04-06T12:24:06.343 INFO:tasks.workunit.client.0.smithi152.stdout:1/725: chown d2/fb 293130 1 2024-04-06T12:24:06.344 INFO:tasks.workunit.client.0.smithi152.stdout:0/935: creat d4/de/d28/d18/d43/d62/dd4/f128 x:0 0 0 2024-04-06T12:24:06.344 INFO:tasks.workunit.client.0.smithi152.stdout:8/905: dread - d4/db/d56/dcb/dd5/f134 zero size 2024-04-06T12:24:06.345 INFO:tasks.workunit.client.0.smithi152.stdout:6/844: creat d7/f114 x:0 0 0 2024-04-06T12:24:06.351 INFO:tasks.workunit.client.0.smithi152.stdout:7/748: mknod d8/df/d28/d75/cf7 0 2024-04-06T12:24:06.352 INFO:tasks.workunit.client.0.smithi152.stdout:4/842: dread d7/d16/d22/d3f/db4/d60/f87 [0,4194304] 0 2024-04-06T12:24:06.355 INFO:tasks.workunit.client.0.smithi152.stdout:4/843: write d7/d29/d78/fe9 [544555,10166] 0 2024-04-06T12:24:06.355 INFO:tasks.workunit.client.0.smithi152.stdout:0/936: dwrite d4/de/d28/d18/d43/d62/dd4/f128 [0,4194304] 0 2024-04-06T12:24:06.355 INFO:tasks.workunit.client.0.smithi152.stdout:8/906: fsync d4/d2c/d54/faf 0 2024-04-06T12:24:06.363 INFO:tasks.workunit.client.0.smithi152.stdout:7/749: read - d8/df/d28/d41/dd4/d43/f9b zero size 2024-04-06T12:24:06.366 INFO:tasks.workunit.client.0.smithi152.stdout:0/937: symlink d4/de/d7f/l129 0 2024-04-06T12:24:06.376 INFO:tasks.workunit.client.0.smithi152.stdout:7/750: mknod d8/df/d28/d41/dd4/d43/d8a/d9d/dc9/cf8 0 2024-04-06T12:24:06.377 INFO:tasks.workunit.client.0.smithi152.stdout:7/751: dread - d8/df/d28/d41/dd4/d43/f9b zero size 2024-04-06T12:24:06.377 INFO:tasks.workunit.client.0.smithi152.stdout:0/938: symlink d4/d31/l12a 0 2024-04-06T12:24:06.383 INFO:tasks.workunit.client.0.smithi152.stdout:0/939: read d4/de/d28/d18/d43/d62/dd4/fe4 [671586,44420] 0 2024-04-06T12:24:06.384 INFO:tasks.workunit.client.0.smithi152.stdout:7/752: rename d8/df/d28/d41/dd4/d43/d8a/d9d/dc9/dd0/f97 to d8/df/d34/d5c/ff9 0 2024-04-06T12:24:06.388 INFO:tasks.workunit.client.0.smithi152.stdout:1/726: write d2/f20 [1228691,1774] 0 2024-04-06T12:24:06.389 INFO:tasks.workunit.client.0.smithi152.stdout:0/940: mkdir d4/de/d7f/db7/d12b 0 2024-04-06T12:24:06.394 INFO:tasks.workunit.client.0.smithi152.stdout:1/727: mknod d2/d2f/d54/d88/d9c/db3/dd3/cf6 0 2024-04-06T12:24:06.397 INFO:tasks.workunit.client.0.smithi152.stdout:0/941: creat d4/d31/d47/d7e/db9/dcc/dd5/f12c x:0 0 0 2024-04-06T12:24:06.398 INFO:tasks.workunit.client.0.smithi152.stdout:7/753: mknod d8/df/d28/d41/dd4/d43/d8a/cfa 0 2024-04-06T12:24:06.399 INFO:tasks.workunit.client.0.smithi152.stdout:1/728: dwrite d2/d2f/d54/d88/d9c/dc5/fc1 [4194304,4194304] 0 2024-04-06T12:24:06.414 INFO:tasks.workunit.client.0.smithi152.stdout:4/844: dwrite d7/d29/d2e/d5b/f77 [0,4194304] 0 2024-04-06T12:24:06.417 INFO:tasks.workunit.client.0.smithi152.stdout:7/754: dread d8/df/d61/fe [4194304,4194304] 0 2024-04-06T12:24:06.419 INFO:tasks.workunit.client.0.smithi152.stdout:0/942: creat d4/de/d28/d18/d43/d62/dd4/d11b/f12d x:0 0 0 2024-04-06T12:24:06.421 INFO:tasks.workunit.client.0.smithi152.stdout:8/907: dwrite d4/dc/d10/d49/f72 [0,4194304] 0 2024-04-06T12:24:06.434 INFO:tasks.workunit.client.0.smithi152.stdout:4/845: mknod d7/d16/c10f 0 2024-04-06T12:24:06.435 INFO:tasks.workunit.client.0.smithi152.stdout:1/729: dread d2/d5d/ddf/ff3 [0,4194304] 0 2024-04-06T12:24:06.436 INFO:tasks.workunit.client.0.smithi152.stdout:1/730: chown d2/d2f/d45/c4b 971799449 1 2024-04-06T12:24:06.453 INFO:tasks.workunit.client.0.smithi152.stdout:4/846: dread d7/d29/d2e/d7b/fad [0,4194304] 0 2024-04-06T12:24:06.453 INFO:tasks.workunit.client.0.smithi152.stdout:1/731: getdents d2/d2f/d54/d88/d9c/dc5/dad/d8c 0 2024-04-06T12:24:06.457 INFO:tasks.workunit.client.0.smithi152.stdout:8/908: write d4/db/d39/f76 [116721,113719] 0 2024-04-06T12:24:06.460 INFO:tasks.workunit.client.0.smithi152.stdout:8/909: stat d4/d2c/d2b/c9a 0 2024-04-06T12:24:06.465 INFO:tasks.workunit.client.0.smithi152.stdout:1/732: dwrite d2/d2f/d45/fef [0,4194304] 0 2024-04-06T12:24:06.467 INFO:tasks.workunit.client.0.smithi152.stdout:7/755: dwrite d8/df/d61/d76/d7e/f72 [0,4194304] 0 2024-04-06T12:24:06.467 INFO:tasks.workunit.client.0.smithi152.stdout:1/733: write d2/d2f/d45/fef [4844908,32278] 0 2024-04-06T12:24:06.471 INFO:tasks.workunit.client.0.smithi152.stdout:8/910: symlink d4/db/d56/d85/dcd/l13c 0 2024-04-06T12:24:06.475 INFO:tasks.workunit.client.0.smithi152.stdout:7/756: rmdir d8/df/d61/d6d/d85 39 2024-04-06T12:24:06.479 INFO:tasks.workunit.client.0.smithi152.stdout:8/911: chown d4/db/d56/dcb/dd5/c129 430346892 1 2024-04-06T12:24:06.483 INFO:tasks.workunit.client.0.smithi152.stdout:8/912: dread d4/d2c/dbf/f12d [4194304,4194304] 0 2024-04-06T12:24:06.484 INFO:tasks.workunit.client.0.smithi152.stdout:8/913: rename d4/d2c/dbf/db2 to d4/d2c/dbf/db2/dba/d13d 22 2024-04-06T12:24:06.486 INFO:tasks.workunit.client.0.smithi152.stdout:8/914: read - d4/d2c/d114/f116 zero size 2024-04-06T12:24:06.493 INFO:tasks.workunit.client.0.smithi152.stdout:1/734: dwrite d2/d2f/d54/d88/da4/fde [0,4194304] 0 2024-04-06T12:24:06.494 INFO:tasks.workunit.client.0.smithi152.stdout:7/757: dread d8/df/d28/d41/dd4/d49/f80 [0,4194304] 0 2024-04-06T12:24:06.496 INFO:tasks.workunit.client.0.smithi152.stdout:8/915: creat d4/db/f13e x:0 0 0 2024-04-06T12:24:06.500 INFO:tasks.workunit.client.0.smithi152.stdout:1/735: creat d2/ff7 x:0 0 0 2024-04-06T12:24:06.503 INFO:tasks.workunit.client.0.smithi152.stdout:1/736: readlink d2/d2f/d54/d88/d9c/db3/lce 0 2024-04-06T12:24:06.504 INFO:tasks.workunit.client.0.smithi152.stdout:7/758: dwrite d8/df/d28/d41/dd4/d8c/d2d/da3/de4/ddc/fed [0,4194304] 0 2024-04-06T12:24:06.504 INFO:tasks.workunit.client.0.smithi152.stdout:8/916: truncate d4/dc/d10/d49/da0/dc0/db6/fc3 177232 0 2024-04-06T12:24:06.511 INFO:tasks.workunit.client.0.smithi152.stdout:1/737: dread d2/d61/d8f/fe6 [0,4194304] 0 2024-04-06T12:24:06.511 INFO:tasks.workunit.client.0.smithi152.stdout:7/759: mknod d8/df/d28/d41/dd4/d43/d8a/cfb 0 2024-04-06T12:24:06.520 INFO:tasks.workunit.client.0.smithi152.stdout:7/760: dwrite d8/df/d61/d4b/fa5 [0,4194304] 0 2024-04-06T12:24:06.520 INFO:tasks.workunit.client.0.smithi152.stdout:8/917: link d4/d2c/dbf/f12d d4/db/d39/f13f 0 2024-04-06T12:24:06.527 INFO:tasks.workunit.client.0.smithi152.stdout:1/738: rename d2/d1d/fbc to d2/d2f/d54/ff8 0 2024-04-06T12:24:06.527 INFO:tasks.workunit.client.0.smithi152.stdout:8/918: mknod d4/d2c/d2b/c140 0 2024-04-06T12:24:06.528 INFO:tasks.workunit.client.0.smithi152.stdout:8/919: stat d4/db/d32/c7e 0 2024-04-06T12:24:06.530 INFO:tasks.workunit.client.0.smithi152.stdout:1/739: read d2/f58 [1903165,1692] 0 2024-04-06T12:24:06.532 INFO:tasks.workunit.client.0.smithi152.stdout:8/920: dread d4/db/d56/dcb/f3e [0,4194304] 0 2024-04-06T12:24:06.534 INFO:tasks.workunit.client.0.smithi152.stdout:7/761: getdents d8/df/d28/d41/dd4/d8c/d2d 0 2024-04-06T12:24:06.536 INFO:tasks.workunit.client.0.smithi152.stdout:5/709: sync 2024-04-06T12:24:06.537 INFO:tasks.workunit.client.0.smithi152.stdout:1/740: creat d2/d5d/d6d/ff9 x:0 0 0 2024-04-06T12:24:06.538 INFO:tasks.workunit.client.0.smithi152.stdout:1/741: fdatasync d2/d2f/d54/d88/d9c/db3/ff2 0 2024-04-06T12:24:06.538 INFO:tasks.workunit.client.0.smithi152.stdout:8/921: creat d4/dc/d10/d49/da0/dc0/d9d/dbe/f141 x:0 0 0 2024-04-06T12:24:06.547 INFO:tasks.workunit.client.0.smithi152.stdout:1/742: dwrite d2/d61/d8f/fe6 [4194304,4194304] 0 2024-04-06T12:24:06.552 INFO:tasks.workunit.client.0.smithi152.stdout:7/762: dread d8/d2a/d42/f4c [0,4194304] 0 2024-04-06T12:24:06.554 INFO:tasks.workunit.client.0.smithi152.stdout:8/922: dread d4/db/d56/dcb/f79 [0,4194304] 0 2024-04-06T12:24:06.560 INFO:tasks.workunit.client.0.smithi152.stdout:7/763: dread d8/df/d28/d41/dd4/d43/fda [0,4194304] 0 2024-04-06T12:24:06.561 INFO:tasks.workunit.client.0.smithi152.stdout:8/923: rename d4/ce to d4/db/d56/dcb/dd5/c142 0 2024-04-06T12:24:06.567 INFO:tasks.workunit.client.0.smithi152.stdout:8/924: creat d4/dc/d10/d49/da0/f143 x:0 0 0 2024-04-06T12:24:06.570 INFO:tasks.workunit.client.0.smithi152.stdout:1/743: dread d2/f1b [4194304,4194304] 0 2024-04-06T12:24:06.571 INFO:tasks.workunit.client.0.smithi152.stdout:7/764: creat d8/df/d28/d75/de8/ffc x:0 0 0 2024-04-06T12:24:06.572 INFO:tasks.workunit.client.0.smithi152.stdout:8/925: truncate d4/dc/fb7 1288225 0 2024-04-06T12:24:06.575 INFO:tasks.workunit.client.0.smithi152.stdout:1/744: rmdir d2/d5d/ddf 39 2024-04-06T12:24:06.575 INFO:tasks.workunit.client.0.smithi152.stdout:5/710: write d3/da/d15/d40/f96 [3819725,64705] 0 2024-04-06T12:24:06.576 INFO:tasks.workunit.client.0.smithi152.stdout:7/765: fsync d8/df/d28/d41/fef 0 2024-04-06T12:24:06.576 INFO:tasks.workunit.client.0.smithi152.stdout:1/745: dread - d2/d5d/d6d/f84 zero size 2024-04-06T12:24:06.582 INFO:tasks.workunit.client.0.smithi152.stdout:1/746: rename d2/d61/de5 to d2/d61/dfa 0 2024-04-06T12:24:06.586 INFO:tasks.workunit.client.0.smithi152.stdout:7/766: rename d8/df/d28/d41/fef to d8/df/d34/d5c/ffd 0 2024-04-06T12:24:06.587 INFO:tasks.workunit.client.0.smithi152.stdout:7/767: chown d8/df/d28/f4d 3 1 2024-04-06T12:24:06.597 INFO:tasks.workunit.client.0.smithi152.stdout:7/768: rename d8/df/d28/d41/dd4/d8c/d59/daa to d8/df/d28/d41/d48/dfe 0 2024-04-06T12:24:06.601 INFO:tasks.workunit.client.0.smithi152.stdout:7/769: rmdir d8/df/d61/d4b/d56 39 2024-04-06T12:24:06.602 INFO:tasks.workunit.client.0.smithi152.stdout:8/926: dwrite d4/db/d39/f3f [4194304,4194304] 0 2024-04-06T12:24:06.607 INFO:tasks.workunit.client.0.smithi152.stdout:5/711: truncate d3/da/d15/d40/d50/d99/faa 551871 0 2024-04-06T12:24:06.608 INFO:tasks.workunit.client.0.smithi152.stdout:8/927: rmdir d4/dc/d10/d49/da0/dc0/d9d 39 2024-04-06T12:24:06.613 INFO:tasks.workunit.client.0.smithi152.stdout:5/712: rename d3/da/d15/d40/f96 to d3/d9/fe6 0 2024-04-06T12:24:06.616 INFO:tasks.workunit.client.0.smithi152.stdout:8/928: mknod d4/d5f/d98/d139/c144 0 2024-04-06T12:24:06.618 INFO:tasks.workunit.client.0.smithi152.stdout:8/929: chown d4/db/d56/d85/dce/l127 2 1 2024-04-06T12:24:06.621 INFO:tasks.workunit.client.0.smithi152.stdout:7/770: truncate d8/df/d34/d63/f92 2218330 0 2024-04-06T12:24:06.623 INFO:tasks.workunit.client.0.smithi152.stdout:5/713: creat d3/da/d15/d2b/d3f/d6d/dc6/dd9/fe7 x:0 0 0 2024-04-06T12:24:06.628 INFO:tasks.workunit.client.0.smithi152.stdout:5/714: read - d3/da/d53/f62 zero size 2024-04-06T12:24:06.638 INFO:tasks.workunit.client.0.smithi152.stdout:7/771: rename d8/df/d61/d6d/d85/dc1 to d8/df/d28/d41/dd4/d79/dff 0 2024-04-06T12:24:06.646 INFO:tasks.workunit.client.0.smithi152.stdout:8/930: truncate d4/fbb 2631975 0 2024-04-06T12:24:06.649 INFO:tasks.workunit.client.0.smithi152.stdout:5/715: symlink d3/da/d15/d2b/d3f/d68/d81/dc1/le8 0 2024-04-06T12:24:06.652 INFO:tasks.workunit.client.0.smithi152.stdout:7/772: mknod d8/df/d61/d6d/d85/df6/c100 0 2024-04-06T12:24:06.653 INFO:tasks.workunit.client.0.smithi152.stdout:8/931: mkdir d4/d81/d145 0 2024-04-06T12:24:06.663 INFO:tasks.workunit.client.0.smithi152.stdout:7/773: dread d8/df/d28/f4d [0,4194304] 0 2024-04-06T12:24:06.665 INFO:tasks.workunit.client.0.smithi152.stdout:5/716: rename d3/da/d15/d2b/d4d to d3/da/d15/de9 0 2024-04-06T12:24:06.668 INFO:tasks.workunit.client.0.smithi152.stdout:7/774: mkdir d8/df/d28/d87/d101 0 2024-04-06T12:24:06.669 INFO:tasks.workunit.client.0.smithi152.stdout:8/932: rename d4/db/c20 to d4/db/d56/dcb/dd5/c146 0 2024-04-06T12:24:06.674 INFO:tasks.workunit.client.0.smithi152.stdout:7/775: rename d8/df/d28/d75/cf7 to d8/df/d28/d75/c102 0 2024-04-06T12:24:06.677 INFO:tasks.workunit.client.0.smithi152.stdout:8/933: chown d4/dc/d10/d49/da0/dc0/d9d/dbe/fad 25345 1 2024-04-06T12:24:06.680 INFO:tasks.workunit.client.0.smithi152.stdout:5/717: mknod d3/da/d15/d40/cea 0 2024-04-06T12:24:06.681 INFO:tasks.workunit.client.0.smithi152.stdout:7/776: dwrite d8/df/d28/d41/dd4/d8c/d2d/da3/fc8 [0,4194304] 0 2024-04-06T12:24:06.682 INFO:tasks.workunit.client.0.smithi152.stdout:5/718: fdatasync d3/da/d15/d40/d50/f95 0 2024-04-06T12:24:06.684 INFO:tasks.workunit.client.0.smithi152.stdout:7/777: fsync d8/fc3 0 2024-04-06T12:24:06.688 INFO:tasks.workunit.client.0.smithi152.stdout:8/934: dread d4/dc/f19 [0,4194304] 0 2024-04-06T12:24:06.693 INFO:tasks.workunit.client.0.smithi152.stdout:8/935: symlink d4/d2c/db0/l147 0 2024-04-06T12:24:06.694 INFO:tasks.workunit.client.0.smithi152.stdout:5/719: dread d3/da/d15/d40/d50/d99/faa [0,4194304] 0 2024-04-06T12:24:06.695 INFO:tasks.workunit.client.0.smithi152.stdout:5/720: chown d3/da/d15/d2b/d3f/d6d/dd1/fc8 900 1 2024-04-06T12:24:06.703 INFO:tasks.workunit.client.0.smithi152.stdout:5/721: dwrite d3/da/d15/d2b/d3f/db9/fbe [0,4194304] 0 2024-04-06T12:24:06.704 INFO:tasks.workunit.client.0.smithi152.stdout:5/722: chown d3/da/d53 156819 1 2024-04-06T12:24:06.746 INFO:tasks.workunit.client.0.smithi152.stdout:8/936: write d4/dc/d10/d51/f67 [4823067,129507] 0 2024-04-06T12:24:06.756 INFO:tasks.workunit.client.0.smithi152.stdout:5/723: write d3/da/d15/d40/d46/f74 [840004,11258] 0 2024-04-06T12:24:06.757 INFO:tasks.workunit.client.0.smithi152.stdout:5/724: read - d3/da/d53/f62 zero size 2024-04-06T12:24:06.784 INFO:tasks.workunit.client.0.smithi152.stdout:8/937: truncate d4/dc/d10/d49/f70 2851085 0 2024-04-06T12:24:06.785 INFO:tasks.workunit.client.0.smithi152.stdout:5/725: mknod d3/de/da9/ceb 0 2024-04-06T12:24:06.798 INFO:tasks.workunit.client.0.smithi152.stdout:8/938: rename d4/dc/d10/d49/da0/d102/c126 to d4/dc/d10/d49/c148 0 2024-04-06T12:24:06.799 INFO:tasks.workunit.client.0.smithi152.stdout:8/939: stat d4/dc/d10/d49/da0/d102 0 2024-04-06T12:24:06.831 INFO:tasks.workunit.client.0.smithi152.stdout:8/940: write d4/f36 [2722383,39204] 0 2024-04-06T12:24:06.834 INFO:tasks.workunit.client.0.smithi152.stdout:5/726: dwrite d3/de/f5b [0,4194304] 0 2024-04-06T12:24:06.835 INFO:tasks.workunit.client.0.smithi152.stdout:8/941: symlink d4/db/l149 0 2024-04-06T12:24:06.837 INFO:tasks.workunit.client.0.smithi152.stdout:8/942: read d4/db/d39/f3f [1435162,72106] 0 2024-04-06T12:24:06.838 INFO:tasks.workunit.client.0.smithi152.stdout:8/943: write d4/dc/d10/d49/da0/f109 [577504,4887] 0 2024-04-06T12:24:06.844 INFO:tasks.workunit.client.0.smithi152.stdout:8/944: creat d4/f14a x:0 0 0 2024-04-06T12:24:06.847 INFO:tasks.workunit.client.0.smithi152.stdout:8/945: creat d4/d2c/f14b x:0 0 0 2024-04-06T12:24:06.850 INFO:tasks.workunit.client.0.smithi152.stdout:8/946: mkdir d4/d2c/d14c 0 2024-04-06T12:24:06.854 INFO:tasks.workunit.client.0.smithi152.stdout:5/727: write d3/de/f35 [354401,25049] 0 2024-04-06T12:24:06.858 INFO:tasks.workunit.client.0.smithi152.stdout:5/728: creat d3/da/d15/d2b/d3f/d68/fec x:0 0 0 2024-04-06T12:24:06.860 INFO:tasks.workunit.client.0.smithi152.stdout:5/729: creat d3/de/d8c/fed x:0 0 0 2024-04-06T12:24:06.862 INFO:tasks.workunit.client.0.smithi152.stdout:5/730: write d3/da/d15/d2b/d3f/d68/d81/f45 [7843086,103890] 0 2024-04-06T12:24:06.866 INFO:tasks.workunit.client.0.smithi152.stdout:5/731: link d3/de/d8c/fed d3/da/d15/fee 0 2024-04-06T12:24:06.868 INFO:tasks.workunit.client.0.smithi152.stdout:5/732: creat d3/da/d15/d2b/d3f/d68/d81/fef x:0 0 0 2024-04-06T12:24:06.873 INFO:tasks.workunit.client.0.smithi152.stdout:5/733: link d3/da/d15/d2b/d3f/d68/d81/f3b d3/da/d15/d2b/d3f/d68/d81/ff0 0 2024-04-06T12:24:06.876 INFO:tasks.workunit.client.0.smithi152.stdout:5/734: creat d3/da/d15/d40/d46/ff1 x:0 0 0 2024-04-06T12:24:06.876 INFO:tasks.workunit.client.0.smithi152.stdout:5/735: chown d3/f7 1 1 2024-04-06T12:24:06.891 INFO:tasks.workunit.client.0.smithi152.stdout:5/736: dwrite d3/da/d15/d2b/d3f/d68/d81/fdf [0,4194304] 0 2024-04-06T12:24:06.896 INFO:tasks.workunit.client.0.smithi152.stdout:5/737: dread d3/d9/f27 [0,4194304] 0 2024-04-06T12:24:06.912 INFO:tasks.workunit.client.0.smithi152.stdout:5/738: dread d3/da/f71 [0,4194304] 0 2024-04-06T12:24:06.914 INFO:tasks.workunit.client.0.smithi152.stdout:5/739: getdents d3/ddc 0 2024-04-06T12:24:06.930 INFO:tasks.workunit.client.0.smithi152.stdout:9/626: sync 2024-04-06T12:24:06.935 INFO:tasks.workunit.client.0.smithi152.stdout:9/627: rename d5/d6/d74/d17/la6 to d5/d6/d74/d17/d9f/lc8 0 2024-04-06T12:24:07.051 INFO:tasks.workunit.client.0.smithi152.stdout:5/740: dwrite d3/da/f24 [0,4194304] 0 2024-04-06T12:24:07.069 INFO:tasks.workunit.client.0.smithi152.stdout:9/628: dread d5/d6/f3c [0,4194304] 0 2024-04-06T12:24:07.093 INFO:tasks.workunit.client.0.smithi152.stdout:3/780: sync 2024-04-06T12:24:07.093 INFO:tasks.workunit.client.0.smithi152.stdout:2/827: sync 2024-04-06T12:24:07.095 INFO:tasks.workunit.client.0.smithi152.stdout:5/741: dread - d3/d9/fc7 zero size 2024-04-06T12:24:07.101 INFO:tasks.workunit.client.0.smithi152.stdout:2/828: dwrite d0/d40/d26/db4/fd7 [0,4194304] 0 2024-04-06T12:24:07.107 INFO:tasks.workunit.client.0.smithi152.stdout:5/742: truncate d3/da/d15/d40/d46/f85 848471 0 2024-04-06T12:24:07.108 INFO:tasks.workunit.client.0.smithi152.stdout:5/743: dread - d3/de/fb8 zero size 2024-04-06T12:24:07.110 INFO:tasks.workunit.client.0.smithi152.stdout:3/781: dread d0/d10/d13/d2a/d4b/ded/fc9 [0,4194304] 0 2024-04-06T12:24:07.117 INFO:tasks.workunit.client.0.smithi152.stdout:3/782: rename d0/d10/d1e/d71/f79 to d0/d35/d43/d48/d83/ff4 0 2024-04-06T12:24:07.122 INFO:tasks.workunit.client.0.smithi152.stdout:5/744: creat d3/da/d15/d2b/d3f/d4c/ff2 x:0 0 0 2024-04-06T12:24:07.123 INFO:tasks.workunit.client.0.smithi152.stdout:5/745: dread - d3/da/d15/fb7 zero size 2024-04-06T12:24:07.128 INFO:tasks.workunit.client.0.smithi152.stdout:9/629: write d5/d6/d74/d17/d23/d2d/d4b/d5a/f6d [934064,6539] 0 2024-04-06T12:24:07.128 INFO:tasks.workunit.client.0.smithi152.stdout:5/746: dwrite d3/f1f [0,4194304] 0 2024-04-06T12:24:07.130 INFO:tasks.workunit.client.0.smithi152.stdout:5/747: dread - d3/de/d8c/fed zero size 2024-04-06T12:24:07.130 INFO:tasks.workunit.client.0.smithi152.stdout:9/630: stat d5/d6/d74/d17/d23/d2d/f51 0 2024-04-06T12:24:07.132 INFO:tasks.workunit.client.0.smithi152.stdout:5/748: write d3/da/d15/de9/fcb [442930,121235] 0 2024-04-06T12:24:07.133 INFO:tasks.workunit.client.0.smithi152.stdout:9/631: truncate d5/d39/fb0 744888 0 2024-04-06T12:24:07.134 INFO:tasks.workunit.client.0.smithi152.stdout:5/749: readlink d3/da/d15/d2b/d3f/d68/le2 0 2024-04-06T12:24:07.135 INFO:tasks.workunit.client.0.smithi152.stdout:9/632: dread d5/d39/fb0 [0,4194304] 0 2024-04-06T12:24:07.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/750: fsync d3/da/d15/d2b/d3f/d4c/f67 0 2024-04-06T12:24:07.144 INFO:tasks.workunit.client.0.smithi152.stdout:5/751: creat d3/de/d8c/ff3 x:0 0 0 2024-04-06T12:24:07.148 INFO:tasks.workunit.client.0.smithi152.stdout:9/633: link d5/d6/d74/d17/d23/c20 d5/d6/d74/d17/d23/d2d/d32/d36/da3/cc9 0 2024-04-06T12:24:07.151 INFO:tasks.workunit.client.0.smithi152.stdout:5/752: creat d3/da/ff4 x:0 0 0 2024-04-06T12:24:07.152 INFO:tasks.workunit.client.0.smithi152.stdout:9/634: readlink d5/l13 0 2024-04-06T12:24:07.154 INFO:tasks.workunit.client.0.smithi152.stdout:9/635: chown d5/d39/d3f/d42 1316837750 1 2024-04-06T12:24:07.154 INFO:tasks.workunit.client.0.smithi152.stdout:3/783: dwrite d0/d35/d43/d48/d83/ff4 [0,4194304] 0 2024-04-06T12:24:07.161 INFO:tasks.workunit.client.0.smithi152.stdout:3/784: creat d0/d10/d13/d2a/d93/d49/ff5 x:0 0 0 2024-04-06T12:24:07.164 INFO:tasks.workunit.client.0.smithi152.stdout:5/753: truncate d3/da/d15/d2b/d3f/d6d/dd1/fc8 15269 0 2024-04-06T12:24:07.164 INFO:tasks.workunit.client.0.smithi152.stdout:9/636: write d5/d6/d74/d17/d23/d2d/d4b/fa9 [4623757,83729] 0 2024-04-06T12:24:07.167 INFO:tasks.workunit.client.0.smithi152.stdout:3/785: creat d0/d1f/d44/ff6 x:0 0 0 2024-04-06T12:24:07.170 INFO:tasks.workunit.client.0.smithi152.stdout:9/637: rmdir d5/d6/d74/d17/d23/d2d/d32/d36/da3 39 2024-04-06T12:24:07.172 INFO:tasks.workunit.client.0.smithi152.stdout:3/786: symlink d0/d10/d1e/d71/lf7 0 2024-04-06T12:24:07.178 INFO:tasks.workunit.client.0.smithi152.stdout:3/787: rename d0/d10/d13/f6f to d0/d10/d13/ff8 0 2024-04-06T12:24:07.179 INFO:tasks.workunit.client.0.smithi152.stdout:3/788: read d0/d35/d43/d48/d83/ff4 [808848,25057] 0 2024-04-06T12:24:07.184 INFO:tasks.workunit.client.0.smithi152.stdout:3/789: fdatasync d0/ff 0 2024-04-06T12:24:07.184 INFO:tasks.workunit.client.0.smithi152.stdout:9/638: write d5/d6/f3c [4046129,81417] 0 2024-04-06T12:24:07.186 INFO:tasks.workunit.client.0.smithi152.stdout:5/754: dwrite d3/da/d15/d2b/d3f/d4c/f79 [0,4194304] 0 2024-04-06T12:24:07.192 INFO:tasks.workunit.client.0.smithi152.stdout:9/639: fdatasync d5/d39/fb0 0 2024-04-06T12:24:07.194 INFO:tasks.workunit.client.0.smithi152.stdout:3/790: symlink d0/d1f/d44/lf9 0 2024-04-06T12:24:07.200 INFO:tasks.workunit.client.0.smithi152.stdout:3/791: creat d0/d10/d1e/d87/ffa x:0 0 0 2024-04-06T12:24:07.200 INFO:tasks.workunit.client.0.smithi152.stdout:9/640: creat d5/d6/d74/d69/fca x:0 0 0 2024-04-06T12:24:07.202 INFO:tasks.workunit.client.0.smithi152.stdout:5/755: rename d3/da/d15/d2b/d3f/d6d/l93 to d3/da/d15/d2b/d3f/d68/lf5 0 2024-04-06T12:24:07.207 INFO:tasks.workunit.client.0.smithi152.stdout:5/756: creat d3/da/d15/d2b/d3f/d68/d81/ff6 x:0 0 0 2024-04-06T12:24:07.208 INFO:tasks.workunit.client.0.smithi152.stdout:3/792: dread d0/d10/d1e/f1d [4194304,4194304] 0 2024-04-06T12:24:07.209 INFO:tasks.workunit.client.0.smithi152.stdout:9/641: dwrite d5/d6/d74/d17/d23/d2d/d4b/fa9 [4194304,4194304] 0 2024-04-06T12:24:07.210 INFO:tasks.workunit.client.0.smithi152.stdout:3/793: readlink d0/d35/lcc 0 2024-04-06T12:24:07.210 INFO:tasks.workunit.client.0.smithi152.stdout:5/757: write d3/da/d15/d2b/d3f/fdb [1028008,48031] 0 2024-04-06T12:24:07.215 INFO:tasks.workunit.client.0.smithi152.stdout:3/794: fsync d0/ff 0 2024-04-06T12:24:07.219 INFO:tasks.workunit.client.0.smithi152.stdout:5/758: creat d3/da/d53/ff7 x:0 0 0 2024-04-06T12:24:07.223 INFO:tasks.workunit.client.0.smithi152.stdout:3/795: write d0/d10/d13/d2a/d4b/ded/fc9 [1575646,78057] 0 2024-04-06T12:24:07.227 INFO:tasks.workunit.client.0.smithi152.stdout:5/759: chown d3/da/d15/d2b/d3f/d4c/c82 127067040 1 2024-04-06T12:24:07.227 INFO:tasks.workunit.client.0.smithi152.stdout:3/796: readlink d0/d10/d13/d2a/d93/d49/d8d/la0 0 2024-04-06T12:24:07.228 INFO:tasks.workunit.client.0.smithi152.stdout:9/642: dwrite d5/fb [0,4194304] 0 2024-04-06T12:24:07.234 INFO:tasks.workunit.client.0.smithi152.stdout:5/760: rename d3/da/d15/de9/l6a to d3/da/d15/d40/d4f/lf8 0 2024-04-06T12:24:07.237 INFO:tasks.workunit.client.0.smithi152.stdout:3/797: dwrite d0/d1f/d28/f76 [4194304,4194304] 0 2024-04-06T12:24:07.240 INFO:tasks.workunit.client.0.smithi152.stdout:5/761: unlink d3/da/d15/d40/d46/la0 0 2024-04-06T12:24:07.240 INFO:tasks.workunit.client.0.smithi152.stdout:9/643: getdents d5/d6/d74/d17/d23/d2d/d32/db1 0 2024-04-06T12:24:07.241 INFO:tasks.workunit.client.0.smithi152.stdout:3/798: read d0/d1f/f23 [649218,86006] 0 2024-04-06T12:24:07.242 INFO:tasks.workunit.client.0.smithi152.stdout:9/644: dread - d5/d39/d79/daa/fb2 zero size 2024-04-06T12:24:07.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/762: dread d3/da/f24 [0,4194304] 0 2024-04-06T12:24:07.249 INFO:tasks.workunit.client.0.smithi152.stdout:3/799: mknod d0/d1f/d44/d7c/cfb 0 2024-04-06T12:24:07.258 INFO:tasks.workunit.client.0.smithi152.stdout:3/800: symlink d0/d10/d13/lfc 0 2024-04-06T12:24:07.259 INFO:tasks.workunit.client.0.smithi152.stdout:9/645: getdents d5/d39/d3f/d42/db6 0 2024-04-06T12:24:07.261 INFO:tasks.workunit.client.0.smithi152.stdout:3/801: stat d0/d35/d43/l7d 0 2024-04-06T12:24:07.263 INFO:tasks.workunit.client.0.smithi152.stdout:5/763: dread d3/da/d15/d40/d92/f78 [0,4194304] 0 2024-04-06T12:24:07.265 INFO:tasks.workunit.client.0.smithi152.stdout:5/764: fdatasync d3/da/d15/d2b/d3f/d68/d81/fef 0 2024-04-06T12:24:07.266 INFO:tasks.workunit.client.0.smithi152.stdout:3/802: mknod d0/d10/d1e/d71/db2/cfd 0 2024-04-06T12:24:07.268 INFO:tasks.workunit.client.0.smithi152.stdout:5/765: creat d3/da/d15/d2b/d3f/d68/d81/ff9 x:0 0 0 2024-04-06T12:24:07.270 INFO:tasks.workunit.client.0.smithi152.stdout:3/803: creat d0/d35/d43/dbe/ffe x:0 0 0 2024-04-06T12:24:07.271 INFO:tasks.workunit.client.0.smithi152.stdout:5/766: chown d3/da/d15/d2b/ca1 55 1 2024-04-06T12:24:07.273 INFO:tasks.workunit.client.0.smithi152.stdout:9/646: dread d5/d6/d74/d17/d23/d2d/d4b/d5a/f6f [0,4194304] 0 2024-04-06T12:24:07.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:05.586388+0000 mgr.smithi195.ausetj (mgr.24375) 87 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 58 MiB/s rd, 142 MiB/s wr, 358 op/s 2024-04-06T12:24:07.276 INFO:tasks.workunit.client.0.smithi152.stdout:9/647: write d5/d6/d74/d17/d86/fba [276214,18069] 0 2024-04-06T12:24:07.277 INFO:tasks.workunit.client.0.smithi152.stdout:5/767: truncate d3/da/d15/f1c 989391 0 2024-04-06T12:24:07.278 INFO:tasks.workunit.client.0.smithi152.stdout:6/845: sync 2024-04-06T12:24:07.279 INFO:tasks.workunit.client.0.smithi152.stdout:0/943: sync 2024-04-06T12:24:07.280 INFO:tasks.workunit.client.0.smithi152.stdout:6/846: dread - d7/d19/d3e/f5d zero size 2024-04-06T12:24:07.282 INFO:tasks.workunit.client.0.smithi152.stdout:6/847: chown d7/d19/d1b/d31/lb3 1435248157 1 2024-04-06T12:24:07.282 INFO:tasks.workunit.client.0.smithi152.stdout:5/768: mknod d3/da/d15/d2b/d3f/d68/d81/cfa 0 2024-04-06T12:24:07.283 INFO:tasks.workunit.client.0.smithi152.stdout:9/648: dread d5/d39/d3f/d42/f48 [4194304,4194304] 0 2024-04-06T12:24:07.283 INFO:tasks.workunit.client.0.smithi152.stdout:5/769: stat d3/da/d53/l8a 0 2024-04-06T12:24:07.284 INFO:tasks.workunit.client.0.smithi152.stdout:0/944: symlink d4/de/d7f/df4/l12e 0 2024-04-06T12:24:07.285 INFO:tasks.workunit.client.0.smithi152.stdout:9/649: write d5/fc2 [149324,1549] 0 2024-04-06T12:24:07.286 INFO:tasks.workunit.client.0.smithi152.stdout:3/804: dread d0/d10/d13/d2a/d93/f5f [0,4194304] 0 2024-04-06T12:24:07.286 INFO:tasks.workunit.client.0.smithi152.stdout:0/945: chown d4/d31/d47/d7e/dbe/fc0 1 1 2024-04-06T12:24:07.287 INFO:tasks.workunit.client.0.smithi152.stdout:3/805: fsync d0/d1f/d28/f86 0 2024-04-06T12:24:07.288 INFO:tasks.workunit.client.0.smithi152.stdout:9/650: write d5/d6/d74/d17/d23/d2d/d32/d36/f85 [3026588,89466] 0 2024-04-06T12:24:07.292 INFO:tasks.workunit.client.0.smithi152.stdout:3/806: dread d0/d10/d13/d2a/d4b/ded/fc9 [0,4194304] 0 2024-04-06T12:24:07.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:05.586388+0000 mgr.smithi195.ausetj (mgr.24375) 87 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 58 MiB/s rd, 142 MiB/s wr, 358 op/s 2024-04-06T12:24:07.319 INFO:tasks.workunit.client.0.smithi152.stdout:6/848: creat d7/d19/d1b/d1f/d3d/f115 x:0 0 0 2024-04-06T12:24:07.319 INFO:tasks.workunit.client.0.smithi152.stdout:6/849: dread - d7/d62/fd8 zero size 2024-04-06T12:24:07.320 INFO:tasks.workunit.client.0.smithi152.stdout:6/850: chown d7/d19/d1b/d22/f29 1159271 1 2024-04-06T12:24:07.327 INFO:tasks.workunit.client.0.smithi152.stdout:0/946: unlink d4/de/d28/d18/d3b/d2e/lcd 0 2024-04-06T12:24:07.327 INFO:tasks.workunit.client.0.smithi152.stdout:6/851: dwrite d7/d19/d3e/d70/f102 [0,4194304] 0 2024-04-06T12:24:07.339 INFO:tasks.workunit.client.0.smithi152.stdout:9/651: dwrite d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fbc [0,4194304] 0 2024-04-06T12:24:07.341 INFO:tasks.workunit.client.0.smithi152.stdout:9/652: chown d5/d6/d74/d17/d23/d2d/c34 73063383 1 2024-04-06T12:24:07.343 INFO:tasks.workunit.client.0.smithi152.stdout:9/653: read d5/d6/f16 [1676645,21310] 0 2024-04-06T12:24:07.346 INFO:tasks.workunit.client.0.smithi152.stdout:5/770: creat d3/da/d15/ffb x:0 0 0 2024-04-06T12:24:07.348 INFO:tasks.workunit.client.0.smithi152.stdout:0/947: mkdir d4/de/d28/d18/d3b/d12f 0 2024-04-06T12:24:07.350 INFO:tasks.workunit.client.0.smithi152.stdout:3/807: link d0/d10/d1e/f1d d0/d10/d1e/d71/fff 0 2024-04-06T12:24:07.354 INFO:tasks.workunit.client.0.smithi152.stdout:5/771: symlink d3/da/d15/d2b/d3f/db9/lfc 0 2024-04-06T12:24:07.357 INFO:tasks.workunit.client.0.smithi152.stdout:6/852: creat d7/d19/d1b/f116 x:0 0 0 2024-04-06T12:24:07.358 INFO:tasks.workunit.client.0.smithi152.stdout:0/948: creat d4/de/d28/d18/d3b/d2e/dcb/f130 x:0 0 0 2024-04-06T12:24:07.361 INFO:tasks.workunit.client.0.smithi152.stdout:3/808: symlink d0/d10/d13/d2a/d4b/d6a/l100 0 2024-04-06T12:24:07.362 INFO:tasks.workunit.client.0.smithi152.stdout:5/772: rmdir d3/da/d15/d2b/d3f/d6d 39 2024-04-06T12:24:07.363 INFO:tasks.workunit.client.0.smithi152.stdout:6/853: fsync d7/d9/d26/d2e/faf 0 2024-04-06T12:24:07.377 INFO:tasks.workunit.client.0.smithi152.stdout:9/654: link d5/d6/d74/d17/cc7 d5/d6/d74/d17/d23/ccb 0 2024-04-06T12:24:07.381 INFO:tasks.workunit.client.0.smithi152.stdout:5/773: write d3/da/d15/d40/d4f/f54 [1739261,106153] 0 2024-04-06T12:24:07.382 INFO:tasks.workunit.client.0.smithi152.stdout:9/655: mknod d5/d6/d74/d17/d23/d2d/d32/ccc 0 2024-04-06T12:24:07.383 INFO:tasks.workunit.client.0.smithi152.stdout:6/854: write d7/d19/d1b/d1f/f2a [99240,73443] 0 2024-04-06T12:24:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.390+0000 7f2ae6e99700 1 -- 172.21.15.152:0/2306753055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 msgr2=0x7f2ae00f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.390+0000 7f2ae6e99700 1 --2- 172.21.15.152:0/2306753055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 0x7f2ae00f6b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f2ad8009b60 tx=0x7f2ad8004d10).stop 2024-04-06T12:24:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.390+0000 7f2ae6e99700 1 -- 172.21.15.152:0/2306753055 shutdown_connections 2024-04-06T12:24:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.390+0000 7f2ae6e99700 1 --2- 172.21.15.152:0/2306753055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ae00f7990 0x7f2ae00f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.390+0000 7f2ae6e99700 1 --2- 172.21.15.152:0/2306753055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 0x7f2ae00f6b10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.390+0000 7f2ae6e99700 1 -- 172.21.15.152:0/2306753055 >> 172.21.15.152:0/2306753055 conn(0x7f2ae00f1e50 msgr2=0x7f2ae00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.390+0000 7f2ae6e99700 1 -- 172.21.15.152:0/2306753055 shutdown_connections 2024-04-06T12:24:07.389 INFO:tasks.workunit.client.0.smithi152.stdout:3/809: link d0/d10/d13/d2a/d93/d3d/c92 d0/d10/d45/c101 0 2024-04-06T12:24:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.390+0000 7f2ae6e99700 1 -- 172.21.15.152:0/2306753055 wait complete. 2024-04-06T12:24:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.391+0000 7f2ae6e99700 1 Processor -- start 2024-04-06T12:24:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.391+0000 7f2ae6e99700 1 -- start start 2024-04-06T12:24:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.391+0000 7f2ae6e99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 0x7f2ae0105df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae6e99700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ae00f7990 0x7f2ae01062e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae6e99700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0106890 con 0x7f2ae00f66f0 2024-04-06T12:24:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae6e99700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01069d0 con 0x7f2ae00f7990 2024-04-06T12:24:07.390 INFO:tasks.workunit.client.0.smithi152.stdout:0/949: dwrite d4/de/d28/d18/d43/fd2 [0,4194304] 0 2024-04-06T12:24:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae4c35700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 0x7f2ae0105df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae4c35700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 0x7f2ae0105df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40910/0 (socket says 172.21.15.152:40910) 2024-04-06T12:24:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae4c35700 1 -- 172.21.15.152:0/3248977587 learned_addr learned my addr 172.21.15.152:0/3248977587 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2adffff700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ae00f7990 0x7f2ae01062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae4c35700 1 -- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ae00f7990 msgr2=0x7f2ae01062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae4c35700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ae00f7990 0x7f2ae01062e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae4c35700 1 -- 172.21.15.152:0/3248977587 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8005040 con 0x7f2ae00f66f0 2024-04-06T12:24:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2adffff700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ae00f7990 0x7f2ae01062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:24:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.392+0000 7f2ae4c35700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 0x7f2ae0105df0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f2ad8003380 tx=0x7f2ad8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:07.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.393+0000 7f2addffb700 1 -- 172.21.15.152:0/3248977587 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ad800e070 con 0x7f2ae00f66f0 2024-04-06T12:24:07.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.393+0000 7f2addffb700 1 -- 172.21.15.152:0/3248977587 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ad801d8d0 con 0x7f2ae00f66f0 2024-04-06T12:24:07.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.393+0000 7f2addffb700 1 -- 172.21.15.152:0/3248977587 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ad8018070 con 0x7f2ae00f66f0 2024-04-06T12:24:07.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.393+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad80097c0 con 0x7f2ae00f66f0 2024-04-06T12:24:07.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.394+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae010b7c0 con 0x7f2ae00f66f0 2024-04-06T12:24:07.394 INFO:tasks.workunit.client.0.smithi152.stdout:9/656: unlink d5/d6/c12 0 2024-04-06T12:24:07.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.396+0000 7f2addffb700 1 -- 172.21.15.152:0/3248977587 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f2ad801da40 con 0x7f2ae00f66f0 2024-04-06T12:24:07.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.397+0000 7f2addffb700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2acc066db0 0x7f2acc069270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:07.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.397+0000 7f2addffb700 1 -- 172.21.15.152:0/3248977587 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f2ad8085860 con 0x7f2ae00f66f0 2024-04-06T12:24:07.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.397+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae00feeb0 con 0x7f2ae00f66f0 2024-04-06T12:24:07.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.398+0000 7f2adffff700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2acc066db0 0x7f2acc069270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:07.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.399+0000 7f2adffff700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2acc066db0 0x7f2acc069270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2ac8007fd0 tx=0x7f2ac8009cb0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:07.399 INFO:tasks.workunit.client.0.smithi152.stdout:5/774: truncate d3/de/f5b 855971 0 2024-04-06T12:24:07.399 INFO:tasks.workunit.client.0.smithi152.stdout:3/810: mkdir d0/d10/d13/d2a/d93/d3d/d102 0 2024-04-06T12:24:07.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.403+0000 7f2addffb700 1 -- 172.21.15.152:0/3248977587 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f2ad8053c10 con 0x7f2ae00f66f0 2024-04-06T12:24:07.403 INFO:tasks.workunit.client.0.smithi152.stdout:9/657: truncate d5/d39/fb7 245072 0 2024-04-06T12:24:07.406 INFO:tasks.workunit.client.0.smithi152.stdout:3/811: creat d0/d2d/d7f/d8c/f103 x:0 0 0 2024-04-06T12:24:07.407 INFO:tasks.workunit.client.0.smithi152.stdout:3/812: fdatasync d0/d1f/d28/f86 0 2024-04-06T12:24:07.408 INFO:tasks.workunit.client.0.smithi152.stdout:3/813: write d0/d35/d75/fac [1420970,47134] 0 2024-04-06T12:24:07.411 INFO:tasks.workunit.client.0.smithi152.stdout:3/814: readlink d0/d35/d43/lde 0 2024-04-06T12:24:07.416 INFO:tasks.workunit.client.0.smithi152.stdout:0/950: dwrite d4/de/d28/d18/d3b/fb4 [4194304,4194304] 0 2024-04-06T12:24:07.418 INFO:tasks.workunit.client.0.smithi152.stdout:3/815: creat d0/d10/d1e/d87/f104 x:0 0 0 2024-04-06T12:24:07.419 INFO:tasks.workunit.client.0.smithi152.stdout:3/816: dread - d0/d10/d1e/d87/f104 zero size 2024-04-06T12:24:07.420 INFO:tasks.workunit.client.0.smithi152.stdout:3/817: dread - d0/d10/d1e/d87/ffa zero size 2024-04-06T12:24:07.430 INFO:tasks.workunit.client.0.smithi152.stdout:5/775: getdents d3/da/d15/d2b/d3f/d6d 0 2024-04-06T12:24:07.432 INFO:tasks.workunit.client.0.smithi152.stdout:5/776: fsync d3/da/d15/d40/d4f/f54 0 2024-04-06T12:24:07.433 INFO:tasks.workunit.client.0.smithi152.stdout:9/658: dwrite d5/d39/d79/f7f [0,4194304] 0 2024-04-06T12:24:07.433 INFO:tasks.workunit.client.0.smithi152.stdout:3/818: getdents d0/d10/d13/d2a/d93/d3d 0 2024-04-06T12:24:07.435 INFO:tasks.workunit.client.0.smithi152.stdout:3/819: read d0/d1f/d44/f7b [950334,84896] 0 2024-04-06T12:24:07.436 INFO:tasks.workunit.client.0.smithi152.stdout:0/951: write d4/de/d87/d94/f7b [2308674,29076] 0 2024-04-06T12:24:07.441 INFO:tasks.workunit.client.0.smithi152.stdout:5/777: dread d3/da/d15/d40/d92/f78 [0,4194304] 0 2024-04-06T12:24:07.441 INFO:tasks.workunit.client.0.smithi152.stdout:3/820: symlink d0/d10/d13/d2a/d4b/d6a/def/l105 0 2024-04-06T12:24:07.449 INFO:tasks.workunit.client.0.smithi152.stdout:9/659: dwrite d5/d6/f73 [0,4194304] 0 2024-04-06T12:24:07.454 INFO:tasks.workunit.client.0.smithi152.stdout:3/821: rename d0/lec to d0/d1f/d44/l106 0 2024-04-06T12:24:07.454 INFO:tasks.workunit.client.0.smithi152.stdout:3/822: chown d0/d10/d1e 76 1 2024-04-06T12:24:07.456 INFO:tasks.workunit.client.0.smithi152.stdout:5/778: rename d3/da/d15/d40/d50/d99/faa to d3/da/d15/d2b/d3f/d6d/ffd 0 2024-04-06T12:24:07.460 INFO:tasks.workunit.client.0.smithi152.stdout:0/952: dwrite d4/d36/d72/d7c/d8d/fcf [0,4194304] 0 2024-04-06T12:24:07.460 INFO:tasks.workunit.client.0.smithi152.stdout:3/823: fsync d0/d2d/d7f/fa4 0 2024-04-06T12:24:07.462 INFO:tasks.workunit.client.0.smithi152.stdout:0/953: stat d4/de/d28/d18/d43/lfb 0 2024-04-06T12:24:07.462 INFO:tasks.workunit.client.0.smithi152.stdout:3/824: fsync d0/d10/d13/d2a/d93/d49/ff5 0 2024-04-06T12:24:07.463 INFO:tasks.workunit.client.0.smithi152.stdout:0/954: readlink d4/l21 0 2024-04-06T12:24:07.467 INFO:tasks.workunit.client.0.smithi152.stdout:3/825: stat d0/d35/f88 0 2024-04-06T12:24:07.474 INFO:tasks.workunit.client.0.smithi152.stdout:0/955: write d4/de/faf [982336,119493] 0 2024-04-06T12:24:07.475 INFO:tasks.workunit.client.0.smithi152.stdout:0/956: dread - d4/de/d28/d18/f10d zero size 2024-04-06T12:24:07.479 INFO:tasks.workunit.client.0.smithi152.stdout:5/779: creat d3/da/d15/d2b/d3f/d6d/dd1/da3/ffe x:0 0 0 2024-04-06T12:24:07.480 INFO:tasks.workunit.client.0.smithi152.stdout:0/957: creat d4/de/d28/d18/f131 x:0 0 0 2024-04-06T12:24:07.482 INFO:tasks.workunit.client.0.smithi152.stdout:3/826: truncate d0/d10/fd6 976511 0 2024-04-06T12:24:07.484 INFO:tasks.workunit.client.0.smithi152.stdout:3/827: fsync d0/d10/d13/d2a/d93/d49/d8d/d9e/fb3 0 2024-04-06T12:24:07.487 INFO:tasks.workunit.client.0.smithi152.stdout:5/780: creat d3/fff x:0 0 0 2024-04-06T12:24:07.489 INFO:tasks.workunit.client.0.smithi152.stdout:3/828: symlink d0/d10/d13/d2a/d93/d49/d8d/d9e/l107 0 2024-04-06T12:24:07.489 INFO:tasks.workunit.client.0.smithi152.stdout:5/781: mkdir d3/da/d15/d40/d92/d100 0 2024-04-06T12:24:07.494 INFO:tasks.workunit.client.0.smithi152.stdout:5/782: symlink d3/da/d15/d2b/d3f/db9/dcd/l101 0 2024-04-06T12:24:07.496 INFO:tasks.workunit.client.0.smithi152.stdout:0/958: dread d4/de/d28/d18/d43/f5f [0,4194304] 0 2024-04-06T12:24:07.507 INFO:tasks.workunit.client.0.smithi152.stdout:3/829: write d0/d1f/fc7 [446111,100980] 0 2024-04-06T12:24:07.508 INFO:tasks.workunit.client.0.smithi152.stdout:5/783: dread d3/da/d53/fb3 [0,4194304] 0 2024-04-06T12:24:07.510 INFO:tasks.workunit.client.0.smithi152.stdout:1/747: sync 2024-04-06T12:24:07.511 INFO:tasks.workunit.client.0.smithi152.stdout:4/847: sync 2024-04-06T12:24:07.511 INFO:tasks.workunit.client.0.smithi152.stdout:3/830: symlink d0/d10/d1e/d71/l108 0 2024-04-06T12:24:07.512 INFO:tasks.workunit.client.0.smithi152.stdout:0/959: write d4/de/d87/f77 [5006459,111466] 0 2024-04-06T12:24:07.515 INFO:tasks.workunit.client.0.smithi152.stdout:5/784: fdatasync d3/da/d15/d2b/d3f/d6d/dd1/fc8 0 2024-04-06T12:24:07.539 INFO:tasks.workunit.client.0.smithi152.stdout:0/960: mkdir d4/d31/d47/d7e/dbe/d8e/d132 0 2024-04-06T12:24:07.541 INFO:tasks.workunit.client.0.smithi152.stdout:3/831: creat d0/d10/d13/d2a/d93/d3d/d102/f109 x:0 0 0 2024-04-06T12:24:07.541 INFO:tasks.workunit.client.0.smithi152.stdout:1/748: dwrite d2/d2f/d54/d88/f34 [0,4194304] 0 2024-04-06T12:24:07.544 INFO:tasks.workunit.client.0.smithi152.stdout:5/785: chown d3/da/f47 3674 1 2024-04-06T12:24:07.546 INFO:tasks.workunit.client.0.smithi152.stdout:1/749: dread d2/d1d/f67 [0,4194304] 0 2024-04-06T12:24:07.549 INFO:tasks.workunit.client.0.smithi152.stdout:0/961: dwrite f1 [4194304,4194304] 0 2024-04-06T12:24:07.550 INFO:tasks.workunit.client.0.smithi152.stdout:4/848: getdents d7 0 2024-04-06T12:24:07.552 INFO:tasks.workunit.client.0.smithi152.stdout:3/832: rename d0/d10/d13/lfc to d0/d1f/d44/l10a 0 2024-04-06T12:24:07.554 INFO:tasks.workunit.client.0.smithi152.stdout:5/786: dread - d3/da/d15/d40/d46/f75 zero size 2024-04-06T12:24:07.557 INFO:tasks.workunit.client.0.smithi152.stdout:1/750: symlink d2/d5d/d6d/lfb 0 2024-04-06T12:24:07.558 INFO:tasks.workunit.client.0.smithi152.stdout:0/962: creat d4/d31/d47/d7e/f133 x:0 0 0 2024-04-06T12:24:07.562 INFO:tasks.workunit.client.0.smithi152.stdout:5/787: fdatasync d3/f11 0 2024-04-06T12:24:07.563 INFO:tasks.workunit.client.0.smithi152.stdout:0/963: read f3 [2343098,75387] 0 2024-04-06T12:24:07.564 INFO:tasks.workunit.client.0.smithi152.stdout:4/849: dwrite d7/d16/d22/d95/fce [4194304,4194304] 0 2024-04-06T12:24:07.566 INFO:tasks.workunit.client.0.smithi152.stdout:1/751: creat d2/d1d/d3b/dc3/ffc x:0 0 0 2024-04-06T12:24:07.568 INFO:tasks.workunit.client.0.smithi152.stdout:1/752: stat d2/d2f/d54/d88/d9c/db3 0 2024-04-06T12:24:07.568 INFO:tasks.workunit.client.0.smithi152.stdout:1/753: chown d2/d1d/d3b/f56 2611153 1 2024-04-06T12:24:07.576 INFO:tasks.workunit.client.0.smithi152.stdout:1/754: unlink d2/c1a 0 2024-04-06T12:24:07.580 INFO:tasks.workunit.client.0.smithi152.stdout:3/833: getdents d0/d35/d43/d48/d83 0 2024-04-06T12:24:07.584 INFO:tasks.workunit.client.0.smithi152.stdout:5/788: rename d3/de/f5b to d3/da/d15/d40/d50/d99/f102 0 2024-04-06T12:24:07.585 INFO:tasks.workunit.client.0.smithi152.stdout:5/789: read - d3/de/d8c/fed zero size 2024-04-06T12:24:07.586 INFO:tasks.workunit.client.0.smithi152.stdout:5/790: dread - d3/fe1 zero size 2024-04-06T12:24:07.593 INFO:tasks.workunit.client.0.smithi152.stdout:5/791: mknod d3/da/d15/d2b/d3f/db9/dcd/c103 0 2024-04-06T12:24:07.594 INFO:tasks.workunit.client.0.smithi152.stdout:0/964: getdents d4/de/d7f 0 2024-04-06T12:24:07.594 INFO:tasks.workunit.client.0.smithi152.stdout:3/834: dwrite d0/d35/d75/ff3 [0,4194304] 0 2024-04-06T12:24:07.595 INFO:tasks.workunit.client.0.smithi152.stdout:4/850: getdents d7/d16/d22/d95/dcf 0 2024-04-06T12:24:07.596 INFO:tasks.workunit.client.0.smithi152.stdout:4/851: stat d7/lc0 0 2024-04-06T12:24:07.597 INFO:tasks.workunit.client.0.smithi152.stdout:5/792: truncate d3/de/da9/fe4 344224 0 2024-04-06T12:24:07.599 INFO:tasks.workunit.client.0.smithi152.stdout:0/965: creat d4/d31/f134 x:0 0 0 2024-04-06T12:24:07.600 INFO:tasks.workunit.client.0.smithi152.stdout:4/852: readlink d7/d82/db1/lc1 0 2024-04-06T12:24:07.600 INFO:tasks.workunit.client.0.smithi152.stdout:3/835: symlink d0/d10/d13/d2a/d93/d3d/l10b 0 2024-04-06T12:24:07.605 INFO:tasks.workunit.client.0.smithi152.stdout:0/966: unlink d4/de/d28/d18/d3b/d2e/dcb/f11d 0 2024-04-06T12:24:07.606 INFO:tasks.workunit.client.0.smithi152.stdout:0/967: write d4/d36/f5b [1925157,61715] 0 2024-04-06T12:24:07.608 INFO:tasks.workunit.client.0.smithi152.stdout:4/853: rename d7/d29/d78/c42 to d7/d16/d55/c110 0 2024-04-06T12:24:07.616 INFO:tasks.workunit.client.0.smithi152.stdout:1/755: dwrite d2/d2f/f32 [0,4194304] 0 2024-04-06T12:24:07.617 INFO:tasks.workunit.client.0.smithi152.stdout:4/854: creat d7/d29/d7e/d59/f111 x:0 0 0 2024-04-06T12:24:07.621 INFO:tasks.workunit.client.0.smithi152.stdout:4/855: chown d7/d16/d22/d3f/db4/d60/dc4 826550068 1 2024-04-06T12:24:07.623 INFO:tasks.workunit.client.0.smithi152.stdout:0/968: write d4/de/d28/d18/d43/f5f [1153930,38337] 0 2024-04-06T12:24:07.624 INFO:tasks.workunit.client.0.smithi152.stdout:3/836: chown d0/d10/d13/d2a/d93/d3d/fcf 6688120 1 2024-04-06T12:24:07.624 INFO:tasks.workunit.client.0.smithi152.stdout:5/793: dwrite d3/da/d15/d40/d50/f7e [4194304,4194304] 0 2024-04-06T12:24:07.627 INFO:tasks.workunit.client.0.smithi152.stdout:4/856: fsync d7/d29/d7e/d59/f111 0 2024-04-06T12:24:07.636 INFO:tasks.workunit.client.0.smithi152.stdout:3/837: rename d0/d35/d43/d48/d83/cae to d0/d10/d1e/d71/db2/c10c 0 2024-04-06T12:24:07.645 INFO:tasks.workunit.client.0.smithi152.stdout:1/756: truncate d2/d5d/f8d 2909629 0 2024-04-06T12:24:07.648 INFO:tasks.workunit.client.0.smithi152.stdout:0/969: creat d4/d36/d72/d7c/d8d/f135 x:0 0 0 2024-04-06T12:24:07.649 INFO:tasks.workunit.client.0.smithi152.stdout:0/970: stat d4/de/d87/d94/c80 0 2024-04-06T12:24:07.650 INFO:tasks.workunit.client.0.smithi152.stdout:3/838: rename d0/d35/d75 to d0/d1f/d4a/dd3/d10d 0 2024-04-06T12:24:07.650 INFO:tasks.workunit.client.0.smithi152.stdout:0/971: fdatasync d4/de/d28/d18/d3b/fb4 0 2024-04-06T12:24:07.653 INFO:tasks.workunit.client.0.smithi152.stdout:1/757: creat d2/d2f/d54/d88/da4/ffd x:0 0 0 2024-04-06T12:24:07.658 INFO:tasks.workunit.client.0.smithi152.stdout:3/839: chown d0/d1f/d44/l8a 43465 1 2024-04-06T12:24:07.663 INFO:tasks.workunit.client.0.smithi152.stdout:0/972: creat d4/de/d28/d18/d3b/d12f/f136 x:0 0 0 2024-04-06T12:24:07.664 INFO:tasks.workunit.client.0.smithi152.stdout:3/840: dwrite d0/d1f/d4a/f98 [0,4194304] 0 2024-04-06T12:24:07.666 INFO:tasks.workunit.client.0.smithi152.stdout:0/973: write d4/de/d28/d18/d43/d62/dd4/f128 [4247279,14393] 0 2024-04-06T12:24:07.669 INFO:tasks.workunit.client.0.smithi152.stdout:1/758: mknod d2/d2f/d54/d88/d9c/dc5/dd0/cfe 0 2024-04-06T12:24:07.669 INFO:tasks.workunit.client.0.smithi152.stdout:4/857: truncate d7/d29/d7e/d59/fba 284837 0 2024-04-06T12:24:07.671 INFO:tasks.workunit.client.0.smithi152.stdout:1/759: chown d2/d2f/d45/c4d 49985 1 2024-04-06T12:24:07.672 INFO:tasks.workunit.client.0.smithi152.stdout:1/760: readlink l1 0 2024-04-06T12:24:07.672 INFO:tasks.workunit.client.0.smithi152.stdout:3/841: truncate d0/d2d/d7f/fa4 1133491 0 2024-04-06T12:24:07.675 INFO:tasks.workunit.client.0.smithi152.stdout:0/974: dwrite d4/de/d28/d18/d43/d62/dd4/f128 [4194304,4194304] 0 2024-04-06T12:24:07.675 INFO:tasks.workunit.client.0.smithi152.stdout:4/858: symlink d7/d16/d22/l112 0 2024-04-06T12:24:07.676 INFO:tasks.workunit.client.0.smithi152.stdout:1/761: rmdir d2/d2f 39 2024-04-06T12:24:07.679 INFO:tasks.workunit.client.0.smithi152.stdout:3/842: mkdir d0/d35/d43/d10e 0 2024-04-06T12:24:07.680 INFO:tasks.workunit.client.0.smithi152.stdout:3/843: chown d0/d10/d13/d2a/d93/d49/fad 466198918 1 2024-04-06T12:24:07.682 INFO:tasks.workunit.client.0.smithi152.stdout:3/844: chown d0/d1f/d4a/l61 249775952 1 2024-04-06T12:24:07.684 INFO:tasks.workunit.client.0.smithi152.stdout:1/762: write d2/d2f/fbe [927789,83504] 0 2024-04-06T12:24:07.688 INFO:tasks.workunit.client.0.smithi152.stdout:1/763: dread d2/d2f/f32 [0,4194304] 0 2024-04-06T12:24:07.693 INFO:tasks.workunit.client.0.smithi152.stdout:1/764: creat d2/d2f/d37/dae/db5/fff x:0 0 0 2024-04-06T12:24:07.696 INFO:tasks.workunit.client.0.smithi152.stdout:1/765: mknod d2/d2f/d37/c100 0 2024-04-06T12:24:07.698 INFO:tasks.workunit.client.0.smithi152.stdout:1/766: truncate d2/d2f/d37/dae/db5/fff 663066 0 2024-04-06T12:24:07.699 INFO:tasks.workunit.client.0.smithi152.stdout:1/767: chown d2/f42 7651551 1 2024-04-06T12:24:07.699 INFO:tasks.workunit.client.0.smithi152.stdout:1/768: chown d2/d2f/d37 35 1 2024-04-06T12:24:07.700 INFO:tasks.workunit.client.0.smithi152.stdout:1/769: readlink d2/d61/la0 0 2024-04-06T12:24:07.705 INFO:tasks.workunit.client.0.smithi152.stdout:1/770: unlink d2/d61/d85/fb4 0 2024-04-06T12:24:07.715 INFO:tasks.workunit.client.0.smithi152.stdout:4/859: write d7/d29/d7e/f93 [615059,65081] 0 2024-04-06T12:24:07.719 INFO:tasks.workunit.client.0.smithi152.stdout:0/975: dwrite d4/de/d87/f8f [0,4194304] 0 2024-04-06T12:24:07.723 INFO:tasks.workunit.client.0.smithi152.stdout:1/771: dread d2/d2f/d54/d88/d9c/dc5/dad/f3a [0,4194304] 0 2024-04-06T12:24:07.733 INFO:tasks.workunit.client.0.smithi152.stdout:4/860: truncate d7/d16/d22/d95/dda/f10e 345237 0 2024-04-06T12:24:07.735 INFO:tasks.workunit.client.0.smithi152.stdout:3/845: dwrite d0/d10/d1e/f1d [0,4194304] 0 2024-04-06T12:24:07.735 INFO:tasks.workunit.client.0.smithi152.stdout:4/861: chown d7/d16/ld9 186 1 2024-04-06T12:24:07.736 INFO:tasks.workunit.client.0.smithi152.stdout:4/862: chown d7/d29/d2e/f9a 14025029 1 2024-04-06T12:24:07.742 INFO:tasks.workunit.client.0.smithi152.stdout:7/778: sync 2024-04-06T12:24:07.742 INFO:tasks.workunit.client.0.smithi152.stdout:8/947: sync 2024-04-06T12:24:07.742 INFO:tasks.workunit.client.0.smithi152.stdout:2/829: sync 2024-04-06T12:24:07.742 INFO:tasks.workunit.client.0.smithi152.stdout:8/948: dread - d4/db/f13e zero size 2024-04-06T12:24:07.758 INFO:tasks.workunit.client.0.smithi152.stdout:2/830: dread d0/d2/f21 [0,4194304] 0 2024-04-06T12:24:07.760 INFO:tasks.workunit.client.0.smithi152.stdout:1/772: creat d2/d2f/d37/f101 x:0 0 0 2024-04-06T12:24:07.763 INFO:tasks.workunit.client.0.smithi152.stdout:4/863: write d7/d16/d22/dc7/dc8/ddd/ffd [665832,72650] 0 2024-04-06T12:24:07.764 INFO:tasks.workunit.client.0.smithi152.stdout:4/864: fdatasync d7/d16/d55/f99 0 2024-04-06T12:24:07.767 INFO:tasks.workunit.client.0.smithi152.stdout:8/949: mknod d4/dc/d10/d49/da0/d102/c14d 0 2024-04-06T12:24:07.768 INFO:tasks.workunit.client.0.smithi152.stdout:8/950: chown d4/d2c/d54/f5d 41617 1 2024-04-06T12:24:07.768 INFO:tasks.workunit.client.0.smithi152.stdout:7/779: symlink d8/df/d28/d41/dd4/d8c/d2d/da3/de4/l103 0 2024-04-06T12:24:07.774 INFO:tasks.workunit.client.0.smithi152.stdout:1/773: mknod d2/d2f/d54/d88/d9c/c102 0 2024-04-06T12:24:07.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.779+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ae00fbbd0 con 0x7f2acc066db0 2024-04-06T12:24:07.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.780+0000 7f2addffb700 1 -- 172.21.15.152:0/3248977587 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2ae00fbbd0 con 0x7f2acc066db0 2024-04-06T12:24:07.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.782+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2acc066db0 msgr2=0x7f2acc069270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:07.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.782+0000 7f2ae6e99700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2acc066db0 0x7f2acc069270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2ac8007fd0 tx=0x7f2ac8009cb0).stop 2024-04-06T12:24:07.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.782+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 msgr2=0x7f2ae0105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:07.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.782+0000 7f2ae6e99700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 0x7f2ae0105df0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f2ad8003380 tx=0x7f2ad8004d10).stop 2024-04-06T12:24:07.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.783+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 shutdown_connections 2024-04-06T12:24:07.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.783+0000 7f2ae6e99700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f2acc066db0 0x7f2acc069270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:07.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.783+0000 7f2ae6e99700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ae00f66f0 0x7f2ae0105df0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:07.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.783+0000 7f2ae6e99700 1 --2- 172.21.15.152:0/3248977587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ae00f7990 0x7f2ae01062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:07.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.783+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 >> 172.21.15.152:0/3248977587 conn(0x7f2ae00f1e50 msgr2=0x7f2ae0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:07.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.784+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 shutdown_connections 2024-04-06T12:24:07.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.784+0000 7f2ae6e99700 1 -- 172.21.15.152:0/3248977587 wait complete. 2024-04-06T12:24:07.785 INFO:tasks.workunit.client.0.smithi152.stdout:1/774: truncate d2/d2f/d54/d88/d9c/dc5/dad/d8c/fa9 1739194 0 2024-04-06T12:24:07.789 INFO:tasks.workunit.client.0.smithi152.stdout:8/951: fdatasync d4/db/d39/f13f 0 2024-04-06T12:24:07.794 INFO:tasks.workunit.client.0.smithi152.stdout:1/775: dwrite d2/d2f/d45/ff0 [0,4194304] 0 2024-04-06T12:24:07.798 INFO:tasks.workunit.client.0.smithi152.stdout:1/776: chown d2/db2/ff1 449146 1 2024-04-06T12:24:07.801 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:24:07.804 INFO:tasks.workunit.client.0.smithi152.stdout:4/865: getdents d7/d29/d2e/d7b 0 2024-04-06T12:24:07.808 INFO:tasks.workunit.client.0.smithi152.stdout:1/777: dread - d2/f76 zero size 2024-04-06T12:24:07.820 INFO:tasks.workunit.client.0.smithi152.stdout:4/866: fdatasync d7/d16/d22/d3f/fa2 0 2024-04-06T12:24:07.823 INFO:tasks.workunit.client.0.smithi152.stdout:4/867: write d7/d16/d22/dc7/f109 [911022,35108] 0 2024-04-06T12:24:07.826 INFO:tasks.workunit.client.0.smithi152.stdout:4/868: fdatasync d7/d16/d22/dc7/dc8/ddd/ffd 0 2024-04-06T12:24:07.834 INFO:tasks.workunit.client.0.smithi152.stdout:4/869: mknod d7/d82/db1/db6/c113 0 2024-04-06T12:24:07.835 INFO:tasks.workunit.client.0.smithi152.stdout:4/870: chown d7/d16/d55/leb 6 1 2024-04-06T12:24:07.839 INFO:tasks.workunit.client.0.smithi152.stdout:0/976: truncate d4/d31/d47/f9c 496935 0 2024-04-06T12:24:07.840 INFO:tasks.workunit.client.0.smithi152.stdout:4/871: write d7/d29/d78/ded/f71 [1648959,28318] 0 2024-04-06T12:24:07.841 INFO:tasks.workunit.client.0.smithi152.stdout:0/977: dread - d4/de/d28/d18/d3b/d12f/f136 zero size 2024-04-06T12:24:07.846 INFO:tasks.workunit.client.0.smithi152.stdout:1/778: dread d2/d2f/d54/d88/d9c/dc5/dad/f4e [0,4194304] 0 2024-04-06T12:24:07.846 INFO:tasks.workunit.client.0.smithi152.stdout:8/952: write d4/dc/d10/d51/fb5 [1289420,126650] 0 2024-04-06T12:24:07.848 INFO:tasks.workunit.client.0.smithi152.stdout:4/872: symlink d7/d16/d55/l114 0 2024-04-06T12:24:07.854 INFO:tasks.workunit.client.0.smithi152.stdout:1/779: write d2/f13 [7843001,50895] 0 2024-04-06T12:24:07.854 INFO:tasks.workunit.client.0.smithi152.stdout:4/873: stat d7/d29/d2e/d5b/l8e 0 2024-04-06T12:24:07.861 INFO:tasks.workunit.client.0.smithi152.stdout:0/978: truncate d4/de/d28/d18/d3b/d12f/f136 626984 0 2024-04-06T12:24:07.864 INFO:tasks.workunit.client.0.smithi152.stdout:3/846: dwrite d0/d2d/d7f/fa4 [0,4194304] 0 2024-04-06T12:24:07.867 INFO:tasks.workunit.client.0.smithi152.stdout:8/953: write d4/dc/f5b [3998388,83033] 0 2024-04-06T12:24:07.870 INFO:tasks.workunit.client.0.smithi152.stdout:7/780: dwrite d8/df/d28/f5a [0,4194304] 0 2024-04-06T12:24:07.871 INFO:tasks.workunit.client.0.smithi152.stdout:0/979: chown d4/d19/dbd/cda 335224 1 2024-04-06T12:24:07.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/954: read d4/db/d56/d85/dce/fd3 [1226780,6442] 0 2024-04-06T12:24:07.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/955: chown d4/db/d56/dcb/d6e 64 1 2024-04-06T12:24:07.881 INFO:tasks.workunit.client.0.smithi152.stdout:7/781: chown d8/df/d28/d41/dd4/d8c/f38 367524 1 2024-04-06T12:24:07.881 INFO:tasks.workunit.client.0.smithi152.stdout:3/847: creat d0/d10/d45/f10f x:0 0 0 2024-04-06T12:24:07.881 INFO:tasks.workunit.client.0.smithi152.stdout:0/980: mkdir d4/d31/d47/d7e/db9/df9/d137 0 2024-04-06T12:24:07.882 INFO:tasks.workunit.client.0.smithi152.stdout:7/782: chown d8/df/d28/d41/dd4/fa7 84493 1 2024-04-06T12:24:07.882 INFO:tasks.workunit.client.0.smithi152.stdout:8/956: creat d4/dc/d10/d49/da0/d102/f14e x:0 0 0 2024-04-06T12:24:07.883 INFO:tasks.workunit.client.0.smithi152.stdout:3/848: chown d0/d10/d1e/d87/da8/cd8 25 1 2024-04-06T12:24:07.886 INFO:tasks.workunit.client.0.smithi152.stdout:1/780: link d2/d2f/d54/d88/d9c/dc5/dad/c2b d2/d2f/d54/d88/da4/c103 0 2024-04-06T12:24:07.894 INFO:tasks.workunit.client.0.smithi152.stdout:8/957: mkdir d4/dc/d10/d49/dae/d14f 0 2024-04-06T12:24:07.895 INFO:tasks.workunit.client.0.smithi152.stdout:1/781: dread d2/d2f/d45/fef [4194304,4194304] 0 2024-04-06T12:24:07.896 INFO:tasks.workunit.client.0.smithi152.stdout:7/783: unlink d8/df/d28/d41/dd4/d8c/d2d/fd5 0 2024-04-06T12:24:07.898 INFO:tasks.workunit.client.0.smithi152.stdout:8/958: dread - d4/dc/d10/d49/da0/d102/f131 zero size 2024-04-06T12:24:07.899 INFO:tasks.workunit.client.0.smithi152.stdout:1/782: fsync d2/d2f/f65 0 2024-04-06T12:24:07.909 INFO:tasks.workunit.client.0.smithi152.stdout:4/874: dread d7/d29/d7e/f93 [0,4194304] 0 2024-04-06T12:24:07.911 INFO:tasks.workunit.client.0.smithi152.stdout:8/959: creat d4/d2c/df9/f150 x:0 0 0 2024-04-06T12:24:07.916 INFO:tasks.workunit.client.0.smithi152.stdout:1/783: dread d2/d2f/d54/d88/f34 [0,4194304] 0 2024-04-06T12:24:07.917 INFO:tasks.workunit.client.0.smithi152.stdout:3/849: creat d0/d10/d1e/d71/da2/f110 x:0 0 0 2024-04-06T12:24:07.917 INFO:tasks.workunit.client.0.smithi152.stdout:0/981: dread d4/de/d28/d18/d3b/d2e/fec [0,4194304] 0 2024-04-06T12:24:07.918 INFO:tasks.workunit.client.0.smithi152.stdout:7/784: stat d8/df/d28/d41/dd4/d8c/d2d 0 2024-04-06T12:24:07.920 INFO:tasks.workunit.client.0.smithi152.stdout:0/982: chown d4/de/d87/d94 0 1 2024-04-06T12:24:07.923 INFO:tasks.workunit.client.0.smithi152.stdout:8/960: dwrite d4/db/f13 [0,4194304] 0 2024-04-06T12:24:07.930 INFO:tasks.workunit.client.0.smithi152.stdout:3/850: dwrite d0/d1f/d4a/dd3/d10d/fac [0,4194304] 0 2024-04-06T12:24:07.936 INFO:tasks.workunit.client.0.smithi152.stdout:4/875: dwrite d7/d16/d22/d3f/db4/d60/f87 [4194304,4194304] 0 2024-04-06T12:24:07.942 INFO:tasks.workunit.client.0.smithi152.stdout:4/876: symlink d7/l115 0 2024-04-06T12:24:07.943 INFO:tasks.workunit.client.0.smithi152.stdout:3/851: symlink d0/d10/d13/d2a/l111 0 2024-04-06T12:24:07.947 INFO:tasks.workunit.client.0.smithi152.stdout:3/852: chown d0/d1f/d4a/cc8 443767585 1 2024-04-06T12:24:07.949 INFO:tasks.workunit.client.0.smithi152.stdout:1/784: dread d2/f13 [4194304,4194304] 0 2024-04-06T12:24:07.949 INFO:tasks.workunit.client.0.smithi152.stdout:7/785: dwrite d8/df/d28/d41/dd4/d8c/d2d/da3/fc8 [0,4194304] 0 2024-04-06T12:24:07.956 INFO:tasks.workunit.client.0.smithi152.stdout:1/785: mknod d2/d61/c104 0 2024-04-06T12:24:07.957 INFO:tasks.workunit.client.0.smithi152.stdout:1/786: stat d2/d2f/fbe 0 2024-04-06T12:24:07.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.960+0000 7f6253135700 1 -- 172.21.15.152:0/2380975354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c06a260 msgr2=0x7f624c103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:07.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.960+0000 7f6253135700 1 --2- 172.21.15.152:0/2380975354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c06a260 0x7f624c103d00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f6238004870 tx=0x7f623800ad00).stop 2024-04-06T12:24:07.959 INFO:tasks.workunit.client.0.smithi152.stdout:8/961: dwrite f3 [0,4194304] 0 2024-04-06T12:24:07.960 INFO:tasks.workunit.client.0.smithi152.stdout:3/853: truncate d0/d1f/d28/f90 744403 0 2024-04-06T12:24:07.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.961+0000 7f6253135700 1 -- 172.21.15.152:0/2380975354 shutdown_connections 2024-04-06T12:24:07.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.961+0000 7f6253135700 1 --2- 172.21.15.152:0/2380975354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c06a260 0x7f624c103d00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:07.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.961+0000 7f6253135700 1 --2- 172.21.15.152:0/2380975354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f624c069950 0x7f624c069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:07.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.961+0000 7f6253135700 1 -- 172.21.15.152:0/2380975354 >> 172.21.15.152:0/2380975354 conn(0x7f624c064880 msgr2=0x7f624c066ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:07.962 INFO:tasks.workunit.client.0.smithi152.stdout:0/983: dread d4/de/d28/d18/d3b/d2e/f4b [0,4194304] 0 2024-04-06T12:24:07.963 INFO:tasks.workunit.client.0.smithi152.stdout:3/854: readlink d0/d10/d13/d2a/d4b/d6a/l100 0 2024-04-06T12:24:07.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.967+0000 7f6253135700 1 -- 172.21.15.152:0/2380975354 shutdown_connections 2024-04-06T12:24:07.966 INFO:tasks.workunit.client.0.smithi152.stdout:4/877: unlink d7/d29/ffe 0 2024-04-06T12:24:07.968 INFO:tasks.workunit.client.0.smithi152.stdout:7/786: rename d8/l5d to d8/df/d28/d41/l104 0 2024-04-06T12:24:07.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.969+0000 7f6253135700 1 -- 172.21.15.152:0/2380975354 wait complete. 2024-04-06T12:24:07.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.970+0000 7f6253135700 1 Processor -- start 2024-04-06T12:24:07.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.970+0000 7f6253135700 1 -- start start 2024-04-06T12:24:07.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.971+0000 7f6253135700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c069950 0x7f624c10e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:07.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.971+0000 7f6253135700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f624c06a260 0x7f624c10ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:07.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.971+0000 7f6253135700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c10efd0 con 0x7f624c069950 2024-04-06T12:24:07.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.971+0000 7f6253135700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c10f110 con 0x7f624c06a260 2024-04-06T12:24:07.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.971+0000 7f624bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f624c06a260 0x7f624c10ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:07.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.971+0000 7f624bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f624c06a260 0x7f624c10ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:38340/0 (socket says 172.21.15.152:38340) 2024-04-06T12:24:07.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.971+0000 7f624bfff700 1 -- 172.21.15.152:0/447462673 learned_addr learned my addr 172.21.15.152:0/447462673 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:07.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.972+0000 7f624bfff700 1 -- 172.21.15.152:0/447462673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c069950 msgr2=0x7f624c10e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:07.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.972+0000 7f6250ed1700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c069950 0x7f624c10e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:07.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.972+0000 7f624bfff700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c069950 0x7f624c10e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:07.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.972+0000 7f624bfff700 1 -- 172.21.15.152:0/447462673 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6238005040 con 0x7f624c06a260 2024-04-06T12:24:07.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.972+0000 7f6250ed1700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c069950 0x7f624c10e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:24:07.971 INFO:tasks.workunit.client.0.smithi152.stdout:8/962: truncate d4/db/d56/dcb/dd5/feb 904005 0 2024-04-06T12:24:07.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.973+0000 7f624bfff700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f624c06a260 0x7f624c10ea20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6238014040 tx=0x7f623800ad00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:07.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.973+0000 7f6249ffb700 1 -- 172.21.15.152:0/447462673 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6238011650 con 0x7f624c06a260 2024-04-06T12:24:07.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.973+0000 7f6249ffb700 1 -- 172.21.15.152:0/447462673 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6238008e20 con 0x7f624c06a260 2024-04-06T12:24:07.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.973+0000 7f6249ffb700 1 -- 172.21.15.152:0/447462673 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f623801b940 con 0x7f624c06a260 2024-04-06T12:24:07.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.973+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c113b50 con 0x7f624c06a260 2024-04-06T12:24:07.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.973+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c1140c0 con 0x7f624c06a260 2024-04-06T12:24:07.972 INFO:tasks.workunit.client.0.smithi152.stdout:8/963: fsync d4/d2c/d114/f116 0 2024-04-06T12:24:07.972 INFO:tasks.workunit.client.0.smithi152.stdout:0/984: dread - d4/de/d87/f105 zero size 2024-04-06T12:24:07.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.975+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c1065b0 con 0x7f624c06a260 2024-04-06T12:24:07.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.976+0000 7f6249ffb700 1 -- 172.21.15.152:0/447462673 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f6238018030 con 0x7f624c06a260 2024-04-06T12:24:07.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.977+0000 7f6249ffb700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f623c066cf0 0x7f623c0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:07.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.977+0000 7f6249ffb700 1 -- 172.21.15.152:0/447462673 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f62380859b0 con 0x7f624c06a260 2024-04-06T12:24:07.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.977+0000 7f6250ed1700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f623c066cf0 0x7f623c0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:07.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.978+0000 7f6250ed1700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f623c066cf0 0x7f623c0691b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f624c068df0 tx=0x7f6240009040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:07.980 INFO:tasks.workunit.client.0.smithi152.stdout:0/985: truncate d4/de/d28/d18/d3b/d2e/f4b 3113833 0 2024-04-06T12:24:07.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:07.985+0000 7f6249ffb700 1 -- 172.21.15.152:0/447462673 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f6238053c10 con 0x7f624c06a260 2024-04-06T12:24:07.987 INFO:tasks.workunit.client.0.smithi152.stdout:1/787: dread d2/fb6 [0,4194304] 0 2024-04-06T12:24:07.992 INFO:tasks.workunit.client.0.smithi152.stdout:4/878: dread d7/d29/d78/ded/f71 [0,4194304] 0 2024-04-06T12:24:07.998 INFO:tasks.workunit.client.0.smithi152.stdout:7/787: getdents d8/df 0 2024-04-06T12:24:07.999 INFO:tasks.workunit.client.0.smithi152.stdout:8/964: dread d4/db/d56/fb1 [0,4194304] 0 2024-04-06T12:24:08.006 INFO:tasks.workunit.client.0.smithi152.stdout:3/855: truncate d0/d2d/d7f/fa4 3245218 0 2024-04-06T12:24:08.008 INFO:tasks.workunit.client.0.smithi152.stdout:0/986: write d4/de/d28/d18/d3b/d2e/d78/f79 [1030167,79118] 0 2024-04-06T12:24:08.009 INFO:tasks.workunit.client.0.smithi152.stdout:3/856: dread d0/d35/d43/fb1 [0,4194304] 0 2024-04-06T12:24:08.011 INFO:tasks.workunit.client.0.smithi152.stdout:6/855: sync 2024-04-06T12:24:08.011 INFO:tasks.workunit.client.0.smithi152.stdout:1/788: truncate d2/d2f/d45/ff0 3443053 0 2024-04-06T12:24:08.014 INFO:tasks.workunit.client.0.smithi152.stdout:8/965: creat d4/d2c/dbf/db2/dba/f151 x:0 0 0 2024-04-06T12:24:08.014 INFO:tasks.workunit.client.0.smithi152.stdout:4/879: truncate d7/d29/d7e/d59/f90 1262232 0 2024-04-06T12:24:08.015 INFO:tasks.workunit.client.0.smithi152.stdout:8/966: fdatasync d4/db/d32/f52 0 2024-04-06T12:24:08.015 INFO:tasks.workunit.client.0.smithi152.stdout:0/987: read d4/fa [31422,39593] 0 2024-04-06T12:24:08.024 INFO:tasks.workunit.client.0.smithi152.stdout:7/788: rename d8/df/d28/d41/dd4/d49/f80 to d8/df/d61/d4b/d56/db8/f105 0 2024-04-06T12:24:08.031 INFO:tasks.workunit.client.0.smithi152.stdout:8/967: fdatasync d4/d2c/d54/f5d 0 2024-04-06T12:24:08.033 INFO:tasks.workunit.client.0.smithi152.stdout:8/968: chown d4/db/d56/dcb/d6e/d88/cd2 22140405 1 2024-04-06T12:24:08.036 INFO:tasks.workunit.client.0.smithi152.stdout:6/856: rename c4 to d7/d19/d1b/d31/c117 0 2024-04-06T12:24:08.040 INFO:tasks.workunit.client.0.smithi152.stdout:1/789: write d2/d1d/d3b/f56 [1164712,58073] 0 2024-04-06T12:24:08.042 INFO:tasks.workunit.client.0.smithi152.stdout:1/790: chown d2/d61/f73 87113 1 2024-04-06T12:24:08.043 INFO:tasks.workunit.client.0.smithi152.stdout:3/857: dwrite d0/d10/d13/d2a/d93/d3d/fcf [0,4194304] 0 2024-04-06T12:24:08.045 INFO:tasks.workunit.client.0.smithi152.stdout:8/969: dwrite f3 [4194304,4194304] 0 2024-04-06T12:24:08.048 INFO:tasks.workunit.client.0.smithi152.stdout:0/988: creat d4/de/d28/d18/d43/d123/f138 x:0 0 0 2024-04-06T12:24:08.050 INFO:tasks.workunit.client.0.smithi152.stdout:6/857: fsync d7/d9/d26/d2e/fae 0 2024-04-06T12:24:08.051 INFO:tasks.workunit.client.0.smithi152.stdout:4/880: rmdir d7/d29/df2/d106 0 2024-04-06T12:24:08.053 INFO:tasks.workunit.client.0.smithi152.stdout:1/791: fsync d2/d2f/d37/f4a 0 2024-04-06T12:24:08.055 INFO:tasks.workunit.client.0.smithi152.stdout:8/970: creat d4/d5f/da7/d11f/f152 x:0 0 0 2024-04-06T12:24:08.059 INFO:tasks.workunit.client.0.smithi152.stdout:1/792: read d2/d61/d8f/fd8 [412812,107055] 0 2024-04-06T12:24:08.063 INFO:tasks.workunit.client.0.smithi152.stdout:6/858: mkdir d7/d19/d3e/d118 0 2024-04-06T12:24:08.071 INFO:tasks.workunit.client.0.smithi152.stdout:7/789: rename d8/df/d61/d6d/d85 to d8/df/d61/d76/d106 0 2024-04-06T12:24:08.073 INFO:tasks.workunit.client.0.smithi152.stdout:4/881: mknod d7/d16/d22/d95/c116 0 2024-04-06T12:24:08.080 INFO:tasks.workunit.client.0.smithi152.stdout:6/859: rename d7/d19/d1b/d1f/la1 to d7/d9/d73/l119 0 2024-04-06T12:24:08.081 INFO:tasks.workunit.client.0.smithi152.stdout:7/790: creat d8/df/d34/f107 x:0 0 0 2024-04-06T12:24:08.088 INFO:tasks.workunit.client.0.smithi152.stdout:3/858: getdents d0/d35/d43/d48/d83/d9d 0 2024-04-06T12:24:08.092 INFO:tasks.workunit.client.0.smithi152.stdout:0/989: getdents d4/de/d7f/df4 0 2024-04-06T12:24:08.092 INFO:tasks.workunit.client.0.smithi152.stdout:1/793: write d2/d2f/daf/fc8 [114121,83100] 0 2024-04-06T12:24:08.094 INFO:tasks.workunit.client.0.smithi152.stdout:6/860: fsync d7/d19/d1b/d31/d35/dbc/ff4 0 2024-04-06T12:24:08.095 INFO:tasks.workunit.client.0.smithi152.stdout:7/791: fsync d8/df/d61/fe 0 2024-04-06T12:24:08.096 INFO:tasks.workunit.client.0.smithi152.stdout:8/971: dwrite d4/dc/d10/d107/f12e [0,4194304] 0 2024-04-06T12:24:08.102 INFO:tasks.workunit.client.0.smithi152.stdout:3/859: symlink d0/d1f/d44/d7c/l112 0 2024-04-06T12:24:08.102 INFO:tasks.workunit.client.0.smithi152.stdout:0/990: dread d4/de/d87/f8f [0,4194304] 0 2024-04-06T12:24:08.103 INFO:tasks.workunit.client.0.smithi152.stdout:3/860: chown d0/d1f/d4a/cc8 0 1 2024-04-06T12:24:08.105 INFO:tasks.workunit.client.0.smithi152.stdout:1/794: symlink d2/d2f/d37/l105 0 2024-04-06T12:24:08.105 INFO:tasks.workunit.client.0.smithi152.stdout:6/861: dwrite d7/d9/d26/dd6/d101/f111 [0,4194304] 0 2024-04-06T12:24:08.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/882: creat d7/d29/d7e/f117 x:0 0 0 2024-04-06T12:24:08.108 INFO:tasks.workunit.client.0.smithi152.stdout:1/795: truncate d2/d2f/d54/ff5 45763 0 2024-04-06T12:24:08.236 INFO:tasks.workunit.client.0.smithi152.stdout:8/972: fsync d4/db/d56/dcb/f7d 0 2024-04-06T12:24:08.237 INFO:tasks.workunit.client.0.smithi152.stdout:8/973: readlink d4/d5f/l6c 0 2024-04-06T12:24:08.242 INFO:tasks.workunit.client.0.smithi152.stdout:0/991: symlink d4/de/d87/l139 0 2024-04-06T12:24:08.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.247+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f624c059120 con 0x7f623c066cf0 2024-04-06T12:24:08.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.248+0000 7f6249ffb700 1 -- 172.21.15.152:0/447462673 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f624c059120 con 0x7f623c066cf0 2024-04-06T12:24:08.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f623c066cf0 msgr2=0x7f623c0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f623c066cf0 0x7f623c0691b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f624c068df0 tx=0x7f6240009040).stop 2024-04-06T12:24:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f624c06a260 msgr2=0x7f624c10ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:08.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f624c06a260 0x7f624c10ea20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6238014040 tx=0x7f623800ad00).stop 2024-04-06T12:24:08.249 INFO:tasks.workunit.client.0.smithi152.stdout:1/796: creat d2/d2f/d54/d88/d9c/dc5/dad/d8c/f106 x:0 0 0 2024-04-06T12:24:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 shutdown_connections 2024-04-06T12:24:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f623c066cf0 0x7f623c0691b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c069950 0x7f624c10e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 --2- 172.21.15.152:0/447462673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f624c06a260 0x7f624c10ea20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 >> 172.21.15.152:0/447462673 conn(0x7f624c064880 msgr2=0x7f624c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 shutdown_connections 2024-04-06T12:24:08.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.251+0000 7f6253135700 1 -- 172.21.15.152:0/447462673 wait complete. 2024-04-06T12:24:08.251 INFO:tasks.workunit.client.0.smithi152.stdout:0/992: dread - d4/d31/d47/d7e/db9/dcc/f101 zero size 2024-04-06T12:24:08.254 INFO:tasks.workunit.client.0.smithi152.stdout:0/993: write d4/de/d28/d18/d43/d62/dd4/f128 [6821686,72031] 0 2024-04-06T12:24:08.258 INFO:tasks.workunit.client.0.smithi152.stdout:1/797: creat d2/d2f/d54/d88/d9c/db3/dd3/f107 x:0 0 0 2024-04-06T12:24:08.259 INFO:tasks.workunit.client.0.smithi152.stdout:9/660: sync 2024-04-06T12:24:08.261 INFO:tasks.workunit.client.0.smithi152.stdout:3/861: creat d0/d10/d1e/f113 x:0 0 0 2024-04-06T12:24:08.262 INFO:tasks.workunit.client.0.smithi152.stdout:4/883: dwrite d7/d16/d22/d3f/db4/f50 [8388608,4194304] 0 2024-04-06T12:24:08.263 INFO:tasks.workunit.client.0.smithi152.stdout:9/661: fdatasync d5/d6/d74/d17/d86/fba 0 2024-04-06T12:24:08.266 INFO:tasks.workunit.client.0.smithi152.stdout:3/862: write d0/d1f/d4a/dd3/d10d/fac [2194493,73214] 0 2024-04-06T12:24:08.270 INFO:tasks.workunit.client.0.smithi152.stdout:1/798: symlink d2/d2f/daf/de2/l108 0 2024-04-06T12:24:08.274 INFO:tasks.workunit.client.0.smithi152.stdout:8/974: dread d4/d2c/d2b/d83/fb4 [0,4194304] 0 2024-04-06T12:24:08.278 INFO:tasks.workunit.client.0.smithi152.stdout:6/862: getdents d7/d19/dbf 0 2024-04-06T12:24:08.278 INFO:tasks.workunit.client.0.smithi152.stdout:0/994: mkdir d4/de/d87/d94/dd3/d108/d13a 0 2024-04-06T12:24:08.279 INFO:tasks.workunit.client.0.smithi152.stdout:1/799: mknod d2/d2f/d54/d88/d9c/dc5/dd0/c109 0 2024-04-06T12:24:08.279 INFO:tasks.workunit.client.0.smithi152.stdout:9/662: dwrite d5/d39/d3f/fab [4194304,4194304] 0 2024-04-06T12:24:08.280 INFO:tasks.workunit.client.0.smithi152.stdout:4/884: creat d7/d16/d55/da0/df6/f118 x:0 0 0 2024-04-06T12:24:08.283 INFO:tasks.workunit.client.0.smithi152.stdout:0/995: chown d4/de/d28/f95 103500 1 2024-04-06T12:24:08.283 INFO:tasks.workunit.client.0.smithi152.stdout:3/863: dwrite d0/d1f/d4a/f98 [0,4194304] 0 2024-04-06T12:24:08.295 INFO:tasks.workunit.client.0.smithi152.stdout:4/885: mknod d7/d16/d22/d95/dda/c119 0 2024-04-06T12:24:08.299 INFO:tasks.workunit.client.0.smithi152.stdout:0/996: link d4/de/d87/f77 d4/de/d28/d18/f13b 0 2024-04-06T12:24:08.299 INFO:tasks.workunit.client.0.smithi152.stdout:3/864: dwrite d0/d10/d1e/d71/db2/fe6 [0,4194304] 0 2024-04-06T12:24:08.304 INFO:tasks.workunit.client.0.smithi152.stdout:1/800: write d2/d1d/f3e [498536,36843] 0 2024-04-06T12:24:08.304 INFO:tasks.workunit.client.0.smithi152.stdout:3/865: chown d0/d10/d1e/d71/lf7 32410493 1 2024-04-06T12:24:08.307 INFO:tasks.workunit.client.0.smithi152.stdout:1/801: dread - d2/d5d/d6d/f84 zero size 2024-04-06T12:24:08.314 INFO:tasks.workunit.client.0.smithi152.stdout:4/886: link d7/d16/d22/d3f/db4/d60/dc4/cf5 d7/d82/db1/c11a 0 2024-04-06T12:24:08.316 INFO:tasks.workunit.client.0.smithi152.stdout:8/975: dread d4/d2c/d54/f75 [0,4194304] 0 2024-04-06T12:24:08.317 INFO:tasks.workunit.client.0.smithi152.stdout:6/863: dread d7/d9/d73/fc5 [0,4194304] 0 2024-04-06T12:24:08.317 INFO:tasks.workunit.client.0.smithi152.stdout:0/997: dwrite d4/d36/d72/d7c/d8d/f135 [0,4194304] 0 2024-04-06T12:24:08.320 INFO:tasks.workunit.client.0.smithi152.stdout:1/802: mkdir d2/d2f/d54/d88/d9c/dc5/dad/d8c/d10a 0 2024-04-06T12:24:08.328 INFO:tasks.workunit.client.0.smithi152.stdout:0/998: write d4/d36/d72/d7c/d8d/f135 [756096,105121] 0 2024-04-06T12:24:08.329 INFO:tasks.workunit.client.0.smithi152.stdout:9/663: dwrite d5/d6/f16 [4194304,4194304] 0 2024-04-06T12:24:08.335 INFO:tasks.workunit.client.0.smithi152.stdout:6/864: dwrite d7/d19/d3e/fc4 [0,4194304] 0 2024-04-06T12:24:08.336 INFO:tasks.workunit.client.0.smithi152.stdout:1/803: creat d2/d5d/f10b x:0 0 0 2024-04-06T12:24:08.342 INFO:tasks.workunit.client.0.smithi152.stdout:0/999: mkdir d4/d36/d72/d7c/d8d/d13c 0 2024-04-06T12:24:08.342 INFO:tasks.workunit.client.0.smithi152.stdout:9/664: dread d5/d6/d74/d17/d86/fba [0,4194304] 0 2024-04-06T12:24:08.347 INFO:tasks.workunit.client.0.smithi152.stdout:4/887: write d7/f2a [221812,120465] 0 2024-04-06T12:24:08.352 INFO:tasks.workunit.client.0.smithi152.stdout:1/804: mkdir d2/d61/d8f/d10c 0 2024-04-06T12:24:08.352 INFO:tasks.workunit.client.0.smithi152.stdout:8/976: dwrite d4/db/d56/dcb/d6e/d88/fe3 [0,4194304] 0 2024-04-06T12:24:08.356 INFO:tasks.workunit.client.0.smithi152.stdout:4/888: creat d7/d16/f11b x:0 0 0 2024-04-06T12:24:08.357 INFO:tasks.workunit.client.0.smithi152.stdout:3/866: dwrite d0/d35/d43/fea [0,4194304] 0 2024-04-06T12:24:08.362 INFO:tasks.workunit.client.0.smithi152.stdout:9/665: creat d5/d39/d3f/d42/db6/fcd x:0 0 0 2024-04-06T12:24:08.363 INFO:tasks.workunit.client.0.smithi152.stdout:6/865: dwrite d7/d9/d73/fc5 [0,4194304] 0 2024-04-06T12:24:08.395 INFO:tasks.workunit.client.0.smithi152.stdout:1/805: rename d2/d2f/d45/l94 to d2/d2f/daf/de2/l10d 0 2024-04-06T12:24:08.396 INFO:tasks.workunit.client.0.smithi152.stdout:3/867: creat d0/d10/d1e/d71/db2/f114 x:0 0 0 2024-04-06T12:24:08.402 INFO:tasks.workunit.client.0.smithi152.stdout:9/666: creat d5/d6/d74/d17/d23/d2d/d98/da4/fce x:0 0 0 2024-04-06T12:24:08.402 INFO:tasks.workunit.client.0.smithi152.stdout:1/806: dread d2/d2f/daf/de2/fe8 [0,4194304] 0 2024-04-06T12:24:08.404 INFO:tasks.workunit.client.0.smithi152.stdout:6/866: truncate d7/d9/d26/d4a/d7b/fc3 1017137 0 2024-04-06T12:24:08.405 INFO:tasks.workunit.client.0.smithi152.stdout:4/889: dwrite d7/d16/f83 [0,4194304] 0 2024-04-06T12:24:08.406 INFO:tasks.workunit.client.0.smithi152.stdout:9/667: read - d5/d6/d74/d69/fca zero size 2024-04-06T12:24:08.407 INFO:tasks.workunit.client.0.smithi152.stdout:6/867: write d7/d9/d26/dd6/d101/f111 [2096068,57651] 0 2024-04-06T12:24:08.409 INFO:tasks.workunit.client.0.smithi152.stdout:3/868: fsync d0/fb 0 2024-04-06T12:24:08.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.416+0000 7fae26cae700 1 -- 172.21.15.152:0/3187585654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006e840 msgr2=0x7fae2006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:08.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.416+0000 7fae26cae700 1 --2- 172.21.15.152:0/3187585654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006e840 0x7fae2006ecc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fae0c0047f0 tx=0x7fae0c009cb0).stop 2024-04-06T12:24:08.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.416+0000 7fae26cae700 1 -- 172.21.15.152:0/3187585654 shutdown_connections 2024-04-06T12:24:08.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.416+0000 7fae26cae700 1 --2- 172.21.15.152:0/3187585654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006e840 0x7fae2006ecc0 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0x7fae0c0047f0 tx=0x7fae0c009cb0).stop 2024-04-06T12:24:08.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.416+0000 7fae26cae700 1 --2- 172.21.15.152:0/3187585654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2006d550 0x7fae2006d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:08.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.416+0000 7fae26cae700 1 -- 172.21.15.152:0/3187585654 >> 172.21.15.152:0/3187585654 conn(0x7fae200f52f0 msgr2=0x7fae200f76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:08.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.417+0000 7fae26cae700 1 -- 172.21.15.152:0/3187585654 shutdown_connections 2024-04-06T12:24:08.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.417+0000 7fae26cae700 1 -- 172.21.15.152:0/3187585654 wait complete. 2024-04-06T12:24:08.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.418+0000 7fae26cae700 1 Processor -- start 2024-04-06T12:24:08.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.418+0000 7fae26cae700 1 -- start start 2024-04-06T12:24:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.418+0000 7fae26cae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006d550 0x7fae2010e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.419+0000 7fae26cae700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2010eb50 0x7fae20113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.419+0000 7fae26cae700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2010f020 con 0x7fae2006d550 2024-04-06T12:24:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.419+0000 7fae26cae700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2010f160 con 0x7fae2010eb50 2024-04-06T12:24:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.419+0000 7fae24a4a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006d550 0x7fae2010e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.419+0000 7fae24a4a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006d550 0x7fae2010e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40946/0 (socket says 172.21.15.152:40946) 2024-04-06T12:24:08.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.419+0000 7fae24a4a700 1 -- 172.21.15.152:0/1821323279 learned_addr learned my addr 172.21.15.152:0/1821323279 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:08.418 INFO:tasks.workunit.client.0.smithi152.stdout:4/890: dwrite d7/d16/d22/dc7/fd6 [0,4194304] 0 2024-04-06T12:24:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.420+0000 7fae24a4a700 1 -- 172.21.15.152:0/1821323279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2010eb50 msgr2=0x7fae20113c20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-06T12:24:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.420+0000 7fae24a4a700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2010eb50 0x7fae20113c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:24:08.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.420+0000 7fae24a4a700 1 -- 172.21.15.152:0/1821323279 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c005040 con 0x7fae2006d550 2024-04-06T12:24:08.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.420+0000 7fae24a4a700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006d550 0x7fae2010e660 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fae140041d0 tx=0x7fae14009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:08.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.421+0000 7fae1dffb700 1 -- 172.21.15.152:0/1821323279 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae14002d90 con 0x7fae2006d550 2024-04-06T12:24:08.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.421+0000 7fae1dffb700 1 -- 172.21.15.152:0/1821323279 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae1400f040 con 0x7fae2006d550 2024-04-06T12:24:08.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.421+0000 7fae1dffb700 1 -- 172.21.15.152:0/1821323279 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae1400d820 con 0x7fae2006d550 2024-04-06T12:24:08.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.421+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae20114110 con 0x7fae2006d550 2024-04-06T12:24:08.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.421+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae20114670 con 0x7fae2006d550 2024-04-06T12:24:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.423+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae201065e0 con 0x7fae2006d550 2024-04-06T12:24:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.426+0000 7fae1dffb700 1 -- 172.21.15.152:0/1821323279 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7fae1400d980 con 0x7fae2006d550 2024-04-06T12:24:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.427+0000 7fae1dffb700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fae10066e00 0x7fae100692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.427+0000 7fae1dffb700 1 -- 172.21.15.152:0/1821323279 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fae14083e60 con 0x7fae2006d550 2024-04-06T12:24:08.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.427+0000 7fae1ffff700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fae10066e00 0x7fae100692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:08.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.429+0000 7fae1ffff700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fae10066e00 0x7fae100692c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fae0c009040 tx=0x7fae0c009cb0).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:08.430 INFO:tasks.workunit.client.0.smithi152.stdout:3/869: creat d0/d10/d13/d2a/d93/d49/d8d/f115 x:0 0 0 2024-04-06T12:24:08.430 INFO:tasks.workunit.client.0.smithi152.stdout:9/668: dread d5/d39/d3f/d42/f89 [0,4194304] 0 2024-04-06T12:24:08.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.432+0000 7fae1dffb700 1 -- 172.21.15.152:0/1821323279 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fae14052160 con 0x7fae2006d550 2024-04-06T12:24:08.436 INFO:tasks.workunit.client.0.smithi152.stdout:9/669: creat d5/d6/d74/d17/d86/fcf x:0 0 0 2024-04-06T12:24:08.438 INFO:tasks.workunit.client.0.smithi152.stdout:4/891: fsync d7/d16/d55/da0/f104 0 2024-04-06T12:24:08.440 INFO:tasks.workunit.client.0.smithi152.stdout:1/807: dwrite d2/d2f/d54/d88/f40 [0,4194304] 0 2024-04-06T12:24:08.441 INFO:tasks.workunit.client.0.smithi152.stdout:4/892: chown d7/d29/d2e/f8a 3358 1 2024-04-06T12:24:08.441 INFO:tasks.workunit.client.0.smithi152.stdout:3/870: fdatasync d0/d2d/d7f/fa4 0 2024-04-06T12:24:08.442 INFO:tasks.workunit.client.0.smithi152.stdout:9/670: fsync d5/f1d 0 2024-04-06T12:24:08.447 INFO:tasks.workunit.client.0.smithi152.stdout:6/868: dread d7/d19/f23 [0,4194304] 0 2024-04-06T12:24:08.451 INFO:tasks.workunit.client.0.smithi152.stdout:3/871: mknod d0/d1f/d4a/dd3/c116 0 2024-04-06T12:24:08.453 INFO:tasks.workunit.client.0.smithi152.stdout:1/808: mkdir d2/d2f/d54/d88/d9c/dc5/d10e 0 2024-04-06T12:24:08.456 INFO:tasks.workunit.client.0.smithi152.stdout:6/869: truncate d7/d19/d3e/f40 4926758 0 2024-04-06T12:24:08.457 INFO:tasks.workunit.client.0.smithi152.stdout:6/870: chown d7/d19/lc8 238610848 1 2024-04-06T12:24:08.458 INFO:tasks.workunit.client.0.smithi152.stdout:6/871: chown d7/d9/d26/f9f 7 1 2024-04-06T12:24:08.459 INFO:tasks.workunit.client.0.smithi152.stdout:3/872: unlink d0/d35/f82 0 2024-04-06T12:24:08.460 INFO:tasks.workunit.client.0.smithi152.stdout:4/893: write d7/d29/d7e/d59/f62 [2073262,130766] 0 2024-04-06T12:24:08.467 INFO:tasks.workunit.client.0.smithi152.stdout:9/671: creat d5/d6/d74/d17/d23/fd0 x:0 0 0 2024-04-06T12:24:08.468 INFO:tasks.workunit.client.0.smithi152.stdout:9/672: write d5/fc2 [329871,69781] 0 2024-04-06T12:24:08.470 INFO:tasks.workunit.client.0.smithi152.stdout:9/673: chown d5/d39/d3f/d42/db6/fcd 12365082 1 2024-04-06T12:24:08.471 INFO:tasks.workunit.client.0.smithi152.stdout:3/873: rename d0/d1f/d4a/l4d to d0/d1f/d44/d7c/l117 0 2024-04-06T12:24:08.473 INFO:tasks.workunit.client.0.smithi152.stdout:9/674: read d5/d6/d74/d17/f46 [955959,21763] 0 2024-04-06T12:24:08.476 INFO:tasks.workunit.client.0.smithi152.stdout:9/675: write d5/d39/d3f/d42/db6/fcd [683546,73354] 0 2024-04-06T12:24:08.476 INFO:tasks.workunit.client.0.smithi152.stdout:3/874: dread d0/d10/d13/d2a/fe0 [0,4194304] 0 2024-04-06T12:24:08.479 INFO:tasks.workunit.client.0.smithi152.stdout:6/872: dread d7/d19/d3e/d70/f102 [0,4194304] 0 2024-04-06T12:24:08.480 INFO:tasks.workunit.client.0.smithi152.stdout:9/676: chown d5/d39/d79/daa/fb2 208878320 1 2024-04-06T12:24:08.480 INFO:tasks.workunit.client.0.smithi152.stdout:4/894: dread d7/d29/d7e/d59/f62 [0,4194304] 0 2024-04-06T12:24:08.481 INFO:tasks.workunit.client.0.smithi152.stdout:1/809: truncate d2/d2f/d54/d88/d9c/dc5/f87 63977 0 2024-04-06T12:24:08.482 INFO:tasks.workunit.client.0.smithi152.stdout:3/875: truncate d0/d10/d13/d2a/db6/fd7 466672 0 2024-04-06T12:24:08.484 INFO:tasks.workunit.client.0.smithi152.stdout:3/876: dread - d0/d10/d13/d2a/d4b/d6a/ff0 zero size 2024-04-06T12:24:08.485 INFO:tasks.workunit.client.0.smithi152.stdout:6/873: chown d7/d9/l2d 868 1 2024-04-06T12:24:08.485 INFO:tasks.workunit.client.0.smithi152.stdout:9/677: chown d5/d6/d74/d17/d23/l43 13 1 2024-04-06T12:24:08.492 INFO:tasks.workunit.client.0.smithi152.stdout:6/874: fsync d7/d19/d1b/d31/f3c 0 2024-04-06T12:24:08.495 INFO:tasks.workunit.client.0.smithi152.stdout:4/895: link d7/d16/d55/ff4 d7/d29/d2e/d5b/db2/dd7/f11c 0 2024-04-06T12:24:08.505 INFO:tasks.workunit.client.0.smithi152.stdout:1/810: link d2/d2f/d54/d88/d9c/c102 d2/d1d/d3b/dc3/d9f/c10f 0 2024-04-06T12:24:08.506 INFO:tasks.workunit.client.0.smithi152.stdout:2/831: sync 2024-04-06T12:24:08.506 INFO:tasks.workunit.client.0.smithi152.stdout:5/794: sync 2024-04-06T12:24:08.507 INFO:tasks.workunit.client.0.smithi152.stdout:5/795: readlink d3/de/d80/d8f/lb0 0 2024-04-06T12:24:08.508 INFO:tasks.workunit.client.0.smithi152.stdout:5/796: write d3/da/d15/d2b/d3f/db9/fbe [4689556,71345] 0 2024-04-06T12:24:08.508 INFO:tasks.workunit.client.0.smithi152.stdout:9/678: creat d5/d6/fd1 x:0 0 0 2024-04-06T12:24:08.510 INFO:tasks.workunit.client.0.smithi152.stdout:9/679: truncate d5/d6/f95 1434058 0 2024-04-06T12:24:08.513 INFO:tasks.workunit.client.0.smithi152.stdout:3/877: write d0/d10/d13/ff8 [1560682,124634] 0 2024-04-06T12:24:08.515 INFO:tasks.workunit.client.0.smithi152.stdout:2/832: mknod d0/dc9/c110 0 2024-04-06T12:24:08.515 INFO:tasks.workunit.client.0.smithi152.stdout:6/875: write d7/d19/d1b/d31/d35/dbc/ff4 [3390548,26864] 0 2024-04-06T12:24:08.521 INFO:tasks.workunit.client.0.smithi152.stdout:9/680: dwrite d5/d6/d74/d17/d86/fcf [0,4194304] 0 2024-04-06T12:24:08.525 INFO:tasks.workunit.client.0.smithi152.stdout:1/811: link d2/d2f/d54/d88/d9c/db3/ff2 d2/d1d/d3b/dc3/d9f/f110 0 2024-04-06T12:24:08.528 INFO:tasks.workunit.client.0.smithi152.stdout:4/896: dwrite d7/d16/f96 [0,4194304] 0 2024-04-06T12:24:08.530 INFO:tasks.workunit.client.0.smithi152.stdout:1/812: write d2/d61/f6c [766238,109100] 0 2024-04-06T12:24:08.537 INFO:tasks.workunit.client.0.smithi152.stdout:9/681: dwrite d5/d6/f73 [0,4194304] 0 2024-04-06T12:24:08.539 INFO:tasks.workunit.client.0.smithi152.stdout:1/813: mkdir d2/d1d/d3b/dc3/d111 0 2024-04-06T12:24:08.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/897: truncate d7/d29/d78/f39 2229971 0 2024-04-06T12:24:08.543 INFO:tasks.workunit.client.0.smithi152.stdout:9/682: truncate d5/d39/d3f/d42/fc0 314515 0 2024-04-06T12:24:08.544 INFO:tasks.workunit.client.0.smithi152.stdout:3/878: rename d0/d35/d43/d48/fbc to d0/d10/d13/d2a/f118 0 2024-04-06T12:24:08.545 INFO:tasks.workunit.client.0.smithi152.stdout:1/814: fdatasync d2/d2f/d54/d88/d9c/dc5/dad/fcf 0 2024-04-06T12:24:08.546 INFO:tasks.workunit.client.0.smithi152.stdout:6/876: link d7/d19/d1b/d31/d7c/fd9 d7/d19/d1b/d1f/f11a 0 2024-04-06T12:24:08.552 INFO:tasks.workunit.client.0.smithi152.stdout:9/683: dwrite d5/d6/d74/fbd [0,4194304] 0 2024-04-06T12:24:08.559 INFO:tasks.workunit.client.0.smithi152.stdout:9/684: symlink d5/d6/d74/ld2 0 2024-04-06T12:24:08.565 INFO:tasks.workunit.client.0.smithi152.stdout:2/833: rename d0/d15/d24/d3d/cba to d0/d40/d41/c111 0 2024-04-06T12:24:08.572 INFO:tasks.workunit.client.0.smithi152.stdout:2/834: dwrite d0/d15/d24/f72 [0,4194304] 0 2024-04-06T12:24:08.577 INFO:tasks.workunit.client.0.smithi152.stdout:5/797: rename d3/da/d15/d2b/d3f/d68/d81/fdf to d3/da/d15/d2b/d3f/d6d/db1/f104 0 2024-04-06T12:24:08.580 INFO:tasks.workunit.client.0.smithi152.stdout:9/685: mkdir d5/d6/dd3 0 2024-04-06T12:24:08.583 INFO:tasks.workunit.client.0.smithi152.stdout:3/879: getdents d0/d1f/d4a/dd3 0 2024-04-06T12:24:08.584 INFO:tasks.workunit.client.0.smithi152.stdout:4/898: write d7/d29/d7e/d59/fba [64840,110935] 0 2024-04-06T12:24:08.585 INFO:tasks.workunit.client.0.smithi152.stdout:2/835: creat d0/d40/d26/db4/f112 x:0 0 0 2024-04-06T12:24:08.587 INFO:tasks.workunit.client.0.smithi152.stdout:6/877: dwrite d7/d19/d1b/d31/f3c [4194304,4194304] 0 2024-04-06T12:24:08.592 INFO:tasks.workunit.client.0.smithi152.stdout:1/815: rename d2/d2f/d54/d88/d9c/dc5/dad/d8c/cee to d2/d5d/ddf/c112 0 2024-04-06T12:24:08.593 INFO:tasks.workunit.client.0.smithi152.stdout:5/798: truncate d3/de/fcf 104607 0 2024-04-06T12:24:08.594 INFO:tasks.workunit.client.0.smithi152.stdout:3/880: symlink d0/d2d/d7f/d8c/l119 0 2024-04-06T12:24:08.597 INFO:tasks.workunit.client.0.smithi152.stdout:4/899: rename d7/d16/d22/l112 to d7/d82/l11d 0 2024-04-06T12:24:08.600 INFO:tasks.workunit.client.0.smithi152.stdout:9/686: symlink d5/d39/ld4 0 2024-04-06T12:24:08.601 INFO:tasks.workunit.client.0.smithi152.stdout:5/799: dwrite d3/f1f [0,4194304] 0 2024-04-06T12:24:08.606 INFO:tasks.workunit.client.0.smithi152.stdout:6/878: creat d7/d9/d26/dd6/d101/d10f/f11b x:0 0 0 2024-04-06T12:24:08.618 INFO:tasks.workunit.client.0.smithi152.stdout:5/800: mkdir d3/da/d15/d40/d46/d105 0 2024-04-06T12:24:08.622 INFO:tasks.workunit.client.0.smithi152.stdout:6/879: dread d7/d19/d3e/d70/f7e [0,4194304] 0 2024-04-06T12:24:08.624 INFO:tasks.workunit.client.0.smithi152.stdout:4/900: unlink d7/lf 0 2024-04-06T12:24:08.629 INFO:tasks.workunit.client.0.smithi152.stdout:5/801: chown d3/da/d15/d2b/d3f/d6d/c91 3 1 2024-04-06T12:24:08.630 INFO:tasks.workunit.client.0.smithi152.stdout:3/881: dwrite d0/d35/d43/d48/d83/ff4 [0,4194304] 0 2024-04-06T12:24:08.635 INFO:tasks.workunit.client.0.smithi152.stdout:1/816: getdents d2/d2f/d37/dae 0 2024-04-06T12:24:08.642 INFO:tasks.workunit.client.0.smithi152.stdout:9/687: dwrite d5/d6/d74/d17/d23/d2d/d32/d36/f85 [8388608,4194304] 0 2024-04-06T12:24:08.642 INFO:tasks.workunit.client.0.smithi152.stdout:4/901: creat d7/d16/d55/da0/f11e x:0 0 0 2024-04-06T12:24:08.646 INFO:tasks.workunit.client.0.smithi152.stdout:5/802: dwrite d3/de/fb8 [0,4194304] 0 2024-04-06T12:24:08.646 INFO:tasks.workunit.client.0.smithi152.stdout:9/688: chown d5/d39/d3f/d42/fc0 1779417798 1 2024-04-06T12:24:08.657 INFO:tasks.workunit.client.0.smithi152.stdout:9/689: rmdir d5/d6/d74/d17/d23/d2d/d98/d99 39 2024-04-06T12:24:08.658 INFO:tasks.workunit.client.0.smithi152.stdout:1/817: getdents d2/d1d/d3b/dc3/d111 0 2024-04-06T12:24:08.659 INFO:tasks.workunit.client.0.smithi152.stdout:1/818: stat d2/d2f/d37/f49 0 2024-04-06T12:24:08.659 INFO:tasks.workunit.client.0.smithi152.stdout:5/803: creat d3/da/d15/d40/d92/d100/f106 x:0 0 0 2024-04-06T12:24:08.660 INFO:tasks.workunit.client.0.smithi152.stdout:4/902: creat d7/d29/df2/f11f x:0 0 0 2024-04-06T12:24:08.661 INFO:tasks.workunit.client.0.smithi152.stdout:1/819: chown d2/d2f/d54/d88/d9c/db3/dd3 61163 1 2024-04-06T12:24:08.663 INFO:tasks.workunit.client.0.smithi152.stdout:5/804: unlink d3/de/da9/ceb 0 2024-04-06T12:24:08.667 INFO:tasks.workunit.client.0.smithi152.stdout:4/903: fdatasync d7/d16/d22/d95/dda/fdb 0 2024-04-06T12:24:08.669 INFO:tasks.workunit.client.0.smithi152.stdout:3/882: truncate d0/d35/d43/d48/d83/ff4 2320438 0 2024-04-06T12:24:08.670 INFO:tasks.workunit.client.0.smithi152.stdout:1/820: rmdir d2/d2f/d54/d88/d9c/db3/dd3 39 2024-04-06T12:24:08.671 INFO:tasks.workunit.client.0.smithi152.stdout:6/880: dwrite d7/d19/d3e/f40 [0,4194304] 0 2024-04-06T12:24:08.680 INFO:tasks.workunit.client.0.smithi152.stdout:9/690: write d5/d6/f28 [1222225,123450] 0 2024-04-06T12:24:08.680 INFO:tasks.workunit.client.0.smithi152.stdout:9/691: dread - d5/d6/fd1 zero size 2024-04-06T12:24:08.683 INFO:tasks.workunit.client.0.smithi152.stdout:1/821: creat d2/d1d/d3b/f113 x:0 0 0 2024-04-06T12:24:08.690 INFO:tasks.workunit.client.0.smithi152.stdout:5/805: mknod d3/da/d15/d40/d46/d105/c107 0 2024-04-06T12:24:08.694 INFO:tasks.workunit.client.0.smithi152.stdout:1/822: mknod d2/d1d/d7c/c114 0 2024-04-06T12:24:08.696 INFO:tasks.workunit.client.0.smithi152.stdout:3/883: creat d0/d10/d13/d2a/d93/deb/f11a x:0 0 0 2024-04-06T12:24:08.702 INFO:tasks.workunit.client.0.smithi152.stdout:5/806: creat d3/da/d15/d2b/d3f/d6d/dd1/dd8/f108 x:0 0 0 2024-04-06T12:24:08.705 INFO:tasks.workunit.client.0.smithi152.stdout:3/884: rename d0/d10/d1e/d87/f104 to d0/d2d/f11b 0 2024-04-06T12:24:08.706 INFO:tasks.workunit.client.0.smithi152.stdout:3/885: chown d0/d10/d13/ff8 354 1 2024-04-06T12:24:08.709 INFO:tasks.workunit.client.0.smithi152.stdout:5/807: write d3/da/d15/d2b/d3f/d6d/dc6/dd9/fe7 [711356,67306] 0 2024-04-06T12:24:08.711 INFO:tasks.workunit.client.0.smithi152.stdout:9/692: getdents d5/d6/d74/d17/d37 0 2024-04-06T12:24:08.713 INFO:tasks.workunit.client.0.smithi152.stdout:5/808: write d3/da/d15/d2b/d3f/d6d/dd1/dd8/f108 [289483,114453] 0 2024-04-06T12:24:08.714 INFO:tasks.workunit.client.0.smithi152.stdout:5/809: readlink d3/de/da9/ld5 0 2024-04-06T12:24:08.718 INFO:tasks.workunit.client.0.smithi152.stdout:9/693: getdents d5/d6/d74/d17/d37 0 2024-04-06T12:24:08.719 INFO:tasks.workunit.client.0.smithi152.stdout:9/694: write d5/d6/f49 [3144897,81557] 0 2024-04-06T12:24:08.721 INFO:tasks.workunit.client.0.smithi152.stdout:9/695: fdatasync d5/d39/d3f/fab 0 2024-04-06T12:24:08.727 INFO:tasks.workunit.client.0.smithi152.stdout:4/904: dwrite d7/d82/db1/db6/ff0 [0,4194304] 0 2024-04-06T12:24:08.737 INFO:tasks.workunit.client.0.smithi152.stdout:1/823: dwrite d2/d2f/d37/f4a [0,4194304] 0 2024-04-06T12:24:08.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.767+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fae20059120 con 0x7fae10066e00 2024-04-06T12:24:08.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.777+0000 7fae1dffb700 1 -- 172.21.15.152:0/1821323279 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fae20059120 con 0x7fae10066e00 2024-04-06T12:24:08.775 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:24:08.775 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 starting - - - - 2024-04-06T12:24:08.775 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (9m) 104s ago 9m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:24:08.775 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (8m) 97s ago 8m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:24:08.775 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (7m) 104s ago 9m 57.2M - 8.3.5 dad864ee21e9 68f8b2b6d071 2024-04-06T12:24:08.775 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (3m) 104s ago 3m 79.0M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:24:08.775 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (4m) 104s ago 4m 111M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:24:08.775 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (4m) 97s ago 4m 12.0M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (3m) 97s ago 3m 12.8M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:9283 running (10m) 104s ago 10m 317M - 16.2.15-1-g8963e9de 727f386679cb 10652d2c4bd5 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283 running (2m) 97s ago 8m 476M - 18.2.2-1086-g052adcad 87261d5ece5a 5089ad242cab 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (10m) 104s ago 10m 47.7M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (8m) 97s ago 8m 39.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (9m) 104s ago 8m 25.9M - 1.3.1 1dbe0e931976 7122c2020056 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (8m) 97s ago 8m 23.6M - 1.3.1 1dbe0e931976 9dbc0ed205d9 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (7m) 104s ago 7m 63.4M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (7m) 104s ago 7m 62.1M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (6m) 104s ago 6m 53.4M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (6m) 97s ago 6m 64.5M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (6m) 97s ago 6m 57.7M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (5m) 97s ago 5m 58.3M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:24:08.776 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (8m) 97s ago 8m 60.4M - 2.33.4 514e6a882f6e d9a8fc6b6cf9 2024-04-06T12:24:08.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fae10066e00 msgr2=0x7fae100692c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:08.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fae10066e00 0x7fae100692c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fae0c009040 tx=0x7fae0c009cb0).stop 2024-04-06T12:24:08.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006d550 msgr2=0x7fae2010e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:08.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006d550 0x7fae2010e660 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fae140041d0 tx=0x7fae14009f60).stop 2024-04-06T12:24:08.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 shutdown_connections 2024-04-06T12:24:08.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fae10066e00 0x7fae100692c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:08.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae2006d550 0x7fae2010e660 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:08.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 --2- 172.21.15.152:0/1821323279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae2010eb50 0x7fae20113c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:24:08.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 >> 172.21.15.152:0/1821323279 conn(0x7fae200f52f0 msgr2=0x7fae201045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:08.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.779+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 shutdown_connections 2024-04-06T12:24:08.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.780+0000 7fae26cae700 1 -- 172.21.15.152:0/1821323279 wait complete. 2024-04-06T12:24:08.811 INFO:tasks.workunit.client.0.smithi152.stdout:9/696: symlink d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/ld5 0 2024-04-06T12:24:08.822 INFO:tasks.workunit.client.0.smithi152.stdout:8/977: sync 2024-04-06T12:24:08.822 INFO:tasks.workunit.client.0.smithi152.stdout:7/792: sync 2024-04-06T12:24:08.825 INFO:tasks.workunit.client.0.smithi152.stdout:8/978: readlink d4/db/d56/dcb/l10c 0 2024-04-06T12:24:08.828 INFO:tasks.workunit.client.0.smithi152.stdout:3/886: dwrite d0/d10/fd6 [0,4194304] 0 2024-04-06T12:24:08.831 INFO:tasks.workunit.client.0.smithi152.stdout:5/810: write d3/da/d15/d2b/d3f/d4c/f8d [801,41906] 0 2024-04-06T12:24:08.875 INFO:tasks.workunit.client.0.smithi152.stdout:7/793: mknod d8/df/d28/d41/dd4/d8c/c108 0 2024-04-06T12:24:08.878 INFO:tasks.workunit.client.0.smithi152.stdout:3/887: symlink d0/d1f/l11c 0 2024-04-06T12:24:08.884 INFO:tasks.workunit.client.0.smithi152.stdout:1/824: getdents d2/d2f/d54/d88/d9c/dc5/d10e 0 2024-04-06T12:24:08.888 INFO:tasks.workunit.client.0.smithi152.stdout:7/794: fdatasync d8/df/d28/d41/dd4/d79/d81/f95 0 2024-04-06T12:24:08.894 INFO:tasks.workunit.client.0.smithi152.stdout:9/697: rename d5/d6/d74/d17/d23/d2d/d32/d36/da3/cc9 to d5/d6/d74/d69/cd6 0 2024-04-06T12:24:08.898 INFO:tasks.workunit.client.0.smithi152.stdout:1/825: symlink d2/d1d/d3b/dc3/l115 0 2024-04-06T12:24:08.902 INFO:tasks.workunit.client.0.smithi152.stdout:8/979: rename d4/db/cdf to d4/db/c153 0 2024-04-06T12:24:08.903 INFO:tasks.workunit.client.0.smithi152.stdout:5/811: creat d3/da/d15/d2b/d3f/f109 x:0 0 0 2024-04-06T12:24:08.904 INFO:tasks.workunit.client.0.smithi152.stdout:8/980: chown d4/dc/d10/d49/da0/d91/c106 6477 1 2024-04-06T12:24:08.906 INFO:tasks.workunit.client.0.smithi152.stdout:7/795: rename d8/df/d28/d41/d48/dfe to d8/df/d28/d41/dd4/d79/d109 0 2024-04-06T12:24:08.906 INFO:tasks.workunit.client.0.smithi152.stdout:3/888: dread d0/d10/f68 [0,4194304] 0 2024-04-06T12:24:08.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.909+0000 7f886abc2700 1 -- 172.21.15.152:0/4017285417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88640f79b0 msgr2=0x7f88640f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:08.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.909+0000 7f886abc2700 1 --2- 172.21.15.152:0/4017285417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88640f79b0 0x7f88640f7e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f88500047f0 tx=0x7f8850009cb0).stop 2024-04-06T12:24:08.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.909+0000 7f886abc2700 1 -- 172.21.15.152:0/4017285417 shutdown_connections 2024-04-06T12:24:08.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.909+0000 7f886abc2700 1 --2- 172.21.15.152:0/4017285417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88640f79b0 0x7f88640f7e10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:08.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.909+0000 7f886abc2700 1 --2- 172.21.15.152:0/4017285417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88640f6710 0x7f88640f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:24:08.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.909+0000 7f886abc2700 1 -- 172.21.15.152:0/4017285417 >> 172.21.15.152:0/4017285417 conn(0x7f88640f1e70 msgr2=0x7f88640f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:08.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.909+0000 7f886abc2700 1 -- 172.21.15.152:0/4017285417 shutdown_connections 2024-04-06T12:24:08.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.909+0000 7f886abc2700 1 -- 172.21.15.152:0/4017285417 wait complete. 2024-04-06T12:24:08.907 INFO:tasks.workunit.client.0.smithi152.stdout:9/698: fdatasync d5/d6/d74/d17/d23/d2d/f56 0 2024-04-06T12:24:08.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.910+0000 7f886abc2700 1 Processor -- start 2024-04-06T12:24:08.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.910+0000 7f886abc2700 1 -- start start 2024-04-06T12:24:08.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.910+0000 7f886abc2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88640f6710 0x7f8864061100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:08.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.910+0000 7f886abc2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886410af30 0x7f886410d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:08.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.910+0000 7f886abc2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886410d8a0 con 0x7f88640f6710 2024-04-06T12:24:08.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.910+0000 7f886abc2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886410d9e0 con 0x7f886410af30 2024-04-06T12:24:08.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.910+0000 7f8863fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886410af30 0x7f886410d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:08.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.910+0000 7f8863fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886410af30 0x7f886410d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:38392/0 (socket says 172.21.15.152:38392) 2024-04-06T12:24:08.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.910+0000 7f8863fff700 1 -- 172.21.15.152:0/608207976 learned_addr learned my addr 172.21.15.152:0/608207976 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:08.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.911+0000 7f886895e700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88640f6710 0x7f8864061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:08.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.911+0000 7f8863fff700 1 -- 172.21.15.152:0/608207976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88640f6710 msgr2=0x7f8864061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:08.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.911+0000 7f8863fff700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88640f6710 0x7f8864061100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:08.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.911+0000 7f8863fff700 1 -- 172.21.15.152:0/608207976 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850005040 con 0x7f886410af30 2024-04-06T12:24:08.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.911+0000 7f8863fff700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886410af30 0x7f886410d320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8850000c00 tx=0x7f885000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:08.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.911+0000 7f8861ffb700 1 -- 172.21.15.152:0/608207976 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f885000e030 con 0x7f886410af30 2024-04-06T12:24:08.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.911+0000 7f8861ffb700 1 -- 172.21.15.152:0/608207976 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8850013410 con 0x7f886410af30 2024-04-06T12:24:08.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.911+0000 7f8861ffb700 1 -- 172.21.15.152:0/608207976 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8850019070 con 0x7f886410af30 2024-04-06T12:24:08.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.911+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886410dc10 con 0x7f886410af30 2024-04-06T12:24:08.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.912+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886410e0f0 con 0x7f886410af30 2024-04-06T12:24:08.911 INFO:tasks.workunit.client.0.smithi152.stdout:1/826: truncate d2/f50 595024 0 2024-04-06T12:24:08.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.913+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88640fef70 con 0x7f886410af30 2024-04-06T12:24:08.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.913+0000 7f8861ffb700 1 -- 172.21.15.152:0/608207976 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f885001e420 con 0x7f886410af30 2024-04-06T12:24:08.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.914+0000 7f8861ffb700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f8854066ca0 0x7f8854069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:08.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.914+0000 7f8861ffb700 1 -- 172.21.15.152:0/608207976 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f8850085480 con 0x7f886410af30 2024-04-06T12:24:08.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.914+0000 7f886895e700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f8854066ca0 0x7f8854069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:08.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.915+0000 7f886895e700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f8854066ca0 0x7f8854069160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8858006fd0 tx=0x7f8858009060).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:08.914 INFO:tasks.workunit.client.0.smithi152.stdout:8/981: unlink d4/d2c/dbf/da3/fee 0 2024-04-06T12:24:08.915 INFO:tasks.workunit.client.0.smithi152.stdout:3/889: dwrite d0/d10/d1e/f1d [0,4194304] 0 2024-04-06T12:24:08.917 INFO:tasks.workunit.client.0.smithi152.stdout:8/982: readlink d4/db/d56/dcb/l10c 0 2024-04-06T12:24:08.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:08.919+0000 7f8861ffb700 1 -- 172.21.15.152:0/608207976 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f88500537c0 con 0x7f886410af30 2024-04-06T12:24:08.917 INFO:tasks.workunit.client.0.smithi152.stdout:3/890: write d0/d10/d13/d2a/d93/deb/f11a [42534,31667] 0 2024-04-06T12:24:08.921 INFO:tasks.workunit.client.0.smithi152.stdout:7/796: creat d8/df/d28/d87/f10a x:0 0 0 2024-04-06T12:24:08.926 INFO:tasks.workunit.client.0.smithi152.stdout:1/827: creat d2/d1d/d3b/dc3/d9f/f116 x:0 0 0 2024-04-06T12:24:08.926 INFO:tasks.workunit.client.0.smithi152.stdout:8/983: truncate d4/db/d56/dcb/d6e/fdc 545721 0 2024-04-06T12:24:08.931 INFO:tasks.workunit.client.0.smithi152.stdout:7/797: stat d8/df/d28/d87/le2 0 2024-04-06T12:24:08.933 INFO:tasks.workunit.client.0.smithi152.stdout:2/836: sync 2024-04-06T12:24:08.934 INFO:tasks.workunit.client.0.smithi152.stdout:1/828: fdatasync d2/d1d/d7c/f9e 0 2024-04-06T12:24:08.936 INFO:tasks.workunit.client.0.smithi152.stdout:6/881: sync 2024-04-06T12:24:08.936 INFO:tasks.workunit.client.0.smithi152.stdout:2/837: chown d0/d40/d41/d28/fab 62184162 1 2024-04-06T12:24:08.947 INFO:tasks.workunit.client.0.smithi152.stdout:8/984: dwrite d4/dc/d10/d49/dae/f10a [4194304,4194304] 0 2024-04-06T12:24:08.950 INFO:tasks.workunit.client.0.smithi152.stdout:8/985: stat d4/dc/d10/d49/da0/d91/c106 0 2024-04-06T12:24:08.953 INFO:tasks.workunit.client.0.smithi152.stdout:8/986: write d4/d2c/dbf/db2/dba/f151 [751856,17823] 0 2024-04-06T12:24:08.955 INFO:tasks.workunit.client.0.smithi152.stdout:6/882: creat d7/d19/d1b/d22/de1/f11c x:0 0 0 2024-04-06T12:24:08.961 INFO:tasks.workunit.client.0.smithi152.stdout:2/838: creat d0/d40/d41/f113 x:0 0 0 2024-04-06T12:24:08.968 INFO:tasks.workunit.client.0.smithi152.stdout:4/905: truncate d7/d16/d22/d3f/db4/f50 3678206 0 2024-04-06T12:24:08.971 INFO:tasks.workunit.client.0.smithi152.stdout:6/883: truncate d7/d19/d1b/d31/d35/fbd 325878 0 2024-04-06T12:24:08.975 INFO:tasks.workunit.client.0.smithi152.stdout:7/798: creat d8/df/d28/d41/dd4/d8c/d66/f10b x:0 0 0 2024-04-06T12:24:08.977 INFO:tasks.workunit.client.0.smithi152.stdout:8/987: creat d4/dc/d10/d49/da0/dc0/d9d/dbe/ddd/d137/f154 x:0 0 0 2024-04-06T12:24:08.990 INFO:tasks.workunit.client.0.smithi152.stdout:7/799: creat d8/df/d61/d76/d106/f10c x:0 0 0 2024-04-06T12:24:08.995 INFO:tasks.workunit.client.0.smithi152.stdout:5/812: write d3/da/f4a [427678,23331] 0 2024-04-06T12:24:08.996 INFO:tasks.workunit.client.0.smithi152.stdout:9/699: write d5/d6/d74/d17/d23/d2d/d32/d36/f9d [5088594,96101] 0 2024-04-06T12:24:08.997 INFO:tasks.workunit.client.0.smithi152.stdout:9/700: chown d5/fb 455252 1 2024-04-06T12:24:08.999 INFO:tasks.workunit.client.0.smithi152.stdout:1/829: rmdir d2 39 2024-04-06T12:24:09.001 INFO:tasks.workunit.client.0.smithi152.stdout:3/891: write d0/d10/f68 [1969315,11856] 0 2024-04-06T12:24:09.003 INFO:tasks.workunit.client.0.smithi152.stdout:6/884: getdents d7/d9/d26/d2e 0 2024-04-06T12:24:09.003 INFO:tasks.workunit.client.0.smithi152.stdout:8/988: link d4/dc/d10/d51/l9b d4/d2c/d2b/d83/l155 0 2024-04-06T12:24:09.004 INFO:tasks.workunit.client.0.smithi152.stdout:6/885: chown d7/d9/d73 7 1 2024-04-06T12:24:09.013 INFO:tasks.workunit.client.0.smithi152.stdout:7/800: symlink d8/df/d28/d41/dd4/d8c/d2d/d7a/l10d 0 2024-04-06T12:24:09.014 INFO:tasks.workunit.client.0.smithi152.stdout:3/892: creat d0/d2d/d7f/f11d x:0 0 0 2024-04-06T12:24:09.018 INFO:tasks.workunit.client.0.smithi152.stdout:5/813: mknod d3/da/d15/d40/d50/dd7/c10a 0 2024-04-06T12:24:09.022 INFO:tasks.workunit.client.0.smithi152.stdout:4/906: dwrite d7/d16/d22/d3f/db4/fe0 [4194304,4194304] 0 2024-04-06T12:24:09.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:07.586648+0000 mgr.smithi195.ausetj (mgr.24375) 88 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 35 MiB/s rd, 92 MiB/s wr, 233 op/s 2024-04-06T12:24:09.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:07.780834+0000 mgr.smithi195.ausetj (mgr.24375) 89 : audit [DBG] from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:09.031 INFO:tasks.workunit.client.0.smithi152.stdout:3/893: creat d0/d10/d13/d2a/d93/d49/d8d/f11e x:0 0 0 2024-04-06T12:24:09.031 INFO:tasks.workunit.client.0.smithi152.stdout:6/886: write d7/d19/d1b/d31/d7c/fd9 [673219,107068] 0 2024-04-06T12:24:09.032 INFO:tasks.workunit.client.0.smithi152.stdout:9/701: mknod d5/d6/d74/d17/d23/d2d/d32/dbb/cd7 0 2024-04-06T12:24:09.033 INFO:tasks.workunit.client.0.smithi152.stdout:3/894: read - d0/d10/d13/d2a/d93/d49/dee/ff2 zero size 2024-04-06T12:24:09.039 INFO:tasks.workunit.client.0.smithi152.stdout:1/830: symlink d2/d61/d8f/d10c/l117 0 2024-04-06T12:24:09.040 INFO:tasks.workunit.client.0.smithi152.stdout:7/801: dwrite d8/df/d28/f4d [0,4194304] 0 2024-04-06T12:24:09.040 INFO:tasks.workunit.client.0.smithi152.stdout:5/814: getdents d3/de/dde 0 2024-04-06T12:24:09.043 INFO:tasks.workunit.client.0.smithi152.stdout:7/802: fsync d8/df/d61/d76/d7e/f72 0 2024-04-06T12:24:09.043 INFO:tasks.workunit.client.0.smithi152.stdout:8/989: dread d4/dc/d10/fc4 [0,4194304] 0 2024-04-06T12:24:09.052 INFO:tasks.workunit.client.0.smithi152.stdout:4/907: unlink d7/lc0 0 2024-04-06T12:24:09.052 INFO:tasks.workunit.client.0.smithi152.stdout:1/831: creat d2/d2f/d37/f118 x:0 0 0 2024-04-06T12:24:09.052 INFO:tasks.workunit.client.0.smithi152.stdout:3/895: mknod d0/d1f/d44/d7c/de8/c11f 0 2024-04-06T12:24:09.052 INFO:tasks.workunit.client.0.smithi152.stdout:6/887: symlink d7/d9/d26/d4a/d7b/d110/l11d 0 2024-04-06T12:24:09.053 INFO:tasks.workunit.client.0.smithi152.stdout:9/702: symlink d5/d6/d74/d17/d23/d2d/d32/db1/ld8 0 2024-04-06T12:24:09.053 INFO:tasks.workunit.client.0.smithi152.stdout:6/888: readlink d7/d19/lec 0 2024-04-06T12:24:09.053 INFO:tasks.workunit.client.0.smithi152.stdout:5/815: symlink d3/da/d53/l10b 0 2024-04-06T12:24:09.054 INFO:tasks.workunit.client.0.smithi152.stdout:5/816: fdatasync d3/da/d15/fb7 0 2024-04-06T12:24:09.055 INFO:tasks.workunit.client.0.smithi152.stdout:7/803: mkdir d8/df/d28/d41/dd4/d43/d8a/d9d/dae/d10e 0 2024-04-06T12:24:09.057 INFO:tasks.workunit.client.0.smithi152.stdout:8/990: symlink d4/dc/d10/d49/da0/l156 0 2024-04-06T12:24:09.058 INFO:tasks.workunit.client.0.smithi152.stdout:3/896: symlink d0/d10/d13/d2a/d93/d49/l120 0 2024-04-06T12:24:09.059 INFO:tasks.workunit.client.0.smithi152.stdout:6/889: mkdir d7/d19/d1b/d22/de1/d11e 0 2024-04-06T12:24:09.061 INFO:tasks.workunit.client.0.smithi152.stdout:5/817: creat d3/da/d15/d40/d92/f10c x:0 0 0 2024-04-06T12:24:09.062 INFO:tasks.workunit.client.0.smithi152.stdout:7/804: symlink d8/df/d28/d41/dd4/d43/l10f 0 2024-04-06T12:24:09.067 INFO:tasks.workunit.client.0.smithi152.stdout:1/832: link d2/d2f/d37/dae/fbf d2/d61/dfa/f119 0 2024-04-06T12:24:09.073 INFO:tasks.workunit.client.0.smithi152.stdout:3/897: rmdir d0/d10/d13/d2a/d93/d3d/dc3 39 2024-04-06T12:24:09.075 INFO:tasks.workunit.client.0.smithi152.stdout:1/833: dwrite d2/d2f/d37/f101 [0,4194304] 0 2024-04-06T12:24:09.076 INFO:tasks.workunit.client.0.smithi152.stdout:6/890: symlink d7/d9/d26/d4a/d7b/d110/l11f 0 2024-04-06T12:24:09.077 INFO:tasks.workunit.client.0.smithi152.stdout:9/703: write d5/d6/d74/d17/d23/d2d/f56 [1165109,10950] 0 2024-04-06T12:24:09.079 INFO:tasks.workunit.client.0.smithi152.stdout:7/805: creat d8/df/d28/d75/de8/f110 x:0 0 0 2024-04-06T12:24:09.082 INFO:tasks.workunit.client.0.smithi152.stdout:4/908: rmdir d7/d16/d22/d95/dcf/d107 0 2024-04-06T12:24:09.087 INFO:tasks.workunit.client.0.smithi152.stdout:1/834: creat d2/d61/d8f/d10c/f11a x:0 0 0 2024-04-06T12:24:09.092 INFO:tasks.workunit.client.0.smithi152.stdout:8/991: dwrite d4/db/d56/fe1 [0,4194304] 0 2024-04-06T12:24:09.093 INFO:tasks.workunit.client.0.smithi152.stdout:6/891: rmdir d7 39 2024-04-06T12:24:09.100 INFO:tasks.workunit.client.0.smithi152.stdout:4/909: mkdir d7/d16/d55/da0/d120 0 2024-04-06T12:24:09.104 INFO:tasks.workunit.client.0.smithi152.stdout:3/898: mkdir d0/d10/d13/d2a/d121 0 2024-04-06T12:24:09.104 INFO:tasks.workunit.client.0.smithi152.stdout:8/992: dwrite d4/dc/d10/d49/da2/f120 [0,4194304] 0 2024-04-06T12:24:09.109 INFO:tasks.workunit.client.0.smithi152.stdout:9/704: mkdir d5/d6/d74/dd9 0 2024-04-06T12:24:09.111 INFO:tasks.workunit.client.0.smithi152.stdout:7/806: dread - d8/df/d28/d41/dd4/d8c/d66/fcc zero size 2024-04-06T12:24:09.113 INFO:tasks.workunit.client.0.smithi152.stdout:6/892: truncate d7/d19/d1b/d1f/d3d/f115 522836 0 2024-04-06T12:24:09.114 INFO:tasks.workunit.client.0.smithi152.stdout:4/910: unlink d7/d29/d7e/d59/f85 0 2024-04-06T12:24:09.115 INFO:tasks.workunit.client.0.smithi152.stdout:5/818: dwrite d3/da/fc [0,4194304] 0 2024-04-06T12:24:09.119 INFO:tasks.workunit.client.0.smithi152.stdout:3/899: creat d0/d10/d13/d2a/d4b/f122 x:0 0 0 2024-04-06T12:24:09.120 INFO:tasks.workunit.client.0.smithi152.stdout:1/835: link d2/d1d/d3b/f56 d2/d61/f11b 0 2024-04-06T12:24:09.121 INFO:tasks.workunit.client.0.smithi152.stdout:8/993: dwrite f3 [4194304,4194304] 0 2024-04-06T12:24:09.122 INFO:tasks.workunit.client.0.smithi152.stdout:5/819: write d3/da/d15/d40/d46/f74 [125419,77439] 0 2024-04-06T12:24:09.123 INFO:tasks.workunit.client.0.smithi152.stdout:1/836: dread - d2/d61/d8f/d10c/f11a zero size 2024-04-06T12:24:09.135 INFO:tasks.workunit.client.0.smithi152.stdout:3/900: mknod d0/d1f/d4a/c123 0 2024-04-06T12:24:09.138 INFO:tasks.workunit.client.0.smithi152.stdout:9/705: write d5/d6/d74/d17/d37/f41 [1908416,89382] 0 2024-04-06T12:24:09.138 INFO:tasks.workunit.client.0.smithi152.stdout:4/911: write d7/d16/d55/fec [330867,33876] 0 2024-04-06T12:24:09.145 INFO:tasks.workunit.client.0.smithi152.stdout:8/994: dread d4/db/d39/f13f [0,4194304] 0 2024-04-06T12:24:09.149 INFO:tasks.workunit.client.0.smithi152.stdout:1/837: mknod d2/d2f/d54/d88/d9c/dc5/dd0/c11c 0 2024-04-06T12:24:09.150 INFO:tasks.workunit.client.0.smithi152.stdout:1/838: read d2/f39 [354380,42272] 0 2024-04-06T12:24:09.153 INFO:tasks.workunit.client.0.smithi152.stdout:6/893: rename d7/d19/d3e/c90 to d7/d9/d26/d4a/d7b/c120 0 2024-04-06T12:24:09.154 INFO:tasks.workunit.client.0.smithi152.stdout:6/894: fdatasync f3 0 2024-04-06T12:24:09.157 INFO:tasks.workunit.client.0.smithi152.stdout:5/820: mknod d3/da/d15/d2b/d3f/d68/c10d 0 2024-04-06T12:24:09.159 INFO:tasks.workunit.client.0.smithi152.stdout:7/807: dwrite d8/df/d34/d63/f92 [0,4194304] 0 2024-04-06T12:24:09.161 INFO:tasks.workunit.client.0.smithi152.stdout:4/912: write d7/d29/d7e/d59/f76 [912062,19840] 0 2024-04-06T12:24:09.167 INFO:tasks.workunit.client.0.smithi152.stdout:4/913: read d7/d82/db1/fdf [255485,68844] 0 2024-04-06T12:24:09.169 INFO:tasks.workunit.client.0.smithi152.stdout:5/821: mkdir d3/da/d15/d2b/d3f/db9/d10e 0 2024-04-06T12:24:09.171 INFO:tasks.workunit.client.0.smithi152.stdout:7/808: mkdir d8/df/d28/d41/dd4/d8c/daf/d111 0 2024-04-06T12:24:09.171 INFO:tasks.workunit.client.0.smithi152.stdout:4/914: chown d7/d16/l4d 26815721 1 2024-04-06T12:24:09.173 INFO:tasks.workunit.client.0.smithi152.stdout:5/822: fsync d3/da/d15/d2b/d3f/db9/fbe 0 2024-04-06T12:24:09.174 INFO:tasks.workunit.client.0.smithi152.stdout:9/706: dwrite d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fbc [4194304,4194304] 0 2024-04-06T12:24:09.176 INFO:tasks.workunit.client.0.smithi152.stdout:5/823: dread - d3/da/d53/ff7 zero size 2024-04-06T12:24:09.177 INFO:tasks.workunit.client.0.smithi152.stdout:9/707: write d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fa8 [4137283,106793] 0 2024-04-06T12:24:09.184 INFO:tasks.workunit.client.0.smithi152.stdout:3/901: rename d0/d10/daf/cb4 to d0/c124 0 2024-04-06T12:24:09.189 INFO:tasks.workunit.client.0.smithi152.stdout:5/824: creat d3/da/d15/d40/d50/d99/f10f x:0 0 0 2024-04-06T12:24:09.189 INFO:tasks.workunit.client.0.smithi152.stdout:1/839: dwrite d2/d1d/d3b/dc3/d9f/fb8 [4194304,4194304] 0 2024-04-06T12:24:09.193 INFO:tasks.workunit.client.0.smithi152.stdout:5/825: readlink d3/da/d15/d40/d4f/la5 0 2024-04-06T12:24:09.194 INFO:tasks.workunit.client.0.smithi152.stdout:6/895: dwrite d7/d62/f92 [0,4194304] 0 2024-04-06T12:24:09.205 INFO:tasks.workunit.client.0.smithi152.stdout:8/995: rename d4/db/d56/dcb/d6e/d88/fe3 to d4/d5f/d98/d139/f157 0 2024-04-06T12:24:09.208 INFO:tasks.workunit.client.0.smithi152.stdout:7/809: creat d8/df/d61/d6d/f112 x:0 0 0 2024-04-06T12:24:09.209 INFO:tasks.workunit.client.0.smithi152.stdout:9/708: creat d5/d6/d74/d17/fda x:0 0 0 2024-04-06T12:24:09.211 INFO:tasks.workunit.client.0.smithi152.stdout:1/840: write d2/d2f/f9b [2834386,94641] 0 2024-04-06T12:24:09.211 INFO:tasks.workunit.client.0.smithi152.stdout:4/915: dwrite d7/d29/fbd [0,4194304] 0 2024-04-06T12:24:09.219 INFO:tasks.workunit.client.0.smithi152.stdout:3/902: fsync d0/d10/d13/d2a/d93/d3d/d102/f109 0 2024-04-06T12:24:09.219 INFO:tasks.workunit.client.0.smithi152.stdout:6/896: dwrite d7/d19/f9d [0,4194304] 0 2024-04-06T12:24:09.220 INFO:tasks.workunit.client.0.smithi152.stdout:5/826: dwrite d3/da/fc [4194304,4194304] 0 2024-04-06T12:24:09.225 INFO:tasks.workunit.client.0.smithi152.stdout:8/996: read d4/d5f/d98/fa5 [253685,53058] 0 2024-04-06T12:24:09.228 INFO:tasks.workunit.client.0.smithi152.stdout:8/997: write d4/dc/d10/d51/fb5 [1416293,17496] 0 2024-04-06T12:24:09.230 INFO:tasks.workunit.client.0.smithi152.stdout:7/810: truncate d8/df/d28/d41/dd4/d79/fba 2412130 0 2024-04-06T12:24:09.231 INFO:tasks.workunit.client.0.smithi152.stdout:4/916: dread d7/d16/d22/d3f/db4/d60/dc4/fef [0,4194304] 0 2024-04-06T12:24:09.232 INFO:tasks.workunit.client.0.smithi152.stdout:4/917: readlink d7/d29/d7e/d59/l8f 0 2024-04-06T12:24:09.234 INFO:tasks.workunit.client.0.smithi152.stdout:9/709: link d5/d39/d3f/d42/f89 d5/d6/d74/d17/d23/d2d/d32/db1/fdb 0 2024-04-06T12:24:09.238 INFO:tasks.workunit.client.0.smithi152.stdout:3/903: dread d0/d10/d1e/f46 [0,4194304] 0 2024-04-06T12:24:09.240 INFO:tasks.workunit.client.0.smithi152.stdout:3/904: chown d0/d1f/d4a/l61 2326 1 2024-04-06T12:24:09.242 INFO:tasks.workunit.client.0.smithi152.stdout:9/710: dread d5/d6/f16 [4194304,4194304] 0 2024-04-06T12:24:09.243 INFO:tasks.workunit.client.0.smithi152.stdout:8/998: mkdir d4/dc/d10/d49/da0/dc0/db6/d158 0 2024-04-06T12:24:09.244 INFO:tasks.workunit.client.0.smithi152.stdout:7/811: readlink d8/df/d61/ld8 0 2024-04-06T12:24:09.245 INFO:tasks.workunit.client.0.smithi152.stdout:8/999: write d4/d2c/df9/f150 [865939,90994] 0 2024-04-06T12:24:09.247 INFO:tasks.workunit.client.0.smithi152.stdout:7/812: write d8/df/d34/f107 [378654,49357] 0 2024-04-06T12:24:09.250 INFO:tasks.workunit.client.0.smithi152.stdout:4/918: creat d7/d82/db1/f121 x:0 0 0 2024-04-06T12:24:09.256 INFO:tasks.workunit.client.0.smithi152.stdout:1/841: truncate d2/f10 4045836 0 2024-04-06T12:24:09.259 INFO:tasks.workunit.client.0.smithi152.stdout:6/897: dread d7/d19/d1b/d22/f29 [0,4194304] 0 2024-04-06T12:24:09.259 INFO:tasks.workunit.client.0.smithi152.stdout:3/905: mkdir d0/d10/d45/d125 0 2024-04-06T12:24:09.262 INFO:tasks.workunit.client.0.smithi152.stdout:9/711: creat d5/d6/d74/d17/d23/d2d/d32/db1/fdc x:0 0 0 2024-04-06T12:24:09.263 INFO:tasks.workunit.client.0.smithi152.stdout:5/827: write d3/da/d15/d2b/d3f/d68/d81/ff0 [873172,17306] 0 2024-04-06T12:24:09.272 INFO:tasks.workunit.client.0.smithi152.stdout:1/842: creat d2/d2f/d54/d88/da4/f11d x:0 0 0 2024-04-06T12:24:09.274 INFO:tasks.workunit.client.0.smithi152.stdout:6/898: creat d7/d19/d1b/d1f/d3d/dc2/f121 x:0 0 0 2024-04-06T12:24:09.276 INFO:tasks.workunit.client.0.smithi152.stdout:7/813: dread d8/d2a/d42/f57 [0,4194304] 0 2024-04-06T12:24:09.277 INFO:tasks.workunit.client.0.smithi152.stdout:7/814: dread - d8/df/d28/d41/dd4/d8c/d66/fcc zero size 2024-04-06T12:24:09.277 INFO:tasks.workunit.client.0.smithi152.stdout:3/906: mkdir d0/d10/d1e/d71/db2/dbb/d126 0 2024-04-06T12:24:09.279 INFO:tasks.workunit.client.0.smithi152.stdout:9/712: creat d5/d39/d3f/d42/fdd x:0 0 0 2024-04-06T12:24:09.284 INFO:tasks.workunit.client.0.smithi152.stdout:5/828: symlink d3/da/d15/d7f/l110 0 2024-04-06T12:24:09.285 INFO:tasks.workunit.client.0.smithi152.stdout:4/919: truncate d7/f2c 2458388 0 2024-04-06T12:24:09.289 INFO:tasks.workunit.client.0.smithi152.stdout:1/843: mkdir d2/d2f/d54/d88/d9c/dc5/dad/d11e 0 2024-04-06T12:24:09.292 INFO:tasks.workunit.client.0.smithi152.stdout:2/839: sync 2024-04-06T12:24:09.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:07.586648+0000 mgr.smithi195.ausetj (mgr.24375) 88 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 35 MiB/s rd, 92 MiB/s wr, 233 op/s 2024-04-06T12:24:09.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:07.780834+0000 mgr.smithi195.ausetj (mgr.24375) 89 : audit [DBG] from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:09.302 INFO:tasks.workunit.client.0.smithi152.stdout:4/920: creat d7/d16/d22/d95/dcf/f122 x:0 0 0 2024-04-06T12:24:09.303 INFO:tasks.workunit.client.0.smithi152.stdout:6/899: symlink d7/d19/d1b/d1f/l122 0 2024-04-06T12:24:09.306 INFO:tasks.workunit.client.0.smithi152.stdout:1/844: chown d2/d2f/d54/d88/d9c/db3/dd3/cf6 1317820 1 2024-04-06T12:24:09.308 INFO:tasks.workunit.client.0.smithi152.stdout:3/907: mknod d0/d10/d13/d2a/d93/c127 0 2024-04-06T12:24:09.309 INFO:tasks.workunit.client.0.smithi152.stdout:3/908: write d0/d10/d45/f47 [82687,40679] 0 2024-04-06T12:24:09.313 INFO:tasks.workunit.client.0.smithi152.stdout:2/840: rmdir d0/d2 39 2024-04-06T12:24:09.315 INFO:tasks.workunit.client.0.smithi152.stdout:7/815: write d8/df/d28/d41/dd4/d8c/daf/fb3 [913668,122697] 0 2024-04-06T12:24:09.317 INFO:tasks.workunit.client.0.smithi152.stdout:9/713: mkdir d5/d6/dde 0 2024-04-06T12:24:09.322 INFO:tasks.workunit.client.0.smithi152.stdout:4/921: fsync d7/d29/d7e/f93 0 2024-04-06T12:24:09.323 INFO:tasks.workunit.client.0.smithi152.stdout:5/829: dwrite d3/de/d80/f5d [0,4194304] 0 2024-04-06T12:24:09.332 INFO:tasks.workunit.client.0.smithi152.stdout:3/909: readlink d0/d2d/l72 0 2024-04-06T12:24:09.334 INFO:tasks.workunit.client.0.smithi152.stdout:3/910: write d0/d10/d1e/d71/fff [2614964,25543] 0 2024-04-06T12:24:09.335 INFO:tasks.workunit.client.0.smithi152.stdout:3/911: chown d0/d10/d13/d2a/d93/deb/f11a 30507 1 2024-04-06T12:24:09.337 INFO:tasks.workunit.client.0.smithi152.stdout:9/714: rmdir d5/d6/d74/d17/d23/d2d/d4b/d5a 39 2024-04-06T12:24:09.344 INFO:tasks.workunit.client.0.smithi152.stdout:2/841: dwrite d0/d2/d6f/d90/d9e/db5/ff5 [0,4194304] 0 2024-04-06T12:24:09.350 INFO:tasks.workunit.client.0.smithi152.stdout:1/845: write d2/d2f/d54/d88/d9c/db3/ff2 [287107,18582] 0 2024-04-06T12:24:09.365 INFO:tasks.workunit.client.0.smithi152.stdout:7/816: dwrite d8/df/d34/d5c/f8e [0,4194304] 0 2024-04-06T12:24:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.406+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8864100de0 con 0x7f886410af30 2024-04-06T12:24:09.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.407+0000 7f8861ffb700 1 -- 172.21.15.152:0/608207976 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f88500533b0 con 0x7f886410af30 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:24:09.405 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:24:09.406 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:24:09.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:24:09.406 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:24:09.406 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-04-06T12:24:09.406 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:24:09.406 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:24:09.406 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:24:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.409+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f8854066ca0 msgr2=0x7f8854069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.409+0000 7f886abc2700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f8854066ca0 0x7f8854069160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8858006fd0 tx=0x7f8858009060).stop 2024-04-06T12:24:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.409+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886410af30 msgr2=0x7f886410d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.410+0000 7f886abc2700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886410af30 0x7f886410d320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8850000c00 tx=0x7f885000b040).stop 2024-04-06T12:24:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.410+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 shutdown_connections 2024-04-06T12:24:09.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.410+0000 7f886abc2700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f8854066ca0 0x7f8854069160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.410+0000 7f886abc2700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88640f6710 0x7f8864061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.410+0000 7f886abc2700 1 --2- 172.21.15.152:0/608207976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886410af30 0x7f886410d320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.410+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 >> 172.21.15.152:0/608207976 conn(0x7f88640f1e70 msgr2=0x7f88640fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.410+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 shutdown_connections 2024-04-06T12:24:09.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.410+0000 7f886abc2700 1 -- 172.21.15.152:0/608207976 wait complete. 2024-04-06T12:24:09.433 INFO:tasks.workunit.client.0.smithi152.stdout:6/900: link d7/d9/d26/f74 d7/d19/d1b/d1f/d3d/dc2/f123 0 2024-04-06T12:24:09.435 INFO:tasks.workunit.client.0.smithi152.stdout:1/846: symlink d2/d2f/d54/d88/d9c/l11f 0 2024-04-06T12:24:09.441 INFO:tasks.workunit.client.0.smithi152.stdout:7/817: truncate d8/df/d28/d41/dd4/d79/d81/f95 3063221 0 2024-04-06T12:24:09.442 INFO:tasks.workunit.client.0.smithi152.stdout:6/901: dwrite d7/d9/d26/fea [0,4194304] 0 2024-04-06T12:24:09.444 INFO:tasks.workunit.client.0.smithi152.stdout:7/818: fsync d8/df/d61/fe 0 2024-04-06T12:24:09.449 INFO:tasks.workunit.client.0.smithi152.stdout:7/819: chown d8/df/d28/d41/dd4/d8c/d2d/d7a/cb0 4 1 2024-04-06T12:24:09.449 INFO:tasks.workunit.client.0.smithi152.stdout:4/922: mknod d7/d29/d2e/d7b/c123 0 2024-04-06T12:24:09.452 INFO:tasks.workunit.client.0.smithi152.stdout:5/830: creat d3/da/d15/d2b/d3f/d4c/f111 x:0 0 0 2024-04-06T12:24:09.460 INFO:tasks.workunit.client.0.smithi152.stdout:6/902: symlink d7/d9/d26/dcc/l124 0 2024-04-06T12:24:09.461 INFO:tasks.workunit.client.0.smithi152.stdout:5/831: dwrite d3/da/d15/d2b/d3f/db9/fbe [4194304,4194304] 0 2024-04-06T12:24:09.464 INFO:tasks.workunit.client.0.smithi152.stdout:4/923: mknod d7/d16/c124 0 2024-04-06T12:24:09.469 INFO:tasks.workunit.client.0.smithi152.stdout:7/820: rename d8/df/d28/d41/dd4/d8c/d2d/d7a/f99 to d8/df/d28/d41/dd4/d49/f113 0 2024-04-06T12:24:09.473 INFO:tasks.workunit.client.0.smithi152.stdout:4/924: rmdir d7/d29/d78/ded 39 2024-04-06T12:24:09.474 INFO:tasks.workunit.client.0.smithi152.stdout:6/903: truncate d7/d9/d26/f3a 218850 0 2024-04-06T12:24:09.476 INFO:tasks.workunit.client.0.smithi152.stdout:7/821: chown d8/df/d61/d4b/la9 2737131 1 2024-04-06T12:24:09.477 INFO:tasks.workunit.client.0.smithi152.stdout:6/904: dread d7/d19/d1b/d1f/d3d/f115 [0,4194304] 0 2024-04-06T12:24:09.480 INFO:tasks.workunit.client.0.smithi152.stdout:4/925: mknod d7/d16/d22/d95/dcf/c125 0 2024-04-06T12:24:09.493 INFO:tasks.workunit.client.0.smithi152.stdout:7/822: creat d8/df/d28/d41/dd4/d8c/d2d/f114 x:0 0 0 2024-04-06T12:24:09.496 INFO:tasks.workunit.client.0.smithi152.stdout:6/905: getdents d7/d19/d1b/d1f/d3d/dc2/ddd 0 2024-04-06T12:24:09.498 INFO:tasks.workunit.client.0.smithi152.stdout:5/832: dread d3/da/f29 [0,4194304] 0 2024-04-06T12:24:09.499 INFO:tasks.workunit.client.0.smithi152.stdout:9/715: creat d5/d6/d74/d17/d23/d2d/d4b/fdf x:0 0 0 2024-04-06T12:24:09.507 INFO:tasks.workunit.client.0.smithi152.stdout:9/716: rmdir d5/d6/d74/d17/d23/d2d/d98/d99 39 2024-04-06T12:24:09.511 INFO:tasks.workunit.client.0.smithi152.stdout:2/842: symlink d0/d15/d24/d3d/l114 0 2024-04-06T12:24:09.512 INFO:tasks.workunit.client.0.smithi152.stdout:2/843: fdatasync d0/d15/d24/d3d/f7d 0 2024-04-06T12:24:09.532 INFO:tasks.workunit.client.0.smithi152.stdout:4/926: rename d7/d16/d22/d3f/db4/f50 to d7/d16/d55/f126 0 2024-04-06T12:24:09.538 INFO:tasks.workunit.client.0.smithi152.stdout:4/927: link d7/d29/d2e/d5b/db2/f102 d7/d16/d22/d95/dcf/f127 0 2024-04-06T12:24:09.544 INFO:tasks.workunit.client.0.smithi152.stdout:4/928: rmdir d7/d29/d2e/d7b/d10b 0 2024-04-06T12:24:09.548 INFO:tasks.workunit.client.0.smithi152.stdout:4/929: creat d7/d29/d78/f128 x:0 0 0 2024-04-06T12:24:09.554 INFO:tasks.workunit.client.0.smithi152.stdout:5/833: rmdir d3/da/d15/d2b/d3f 39 2024-04-06T12:24:09.560 INFO:tasks.workunit.client.0.smithi152.stdout:1/847: dwrite d2/f1b [4194304,4194304] 0 2024-04-06T12:24:09.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.563+0000 7facffe85700 1 -- 172.21.15.152:0/3864691535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 msgr2=0x7facf80f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:09.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.563+0000 7facffe85700 1 --2- 172.21.15.152:0/3864691535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 0x7facf80f6b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7facf40047f0 tx=0x7facf4009cb0).stop 2024-04-06T12:24:09.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.563+0000 7facffe85700 1 -- 172.21.15.152:0/3864691535 shutdown_connections 2024-04-06T12:24:09.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.563+0000 7facffe85700 1 --2- 172.21.15.152:0/3864691535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facf80f7990 0x7facf80f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:09.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.563+0000 7facffe85700 1 --2- 172.21.15.152:0/3864691535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 0x7facf80f6b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:09.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.563+0000 7facffe85700 1 -- 172.21.15.152:0/3864691535 >> 172.21.15.152:0/3864691535 conn(0x7facf80f1e50 msgr2=0x7facf80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:09.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.563+0000 7facffe85700 1 -- 172.21.15.152:0/3864691535 shutdown_connections 2024-04-06T12:24:09.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.564+0000 7facffe85700 1 -- 172.21.15.152:0/3864691535 wait complete. 2024-04-06T12:24:09.563 INFO:tasks.workunit.client.0.smithi152.stdout:5/834: rename d3/da/d15/d2b/c42 to d3/de/d80/c112 0 2024-04-06T12:24:09.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facffe85700 1 Processor -- start 2024-04-06T12:24:09.564 INFO:tasks.workunit.client.0.smithi152.stdout:1/848: creat d2/d2f/daf/f120 x:0 0 0 2024-04-06T12:24:09.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facffe85700 1 -- start start 2024-04-06T12:24:09.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facffe85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 0x7facf8107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:09.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facffe85700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facf80f7990 0x7facf8108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:09.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facffe85700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8108a40 con 0x7facf80f66f0 2024-04-06T12:24:09.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facffe85700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8108b80 con 0x7facf80f7990 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facfdc21700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 0x7facf8107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facfdc21700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 0x7facf8107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40974/0 (socket says 172.21.15.152:40974) 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facfdc21700 1 -- 172.21.15.152:0/1146664996 learned_addr learned my addr 172.21.15.152:0/1146664996 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facfdc21700 1 -- 172.21.15.152:0/1146664996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facf80f7990 msgr2=0x7facf8108490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facfdc21700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facf80f7990 0x7facf8108490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.566+0000 7facfdc21700 1 -- 172.21.15.152:0/1146664996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4005040 con 0x7facf80f66f0 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.567+0000 7facfdc21700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 0x7facf8107fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7facf4013620 tx=0x7facf4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.567+0000 7faceeffd700 1 -- 172.21.15.152:0/1146664996 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf400e070 con 0x7facf80f66f0 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.567+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf8062760 con 0x7facf80f66f0 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.567+0000 7faceeffd700 1 -- 172.21.15.152:0/1146664996 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7facf4007e90 con 0x7facf80f66f0 2024-04-06T12:24:09.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.567+0000 7faceeffd700 1 -- 172.21.15.152:0/1146664996 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf4018070 con 0x7facf80f66f0 2024-04-06T12:24:09.567 INFO:tasks.workunit.client.0.smithi152.stdout:1/849: chown d2/d2f/d37/dae/cca 585830634 1 2024-04-06T12:24:09.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.567+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf8062d20 con 0x7facf80f66f0 2024-04-06T12:24:09.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.568+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf80feed0 con 0x7facf80f66f0 2024-04-06T12:24:09.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.569+0000 7faceeffd700 1 -- 172.21.15.152:0/1146664996 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7facf401d420 con 0x7facf80f66f0 2024-04-06T12:24:09.568 INFO:tasks.workunit.client.0.smithi152.stdout:1/850: read d2/d1d/d3b/dc3/d9f/fb8 [421874,90083] 0 2024-04-06T12:24:09.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.570+0000 7faceeffd700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7face4066ca0 0x7face4069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:09.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.570+0000 7faceeffd700 1 -- 172.21.15.152:0/1146664996 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7facf4084530 con 0x7facf80f66f0 2024-04-06T12:24:09.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.570+0000 7facfd420700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7face4066ca0 0x7face4069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:09.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.571+0000 7facfd420700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7face4066ca0 0x7face4069160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7face8004b90 tx=0x7face8009b60).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:09.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.576+0000 7faceeffd700 1 -- 172.21.15.152:0/1146664996 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7facf4052760 con 0x7facf80f66f0 2024-04-06T12:24:09.575 INFO:tasks.workunit.client.0.smithi152.stdout:1/851: creat d2/d1d/d3b/f121 x:0 0 0 2024-04-06T12:24:09.578 INFO:tasks.workunit.client.0.smithi152.stdout:1/852: read d2/ff [682208,90228] 0 2024-04-06T12:24:09.578 INFO:tasks.workunit.client.0.smithi152.stdout:6/906: truncate d7/d19/d1b/d1f/d3d/f115 32972 0 2024-04-06T12:24:09.582 INFO:tasks.workunit.client.0.smithi152.stdout:6/907: write d7/d9/d73/fc5 [1301245,30389] 0 2024-04-06T12:24:09.583 INFO:tasks.workunit.client.0.smithi152.stdout:1/853: dread d2/d2f/d54/d88/f40 [0,4194304] 0 2024-04-06T12:24:09.587 INFO:tasks.workunit.client.0.smithi152.stdout:9/717: write d5/d39/fb7 [827541,56266] 0 2024-04-06T12:24:09.589 INFO:tasks.workunit.client.0.smithi152.stdout:6/908: creat d7/d9/d26/f125 x:0 0 0 2024-04-06T12:24:09.596 INFO:tasks.workunit.client.0.smithi152.stdout:3/912: unlink d0/d1f/c42 0 2024-04-06T12:24:09.597 INFO:tasks.workunit.client.0.smithi152.stdout:3/913: readlink d0/d10/d13/d2a/d4b/lb9 0 2024-04-06T12:24:09.597 INFO:tasks.workunit.client.0.smithi152.stdout:3/914: chown d0/d35 78046 1 2024-04-06T12:24:09.599 INFO:tasks.workunit.client.0.smithi152.stdout:3/915: readlink d0/d1f/d44/l10a 0 2024-04-06T12:24:09.601 INFO:tasks.workunit.client.0.smithi152.stdout:3/916: truncate d0/d2d/f84 160800 0 2024-04-06T12:24:09.602 INFO:tasks.workunit.client.0.smithi152.stdout:9/718: dread d5/d6/f49 [4194304,4194304] 0 2024-04-06T12:24:09.602 INFO:tasks.workunit.client.0.smithi152.stdout:3/917: chown d0/d10/d1e/d71/fff 31548757 1 2024-04-06T12:24:09.610 INFO:tasks.workunit.client.0.smithi152.stdout:9/719: getdents d5/d6/dde 0 2024-04-06T12:24:09.614 INFO:tasks.workunit.client.0.smithi152.stdout:9/720: creat d5/d6/d74/dd9/fe0 x:0 0 0 2024-04-06T12:24:09.616 INFO:tasks.workunit.client.0.smithi152.stdout:9/721: write d5/d6/d74/d17/d23/d2d/f6b [8655783,57733] 0 2024-04-06T12:24:09.620 INFO:tasks.workunit.client.0.smithi152.stdout:9/722: write d5/d6/d74/fbd [4169522,123911] 0 2024-04-06T12:24:09.625 INFO:tasks.workunit.client.0.smithi152.stdout:9/723: mknod d5/d6/d74/dd9/ce1 0 2024-04-06T12:24:09.625 INFO:tasks.workunit.client.0.smithi152.stdout:2/844: rmdir d0/d15 39 2024-04-06T12:24:09.634 INFO:tasks.workunit.client.0.smithi152.stdout:9/724: creat d5/d6/dde/fe2 x:0 0 0 2024-04-06T12:24:09.638 INFO:tasks.workunit.client.0.smithi152.stdout:6/909: rename d7/d19/d1b/f8a to d7/d9/d26/dd6/f126 0 2024-04-06T12:24:09.639 INFO:tasks.workunit.client.0.smithi152.stdout:9/725: truncate d5/d39/f93 868688 0 2024-04-06T12:24:09.647 INFO:tasks.workunit.client.0.smithi152.stdout:6/910: creat d7/d19/d1b/d1f/d3d/dc2/ddd/f127 x:0 0 0 2024-04-06T12:24:09.648 INFO:tasks.workunit.client.0.smithi152.stdout:9/726: mknod d5/d6/d74/d17/d37/ce3 0 2024-04-06T12:24:09.649 INFO:tasks.workunit.client.0.smithi152.stdout:6/911: readlink d7/d9/l7d 0 2024-04-06T12:24:09.653 INFO:tasks.workunit.client.0.smithi152.stdout:2/845: rename d0/l17 to d0/d15/de7/l115 0 2024-04-06T12:24:09.653 INFO:tasks.workunit.client.0.smithi152.stdout:1/854: dwrite d2/d1d/fb1 [0,4194304] 0 2024-04-06T12:24:09.663 INFO:tasks.workunit.client.0.smithi152.stdout:2/846: dwrite d0/f60 [0,4194304] 0 2024-04-06T12:24:09.665 INFO:tasks.workunit.client.0.smithi152.stdout:2/847: write d0/d2/ff9 [851248,63245] 0 2024-04-06T12:24:09.675 INFO:tasks.workunit.client.0.smithi152.stdout:6/912: truncate d7/d19/dbf/fd0 127803 0 2024-04-06T12:24:09.676 INFO:tasks.workunit.client.0.smithi152.stdout:3/918: dwrite d0/d2d/d7f/d8c/fab [0,4194304] 0 2024-04-06T12:24:09.681 INFO:tasks.workunit.client.0.smithi152.stdout:6/913: read d7/fb [4226038,31108] 0 2024-04-06T12:24:09.682 INFO:tasks.workunit.client.0.smithi152.stdout:6/914: stat d7/d19/d3e/f8b 0 2024-04-06T12:24:09.687 INFO:tasks.workunit.client.0.smithi152.stdout:3/919: dwrite d0/d10/d13/ff8 [0,4194304] 0 2024-04-06T12:24:09.688 INFO:tasks.workunit.client.0.smithi152.stdout:3/920: chown d0/d10/d45/ca6 102990 1 2024-04-06T12:24:09.689 INFO:tasks.workunit.client.0.smithi152.stdout:1/855: symlink d2/d2f/d54/d88/d9c/db3/l122 0 2024-04-06T12:24:09.692 INFO:tasks.workunit.client.0.smithi152.stdout:2/848: mknod d0/d15/c116 0 2024-04-06T12:24:09.700 INFO:tasks.workunit.client.0.smithi152.stdout:2/849: dwrite d0/dc9/de9/d106/d10a/f101 [0,4194304] 0 2024-04-06T12:24:09.702 INFO:tasks.workunit.client.0.smithi152.stdout:3/921: symlink d0/d2d/d7f/l128 0 2024-04-06T12:24:09.707 INFO:tasks.workunit.client.0.smithi152.stdout:1/856: readlink d2/d5d/la2 0 2024-04-06T12:24:09.708 INFO:tasks.workunit.client.0.smithi152.stdout:9/727: write d5/d6/f16 [9169119,42099] 0 2024-04-06T12:24:09.713 INFO:tasks.workunit.client.0.smithi152.stdout:2/850: truncate d0/d40/f56 3518268 0 2024-04-06T12:24:09.714 INFO:tasks.workunit.client.0.smithi152.stdout:2/851: stat d0/d2/d6f/d90/d9e/db5/f50 0 2024-04-06T12:24:09.714 INFO:tasks.workunit.client.0.smithi152.stdout:3/922: truncate d0/d10/d13/f6d 4771893 0 2024-04-06T12:24:09.715 INFO:tasks.workunit.client.0.smithi152.stdout:2/852: fsync d0/d40/d41/d28/fab 0 2024-04-06T12:24:09.716 INFO:tasks.workunit.client.0.smithi152.stdout:2/853: chown d0/d40/d41/d28/fab 574786 1 2024-04-06T12:24:09.720 INFO:tasks.workunit.client.0.smithi152.stdout:3/923: mkdir d0/d1f/d4a/dd3/d129 0 2024-04-06T12:24:09.722 INFO:tasks.workunit.client.0.smithi152.stdout:3/924: dread - d0/d10/d13/d2a/d93/d49/d8d/f115 zero size 2024-04-06T12:24:09.722 INFO:tasks.workunit.client.0.smithi152.stdout:1/857: link d2/d2f/d37/ca5 d2/d2f/d54/d88/da4/c123 0 2024-04-06T12:24:09.727 INFO:tasks.workunit.client.0.smithi152.stdout:3/925: mkdir d0/d10/d13/d2a/d4b/ded/d12a 0 2024-04-06T12:24:09.727 INFO:tasks.workunit.client.0.smithi152.stdout:3/926: chown d0/d35/d43/lde 174 1 2024-04-06T12:24:09.728 INFO:tasks.workunit.client.0.smithi152.stdout:9/728: getdents d5/d39/d79 0 2024-04-06T12:24:09.730 INFO:tasks.workunit.client.0.smithi152.stdout:3/927: symlink d0/d10/l12b 0 2024-04-06T12:24:09.734 INFO:tasks.workunit.client.0.smithi152.stdout:3/928: creat d0/d1f/d4a/dd3/d129/f12c x:0 0 0 2024-04-06T12:24:09.744 INFO:tasks.workunit.client.0.smithi152.stdout:9/729: getdents d5/d6/d74/d17/d23 0 2024-04-06T12:24:09.745 INFO:tasks.workunit.client.0.smithi152.stdout:6/915: write d7/d19/d1b/d1f/d3d/f8e [2161889,1073] 0 2024-04-06T12:24:09.771 INFO:tasks.workunit.client.0.smithi152.stdout:6/916: dread d7/d19/d3e/f9a [0,4194304] 0 2024-04-06T12:24:09.779 INFO:tasks.workunit.client.0.smithi152.stdout:2/854: write d0/d2/d6f/f77 [667019,82647] 0 2024-04-06T12:24:09.788 INFO:tasks.workunit.client.0.smithi152.stdout:1/858: dwrite d2/d1d/d7c/f9e [0,4194304] 0 2024-04-06T12:24:09.818 INFO:tasks.workunit.client.0.smithi152.stdout:3/929: fdatasync d0/d1f/d4a/dd3/d10d/f85 0 2024-04-06T12:24:09.819 INFO:tasks.workunit.client.0.smithi152.stdout:3/930: chown d0/d10/d13/d2a/d93/d49/f81 5031 1 2024-04-06T12:24:09.820 INFO:tasks.workunit.client.0.smithi152.stdout:3/931: stat d0/d10/d1e/ce2 0 2024-04-06T12:24:09.824 INFO:tasks.workunit.client.0.smithi152.stdout:2/855: stat d0/d2/c59 0 2024-04-06T12:24:09.828 INFO:tasks.workunit.client.0.smithi152.stdout:3/932: rename d0/d10/d13/d2a/d4b/d6a/def/l105 to d0/d35/d43/d10e/l12d 0 2024-04-06T12:24:09.829 INFO:tasks.workunit.client.0.smithi152.stdout:3/933: write d0/d35/d43/fea [3656798,65728] 0 2024-04-06T12:24:09.831 INFO:tasks.workunit.client.0.smithi152.stdout:6/917: mknod d7/d9/d26/c128 0 2024-04-06T12:24:09.832 INFO:tasks.workunit.client.0.smithi152.stdout:1/859: symlink d2/d2f/d54/d88/da4/dda/l124 0 2024-04-06T12:24:09.833 INFO:tasks.workunit.client.0.smithi152.stdout:1/860: chown d2/d2f/d37/f64 2412 1 2024-04-06T12:24:09.844 INFO:tasks.workunit.client.0.smithi152.stdout:6/918: mknod d7/d19/d1b/db2/de6/c129 0 2024-04-06T12:24:09.844 INFO:tasks.workunit.client.0.smithi152.stdout:6/919: chown d7/d19/d1b/d1f/l66 8 1 2024-04-06T12:24:09.846 INFO:tasks.workunit.client.0.smithi152.stdout:1/861: creat d2/d5d/ddf/f125 x:0 0 0 2024-04-06T12:24:09.847 INFO:tasks.workunit.client.0.smithi152.stdout:1/862: chown d2/d2f/d45/f77 1248319 1 2024-04-06T12:24:09.848 INFO:tasks.workunit.client.0.smithi152.stdout:9/730: getdents d5/d6/d74/d17/d86 0 2024-04-06T12:24:09.861 INFO:tasks.workunit.client.0.smithi152.stdout:1/863: fsync d2/d2f/d37/fcc 0 2024-04-06T12:24:09.869 INFO:tasks.workunit.client.0.smithi152.stdout:9/731: symlink d5/d6/d74/da0/le4 0 2024-04-06T12:24:09.873 INFO:tasks.workunit.client.0.smithi152.stdout:6/920: creat d7/d9/d26/f12a x:0 0 0 2024-04-06T12:24:09.876 INFO:tasks.workunit.client.0.smithi152.stdout:9/732: mknod d5/d6/d74/d17/d23/d2d/d32/db1/ce5 0 2024-04-06T12:24:09.879 INFO:tasks.workunit.client.0.smithi152.stdout:1/864: link d2/c14 d2/d2f/d54/d88/da4/c126 0 2024-04-06T12:24:09.887 INFO:tasks.workunit.client.0.smithi152.stdout:9/733: rmdir d5/d6/d74/d17/d23/d2d/d98/d99 39 2024-04-06T12:24:09.895 INFO:tasks.workunit.client.0.smithi152.stdout:9/734: dread d5/d6/d74/d17/f19 [8388608,4194304] 0 2024-04-06T12:24:09.896 INFO:tasks.workunit.client.0.smithi152.stdout:9/735: stat d5/d39/d3f/d42/fc0 0 2024-04-06T12:24:09.898 INFO:tasks.workunit.client.0.smithi152.stdout:9/736: rmdir d5/d6/d74/d17/d86 39 2024-04-06T12:24:09.899 INFO:tasks.workunit.client.0.smithi152.stdout:9/737: readlink d5/d6/d74/d17/d23/l43 0 2024-04-06T12:24:09.902 INFO:tasks.workunit.client.0.smithi152.stdout:9/738: mkdir d5/d6/d74/d17/d23/d2d/d32/dbb/de6 0 2024-04-06T12:24:09.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.908+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7facf80fbdd0 con 0x7face4066ca0 2024-04-06T12:24:09.907 INFO:tasks.workunit.client.0.smithi152.stdout:2/856: write d0/d2/d6f/d90/fa6 [569132,36062] 0 2024-04-06T12:24:09.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.909+0000 7faceeffd700 1 -- 172.21.15.152:0/1146664996 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7facf80fbdd0 con 0x7face4066ca0 2024-04-06T12:24:09.907 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:24:09.908 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:24:09.908 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:24:09.908 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:24:09.908 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2024-04-06T12:24:09.908 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "1/2 daemons upgraded", 2024-04-06T12:24:09.908 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2024-04-06T12:24:09.908 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:24:09.908 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:24:09.908 INFO:tasks.workunit.client.0.smithi152.stdout:9/739: dread d5/d39/d3f/d42/f5b [8388608,4194304] 0 2024-04-06T12:24:09.910 INFO:tasks.workunit.client.0.smithi152.stdout:2/857: rmdir d0 39 2024-04-06T12:24:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.913+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7face4066ca0 msgr2=0x7face4069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.913+0000 7facffe85700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7face4066ca0 0x7face4069160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7face8004b90 tx=0x7face8009b60).stop 2024-04-06T12:24:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.913+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 msgr2=0x7facf8107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.913+0000 7facffe85700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 0x7facf8107fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7facf4013620 tx=0x7facf4009cb0).stop 2024-04-06T12:24:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.913+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 shutdown_connections 2024-04-06T12:24:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.913+0000 7facffe85700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7face4066ca0 0x7face4069160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.913+0000 7facffe85700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf80f66f0 0x7facf8107fa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.913+0000 7facffe85700 1 --2- 172.21.15.152:0/1146664996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facf80f7990 0x7facf8108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:24:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.913+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 >> 172.21.15.152:0/1146664996 conn(0x7facf80f1e50 msgr2=0x7facf8060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.914+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 shutdown_connections 2024-04-06T12:24:09.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:09.914+0000 7facffe85700 1 -- 172.21.15.152:0/1146664996 wait complete. 2024-04-06T12:24:09.915 INFO:tasks.workunit.client.0.smithi152.stdout:2/858: rename d0/d15/d24/fe4 to d0/d15/d24/d79/f117 0 2024-04-06T12:24:09.920 INFO:tasks.workunit.client.0.smithi152.stdout:2/859: creat d0/dc9/de9/f118 x:0 0 0 2024-04-06T12:24:09.920 INFO:tasks.workunit.client.0.smithi152.stdout:3/934: dwrite d0/d1f/d28/f90 [0,4194304] 0 2024-04-06T12:24:09.923 INFO:tasks.workunit.client.0.smithi152.stdout:9/740: dread d5/d6/f7 [0,4194304] 0 2024-04-06T12:24:09.925 INFO:tasks.workunit.client.0.smithi152.stdout:2/860: mknod d0/d40/d26/c119 0 2024-04-06T12:24:09.927 INFO:tasks.workunit.client.0.smithi152.stdout:2/861: truncate d0/d15/f103 405320 0 2024-04-06T12:24:09.929 INFO:tasks.workunit.client.0.smithi152.stdout:9/741: write d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fa8 [847825,49293] 0 2024-04-06T12:24:09.929 INFO:tasks.workunit.client.0.smithi152.stdout:3/935: symlink d0/d10/l12e 0 2024-04-06T12:24:09.937 INFO:tasks.workunit.client.0.smithi152.stdout:2/862: creat d0/dc9/de9/d106/d10a/f11a x:0 0 0 2024-04-06T12:24:09.941 INFO:tasks.workunit.client.0.smithi152.stdout:1/865: write d2/f42 [4554854,80765] 0 2024-04-06T12:24:09.942 INFO:tasks.workunit.client.0.smithi152.stdout:1/866: chown d2/c6 778 1 2024-04-06T12:24:09.942 INFO:tasks.workunit.client.0.smithi152.stdout:3/936: dread d0/d10/d13/d2a/fe0 [0,4194304] 0 2024-04-06T12:24:09.942 INFO:tasks.workunit.client.0.smithi152.stdout:2/863: mknod d0/d40/d41/d28/c11b 0 2024-04-06T12:24:09.944 INFO:tasks.workunit.client.0.smithi152.stdout:6/921: dwrite f3 [0,4194304] 0 2024-04-06T12:24:09.946 INFO:tasks.workunit.client.0.smithi152.stdout:6/922: chown d7/d19/d1b/d1f/l122 1242 1 2024-04-06T12:24:09.950 INFO:tasks.workunit.client.0.smithi152.stdout:1/867: fsync d2/d2f/d54/d88/f90 0 2024-04-06T12:24:09.953 INFO:tasks.workunit.client.0.smithi152.stdout:2/864: dread - d0/d40/d41/d28/d8c/fed zero size 2024-04-06T12:24:09.953 INFO:tasks.workunit.client.0.smithi152.stdout:3/937: dread d0/d10/d1e/d71/fff [4194304,4194304] 0 2024-04-06T12:24:09.955 INFO:tasks.workunit.client.0.smithi152.stdout:3/938: chown d0/d1f/d28/c38 14906298 1 2024-04-06T12:24:09.956 INFO:tasks.workunit.client.0.smithi152.stdout:6/923: rename d7/d19/d1b/d1f/d3d/dc2/ddd/f127 to d7/d9/d26/dcc/d113/f12b 0 2024-04-06T12:24:09.956 INFO:tasks.workunit.client.0.smithi152.stdout:2/865: readlink d0/d2/d6f/d90/d9e/db5/d3a/d87/lc5 0 2024-04-06T12:24:09.961 INFO:tasks.workunit.client.0.smithi152.stdout:1/868: unlink d2/d61/d85/f8a 0 2024-04-06T12:24:09.962 INFO:tasks.workunit.client.0.smithi152.stdout:9/742: dwrite d5/d6/d74/d17/d23/d2d/f51 [0,4194304] 0 2024-04-06T12:24:09.965 INFO:tasks.workunit.client.0.smithi152.stdout:6/924: rename d7 to d7/d12c 22 2024-04-06T12:24:09.967 INFO:tasks.workunit.client.0.smithi152.stdout:6/925: chown d7/d19/d3e/f4f 114516 1 2024-04-06T12:24:09.970 INFO:tasks.workunit.client.0.smithi152.stdout:6/926: fsync d7/d19/d1b/d31/d7c/fd9 0 2024-04-06T12:24:09.971 INFO:tasks.workunit.client.0.smithi152.stdout:1/869: truncate d2/d2f/d45/fa8 1670544 0 2024-04-06T12:24:09.974 INFO:tasks.workunit.client.0.smithi152.stdout:2/866: rename d0/d2/f108 to d0/d15/d24/d3d/de3/db2/f11c 0 2024-04-06T12:24:09.980 INFO:tasks.workunit.client.0.smithi152.stdout:6/927: unlink d7/d19/d1b/db2/de6/c129 0 2024-04-06T12:24:09.982 INFO:tasks.workunit.client.0.smithi152.stdout:3/939: dwrite d0/d10/d13/d2a/d93/d49/f81 [4194304,4194304] 0 2024-04-06T12:24:09.982 INFO:tasks.workunit.client.0.smithi152.stdout:2/867: creat d0/dae/f11d x:0 0 0 2024-04-06T12:24:09.986 INFO:tasks.workunit.client.0.smithi152.stdout:1/870: creat d2/d2f/d54/d88/d9c/dc5/dad/d8c/d10a/f127 x:0 0 0 2024-04-06T12:24:09.989 INFO:tasks.workunit.client.0.smithi152.stdout:1/871: write d2/d2f/d54/d88/da4/fde [3567224,42718] 0 2024-04-06T12:24:09.989 INFO:tasks.workunit.client.0.smithi152.stdout:3/940: creat d0/d10/d1e/d87/f12f x:0 0 0 2024-04-06T12:24:09.991 INFO:tasks.workunit.client.0.smithi152.stdout:9/743: link d5/d39/f93 d5/d6/d74/d17/d23/d2d/d98/da4/fe7 0 2024-04-06T12:24:09.994 INFO:tasks.workunit.client.0.smithi152.stdout:6/928: dwrite d7/d19/d1b/d1f/d3d/f8e [8388608,4194304] 0 2024-04-06T12:24:09.994 INFO:tasks.workunit.client.0.smithi152.stdout:1/872: write d2/f20 [2247077,24498] 0 2024-04-06T12:24:10.003 INFO:tasks.workunit.client.0.smithi152.stdout:1/873: readlink d2/d5d/l7b 0 2024-04-06T12:24:10.006 INFO:tasks.workunit.client.0.smithi152.stdout:3/941: creat d0/d1f/d4a/dd3/f130 x:0 0 0 2024-04-06T12:24:10.007 INFO:tasks.workunit.client.0.smithi152.stdout:2/868: getdents d0/dc9 0 2024-04-06T12:24:10.013 INFO:tasks.workunit.client.0.smithi152.stdout:2/869: creat d0/d40/d41/d28/f11e x:0 0 0 2024-04-06T12:24:10.014 INFO:tasks.workunit.client.0.smithi152.stdout:6/929: mkdir d7/d9/d26/dcc/ddb/d12d 0 2024-04-06T12:24:10.015 INFO:tasks.workunit.client.0.smithi152.stdout:6/930: truncate d7/d62/fd8 440267 0 2024-04-06T12:24:10.018 INFO:tasks.workunit.client.0.smithi152.stdout:2/870: rename d0/l8 to d0/d40/d41/d28/l11f 0 2024-04-06T12:24:10.019 INFO:tasks.workunit.client.0.smithi152.stdout:2/871: chown d0/d40/d26/db4/fd7 30155 1 2024-04-06T12:24:10.020 INFO:tasks.workunit.client.0.smithi152.stdout:6/931: mkdir d7/d19/d3e/d118/d12e 0 2024-04-06T12:24:10.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/872: unlink d0/d2/d6f/d90/l68 0 2024-04-06T12:24:10.025 INFO:tasks.workunit.client.0.smithi152.stdout:9/744: write d5/d6/f14 [6861099,86918] 0 2024-04-06T12:24:10.026 INFO:tasks.workunit.client.0.smithi152.stdout:1/874: dread d2/d1d/f2d [0,4194304] 0 2024-04-06T12:24:10.027 INFO:tasks.workunit.client.0.smithi152.stdout:7/823: sync 2024-04-06T12:24:10.031 INFO:tasks.workunit.client.0.smithi152.stdout:3/942: write d0/d1f/d44/d7c/f8f [4484458,31480] 0 2024-04-06T12:24:10.034 INFO:tasks.workunit.client.0.smithi152.stdout:7/824: write d8/df/d28/d41/dd4/d8c/d2d/f114 [529602,128874] 0 2024-04-06T12:24:10.034 INFO:tasks.workunit.client.0.smithi152.stdout:9/745: dread d5/d6/f95 [0,4194304] 0 2024-04-06T12:24:10.036 INFO:tasks.workunit.client.0.smithi152.stdout:9/746: dread - d5/d6/d74/d17/d23/fd0 zero size 2024-04-06T12:24:10.038 INFO:tasks.workunit.client.0.smithi152.stdout:1/875: dwrite d2/fb6 [4194304,4194304] 0 2024-04-06T12:24:10.038 INFO:tasks.workunit.client.0.smithi152.stdout:3/943: write d0/d10/d13/d2a/d93/d3d/fcf [3751504,107091] 0 2024-04-06T12:24:10.040 INFO:tasks.workunit.client.0.smithi152.stdout:3/944: readlink d0/d10/daf/lcb 0 2024-04-06T12:24:10.041 INFO:tasks.workunit.client.0.smithi152.stdout:6/932: write d7/d19/d3e/f9a [5421711,19644] 0 2024-04-06T12:24:10.041 INFO:tasks.workunit.client.0.smithi152.stdout:2/873: write d0/d15/d24/d3d/de3/f52 [1404163,3035] 0 2024-04-06T12:24:10.046 INFO:tasks.workunit.client.0.smithi152.stdout:1/876: read d2/d2f/f32 [1400106,45731] 0 2024-04-06T12:24:10.050 INFO:tasks.workunit.client.0.smithi152.stdout:1/877: dread - d2/d61/d8f/d10c/f11a zero size 2024-04-06T12:24:10.052 INFO:tasks.workunit.client.0.smithi152.stdout:3/945: dwrite d0/d2d/d7f/d8c/fab [4194304,4194304] 0 2024-04-06T12:24:10.053 INFO:tasks.workunit.client.0.smithi152.stdout:7/825: creat d8/df/d61/f115 x:0 0 0 2024-04-06T12:24:10.053 INFO:tasks.workunit.client.0.smithi152.stdout:3/946: fsync d0/d1f/d44/ff6 0 2024-04-06T12:24:10.054 INFO:tasks.workunit.client.0.smithi152.stdout:1/878: write d2/d2f/d54/d88/d9c/dc5/fc1 [9146137,54813] 0 2024-04-06T12:24:10.057 INFO:tasks.workunit.client.0.smithi152.stdout:9/747: symlink d5/d6/d74/d17/d23/d2d/d98/le8 0 2024-04-06T12:24:10.059 INFO:tasks.workunit.client.0.smithi152.stdout:3/947: chown d0/d2d/d7f/l128 57070 1 2024-04-06T12:24:10.060 INFO:tasks.workunit.client.0.smithi152.stdout:3/948: write d0/d2d/d7f/d8c/f103 [156240,21365] 0 2024-04-06T12:24:10.066 INFO:tasks.workunit.client.0.smithi152.stdout:3/949: mkdir d0/d2d/d7f/d8c/d131 0 2024-04-06T12:24:10.068 INFO:tasks.workunit.client.0.smithi152.stdout:6/933: write d7/d19/d1b/fb4 [1571649,54979] 0 2024-04-06T12:24:10.069 INFO:tasks.workunit.client.0.smithi152.stdout:2/874: truncate d0/d15/d24/d3d/de3/f52 6850856 0 2024-04-06T12:24:10.071 INFO:tasks.workunit.client.0.smithi152.stdout:2/875: dread d0/d40/d41/d28/d54/fb1 [0,4194304] 0 2024-04-06T12:24:10.073 INFO:tasks.workunit.client.0.smithi152.stdout:1/879: creat d2/d5d/f128 x:0 0 0 2024-04-06T12:24:10.076 INFO:tasks.workunit.client.0.smithi152.stdout:6/934: read d7/d19/d3e/fe0 [183026,89722] 0 2024-04-06T12:24:10.079 INFO:tasks.workunit.client.0.smithi152.stdout:9/748: truncate d5/d6/f14 6890663 0 2024-04-06T12:24:10.079 INFO:tasks.workunit.client.0.smithi152.stdout:3/950: mknod d0/d10/d1e/d71/da2/c132 0 2024-04-06T12:24:10.080 INFO:tasks.workunit.client.0.smithi152.stdout:1/880: dwrite d2/d5d/f128 [0,4194304] 0 2024-04-06T12:24:10.082 INFO:tasks.workunit.client.0.smithi152.stdout:2/876: fdatasync d0/d2/f7f 0 2024-04-06T12:24:10.087 INFO:tasks.workunit.client.0.smithi152.stdout:5/835: sync 2024-04-06T12:24:10.087 INFO:tasks.workunit.client.0.smithi152.stdout:7/826: rename d8/df/d28/d41/dd4/d8c/d2d/da3/de4/f89 to d8/df/d28/d41/dd4/d43/d8a/f116 0 2024-04-06T12:24:10.087 INFO:tasks.workunit.client.0.smithi152.stdout:3/951: dread d0/d10/d13/ff8 [0,4194304] 0 2024-04-06T12:24:10.087 INFO:tasks.workunit.client.0.smithi152.stdout:4/930: sync 2024-04-06T12:24:10.088 INFO:tasks.workunit.client.0.smithi152.stdout:6/935: mkdir d7/d62/d12f 0 2024-04-06T12:24:10.092 INFO:tasks.workunit.client.0.smithi152.stdout:9/749: dread d5/d39/f93 [0,4194304] 0 2024-04-06T12:24:10.094 INFO:tasks.workunit.client.0.smithi152.stdout:1/881: fdatasync d2/d1d/d3b/dc3/d9f/fb8 0 2024-04-06T12:24:10.098 INFO:tasks.workunit.client.0.smithi152.stdout:2/877: stat d0/d40/f56 0 2024-04-06T12:24:10.100 INFO:tasks.workunit.client.0.smithi152.stdout:7/827: mkdir d8/df/d34/d117 0 2024-04-06T12:24:10.101 INFO:tasks.workunit.client.0.smithi152.stdout:1/882: dread d2/d1d/d3b/f56 [0,4194304] 0 2024-04-06T12:24:10.101 INFO:tasks.workunit.client.0.smithi152.stdout:5/836: creat d3/de/d8c/f113 x:0 0 0 2024-04-06T12:24:10.103 INFO:tasks.workunit.client.0.smithi152.stdout:6/936: fdatasync d7/d19/dde/fe9 0 2024-04-06T12:24:10.104 INFO:tasks.workunit.client.0.smithi152.stdout:3/952: symlink d0/d10/d13/d2a/d93/d49/d8d/l133 0 2024-04-06T12:24:10.105 INFO:tasks.workunit.client.0.smithi152.stdout:4/931: dread d7/d29/d2e/d5b/f77 [0,4194304] 0 2024-04-06T12:24:10.105 INFO:tasks.workunit.client.0.smithi152.stdout:3/953: fsync d0/d1f/d4a/dd3/d129/f12c 0 2024-04-06T12:24:10.107 INFO:tasks.workunit.client.0.smithi152.stdout:9/750: mknod d5/d39/d3f/d42/db6/ce9 0 2024-04-06T12:24:10.117 INFO:tasks.workunit.client.0.smithi152.stdout:5/837: write d3/da/d15/d2b/d3f/db9/fbe [6138830,14567] 0 2024-04-06T12:24:10.119 INFO:tasks.workunit.client.0.smithi152.stdout:5/838: readlink d3/da/d15/d7f/lc3 0 2024-04-06T12:24:10.121 INFO:tasks.workunit.client.0.smithi152.stdout:1/883: dwrite d2/d1d/f2d [4194304,4194304] 0 2024-04-06T12:24:10.128 INFO:tasks.workunit.client.0.smithi152.stdout:3/954: mknod d0/d35/c134 0 2024-04-06T12:24:10.130 INFO:tasks.workunit.client.0.smithi152.stdout:3/955: dread - d0/d35/d43/d48/d83/d9d/fd5 zero size 2024-04-06T12:24:10.130 INFO:tasks.workunit.client.0.smithi152.stdout:6/937: dwrite d7/d9/d26/d2e/f42 [0,4194304] 0 2024-04-06T12:24:10.131 INFO:tasks.workunit.client.0.smithi152.stdout:4/932: mkdir d7/d16/d22/d3f/db4/d60/d129 0 2024-04-06T12:24:10.136 INFO:tasks.workunit.client.0.smithi152.stdout:5/839: mkdir d3/da/d15/d2b/d3f/d6d/db1/d114 0 2024-04-06T12:24:10.137 INFO:tasks.workunit.client.0.smithi152.stdout:5/840: write d3/da/d15/d2b/d3f/d4c/f8d [1102103,122340] 0 2024-04-06T12:24:10.140 INFO:tasks.workunit.client.0.smithi152.stdout:4/933: mknod d7/d29/d2e/d5b/db2/c12a 0 2024-04-06T12:24:10.143 INFO:tasks.workunit.client.0.smithi152.stdout:9/751: link d5/d6/d74/d17/d23/d2d/d4b/d5a/l80 d5/d6/d74/d17/d23/d2d/d4b/d5a/lea 0 2024-04-06T12:24:10.145 INFO:tasks.workunit.client.0.smithi152.stdout:4/934: rename d7/d16/d22/dc7/dc8/ddd to d7/d16/d22/dc7/d12b 0 2024-04-06T12:24:10.147 INFO:tasks.workunit.client.0.smithi152.stdout:3/956: creat d0/d10/d1e/f135 x:0 0 0 2024-04-06T12:24:10.149 INFO:tasks.workunit.client.0.smithi152.stdout:6/938: creat d7/d19/d1b/d31/d7c/f130 x:0 0 0 2024-04-06T12:24:10.150 INFO:tasks.workunit.client.0.smithi152.stdout:1/884: write d2/fb [1375589,79229] 0 2024-04-06T12:24:10.150 INFO:tasks.workunit.client.0.smithi152.stdout:9/752: creat d5/d39/d79/daa/feb x:0 0 0 2024-04-06T12:24:10.151 INFO:tasks.workunit.client.0.smithi152.stdout:3/957: chown d0/d10/daf/ccd 19115090 1 2024-04-06T12:24:10.154 INFO:tasks.workunit.client.0.smithi152.stdout:1/885: readlink d2/d61/la0 0 2024-04-06T12:24:10.155 INFO:tasks.workunit.client.0.smithi152.stdout:3/958: chown d0/d10/d13/l1c 60147852 1 2024-04-06T12:24:10.155 INFO:tasks.workunit.client.0.smithi152.stdout:6/939: write d7/d19/d1b/d1f/d3d/f8e [12825421,40036] 0 2024-04-06T12:24:10.158 INFO:tasks.workunit.client.0.smithi152.stdout:4/935: dwrite d7/d16/d55/da0/f11e [0,4194304] 0 2024-04-06T12:24:10.162 INFO:tasks.workunit.client.0.smithi152.stdout:5/841: dread d3/da/f13 [0,4194304] 0 2024-04-06T12:24:10.163 INFO:tasks.workunit.client.0.smithi152.stdout:5/842: readlink d3/de/da9/ld5 0 2024-04-06T12:24:10.165 INFO:tasks.workunit.client.0.smithi152.stdout:9/753: dread d5/d6/d74/d17/d86/fba [0,4194304] 0 2024-04-06T12:24:10.168 INFO:tasks.workunit.client.0.smithi152.stdout:1/886: read d2/d2f/d54/d88/d9c/dc5/fc1 [6567069,55414] 0 2024-04-06T12:24:10.173 INFO:tasks.workunit.client.0.smithi152.stdout:3/959: dwrite d0/d10/d1e/d71/fff [0,4194304] 0 2024-04-06T12:24:10.175 INFO:tasks.workunit.client.0.smithi152.stdout:6/940: unlink d7/d19/c5b 0 2024-04-06T12:24:10.177 INFO:tasks.workunit.client.0.smithi152.stdout:9/754: dread - d5/d39/d79/daa/fae zero size 2024-04-06T12:24:10.178 INFO:tasks.workunit.client.0.smithi152.stdout:9/755: write d5/d6/d74/d17/d86/fcf [987165,130108] 0 2024-04-06T12:24:10.179 INFO:tasks.workunit.client.0.smithi152.stdout:5/843: rename d3/da/d15/d2b/d3f/d4c/f9a to d3/da/d15/d2b/d3f/d6d/db1/d114/f115 0 2024-04-06T12:24:10.180 INFO:tasks.workunit.client.0.smithi152.stdout:5/844: chown d3/d9/f4b 0 1 2024-04-06T12:24:10.190 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:08.249281+0000 mgr.smithi195.ausetj (mgr.24375) 90 : audit [DBG] from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:10.190 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:08.769267+0000 mgr.smithi195.ausetj (mgr.24375) 91 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:10.190 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:09.408004+0000 mon.smithi195 (mon.1) 65 : audit [DBG] from='client.? 172.21.15.152:0/608207976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:24:10.273 INFO:tasks.workunit.client.0.smithi152.stdout:1/887: mknod d2/d5d/ddf/c129 0 2024-04-06T12:24:10.273 INFO:tasks.workunit.client.0.smithi152.stdout:3/960: mknod d0/d10/d13/d2a/d4b/d6a/def/c136 0 2024-04-06T12:24:10.274 INFO:tasks.workunit.client.0.smithi152.stdout:4/936: write d7/d29/d7e/d59/f90 [2079981,26739] 0 2024-04-06T12:24:10.275 INFO:tasks.workunit.client.0.smithi152.stdout:3/961: readlink d0/d10/d1e/d71/lf7 0 2024-04-06T12:24:10.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:08.249281+0000 mgr.smithi195.ausetj (mgr.24375) 90 : audit [DBG] from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:10.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:08.769267+0000 mgr.smithi195.ausetj (mgr.24375) 91 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:10.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:09 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:09.408004+0000 mon.smithi195 (mon.1) 65 : audit [DBG] from='client.? 172.21.15.152:0/608207976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:24:10.276 INFO:tasks.workunit.client.0.smithi152.stdout:1/888: read d2/d5d/f96 [3479564,51330] 0 2024-04-06T12:24:10.283 INFO:tasks.workunit.client.0.smithi152.stdout:4/937: mknod d7/d29/d2e/d7b/c12c 0 2024-04-06T12:24:10.287 INFO:tasks.workunit.client.0.smithi152.stdout:3/962: creat d0/d10/d1e/d71/db2/f137 x:0 0 0 2024-04-06T12:24:10.289 INFO:tasks.workunit.client.0.smithi152.stdout:1/889: rmdir d2/d61/d8f/d10c 39 2024-04-06T12:24:10.298 INFO:tasks.workunit.client.0.smithi152.stdout:3/963: read - d0/d10/d1e/fc4 zero size 2024-04-06T12:24:10.300 INFO:tasks.workunit.client.0.smithi152.stdout:1/890: creat d2/d2f/d54/d88/d9c/db3/dd3/f12a x:0 0 0 2024-04-06T12:24:10.303 INFO:tasks.workunit.client.0.smithi152.stdout:4/938: rename d7/d16/d55/da0/ld5 to d7/d29/d78/l12d 0 2024-04-06T12:24:10.310 INFO:tasks.workunit.client.0.smithi152.stdout:3/964: rename d0/d35/d43/fea to d0/d10/d13/d2a/d121/f138 0 2024-04-06T12:24:10.312 INFO:tasks.workunit.client.0.smithi152.stdout:4/939: symlink d7/l12e 0 2024-04-06T12:24:10.313 INFO:tasks.workunit.client.0.smithi152.stdout:9/756: truncate d5/d39/d3f/d42/f48 6595725 0 2024-04-06T12:24:10.316 INFO:tasks.workunit.client.0.smithi152.stdout:9/757: stat d5/d39/d79/daa 0 2024-04-06T12:24:10.316 INFO:tasks.workunit.client.0.smithi152.stdout:5/845: dwrite d3/d9/fb [0,4194304] 0 2024-04-06T12:24:10.322 INFO:tasks.workunit.client.0.smithi152.stdout:9/758: truncate d5/d6/d74/d17/d23/d2d/d32/d36/f85 13040011 0 2024-04-06T12:24:10.324 INFO:tasks.workunit.client.0.smithi152.stdout:1/891: creat d2/d2f/d54/f12b x:0 0 0 2024-04-06T12:24:10.325 INFO:tasks.workunit.client.0.smithi152.stdout:3/965: creat d0/d35/d43/d48/f139 x:0 0 0 2024-04-06T12:24:10.325 INFO:tasks.workunit.client.0.smithi152.stdout:1/892: write d2/d5d/f128 [1875524,43326] 0 2024-04-06T12:24:10.330 INFO:tasks.workunit.client.0.smithi152.stdout:9/759: rename d5/d6/d74/d17/d37/f61 to d5/d6/d74/d69/fec 0 2024-04-06T12:24:10.332 INFO:tasks.workunit.client.0.smithi152.stdout:4/940: dread d7/d16/d22/d3f/f81 [0,4194304] 0 2024-04-06T12:24:10.336 INFO:tasks.workunit.client.0.smithi152.stdout:1/893: dwrite d2/d2f/d37/f118 [0,4194304] 0 2024-04-06T12:24:10.342 INFO:tasks.workunit.client.0.smithi152.stdout:4/941: symlink d7/d29/d2e/d5b/db2/dd7/l12f 0 2024-04-06T12:24:10.343 INFO:tasks.workunit.client.0.smithi152.stdout:4/942: chown d7/d29/d78 1054 1 2024-04-06T12:24:10.346 INFO:tasks.workunit.client.0.smithi152.stdout:1/894: dwrite d2/d2f/d54/d88/d9c/db3/ff2 [0,4194304] 0 2024-04-06T12:24:10.347 INFO:tasks.workunit.client.0.smithi152.stdout:4/943: chown d7/d16/d22/dc7/d12b/ffd 110474892 1 2024-04-06T12:24:10.349 INFO:tasks.workunit.client.0.smithi152.stdout:9/760: mknod d5/d6/d74/d17/d23/d2d/d4b/ced 0 2024-04-06T12:24:10.352 INFO:tasks.workunit.client.0.smithi152.stdout:9/761: dread - d5/d6/d74/d17/fda zero size 2024-04-06T12:24:10.356 INFO:tasks.workunit.client.0.smithi152.stdout:9/762: mknod d5/d6/d74/dd9/cee 0 2024-04-06T12:24:10.360 INFO:tasks.workunit.client.0.smithi152.stdout:9/763: truncate d5/d6/d74/d17/d86/fba 788980 0 2024-04-06T12:24:10.361 INFO:tasks.workunit.client.0.smithi152.stdout:9/764: write d5/d6/f3c [4956613,13622] 0 2024-04-06T12:24:10.367 INFO:tasks.workunit.client.0.smithi152.stdout:5/846: dread d3/da/d15/f21 [0,4194304] 0 2024-04-06T12:24:10.369 INFO:tasks.workunit.client.0.smithi152.stdout:5/847: chown d3/da/d15/d40/d92/f10c 0 1 2024-04-06T12:24:10.369 INFO:tasks.workunit.client.0.smithi152.stdout:4/944: dread d7/d16/f83 [0,4194304] 0 2024-04-06T12:24:10.371 INFO:tasks.workunit.client.0.smithi152.stdout:1/895: dread d2/d2f/d37/f5f [0,4194304] 0 2024-04-06T12:24:10.376 INFO:tasks.workunit.client.0.smithi152.stdout:4/945: mkdir d7/d82/db1/d130 0 2024-04-06T12:24:10.377 INFO:tasks.workunit.client.0.smithi152.stdout:5/848: write d3/da/d15/d2b/d3f/f43 [955759,38246] 0 2024-04-06T12:24:10.384 INFO:tasks.workunit.client.0.smithi152.stdout:4/946: creat d7/d16/d22/dc7/dc8/f131 x:0 0 0 2024-04-06T12:24:10.386 INFO:tasks.workunit.client.0.smithi152.stdout:4/947: dread d7/d16/d22/d3f/db4/d60/dc4/fef [0,4194304] 0 2024-04-06T12:24:10.392 INFO:tasks.workunit.client.0.smithi152.stdout:4/948: dwrite d7/d29/d78/fe9 [0,4194304] 0 2024-04-06T12:24:10.396 INFO:tasks.workunit.client.0.smithi152.stdout:5/849: symlink d3/de/dde/l116 0 2024-04-06T12:24:10.396 INFO:tasks.workunit.client.0.smithi152.stdout:9/765: truncate d5/d6/d74/d17/d23/d2d/d32/d36/f9d 4769236 0 2024-04-06T12:24:10.398 INFO:tasks.workunit.client.0.smithi152.stdout:9/766: chown d5/d6/d74/d17/d23/fd0 993477295 1 2024-04-06T12:24:10.398 INFO:tasks.workunit.client.0.smithi152.stdout:4/949: mknod d7/d16/d22/d3f/db4/c132 0 2024-04-06T12:24:10.408 INFO:tasks.workunit.client.0.smithi152.stdout:4/950: symlink d7/d29/d78/l133 0 2024-04-06T12:24:10.410 INFO:tasks.workunit.client.0.smithi152.stdout:9/767: dread d5/d6/f73 [0,4194304] 0 2024-04-06T12:24:10.412 INFO:tasks.workunit.client.0.smithi152.stdout:5/850: creat d3/da/d15/d2b/d3f/d6d/f117 x:0 0 0 2024-04-06T12:24:10.419 INFO:tasks.workunit.client.0.smithi152.stdout:4/951: symlink d7/d29/d78/ded/l134 0 2024-04-06T12:24:10.424 INFO:tasks.workunit.client.0.smithi152.stdout:5/851: dread d3/da/d53/fb3 [0,4194304] 0 2024-04-06T12:24:10.426 INFO:tasks.workunit.client.0.smithi152.stdout:9/768: link d5/l7d d5/d39/d3f/d42/lef 0 2024-04-06T12:24:10.427 INFO:tasks.workunit.client.0.smithi152.stdout:9/769: stat d5/d6/f50 0 2024-04-06T12:24:10.428 INFO:tasks.workunit.client.0.smithi152.stdout:4/952: mkdir d7/d16/d55/da0/d120/d135 0 2024-04-06T12:24:10.430 INFO:tasks.workunit.client.0.smithi152.stdout:5/852: mknod d3/da/d15/d40/d50/dd7/c118 0 2024-04-06T12:24:10.431 INFO:tasks.workunit.client.0.smithi152.stdout:9/770: symlink d5/d6/d74/d17/d23/lf0 0 2024-04-06T12:24:10.433 INFO:tasks.workunit.client.0.smithi152.stdout:4/953: truncate d7/d16/d55/da0/f104 1711868 0 2024-04-06T12:24:10.437 INFO:tasks.workunit.client.0.smithi152.stdout:5/853: fsync d3/da/d15/d40/d50/d99/f102 0 2024-04-06T12:24:10.447 INFO:tasks.workunit.client.0.smithi152.stdout:4/954: dread d7/d16/d22/d3f/db4/d60/f87 [0,4194304] 0 2024-04-06T12:24:10.449 INFO:tasks.workunit.client.0.smithi152.stdout:5/854: symlink d3/da/d15/d40/l119 0 2024-04-06T12:24:10.455 INFO:tasks.workunit.client.0.smithi152.stdout:4/955: dread d7/d16/d22/d3f/fe8 [0,4194304] 0 2024-04-06T12:24:10.460 INFO:tasks.workunit.client.0.smithi152.stdout:5/855: rename d3/da/d15/fee to d3/da/d15/d2b/d3f/d6d/db1/f11a 0 2024-04-06T12:24:10.473 INFO:tasks.workunit.client.0.smithi152.stdout:5/856: link d3/da/d15/d7f/ld3 d3/da/d15/d2b/l11b 0 2024-04-06T12:24:10.481 INFO:tasks.workunit.client.0.smithi152.stdout:5/857: dread d3/da/d15/d2b/d3f/d6d/dc6/dd9/fe7 [0,4194304] 0 2024-04-06T12:24:10.497 INFO:tasks.workunit.client.0.smithi152.stdout:9/771: symlink d5/d6/d74/d17/d23/d2d/d32/d36/lf1 0 2024-04-06T12:24:10.501 INFO:tasks.workunit.client.0.smithi152.stdout:9/772: rmdir d5/d6/d74/d17/d23/d2d/d4b 39 2024-04-06T12:24:10.502 INFO:tasks.workunit.client.0.smithi152.stdout:4/956: write d7/d16/d22/d3f/db4/d60/f9e [3383084,1745] 0 2024-04-06T12:24:10.503 INFO:tasks.workunit.client.0.smithi152.stdout:9/773: stat d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/ld5 0 2024-04-06T12:24:10.510 INFO:tasks.workunit.client.0.smithi152.stdout:9/774: dwrite d5/d39/d79/f7f [0,4194304] 0 2024-04-06T12:24:10.515 INFO:tasks.workunit.client.0.smithi152.stdout:4/957: link d7/d29/d7e/d59/f76 d7/d16/d22/dc7/dc8/f136 0 2024-04-06T12:24:10.517 INFO:tasks.workunit.client.0.smithi152.stdout:9/775: unlink d5/d6/d74/d17/d86/cb3 0 2024-04-06T12:24:10.519 INFO:tasks.workunit.client.0.smithi152.stdout:9/776: dread - d5/d6/d74/d17/d23/d2d/d32/db1/fdc zero size 2024-04-06T12:24:10.524 INFO:tasks.workunit.client.0.smithi152.stdout:9/777: creat d5/d39/d79/ff2 x:0 0 0 2024-04-06T12:24:10.526 INFO:tasks.workunit.client.0.smithi152.stdout:5/858: write d3/da/d53/f60 [1447524,66743] 0 2024-04-06T12:24:10.529 INFO:tasks.workunit.client.0.smithi152.stdout:5/859: creat d3/de/da9/f11c x:0 0 0 2024-04-06T12:24:10.541 INFO:tasks.workunit.client.0.smithi152.stdout:9/778: getdents d5/d39/d3f/d42 0 2024-04-06T12:24:10.543 INFO:tasks.workunit.client.0.smithi152.stdout:5/860: creat d3/da/d15/d2b/d3f/f11d x:0 0 0 2024-04-06T12:24:10.544 INFO:tasks.workunit.client.0.smithi152.stdout:5/861: fsync d3/da/d15/d2b/d3f/d68/d81/f6e 0 2024-04-06T12:24:10.547 INFO:tasks.workunit.client.0.smithi152.stdout:9/779: truncate d5/d6/d74/d17/d23/fd0 428074 0 2024-04-06T12:24:10.554 INFO:tasks.workunit.client.0.smithi152.stdout:4/958: dwrite d7/d16/f68 [4194304,4194304] 0 2024-04-06T12:24:10.557 INFO:tasks.workunit.client.0.smithi152.stdout:9/780: mknod d5/d6/d74/d17/d23/d2d/d98/cf3 0 2024-04-06T12:24:10.562 INFO:tasks.workunit.client.0.smithi152.stdout:9/781: symlink d5/d6/d74/d17/d37/lf4 0 2024-04-06T12:24:10.573 INFO:tasks.workunit.client.0.smithi152.stdout:4/959: getdents d7/d29/d7e 0 2024-04-06T12:24:10.574 INFO:tasks.workunit.client.0.smithi152.stdout:5/862: dwrite d3/da/d53/f62 [0,4194304] 0 2024-04-06T12:24:10.575 INFO:tasks.workunit.client.0.smithi152.stdout:4/960: chown d7/d16/d22/dc7/dc8 0 1 2024-04-06T12:24:10.575 INFO:tasks.workunit.client.0.smithi152.stdout:5/863: fdatasync d3/da/ff4 0 2024-04-06T12:24:10.575 INFO:tasks.workunit.client.0.smithi152.stdout:9/782: creat d5/d6/d74/d17/d23/d2d/d98/ff5 x:0 0 0 2024-04-06T12:24:10.580 INFO:tasks.workunit.client.0.smithi152.stdout:5/864: symlink d3/da/d15/d2b/dbd/l11e 0 2024-04-06T12:24:10.580 INFO:tasks.workunit.client.0.smithi152.stdout:9/783: mknod d5/d6/d74/d17/d37/cf6 0 2024-04-06T12:24:10.581 INFO:tasks.workunit.client.0.smithi152.stdout:7/828: sync 2024-04-06T12:24:10.581 INFO:tasks.workunit.client.0.smithi152.stdout:2/878: sync 2024-04-06T12:24:10.582 INFO:tasks.workunit.client.0.smithi152.stdout:9/784: stat d5/d6/d74/d17/d23/d2d 0 2024-04-06T12:24:10.583 INFO:tasks.workunit.client.0.smithi152.stdout:4/961: truncate d7/d29/d7e/d59/fac 3615077 0 2024-04-06T12:24:10.585 INFO:tasks.workunit.client.0.smithi152.stdout:5/865: rmdir d3/da/d15/d2b/d3f 39 2024-04-06T12:24:10.594 INFO:tasks.workunit.client.0.smithi152.stdout:2/879: truncate d0/d15/d24/d3d/fc7 847942 0 2024-04-06T12:24:10.595 INFO:tasks.workunit.client.0.smithi152.stdout:2/880: chown d0/d15/d24/d3d/de3/db2/cc6 92 1 2024-04-06T12:24:10.600 INFO:tasks.workunit.client.0.smithi152.stdout:2/881: dwrite d0/d15/d24/f72 [0,4194304] 0 2024-04-06T12:24:10.604 INFO:tasks.workunit.client.0.smithi152.stdout:9/785: truncate d5/d6/d74/d17/f19 3896867 0 2024-04-06T12:24:10.605 INFO:tasks.workunit.client.0.smithi152.stdout:4/962: rename d7/d16/d22/d3f/db4/d60/cf7 to d7/d29/d78/ded/c137 0 2024-04-06T12:24:10.605 INFO:tasks.workunit.client.0.smithi152.stdout:9/786: dread - d5/d6/d74/d17/fda zero size 2024-04-06T12:24:10.607 INFO:tasks.workunit.client.0.smithi152.stdout:9/787: chown d5/d6/d74/d17/d86 2034 1 2024-04-06T12:24:10.607 INFO:tasks.workunit.client.0.smithi152.stdout:4/963: write d7/d16/d22/d95/fce [8086201,99075] 0 2024-04-06T12:24:10.609 INFO:tasks.workunit.client.0.smithi152.stdout:7/829: write d8/df/d28/d41/dd4/d49/fec [769660,60752] 0 2024-04-06T12:24:10.610 INFO:tasks.workunit.client.0.smithi152.stdout:7/830: read - d8/df/d61/d6d/ff2 zero size 2024-04-06T12:24:10.611 INFO:tasks.workunit.client.0.smithi152.stdout:7/831: readlink d8/df/d34/lb2 0 2024-04-06T12:24:10.611 INFO:tasks.workunit.client.0.smithi152.stdout:5/866: truncate d3/da/d15/d2b/d3f/d6d/dc6/dd9/fe7 226910 0 2024-04-06T12:24:10.617 INFO:tasks.workunit.client.0.smithi152.stdout:2/882: unlink d0/d2/f45 0 2024-04-06T12:24:10.623 INFO:tasks.workunit.client.0.smithi152.stdout:9/788: rmdir d5/d39/d79/daa 39 2024-04-06T12:24:10.625 INFO:tasks.workunit.client.0.smithi152.stdout:4/964: creat d7/d16/d22/d95/dda/f138 x:0 0 0 2024-04-06T12:24:10.630 INFO:tasks.workunit.client.0.smithi152.stdout:7/832: fsync d8/df/d61/d3d/f39 0 2024-04-06T12:24:10.634 INFO:tasks.workunit.client.0.smithi152.stdout:2/883: creat d0/d40/d41/d28/d8c/f120 x:0 0 0 2024-04-06T12:24:10.640 INFO:tasks.workunit.client.0.smithi152.stdout:5/867: dread d3/de/d80/f52 [0,4194304] 0 2024-04-06T12:24:10.641 INFO:tasks.workunit.client.0.smithi152.stdout:5/868: fsync d3/da/d15/d40/d50/f95 0 2024-04-06T12:24:10.643 INFO:tasks.workunit.client.0.smithi152.stdout:7/833: creat d8/df/d61/d4b/d56/f118 x:0 0 0 2024-04-06T12:24:10.651 INFO:tasks.workunit.client.0.smithi152.stdout:4/965: rename d7/d16/d22/d3f/db4/d60/l8c to d7/d16/d22/d3f/db4/d60/dc4/l139 0 2024-04-06T12:24:10.654 INFO:tasks.workunit.client.0.smithi152.stdout:5/869: mknod d3/da/d15/d2b/d3f/d6d/dc6/c11f 0 2024-04-06T12:24:10.666 INFO:tasks.workunit.client.0.smithi152.stdout:9/789: write d5/d6/d74/f96 [8544907,14482] 0 2024-04-06T12:24:10.668 INFO:tasks.workunit.client.0.smithi152.stdout:1/896: sync 2024-04-06T12:24:10.668 INFO:tasks.workunit.client.0.smithi152.stdout:3/966: sync 2024-04-06T12:24:10.668 INFO:tasks.workunit.client.0.smithi152.stdout:6/941: sync 2024-04-06T12:24:10.671 INFO:tasks.workunit.client.0.smithi152.stdout:2/884: dwrite d0/d40/d26/fdc [4194304,4194304] 0 2024-04-06T12:24:10.672 INFO:tasks.workunit.client.0.smithi152.stdout:9/790: write d5/d6/f16 [53174,69243] 0 2024-04-06T12:24:10.673 INFO:tasks.workunit.client.0.smithi152.stdout:7/834: dread d8/df/d61/d4b/d56/db8/f105 [0,4194304] 0 2024-04-06T12:24:10.673 INFO:tasks.workunit.client.0.smithi152.stdout:2/885: stat d0/d15/f103 0 2024-04-06T12:24:10.674 INFO:tasks.workunit.client.0.smithi152.stdout:4/966: creat d7/d29/d78/f13a x:0 0 0 2024-04-06T12:24:10.675 INFO:tasks.workunit.client.0.smithi152.stdout:5/870: unlink d3/da/d15/d2b/d3f/d6d/dd1/da3/ffe 0 2024-04-06T12:24:10.675 INFO:tasks.workunit.client.0.smithi152.stdout:9/791: fsync d5/d6/d74/d17/d86/fba 0 2024-04-06T12:24:10.676 INFO:tasks.workunit.client.0.smithi152.stdout:7/835: read - d8/df/d34/ff1 zero size 2024-04-06T12:24:10.679 INFO:tasks.workunit.client.0.smithi152.stdout:6/942: mkdir d7/d19/d1b/d31/d131 0 2024-04-06T12:24:10.683 INFO:tasks.workunit.client.0.smithi152.stdout:2/886: creat d0/d15/d24/d79/f121 x:0 0 0 2024-04-06T12:24:10.687 INFO:tasks.workunit.client.0.smithi152.stdout:3/967: rename d0/d2d/l72 to d0/d10/d13/d2a/d93/d49/d8d/l13a 0 2024-04-06T12:24:10.688 INFO:tasks.workunit.client.0.smithi152.stdout:3/968: stat d0/d1f/d4a/dd3/dd9/ce7 0 2024-04-06T12:24:10.691 INFO:tasks.workunit.client.0.smithi152.stdout:4/967: creat d7/d16/d22/d95/dcf/f13b x:0 0 0 2024-04-06T12:24:10.693 INFO:tasks.workunit.client.0.smithi152.stdout:5/871: read d3/fd2 [288738,14280] 0 2024-04-06T12:24:10.700 INFO:tasks.workunit.client.0.smithi152.stdout:1/897: mknod d2/d2f/d54/d88/c12c 0 2024-04-06T12:24:10.701 INFO:tasks.workunit.client.0.smithi152.stdout:7/836: dread d8/df/d34/f88 [0,4194304] 0 2024-04-06T12:24:10.702 INFO:tasks.workunit.client.0.smithi152.stdout:7/837: fsync d8/df/d28/f5a 0 2024-04-06T12:24:10.703 INFO:tasks.workunit.client.0.smithi152.stdout:3/969: dread d0/d10/d13/d2a/d93/d49/d8d/d9e/fb3 [0,4194304] 0 2024-04-06T12:24:10.705 INFO:tasks.workunit.client.0.smithi152.stdout:2/887: mkdir d0/d40/d26/db4/d122 0 2024-04-06T12:24:10.709 INFO:tasks.workunit.client.0.smithi152.stdout:9/792: write d5/d6/d74/d17/d23/d2d/d4b/d5a/f6f [2733333,44986] 0 2024-04-06T12:24:10.716 INFO:tasks.workunit.client.0.smithi152.stdout:6/943: truncate d7/d9/d26/d4a/d7b/fc3 471994 0 2024-04-06T12:24:10.719 INFO:tasks.workunit.client.0.smithi152.stdout:7/838: dread d8/df/d28/d41/dd4/d43/d8a/f116 [0,4194304] 0 2024-04-06T12:24:10.722 INFO:tasks.workunit.client.0.smithi152.stdout:4/968: unlink d7/f108 0 2024-04-06T12:24:10.723 INFO:tasks.workunit.client.0.smithi152.stdout:4/969: chown d7/d29/d7e/f117 94278 1 2024-04-06T12:24:10.726 INFO:tasks.workunit.client.0.smithi152.stdout:9/793: creat d5/d6/d74/d17/d37/ff7 x:0 0 0 2024-04-06T12:24:10.727 INFO:tasks.workunit.client.0.smithi152.stdout:2/888: read d0/d15/d24/d3d/de3/f4e [294054,99595] 0 2024-04-06T12:24:10.731 INFO:tasks.workunit.client.0.smithi152.stdout:3/970: mkdir d0/d10/d1e/d71/db2/dbb/d126/d13b 0 2024-04-06T12:24:10.731 INFO:tasks.workunit.client.0.smithi152.stdout:3/971: fsync d0/d1f/d28/f76 0 2024-04-06T12:24:10.733 INFO:tasks.workunit.client.0.smithi152.stdout:7/839: truncate d8/df/d61/d4b/d56/f83 50150 0 2024-04-06T12:24:10.734 INFO:tasks.workunit.client.0.smithi152.stdout:7/840: chown d8/df/d61/d3d/d53/dee/df4 31 1 2024-04-06T12:24:10.735 INFO:tasks.workunit.client.0.smithi152.stdout:7/841: write d8/df/d28/f5a [1150568,2287] 0 2024-04-06T12:24:10.738 INFO:tasks.workunit.client.0.smithi152.stdout:4/970: creat d7/d16/d22/dc7/dc8/f13c x:0 0 0 2024-04-06T12:24:10.738 INFO:tasks.workunit.client.0.smithi152.stdout:7/842: dread d8/df/d28/d41/dd4/d43/d8a/f116 [0,4194304] 0 2024-04-06T12:24:10.739 INFO:tasks.workunit.client.0.smithi152.stdout:4/971: write d7/d16/d22/dc7/dc8/f13c [700979,11127] 0 2024-04-06T12:24:10.742 INFO:tasks.workunit.client.0.smithi152.stdout:2/889: fdatasync d0/d15/d24/d79/d80/dce/fdf 0 2024-04-06T12:24:10.743 INFO:tasks.workunit.client.0.smithi152.stdout:2/890: chown d0/d15/d24/d79/f7a 15663 1 2024-04-06T12:24:10.752 INFO:tasks.workunit.client.0.smithi152.stdout:6/944: creat d7/d19/d1b/d31/d131/f132 x:0 0 0 2024-04-06T12:24:10.753 INFO:tasks.workunit.client.0.smithi152.stdout:6/945: chown d7/d62/fd8 61759065 1 2024-04-06T12:24:10.775 INFO:tasks.workunit.client.0.smithi152.stdout:1/898: write d2/d1d/f67 [567462,70627] 0 2024-04-06T12:24:10.998 INFO:tasks.workunit.client.0.smithi152.stdout:3/972: write d0/d35/d43/d48/d83/f9a [247529,41163] 0 2024-04-06T12:24:11.002 INFO:tasks.workunit.client.0.smithi152.stdout:6/946: mknod d7/d19/d1b/d22/de1/c133 0 2024-04-06T12:24:11.004 INFO:tasks.workunit.client.0.smithi152.stdout:9/794: link d5/d6/d74/ld2 d5/d39/d79/daa/lf8 0 2024-04-06T12:24:11.009 INFO:tasks.workunit.client.0.smithi152.stdout:7/843: creat d8/df/d61/d4b/f119 x:0 0 0 2024-04-06T12:24:11.015 INFO:tasks.workunit.client.0.smithi152.stdout:4/972: getdents d7/d16/d22/d3f/db4/d60/dc4 0 2024-04-06T12:24:11.016 INFO:tasks.workunit.client.0.smithi152.stdout:4/973: chown d7/d29/d2e/d5b/db2/dd7 3347742 1 2024-04-06T12:24:11.024 INFO:tasks.workunit.client.0.smithi152.stdout:1/899: rename d2/d2f/d54/d88/d9c to d2/d2f/d12d 0 2024-04-06T12:24:11.027 INFO:tasks.workunit.client.0.smithi152.stdout:3/973: creat d0/d10/d1e/d71/da2/f13c x:0 0 0 2024-04-06T12:24:11.029 INFO:tasks.workunit.client.0.smithi152.stdout:4/974: mknod d7/d16/d22/dc7/dc8/c13d 0 2024-04-06T12:24:11.033 INFO:tasks.workunit.client.0.smithi152.stdout:6/947: creat d7/d19/d1b/d1f/f134 x:0 0 0 2024-04-06T12:24:11.034 INFO:tasks.workunit.client.0.smithi152.stdout:7/844: truncate d8/df/d28/d41/dd4/d8c/d2d/f32 909590 0 2024-04-06T12:24:11.037 INFO:tasks.workunit.client.0.smithi152.stdout:3/974: creat d0/d10/d1e/d71/db2/f13d x:0 0 0 2024-04-06T12:24:11.042 INFO:tasks.workunit.client.0.smithi152.stdout:6/948: mknod d7/d19/d1b/d31/d131/c135 0 2024-04-06T12:24:11.044 INFO:tasks.workunit.client.0.smithi152.stdout:7/845: creat d8/df/d28/d41/dd4/d43/d8a/d9d/dc9/dd0/f11a x:0 0 0 2024-04-06T12:24:11.048 INFO:tasks.workunit.client.0.smithi152.stdout:3/975: creat d0/d10/d1e/d71/db2/dbb/f13e x:0 0 0 2024-04-06T12:24:11.053 INFO:tasks.workunit.client.0.smithi152.stdout:6/949: creat d7/d9/f136 x:0 0 0 2024-04-06T12:24:11.054 INFO:tasks.workunit.client.0.smithi152.stdout:6/950: dread d7/d62/fd8 [0,4194304] 0 2024-04-06T12:24:11.057 INFO:tasks.workunit.client.0.smithi152.stdout:3/976: creat d0/d2d/d7f/d8c/f13f x:0 0 0 2024-04-06T12:24:11.058 INFO:tasks.workunit.client.0.smithi152.stdout:7/846: symlink d8/df/d61/d3d/d53/dee/df4/l11b 0 2024-04-06T12:24:11.065 INFO:tasks.workunit.client.0.smithi152.stdout:6/951: mknod d7/d9/d26/dcc/d113/c137 0 2024-04-06T12:24:11.069 INFO:tasks.workunit.client.0.smithi152.stdout:7/847: read d8/df/d28/d41/dd4/fa7 [349696,92561] 0 2024-04-06T12:24:11.080 INFO:tasks.workunit.client.0.smithi152.stdout:7/848: symlink d8/df/d28/l11c 0 2024-04-06T12:24:11.092 INFO:tasks.workunit.client.0.smithi152.stdout:7/849: rmdir d8/df/d28/d41/dd4/d49/d7b 0 2024-04-06T12:24:11.095 INFO:tasks.workunit.client.0.smithi152.stdout:7/850: mknod d8/df/d28/d41/dd4/d8c/c11d 0 2024-04-06T12:24:11.097 INFO:tasks.workunit.client.0.smithi152.stdout:7/851: mkdir d8/df/d28/d41/dd4/d43/d8a/d9d/dc9/dd0/d11e 0 2024-04-06T12:24:11.100 INFO:tasks.workunit.client.0.smithi152.stdout:2/891: write d0/d2/d6f/d90/d9e/db5/d92/fd6 [3952818,7645] 0 2024-04-06T12:24:11.103 INFO:tasks.workunit.client.0.smithi152.stdout:7/852: creat d8/df/d28/d41/dd4/d8c/d2d/d7a/f11f x:0 0 0 2024-04-06T12:24:11.108 INFO:tasks.workunit.client.0.smithi152.stdout:7/853: creat d8/df/d28/d41/dd4/d8c/f120 x:0 0 0 2024-04-06T12:24:11.110 INFO:tasks.workunit.client.0.smithi152.stdout:7/854: write d8/df/d34/d63/f92 [198129,99252] 0 2024-04-06T12:24:11.118 INFO:tasks.workunit.client.0.smithi152.stdout:9/795: dwrite d5/d6/d74/d17/f75 [0,4194304] 0 2024-04-06T12:24:11.123 INFO:tasks.workunit.client.0.smithi152.stdout:9/796: creat d5/d6/d74/d69/ff9 x:0 0 0 2024-04-06T12:24:11.124 INFO:tasks.workunit.client.0.smithi152.stdout:9/797: chown d5/d6/d74/d17/d23/d2d/d32/dbb/cd7 1435 1 2024-04-06T12:24:11.132 INFO:tasks.workunit.client.0.smithi152.stdout:9/798: rename d5/d39/d3f/d42 to d5/d6/dfa 0 2024-04-06T12:24:11.133 INFO:tasks.workunit.client.0.smithi152.stdout:7/855: dread d8/df/d34/f67 [0,4194304] 0 2024-04-06T12:24:11.137 INFO:tasks.workunit.client.0.smithi152.stdout:9/799: mknod d5/d6/d74/d17/d23/d2d/d98/da4/cfb 0 2024-04-06T12:24:11.138 INFO:tasks.workunit.client.0.smithi152.stdout:7/856: truncate d8/df/d61/d76/fc6 1046080 0 2024-04-06T12:24:11.143 INFO:tasks.workunit.client.0.smithi152.stdout:7/857: dread d8/df/d28/d41/dd4/d43/fda [0,4194304] 0 2024-04-06T12:24:11.144 INFO:tasks.workunit.client.0.smithi152.stdout:4/975: dwrite d7/d29/d2e/d5b/db2/f102 [0,4194304] 0 2024-04-06T12:24:11.148 INFO:tasks.workunit.client.0.smithi152.stdout:7/858: mknod d8/df/c121 0 2024-04-06T12:24:11.151 INFO:tasks.workunit.client.0.smithi152.stdout:4/976: creat d7/d29/df2/f13e x:0 0 0 2024-04-06T12:24:11.154 INFO:tasks.workunit.client.0.smithi152.stdout:9/800: dread d5/d6/d74/d17/d23/d2d/d4b/d5a/f6f [0,4194304] 0 2024-04-06T12:24:11.155 INFO:tasks.workunit.client.0.smithi152.stdout:9/801: write d5/d6/d74/d17/d23/d2d/f6b [5268603,13990] 0 2024-04-06T12:24:11.161 INFO:tasks.workunit.client.0.smithi152.stdout:4/977: dwrite d7/d16/d22/d3f/db4/d60/f87 [0,4194304] 0 2024-04-06T12:24:11.166 INFO:tasks.workunit.client.0.smithi152.stdout:4/978: symlink d7/d16/d22/dc7/l13f 0 2024-04-06T12:24:11.166 INFO:tasks.workunit.client.0.smithi152.stdout:6/952: write d7/d19/d3e/d70/fd5 [275471,50547] 0 2024-04-06T12:24:11.171 INFO:tasks.workunit.client.0.smithi152.stdout:9/802: getdents d5/d6/d74/d17/d23/d2d/d4b 0 2024-04-06T12:24:11.175 INFO:tasks.workunit.client.0.smithi152.stdout:3/977: dwrite d0/d1f/d28/fa9 [0,4194304] 0 2024-04-06T12:24:11.176 INFO:tasks.workunit.client.0.smithi152.stdout:6/953: mknod d7/d9/d26/d4a/c138 0 2024-04-06T12:24:11.183 INFO:tasks.workunit.client.0.smithi152.stdout:9/803: fsync d5/d6/d74/d17/d23/d2d/f8f 0 2024-04-06T12:24:11.190 INFO:tasks.workunit.client.0.smithi152.stdout:3/978: rename d0/d10/d1e/d71/db2/ddc to d0/d10/daf/d140 0 2024-04-06T12:24:11.192 INFO:tasks.workunit.client.0.smithi152.stdout:9/804: dread d5/d39/f3d [0,4194304] 0 2024-04-06T12:24:11.201 INFO:tasks.workunit.client.0.smithi152.stdout:3/979: creat d0/d1f/d4a/dd3/dd9/f141 x:0 0 0 2024-04-06T12:24:11.203 INFO:tasks.workunit.client.0.smithi152.stdout:2/892: dwrite d0/d40/d41/d28/d8c/fed [0,4194304] 0 2024-04-06T12:24:11.205 INFO:tasks.workunit.client.0.smithi152.stdout:9/805: symlink d5/d6/d74/dd9/lfc 0 2024-04-06T12:24:11.212 INFO:tasks.workunit.client.0.smithi152.stdout:2/893: symlink d0/d15/d24/d79/l123 0 2024-04-06T12:24:11.215 INFO:tasks.workunit.client.0.smithi152.stdout:9/806: mknod d5/d6/dfa/db6/cfd 0 2024-04-06T12:24:11.222 INFO:tasks.workunit.client.0.smithi152.stdout:9/807: fdatasync d5/d6/d74/d17/d23/d2d/d32/db1/fdb 0 2024-04-06T12:24:11.224 INFO:tasks.workunit.client.0.smithi152.stdout:3/980: dread d0/d10/d1e/d71/db2/fe6 [0,4194304] 0 2024-04-06T12:24:11.237 INFO:tasks.workunit.client.0.smithi152.stdout:9/808: link d5/d6/f95 d5/d6/dd3/ffe 0 2024-04-06T12:24:11.242 INFO:tasks.workunit.client.0.smithi152.stdout:7/859: dread - d8/df/d61/d6d/fde zero size 2024-04-06T12:24:11.244 INFO:tasks.workunit.client.0.smithi152.stdout:4/979: write d7/d16/d55/da0/f104 [2653391,124782] 0 2024-04-06T12:24:11.247 INFO:tasks.workunit.client.0.smithi152.stdout:9/809: symlink d5/d6/d74/d17/d23/d2d/d32/dbb/de6/lff 0 2024-04-06T12:24:11.251 INFO:tasks.workunit.client.0.smithi152.stdout:3/981: getdents d0/d10/d1e/d71/db2/dbb/d126 0 2024-04-06T12:24:11.252 INFO:tasks.workunit.client.0.smithi152.stdout:6/954: write d7/d9/d26/d2e/faf [461505,108748] 0 2024-04-06T12:24:11.255 INFO:tasks.workunit.client.0.smithi152.stdout:6/955: write d7/d19/d3e/f9a [2602642,105275] 0 2024-04-06T12:24:11.257 INFO:tasks.workunit.client.0.smithi152.stdout:9/810: creat d5/d6/d74/d69/f100 x:0 0 0 2024-04-06T12:24:11.259 INFO:tasks.workunit.client.0.smithi152.stdout:4/980: dread d7/d16/d22/d95/fce [0,4194304] 0 2024-04-06T12:24:11.267 INFO:tasks.workunit.client.0.smithi152.stdout:6/956: symlink d7/d9/d26/dcc/d113/l139 0 2024-04-06T12:24:11.267 INFO:tasks.workunit.client.0.smithi152.stdout:6/957: chown d7/d19/d1b/d1f/d3d/f8e 514889617 1 2024-04-06T12:24:11.271 INFO:tasks.workunit.client.0.smithi152.stdout:9/811: creat d5/d6/d74/d17/d86/f101 x:0 0 0 2024-04-06T12:24:11.273 INFO:tasks.workunit.client.0.smithi152.stdout:9/812: dread d5/d6/dfa/fc0 [0,4194304] 0 2024-04-06T12:24:11.275 INFO:tasks.workunit.client.0.smithi152.stdout:4/981: creat d7/d29/d2e/d7b/f140 x:0 0 0 2024-04-06T12:24:11.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:09.587083+0000 mgr.smithi195.ausetj (mgr.24375) 92 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 145 MiB/s wr, 373 op/s 2024-04-06T12:24:11.278 INFO:tasks.workunit.client.0.smithi152.stdout:3/982: rename d0/d10/d13/d2a/f118 to d0/d10/d13/d2a/d93/d49/d8d/d9e/f142 0 2024-04-06T12:24:11.282 INFO:tasks.workunit.client.0.smithi152.stdout:2/894: dwrite d0/d15/d24/d3d/de3/f4e [0,4194304] 0 2024-04-06T12:24:11.292 INFO:tasks.workunit.client.0.smithi152.stdout:4/982: creat d7/d16/d22/d95/dda/f141 x:0 0 0 2024-04-06T12:24:11.293 INFO:tasks.workunit.client.0.smithi152.stdout:3/983: mkdir d0/d10/d13/d2a/db6/d143 0 2024-04-06T12:24:11.298 INFO:tasks.workunit.client.0.smithi152.stdout:4/983: dwrite d7/d16/d22/dc7/fd6 [0,4194304] 0 2024-04-06T12:24:11.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:09.587083+0000 mgr.smithi195.ausetj (mgr.24375) 92 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 145 MiB/s wr, 373 op/s 2024-04-06T12:24:11.302 INFO:tasks.workunit.client.0.smithi152.stdout:9/813: mknod d5/d6/d74/d17/d23/c102 0 2024-04-06T12:24:11.307 INFO:tasks.workunit.client.0.smithi152.stdout:3/984: fdatasync d0/d10/d13/d2a/d4b/ded/fc6 0 2024-04-06T12:24:11.308 INFO:tasks.workunit.client.0.smithi152.stdout:2/895: dread d0/d15/d24/d3d/de3/f52 [0,4194304] 0 2024-04-06T12:24:11.311 INFO:tasks.workunit.client.0.smithi152.stdout:3/985: write d0/d10/d13/d2a/d4b/d6a/ff0 [701356,119973] 0 2024-04-06T12:24:11.312 INFO:tasks.workunit.client.0.smithi152.stdout:4/984: rmdir d7/d82/db1/db6 39 2024-04-06T12:24:11.318 INFO:tasks.workunit.client.0.smithi152.stdout:7/860: write d8/df/d28/d41/dd4/d79/d81/f95 [74175,36837] 0 2024-04-06T12:24:11.320 INFO:tasks.workunit.client.0.smithi152.stdout:2/896: unlink d0/d15/d24/d3d/de3/ldd 0 2024-04-06T12:24:11.320 INFO:tasks.workunit.client.0.smithi152.stdout:7/861: write d8/df/d28/d41/dd4/d43/d8a/d9d/dc9/dd0/f11a [118563,119239] 0 2024-04-06T12:24:11.321 INFO:tasks.workunit.client.0.smithi152.stdout:7/862: dread - d8/df/d61/d6d/f112 zero size 2024-04-06T12:24:11.323 INFO:tasks.workunit.client.0.smithi152.stdout:3/986: mknod d0/d35/d43/d48/d83/d9d/c144 0 2024-04-06T12:24:11.324 INFO:tasks.workunit.client.0.smithi152.stdout:3/987: chown d0/d10/d13/d2a/db6/fd7 19394061 1 2024-04-06T12:24:11.325 INFO:tasks.workunit.client.0.smithi152.stdout:4/985: mkdir d7/d29/d2e/d7b/d142 0 2024-04-06T12:24:11.329 INFO:tasks.workunit.client.0.smithi152.stdout:9/814: mknod d5/d6/d74/d17/d23/d2d/d32/d36/da3/c103 0 2024-04-06T12:24:11.330 INFO:tasks.workunit.client.0.smithi152.stdout:6/958: write d7/d19/d1b/d1f/d3d/dc2/ddd/feb [518110,32190] 0 2024-04-06T12:24:11.331 INFO:tasks.workunit.client.0.smithi152.stdout:2/897: creat d0/d40/d41/d63/f124 x:0 0 0 2024-04-06T12:24:11.334 INFO:tasks.workunit.client.0.smithi152.stdout:7/863: mkdir d8/df/d28/d41/dd4/d8c/d59/d122 0 2024-04-06T12:24:11.336 INFO:tasks.workunit.client.0.smithi152.stdout:7/864: chown d8/df/d28/d41/dd4/d8c/daf/fb3 532 1 2024-04-06T12:24:11.336 INFO:tasks.workunit.client.0.smithi152.stdout:3/988: unlink d0/d10/d13/d2a/d121/f138 0 2024-04-06T12:24:11.341 INFO:tasks.workunit.client.0.smithi152.stdout:4/986: creat d7/d16/d22/d95/f143 x:0 0 0 2024-04-06T12:24:11.345 INFO:tasks.workunit.client.0.smithi152.stdout:3/989: dwrite d0/d10/d1e/d71/da2/f110 [0,4194304] 0 2024-04-06T12:24:11.346 INFO:tasks.workunit.client.0.smithi152.stdout:5/872: sync 2024-04-06T12:24:11.346 INFO:tasks.workunit.client.0.smithi152.stdout:1/900: sync 2024-04-06T12:24:11.346 INFO:tasks.workunit.client.0.smithi152.stdout:9/815: dread d5/d6/d74/d17/d23/d2d/d32/d36/f85 [8388608,4194304] 0 2024-04-06T12:24:11.349 INFO:tasks.workunit.client.0.smithi152.stdout:6/959: rename d7/d19/dde/c10e to d7/d19/d1b/d31/d35/c13a 0 2024-04-06T12:24:11.350 INFO:tasks.workunit.client.0.smithi152.stdout:4/987: dread d7/d16/d55/da0/f11e [0,4194304] 0 2024-04-06T12:24:11.355 INFO:tasks.workunit.client.0.smithi152.stdout:5/873: truncate d3/da/d15/d2b/d3f/db9/fbe 9178161 0 2024-04-06T12:24:11.355 INFO:tasks.workunit.client.0.smithi152.stdout:6/960: read d7/d19/d3e/f40 [3080705,115097] 0 2024-04-06T12:24:11.356 INFO:tasks.workunit.client.0.smithi152.stdout:3/990: dread d0/d10/d1e/d71/db2/fe6 [0,4194304] 0 2024-04-06T12:24:11.360 INFO:tasks.workunit.client.0.smithi152.stdout:1/901: symlink d2/d2f/d37/l12e 0 2024-04-06T12:24:11.360 INFO:tasks.workunit.client.0.smithi152.stdout:2/898: dread d0/d15/d24/d3d/f91 [0,4194304] 0 2024-04-06T12:24:11.446 INFO:tasks.workunit.client.0.smithi152.stdout:5/874: dread - d3/d9/f7b zero size 2024-04-06T12:24:11.448 INFO:tasks.workunit.client.0.smithi152.stdout:4/988: dread d7/d29/d78/f7c [0,4194304] 0 2024-04-06T12:24:11.463 INFO:tasks.workunit.client.0.smithi152.stdout:2/899: mknod d0/d2/d6f/d90/d9e/db5/d3a/d87/c125 0 2024-04-06T12:24:11.464 INFO:tasks.workunit.client.0.smithi152.stdout:2/900: chown d0/d15/d24/d3d/de3/c53 9557 1 2024-04-06T12:24:11.469 INFO:tasks.workunit.client.0.smithi152.stdout:5/875: dread - d3/da/d15/de9/f97 zero size 2024-04-06T12:24:11.472 INFO:tasks.workunit.client.0.smithi152.stdout:6/961: mkdir d7/d19/d1b/d1f/d13b 0 2024-04-06T12:24:11.475 INFO:tasks.workunit.client.0.smithi152.stdout:5/876: dread d3/da/d15/d40/d50/d99/f102 [0,4194304] 0 2024-04-06T12:24:11.478 INFO:tasks.workunit.client.0.smithi152.stdout:7/865: getdents d8/df/d61/d3d/dac 0 2024-04-06T12:24:11.479 INFO:tasks.workunit.client.0.smithi152.stdout:6/962: stat d7/d19/d1b/d31/fb9 0 2024-04-06T12:24:11.480 INFO:tasks.workunit.client.0.smithi152.stdout:9/816: write d5/d6/d74/d17/d23/d2d/d4b/fa9 [5602637,47975] 0 2024-04-06T12:24:11.482 INFO:tasks.workunit.client.0.smithi152.stdout:7/866: truncate d8/df/d28/d75/de8/ffc 187420 0 2024-04-06T12:24:11.483 INFO:tasks.workunit.client.0.smithi152.stdout:9/817: chown d5/d6/f2c 1 1 2024-04-06T12:24:11.483 INFO:tasks.workunit.client.0.smithi152.stdout:5/877: creat d3/de/d8c/f120 x:0 0 0 2024-04-06T12:24:11.485 INFO:tasks.workunit.client.0.smithi152.stdout:6/963: read d7/d19/d1b/d1f/d3d/fc0 [3606932,6773] 0 2024-04-06T12:24:11.492 INFO:tasks.workunit.client.0.smithi152.stdout:6/964: fsync d7/d19/d1b/d1f/f8f 0 2024-04-06T12:24:11.500 INFO:tasks.workunit.client.0.smithi152.stdout:3/991: dwrite d0/d10/d13/d2a/d93/d49/d8d/d9e/f142 [0,4194304] 0 2024-04-06T12:24:11.502 INFO:tasks.workunit.client.0.smithi152.stdout:5/878: link d3/da/d15/de9/f97 d3/da/d53/f121 0 2024-04-06T12:24:11.503 INFO:tasks.workunit.client.0.smithi152.stdout:6/965: mkdir d7/d9/d26/dd6/d101/d13c 0 2024-04-06T12:24:11.503 INFO:tasks.workunit.client.0.smithi152.stdout:2/901: dwrite d0/dc9/fd2 [0,4194304] 0 2024-04-06T12:24:11.507 INFO:tasks.workunit.client.0.smithi152.stdout:5/879: read - d3/de/d80/d8f/fae zero size 2024-04-06T12:24:11.507 INFO:tasks.workunit.client.0.smithi152.stdout:9/818: getdents d5/d39/d3f 0 2024-04-06T12:24:11.508 INFO:tasks.workunit.client.0.smithi152.stdout:7/867: dwrite d8/df/d28/d41/dd4/d8c/d2d/d7a/fca [4194304,4194304] 0 2024-04-06T12:24:11.516 INFO:tasks.workunit.client.0.smithi152.stdout:2/902: symlink d0/d40/d41/d28/d54/l126 0 2024-04-06T12:24:11.520 INFO:tasks.workunit.client.0.smithi152.stdout:9/819: symlink d5/d6/d74/d17/d23/d2d/d4b/l104 0 2024-04-06T12:24:11.521 INFO:tasks.workunit.client.0.smithi152.stdout:5/880: dwrite d3/da/d15/d2b/d3f/d68/d81/ff9 [0,4194304] 0 2024-04-06T12:24:11.523 INFO:tasks.workunit.client.0.smithi152.stdout:7/868: read d8/df/d34/d5c/ff9 [4590829,22563] 0 2024-04-06T12:24:11.525 INFO:tasks.workunit.client.0.smithi152.stdout:9/820: chown d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/fa8 62727 1 2024-04-06T12:24:11.525 INFO:tasks.workunit.client.0.smithi152.stdout:5/881: chown d3/da/d15/d2b/d3f/d6d/dd1/dd8/f108 9 1 2024-04-06T12:24:11.529 INFO:tasks.workunit.client.0.smithi152.stdout:9/821: mkdir d5/d6/d74/d17/d37/d105 0 2024-04-06T12:24:11.532 INFO:tasks.workunit.client.0.smithi152.stdout:5/882: dwrite d3/de/d8c/f120 [0,4194304] 0 2024-04-06T12:24:11.533 INFO:tasks.workunit.client.0.smithi152.stdout:5/883: stat d3/da/d15/d40/d4f/f51 0 2024-04-06T12:24:11.535 INFO:tasks.workunit.client.0.smithi152.stdout:6/966: getdents d7/d9/d26/d4a/d7b 0 2024-04-06T12:24:11.537 INFO:tasks.workunit.client.0.smithi152.stdout:7/869: symlink d8/df/d28/d41/dd4/d8c/d2d/l123 0 2024-04-06T12:24:11.541 INFO:tasks.workunit.client.0.smithi152.stdout:9/822: creat d5/d6/d74/d17/d86/f106 x:0 0 0 2024-04-06T12:24:11.546 INFO:tasks.workunit.client.0.smithi152.stdout:6/967: chown d7/d9/d73/l119 1622 1 2024-04-06T12:24:11.547 INFO:tasks.workunit.client.0.smithi152.stdout:6/968: chown d7/d9/d26/d4a/ffd 74 1 2024-04-06T12:24:11.547 INFO:tasks.workunit.client.0.smithi152.stdout:3/992: write d0/d10/d13/f6d [4990724,75161] 0 2024-04-06T12:24:11.550 INFO:tasks.workunit.client.0.smithi152.stdout:2/903: link d0/dae/df7/ffe d0/f127 0 2024-04-06T12:24:11.553 INFO:tasks.workunit.client.0.smithi152.stdout:6/969: creat d7/d9/d26/d2e/f13d x:0 0 0 2024-04-06T12:24:11.554 INFO:tasks.workunit.client.0.smithi152.stdout:3/993: readlink d0/d1f/d28/l97 0 2024-04-06T12:24:11.556 INFO:tasks.workunit.client.0.smithi152.stdout:7/870: rmdir d8/df/d28/d41/dd4/d8c/d59/d122 0 2024-04-06T12:24:11.560 INFO:tasks.workunit.client.0.smithi152.stdout:9/823: rename d5/d6/d74/d17/c26 to d5/d39/c107 0 2024-04-06T12:24:11.560 INFO:tasks.workunit.client.0.smithi152.stdout:2/904: rename d0/dc9 to d0/dc9/d128 22 2024-04-06T12:24:11.561 INFO:tasks.workunit.client.0.smithi152.stdout:9/824: fsync d5/d6/d74/d17/fda 0 2024-04-06T12:24:11.563 INFO:tasks.workunit.client.0.smithi152.stdout:5/884: getdents d3/da/d15/d40/d46 0 2024-04-06T12:24:11.564 INFO:tasks.workunit.client.0.smithi152.stdout:3/994: truncate d0/d10/d13/d2a/db6/fc2 19790 0 2024-04-06T12:24:11.571 INFO:tasks.workunit.client.0.smithi152.stdout:2/905: dwrite d0/ff4 [0,4194304] 0 2024-04-06T12:24:11.571 INFO:tasks.workunit.client.0.smithi152.stdout:9/825: symlink d5/d6/d74/d17/d23/d2d/l108 0 2024-04-06T12:24:11.574 INFO:tasks.workunit.client.0.smithi152.stdout:6/970: dwrite d7/d9/d26/d4a/f58 [0,4194304] 0 2024-04-06T12:24:11.575 INFO:tasks.workunit.client.0.smithi152.stdout:5/885: write d3/da/d15/d2b/d3f/d68/d81/f3b [4500077,89849] 0 2024-04-06T12:24:11.578 INFO:tasks.workunit.client.0.smithi152.stdout:9/826: unlink d5/d6/dfa/fdd 0 2024-04-06T12:24:11.580 INFO:tasks.workunit.client.0.smithi152.stdout:5/886: fdatasync d3/da/f29 0 2024-04-06T12:24:11.581 INFO:tasks.workunit.client.0.smithi152.stdout:6/971: write d7/d19/d1b/f116 [556501,68956] 0 2024-04-06T12:24:11.584 INFO:tasks.workunit.client.0.smithi152.stdout:3/995: dread d0/d10/d1e/d71/db2/fe6 [0,4194304] 0 2024-04-06T12:24:11.585 INFO:tasks.workunit.client.0.smithi152.stdout:2/906: truncate d0/d2/d6f/d90/d9e/db5/ff5 4742175 0 2024-04-06T12:24:11.591 INFO:tasks.workunit.client.0.smithi152.stdout:7/871: dwrite d8/df/d61/d3d/dac/fe5 [0,4194304] 0 2024-04-06T12:24:11.592 INFO:tasks.workunit.client.0.smithi152.stdout:9/827: symlink d5/d6/d74/d17/d9f/l109 0 2024-04-06T12:24:11.594 INFO:tasks.workunit.client.0.smithi152.stdout:2/907: mknod d0/d15/d24/d3d/c129 0 2024-04-06T12:24:11.601 INFO:tasks.workunit.client.0.smithi152.stdout:3/996: dwrite d0/d35/d43/dbe/ffe [0,4194304] 0 2024-04-06T12:24:11.606 INFO:tasks.workunit.client.0.smithi152.stdout:6/972: dwrite d7/d19/d1b/d31/f3c [4194304,4194304] 0 2024-04-06T12:24:11.609 INFO:tasks.workunit.client.0.smithi152.stdout:5/887: dread d3/da/d15/f1c [0,4194304] 0 2024-04-06T12:24:11.610 INFO:tasks.workunit.client.0.smithi152.stdout:9/828: rename d5/d6/d74/c6c to d5/d6/d74/d17/d23/d2d/c10a 0 2024-04-06T12:24:11.611 INFO:tasks.workunit.client.0.smithi152.stdout:3/997: dwrite d0/d10/d1e/d87/ffa [0,4194304] 0 2024-04-06T12:24:11.613 INFO:tasks.workunit.client.0.smithi152.stdout:6/973: truncate d7/d19/d1b/d31/fe2 4835745 0 2024-04-06T12:24:11.613 INFO:tasks.workunit.client.0.smithi152.stdout:9/829: chown d5/d6/f49 21348 1 2024-04-06T12:24:11.615 INFO:tasks.workunit.client.0.smithi152.stdout:6/974: fdatasync d7/d9/d26/d2e/faf 0 2024-04-06T12:24:11.617 INFO:tasks.workunit.client.0.smithi152.stdout:9/830: dread - d5/d39/d79/daa/feb zero size 2024-04-06T12:24:11.618 INFO:tasks.workunit.client.0.smithi152.stdout:5/888: symlink d3/da/d15/d2b/d3f/d6d/dc6/l122 0 2024-04-06T12:24:11.621 INFO:tasks.workunit.client.0.smithi152.stdout:3/998: rmdir d0/d10/d1e/d87 39 2024-04-06T12:24:11.625 INFO:tasks.workunit.client.0.smithi152.stdout:7/872: write d8/df/d61/fa6 [1162014,94667] 0 2024-04-06T12:24:11.626 INFO:tasks.workunit.client.0.smithi152.stdout:2/908: write d0/d40/d41/f109 [20309,51981] 0 2024-04-06T12:24:11.629 INFO:tasks.workunit.client.0.smithi152.stdout:7/873: write d8/df/d28/d41/dd4/d8c/d2d/d7a/fca [5002048,64692] 0 2024-04-06T12:24:11.630 INFO:tasks.workunit.client.0.smithi152.stdout:5/889: mknod d3/da/d15/d2b/d3f/d6d/dd1/c123 0 2024-04-06T12:24:11.631 INFO:tasks.workunit.client.0.smithi152.stdout:7/874: chown d8/df/d61/d3d/dac/cbf 15005759 1 2024-04-06T12:24:11.632 INFO:tasks.workunit.client.0.smithi152.stdout:3/999: rmdir d0/d35/d43/d48/d83 39 2024-04-06T12:24:11.632 INFO:tasks.workunit.client.0.smithi152.stdout:5/890: read d3/fd2 [124451,4302] 0 2024-04-06T12:24:11.640 INFO:tasks.workunit.client.0.smithi152.stdout:9/831: truncate d5/f81 4357024 0 2024-04-06T12:24:11.641 INFO:tasks.workunit.client.0.smithi152.stdout:2/909: dread - d0/d15/d24/d79/d80/dce/fcf zero size 2024-04-06T12:24:11.642 INFO:tasks.workunit.client.0.smithi152.stdout:6/975: dwrite d7/d19/d3e/f5d [0,4194304] 0 2024-04-06T12:24:11.643 INFO:tasks.workunit.client.0.smithi152.stdout:6/976: chown d7/d19/f9d 791623365 1 2024-04-06T12:24:11.645 INFO:tasks.workunit.client.0.smithi152.stdout:7/875: creat d8/df/d28/d75/f124 x:0 0 0 2024-04-06T12:24:11.646 INFO:tasks.workunit.client.0.smithi152.stdout:2/910: read - d0/dae/fc3 zero size 2024-04-06T12:24:11.648 INFO:tasks.workunit.client.0.smithi152.stdout:6/977: mkdir d7/d19/dde/d13e 0 2024-04-06T12:24:11.649 INFO:tasks.workunit.client.0.smithi152.stdout:7/876: symlink d8/df/d61/d3d/l125 0 2024-04-06T12:24:11.656 INFO:tasks.workunit.client.0.smithi152.stdout:7/877: creat d8/df/d61/d76/d106/df6/f126 x:0 0 0 2024-04-06T12:24:11.657 INFO:tasks.workunit.client.0.smithi152.stdout:6/978: mkdir d7/d62/d12f/d13f 0 2024-04-06T12:24:11.659 INFO:tasks.workunit.client.0.smithi152.stdout:9/832: dread d5/d6/d74/d17/d37/f76 [0,4194304] 0 2024-04-06T12:24:11.660 INFO:tasks.workunit.client.0.smithi152.stdout:7/878: dread - d8/df/d61/d6d/fde zero size 2024-04-06T12:24:11.665 INFO:tasks.workunit.client.0.smithi152.stdout:2/911: dwrite d0/d15/d24/d3d/de3/db2/f11c [0,4194304] 0 2024-04-06T12:24:11.665 INFO:tasks.workunit.client.0.smithi152.stdout:9/833: fsync d5/d6/d74/d17/d23/d2d/d4b/d5a/f6d 0 2024-04-06T12:24:11.667 INFO:tasks.workunit.client.0.smithi152.stdout:5/891: dread d3/de/d8e/f9b [0,4194304] 0 2024-04-06T12:24:11.668 INFO:tasks.workunit.client.0.smithi152.stdout:5/892: stat d3/da 0 2024-04-06T12:24:11.674 INFO:tasks.workunit.client.0.smithi152.stdout:6/979: rename d7/d19/d1b/d22/l49 to d7/d19/d1b/d22/de1/l140 0 2024-04-06T12:24:11.676 INFO:tasks.workunit.client.0.smithi152.stdout:2/912: dwrite d0/d40/d41/d28/d8c/f120 [0,4194304] 0 2024-04-06T12:24:11.678 INFO:tasks.workunit.client.0.smithi152.stdout:7/879: creat d8/df/d28/d41/dd4/d79/d81/f127 x:0 0 0 2024-04-06T12:24:11.682 INFO:tasks.workunit.client.0.smithi152.stdout:5/893: fdatasync d3/f7 0 2024-04-06T12:24:11.686 INFO:tasks.workunit.client.0.smithi152.stdout:9/834: rename d5/d6/d74/fbd to d5/d6/d74/d17/d37/d5d/f10b 0 2024-04-06T12:24:11.688 INFO:tasks.workunit.client.0.smithi152.stdout:6/980: fsync d7/d19/dbf/fd2 0 2024-04-06T12:24:11.688 INFO:tasks.workunit.client.0.smithi152.stdout:9/835: fsync d5/d39/d79/ff2 0 2024-04-06T12:24:11.688 INFO:tasks.workunit.client.0.smithi152.stdout:7/880: dwrite d8/df/d61/d3d/dac/fe5 [4194304,4194304] 0 2024-04-06T12:24:11.695 INFO:tasks.workunit.client.0.smithi152.stdout:5/894: symlink d3/d9/l124 0 2024-04-06T12:24:11.702 INFO:tasks.workunit.client.0.smithi152.stdout:5/895: dwrite d3/da/d15/d2b/d3f/d68/fec [0,4194304] 0 2024-04-06T12:24:11.705 INFO:tasks.workunit.client.0.smithi152.stdout:9/836: mknod d5/d6/d74/d17/d23/d2d/d98/c10c 0 2024-04-06T12:24:11.706 INFO:tasks.workunit.client.0.smithi152.stdout:9/837: chown d5/d6/d74/dd9/ce1 2 1 2024-04-06T12:24:11.711 INFO:tasks.workunit.client.0.smithi152.stdout:6/981: symlink d7/d19/d1b/d22/de1/d11e/l141 0 2024-04-06T12:24:11.712 INFO:tasks.workunit.client.0.smithi152.stdout:2/913: write d0/d2/fb3 [118218,44695] 0 2024-04-06T12:24:11.714 INFO:tasks.workunit.client.0.smithi152.stdout:2/914: truncate d0/d40/d41/d28/d8c/f120 4962437 0 2024-04-06T12:24:11.745 INFO:tasks.workunit.client.0.smithi152.stdout:7/881: rename d8/df/d28/d41/dd4/d8c/d2d/da3/de4/ddc/fed to d8/df/d61/f128 0 2024-04-06T12:24:11.746 INFO:tasks.workunit.client.0.smithi152.stdout:9/838: symlink d5/d39/d79/l10d 0 2024-04-06T12:24:11.825 INFO:tasks.workunit.client.0.smithi152.stdout:6/982: truncate d7/d62/f6f 8240668 0 2024-04-06T12:24:11.827 INFO:tasks.workunit.client.0.smithi152.stdout:7/882: creat d8/df/d28/d41/dd4/d8c/d2d/d7a/f129 x:0 0 0 2024-04-06T12:24:11.828 INFO:tasks.workunit.client.0.smithi152.stdout:9/839: mkdir d5/d6/d74/d17/d23/d2d/d4b/d10e 0 2024-04-06T12:24:11.867 INFO:tasks.workunit.client.0.smithi152.stdout:2/915: write d0/f127 [714840,48207] 0 2024-04-06T12:24:11.868 INFO:tasks.workunit.client.0.smithi152.stdout:2/916: chown d0/d40/d41/d63 858 1 2024-04-06T12:24:11.868 INFO:tasks.workunit.client.0.smithi152.stdout:2/917: readlink d0/d40/d41/l34 0 2024-04-06T12:24:11.883 INFO:tasks.workunit.client.0.smithi152.stdout:6/983: symlink d7/d19/d1b/d31/d35/l142 0 2024-04-06T12:24:11.885 INFO:tasks.workunit.client.0.smithi152.stdout:6/984: chown d7/d9/c86 96 1 2024-04-06T12:24:11.886 INFO:tasks.workunit.client.0.smithi152.stdout:7/883: creat d8/df/d28/d41/dd4/d8c/d2d/da3/f12a x:0 0 0 2024-04-06T12:24:11.889 INFO:tasks.workunit.client.0.smithi152.stdout:9/840: creat d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7/f10f x:0 0 0 2024-04-06T12:24:11.889 INFO:tasks.workunit.client.0.smithi152.stdout:7/884: chown d8/df/d61/f128 89341543 1 2024-04-06T12:24:11.898 INFO:tasks.workunit.client.0.smithi152.stdout:7/885: chown d8/df/d28/d41/dd4/d79/fba 1642715 1 2024-04-06T12:24:11.900 INFO:tasks.workunit.client.0.smithi152.stdout:7/886: write d8/df/d61/f115 [857399,47502] 0 2024-04-06T12:24:11.907 INFO:tasks.workunit.client.0.smithi152.stdout:7/887: creat d8/df/d28/d41/dd4/d43/f12b x:0 0 0 2024-04-06T12:24:11.909 INFO:tasks.workunit.client.0.smithi152.stdout:9/841: link d5/d6/d74/f96 d5/d6/d74/d17/d23/d2d/d4b/f110 0 2024-04-06T12:24:11.928 INFO:tasks.workunit.client.0.smithi152.stdout:9/842: getdents d5/d6/d74/d17/d23/d2d/d32/d36/da3/da7 0 2024-04-06T12:24:11.933 INFO:tasks.workunit.client.0.smithi152.stdout:9/843: symlink d5/d6/d74/d17/d23/d2d/d98/l111 0 2024-04-06T12:24:11.937 INFO:tasks.workunit.client.0.smithi152.stdout:2/918: dwrite d0/d15/d24/d3d/de3/f52 [4194304,4194304] 0 2024-04-06T12:24:11.937 INFO:tasks.workunit.client.0.smithi152.stdout:6/985: dwrite d7/d19/d3e/d70/f99 [0,4194304] 0 2024-04-06T12:24:11.943 INFO:tasks.workunit.client.0.smithi152.stdout:9/844: mkdir d5/d6/d74/d17/d23/d2d/d112 0 2024-04-06T12:24:11.943 INFO:tasks.workunit.client.0.smithi152.stdout:7/888: dwrite d8/df/d28/d41/dd4/d8c/f38 [4194304,4194304] 0 2024-04-06T12:24:11.947 INFO:tasks.workunit.client.0.smithi152.stdout:9/845: creat d5/d6/d74/dd9/f113 x:0 0 0 2024-04-06T12:24:11.949 INFO:tasks.workunit.client.0.smithi152.stdout:1/902: sync 2024-04-06T12:24:11.949 INFO:tasks.workunit.client.0.smithi152.stdout:4/989: sync 2024-04-06T12:24:11.949 INFO:tasks.workunit.client.0.smithi152.stdout:7/889: creat d8/df/d28/d75/de8/f12c x:0 0 0 2024-04-06T12:24:11.950 INFO:tasks.workunit.client.0.smithi152.stdout:6/986: creat d7/d9/d26/d4a/d7b/d110/f143 x:0 0 0 2024-04-06T12:24:11.951 INFO:tasks.workunit.client.0.smithi152.stdout:9/846: mknod d5/d6/d74/d17/d86/c114 0 2024-04-06T12:24:11.955 INFO:tasks.workunit.client.0.smithi152.stdout:7/890: fsync d8/df/d28/d41/dd4/d8c/d2d/d7a/fca 0 2024-04-06T12:24:11.955 INFO:tasks.workunit.client.0.smithi152.stdout:6/987: chown d7/d9/d26/dd6/l108 560 1 2024-04-06T12:24:11.957 INFO:tasks.workunit.client.0.smithi152.stdout:6/988: chown d7/d9/d26/dd6/d101/f111 4507957 1 2024-04-06T12:24:11.957 INFO:tasks.workunit.client.0.smithi152.stdout:4/990: rmdir d7/d29/d2e/d5b 39 2024-04-06T12:24:11.957 INFO:tasks.workunit.client.0.smithi152.stdout:7/891: dread - d8/df/d28/d41/dd4/d8c/d2d/d7a/f129 zero size 2024-04-06T12:24:11.959 INFO:tasks.workunit.client.0.smithi152.stdout:1/903: rename d2/d2f/d37/fcc to d2/d61/dfa/f12f 0 2024-04-06T12:24:11.964 INFO:tasks.workunit.client.0.smithi152.stdout:9/847: mkdir d5/d6/d74/d17/d23/d2d/d4b/d115 0 2024-04-06T12:24:11.969 INFO:tasks.workunit.client.0.smithi152.stdout:1/904: stat d2/d2f/d54/d88/da4/c126 0 2024-04-06T12:24:11.969 INFO:tasks.workunit.client.0.smithi152.stdout:1/905: stat d2/d2f/d54/d88/c12c 0 2024-04-06T12:24:11.971 INFO:tasks.workunit.client.0.smithi152.stdout:2/919: write d0/d2/d6f/d90/d9e/db5/d3a/f8a [516405,99916] 0 2024-04-06T12:24:11.973 INFO:tasks.workunit.client.0.smithi152.stdout:2/920: write d0/d2/d6f/d90/d9e/db5/ff5 [1720421,76919] 0 2024-04-06T12:24:11.974 INFO:tasks.workunit.client.0.smithi152.stdout:1/906: mkdir d2/d1d/d3b/d130 0 2024-04-06T12:24:11.975 INFO:tasks.workunit.client.0.smithi152.stdout:7/892: rename d8/df/d28/d41/dd4/d8c/d66/cb6 to d8/df/d28/d41/dd4/d8c/d59/c12d 0 2024-04-06T12:24:11.975 INFO:tasks.workunit.client.0.smithi152.stdout:2/921: dread d0/d15/f103 [0,4194304] 0 2024-04-06T12:24:11.977 INFO:tasks.workunit.client.0.smithi152.stdout:9/848: creat d5/d6/d74/d17/d23/d2d/d98/d99/f116 x:0 0 0 2024-04-06T12:24:11.980 INFO:tasks.workunit.client.0.smithi152.stdout:6/989: write d7/d62/fd8 [839895,4091] 0 2024-04-06T12:24:11.983 INFO:tasks.workunit.client.0.smithi152.stdout:2/922: dread - d0/d2/d6f/d90/fa5 zero size 2024-04-06T12:24:11.985 INFO:tasks.workunit.client.0.smithi152.stdout:9/849: dwrite d5/d6/d74/d17/d86/fcf [0,4194304] 0 2024-04-06T12:24:11.987 INFO:tasks.workunit.client.0.smithi152.stdout:4/991: getdents d7/d29/d2e 0 2024-04-06T12:24:11.990 INFO:tasks.workunit.client.0.smithi152.stdout:9/850: unlink d5/d39/d79/f7c 0 2024-04-06T12:24:11.992 INFO:tasks.workunit.client.0.smithi152.stdout:4/992: creat d7/d82/f144 x:0 0 0 2024-04-06T12:24:11.994 INFO:tasks.workunit.client.0.smithi152.stdout:6/990: mkdir d7/d9/d26/dd6/d101/d112/d144 0 2024-04-06T12:24:11.997 INFO:tasks.workunit.client.0.smithi152.stdout:6/991: write d7/d9/d26/d2e/f13d [536411,77069] 0 2024-04-06T12:24:11.998 INFO:tasks.workunit.client.0.smithi152.stdout:1/907: truncate d2/f7 5926396 0 2024-04-06T12:24:12.000 INFO:tasks.workunit.client.0.smithi152.stdout:9/851: dwrite d5/d6/d74/d17/d23/d2d/d32/db1/fdc [0,4194304] 0 2024-04-06T12:24:12.000 INFO:tasks.workunit.client.0.smithi152.stdout:2/923: creat d0/d15/d24/d3d/de3/db2/df2/f12a x:0 0 0 2024-04-06T12:24:12.002 INFO:tasks.workunit.client.0.smithi152.stdout:4/993: mknod d7/d29/d2e/d7b/c145 0 2024-04-06T12:24:12.002 INFO:tasks.workunit.client.0.smithi152.stdout:1/908: truncate d2/d2f/d12d/db3/ff2 4771327 0 2024-04-06T12:24:12.005 INFO:tasks.workunit.client.0.smithi152.stdout:7/893: getdents d8/df/d34 0 2024-04-06T12:24:12.007 INFO:tasks.workunit.client.0.smithi152.stdout:7/894: chown d8/df/d28/d41/dd4/d8c/d2d/da3/de4/ddc 160168029 1 2024-04-06T12:24:12.009 INFO:tasks.workunit.client.0.smithi152.stdout:6/992: rmdir d7/d19/d1b/d31/d35 39 2024-04-06T12:24:12.013 INFO:tasks.workunit.client.0.smithi152.stdout:9/852: creat d5/d6/d74/d17/d23/d2d/d32/f117 x:0 0 0 2024-04-06T12:24:12.016 INFO:tasks.workunit.client.0.smithi152.stdout:2/924: write d0/d2/f14 [1157143,42184] 0 2024-04-06T12:24:12.023 INFO:tasks.workunit.client.0.smithi152.stdout:1/909: unlink d2/d2f/d12d/dc5/ce3 0 2024-04-06T12:24:12.024 INFO:tasks.workunit.client.0.smithi152.stdout:9/853: mknod d5/d6/d74/d17/d23/d2d/d4b/c118 0 2024-04-06T12:24:12.026 INFO:tasks.workunit.client.0.smithi152.stdout:6/993: dread d7/d19/d1b/d1f/d3d/f8e [4194304,4194304] 0 2024-04-06T12:24:12.028 INFO:tasks.workunit.client.0.smithi152.stdout:2/925: symlink d0/d15/d24/d3d/de3/db2/l12b 0 2024-04-06T12:24:12.031 INFO:tasks.workunit.client.0.smithi152.stdout:4/994: link d7/d16/d22/d95/dcf/c125 d7/d16/d22/dc7/dc8/c146 0 2024-04-06T12:24:12.031 INFO:tasks.workunit.client.0.smithi152.stdout:1/910: dwrite d2/d2f/d54/d88/da4/ffd [0,4194304] 0 2024-04-06T12:24:12.036 INFO:tasks.workunit.client.0.smithi152.stdout:9/854: mkdir d5/d6/d74/d17/d23/d119 0 2024-04-06T12:24:12.037 INFO:tasks.workunit.client.0.smithi152.stdout:4/995: creat d7/d16/d22/d95/dcf/f147 x:0 0 0 2024-04-06T12:24:12.038 INFO:tasks.workunit.client.0.smithi152.stdout:4/996: dread - d7/d16/d22/d95/dda/f141 zero size 2024-04-06T12:24:12.038 INFO:tasks.workunit.client.0.smithi152.stdout:5/896: sync 2024-04-06T12:24:12.039 INFO:tasks.workunit.client.0.smithi152.stdout:1/911: truncate d2/f76 632351 0 2024-04-06T12:24:12.040 INFO:tasks.workunit.client.0.smithi152.stdout:4/997: dread - d7/d16/d22/d95/dda/f138 zero size 2024-04-06T12:24:12.043 INFO:tasks.workunit.client.0.smithi152.stdout:7/895: getdents d8/df/d28 0 2024-04-06T12:24:12.050 INFO:tasks.workunit.client.0.smithi152.stdout:5/897: creat d3/da/d15/d2b/d3f/d6d/db1/f125 x:0 0 0 2024-04-06T12:24:12.051 INFO:tasks.workunit.client.0.smithi152.stdout:4/998: creat d7/d16/f148 x:0 0 0 2024-04-06T12:24:12.054 INFO:tasks.workunit.client.0.smithi152.stdout:7/896: symlink d8/df/d28/d87/l12e 0 2024-04-06T12:24:12.058 INFO:tasks.workunit.client.0.smithi152.stdout:1/912: mkdir d2/d61/d8f/d10c/d131 0 2024-04-06T12:24:12.059 INFO:tasks.workunit.client.0.smithi152.stdout:1/913: write d2/d1d/f2d [2891684,106045] 0 2024-04-06T12:24:12.060 INFO:tasks.workunit.client.0.smithi152.stdout:5/898: creat d3/de/d8e/f126 x:0 0 0 2024-04-06T12:24:12.062 INFO:tasks.workunit.client.0.smithi152.stdout:6/994: rename d7/d19/d3e/d70/c8c to d7/d19/c145 0 2024-04-06T12:24:12.064 INFO:tasks.workunit.client.0.smithi152.stdout:4/999: rmdir d7/d29/d2e/d7b 39 2024-04-06T12:24:12.065 INFO:tasks.workunit.client.0.smithi152.stdout:2/926: getdents d0/dae 0 2024-04-06T12:24:12.066 INFO:tasks.workunit.client.0.smithi152.stdout:2/927: fsync d0/fd 0 2024-04-06T12:24:12.071 INFO:tasks.workunit.client.0.smithi152.stdout:1/914: mknod d2/d2f/d12d/c132 0 2024-04-06T12:24:12.072 INFO:tasks.workunit.client.0.smithi152.stdout:5/899: read d3/da/d15/d2b/d3f/d6d/ffd [342688,8965] 0 2024-04-06T12:24:12.073 INFO:tasks.workunit.client.0.smithi152.stdout:5/900: dread - d3/da/ff4 zero size 2024-04-06T12:24:12.075 INFO:tasks.workunit.client.0.smithi152.stdout:9/855: getdents d5/d39/d79 0 2024-04-06T12:24:12.076 INFO:tasks.workunit.client.0.smithi152.stdout:9/856: chown d5/d6/d74/d17/d23/d2d/d32/db1/fdc 29 1 2024-04-06T12:24:12.077 INFO:tasks.workunit.client.0.smithi152.stdout:9/857: readlink d5/d6/d74/d17/d23/d2d/d4b/l104 0 2024-04-06T12:24:12.079 INFO:tasks.workunit.client.0.smithi152.stdout:2/928: creat d0/d15/d24/d3d/de3/db2/f12c x:0 0 0 2024-04-06T12:24:12.080 INFO:tasks.workunit.client.0.smithi152.stdout:2/929: dread - d0/dae/ff0 zero size 2024-04-06T12:24:12.086 INFO:tasks.workunit.client.0.smithi152.stdout:5/901: symlink d3/da/d15/d40/d4f/l127 0 2024-04-06T12:24:12.091 INFO:tasks.workunit.client.0.smithi152.stdout:6/995: truncate d7/d9/d26/d2e/f13d 132441 0 2024-04-06T12:24:12.092 INFO:tasks.workunit.client.0.smithi152.stdout:1/915: dread d2/d2f/d12d/fd2 [0,4194304] 0 2024-04-06T12:24:12.095 INFO:tasks.workunit.client.0.smithi152.stdout:7/897: rename d8/df/d28/d41/dd4/d79/d109/ce6 to d8/c12f 0 2024-04-06T12:24:12.102 INFO:tasks.workunit.client.0.smithi152.stdout:9/858: unlink d5/d6/d74/d17/d23/c20 0 2024-04-06T12:24:12.103 INFO:tasks.workunit.client.0.smithi152.stdout:1/916: rename d2/d2f/d12d/dc5/dad/d8c to d2/d61/d8f/d10c/d133 0 2024-04-06T12:24:12.104 INFO:tasks.workunit.client.0.smithi152.stdout:9/859: dread - d5/d39/d79/daa/fb2 zero size 2024-04-06T12:24:12.106 INFO:tasks.workunit.client.0.smithi152.stdout:9/860: truncate d5/d6/d74/d17/fda 496594 0 2024-04-06T12:24:12.107 INFO:tasks.workunit.client.0.smithi152.stdout:9/861: dread - d5/d6/dde/fe2 zero size 2024-04-06T12:24:12.109 INFO:tasks.workunit.client.0.smithi152.stdout:5/902: symlink d3/da/d15/l128 0 2024-04-06T12:24:12.111 INFO:tasks.workunit.client.0.smithi152.stdout:7/898: symlink d8/df/d61/l130 0 2024-04-06T12:24:12.114 INFO:tasks.workunit.client.0.smithi152.stdout:6/996: creat d7/d19/d1b/d31/d7c/f146 x:0 0 0 2024-04-06T12:24:12.115 INFO:tasks.workunit.client.0.smithi152.stdout:2/930: rename d0/cea to d0/c12d 0 2024-04-06T12:24:12.124 INFO:tasks.workunit.client.0.smithi152.stdout:1/917: mknod d2/d2f/d54/c134 0 2024-04-06T12:24:12.126 INFO:tasks.workunit.client.0.smithi152.stdout:9/862: dread d5/f1d [4194304,4194304] 0 2024-04-06T12:24:12.126 INFO:tasks.workunit.client.0.smithi152.stdout:5/903: dread d3/f1f [0,4194304] 0 2024-04-06T12:24:12.129 INFO:tasks.workunit.client.0.smithi152.stdout:9/863: chown d5/d6/la 450362001 1 2024-04-06T12:24:12.129 INFO:tasks.workunit.client.0.smithi152.stdout:2/931: fdatasync d0/d15/d24/d3d/de3/fca 0 2024-04-06T12:24:12.130 INFO:tasks.workunit.client.0.smithi152.stdout:9/864: stat d5/d6/d74/dd9 0 2024-04-06T12:24:12.131 INFO:tasks.workunit.client.0.smithi152.stdout:2/932: chown d0/d15/d24/d3d/f2e 916302633 1 2024-04-06T12:24:12.139 INFO:tasks.workunit.client.0.smithi152.stdout:7/899: truncate d8/df/d28/d41/dd4/d49/f113 460306 0 2024-04-06T12:24:12.143 INFO:tasks.workunit.client.0.smithi152.stdout:1/918: write d2/d5d/ddf/ff3 [2168204,78868] 0 2024-04-06T12:24:12.143 INFO:tasks.workunit.client.0.smithi152.stdout:9/865: creat d5/d6/d74/d17/d23/d2d/d98/d99/f11a x:0 0 0 2024-04-06T12:24:12.150 INFO:tasks.workunit.client.0.smithi152.stdout:6/997: dwrite d7/d9/d26/d2e/f13d [0,4194304] 0 2024-04-06T12:24:12.158 INFO:tasks.workunit.client.0.smithi152.stdout:7/900: mknod d8/df/d28/d75/dea/c131 0 2024-04-06T12:24:12.160 INFO:tasks.workunit.client.0.smithi152.stdout:2/933: truncate d0/d15/d24/d3d/de3/f4e 1514556 0 2024-04-06T12:24:12.161 INFO:tasks.workunit.client.0.smithi152.stdout:9/866: symlink d5/d6/d74/d17/d23/d119/l11b 0 2024-04-06T12:24:12.168 INFO:tasks.workunit.client.0.smithi152.stdout:9/867: fsync d5/d6/f49 0 2024-04-06T12:24:12.168 INFO:tasks.workunit.client.0.smithi152.stdout:1/919: write d2/f50 [922502,96453] 0 2024-04-06T12:24:12.174 INFO:tasks.workunit.client.0.smithi152.stdout:9/868: mknod d5/d6/d74/d17/d23/d2d/d112/c11c 0 2024-04-06T12:24:12.175 INFO:tasks.workunit.client.0.smithi152.stdout:9/869: fsync d5/d6/dfa/db6/fcd 0 2024-04-06T12:24:12.175 INFO:tasks.workunit.client.0.smithi152.stdout:7/901: write d8/df/d34/d5c/f82 [275884,32560] 0 2024-04-06T12:24:12.186 INFO:tasks.workunit.client.0.smithi152.stdout:1/920: dread d2/d2f/d54/d88/da4/fde [0,4194304] 0 2024-04-06T12:24:12.186 INFO:tasks.workunit.client.0.smithi152.stdout:6/998: dread d7/d62/f92 [0,4194304] 0 2024-04-06T12:24:12.187 INFO:tasks.workunit.client.0.smithi152.stdout:2/934: dwrite d0/d15/d24/f8e [0,4194304] 0 2024-04-06T12:24:12.189 INFO:tasks.workunit.client.0.smithi152.stdout:9/870: dwrite d5/d6/d74/d17/d23/d2d/f56 [0,4194304] 0 2024-04-06T12:24:12.191 INFO:tasks.workunit.client.0.smithi152.stdout:7/902: dread d8/df/d61/d3d/dac/fe5 [4194304,4194304] 0 2024-04-06T12:24:12.195 INFO:tasks.workunit.client.0.smithi152.stdout:2/935: mkdir d0/d2/d6f/d12e 0 2024-04-06T12:24:12.204 INFO:tasks.workunit.client.0.smithi152.stdout:6/999: getdents d7/d9/d26/dd6/d101/d112/d144 0 2024-04-06T12:24:12.207 INFO:tasks.workunit.client.0.smithi152.stdout:1/921: dwrite d2/d61/f11b [0,4194304] 0 2024-04-06T12:24:12.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:09.910517+0000 mgr.smithi195.ausetj (mgr.24375) 93 : audit [DBG] from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:12.290 INFO:tasks.workunit.client.0.smithi152.stdout:2/936: getdents d0/d15/d24/d79 0 2024-04-06T12:24:12.291 INFO:tasks.workunit.client.0.smithi152.stdout:7/903: write d8/df/f5e [4194405,52348] 0 2024-04-06T12:24:12.291 INFO:tasks.workunit.client.0.smithi152.stdout:9/871: dwrite d5/d6/d74/d17/d23/fd0 [0,4194304] 0 2024-04-06T12:24:12.294 INFO:tasks.workunit.client.0.smithi152.stdout:9/872: write d5/d39/d79/daa/fb2 [411978,34422] 0 2024-04-06T12:24:12.295 INFO:tasks.workunit.client.0.smithi152.stdout:7/904: readlink d8/df/d28/d41/dd4/d8c/d2d/da3/de4/l103 0 2024-04-06T12:24:12.296 INFO:tasks.workunit.client.0.smithi152.stdout:1/922: write d2/db2/ff1 [669719,3970] 0 2024-04-06T12:24:12.298 INFO:tasks.workunit.client.0.smithi152.stdout:7/905: dread - d8/df/d28/d41/dd4/d8c/d2d/da3/f12a zero size 2024-04-06T12:24:12.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:09.910517+0000 mgr.smithi195.ausetj (mgr.24375) 93 : audit [DBG] from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:12.304 INFO:tasks.workunit.client.0.smithi152.stdout:7/906: truncate d8/df/d28/d41/dd4/d43/fda 684429 0 2024-04-06T12:24:12.305 INFO:tasks.workunit.client.0.smithi152.stdout:1/923: dwrite d2/f42 [0,4194304] 0 2024-04-06T12:24:12.307 INFO:tasks.workunit.client.0.smithi152.stdout:7/907: chown d8/df/d61/d3d/fd1 1032072738 1 2024-04-06T12:24:12.308 INFO:tasks.workunit.client.0.smithi152.stdout:7/908: readlink d8/l4f 0 2024-04-06T12:24:12.313 INFO:tasks.workunit.client.0.smithi152.stdout:1/924: mkdir d2/d2f/d12d/dc5/d10e/d135 0 2024-04-06T12:24:12.318 INFO:tasks.workunit.client.0.smithi152.stdout:7/909: dwrite d8/df/d28/d41/dd4/d8c/d2d/da3/f12a [0,4194304] 0 2024-04-06T12:24:12.319 INFO:tasks.workunit.client.0.smithi152.stdout:9/873: dread d5/d39/d79/f7f [0,4194304] 0 2024-04-06T12:24:12.321 INFO:tasks.workunit.client.0.smithi152.stdout:1/925: creat d2/d2f/daf/f136 x:0 0 0 2024-04-06T12:24:12.326 INFO:tasks.workunit.client.0.smithi152.stdout:1/926: chown d2/d2f/d54/d88/f40 0 1 2024-04-06T12:24:12.327 INFO:tasks.workunit.client.0.smithi152.stdout:7/910: symlink d8/df/d61/d4b/dcd/l132 0 2024-04-06T12:24:12.327 INFO:tasks.workunit.client.0.smithi152.stdout:1/927: chown d2/d2f/d12d/dc5/dad/f30 6637221 1 2024-04-06T12:24:12.328 INFO:tasks.workunit.client.0.smithi152.stdout:7/911: fdatasync d8/df/d61/d4b/f119 0 2024-04-06T12:24:12.329 INFO:tasks.workunit.client.0.smithi152.stdout:1/928: chown d2/f76 7 1 2024-04-06T12:24:12.330 INFO:tasks.workunit.client.0.smithi152.stdout:7/912: chown d8/df/d28/d41/dd4/d8c/f120 12478677 1 2024-04-06T12:24:12.331 INFO:tasks.workunit.client.0.smithi152.stdout:1/929: rmdir d2/d1d/d7c 39 2024-04-06T12:24:12.333 INFO:tasks.workunit.client.0.smithi152.stdout:7/913: rename d8/df/d34/lb2 to d8/df/d61/d3d/d6e/l133 0 2024-04-06T12:24:12.335 INFO:tasks.workunit.client.0.smithi152.stdout:1/930: dread d2/d1d/f67 [0,4194304] 0 2024-04-06T12:24:12.342 INFO:tasks.workunit.client.0.smithi152.stdout:9/874: write d5/d6/dfa/fc0 [1338560,21660] 0 2024-04-06T12:24:12.342 INFO:tasks.workunit.client.0.smithi152.stdout:7/914: dread d8/df/d28/d41/dd4/d8c/d2d/f32 [0,4194304] 0 2024-04-06T12:24:12.347 INFO:tasks.workunit.client.0.smithi152.stdout:7/915: read d8/df/d28/d41/dd4/d43/d8a/f116 [269275,120141] 0 2024-04-06T12:24:12.351 INFO:tasks.workunit.client.0.smithi152.stdout:9/875: dwrite d5/d6/d74/d17/d23/d2d/d32/f117 [0,4194304] 0 2024-04-06T12:24:12.353 INFO:tasks.workunit.client.0.smithi152.stdout:1/931: dwrite d2/f58 [0,4194304] 0 2024-04-06T12:24:12.357 INFO:tasks.workunit.client.0.smithi152.stdout:7/916: getdents d8 0 2024-04-06T12:24:12.358 INFO:tasks.workunit.client.0.smithi152.stdout:7/917: chown d8/df/d61/fa6 15 1 2024-04-06T12:24:12.360 INFO:tasks.workunit.client.0.smithi152.stdout:1/932: unlink d2/d5d/d6d/lfb 0 2024-04-06T12:24:12.362 INFO:tasks.workunit.client.0.smithi152.stdout:7/918: read d8/df/d61/d76/fc6 [367711,38812] 0 2024-04-06T12:24:12.364 INFO:tasks.workunit.client.0.smithi152.stdout:9/876: rename d5/d39/d79/c88 to d5/d6/d74/d17/d23/d2d/d32/c11d 0 2024-04-06T12:24:12.367 INFO:tasks.workunit.client.0.smithi152.stdout:7/919: mkdir d8/df/d28/d41/dd4/d8c/d134 0 2024-04-06T12:24:12.369 INFO:tasks.workunit.client.0.smithi152.stdout:1/933: read d2/f7 [2479658,25547] 0 2024-04-06T12:24:12.373 INFO:tasks.workunit.client.0.smithi152.stdout:1/934: chown d2/d1d/d7c/cc0 1122 1 2024-04-06T12:24:12.377 INFO:tasks.workunit.client.0.smithi152.stdout:7/920: link d8/df/d61/d4b/d56/db8/f105 d8/df/d28/d41/dd4/d79/f135 0 2024-04-06T12:24:12.379 INFO:tasks.workunit.client.0.smithi152.stdout:1/935: dwrite d2/fb6 [4194304,4194304] 0 2024-04-06T12:24:12.382 INFO:tasks.workunit.client.0.smithi152.stdout:7/921: read d8/df/d28/d41/dd4/d43/d8a/f116 [55775,42462] 0 2024-04-06T12:24:12.386 INFO:tasks.workunit.client.0.smithi152.stdout:9/877: dwrite d5/d6/f95 [0,4194304] 0 2024-04-06T12:24:12.388 INFO:tasks.workunit.client.0.smithi152.stdout:7/922: truncate d8/df/d28/d75/de8/ffc 595619 0 2024-04-06T12:24:12.389 INFO:tasks.workunit.client.0.smithi152.stdout:1/936: dread d2/d2f/daf/fc8 [0,4194304] 0 2024-04-06T12:24:12.390 INFO:tasks.workunit.client.0.smithi152.stdout:1/937: fsync d2/d2f/d54/d88/da4/fde 0 2024-04-06T12:24:12.392 INFO:tasks.workunit.client.0.smithi152.stdout:7/923: rmdir d8/df/d61/d6d 39 2024-04-06T12:24:12.396 INFO:tasks.workunit.client.0.smithi152.stdout:9/878: read d5/d6/d74/d17/d23/d2d/d32/d36/f9d [2844486,103381] 0 2024-04-06T12:24:12.399 INFO:tasks.workunit.client.0.smithi152.stdout:7/924: dread - d8/df/d61/d6d/f112 zero size 2024-04-06T12:24:12.400 INFO:tasks.workunit.client.0.smithi152.stdout:1/938: write d2/d2f/d54/d88/f40 [2079911,45264] 0 2024-04-06T12:24:12.401 INFO:tasks.workunit.client.0.smithi152.stdout:9/879: symlink d5/d6/d74/d17/d23/d2d/d32/dbb/l11e 0 2024-04-06T12:24:12.404 INFO:tasks.workunit.client.0.smithi152.stdout:7/925: dread - d8/df/d28/d41/dd4/d79/d109/ff5 zero size 2024-04-06T12:24:12.407 INFO:tasks.workunit.client.0.smithi152.stdout:1/939: creat d2/d2f/d12d/dc5/dd0/f137 x:0 0 0 2024-04-06T12:24:12.409 INFO:tasks.workunit.client.0.smithi152.stdout:7/926: fdatasync d8/df/d34/f67 0 2024-04-06T12:24:12.410 INFO:tasks.workunit.client.0.smithi152.stdout:9/880: symlink d5/d39/d79/daa/l11f 0 2024-04-06T12:24:12.411 INFO:tasks.workunit.client.0.smithi152.stdout:7/927: readlink d8/df/d28/d41/dd4/d8c/d2d/da3/de4/l103 0 2024-04-06T12:24:12.412 INFO:tasks.workunit.client.0.smithi152.stdout:7/928: chown d8/df/d28/d41/dd4/d79/fba 0 1 2024-04-06T12:24:12.413 INFO:tasks.workunit.client.0.smithi152.stdout:1/940: rename d2/d2f/d45 to d2/d61/d8f/d10c/d138 0 2024-04-06T12:24:12.413 INFO:tasks.workunit.client.0.smithi152.stdout:7/929: chown d8/df/d28/d41/dd4/d8c/daf/cb4 3244195 1 2024-04-06T12:24:12.414 INFO:tasks.workunit.client.0.smithi152.stdout:1/941: write d2/fb6 [823177,98138] 0 2024-04-06T12:24:12.415 INFO:tasks.workunit.client.0.smithi152.stdout:9/881: stat d5/d6/d74/d17/d23/d2d/d98/c9a 0 2024-04-06T12:24:12.417 INFO:tasks.workunit.client.0.smithi152.stdout:9/882: write d5/d6/d74/d17/d23/d2d/d98/d99/f11a [1019879,81659] 0 2024-04-06T12:24:12.419 INFO:tasks.workunit.client.0.smithi152.stdout:1/942: symlink d2/d2f/d54/d88/da4/l139 0 2024-04-06T12:24:12.419 INFO:tasks.workunit.client.0.smithi152.stdout:7/930: write d8/df/d34/d5c/ff9 [11102430,73162] 0 2024-04-06T12:24:12.425 INFO:tasks.workunit.client.0.smithi152.stdout:9/883: dread d5/d6/d74/d17/d23/d2d/d32/db1/fdc [0,4194304] 0 2024-04-06T12:24:12.427 INFO:tasks.workunit.client.0.smithi152.stdout:7/931: dwrite d8/df/d34/f107 [0,4194304] 0 2024-04-06T12:24:12.428 INFO:tasks.workunit.client.0.smithi152.stdout:1/943: mkdir d2/d61/d8f/d10c/d138/d13a 0 2024-04-06T12:24:12.429 INFO:tasks.workunit.client.0.smithi152.stdout:7/932: stat d8/df/d34/ff1 0 2024-04-06T12:24:12.429 INFO:tasks.workunit.client.0.smithi152.stdout:1/944: stat d2/d2f/d37/l12e 0 2024-04-06T12:24:12.429 INFO:tasks.workunit.client.0.smithi152.stdout:7/933: readlink d8/df/d61/l130 0 2024-04-06T12:24:12.431 INFO:tasks.workunit.client.0.smithi152.stdout:7/934: chown d8/df/d28/d41/dd4/d8c/daf/fb3 118435414 1 2024-04-06T12:24:12.432 INFO:tasks.workunit.client.0.smithi152.stdout:9/884: mkdir d5/d6/d74/d17/d23/d119/d120 0 2024-04-06T12:24:12.433 INFO:tasks.workunit.client.0.smithi152.stdout:7/935: write d8/df/d28/d41/dd4/d8c/d2d/da3/fc8 [2017151,79522] 0 2024-04-06T12:24:12.433 INFO:tasks.workunit.client.0.smithi152.stdout:9/885: fdatasync d5/d6/f95 0 2024-04-06T12:24:12.436 INFO:tasks.workunit.client.0.smithi152.stdout:7/936: write d8/df/d28/d41/dd4/d8c/d2d/da3/fc8 [4485255,131024] 0 2024-04-06T12:24:12.436 INFO:tasks.workunit.client.0.smithi152.stdout:9/886: dread - d5/d6/d74/fb4 zero size 2024-04-06T12:24:12.446 INFO:tasks.workunit.client.0.smithi152.stdout:7/937: write d8/df/d28/d41/fa4 [790516,3063] 0 2024-04-06T12:24:12.449 INFO:tasks.workunit.client.0.smithi152.stdout:1/945: dwrite d2/d2f/daf/de2/fe8 [0,4194304] 0 2024-04-06T12:24:12.457 INFO:tasks.workunit.client.0.smithi152.stdout:7/938: rmdir d8/df/d28/d41/dd4/d79/dff 0 2024-04-06T12:24:12.459 INFO:tasks.workunit.client.0.smithi152.stdout:1/946: dwrite d2/d5d/f128 [0,4194304] 0 2024-04-06T12:24:12.463 INFO:tasks.workunit.client.0.smithi152.stdout:1/947: mknod d2/d61/d8f/d10c/d133/c13b 0 2024-04-06T12:24:12.464 INFO:tasks.workunit.client.0.smithi152.stdout:1/948: dread d2/f76 [0,4194304] 0 2024-04-06T12:24:12.467 INFO:tasks.workunit.client.0.smithi152.stdout:1/949: creat d2/d61/d8f/d10c/d131/f13c x:0 0 0 2024-04-06T12:24:12.483 INFO:tasks.workunit.client.0.smithi152.stdout:7/939: dwrite d8/d2a/d42/f4c [0,4194304] 0 2024-04-06T12:24:12.491 INFO:tasks.workunit.client.0.smithi152.stdout:7/940: rename d8/df/d34 to d8/df/d61/d4b/dcd/d136 0 2024-04-06T12:24:12.491 INFO:tasks.workunit.client.0.smithi152.stdout:1/950: dread d2/d2f/d12d/dc5/fc1 [4194304,4194304] 0 2024-04-06T12:24:12.497 INFO:tasks.workunit.client.0.smithi152.stdout:1/951: dwrite d2/d1d/d7c/f9e [0,4194304] 0 2024-04-06T12:24:12.499 INFO:tasks.workunit.client.0.smithi152.stdout:1/952: truncate d2/d2f/d54/d88/da4/ffd 4962434 0 2024-04-06T12:24:12.500 INFO:tasks.workunit.client.0.smithi152.stdout:1/953: chown d2/d2f/d12d/db3/dd3/f12a 898511 1 2024-04-06T12:24:12.504 INFO:tasks.workunit.client.0.smithi152.stdout:1/954: truncate d2/d5d/d6d/ff9 487148 0 2024-04-06T12:24:12.504 INFO:tasks.workunit.client.0.smithi152.stdout:7/941: chown d8/df/d28/d41/dd4/d8c/d2d/da3/de4/ddc 131934193 1 2024-04-06T12:24:12.506 INFO:tasks.workunit.client.0.smithi152.stdout:7/942: chown d8/df/d28/d41/dd4/d43/d8a/d9d/dc9/dd0/d11e 1 1 2024-04-06T12:24:12.507 INFO:tasks.workunit.client.0.smithi152.stdout:1/955: rename d2/d2f/d54/d88/f34 to d2/d2f/d37/f13d 0 2024-04-06T12:24:12.510 INFO:tasks.workunit.client.0.smithi152.stdout:7/943: creat d8/d2a/f137 x:0 0 0 2024-04-06T12:24:12.512 INFO:tasks.workunit.client.0.smithi152.stdout:1/956: mkdir d2/d13e 0 2024-04-06T12:24:12.514 INFO:tasks.workunit.client.0.smithi152.stdout:7/944: write d8/df/f5e [1073093,48293] 0 2024-04-06T12:24:12.515 INFO:tasks.workunit.client.0.smithi152.stdout:7/945: chown d8/df/d28/d41/dd4/d79 44494 1 2024-04-06T12:24:12.520 INFO:tasks.workunit.client.0.smithi152.stdout:1/957: dwrite d2/d1d/fb1 [0,4194304] 0 2024-04-06T12:24:12.524 INFO:tasks.workunit.client.0.smithi152.stdout:1/958: symlink d2/d1d/d3b/l13f 0 2024-04-06T12:24:12.526 INFO:tasks.workunit.client.0.smithi152.stdout:1/959: unlink d2/d1d/d7c/f93 0 2024-04-06T12:24:12.534 INFO:tasks.workunit.client.0.smithi152.stdout:1/960: rename d2/d2f/d37/f5f to d2/d2f/d12d/dc5/dad/f140 0 2024-04-06T12:24:12.535 INFO:tasks.workunit.client.0.smithi152.stdout:7/946: dread d8/f16 [0,4194304] 0 2024-04-06T12:24:12.541 INFO:tasks.workunit.client.0.smithi152.stdout:7/947: rename d8/df/d28/d41/dd4/d8c/d2d/d7a/lf0 to d8/df/d61/d76/d7e/de3/l138 0 2024-04-06T12:24:12.542 INFO:tasks.workunit.client.0.smithi152.stdout:1/961: getdents d2/d5d 0 2024-04-06T12:24:12.547 INFO:tasks.workunit.client.0.smithi152.stdout:7/948: symlink d8/df/d61/d76/d106/df6/l139 0 2024-04-06T12:24:12.548 INFO:tasks.workunit.client.0.smithi152.stdout:1/962: mkdir d2/d1d/d3b/d141 0 2024-04-06T12:24:12.554 INFO:tasks.workunit.client.0.smithi152.stdout:7/949: dwrite d8/df/d61/f115 [0,4194304] 0 2024-04-06T12:24:12.555 INFO:tasks.workunit.client.0.smithi152.stdout:7/950: stat d8/df/d28/d75/de8/f110 0 2024-04-06T12:24:12.557 INFO:tasks.workunit.client.0.smithi152.stdout:1/963: write d2/d2f/f32 [2922692,115722] 0 2024-04-06T12:24:12.558 INFO:tasks.workunit.client.0.smithi152.stdout:1/964: readlink d2/d61/d8f/lcd 0 2024-04-06T12:24:12.559 INFO:tasks.workunit.client.0.smithi152.stdout:1/965: chown d2/d2f/d37/l12e 149383 1 2024-04-06T12:24:12.560 INFO:tasks.workunit.client.0.smithi152.stdout:7/951: fsync d8/df/f25 0 2024-04-06T12:24:12.561 INFO:tasks.workunit.client.0.smithi152.stdout:1/966: readlink d2/d2f/d54/d88/da4/led 0 2024-04-06T12:24:12.565 INFO:tasks.workunit.client.0.smithi152.stdout:1/967: unlink d2/d1d/fb1 0 2024-04-06T12:24:12.565 INFO:tasks.workunit.client.0.smithi152.stdout:1/968: fdatasync d2/d1d/d7c/f9e 0 2024-04-06T12:24:12.566 INFO:tasks.workunit.client.0.smithi152.stdout:5/904: sync 2024-04-06T12:24:12.567 INFO:tasks.workunit.client.0.smithi152.stdout:1/969: read - d2/d61/d8f/d10c/d133/d10a/f127 zero size 2024-04-06T12:24:12.569 INFO:tasks.workunit.client.0.smithi152.stdout:7/952: creat d8/df/d61/d98/f13a x:0 0 0 2024-04-06T12:24:12.572 INFO:tasks.workunit.client.0.smithi152.stdout:1/970: rename d2/f13 to d2/d1d/d3b/d130/f142 0 2024-04-06T12:24:12.575 INFO:tasks.workunit.client.0.smithi152.stdout:5/905: getdents d3/da/d15/d2b/dbd 0 2024-04-06T12:24:12.585 INFO:tasks.workunit.client.0.smithi152.stdout:1/971: dread d2/d5d/f96 [0,4194304] 0 2024-04-06T12:24:12.592 INFO:tasks.workunit.client.0.smithi152.stdout:1/972: dwrite d2/d2f/d12d/db3/dd3/f12a [0,4194304] 0 2024-04-06T12:24:12.594 INFO:tasks.workunit.client.0.smithi152.stdout:1/973: rmdir d2/d1d 39 2024-04-06T12:24:12.598 INFO:tasks.workunit.client.0.smithi152.stdout:1/974: truncate d2/d2f/d54/d88/fd1 465060 0 2024-04-06T12:24:12.661 INFO:tasks.workunit.client.0.smithi152.stdout:2/937: sync 2024-04-06T12:24:12.663 INFO:tasks.workunit.client.0.smithi152.stdout:2/938: rmdir d0/d15/d24/d3d 39 2024-04-06T12:24:12.669 INFO:tasks.workunit.client.0.smithi152.stdout:2/939: write d0/d2/d6f/d90/d9e/db5/fbf [372343,59491] 0 2024-04-06T12:24:12.670 INFO:tasks.workunit.client.0.smithi152.stdout:2/940: chown d0/d40/d26/f83 967 1 2024-04-06T12:24:12.672 INFO:tasks.workunit.client.0.smithi152.stdout:2/941: write d0/d40/d41/f113 [234763,71009] 0 2024-04-06T12:24:12.678 INFO:tasks.workunit.client.0.smithi152.stdout:2/942: dwrite d0/d2/d6f/d90/d9e/db5/d92/fd6 [0,4194304] 0 2024-04-06T12:24:12.684 INFO:tasks.workunit.client.0.smithi152.stdout:2/943: stat d0/d15/d24/d3d/de3/f76 0 2024-04-06T12:24:12.687 INFO:tasks.workunit.client.0.smithi152.stdout:2/944: creat d0/d15/d24/d79/d80/dce/f12f x:0 0 0 2024-04-06T12:24:12.689 INFO:tasks.workunit.client.0.smithi152.stdout:2/945: symlink d0/d40/d41/d63/l130 0 2024-04-06T12:24:12.690 INFO:tasks.workunit.client.0.smithi152.stdout:2/946: chown d0/d40/d41/d28/d54 1236204 1 2024-04-06T12:24:12.708 INFO:tasks.workunit.client.0.smithi152.stdout:2/947: write d0/d15/d24/f36 [4622586,77590] 0 2024-04-06T12:24:12.710 INFO:tasks.workunit.client.0.smithi152.stdout:2/948: symlink d0/d15/d24/d79/d80/dce/l131 0 2024-04-06T12:24:12.713 INFO:tasks.workunit.client.0.smithi152.stdout:2/949: fsync d0/d15/d24/d3d/de3/db2/fac 0 2024-04-06T12:24:12.716 INFO:tasks.workunit.client.0.smithi152.stdout:2/950: mknod d0/d15/d24/d3d/c132 0 2024-04-06T12:24:12.719 INFO:tasks.workunit.client.0.smithi152.stdout:2/951: unlink d0/d40/d41/d28/l11f 0 2024-04-06T12:24:12.722 INFO:tasks.workunit.client.0.smithi152.stdout:2/952: creat d0/dc9/de9/d106/d10a/f133 x:0 0 0 2024-04-06T12:24:12.724 INFO:tasks.workunit.client.0.smithi152.stdout:2/953: truncate d0/d40/d26/f2b 3030984 0 2024-04-06T12:24:12.727 INFO:tasks.workunit.client.0.smithi152.stdout:2/954: chown d0/d40/d41/d63/cfb 1 1 2024-04-06T12:24:12.754 INFO:tasks.workunit.client.0.smithi152.stdout:2/955: dwrite d0/d40/d41/d28/d54/f7c [4194304,4194304] 0 2024-04-06T12:24:12.830 INFO:tasks.workunit.client.0.smithi152.stdout:2/956: dwrite d0/d2/d6f/d90/fa5 [0,4194304] 0 2024-04-06T12:24:12.834 INFO:tasks.workunit.client.0.smithi152.stdout:2/957: fdatasync d0/dc9/de9/d106/d10a/f11a 0 2024-04-06T12:24:12.836 INFO:tasks.workunit.client.0.smithi152.stdout:2/958: dread - d0/d40/d41/d28/d54/f7e zero size 2024-04-06T12:24:12.844 INFO:tasks.workunit.client.0.smithi152.stdout:2/959: dwrite d0/d2/d6f/d90/fa6 [0,4194304] 0 2024-04-06T12:24:12.852 INFO:tasks.workunit.client.0.smithi152.stdout:2/960: dwrite d0/d2/d6f/f77 [0,4194304] 0 2024-04-06T12:24:12.858 INFO:tasks.workunit.client.0.smithi152.stdout:2/961: rename d0/d40/d41/d28/d8c/fed to d0/d40/d41/d28/f134 0 2024-04-06T12:24:12.860 INFO:tasks.workunit.client.0.smithi152.stdout:2/962: rmdir d0/dc9/de9/d106/d10a 39 2024-04-06T12:24:12.863 INFO:tasks.workunit.client.0.smithi152.stdout:2/963: creat d0/dae/f135 x:0 0 0 2024-04-06T12:24:12.865 INFO:tasks.workunit.client.0.smithi152.stdout:2/964: creat d0/d2/d6f/d90/d9e/f136 x:0 0 0 2024-04-06T12:24:12.998 INFO:tasks.workunit.client.0.smithi152.stdout:7/953: sync 2024-04-06T12:24:12.998 INFO:tasks.workunit.client.0.smithi152.stdout:5/906: sync 2024-04-06T12:24:12.998 INFO:tasks.workunit.client.0.smithi152.stdout:9/887: sync 2024-04-06T12:24:12.998 INFO:tasks.workunit.client.0.smithi152.stdout:1/975: sync 2024-04-06T12:24:13.002 INFO:tasks.workunit.client.0.smithi152.stdout:9/888: fdatasync d5/d6/d74/d17/f84 0 2024-04-06T12:24:13.005 INFO:tasks.workunit.client.0.smithi152.stdout:5/907: rename d3/da/d15/d40/d92/f78 to d3/da/d15/d2b/d3f/d6d/dc6/dd9/f129 0 2024-04-06T12:24:13.007 INFO:tasks.workunit.client.0.smithi152.stdout:7/954: mkdir d8/df/d61/d76/dad/d13b 0 2024-04-06T12:24:13.009 INFO:tasks.workunit.client.0.smithi152.stdout:9/889: rmdir d5/d6/d74/d17/d23/d119 39 2024-04-06T12:24:13.011 INFO:tasks.workunit.client.0.smithi152.stdout:1/976: dread d2/fb6 [0,4194304] 0 2024-04-06T12:24:13.013 INFO:tasks.workunit.client.0.smithi152.stdout:5/908: symlink d3/da/d15/d40/d4f/d9f/l12a 0 2024-04-06T12:24:13.015 INFO:tasks.workunit.client.0.smithi152.stdout:5/909: chown d3/da/d15/d40/d50/l9d 3324814 1 2024-04-06T12:24:13.016 INFO:tasks.workunit.client.0.smithi152.stdout:9/890: creat d5/d6/d74/d17/d23/d2d/d98/f121 x:0 0 0 2024-04-06T12:24:13.019 INFO:tasks.workunit.client.0.smithi152.stdout:1/977: dwrite d2/d2f/daf/f136 [0,4194304] 0 2024-04-06T12:24:13.021 INFO:tasks.workunit.client.0.smithi152.stdout:5/910: mkdir d3/ddc/d12b 0 2024-04-06T12:24:13.024 INFO:tasks.workunit.client.0.smithi152.stdout:9/891: symlink d5/d6/l122 0 2024-04-06T12:24:13.025 INFO:tasks.workunit.client.0.smithi152.stdout:5/911: chown d3/da/d15/d2b/d3f/d6d/dd1/dd8/f108 100 1 2024-04-06T12:24:13.030 INFO:tasks.workunit.client.0.smithi152.stdout:1/978: rename d2/d5d/f128 to d2/d61/d8f/d10c/f143 0 2024-04-06T12:24:13.032 INFO:tasks.workunit.client.0.smithi152.stdout:9/892: fdatasync d5/d6/d74/d17/d37/f76 0 2024-04-06T12:24:13.041 INFO:tasks.workunit.client.0.smithi152.stdout:9/893: rename d5/d39/d3f/c54 to d5/d6/dde/c123 0 2024-04-06T12:24:13.044 INFO:tasks.workunit.client.0.smithi152.stdout:5/912: dread d3/da/d53/f62 [0,4194304] 0 2024-04-06T12:24:13.045 INFO:tasks.workunit.client.0.smithi152.stdout:1/979: rename d2/d1d/c41 to d2/db2/dbb/c144 0 2024-04-06T12:24:13.046 INFO:tasks.workunit.client.0.smithi152.stdout:5/913: fdatasync d3/da/d15/d2b/d3f/f43 0 2024-04-06T12:24:13.050 INFO:tasks.workunit.client.0.smithi152.stdout:5/914: creat d3/da/d15/d2b/d3f/d6d/db1/d114/f12c x:0 0 0 2024-04-06T12:24:13.057 INFO:tasks.workunit.client.0.smithi152.stdout:5/915: mkdir d3/da/d15/d40/d92/d100/d12d 0 2024-04-06T12:24:13.058 INFO:tasks.workunit.client.0.smithi152.stdout:9/894: getdents d5/d6/d74/d17/d23/d2d/d98/da4 0 2024-04-06T12:24:13.059 INFO:tasks.workunit.client.0.smithi152.stdout:9/895: dread - d5/d39/d79/daa/fae zero size 2024-04-06T12:24:13.061 INFO:tasks.workunit.client.0.smithi152.stdout:1/980: rename d2/d5d/d6d/ff9 to d2/d2f/d37/f145 0 2024-04-06T12:24:13.066 INFO:tasks.workunit.client.0.smithi152.stdout:5/916: write d3/de/da9/fe4 [543094,20118] 0 2024-04-06T12:24:13.069 INFO:tasks.workunit.client.0.smithi152.stdout:9/896: rename d5/d6/dfa/f48 to d5/f124 0 2024-04-06T12:24:13.071 INFO:tasks.workunit.client.0.smithi152.stdout:1/981: unlink d2/d5d/ddf/c112 0 2024-04-06T12:24:13.073 INFO:tasks.workunit.client.0.smithi152.stdout:5/917: truncate d3/da/d15/d2b/d3f/d68/d81/fef 271538 0 2024-04-06T12:24:13.073 INFO:tasks.workunit.client.0.smithi152.stdout:9/897: fsync d5/f10 0 2024-04-06T12:24:13.084 INFO:tasks.workunit.client.0.smithi152.stdout:5/918: write d3/da/d15/d2b/d3f/d68/d81/f45 [3229526,87403] 0 2024-04-06T12:24:13.086 INFO:tasks.workunit.client.0.smithi152.stdout:9/898: dread d5/d6/f49 [4194304,4194304] 0 2024-04-06T12:24:13.089 INFO:tasks.workunit.client.0.smithi152.stdout:1/982: dwrite d2/d2f/d12d/fd2 [4194304,4194304] 0 2024-04-06T12:24:13.091 INFO:tasks.workunit.client.0.smithi152.stdout:1/983: chown d2/d61/d8f/ce0 347495 1 2024-04-06T12:24:13.091 INFO:tasks.workunit.client.0.smithi152.stdout:9/899: rmdir d5/d6/d74/d17/d37 39 2024-04-06T12:24:13.096 INFO:tasks.workunit.client.0.smithi152.stdout:5/919: dwrite d3/da/d15/d2b/d3f/d4c/f8d [0,4194304] 0 2024-04-06T12:24:13.101 INFO:tasks.workunit.client.0.smithi152.stdout:1/984: link d2/f76 d2/d61/f146 0 2024-04-06T12:24:13.102 INFO:tasks.workunit.client.0.smithi152.stdout:1/985: chown d2/d2f/d54 30572 1 2024-04-06T12:24:13.104 INFO:tasks.workunit.client.0.smithi152.stdout:1/986: mknod d2/d61/d8f/d10c/d138/c147 0 2024-04-06T12:24:13.105 INFO:tasks.workunit.client.0.smithi152.stdout:1/987: write d2/d1d/f67 [317038,29821] 0 2024-04-06T12:24:13.106 INFO:tasks.workunit.client.0.smithi152.stdout:1/988: chown d2/d2f/d54/c70 17646967 1 2024-04-06T12:24:13.107 INFO:tasks.workunit.client.0.smithi152.stdout:9/900: write d5/d6/d74/d17/f19 [2413501,53129] 0 2024-04-06T12:24:13.110 INFO:tasks.workunit.client.0.smithi152.stdout:5/920: write d3/da/d15/de9/fcb [503118,53366] 0 2024-04-06T12:24:13.113 INFO:tasks.workunit.client.0.smithi152.stdout:1/989: unlink d2/d2f/d12d/dc5/dad/fcf 0 2024-04-06T12:24:13.114 INFO:tasks.workunit.client.0.smithi152.stdout:9/901: dread d5/d6/dfa/fc0 [0,4194304] 0 2024-04-06T12:24:13.115 INFO:tasks.workunit.client.0.smithi152.stdout:5/921: rmdir d3/da/d15/d2b/d3f/d6d/dd1/dd8 39 2024-04-06T12:24:13.116 INFO:tasks.workunit.client.0.smithi152.stdout:5/922: stat d3/da/d15/f21 0 2024-04-06T12:24:13.120 INFO:tasks.workunit.client.0.smithi152.stdout:9/902: read - d5/d6/d74/f97 zero size 2024-04-06T12:24:13.126 INFO:tasks.workunit.client.0.smithi152.stdout:5/923: dwrite d3/da/d15/d2b/d3f/d6d/db1/d114/f12c [0,4194304] 0 2024-04-06T12:24:13.132 INFO:tasks.workunit.client.0.smithi152.stdout:9/903: dwrite d5/d6/d74/d17/fda [0,4194304] 0 2024-04-06T12:24:13.133 INFO:tasks.workunit.client.0.smithi152.stdout:5/924: mkdir d3/da/d15/d2b/d3f/d6d/dc6/d12e 0 2024-04-06T12:24:13.134 INFO:tasks.workunit.client.0.smithi152.stdout:1/990: dread d2/d2f/d12d/dc5/dad/f4e [0,4194304] 0 2024-04-06T12:24:13.137 INFO:tasks.workunit.client.0.smithi152.stdout:9/904: mkdir d5/d6/d74/d17/d23/d2d/d32/db1/d125 0 2024-04-06T12:24:13.143 INFO:tasks.workunit.client.0.smithi152.stdout:1/991: creat d2/d2f/d12d/db3/dd3/f148 x:0 0 0 2024-04-06T12:24:13.144 INFO:tasks.workunit.client.0.smithi152.stdout:1/992: chown d2/d2f/d37/f101 0 1 2024-04-06T12:24:13.147 INFO:tasks.workunit.client.0.smithi152.stdout:1/993: mkdir d2/d1d/d3b/dc3/d9f/d149 0 2024-04-06T12:24:13.148 INFO:tasks.workunit.client.0.smithi152.stdout:1/994: write d2/d1d/d3b/dc3/d9f/f116 [1012179,41655] 0 2024-04-06T12:24:13.150 INFO:tasks.workunit.client.0.smithi152.stdout:1/995: read d2/d2f/d37/f13d [4089400,92419] 0 2024-04-06T12:24:13.152 INFO:tasks.workunit.client.0.smithi152.stdout:9/905: creat d5/d39/d3f/f126 x:0 0 0 2024-04-06T12:24:13.156 INFO:tasks.workunit.client.0.smithi152.stdout:5/925: dwrite d3/da/d15/d40/d50/d99/fca [0,4194304] 0 2024-04-06T12:24:13.158 INFO:tasks.workunit.client.0.smithi152.stdout:1/996: rename d2/d61/d8f/d10c/d138/c4d to d2/d2f/d12d/db3/dd3/c14a 0 2024-04-06T12:24:13.158 INFO:tasks.workunit.client.0.smithi152.stdout:9/906: fsync d5/d6/d74/d17/d86/f8e 0 2024-04-06T12:24:13.159 INFO:tasks.workunit.client.0.smithi152.stdout:1/997: chown d2/d2f/d54/f57 4173814 1 2024-04-06T12:24:13.160 INFO:tasks.workunit.client.0.smithi152.stdout:1/998: fdatasync d2/d1d/d3b/dc3/d9f/fb8 0 2024-04-06T12:24:13.161 INFO:tasks.workunit.client.0.smithi152.stdout:5/926: creat d3/da/d15/d40/d4f/f12f x:0 0 0 2024-04-06T12:24:13.162 INFO:tasks.workunit.client.0.smithi152.stdout:9/907: write d5/d6/f73 [1293143,11803] 0 2024-04-06T12:24:13.164 INFO:tasks.workunit.client.0.smithi152.stdout:9/908: chown d5/d6/d74/d17/fda 7703233 1 2024-04-06T12:24:13.166 INFO:tasks.workunit.client.0.smithi152.stdout:1/999: truncate d2/d2f/d37/dae/db5/fff 1219920 0 2024-04-06T12:24:13.167 INFO:tasks.workunit.client.0.smithi152.stdout:9/909: mknod d5/d6/d74/dd9/c127 0 2024-04-06T12:24:13.169 INFO:tasks.workunit.client.0.smithi152.stdout:9/910: chown d5/d6/d74/d17/d23/d2d/d4b/d10e 991709 1 2024-04-06T12:24:13.170 INFO:tasks.workunit.client.0.smithi152.stdout:5/927: rename d3/da/d15/d2b/d3f/d6d/c91 to d3/da/d15/d2b/d3f/d6d/dd1/da3/c130 0 2024-04-06T12:24:13.175 INFO:tasks.workunit.client.0.smithi152.stdout:5/928: rename d3/da/d15/d40/d50/f7e to d3/f131 0 2024-04-06T12:24:13.178 INFO:tasks.workunit.client.0.smithi152.stdout:5/929: mkdir d3/da/d15/d2b/d3f/d6d/dd1/da3/d132 0 2024-04-06T12:24:13.183 INFO:tasks.workunit.client.0.smithi152.stdout:5/930: creat d3/da/d15/d40/d92/d100/d12d/f133 x:0 0 0 2024-04-06T12:24:13.183 INFO:tasks.workunit.client.0.smithi152.stdout:9/911: dread d5/f124 [0,4194304] 0 2024-04-06T12:24:13.184 INFO:tasks.workunit.client.0.smithi152.stdout:9/912: readlink d5/d6/d74/d17/d23/d2d/d4b/l104 0 2024-04-06T12:24:13.185 INFO:tasks.workunit.client.0.smithi152.stdout:5/931: fdatasync d3/da/f13 0 2024-04-06T12:24:13.194 INFO:tasks.workunit.client.0.smithi152.stdout:5/932: dwrite d3/da/d15/d2b/d3f/d6d/f117 [0,4194304] 0 2024-04-06T12:24:13.195 INFO:tasks.workunit.client.0.smithi152.stdout:9/913: link d5/d6/d74/d17/d23/d2d/f51 d5/d6/d74/d17/d23/d2d/d32/f128 0 2024-04-06T12:24:13.195 INFO:tasks.workunit.client.0.smithi152.stdout:5/933: stat d3/de/d80/d8f/fae 0 2024-04-06T12:24:13.200 INFO:tasks.workunit.client.0.smithi152.stdout:9/914: write d5/d6/d74/d17/d23/d2d/f51 [1963784,112485] 0 2024-04-06T12:24:13.201 INFO:tasks.workunit.client.0.smithi152.stdout:9/915: readlink d5/d6/dfa/l4e 0 2024-04-06T12:24:13.206 INFO:tasks.workunit.client.0.smithi152.stdout:5/934: rename d3/c8 to d3/ddc/d12b/c134 0 2024-04-06T12:24:13.209 INFO:tasks.workunit.client.0.smithi152.stdout:9/916: dwrite d5/d6/d74/dd9/fe0 [0,4194304] 0 2024-04-06T12:24:13.216 INFO:tasks.workunit.client.0.smithi152.stdout:5/935: unlink d3/da/d15/d2b/d3f/d68/fec 0 2024-04-06T12:24:13.217 INFO:tasks.workunit.client.0.smithi152.stdout:9/917: chown d5/d6/d74/f96 8302089 1 2024-04-06T12:24:13.219 INFO:tasks.workunit.client.0.smithi152.stdout:5/936: mkdir d3/da/d15/d40/d92/d100/d12d/d135 0 2024-04-06T12:24:13.220 INFO:tasks.workunit.client.0.smithi152.stdout:5/937: stat d3/da/d15/d2b/d3f/d6d/dd1 0 2024-04-06T12:24:13.225 INFO:tasks.workunit.client.0.smithi152.stdout:5/938: mkdir d3/da/d15/d40/d50/d99/d136 0 2024-04-06T12:24:13.227 INFO:tasks.workunit.client.0.smithi152.stdout:9/918: rmdir d5/d6/d74/d17/d37/d105 0 2024-04-06T12:24:13.231 INFO:tasks.workunit.client.0.smithi152.stdout:5/939: creat d3/f137 x:0 0 0 2024-04-06T12:24:13.233 INFO:tasks.workunit.client.0.smithi152.stdout:9/919: dwrite d5/d6/f14 [0,4194304] 0 2024-04-06T12:24:13.246 INFO:tasks.workunit.client.0.smithi152.stdout:5/940: write d3/f5a [351515,97157] 0 2024-04-06T12:24:13.250 INFO:tasks.workunit.client.0.smithi152.stdout:5/941: chown d3/da/l25 276 1 2024-04-06T12:24:13.253 INFO:tasks.workunit.client.0.smithi152.stdout:9/920: dwrite d5/d6/d74/d17/d37/f76 [0,4194304] 0 2024-04-06T12:24:13.261 INFO:tasks.workunit.client.0.smithi152.stdout:9/921: creat d5/d6/d74/d17/d23/d2d/d98/d99/f129 x:0 0 0 2024-04-06T12:24:13.263 INFO:tasks.workunit.client.0.smithi152.stdout:9/922: chown d5/d6/d74/d17/d37/d5d/cbf 87 1 2024-04-06T12:24:13.265 INFO:tasks.workunit.client.0.smithi152.stdout:5/942: dwrite d3/fd2 [0,4194304] 0 2024-04-06T12:24:13.266 INFO:tasks.workunit.client.0.smithi152.stdout:9/923: write d5/d6/d74/d17/f75 [1071080,115533] 0 2024-04-06T12:24:13.268 INFO:tasks.workunit.client.0.smithi152.stdout:9/924: stat d5/d6/d74/d17/d23/d2d/f56 0 2024-04-06T12:24:13.273 INFO:tasks.workunit.client.0.smithi152.stdout:5/943: creat d3/da/d15/d2b/d3f/db9/dcd/f138 x:0 0 0 2024-04-06T12:24:13.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:11.587405+0000 mgr.smithi195.ausetj (mgr.24375) 94 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 48 MiB/s rd, 95 MiB/s wr, 245 op/s 2024-04-06T12:24:13.279 INFO:tasks.workunit.client.0.smithi152.stdout:9/925: dwrite d5/d6/d74/d17/d23/d2d/d4b/fa9 [4194304,4194304] 0 2024-04-06T12:24:13.285 INFO:tasks.workunit.client.0.smithi152.stdout:9/926: mknod d5/d6/d74/d17/c12a 0 2024-04-06T12:24:13.288 INFO:tasks.workunit.client.0.smithi152.stdout:5/944: dwrite d3/da/f13 [0,4194304] 0 2024-04-06T12:24:13.290 INFO:tasks.workunit.client.0.smithi152.stdout:5/945: mkdir d3/da/d15/d40/d50/dd7/d139 0 2024-04-06T12:24:13.292 INFO:tasks.workunit.client.0.smithi152.stdout:5/946: write d3/da/d53/f60 [5319369,75829] 0 2024-04-06T12:24:13.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:11.587405+0000 mgr.smithi195.ausetj (mgr.24375) 94 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 48 MiB/s rd, 95 MiB/s wr, 245 op/s 2024-04-06T12:24:13.308 INFO:tasks.workunit.client.0.smithi152.stdout:5/947: dwrite d3/da/d15/d2b/d3f/d68/d81/f56 [0,4194304] 0 2024-04-06T12:24:13.310 INFO:tasks.workunit.client.0.smithi152.stdout:9/927: dread d5/d6/d74/d17/d23/d2d/d32/db1/fdb [0,4194304] 0 2024-04-06T12:24:13.312 INFO:tasks.workunit.client.0.smithi152.stdout:5/948: creat d3/da/d15/d40/d50/d99/f13a x:0 0 0 2024-04-06T12:24:13.316 INFO:tasks.workunit.client.0.smithi152.stdout:9/928: rename d5/d6/d74/f97 to d5/d6/d74/d17/f12b 0 2024-04-06T12:24:13.320 INFO:tasks.workunit.client.0.smithi152.stdout:5/949: rename d3/da/d15/d2b/d3f/d68/d81/ff9 to d3/da/d15/d2b/d3f/d4c/f13b 0 2024-04-06T12:24:13.324 INFO:tasks.workunit.client.0.smithi152.stdout:9/929: dwrite d5/d6/d74/d17/d23/d2d/d98/f121 [0,4194304] 0 2024-04-06T12:24:13.326 INFO:tasks.workunit.client.0.smithi152.stdout:9/930: read d5/d39/d79/daa/fb2 [255170,122396] 0 2024-04-06T12:24:13.334 INFO:tasks.workunit.client.0.smithi152.stdout:5/950: dwrite d3/da/d15/d2b/d3f/d6d/db1/f104 [0,4194304] 0 2024-04-06T12:24:13.336 INFO:tasks.workunit.client.0.smithi152.stdout:5/951: fdatasync d3/de/fb8 0 2024-04-06T12:24:13.344 INFO:tasks.workunit.client.0.smithi152.stdout:5/952: getdents d3/ddc/d12b 0 2024-04-06T12:24:13.348 INFO:tasks.workunit.client.0.smithi152.stdout:9/931: dread d5/d6/f2c [0,4194304] 0 2024-04-06T12:24:13.361 INFO:tasks.workunit.client.0.smithi152.stdout:5/953: dwrite d3/da/d15/d40/d50/f61 [0,4194304] 0 2024-04-06T12:24:13.367 INFO:tasks.workunit.client.0.smithi152.stdout:2/965: sync 2024-04-06T12:24:13.367 INFO:tasks.workunit.client.0.smithi152.stdout:7/955: sync 2024-04-06T12:24:13.369 INFO:tasks.workunit.client.0.smithi152.stdout:5/954: truncate d3/da/d15/d2b/d3f/d4c/ff2 678952 0 2024-04-06T12:24:13.370 INFO:tasks.workunit.client.0.smithi152.stdout:9/932: dread d5/d6/f3c [0,4194304] 0 2024-04-06T12:24:13.371 INFO:tasks.workunit.client.0.smithi152.stdout:7/956: write d8/df/d61/d3d/dac/fe5 [109664,91631] 0 2024-04-06T12:24:13.371 INFO:tasks.workunit.client.0.smithi152.stdout:2/966: creat d0/d40/d41/d28/d8c/f137 x:0 0 0 2024-04-06T12:24:13.374 INFO:tasks.workunit.client.0.smithi152.stdout:5/955: mknod d3/da/d15/d2b/d3f/d6d/db1/d114/c13c 0 2024-04-06T12:24:13.376 INFO:tasks.workunit.client.0.smithi152.stdout:5/956: write d3/da/f29 [5537920,18893] 0 2024-04-06T12:24:13.381 INFO:tasks.workunit.client.0.smithi152.stdout:7/957: dwrite d8/df/d28/d41/fa4 [0,4194304] 0 2024-04-06T12:24:13.386 INFO:tasks.workunit.client.0.smithi152.stdout:2/967: write d0/d2/d6f/d90/d9e/feb [808740,80246] 0 2024-04-06T12:24:13.388 INFO:tasks.workunit.client.0.smithi152.stdout:5/957: getdents d3/da/d15/de9 0 2024-04-06T12:24:13.390 INFO:tasks.workunit.client.0.smithi152.stdout:2/968: chown d0/d15/d24/d3d/f7d 533113 1 2024-04-06T12:24:13.392 INFO:tasks.workunit.client.0.smithi152.stdout:2/969: chown d0/d2/f7f 46 1 2024-04-06T12:24:13.392 INFO:tasks.workunit.client.0.smithi152.stdout:7/958: dwrite d8/df/d61/f115 [0,4194304] 0 2024-04-06T12:24:13.395 INFO:tasks.workunit.client.0.smithi152.stdout:5/958: creat d3/da/d15/d2b/d3f/db9/f13d x:0 0 0 2024-04-06T12:24:13.395 INFO:tasks.workunit.client.0.smithi152.stdout:2/970: truncate d0/d2/d6f/d90/fa5 4592696 0 2024-04-06T12:24:13.397 INFO:tasks.workunit.client.0.smithi152.stdout:2/971: stat d0/d15/d24/d3d/de3/db2/fac 0 2024-04-06T12:24:13.400 INFO:tasks.workunit.client.0.smithi152.stdout:9/933: dread d5/d6/d74/d17/d23/d2d/f8f [0,4194304] 0 2024-04-06T12:24:13.401 INFO:tasks.workunit.client.0.smithi152.stdout:2/972: rmdir d0/d2/d6f/d90/d9e/db5/d3a 39 2024-04-06T12:24:13.407 INFO:tasks.workunit.client.0.smithi152.stdout:9/934: dwrite d5/d6/d74/d17/d23/d2d/f51 [4194304,4194304] 0 2024-04-06T12:24:13.407 INFO:tasks.workunit.client.0.smithi152.stdout:5/959: write d3/da/f24 [5051687,90082] 0 2024-04-06T12:24:13.411 INFO:tasks.workunit.client.0.smithi152.stdout:7/959: link d8/c20 d8/df/d28/d41/dd4/d43/d8a/d9d/dc9/dd0/d11e/c13c 0 2024-04-06T12:24:13.417 INFO:tasks.workunit.client.0.smithi152.stdout:9/935: dwrite d5/d6/d74/d17/d23/d2d/d32/f128 [4194304,4194304] 0 2024-04-06T12:24:13.419 INFO:tasks.workunit.client.0.smithi152.stdout:5/960: rmdir d3/da/d15/d2b/d3f/db9/d10e 0 2024-04-06T12:24:13.423 INFO:tasks.workunit.client.0.smithi152.stdout:9/936: mkdir d5/d6/d74/d17/d86/d12c 0 2024-04-06T12:24:13.424 INFO:tasks.workunit.client.0.smithi152.stdout:5/961: creat d3/da/d15/d2b/d3f/db9/dcd/f13e x:0 0 0 2024-04-06T12:24:13.428 INFO:tasks.workunit.client.0.smithi152.stdout:2/973: write d0/d2/d6f/d90/fff [226083,74579] 0 2024-04-06T12:24:13.431 INFO:tasks.workunit.client.0.smithi152.stdout:7/960: write d8/df/d61/d3d/fd1 [795659,50674] 0 2024-04-06T12:24:13.433 INFO:tasks.workunit.client.0.smithi152.stdout:9/937: write d5/d6/d74/d69/f100 [470847,30732] 0 2024-04-06T12:24:13.438 INFO:tasks.workunit.client.0.smithi152.stdout:2/974: rename d0/f11 to d0/d2/d6f/d90/f138 0 2024-04-06T12:24:13.440 INFO:tasks.workunit.client.0.smithi152.stdout:9/938: write d5/d6/dfa/f5b [71292,3065] 0 2024-04-06T12:24:13.442 INFO:tasks.workunit.client.0.smithi152.stdout:7/961: write d8/df/d61/d4b/dcd/d136/f67 [928195,28800] 0 2024-04-06T12:24:13.442 INFO:tasks.workunit.client.0.smithi152.stdout:9/939: readlink d5/d6/d74/d17/d23/d2d/d4b/d5a/l83 0 2024-04-06T12:24:13.443 INFO:tasks.workunit.client.0.smithi152.stdout:2/975: symlink d0/d15/d24/d3d/l139 0 2024-04-06T12:24:13.450 INFO:tasks.workunit.client.0.smithi152.stdout:5/962: dwrite d3/da/d15/d2b/d3f/fdb [0,4194304] 0 2024-04-06T12:24:13.450 INFO:tasks.workunit.client.0.smithi152.stdout:5/963: chown d3/de/lad 35 1 2024-04-06T12:24:13.450 INFO:tasks.workunit.client.0.smithi152.stdout:9/940: mkdir d5/d6/d74/d17/d9f/d12d 0 2024-04-06T12:24:13.452 INFO:tasks.workunit.client.0.smithi152.stdout:7/962: mknod d8/df/d28/d41/dd4/d79/d81/c13d 0 2024-04-06T12:24:13.456 INFO:tasks.workunit.client.0.smithi152.stdout:2/976: symlink d0/dc9/de9/d106/d10a/l13a 0 2024-04-06T12:24:13.457 INFO:tasks.workunit.client.0.smithi152.stdout:7/963: fsync d8/df/d61/d4b/dcd/d136/f88 0 2024-04-06T12:24:13.460 INFO:tasks.workunit.client.0.smithi152.stdout:9/941: symlink d5/d39/d79/l12e 0 2024-04-06T12:24:13.464 INFO:tasks.workunit.client.0.smithi152.stdout:2/977: truncate d0/d40/d41/d28/d54/fb1 307375 0 2024-04-06T12:24:13.465 INFO:tasks.workunit.client.0.smithi152.stdout:7/964: dwrite d8/df/d28/f4d [0,4194304] 0 2024-04-06T12:24:13.468 INFO:tasks.workunit.client.0.smithi152.stdout:9/942: unlink d5/c9c 0 2024-04-06T12:24:13.471 INFO:tasks.workunit.client.0.smithi152.stdout:9/943: chown d5/d6/d74/da0 61 1 2024-04-06T12:24:13.473 INFO:tasks.workunit.client.0.smithi152.stdout:9/944: write d5/f124 [4483597,103627] 0 2024-04-06T12:24:13.474 INFO:tasks.workunit.client.0.smithi152.stdout:5/964: dwrite d3/da/d53/f87 [0,4194304] 0 2024-04-06T12:24:13.477 INFO:tasks.workunit.client.0.smithi152.stdout:7/965: rmdir d8/df/d28/d41/dd4/d8c/d66 39 2024-04-06T12:24:13.479 INFO:tasks.workunit.client.0.smithi152.stdout:2/978: mknod d0/d2/d6f/d90/d9e/db5/d3a/c13b 0 2024-04-06T12:24:13.483 INFO:tasks.workunit.client.0.smithi152.stdout:2/979: symlink d0/d15/de7/l13c 0 2024-04-06T12:24:13.487 INFO:tasks.workunit.client.0.smithi152.stdout:5/965: link d3/da/d15/d40/d50/d99/f10f d3/da/d15/d2b/d3f/d68/f13f 0 2024-04-06T12:24:13.494 INFO:tasks.workunit.client.0.smithi152.stdout:9/945: write d5/d6/f50 [1754579,90298] 0 2024-04-06T12:24:13.498 INFO:tasks.workunit.client.0.smithi152.stdout:7/966: truncate d8/df/d61/d4b/fa5 1496058 0 2024-04-06T12:24:13.502 INFO:tasks.workunit.client.0.smithi152.stdout:9/946: dwrite d5/d6/d74/d17/f75 [0,4194304] 0 2024-04-06T12:24:13.505 INFO:tasks.workunit.client.0.smithi152.stdout:7/967: creat d8/df/d28/d41/dd4/d43/d8a/d9d/dc9/f13e x:0 0 0 2024-04-06T12:24:13.510 INFO:tasks.workunit.client.0.smithi152.stdout:2/980: dwrite d0/d2/d6f/fbb [4194304,4194304] 0 2024-04-06T12:24:13.512 INFO:tasks.workunit.client.0.smithi152.stdout:5/966: truncate d3/da/d15/d2b/d3f/db9/fbe 6560666 0 2024-04-06T12:24:13.512 INFO:tasks.workunit.client.0.smithi152.stdout:7/968: symlink d8/d2a/d42/l13f 0 2024-04-06T12:24:13.514 INFO:tasks.workunit.client.0.smithi152.stdout:2/981: mknod d0/dae/c13d 0 2024-04-06T12:24:13.516 INFO:tasks.workunit.client.0.smithi152.stdout:7/969: mknod d8/c140 0 2024-04-06T12:24:13.518 INFO:tasks.workunit.client.0.smithi152.stdout:5/967: creat d3/da/d15/d2b/d3f/d68/d81/dc1/f140 x:0 0 0 2024-04-06T12:24:13.523 INFO:tasks.workunit.client.0.smithi152.stdout:5/968: creat d3/de/d8c/f141 x:0 0 0 2024-04-06T12:24:13.530 INFO:tasks.workunit.client.0.smithi152.stdout:9/947: dwrite d5/d39/d79/daa/fb2 [0,4194304] 0 2024-04-06T12:24:13.540 INFO:tasks.workunit.client.0.smithi152.stdout:7/970: write d8/fb [4223966,97867] 0 2024-04-06T12:24:13.540 INFO:tasks.workunit.client.0.smithi152.stdout:2/982: truncate d0/d15/d24/f8e 6300168 0 2024-04-06T12:24:13.545 INFO:tasks.workunit.client.0.smithi152.stdout:7/971: chown d8/df/d61/d76/cd9 4 1 2024-04-06T12:24:13.546 INFO:tasks.workunit.client.0.smithi152.stdout:5/969: dwrite d3/da/d15/d2b/d3f/d4c/f13b [0,4194304] 0 2024-04-06T12:24:13.556 INFO:tasks.workunit.client.0.smithi152.stdout:2/983: write d0/d15/d24/f98 [4188079,34890] 0 2024-04-06T12:24:13.558 INFO:tasks.workunit.client.0.smithi152.stdout:9/948: dwrite d5/d6/d74/d69/fca [0,4194304] 0 2024-04-06T12:24:13.571 INFO:tasks.workunit.client.0.smithi152.stdout:5/970: dwrite d3/da/f29 [0,4194304] 0 2024-04-06T12:24:13.571 INFO:tasks.workunit.client.0.smithi152.stdout:7/972: dwrite d8/df/d28/d41/dd4/d49/fec [0,4194304] 0 2024-04-06T12:24:13.576 INFO:tasks.workunit.client.0.smithi152.stdout:7/973: write d8/df/d28/d41/fa4 [1884994,64126] 0 2024-04-06T12:24:13.590 INFO:tasks.workunit.client.0.smithi152.stdout:5/971: creat d3/d9/f142 x:0 0 0 2024-04-06T12:24:13.594 INFO:tasks.workunit.client.0.smithi152.stdout:9/949: link d5/d6/d74/l65 d5/d6/d74/d17/d23/d2d/d32/l12f 0 2024-04-06T12:24:13.597 INFO:tasks.workunit.client.0.smithi152.stdout:9/950: symlink d5/d6/d74/da0/l130 0 2024-04-06T12:24:13.599 INFO:tasks.workunit.client.0.smithi152.stdout:2/984: dwrite d0/d15/d24/d3d/f7d [0,4194304] 0 2024-04-06T12:24:13.604 INFO:tasks.workunit.client.0.smithi152.stdout:7/974: creat d8/d2a/f141 x:0 0 0 2024-04-06T12:24:13.609 INFO:tasks.workunit.client.0.smithi152.stdout:9/951: rename d5/d6/d74/d17/d37/d5d to d5/d6/d74/d17/d23/d2d/d4b/d131 0 2024-04-06T12:24:13.611 INFO:tasks.workunit.client.0.smithi152.stdout:7/975: creat d8/df/d61/d76/d106/f142 x:0 0 0 2024-04-06T12:24:13.611 INFO:tasks.workunit.client.0.smithi152.stdout:2/985: dread d0/d2/d6f/d90/fa6 [0,4194304] 0 2024-04-06T12:24:13.613 INFO:tasks.workunit.client.0.smithi152.stdout:9/952: fdatasync d5/f81 0 2024-04-06T12:24:13.615 INFO:tasks.workunit.client.0.smithi152.stdout:2/986: creat d0/d2/d6f/f13e x:0 0 0 2024-04-06T12:24:13.621 INFO:tasks.workunit.client.0.smithi152.stdout:9/953: dwrite d5/f124 [0,4194304] 0 2024-04-06T12:24:13.637 INFO:tasks.workunit.client.0.smithi152.stdout:2/987: rename d0/d2/d6f/d90/d9e/db5/d3a/d87/lc5 to d0/d2/d6f/d90/d9e/db5/l13f 0 2024-04-06T12:24:13.640 INFO:tasks.workunit.client.0.smithi152.stdout:2/988: write d0/d2/fb3 [2889131,63385] 0 2024-04-06T12:24:13.641 INFO:tasks.workunit.client.0.smithi152.stdout:7/976: dwrite d8/df/d61/d4b/d56/db8/f105 [0,4194304] 0 2024-04-06T12:24:13.643 INFO:tasks.workunit.client.0.smithi152.stdout:9/954: dread d5/d6/d74/d17/d23/d2d/d32/f128 [0,4194304] 0 2024-04-06T12:24:13.644 INFO:tasks.workunit.client.0.smithi152.stdout:2/989: fdatasync d0/d40/d41/d28/fbe 0 2024-04-06T12:24:13.645 INFO:tasks.workunit.client.0.smithi152.stdout:9/955: write d5/d6/f49 [8376305,39134] 0 2024-04-06T12:24:13.648 INFO:tasks.workunit.client.0.smithi152.stdout:2/990: read d0/d40/d41/d28/d54/f7c [3437357,65759] 0 2024-04-06T12:24:13.653 INFO:tasks.workunit.client.0.smithi152.stdout:7/977: rename d8/df/c19 to d8/df/d61/d4b/dcd/c143 0 2024-04-06T12:24:13.656 INFO:tasks.workunit.client.0.smithi152.stdout:2/991: rmdir d0/d2/d6f/d90 39 2024-04-06T12:24:13.657 INFO:tasks.workunit.client.0.smithi152.stdout:7/978: read d8/f16 [3363516,7702] 0 2024-04-06T12:24:13.658 INFO:tasks.workunit.client.0.smithi152.stdout:9/956: creat d5/d6/d74/d17/d23/d2d/d4b/d115/f132 x:0 0 0 2024-04-06T12:24:13.659 INFO:tasks.workunit.client.0.smithi152.stdout:2/992: read d0/d15/d24/d79/d80/fc4 [83996,1812] 0 2024-04-06T12:24:13.673 INFO:tasks.workunit.client.0.smithi152.stdout:2/993: rmdir d0/d40/d26/db4/d122 0 2024-04-06T12:24:13.674 INFO:tasks.workunit.client.0.smithi152.stdout:9/957: dread d5/d6/d74/d17/d37/f41 [0,4194304] 0 2024-04-06T12:24:13.675 INFO:tasks.workunit.client.0.smithi152.stdout:2/994: fsync d0/f60 0 2024-04-06T12:24:13.690 INFO:tasks.workunit.client.0.smithi152.stdout:9/958: link d5/d6/dde/fe2 d5/d6/d74/d17/d23/d2d/d32/d36/da3/f133 0 2024-04-06T12:24:13.693 INFO:tasks.workunit.client.0.smithi152.stdout:7/979: dwrite d8/df/d61/d4b/f69 [0,4194304] 0 2024-04-06T12:24:13.704 INFO:tasks.workunit.client.0.smithi152.stdout:2/995: dwrite d0/dae/fd5 [0,4194304] 0 2024-04-06T12:24:13.710 INFO:tasks.workunit.client.0.smithi152.stdout:7/980: dwrite d8/df/d28/d41/dd4/d8c/f120 [0,4194304] 0 2024-04-06T12:24:13.718 INFO:tasks.workunit.client.0.smithi152.stdout:7/981: truncate d8/df/d61/d6d/ff2 832426 0 2024-04-06T12:24:13.729 INFO:tasks.workunit.client.0.smithi152.stdout:9/959: dwrite d5/d6/d74/d17/d23/d2d/d32/d36/f82 [0,4194304] 0 2024-04-06T12:24:13.732 INFO:tasks.workunit.client.0.smithi152.stdout:9/960: chown d5/d6/d74/d17/d23/d2d/d32/ccc 8707 1 2024-04-06T12:24:13.739 INFO:tasks.workunit.client.0.smithi152.stdout:9/961: unlink d5/d6/d74/l18 0 2024-04-06T12:24:13.743 INFO:tasks.workunit.client.0.smithi152.stdout:9/962: write d5/d6/f50 [4655452,8923] 0 2024-04-06T12:24:13.749 INFO:tasks.workunit.client.0.smithi152.stdout:9/963: write d5/d6/d74/d17/d23/d2d/d4b/d5a/f6f [1663864,12968] 0 2024-04-06T12:24:13.749 INFO:tasks.workunit.client.0.smithi152.stdout:2/996: dread d0/d40/f3f [0,4194304] 0 2024-04-06T12:24:13.751 INFO:tasks.workunit.client.0.smithi152.stdout:9/964: chown d5/d6/d74/d17/d37/f41 1644376 1 2024-04-06T12:24:13.757 INFO:tasks.workunit.client.0.smithi152.stdout:9/965: symlink d5/d6/dde/l134 0 2024-04-06T12:24:13.774 INFO:tasks.workunit.client.0.smithi152.stdout:9/966: dread d5/d6/dfa/f89 [0,4194304] 0 2024-04-06T12:24:13.777 INFO:tasks.workunit.client.0.smithi152.stdout:7/982: dread d8/f16 [0,4194304] 0 2024-04-06T12:24:13.781 INFO:tasks.workunit.client.0.smithi152.stdout:2/997: dread d0/d2/d6f/d90/f138 [0,4194304] 0 2024-04-06T12:24:13.844 INFO:tasks.workunit.client.0.smithi152.stdout:7/983: symlink d8/df/d61/d4b/dcd/d136/d5c/l144 0 2024-04-06T12:24:13.844 INFO:tasks.workunit.client.0.smithi152.stdout:7/984: chown d8/df/d28/d87/d101 2935250 1 2024-04-06T12:24:13.849 INFO:tasks.workunit.client.0.smithi152.stdout:9/967: rename d5/d6/d74/d17/d23/d2d/d98/l111 to d5/d6/d74/d17/d9f/l135 0 2024-04-06T12:24:13.852 INFO:tasks.workunit.client.0.smithi152.stdout:9/968: stat d5/ce 0 2024-04-06T12:24:13.853 INFO:tasks.workunit.client.0.smithi152.stdout:9/969: write d5/d6/f16 [2223784,89109] 0 2024-04-06T12:24:13.860 INFO:tasks.workunit.client.0.smithi152.stdout:9/970: getdents d5/d6/d74/da0 0 2024-04-06T12:24:13.864 INFO:tasks.workunit.client.0.smithi152.stdout:9/971: dread d5/d6/d74/d17/d23/d2d/d32/f128 [4194304,4194304] 0 2024-04-06T12:24:13.871 INFO:tasks.workunit.client.0.smithi152.stdout:9/972: link d5/d6/d74/d17/d23/d2d/d32/db1/ld8 d5/d6/d74/d17/d23/d119/l136 0 2024-04-06T12:24:13.872 INFO:tasks.workunit.client.0.smithi152.stdout:2/998: write d0/d40/f56 [405184,57147] 0 2024-04-06T12:24:13.878 INFO:tasks.workunit.client.0.smithi152.stdout:2/999: mkdir d0/dc9/de9/d106/d140 0 2024-04-06T12:24:13.881 INFO:tasks.workunit.client.0.smithi152.stdout:9/973: write d5/d6/dde/fe2 [1027044,48589] 0 2024-04-06T12:24:13.882 INFO:tasks.workunit.client.0.smithi152.stdout:7/985: dwrite d8/df/d61/d4b/d56/f83 [0,4194304] 0 2024-04-06T12:24:13.886 INFO:tasks.workunit.client.0.smithi152.stdout:9/974: chown d5/d39/d79/f91 7738 1 2024-04-06T12:24:13.969 INFO:tasks.workunit.client.0.smithi152.stdout:9/975: dwrite d5/d6/d74/d17/d23/d2d/d32/d36/f9d [0,4194304] 0 2024-04-06T12:24:13.972 INFO:tasks.workunit.client.0.smithi152.stdout:9/976: mknod d5/d6/d74/d17/d23/d2d/d98/d99/c137 0 2024-04-06T12:24:13.975 INFO:tasks.workunit.client.0.smithi152.stdout:9/977: write d5/d6/d74/d69/fec [2992609,31389] 0 2024-04-06T12:24:13.985 INFO:tasks.workunit.client.0.smithi152.stdout:9/978: link d5/d6/d74/d17/d23/d2d/c87 d5/d6/d74/d17/d23/d2d/d32/db1/d125/c138 0 2024-04-06T12:24:13.991 INFO:tasks.workunit.client.0.smithi152.stdout:9/979: creat d5/d6/d74/d17/d23/d2d/d98/f139 x:0 0 0 2024-04-06T12:24:13.994 INFO:tasks.workunit.client.0.smithi152.stdout:9/980: mknod d5/d6/d74/d17/d23/d2d/d4b/d5a/c13a 0 2024-04-06T12:24:13.994 INFO:tasks.workunit.client.0.smithi152.stdout:9/981: chown d5/d6/fd 1637 1 2024-04-06T12:24:13.996 INFO:tasks.workunit.client.0.smithi152.stdout:9/982: write d5/d6/dfa/fc0 [299855,94349] 0 2024-04-06T12:24:14.005 INFO:tasks.workunit.client.0.smithi152.stdout:9/983: rename d5/d6/d74/d17/d23/d2d/d32/db1/fdb to d5/d6/d74/d17/d23/d2d/f13b 0 2024-04-06T12:24:14.006 INFO:tasks.workunit.client.0.smithi152.stdout:9/984: rmdir d5/d6 39 2024-04-06T12:24:14.009 INFO:tasks.workunit.client.0.smithi152.stdout:9/985: dread - d5/d6/d74/d17/f12b zero size 2024-04-06T12:24:14.011 INFO:tasks.workunit.client.0.smithi152.stdout:9/986: chown d5/d6/d74/d17/d23/d2d/d4b/d115/f132 38 1 2024-04-06T12:24:14.017 INFO:tasks.workunit.client.0.smithi152.stdout:9/987: dwrite d5/d39/d79/ff2 [0,4194304] 0 2024-04-06T12:24:14.023 INFO:tasks.workunit.client.0.smithi152.stdout:9/988: mknod d5/d6/d74/d17/d23/d2d/d4b/c13c 0 2024-04-06T12:24:14.030 INFO:tasks.workunit.client.0.smithi152.stdout:9/989: link d5/d6/d74/dd9/ce1 d5/d6/d74/d17/d86/c13d 0 2024-04-06T12:24:14.032 INFO:tasks.workunit.client.0.smithi152.stdout:9/990: write d5/d6/d74/d17/d23/d2d/d32/d36/f82 [1794938,49729] 0 2024-04-06T12:24:14.035 INFO:tasks.workunit.client.0.smithi152.stdout:9/991: mkdir d5/d6/d74/d17/d86/d13e 0 2024-04-06T12:24:14.040 INFO:tasks.workunit.client.0.smithi152.stdout:9/992: symlink d5/d6/d74/d17/d9f/d12d/l13f 0 2024-04-06T12:24:14.043 INFO:tasks.workunit.client.0.smithi152.stdout:9/993: creat d5/d6/d74/d17/d23/d2d/d4b/d5a/f140 x:0 0 0 2024-04-06T12:24:14.051 INFO:tasks.workunit.client.0.smithi152.stdout:9/994: write d5/d39/f93 [48340,69291] 0 2024-04-06T12:24:14.053 INFO:tasks.workunit.client.0.smithi152.stdout:9/995: rmdir d5/d6/d74/d17/d23/d119 39 2024-04-06T12:24:14.057 INFO:tasks.workunit.client.0.smithi152.stdout:9/996: creat d5/d6/d74/d69/f141 x:0 0 0 2024-04-06T12:24:14.061 INFO:tasks.workunit.client.0.smithi152.stdout:9/997: creat d5/d6/d74/d17/d23/d2d/d32/db1/d125/f142 x:0 0 0 2024-04-06T12:24:14.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/998: creat d5/d6/dfa/f143 x:0 0 0 2024-04-06T12:24:14.066 INFO:tasks.workunit.client.0.smithi152.stdout:9/999: unlink d5/d6/d74/d17/f77 0 2024-04-06T12:24:14.069 INFO:tasks.workunit.client.0.smithi152.stdout:5/972: sync 2024-04-06T12:24:14.076 INFO:tasks.workunit.client.0.smithi152.stdout:5/973: dwrite d3/da/d15/d2b/d3f/f43 [0,4194304] 0 2024-04-06T12:24:14.097 INFO:tasks.workunit.client.0.smithi152.stdout:5/974: dwrite d3/da/d15/d2b/d3f/d68/d81/fef [0,4194304] 0 2024-04-06T12:24:14.102 INFO:tasks.workunit.client.0.smithi152.stdout:5/975: mkdir d3/da/d15/d2b/d143 0 2024-04-06T12:24:14.106 INFO:tasks.workunit.client.0.smithi152.stdout:5/976: mkdir d3/da/d15/d7f/d144 0 2024-04-06T12:24:14.113 INFO:tasks.workunit.client.0.smithi152.stdout:5/977: dwrite d3/da/d15/de9/fcb [0,4194304] 0 2024-04-06T12:24:14.126 INFO:tasks.workunit.client.0.smithi152.stdout:5/978: write d3/de/fcf [618940,49010] 0 2024-04-06T12:24:14.137 INFO:tasks.workunit.client.0.smithi152.stdout:5/979: dwrite d3/da/d15/d2b/d3f/d68/d81/f90 [0,4194304] 0 2024-04-06T12:24:14.144 INFO:tasks.workunit.client.0.smithi152.stdout:5/980: creat d3/da/d15/d40/d4f/f145 x:0 0 0 2024-04-06T12:24:14.149 INFO:tasks.workunit.client.0.smithi152.stdout:5/981: creat d3/da/d15/d2b/d3f/d6d/dd1/da3/d132/f146 x:0 0 0 2024-04-06T12:24:14.157 INFO:tasks.workunit.client.0.smithi152.stdout:5/982: dwrite d3/da/d15/d2b/d3f/d4c/f13b [0,4194304] 0 2024-04-06T12:24:14.160 INFO:tasks.workunit.client.0.smithi152.stdout:5/983: mknod d3/de/da9/c147 0 2024-04-06T12:24:14.171 INFO:tasks.workunit.client.0.smithi152.stdout:5/984: truncate d3/da/fc 4287770 0 2024-04-06T12:24:14.175 INFO:tasks.workunit.client.0.smithi152.stdout:5/985: creat d3/da/d15/de9/f148 x:0 0 0 2024-04-06T12:24:14.178 INFO:tasks.workunit.client.0.smithi152.stdout:5/986: symlink d3/da/d15/de9/l149 0 2024-04-06T12:24:14.179 INFO:tasks.workunit.client.0.smithi152.stdout:5/987: fdatasync d3/da/f13 0 2024-04-06T12:24:14.183 INFO:tasks.workunit.client.0.smithi152.stdout:5/988: symlink d3/da/d15/d40/d92/d100/d12d/l14a 0 2024-04-06T12:24:14.187 INFO:tasks.workunit.client.0.smithi152.stdout:5/989: mknod d3/da/d15/c14b 0 2024-04-06T12:24:14.196 INFO:tasks.workunit.client.0.smithi152.stdout:7/986: sync 2024-04-06T12:24:14.196 INFO:tasks.workunit.client.0.smithi152.stdout:5/990: getdents d3/da/d15 0 2024-04-06T12:24:14.199 INFO:tasks.workunit.client.0.smithi152.stdout:5/991: dread - d3/da/d15/d40/d50/d99/f13a zero size 2024-04-06T12:24:14.200 INFO:tasks.workunit.client.0.smithi152.stdout:7/987: chown d8/df/d28/d75/de8/f12c 1 1 2024-04-06T12:24:14.201 INFO:tasks.workunit.client.0.smithi152.stdout:7/988: read d8/df/d28/d41/fa4 [1466236,78433] 0 2024-04-06T12:24:14.202 INFO:tasks.workunit.client.0.smithi152.stdout:5/992: symlink d3/da/d15/de9/l14c 0 2024-04-06T12:24:14.207 INFO:tasks.workunit.client.0.smithi152.stdout:5/993: mkdir d3/da/d15/d2b/d143/d14d 0 2024-04-06T12:24:14.209 INFO:tasks.workunit.client.0.smithi152.stdout:7/989: link d8/df/d28/d41/d48/lce d8/df/d61/d76/d106/df6/l145 0 2024-04-06T12:24:14.217 INFO:tasks.workunit.client.0.smithi152.stdout:7/990: getdents d8/df/d61/d3d 0 2024-04-06T12:24:14.219 INFO:tasks.workunit.client.0.smithi152.stdout:7/991: truncate d8/df/d28/d41/dd4/d49/fec 4882146 0 2024-04-06T12:24:14.220 INFO:tasks.workunit.client.0.smithi152.stdout:5/994: write d3/da/d15/d40/d4f/f51 [664080,125032] 0 2024-04-06T12:24:14.221 INFO:tasks.workunit.client.0.smithi152.stdout:5/995: chown d3/da/d15/d2b/d143 2 1 2024-04-06T12:24:14.222 INFO:tasks.workunit.client.0.smithi152.stdout:7/992: dread d8/df/d28/d75/de8/ffc [0,4194304] 0 2024-04-06T12:24:14.228 INFO:tasks.workunit.client.0.smithi152.stdout:5/996: mknod d3/da/d15/d2b/d3f/d6d/dc6/d12e/c14e 0 2024-04-06T12:24:14.233 INFO:tasks.workunit.client.0.smithi152.stdout:5/997: write d3/da/d15/d2b/d3f/d4c/f8d [803631,59395] 0 2024-04-06T12:24:14.233 INFO:tasks.workunit.client.0.smithi152.stdout:5/998: stat d3/da/d15/d40/d46/lb2 0 2024-04-06T12:24:14.236 INFO:tasks.workunit.client.0.smithi152.stdout:5/999: creat d3/da/d15/d2b/d3f/f14f x:0 0 0 2024-04-06T12:24:14.243 INFO:tasks.workunit.client.0.smithi152.stdout:7/993: dwrite d8/df/d61/d4b/dcd/d136/f88 [0,4194304] 0 2024-04-06T12:24:14.250 INFO:tasks.workunit.client.0.smithi152.stdout:7/994: stat d8/df/d28/d41/dd4/d8c/d2d/d7a/l10d 0 2024-04-06T12:24:14.253 INFO:tasks.workunit.client.0.smithi152.stdout:7/995: mknod d8/df/d61/d4b/d56/db8/c146 0 2024-04-06T12:24:14.257 INFO:tasks.workunit.client.0.smithi152.stdout:7/996: rename d8/df/d28/d41/dd4/d8c/d2d/da3/le1 to d8/df/d28/d41/dd4/d43/d8a/d9d/dae/l147 0 2024-04-06T12:24:14.265 INFO:tasks.workunit.client.0.smithi152.stdout:7/997: write d8/df/d28/d75/de8/ffc [565137,54782] 0 2024-04-06T12:24:14.267 INFO:tasks.workunit.client.0.smithi152.stdout:7/998: mknod d8/df/d28/d87/c148 0 2024-04-06T12:24:14.271 INFO:tasks.workunit.client.0.smithi152.stdout:7/999: symlink d8/df/d61/d76/d7e/de3/l149 0 2024-04-06T12:24:14.277 INFO:tasks.workunit.client.0.smithi152.stderr:+ rm -rf -- ./tmp.IfyeenMBIz 2024-04-06T12:24:14.928 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:13.587698+0000 mgr.smithi195.ausetj (mgr.24375) 95 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 48 MiB/s rd, 95 MiB/s wr, 245 op/s 2024-04-06T12:24:14.928 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:13.636614+0000 mon.smithi152 (mon.0) 698 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:14.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:13.646526+0000 mon.smithi152 (mon.0) 699 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:14.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:13.670603+0000 mgr.smithi195.ausetj (mgr.24375) 96 : cephadm [INF] Reconfiguring node-exporter.smithi152 (dependencies changed)... 2024-04-06T12:24:14.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:13.671165+0000 mgr.smithi195.ausetj (mgr.24375) 97 : cephadm [INF] Reconfiguring daemon node-exporter.smithi152 on smithi152 2024-04-06T12:24:15.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:13.587698+0000 mgr.smithi195.ausetj (mgr.24375) 95 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 48 MiB/s rd, 95 MiB/s wr, 245 op/s 2024-04-06T12:24:15.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:13.636614+0000 mon.smithi152 (mon.0) 698 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:15.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:13.646526+0000 mon.smithi152 (mon.0) 699 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:15.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:13.670603+0000 mgr.smithi195.ausetj (mgr.24375) 96 : cephadm [INF] Reconfiguring node-exporter.smithi152 (dependencies changed)... 2024-04-06T12:24:15.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:13.671165+0000 mgr.smithi195.ausetj (mgr.24375) 97 : cephadm [INF] Reconfiguring daemon node-exporter.smithi152 on smithi152 2024-04-06T12:24:16.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:15.588147+0000 mgr.smithi195.ausetj (mgr.24375) 98 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 69 MiB/s rd, 143 MiB/s wr, 377 op/s 2024-04-06T12:24:16.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:16.109892+0000 mon.smithi152 (mon.0) 700 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:16.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:16.116825+0000 mon.smithi152 (mon.0) 701 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:17.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:15.588147+0000 mgr.smithi195.ausetj (mgr.24375) 98 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 69 MiB/s rd, 143 MiB/s wr, 377 op/s 2024-04-06T12:24:17.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:16.109892+0000 mon.smithi152 (mon.0) 700 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:17.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:16.116825+0000 mon.smithi152 (mon.0) 701 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:18.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:16.139231+0000 mgr.smithi195.ausetj (mgr.24375) 99 : cephadm [INF] Reconfiguring node-exporter.smithi195 (dependencies changed)... 2024-04-06T12:24:18.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:16.139550+0000 mgr.smithi195.ausetj (mgr.24375) 100 : cephadm [INF] Reconfiguring daemon node-exporter.smithi195 on smithi195 2024-04-06T12:24:18.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:16.139231+0000 mgr.smithi195.ausetj (mgr.24375) 99 : cephadm [INF] Reconfiguring node-exporter.smithi195 (dependencies changed)... 2024-04-06T12:24:18.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:16.139550+0000 mgr.smithi195.ausetj (mgr.24375) 100 : cephadm [INF] Reconfiguring daemon node-exporter.smithi195 on smithi195 2024-04-06T12:24:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:17.588613+0000 mgr.smithi195.ausetj (mgr.24375) 101 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 51 MiB/s rd, 101 MiB/s wr, 271 op/s 2024-04-06T12:24:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:17.789127+0000 mon.smithi195 (mon.1) 66 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:19.031 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:17.588613+0000 mgr.smithi195.ausetj (mgr.24375) 101 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 51 MiB/s rd, 101 MiB/s wr, 271 op/s 2024-04-06T12:24:19.031 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:17.789127+0000 mon.smithi195 (mon.1) 66 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:20.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:19.589060+0000 mgr.smithi195.ausetj (mgr.24375) 102 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 107 MiB/s wr, 338 op/s 2024-04-06T12:24:20.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:20.567753+0000 mon.smithi152 (mon.0) 702 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:20.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:20.572723+0000 mon.smithi152 (mon.0) 703 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:21.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:19.589060+0000 mgr.smithi195.ausetj (mgr.24375) 102 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 107 MiB/s wr, 338 op/s 2024-04-06T12:24:21.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:20.567753+0000 mon.smithi152 (mon.0) 702 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:21.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:20.572723+0000 mon.smithi152 (mon.0) 703 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:22.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:20.612301+0000 mgr.smithi195.ausetj (mgr.24375) 103 : cephadm [INF] Reconfiguring prometheus.smithi195 (dependencies changed)... 2024-04-06T12:24:22.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:20.612301+0000 mgr.smithi195.ausetj (mgr.24375) 103 : cephadm [INF] Reconfiguring prometheus.smithi195 (dependencies changed)... 2024-04-06T12:24:23.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:20.845486+0000 mgr.smithi195.ausetj (mgr.24375) 104 : cephadm [INF] Reconfiguring daemon prometheus.smithi195 on smithi195 2024-04-06T12:24:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:21.589334+0000 mgr.smithi195.ausetj (mgr.24375) 105 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 23 MiB/s rd, 54 MiB/s wr, 199 op/s 2024-04-06T12:24:23.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:20.845486+0000 mgr.smithi195.ausetj (mgr.24375) 104 : cephadm [INF] Reconfiguring daemon prometheus.smithi195 on smithi195 2024-04-06T12:24:23.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:21.589334+0000 mgr.smithi195.ausetj (mgr.24375) 105 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 23 MiB/s rd, 54 MiB/s wr, 199 op/s 2024-04-06T12:24:25.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:23.589621+0000 mgr.smithi195.ausetj (mgr.24375) 106 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 23 MiB/s rd, 54 MiB/s wr, 199 op/s 2024-04-06T12:24:25.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:23.589621+0000 mgr.smithi195.ausetj (mgr.24375) 106 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 23 MiB/s rd, 54 MiB/s wr, 199 op/s 2024-04-06T12:24:27.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:25.590112+0000 mgr.smithi195.ausetj (mgr.24375) 107 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 23 MiB/s rd, 55 MiB/s wr, 280 op/s 2024-04-06T12:24:27.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:25.590112+0000 mgr.smithi195.ausetj (mgr.24375) 107 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 23 MiB/s rd, 55 MiB/s wr, 280 op/s 2024-04-06T12:24:29.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:27.590383+0000 mgr.smithi195.ausetj (mgr.24375) 108 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.3 MiB/s wr, 148 op/s 2024-04-06T12:24:29.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:27.590383+0000 mgr.smithi195.ausetj (mgr.24375) 108 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.3 MiB/s wr, 148 op/s 2024-04-06T12:24:31.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:29.590806+0000 mgr.smithi195.ausetj (mgr.24375) 109 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 986 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 218 op/s 2024-04-06T12:24:31.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:29.590806+0000 mgr.smithi195.ausetj (mgr.24375) 109 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 986 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 218 op/s 2024-04-06T12:24:31.297 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-06T12:24:31.297 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-06T12:24:32.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:31.591097+0000 mgr.smithi195.ausetj (mgr.24375) 110 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 986 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 150 op/s 2024-04-06T12:24:33.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:31.591097+0000 mgr.smithi195.ausetj (mgr.24375) 110 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 986 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 150 op/s 2024-04-06T12:24:33.935 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:32.789543+0000 mon.smithi195 (mon.1) 67 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:34.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:32.789543+0000 mon.smithi195 (mon.1) 67 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:35.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:33.591349+0000 mgr.smithi195.ausetj (mgr.24375) 111 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 986 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 150 op/s 2024-04-06T12:24:35.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:34.024921+0000 mon.smithi152 (mon.0) 704 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:35.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:34.032216+0000 mon.smithi152 (mon.0) 705 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:35.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:34.037342+0000 mon.smithi195 (mon.1) 68 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:24:35.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:34.040705+0000 mon.smithi195 (mon.1) 69 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:24:35.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:34.043636+0000 mon.smithi195 (mon.1) 70 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:24:35.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:34.049333+0000 mon.smithi195 (mon.1) 71 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:24:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:33.591349+0000 mgr.smithi195.ausetj (mgr.24375) 111 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 986 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 150 op/s 2024-04-06T12:24:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:34.024921+0000 mon.smithi152 (mon.0) 704 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:34.032216+0000 mon.smithi152 (mon.0) 705 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:34.037342+0000 mon.smithi195 (mon.1) 68 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:24:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:34.040705+0000 mon.smithi195 (mon.1) 69 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:24:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:34.043636+0000 mon.smithi195 (mon.1) 70 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:24:35.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:34.049333+0000 mon.smithi195 (mon.1) 71 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:24:35.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:34.037710+0000 mgr.smithi195.ausetj (mgr.24375) 112 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:24:35.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:34.040996+0000 mgr.smithi195.ausetj (mgr.24375) 113 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:24:35.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:34.043937+0000 mgr.smithi195.ausetj (mgr.24375) 114 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:24:35.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:34.051358+0000 mgr.smithi195.ausetj (mgr.24375) 115 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi195.ausetj) 2024-04-06T12:24:35.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:34.051750+0000 mgr.smithi195.ausetj (mgr.24375) 116 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi195.ausetj) 2024-04-06T12:24:36.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:34.037710+0000 mgr.smithi195.ausetj (mgr.24375) 112 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:24:36.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:34.040996+0000 mgr.smithi195.ausetj (mgr.24375) 113 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:24:36.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:34.043937+0000 mgr.smithi195.ausetj (mgr.24375) 114 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:24:36.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:34.051358+0000 mgr.smithi195.ausetj (mgr.24375) 115 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi195.ausetj) 2024-04-06T12:24:36.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:34.051750+0000 mgr.smithi195.ausetj (mgr.24375) 116 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi195.ausetj) 2024-04-06T12:24:36.832 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:35.591889+0000 mgr.smithi195.ausetj (mgr.24375) 117 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 241 op/s 2024-04-06T12:24:36.832 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:36.023960+0000 mon.smithi152 (mon.0) 706 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:36.833 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:36.024982+0000 mon.smithi195 (mon.1) 72 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.lynahm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:24:36.833 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:36.025240+0000 mon.smithi152 (mon.0) 707 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.lynahm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:24:36.833 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:36.026004+0000 mon.smithi195 (mon.1) 73 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:24:36.833 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:36.026700+0000 mon.smithi195 (mon.1) 74 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:24:37.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:35.591889+0000 mgr.smithi195.ausetj (mgr.24375) 117 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 241 op/s 2024-04-06T12:24:37.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:36.023960+0000 mon.smithi152 (mon.0) 706 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:37.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:36.024982+0000 mon.smithi195 (mon.1) 72 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.lynahm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:24:37.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:36.025240+0000 mon.smithi152 (mon.0) 707 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.lynahm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:24:37.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:36.026004+0000 mon.smithi195 (mon.1) 73 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:24:37.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:36.026700+0000 mon.smithi195 (mon.1) 74 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:24:37.954 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:36.018920+0000 mgr.smithi195.ausetj (mgr.24375) 118 : cephadm [INF] Upgrade: Updating mgr.smithi152.lynahm 2024-04-06T12:24:37.954 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:36.027555+0000 mgr.smithi195.ausetj (mgr.24375) 119 : cephadm [INF] Deploying daemon mgr.smithi152.lynahm on smithi152 2024-04-06T12:24:38.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:36.018920+0000 mgr.smithi195.ausetj (mgr.24375) 118 : cephadm [INF] Upgrade: Updating mgr.smithi152.lynahm 2024-04-06T12:24:38.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:36.027555+0000 mgr.smithi195.ausetj (mgr.24375) 119 : cephadm [INF] Deploying daemon mgr.smithi152.lynahm on smithi152 2024-04-06T12:24:38.953 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:37.592248+0000 mgr.smithi195.ausetj (mgr.24375) 120 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-04-06T12:24:39.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:37.592248+0000 mgr.smithi195.ausetj (mgr.24375) 120 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-04-06T12:24:40.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.058+0000 7fada1613700 1 -- 172.21.15.152:0/2160377330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 msgr2=0x7fad9c0f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:40.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.058+0000 7fada1613700 1 --2- 172.21.15.152:0/2160377330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 0x7fad9c0f6ac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fad900047f0 tx=0x7fad90009cb0).stop 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.058+0000 7fada1613700 1 -- 172.21.15.152:0/2160377330 shutdown_connections 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.058+0000 7fada1613700 1 --2- 172.21.15.152:0/2160377330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 0x7fad9c0f6ac0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.058+0000 7fada1613700 1 --2- 172.21.15.152:0/2160377330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0f7cd0 0x7fad9c0f80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.058+0000 7fada1613700 1 -- 172.21.15.152:0/2160377330 >> 172.21.15.152:0/2160377330 conn(0x7fad9c0f15d0 msgr2=0x7fad9c0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.058+0000 7fada1613700 1 -- 172.21.15.152:0/2160377330 shutdown_connections 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.058+0000 7fada1613700 1 -- 172.21.15.152:0/2160377330 wait complete. 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.059+0000 7fada1613700 1 Processor -- start 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.059+0000 7fada1613700 1 -- start start 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.059+0000 7fada1613700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0f7cd0 0x7fad9c1080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.059+0000 7fada1613700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 0x7fad9c1085b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.059+0000 7fada1613700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c108b60 con 0x7fad9c0f8670 2024-04-06T12:24:40.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.059+0000 7fada1613700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c108ca0 con 0x7fad9c0f7cd0 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.059+0000 7fad9a7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 0x7fad9c1085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.059+0000 7fad9a7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 0x7fad9c1085b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34932/0 (socket says 172.21.15.152:34932) 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.059+0000 7fad9a7fc700 1 -- 172.21.15.152:0/1973582819 learned_addr learned my addr 172.21.15.152:0/1973582819 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.060+0000 7fad9affd700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0f7cd0 0x7fad9c1080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.060+0000 7fad9a7fc700 1 -- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0f7cd0 msgr2=0x7fad9c1080c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.060+0000 7fad9a7fc700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0f7cd0 0x7fad9c1080c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.060+0000 7fad9a7fc700 1 -- 172.21.15.152:0/1973582819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90005040 con 0x7fad9c0f8670 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.060+0000 7fad9a7fc700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 0x7fad9c1085b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fad90013560 tx=0x7fad90009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.060+0000 7fad83fff700 1 -- 172.21.15.152:0/1973582819 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad90018070 con 0x7fad9c0f8670 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.060+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c062760 con 0x7fad9c0f8670 2024-04-06T12:24:40.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.060+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c062d20 con 0x7fad9c0f8670 2024-04-06T12:24:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.061+0000 7fad83fff700 1 -- 172.21.15.152:0/1973582819 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad90007e90 con 0x7fad9c0f8670 2024-04-06T12:24:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.061+0000 7fad83fff700 1 -- 172.21.15.152:0/1973582819 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad90012e80 con 0x7fad9c0f8670 2024-04-06T12:24:40.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.062+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad88005150 con 0x7fad9c0f8670 2024-04-06T12:24:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.063+0000 7fad83fff700 1 -- 172.21.15.152:0/1973582819 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7fad900123c0 con 0x7fad9c0f8670 2024-04-06T12:24:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.063+0000 7fad83fff700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fad84066ca0 0x7fad84069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.063+0000 7fad83fff700 1 -- 172.21.15.152:0/1973582819 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fad90084de0 con 0x7fad9c0f8670 2024-04-06T12:24:40.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.064+0000 7fad9affd700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fad84066ca0 0x7fad84069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:40.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.064+0000 7fad9affd700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fad84066ca0 0x7fad84069160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fad9c05fa90 tx=0x7fad8c00b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:40.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.070+0000 7fad83fff700 1 -- 172.21.15.152:0/1973582819 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fad900530c0 con 0x7fad9c0f8670 2024-04-06T12:24:40.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.422+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad88000bf0 con 0x7fad84066ca0 2024-04-06T12:24:40.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.427+0000 7fad83fff700 1 -- 172.21.15.152:0/1973582819 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fad88000bf0 con 0x7fad84066ca0 2024-04-06T12:24:40.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.433+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fad84066ca0 msgr2=0x7fad84069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.433+0000 7fada1613700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fad84066ca0 0x7fad84069160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fad9c05fa90 tx=0x7fad8c00b040).stop 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.433+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 msgr2=0x7fad9c1085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.433+0000 7fada1613700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 0x7fad9c1085b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fad90013560 tx=0x7fad90009cb0).stop 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.434+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 shutdown_connections 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.434+0000 7fada1613700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fad84066ca0 0x7fad84069160 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.434+0000 7fada1613700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c0f7cd0 0x7fad9c1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.434+0000 7fada1613700 1 --2- 172.21.15.152:0/1973582819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad9c0f8670 0x7fad9c1085b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.434+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 >> 172.21.15.152:0/1973582819 conn(0x7fad9c0f15d0 msgr2=0x7fad9c0fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.436+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 shutdown_connections 2024-04-06T12:24:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.436+0000 7fada1613700 1 -- 172.21.15.152:0/1973582819 wait complete. 2024-04-06T12:24:40.465 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:24:40.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.593+0000 7f11a2703700 1 -- 172.21.15.152:0/1472423359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f7070 msgr2=0x7f119c0f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:40.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.593+0000 7f11a2703700 1 --2- 172.21.15.152:0/1472423359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f7070 0x7f119c0f74f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f11900048f0 tx=0x7f119000adc0).stop 2024-04-06T12:24:40.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.593+0000 7f11a2703700 1 -- 172.21.15.152:0/1472423359 shutdown_connections 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.593+0000 7f11a2703700 1 --2- 172.21.15.152:0/1472423359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f7070 0x7f119c0f74f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.593+0000 7f11a2703700 1 --2- 172.21.15.152:0/1472423359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0f5e70 0x7f119c0f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.593+0000 7f11a2703700 1 -- 172.21.15.152:0/1472423359 >> 172.21.15.152:0/1472423359 conn(0x7f119c0f15d0 msgr2=0x7f119c0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.593+0000 7f11a2703700 1 -- 172.21.15.152:0/1472423359 shutdown_connections 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.593+0000 7f11a2703700 1 -- 172.21.15.152:0/1472423359 wait complete. 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f11a2703700 1 Processor -- start 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f11a2703700 1 -- start start 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f11a2703700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f5e70 0x7f119c10a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f11a2703700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0f7070 0x7f119c10a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f11a2703700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c10ac50 con 0x7f119c0f5e70 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f11a2703700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c10ad90 con 0x7f119c0f7070 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f119bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f5e70 0x7f119c10a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f119bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f5e70 0x7f119c10a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34954/0 (socket says 172.21.15.152:34954) 2024-04-06T12:24:40.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f119bfff700 1 -- 172.21.15.152:0/157791591 learned_addr learned my addr 172.21.15.152:0/157791591 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.594+0000 7f119b7fe700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0f7070 0x7f119c10a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.595+0000 7f119bfff700 1 -- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0f7070 msgr2=0x7f119c10a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.595+0000 7f119bfff700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0f7070 0x7f119c10a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.595+0000 7f119bfff700 1 -- 172.21.15.152:0/157791591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190005040 con 0x7f119c0f5e70 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.595+0000 7f119bfff700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f5e70 0x7f119c10a1b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f118c00c740 tx=0x7f118c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.595+0000 7f11997fa700 1 -- 172.21.15.152:0/157791591 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c00e680 con 0x7f119c0f5e70 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.595+0000 7f11997fa700 1 -- 172.21.15.152:0/157791591 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f118c00ec90 con 0x7f119c0f5e70 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.595+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c10f830 con 0x7f119c0f5e70 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.595+0000 7f11997fa700 1 -- 172.21.15.152:0/157791591 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c013d30 con 0x7f119c0f5e70 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.595+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c10fdf0 con 0x7f119c0f5e70 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.596+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c0fddb0 con 0x7f119c0f5e70 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.597+0000 7f11997fa700 1 -- 172.21.15.152:0/157791591 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f118c013410 con 0x7f119c0f5e70 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.597+0000 7f11997fa700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1184066ca0 0x7f1184069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:40.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.597+0000 7f11997fa700 1 -- 172.21.15.152:0/157791591 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f118c084730 con 0x7f119c0f5e70 2024-04-06T12:24:40.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.598+0000 7f119b7fe700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1184066ca0 0x7f1184069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:40.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.598+0000 7f119b7fe700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1184066ca0 0x7f1184069160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f119000c3b0 tx=0x7f1190016040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:40.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.602+0000 7f11997fa700 1 -- 172.21.15.152:0/157791591 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f118c052a70 con 0x7f119c0f5e70 2024-04-06T12:24:40.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:39.592742+0000 mgr.smithi195.ausetj (mgr.24375) 121 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 236 op/s 2024-04-06T12:24:40.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:40.106397+0000 mon.smithi152 (mon.0) 708 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:40.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:40.112925+0000 mon.smithi152 (mon.0) 709 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:40.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:40.148134+0000 mon.smithi195 (mon.1) 75 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:24:40.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:40.520011+0000 mon.smithi152 (mon.0) 710 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:40.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:40.527756+0000 mon.smithi152 (mon.0) 711 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:40.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.909+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f119c059120 con 0x7f1184066ca0 2024-04-06T12:24:40.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.910+0000 7f11997fa700 1 -- 172.21.15.152:0/157791591 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f119c059120 con 0x7f1184066ca0 2024-04-06T12:24:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1184066ca0 msgr2=0x7f1184069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1184066ca0 0x7f1184069160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f119000c3b0 tx=0x7f1190016040).stop 2024-04-06T12:24:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f5e70 msgr2=0x7f119c10a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f5e70 0x7f119c10a1b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f118c00c740 tx=0x7f118c007ef0).stop 2024-04-06T12:24:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 shutdown_connections 2024-04-06T12:24:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f1184066ca0 0x7f1184069160 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c0f5e70 0x7f119c10a1b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 --2- 172.21.15.152:0/157791591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0f7070 0x7f119c10a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:40.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 >> 172.21.15.152:0/157791591 conn(0x7f119c0f15d0 msgr2=0x7f119c0fab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:40.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 shutdown_connections 2024-04-06T12:24:40.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:40.913+0000 7f11a2703700 1 -- 172.21.15.152:0/157791591 wait complete. 2024-04-06T12:24:41.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.050+0000 7fee02bb7700 1 -- 172.21.15.152:0/2642971361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedfc0f8740 msgr2=0x7fedfc0fabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:41.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.050+0000 7fee02bb7700 1 --2- 172.21.15.152:0/2642971361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedfc0f8740 0x7fedfc0fabd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fede80047f0 tx=0x7fede8009cb0).stop 2024-04-06T12:24:41.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.050+0000 7fee02bb7700 1 -- 172.21.15.152:0/2642971361 shutdown_connections 2024-04-06T12:24:41.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.050+0000 7fee02bb7700 1 --2- 172.21.15.152:0/2642971361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedfc0f8740 0x7fedfc0fabd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.050+0000 7fee02bb7700 1 --2- 172.21.15.152:0/2642971361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedfc061280 0x7fedfc0f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.050+0000 7fee02bb7700 1 -- 172.21.15.152:0/2642971361 >> 172.21.15.152:0/2642971361 conn(0x7fedfc0f1e50 msgr2=0x7fedfc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:39.592742+0000 mgr.smithi195.ausetj (mgr.24375) 121 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 236 op/s 2024-04-06T12:24:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:40.106397+0000 mon.smithi152 (mon.0) 708 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:40.112925+0000 mon.smithi152 (mon.0) 709 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:40.148134+0000 mon.smithi195 (mon.1) 75 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:24:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:40.520011+0000 mon.smithi152 (mon.0) 710 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:40.527756+0000 mon.smithi152 (mon.0) 711 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:41.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.052+0000 7fee02bb7700 1 -- 172.21.15.152:0/2642971361 shutdown_connections 2024-04-06T12:24:41.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.052+0000 7fee02bb7700 1 -- 172.21.15.152:0/2642971361 wait complete. 2024-04-06T12:24:41.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.052+0000 7fee02bb7700 1 Processor -- start 2024-04-06T12:24:41.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.052+0000 7fee02bb7700 1 -- start start 2024-04-06T12:24:41.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.053+0000 7fee02bb7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedfc061280 0x7fedfc069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:41.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.053+0000 7fee02bb7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedfc0f8740 0x7fedfc06a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:41.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.053+0000 7fee02bb7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc06a9b0 con 0x7fedfc061280 2024-04-06T12:24:41.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.053+0000 7fee02bb7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc06aaf0 con 0x7fedfc0f8740 2024-04-06T12:24:41.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.053+0000 7fedfbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedfc0f8740 0x7fedfc06a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:41.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.053+0000 7fedfbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedfc0f8740 0x7fedfc06a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:46730/0 (socket says 172.21.15.152:46730) 2024-04-06T12:24:41.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.053+0000 7fedfbfff700 1 -- 172.21.15.152:0/578617642 learned_addr learned my addr 172.21.15.152:0/578617642 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:41.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.054+0000 7fedfbfff700 1 -- 172.21.15.152:0/578617642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedfc061280 msgr2=0x7fedfc069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:41.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.054+0000 7fedfbfff700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedfc061280 0x7fedfc069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:24:41.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.054+0000 7fedfbfff700 1 -- 172.21.15.152:0/578617642 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede8005040 con 0x7fedfc0f8740 2024-04-06T12:24:41.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.054+0000 7fedfbfff700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedfc0f8740 0x7fedfc06a400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fede8013560 tx=0x7fede8009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:41.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.059+0000 7fedf9ffb700 1 -- 172.21.15.152:0/578617642 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede8018070 con 0x7fedfc0f8740 2024-04-06T12:24:41.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.059+0000 7fedf9ffb700 1 -- 172.21.15.152:0/578617642 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fede8007e90 con 0x7fedfc0f8740 2024-04-06T12:24:41.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.059+0000 7fedf9ffb700 1 -- 172.21.15.152:0/578617642 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede801c5e0 con 0x7fedfc0f8740 2024-04-06T12:24:41.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.059+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc0fc830 con 0x7fedfc0f8740 2024-04-06T12:24:41.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.059+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc0fcdf0 con 0x7fedfc0f8740 2024-04-06T12:24:41.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.060+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc1065c0 con 0x7fedfc0f8740 2024-04-06T12:24:41.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.061+0000 7fedf9ffb700 1 -- 172.21.15.152:0/578617642 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7fede80123c0 con 0x7fedfc0f8740 2024-04-06T12:24:41.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.061+0000 7fedf9ffb700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fedec066cf0 0x7fedec0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:41.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.061+0000 7fedf9ffb700 1 -- 172.21.15.152:0/578617642 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fede8084e40 con 0x7fedfc0f8740 2024-04-06T12:24:41.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.061+0000 7fee00953700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fedec066cf0 0x7fedec0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:41.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.062+0000 7fee00953700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fedec066cf0 0x7fedec0691b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fedf0004c60 tx=0x7fedf000b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:41.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.066+0000 7fedf9ffb700 1 -- 172.21.15.152:0/578617642 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fede8053140 con 0x7fedfc0f8740 2024-04-06T12:24:41.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.422+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fedfc059120 con 0x7fedec066cf0 2024-04-06T12:24:41.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.431+0000 7fedf9ffb700 1 -- 172.21.15.152:0/578617642 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fedfc059120 con 0x7fedec066cf0 2024-04-06T12:24:41.429 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 starting - - - - 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (9m) 2m ago 9m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (9m) 2m ago 9m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 starting - - - - 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (4m) 2m ago 4m 79.0M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (4m) 2m ago 4m 111M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (4m) 2m ago 4m 12.0M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (4m) 2m ago 4m 12.8M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 starting - - - - 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283 running (2m) 2m ago 9m 476M - 18.2.2-1086-g052adcad 87261d5ece5a 5089ad242cab 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (11m) 2m ago 11m 47.7M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (9m) 2m ago 9m 39.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:24:41.430 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 starting - - - - 2024-04-06T12:24:41.431 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 starting - - - - 2024-04-06T12:24:41.431 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (8m) 2m ago 8m 63.4M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:24:41.431 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (7m) 2m ago 7m 62.1M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:24:41.431 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (7m) 2m ago 7m 53.4M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:24:41.431 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (7m) 2m ago 7m 64.5M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:24:41.431 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (6m) 2m ago 6m 57.7M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:24:41.431 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (6m) 2m ago 6m 58.3M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:24:41.431 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 starting - - - - 2024-04-06T12:24:41.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.434+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fedec066cf0 msgr2=0x7fedec0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.434+0000 7fee02bb7700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fedec066cf0 0x7fedec0691b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fedf0004c60 tx=0x7fedf000b040).stop 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.434+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedfc0f8740 msgr2=0x7fedfc06a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.434+0000 7fee02bb7700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedfc0f8740 0x7fedfc06a400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fede8013560 tx=0x7fede8009cb0).stop 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.435+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 shutdown_connections 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.435+0000 7fee02bb7700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fedec066cf0 0x7fedec0691b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.435+0000 7fee02bb7700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedfc061280 0x7fedfc069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.435+0000 7fee02bb7700 1 --2- 172.21.15.152:0/578617642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedfc0f8740 0x7fedfc06a400 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.435+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 >> 172.21.15.152:0/578617642 conn(0x7fedfc0f1e50 msgr2=0x7fedfc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.435+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 shutdown_connections 2024-04-06T12:24:41.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.435+0000 7fee02bb7700 1 -- 172.21.15.152:0/578617642 wait complete. 2024-04-06T12:24:41.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.563+0000 7fe5c2166700 1 -- 172.21.15.152:0/2228593832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5bc0f79b0 msgr2=0x7fe5bc0f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:41.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.563+0000 7fe5c2166700 1 --2- 172.21.15.152:0/2228593832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5bc0f79b0 0x7fe5bc0f7e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fe5b00047f0 tx=0x7fe5b0009cb0).stop 2024-04-06T12:24:41.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.563+0000 7fe5c2166700 1 -- 172.21.15.152:0/2228593832 shutdown_connections 2024-04-06T12:24:41.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.563+0000 7fe5c2166700 1 --2- 172.21.15.152:0/2228593832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5bc0f79b0 0x7fe5bc0f7e10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.563+0000 7fe5c2166700 1 --2- 172.21.15.152:0/2228593832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5bc0f6710 0x7fe5bc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.563+0000 7fe5c2166700 1 -- 172.21.15.152:0/2228593832 >> 172.21.15.152:0/2228593832 conn(0x7fe5bc0f1e70 msgr2=0x7fe5bc0f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:41.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.564+0000 7fe5c2166700 1 -- 172.21.15.152:0/2228593832 shutdown_connections 2024-04-06T12:24:41.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.564+0000 7fe5c2166700 1 -- 172.21.15.152:0/2228593832 wait complete. 2024-04-06T12:24:41.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.564+0000 7fe5c2166700 1 Processor -- start 2024-04-06T12:24:41.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.564+0000 7fe5c2166700 1 -- start start 2024-04-06T12:24:41.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5c2166700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5bc0f6710 0x7fe5bc0610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:41.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5c2166700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5bc0f79b0 0x7fe5bc10f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:41.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5c2166700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc108c50 con 0x7fe5bc0f79b0 2024-04-06T12:24:41.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5c2166700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc10f760 con 0x7fe5bc0f6710 2024-04-06T12:24:41.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5bb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5bc0f6710 0x7fe5bc0610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5bb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5bc0f6710 0x7fe5bc0610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:46752/0 (socket says 172.21.15.152:46752) 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5bb7fe700 1 -- 172.21.15.152:0/4158799267 learned_addr learned my addr 172.21.15.152:0/4158799267 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5baffd700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5bc0f79b0 0x7fe5bc10f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5bb7fe700 1 -- 172.21.15.152:0/4158799267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5bc0f79b0 msgr2=0x7fe5bc10f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5bb7fe700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5bc0f79b0 0x7fe5bc10f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5bb7fe700 1 -- 172.21.15.152:0/4158799267 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0005040 con 0x7fe5bc0f6710 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5bb7fe700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5bc0f6710 0x7fe5bc0610a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe5ac00e8c0 tx=0x7fe5ac00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.565+0000 7fe5b8ff9700 1 -- 172.21.15.152:0/4158799267 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ac00ee60 con 0x7fe5bc0f6710 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.566+0000 7fe5b8ff9700 1 -- 172.21.15.152:0/4158799267 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5ac00f040 con 0x7fe5bc0f6710 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.566+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc10f900 con 0x7fe5bc0f6710 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.566+0000 7fe5b8ff9700 1 -- 172.21.15.152:0/4158799267 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ac00c810 con 0x7fe5bc0f6710 2024-04-06T12:24:41.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.567+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc10fe90 con 0x7fe5bc0f6710 2024-04-06T12:24:41.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.567+0000 7fe5b8ff9700 1 -- 172.21.15.152:0/4158799267 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7fe5ac007b40 con 0x7fe5bc0f6710 2024-04-06T12:24:41.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.568+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc0feed0 con 0x7fe5bc0f6710 2024-04-06T12:24:41.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.568+0000 7fe5b8ff9700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe5a4066ca0 0x7fe5a4069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:41.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.568+0000 7fe5b8ff9700 1 -- 172.21.15.152:0/4158799267 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fe5ac085c90 con 0x7fe5bc0f6710 2024-04-06T12:24:41.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.568+0000 7fe5baffd700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe5a4066ca0 0x7fe5a4069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:41.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.568+0000 7fe5baffd700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe5a4066ca0 0x7fe5a4069160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe5b0004540 tx=0x7fe5b000b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.573+0000 7fe5b8ff9700 1 -- 172.21.15.152:0/4158799267 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fe5ac089060 con 0x7fe5bc0f6710 2024-04-06T12:24:41.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.931+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe5bc100d40 con 0x7fe5bc0f6710 2024-04-06T12:24:41.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.931+0000 7fe5b8ff9700 1 -- 172.21.15.152:0/4158799267 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fe5ac051d60 con 0x7fe5bc0f6710 2024-04-06T12:24:41.929 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:24:41.929 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:24:41.930 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-04-06T12:24:41.931 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:24:41.931 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:24:41.931 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:24:41.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.934+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe5a4066ca0 msgr2=0x7fe5a4069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:41.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.934+0000 7fe5c2166700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe5a4066ca0 0x7fe5a4069160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe5b0004540 tx=0x7fe5b000b040).stop 2024-04-06T12:24:41.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.934+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5bc0f6710 msgr2=0x7fe5bc0610a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:41.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.934+0000 7fe5c2166700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5bc0f6710 0x7fe5bc0610a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe5ac00e8c0 tx=0x7fe5ac00b040).stop 2024-04-06T12:24:41.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.934+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 shutdown_connections 2024-04-06T12:24:41.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.934+0000 7fe5c2166700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7fe5a4066ca0 0x7fe5a4069160 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.934+0000 7fe5c2166700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5bc0f6710 0x7fe5bc0610a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.934+0000 7fe5c2166700 1 --2- 172.21.15.152:0/4158799267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5bc0f79b0 0x7fe5bc10f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:41.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.934+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 >> 172.21.15.152:0/4158799267 conn(0x7fe5bc0f1e70 msgr2=0x7fe5bc0fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:41.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.935+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 shutdown_connections 2024-04-06T12:24:41.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:41.935+0000 7fe5c2166700 1 -- 172.21.15.152:0/4158799267 wait complete. 2024-04-06T12:24:42.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:41 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:40.424981+0000 mgr.smithi195.ausetj (mgr.24375) 122 : audit [DBG] from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:42.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:40.424981+0000 mgr.smithi195.ausetj (mgr.24375) 122 : audit [DBG] from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:42.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.051+0000 7f372e317700 1 -- 172.21.15.152:0/1133928733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 msgr2=0x7f37280f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:42.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.051+0000 7f372e317700 1 --2- 172.21.15.152:0/1133928733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 0x7f37280f7e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f37180047f0 tx=0x7f3718009cb0).stop 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.051+0000 7f372e317700 1 -- 172.21.15.152:0/1133928733 shutdown_connections 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.051+0000 7f372e317700 1 --2- 172.21.15.152:0/1133928733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37280f8cb0 0x7f37280f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.051+0000 7f372e317700 1 --2- 172.21.15.152:0/1133928733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 0x7f37280f7e30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.051+0000 7f372e317700 1 -- 172.21.15.152:0/1133928733 >> 172.21.15.152:0/1133928733 conn(0x7f37280f3150 msgr2=0x7f37280f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.051+0000 7f372e317700 1 -- 172.21.15.152:0/1133928733 shutdown_connections 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.051+0000 7f372e317700 1 -- 172.21.15.152:0/1133928733 wait complete. 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.052+0000 7f372e317700 1 Processor -- start 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.052+0000 7f372e317700 1 -- start start 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.052+0000 7f372e317700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 0x7f37281082e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.052+0000 7f372e317700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37280f8cb0 0x7f37281087d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.052+0000 7f372e317700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3728108d80 con 0x7f37280f7a10 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.052+0000 7f372e317700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3728108ec0 con 0x7f37280f8cb0 2024-04-06T12:24:42.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.052+0000 7f3727fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 0x7f37281082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.052+0000 7f3727fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 0x7f37281082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35004/0 (socket says 172.21.15.152:35004) 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.052+0000 7f3727fff700 1 -- 172.21.15.152:0/3912289184 learned_addr learned my addr 172.21.15.152:0/3912289184 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f37277fe700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37280f8cb0 0x7f37281087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f3727fff700 1 -- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37280f8cb0 msgr2=0x7f37281087d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f3727fff700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37280f8cb0 0x7f37281087d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f3727fff700 1 -- 172.21.15.152:0/3912289184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3718005040 con 0x7f37280f7a10 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f37277fe700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37280f8cb0 0x7f37281087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f3727fff700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 0x7f37281082e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f3718013560 tx=0x7f3718009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f37257fa700 1 -- 172.21.15.152:0/3912289184 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3718018070 con 0x7f37280f7a10 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f37257fa700 1 -- 172.21.15.152:0/3912289184 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3718007e90 con 0x7f37280f7a10 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372810d900 con 0x7f37280f7a10 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f37257fa700 1 -- 172.21.15.152:0/3912289184 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371801c5e0 con 0x7f37280f7a10 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.053+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372810dec0 con 0x7f37280f7a10 2024-04-06T12:24:42.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.054+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372805fb50 con 0x7f37280f7a10 2024-04-06T12:24:42.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.055+0000 7f37257fa700 1 -- 172.21.15.152:0/3912289184 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f37180123c0 con 0x7f37280f7a10 2024-04-06T12:24:42.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.055+0000 7f37257fa700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f3710066ca0 0x7f3710069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:24:42.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.055+0000 7f37257fa700 1 -- 172.21.15.152:0/3912289184 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f3718084f20 con 0x7f37280f7a10 2024-04-06T12:24:42.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.055+0000 7f37277fe700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f3710066ca0 0x7f3710069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:24:42.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.056+0000 7f37277fe700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f3710066ca0 0x7f3710069160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f371c007fd0 tx=0x7f371c00b040).ready entity=mgr.24375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:24:42.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.063+0000 7f37257fa700 1 -- 172.21.15.152:0/3912289184 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f37180b8390 con 0x7f37280f7a10 2024-04-06T12:24:42.469 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:24:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:24:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:24:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:24:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2024-04-06T12:24:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "", 2024-04-06T12:24:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading mgr daemons", 2024-04-06T12:24:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:24:42.470 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:24:42.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.381+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 --> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3728059120 con 0x7f3710066ca0 2024-04-06T12:24:42.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.382+0000 7f37257fa700 1 -- 172.21.15.152:0/3912289184 <== mgr.24375 v2:172.21.15.195:6828/929884390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f3728059120 con 0x7f3710066ca0 2024-04-06T12:24:42.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.384+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f3710066ca0 msgr2=0x7f3710069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:42.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.384+0000 7f372e317700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f3710066ca0 0x7f3710069160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f371c007fd0 tx=0x7f371c00b040).stop 2024-04-06T12:24:42.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.384+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 msgr2=0x7f37281082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:24:42.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.384+0000 7f372e317700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 0x7f37281082e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f3718013560 tx=0x7f3718009cb0).stop 2024-04-06T12:24:42.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.385+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 shutdown_connections 2024-04-06T12:24:42.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.385+0000 7f372e317700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:6828/929884390,v1:172.21.15.195:6829/929884390] conn(0x7f3710066ca0 0x7f3710069160 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:42.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.385+0000 7f372e317700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37280f7a10 0x7f37281082e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:42.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.385+0000 7f372e317700 1 --2- 172.21.15.152:0/3912289184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37280f8cb0 0x7f37281087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:24:42.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.385+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 >> 172.21.15.152:0/3912289184 conn(0x7f37280f3150 msgr2=0x7f37280fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:24:42.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.385+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 shutdown_connections 2024-04-06T12:24:42.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:24:42.385+0000 7f372e317700 1 -- 172.21.15.152:0/3912289184 wait complete. 2024-04-06T12:24:43.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:40.910939+0000 mgr.smithi195.ausetj (mgr.24375) 123 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:43.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:41.424570+0000 mgr.smithi195.ausetj (mgr.24375) 124 : audit [DBG] from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:43.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:41.593181+0000 mgr.smithi195.ausetj (mgr.24375) 125 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-06T12:24:43.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:41.932566+0000 mon.smithi195 (mon.1) 76 : audit [DBG] from='client.? 172.21.15.152:0/4158799267' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:24:43.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:40.910939+0000 mgr.smithi195.ausetj (mgr.24375) 123 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:43.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:41.424570+0000 mgr.smithi195.ausetj (mgr.24375) 124 : audit [DBG] from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:43.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:41.593181+0000 mgr.smithi195.ausetj (mgr.24375) 125 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-06T12:24:43.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:41.932566+0000 mon.smithi195 (mon.1) 76 : audit [DBG] from='client.? 172.21.15.152:0/4158799267' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:24:43.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:43 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:42.383345+0000 mgr.smithi195.ausetj (mgr.24375) 126 : audit [DBG] from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:44.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:42.383345+0000 mgr.smithi195.ausetj (mgr.24375) 126 : audit [DBG] from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:24:44.731 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:43.593509+0000 mgr.smithi195.ausetj (mgr.24375) 127 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-06T12:24:44.731 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:44.476791+0000 mon.smithi152 (mon.0) 712 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:44.732 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:44.485413+0000 mon.smithi152 (mon.0) 713 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:45.013 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:43.593509+0000 mgr.smithi195.ausetj (mgr.24375) 127 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-06T12:24:45.013 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:44.476791+0000 mon.smithi152 (mon.0) 712 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:45.013 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:44.485413+0000 mon.smithi152 (mon.0) 713 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:45.014 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-06T12:24:45.015 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-06T12:24:45.348 DEBUG:teuthology.parallel:result is None 2024-04-06T12:24:46.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:45.593948+0000 mgr.smithi195.ausetj (mgr.24375) 128 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-04-06T12:24:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:45.593948+0000 mgr.smithi195.ausetj (mgr.24375) 128 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-04-06T12:24:48.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:47.594323+0000 mgr.smithi195.ausetj (mgr.24375) 129 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-04-06T12:24:48.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:47.789683+0000 mon.smithi195 (mon.1) 77 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:48.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:48.215428+0000 mon.smithi152 (mon.0) 714 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:48.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:48.222108+0000 mon.smithi152 (mon.0) 715 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:49.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:47.594323+0000 mgr.smithi195.ausetj (mgr.24375) 129 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-04-06T12:24:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:47.789683+0000 mon.smithi195 (mon.1) 77 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:48.215428+0000 mon.smithi152 (mon.0) 714 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:48.222108+0000 mon.smithi152 (mon.0) 715 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:50.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:49.109098+0000 mon.smithi152 (mon.0) 716 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:50.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:49.115229+0000 mon.smithi152 (mon.0) 717 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:50.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:49.220951+0000 mon.smithi152 (mon.0) 718 : cluster [DBG] Standby manager daemon smithi152.lynahm restarted 2024-04-06T12:24:50.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:49.221073+0000 mon.smithi152 (mon.0) 719 : cluster [DBG] Standby manager daemon smithi152.lynahm started 2024-04-06T12:24:50.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:49.223379+0000 mon.smithi195 (mon.1) 78 : audit [DBG] from='mgr.? 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.lynahm/crt"}]: dispatch 2024-04-06T12:24:50.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:49.223793+0000 mon.smithi195 (mon.1) 79 : audit [DBG] from='mgr.? 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:24:50.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:49.228929+0000 mon.smithi195 (mon.1) 80 : audit [DBG] from='mgr.? 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.lynahm/key"}]: dispatch 2024-04-06T12:24:50.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:49.230952+0000 mon.smithi195 (mon.1) 81 : audit [DBG] from='mgr.? 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:24:50.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:49.594944+0000 mgr.smithi195.ausetj (mgr.24375) 130 : cluster [DBG] pgmap v81: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 187 op/s 2024-04-06T12:24:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:49.109098+0000 mon.smithi152 (mon.0) 716 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:49.115229+0000 mon.smithi152 (mon.0) 717 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:49.220951+0000 mon.smithi152 (mon.0) 718 : cluster [DBG] Standby manager daemon smithi152.lynahm restarted 2024-04-06T12:24:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:49.221073+0000 mon.smithi152 (mon.0) 719 : cluster [DBG] Standby manager daemon smithi152.lynahm started 2024-04-06T12:24:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:49.223379+0000 mon.smithi195 (mon.1) 78 : audit [DBG] from='mgr.? 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.lynahm/crt"}]: dispatch 2024-04-06T12:24:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:49.223793+0000 mon.smithi195 (mon.1) 79 : audit [DBG] from='mgr.? 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:24:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:49.228929+0000 mon.smithi195 (mon.1) 80 : audit [DBG] from='mgr.? 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.lynahm/key"}]: dispatch 2024-04-06T12:24:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:49.230952+0000 mon.smithi195 (mon.1) 81 : audit [DBG] from='mgr.? 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:24:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:49.594944+0000 mgr.smithi195.ausetj (mgr.24375) 130 : cluster [DBG] pgmap v81: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 187 op/s 2024-04-06T12:24:51.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:50.122112+0000 mon.smithi152 (mon.0) 720 : cluster [DBG] mgrmap e26: smithi195.ausetj(active, since 2m), standbys: smithi152.lynahm 2024-04-06T12:24:51.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:50.122112+0000 mon.smithi152 (mon.0) 720 : cluster [DBG] mgrmap e26: smithi195.ausetj(active, since 2m), standbys: smithi152.lynahm 2024-04-06T12:24:52.457 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:51.595245+0000 mgr.smithi195.ausetj (mgr.24375) 131 : cluster [DBG] pgmap v82: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 112 op/s 2024-04-06T12:24:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:51.595245+0000 mgr.smithi195.ausetj (mgr.24375) 131 : cluster [DBG] pgmap v82: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 112 op/s 2024-04-06T12:24:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:52.943685+0000 mon.smithi152 (mon.0) 721 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:52.949808+0000 mon.smithi152 (mon.0) 722 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:52.951123+0000 mon.smithi195 (mon.1) 82 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:24:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:52.951791+0000 mon.smithi195 (mon.1) 83 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:24:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:52.956113+0000 mon.smithi152 (mon.0) 723 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.093784+0000 mon.smithi195 (mon.1) 84 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:24:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.098687+0000 mon.smithi195 (mon.1) 85 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr fail", "who": "smithi195.ausetj"}]: dispatch 2024-04-06T12:24:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.098988+0000 mon.smithi152 (mon.0) 724 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr fail", "who": "smithi195.ausetj"}]: dispatch 2024-04-06T12:24:54.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:53.104536+0000 mon.smithi152 (mon.0) 725 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.104767+0000 mon.smithi152 (mon.0) 726 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd='[{"prefix": "mgr fail", "who": "smithi195.ausetj"}]': finished 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:53.104833+0000 mon.smithi152 (mon.0) 727 : cluster [DBG] mgrmap e27: smithi152.lynahm(active, starting, since 0.00545149s) 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.108406+0000 mon.smithi152 (mon.0) 728 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.108615+0000 mon.smithi152 (mon.0) 729 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.108809+0000 mon.smithi152 (mon.0) 730 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.109118+0000 mon.smithi152 (mon.0) 731 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.109393+0000 mon.smithi152 (mon.0) 732 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.109665+0000 mon.smithi152 (mon.0) 733 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.109940+0000 mon.smithi152 (mon.0) 734 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.110168+0000 mon.smithi152 (mon.0) 735 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.110383+0000 mon.smithi152 (mon.0) 736 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.110624+0000 mon.smithi152 (mon.0) 737 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:24:54.278 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.110874+0000 mon.smithi152 (mon.0) 738 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.111171+0000 mon.smithi152 (mon.0) 739 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.111443+0000 mon.smithi152 (mon.0) 740 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.111670+0000 mon.smithi152 (mon.0) 741 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.111931+0000 mon.smithi152 (mon.0) 742 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.112527+0000 mon.smithi152 (mon.0) 743 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:53.145172+0000 mon.smithi152 (mon.0) 744 : cluster [INF] Manager daemon smithi152.lynahm is now available 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.177802+0000 mon.smithi152 (mon.0) 745 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.214208+0000 mon.smithi152 (mon.0) 746 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.248517+0000 mon.smithi152 (mon.0) 747 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:24:54.279 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:53.313452+0000 mon.smithi152 (mon.0) 748 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/trash_purge_schedule"}]: dispatch 2024-04-06T12:24:54.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:52.943685+0000 mon.smithi152 (mon.0) 721 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:54.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:52.949808+0000 mon.smithi152 (mon.0) 722 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:54.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:52.951123+0000 mon.smithi195 (mon.1) 82 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:24:54.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:52.951791+0000 mon.smithi195 (mon.1) 83 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:24:54.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:52.956113+0000 mon.smithi152 (mon.0) 723 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' 2024-04-06T12:24:54.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.093784+0000 mon.smithi195 (mon.1) 84 : audit [DBG] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:24:54.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.098687+0000 mon.smithi195 (mon.1) 85 : audit [INF] from='mgr.24375 172.21.15.195:0/2146732194' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr fail", "who": "smithi195.ausetj"}]: dispatch 2024-04-06T12:24:54.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.098988+0000 mon.smithi152 (mon.0) 724 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "mgr fail", "who": "smithi195.ausetj"}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:53.104536+0000 mon.smithi152 (mon.0) 725 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.104767+0000 mon.smithi152 (mon.0) 726 : audit [INF] from='mgr.24375 ' entity='mgr.smithi195.ausetj' cmd='[{"prefix": "mgr fail", "who": "smithi195.ausetj"}]': finished 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:53.104833+0000 mon.smithi152 (mon.0) 727 : cluster [DBG] mgrmap e27: smithi152.lynahm(active, starting, since 0.00545149s) 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.108406+0000 mon.smithi152 (mon.0) 728 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.108615+0000 mon.smithi152 (mon.0) 729 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.108809+0000 mon.smithi152 (mon.0) 730 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.109118+0000 mon.smithi152 (mon.0) 731 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.109393+0000 mon.smithi152 (mon.0) 732 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.109665+0000 mon.smithi152 (mon.0) 733 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.109940+0000 mon.smithi152 (mon.0) 734 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.110168+0000 mon.smithi152 (mon.0) 735 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.110383+0000 mon.smithi152 (mon.0) 736 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.110624+0000 mon.smithi152 (mon.0) 737 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.110874+0000 mon.smithi152 (mon.0) 738 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:24:54.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.111171+0000 mon.smithi152 (mon.0) 739 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:24:54.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.111443+0000 mon.smithi152 (mon.0) 740 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:24:54.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.111670+0000 mon.smithi152 (mon.0) 741 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:24:54.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.111931+0000 mon.smithi152 (mon.0) 742 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:24:54.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.112527+0000 mon.smithi152 (mon.0) 743 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:24:54.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:53.145172+0000 mon.smithi152 (mon.0) 744 : cluster [INF] Manager daemon smithi152.lynahm is now available 2024-04-06T12:24:54.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.177802+0000 mon.smithi152 (mon.0) 745 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:24:54.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.214208+0000 mon.smithi152 (mon.0) 746 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:24:54.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.248517+0000 mon.smithi152 (mon.0) 747 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:24:54.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:53.313452+0000 mon.smithi152 (mon.0) 748 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/trash_purge_schedule"}]: dispatch 2024-04-06T12:24:55.231 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:53.685297+0000 mgr.smithi152.lynahm (mgr.24477) 1 : cephadm [INF] [06/Apr/2024:12:24:53] ENGINE Bus STARTING 2024-04-06T12:24:55.231 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:53.787410+0000 mgr.smithi152.lynahm (mgr.24477) 2 : cephadm [INF] [06/Apr/2024:12:24:53] ENGINE Serving on http://172.21.15.152:8765 2024-04-06T12:24:55.231 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:53.905588+0000 mgr.smithi152.lynahm (mgr.24477) 3 : cephadm [INF] [06/Apr/2024:12:24:53] ENGINE Serving on https://172.21.15.152:7150 2024-04-06T12:24:55.231 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:24:53.905754+0000 mgr.smithi152.lynahm (mgr.24477) 4 : cephadm [INF] [06/Apr/2024:12:24:53] ENGINE Bus STARTED 2024-04-06T12:24:55.231 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:54.107851+0000 mon.smithi152 (mon.0) 749 : cluster [DBG] mgrmap e28: smithi152.lynahm(active, since 1.00846s) 2024-04-06T12:24:55.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:53.685297+0000 mgr.smithi152.lynahm (mgr.24477) 1 : cephadm [INF] [06/Apr/2024:12:24:53] ENGINE Bus STARTING 2024-04-06T12:24:55.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:53.787410+0000 mgr.smithi152.lynahm (mgr.24477) 2 : cephadm [INF] [06/Apr/2024:12:24:53] ENGINE Serving on http://172.21.15.152:8765 2024-04-06T12:24:55.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:53.905588+0000 mgr.smithi152.lynahm (mgr.24477) 3 : cephadm [INF] [06/Apr/2024:12:24:53] ENGINE Serving on https://172.21.15.152:7150 2024-04-06T12:24:55.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:24:53.905754+0000 mgr.smithi152.lynahm (mgr.24477) 4 : cephadm [INF] [06/Apr/2024:12:24:53] ENGINE Bus STARTED 2024-04-06T12:24:55.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:54.107851+0000 mon.smithi152 (mon.0) 749 : cluster [DBG] mgrmap e28: smithi152.lynahm(active, since 1.00846s) 2024-04-06T12:24:56.004 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:54.120251+0000 mgr.smithi152.lynahm (mgr.24477) 5 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:24:56.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:55 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:54.120251+0000 mgr.smithi152.lynahm (mgr.24477) 5 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:24:57.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:55.111294+0000 mgr.smithi152.lynahm (mgr.24477) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:24:57.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:56.111608+0000 mon.smithi152 (mon.0) 750 : cluster [DBG] mgrmap e29: smithi152.lynahm(active, since 3s) 2024-04-06T12:24:57.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:55.111294+0000 mgr.smithi152.lynahm (mgr.24477) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:24:57.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:56.111608+0000 mon.smithi152 (mon.0) 750 : cluster [DBG] mgrmap e29: smithi152.lynahm(active, since 3s) 2024-04-06T12:24:58.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:57.111632+0000 mgr.smithi152.lynahm (mgr.24477) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:24:58.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:57.534316+0000 mon.smithi152 (mon.0) 751 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:24:58.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:57.540041+0000 mon.smithi152 (mon.0) 752 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:24:58.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:58.223396+0000 mon.smithi152 (mon.0) 753 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:24:58.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:24:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:24:58.228012+0000 mon.smithi152 (mon.0) 754 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:24:59.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:57.111632+0000 mgr.smithi152.lynahm (mgr.24477) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:24:59.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:57.534316+0000 mon.smithi152 (mon.0) 751 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:24:59.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:57.540041+0000 mon.smithi152 (mon.0) 752 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:24:59.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:58.223396+0000 mon.smithi152 (mon.0) 753 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:24:59.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:24:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:24:58.228012+0000 mon.smithi152 (mon.0) 754 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:00.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:24:59.112092+0000 mgr.smithi152.lynahm (mgr.24477) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 404 op/s 2024-04-06T12:25:00.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:00.294427+0000 mon.smithi152 (mon.0) 755 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:00.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:00.299755+0000 mon.smithi152 (mon.0) 756 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:01.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:24:59.112092+0000 mgr.smithi152.lynahm (mgr.24477) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 404 op/s 2024-04-06T12:25:01.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:00.294427+0000 mon.smithi152 (mon.0) 755 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:01.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:00.299755+0000 mon.smithi152 (mon.0) 756 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:01.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:00.740320+0000 mon.smithi152 (mon.0) 757 : cluster [DBG] Standby manager daemon smithi195.ausetj started 2024-04-06T12:25:01.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:00.742856+0000 mon.smithi195 (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.195:0/3535634515' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:25:01.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:00.743683+0000 mon.smithi195 (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.195:0/3535634515' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:25:01.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:00.746022+0000 mon.smithi195 (mon.1) 88 : audit [DBG] from='mgr.? 172.21.15.195:0/3535634515' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:25:01.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:00.746319+0000 mon.smithi195 (mon.1) 89 : audit [DBG] from='mgr.? 172.21.15.195:0/3535634515' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:25:01.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:01.087908+0000 mon.smithi152 (mon.0) 758 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:01.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:01.092471+0000 mon.smithi152 (mon.0) 759 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:02.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:00.740320+0000 mon.smithi152 (mon.0) 757 : cluster [DBG] Standby manager daemon smithi195.ausetj started 2024-04-06T12:25:02.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:00.742856+0000 mon.smithi195 (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.195:0/3535634515' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:25:02.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:00.743683+0000 mon.smithi195 (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.195:0/3535634515' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:25:02.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:00.746022+0000 mon.smithi195 (mon.1) 88 : audit [DBG] from='mgr.? 172.21.15.195:0/3535634515' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:25:02.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:00.746319+0000 mon.smithi195 (mon.1) 89 : audit [DBG] from='mgr.? 172.21.15.195:0/3535634515' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:25:02.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:01.087908+0000 mon.smithi152 (mon.0) 758 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:02.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:01.092471+0000 mon.smithi152 (mon.0) 759 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:02.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:01.112555+0000 mgr.smithi152.lynahm (mgr.24477) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 491 op/s 2024-04-06T12:25:02.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:01.553173+0000 mon.smithi152 (mon.0) 760 : cluster [DBG] mgrmap e30: smithi152.lynahm(active, since 8s), standbys: smithi195.ausetj 2024-04-06T12:25:02.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:01.553317+0000 mon.smithi152 (mon.0) 761 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi195.ausetj", "id": "smithi195.ausetj"}]: dispatch 2024-04-06T12:25:03.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:01.112555+0000 mgr.smithi152.lynahm (mgr.24477) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 491 op/s 2024-04-06T12:25:03.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:01.553173+0000 mon.smithi152 (mon.0) 760 : cluster [DBG] mgrmap e30: smithi152.lynahm(active, since 8s), standbys: smithi195.ausetj 2024-04-06T12:25:03.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:01.553317+0000 mon.smithi152 (mon.0) 761 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi195.ausetj", "id": "smithi195.ausetj"}]: dispatch 2024-04-06T12:25:04.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:03.112900+0000 mgr.smithi152.lynahm (mgr.24477) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-04-06T12:25:05.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:03.112900+0000 mgr.smithi152.lynahm (mgr.24477) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-04-06T12:25:07.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:05.113336+0000 mgr.smithi152.lynahm (mgr.24477) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 424 op/s 2024-04-06T12:25:07.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:05.113336+0000 mgr.smithi152.lynahm (mgr.24477) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 424 op/s 2024-04-06T12:25:09.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:07.113659+0000 mgr.smithi152.lynahm (mgr.24477) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 389 op/s 2024-04-06T12:25:09.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:08.212786+0000 mon.smithi152 (mon.0) 762 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:25:09.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:07.113659+0000 mgr.smithi152.lynahm (mgr.24477) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 389 op/s 2024-04-06T12:25:09.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:08.212786+0000 mon.smithi152 (mon.0) 762 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:25:10.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:09.114089+0000 mgr.smithi152.lynahm (mgr.24477) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 443 op/s 2024-04-06T12:25:10.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:10.377669+0000 mon.smithi152 (mon.0) 763 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:10.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:10.382735+0000 mon.smithi152 (mon.0) 764 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:10.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:10.383970+0000 mon.smithi152 (mon.0) 765 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:25:10.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:10.384745+0000 mon.smithi152 (mon.0) 766 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:25:11.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:09.114089+0000 mgr.smithi152.lynahm (mgr.24477) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 443 op/s 2024-04-06T12:25:11.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:10.377669+0000 mon.smithi152 (mon.0) 763 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:11.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:10.382735+0000 mon.smithi152 (mon.0) 764 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:11.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:10.383970+0000 mon.smithi152 (mon.0) 765 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:25:11.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:10.384745+0000 mon.smithi152 (mon.0) 766 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:25:12.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:10.385860+0000 mgr.smithi152.lynahm (mgr.24477) 14 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:25:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:10.386058+0000 mgr.smithi152.lynahm (mgr.24477) 15 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:25:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:10.700586+0000 mgr.smithi152.lynahm (mgr.24477) 16 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:25:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:10.703233+0000 mgr.smithi152.lynahm (mgr.24477) 17 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:25:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:10.965067+0000 mgr.smithi152.lynahm (mgr.24477) 18 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:25:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:11.497864+0000 mon.smithi152 (mon.0) 767 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:11.500684+0000 mon.smithi152 (mon.0) 768 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:11.504375+0000 mon.smithi152 (mon.0) 769 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:11.507804+0000 mon.smithi152 (mon.0) 770 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:11.512112+0000 mon.smithi152 (mon.0) 771 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:10.385860+0000 mgr.smithi152.lynahm (mgr.24477) 14 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:25:12.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:10.386058+0000 mgr.smithi152.lynahm (mgr.24477) 15 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:25:12.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:10.700586+0000 mgr.smithi152.lynahm (mgr.24477) 16 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:25:12.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:10.703233+0000 mgr.smithi152.lynahm (mgr.24477) 17 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:25:12.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:10.965067+0000 mgr.smithi152.lynahm (mgr.24477) 18 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:25:12.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:11.497864+0000 mon.smithi152 (mon.0) 767 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:11.500684+0000 mon.smithi152 (mon.0) 768 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:11.504375+0000 mon.smithi152 (mon.0) 769 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:11.507804+0000 mon.smithi152 (mon.0) 770 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:11.512112+0000 mon.smithi152 (mon.0) 771 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:12.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.509+0000 7f5df2be6700 1 -- 172.21.15.152:0/1931851631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dec0f8aa0 msgr2=0x7f5dec0f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:12.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.509+0000 7f5df2be6700 1 --2- 172.21.15.152:0/1931851631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dec0f8aa0 0x7f5dec0f8f00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f5dd80047f0 tx=0x7f5dd8009cb0).stop 2024-04-06T12:25:12.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.509+0000 7f5df2be6700 1 -- 172.21.15.152:0/1931851631 shutdown_connections 2024-04-06T12:25:12.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.509+0000 7f5df2be6700 1 --2- 172.21.15.152:0/1931851631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dec0f8aa0 0x7f5dec0f8f00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:12.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.509+0000 7f5df2be6700 1 --2- 172.21.15.152:0/1931851631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec0f7800 0x7f5dec0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:12.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.509+0000 7f5df2be6700 1 -- 172.21.15.152:0/1931851631 >> 172.21.15.152:0/1931851631 conn(0x7f5dec0f2f80 msgr2=0x7f5dec0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:12.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.509+0000 7f5df2be6700 1 -- 172.21.15.152:0/1931851631 shutdown_connections 2024-04-06T12:25:12.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.509+0000 7f5df2be6700 1 -- 172.21.15.152:0/1931851631 wait complete. 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5df2be6700 1 Processor -- start 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5df2be6700 1 -- start start 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5df2be6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec0f7800 0x7f5dec06c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5df2be6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dec0f8aa0 0x7f5dec06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5df2be6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec06ce80 con 0x7f5dec0f8aa0 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5df2be6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec06cfc0 con 0x7f5dec0f7800 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5debfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dec0f8aa0 0x7f5dec06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5df0982700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec0f7800 0x7f5dec06c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5df0982700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec0f7800 0x7f5dec06c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:33076/0 (socket says 172.21.15.152:33076) 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5debfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dec0f8aa0 0x7f5dec06c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49014/0 (socket says 172.21.15.152:49014) 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.510+0000 7f5df0982700 1 -- 172.21.15.152:0/2599294791 learned_addr learned my addr 172.21.15.152:0/2599294791 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.511+0000 7f5df0982700 1 -- 172.21.15.152:0/2599294791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dec0f8aa0 msgr2=0x7f5dec06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:12.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.511+0000 7f5df0982700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dec0f8aa0 0x7f5dec06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:12.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.511+0000 7f5df0982700 1 -- 172.21.15.152:0/2599294791 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd8005040 con 0x7f5dec0f7800 2024-04-06T12:25:12.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.511+0000 7f5df0982700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec0f7800 0x7f5dec06c3e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5de0002820 tx=0x7f5de0009f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:12.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.511+0000 7f5de9ffb700 1 -- 172.21.15.152:0/2599294791 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de0007b40 con 0x7f5dec0f7800 2024-04-06T12:25:12.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.511+0000 7f5de9ffb700 1 -- 172.21.15.152:0/2599294791 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5de000f040 con 0x7f5dec0f7800 2024-04-06T12:25:12.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.511+0000 7f5de9ffb700 1 -- 172.21.15.152:0/2599294791 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de0014820 con 0x7f5dec0f7800 2024-04-06T12:25:12.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.512+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec114be0 con 0x7f5dec0f7800 2024-04-06T12:25:12.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.512+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec1151a0 con 0x7f5dec0f7800 2024-04-06T12:25:12.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.516+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd0005150 con 0x7f5dec0f7800 2024-04-06T12:25:12.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.516+0000 7f5de9ffb700 1 -- 172.21.15.152:0/2599294791 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 30) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f5de0009110 con 0x7f5dec0f7800 2024-04-06T12:25:12.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.517+0000 7f5de9ffb700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5ddc06c7c0 0x7f5ddc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:12.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.517+0000 7f5de9ffb700 1 -- 172.21.15.152:0/2599294791 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f5de008b630 con 0x7f5dec0f7800 2024-04-06T12:25:12.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.518+0000 7f5debfff700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5ddc06c7c0 0x7f5ddc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:12.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.518+0000 7f5debfff700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5ddc06c7c0 0x7f5ddc06ec80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f5dd8004f10 tx=0x7f5dd800b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:12.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.525+0000 7f5de9ffb700 1 -- 172.21.15.152:0/2599294791 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f5de0059490 con 0x7f5dec0f7800 2024-04-06T12:25:12.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.836+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5dd0000bf0 con 0x7f5ddc06c7c0 2024-04-06T12:25:12.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.837+0000 7f5de9ffb700 1 -- 172.21.15.152:0/2599294791 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f5dd0000bf0 con 0x7f5ddc06c7c0 2024-04-06T12:25:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5ddc06c7c0 msgr2=0x7f5ddc06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5ddc06c7c0 0x7f5ddc06ec80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f5dd8004f10 tx=0x7f5dd800b040).stop 2024-04-06T12:25:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec0f7800 msgr2=0x7f5dec06c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec0f7800 0x7f5dec06c3e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5de0002820 tx=0x7f5de0009f00).stop 2024-04-06T12:25:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 shutdown_connections 2024-04-06T12:25:12.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec0f7800 0x7f5dec06c3e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5ddc06c7c0 0x7f5ddc06ec80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 --2- 172.21.15.152:0/2599294791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dec0f8aa0 0x7f5dec06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 >> 172.21.15.152:0/2599294791 conn(0x7f5dec0f2f80 msgr2=0x7f5dec0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 shutdown_connections 2024-04-06T12:25:12.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.840+0000 7f5df2be6700 1 -- 172.21.15.152:0/2599294791 wait complete. 2024-04-06T12:25:12.839 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:10.968135+0000 mgr.smithi152.lynahm (mgr.24477) 19 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:25:12.839 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:11.114517+0000 mgr.smithi152.lynahm (mgr.24477) 20 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-04-06T12:25:12.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:11.229377+0000 mgr.smithi152.lynahm (mgr.24477) 21 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:25:12.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:11.232101+0000 mgr.smithi152.lynahm (mgr.24477) 22 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:25:12.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:11.653174+0000 mgr.smithi152.lynahm (mgr.24477) 23 : cephadm [INF] Reconfiguring prometheus.smithi195 (dependencies changed)... 2024-04-06T12:25:12.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:11.892970+0000 mgr.smithi152.lynahm (mgr.24477) 24 : cephadm [INF] Reconfiguring daemon prometheus.smithi195 on smithi195 2024-04-06T12:25:12.849 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:25:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.976+0000 7f6136142700 1 -- 172.21.15.152:0/3575609917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6130069150 msgr2=0x7f6130101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.976+0000 7f6136142700 1 --2- 172.21.15.152:0/3575609917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6130069150 0x7f6130101cf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f61200047f0 tx=0x7f6120009cb0).stop 2024-04-06T12:25:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.976+0000 7f6136142700 1 -- 172.21.15.152:0/3575609917 shutdown_connections 2024-04-06T12:25:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.976+0000 7f6136142700 1 --2- 172.21.15.152:0/3575609917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61301021e0 0x7f61301045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.976+0000 7f6136142700 1 --2- 172.21.15.152:0/3575609917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6130069150 0x7f6130101cf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.976+0000 7f6136142700 1 -- 172.21.15.152:0/3575609917 >> 172.21.15.152:0/3575609917 conn(0x7f6130064880 msgr2=0x7f6130066ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.976+0000 7f6136142700 1 -- 172.21.15.152:0/3575609917 shutdown_connections 2024-04-06T12:25:12.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.976+0000 7f6136142700 1 -- 172.21.15.152:0/3575609917 wait complete. 2024-04-06T12:25:12.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f6136142700 1 Processor -- start 2024-04-06T12:25:12.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f6136142700 1 -- start start 2024-04-06T12:25:12.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f6136142700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6130069150 0x7f6130104340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:12.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f6136142700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61301021e0 0x7f61301029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:12.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f6136142700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61301048f0 con 0x7f6130069150 2024-04-06T12:25:12.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f6136142700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6130102e90 con 0x7f61301021e0 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f612f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6130069150 0x7f6130104340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f612effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61301021e0 0x7f61301029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f612f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6130069150 0x7f6130104340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49026/0 (socket says 172.21.15.152:49026) 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.977+0000 7f612f7fe700 1 -- 172.21.15.152:0/4010061449 learned_addr learned my addr 172.21.15.152:0/4010061449 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.978+0000 7f612effd700 1 -- 172.21.15.152:0/4010061449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6130069150 msgr2=0x7f6130104340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.978+0000 7f612effd700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6130069150 0x7f6130104340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.978+0000 7f612effd700 1 -- 172.21.15.152:0/4010061449 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6120005040 con 0x7f61301021e0 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.978+0000 7f612effd700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61301021e0 0x7f61301029a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f612400e840 tx=0x7f612400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.978+0000 7f612cff9700 1 -- 172.21.15.152:0/4010061449 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6124007b40 con 0x7f61301021e0 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.978+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6130103110 con 0x7f61301021e0 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.978+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61301036d0 con 0x7f61301021e0 2024-04-06T12:25:12.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.978+0000 7f612cff9700 1 -- 172.21.15.152:0/4010061449 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f612400f040 con 0x7f61301021e0 2024-04-06T12:25:12.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.978+0000 7f612cff9700 1 -- 172.21.15.152:0/4010061449 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6124014890 con 0x7f61301021e0 2024-04-06T12:25:12.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.979+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c005150 con 0x7f61301021e0 2024-04-06T12:25:12.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.980+0000 7f612cff9700 1 -- 172.21.15.152:0/4010061449 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 30) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f6124014b00 con 0x7f61301021e0 2024-04-06T12:25:12.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.980+0000 7f612cff9700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f611806c7c0 0x7f611806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:12.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.980+0000 7f612cff9700 1 -- 172.21.15.152:0/4010061449 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f612408b1b0 con 0x7f61301021e0 2024-04-06T12:25:12.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.980+0000 7f612f7fe700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f611806c7c0 0x7f611806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:12.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.981+0000 7f612f7fe700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f611806c7c0 0x7f611806ec80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f6120004540 tx=0x7f612000b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:12.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:12.985+0000 7f612cff9700 1 -- 172.21.15.152:0/4010061449 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f6124059090 con 0x7f61301021e0 2024-04-06T12:25:13.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:10.968135+0000 mgr.smithi152.lynahm (mgr.24477) 19 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:25:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:11.114517+0000 mgr.smithi152.lynahm (mgr.24477) 20 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-04-06T12:25:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:11.229377+0000 mgr.smithi152.lynahm (mgr.24477) 21 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:25:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:11.232101+0000 mgr.smithi152.lynahm (mgr.24477) 22 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:25:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:11.653174+0000 mgr.smithi152.lynahm (mgr.24477) 23 : cephadm [INF] Reconfiguring prometheus.smithi195 (dependencies changed)... 2024-04-06T12:25:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:11.892970+0000 mgr.smithi152.lynahm (mgr.24477) 24 : cephadm [INF] Reconfiguring daemon prometheus.smithi195 on smithi195 2024-04-06T12:25:13.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.250+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f611c000bf0 con 0x7f611806c7c0 2024-04-06T12:25:13.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.251+0000 7f612cff9700 1 -- 172.21.15.152:0/4010061449 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f611c000bf0 con 0x7f611806c7c0 2024-04-06T12:25:13.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.254+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f611806c7c0 msgr2=0x7f611806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:13.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.254+0000 7f6136142700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f611806c7c0 0x7f611806ec80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f6120004540 tx=0x7f612000b040).stop 2024-04-06T12:25:13.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.254+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61301021e0 msgr2=0x7f61301029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:13.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.254+0000 7f6136142700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61301021e0 0x7f61301029a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f612400e840 tx=0x7f612400b040).stop 2024-04-06T12:25:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.254+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 shutdown_connections 2024-04-06T12:25:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.254+0000 7f6136142700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f611806c7c0 0x7f611806ec80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.254+0000 7f6136142700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6130069150 0x7f6130104340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.254+0000 7f6136142700 1 --2- 172.21.15.152:0/4010061449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61301021e0 0x7f61301029a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.254+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 >> 172.21.15.152:0/4010061449 conn(0x7f6130064880 msgr2=0x7f613006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.255+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 shutdown_connections 2024-04-06T12:25:13.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.255+0000 7f6136142700 1 -- 172.21.15.152:0/4010061449 wait complete. 2024-04-06T12:25:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.377+0000 7f2fb777e700 1 -- 172.21.15.152:0/3678916059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb00f6710 msgr2=0x7f2fb00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.377+0000 7f2fb777e700 1 --2- 172.21.15.152:0/3678916059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb00f6710 0x7f2fb00f6b30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2fac0047f0 tx=0x7f2fac009cb0).stop 2024-04-06T12:25:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.377+0000 7f2fb777e700 1 -- 172.21.15.152:0/3678916059 shutdown_connections 2024-04-06T12:25:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.377+0000 7f2fb777e700 1 --2- 172.21.15.152:0/3678916059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00f79b0 0x7f2fb00f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.377+0000 7f2fb777e700 1 --2- 172.21.15.152:0/3678916059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb00f6710 0x7f2fb00f6b30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.377+0000 7f2fb777e700 1 -- 172.21.15.152:0/3678916059 >> 172.21.15.152:0/3678916059 conn(0x7f2fb00f1e70 msgr2=0x7f2fb00f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:13.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.377+0000 7f2fb777e700 1 -- 172.21.15.152:0/3678916059 shutdown_connections 2024-04-06T12:25:13.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.377+0000 7f2fb777e700 1 -- 172.21.15.152:0/3678916059 wait complete. 2024-04-06T12:25:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb777e700 1 Processor -- start 2024-04-06T12:25:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb777e700 1 -- start start 2024-04-06T12:25:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb777e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb00f6710 0x7f2fb00610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb777e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00f79b0 0x7f2fb010ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb777e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb010d3a0 con 0x7f2fb00f6710 2024-04-06T12:25:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb777e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0106c80 con 0x7f2fb00f79b0 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb4d19700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00f79b0 0x7f2fb010ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb4d19700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00f79b0 0x7f2fb010ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:33110/0 (socket says 172.21.15.152:33110) 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb4d19700 1 -- 172.21.15.152:0/1669707895 learned_addr learned my addr 172.21.15.152:0/1669707895 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb4d19700 1 -- 172.21.15.152:0/1669707895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb00f6710 msgr2=0x7f2fb00610a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.378+0000 7f2fb4d19700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb00f6710 0x7f2fb00610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.379+0000 7f2fb4d19700 1 -- 172.21.15.152:0/1669707895 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac005040 con 0x7f2fb00f79b0 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.379+0000 7f2fb4d19700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00f79b0 0x7f2fb010ceb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2fa000e8f0 tx=0x7f2fa000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.379+0000 7f2fa67fc700 1 -- 172.21.15.152:0/1669707895 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fa000ee90 con 0x7f2fb00f79b0 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.379+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb0106f60 con 0x7f2fb00f79b0 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.379+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb0107520 con 0x7f2fb00f79b0 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.379+0000 7f2fa67fc700 1 -- 172.21.15.152:0/1669707895 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2fa000f040 con 0x7f2fb00f79b0 2024-04-06T12:25:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.379+0000 7f2fa67fc700 1 -- 172.21.15.152:0/1669707895 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fa000c8a0 con 0x7f2fb00f79b0 2024-04-06T12:25:13.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.380+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f94005150 con 0x7f2fb00f79b0 2024-04-06T12:25:13.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.380+0000 7f2fa67fc700 1 -- 172.21.15.152:0/1669707895 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 30) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f2fa0007b40 con 0x7f2fb00f79b0 2024-04-06T12:25:13.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.381+0000 7f2fa67fc700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2f9c06c7c0 0x7f2f9c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:13.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.381+0000 7f2fa67fc700 1 -- 172.21.15.152:0/1669707895 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f2fa008b5d0 con 0x7f2fb00f79b0 2024-04-06T12:25:13.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.381+0000 7f2fb551a700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2f9c06c7c0 0x7f2f9c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:13.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.381+0000 7f2fb551a700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2f9c06c7c0 0x7f2f9c06ec80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2fac013560 tx=0x7f2fac009cb0).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:13.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.387+0000 7f2fa67fc700 1 -- 172.21.15.152:0/1669707895 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f2fa00593f0 con 0x7f2fb00f79b0 2024-04-06T12:25:13.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.685+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f94000bc0 con 0x7f2f9c06c7c0 2024-04-06T12:25:13.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.700+0000 7f2fa67fc700 1 -- 172.21.15.152:0/1669707895 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2f94000bc0 con 0x7f2f9c06c7c0 2024-04-06T12:25:13.697 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:25:13.698 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (2m) 13s ago 10m 17.2M - 0.23.0 ba2b418f427c ff669aad1b5a 2024-04-06T12:25:13.698 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (10m) 13s ago 10m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:25:13.698 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (9m) 16s ago 9m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:25:13.698 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (63s) 13s ago 10m 46.3M - 8.3.5 dad864ee21e9 bec520698642 2024-04-06T12:25:13.698 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (5m) 13s ago 5m 219M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:25:13.699 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (5m) 13s ago 5m 236M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:25:13.699 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (5m) 16s ago 5m 13.3M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:25:13.699 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (5m) 16s ago 5m 13.9M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:25:13.699 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (34s) 13s ago 11m 470M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:25:13.699 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283 running (3m) 16s ago 9m 68.1M - 18.2.2-1086-g052adcad 87261d5ece5a 5089ad242cab 2024-04-06T12:25:13.699 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (11m) 13s ago 11m 52.2M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:25:13.700 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (9m) 16s ago 9m 41.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:25:13.700 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (58s) 13s ago 10m 16.3M - 1.3.1 1dbe0e931976 3da4792a7739 2024-04-06T12:25:13.700 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (54s) 16s ago 9m 17.5M - 1.3.1 1dbe0e931976 716ffb27d0e7 2024-04-06T12:25:13.700 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (9m) 13s ago 9m 185M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:25:13.700 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (8m) 13s ago 8m 198M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:25:13.700 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (7m) 13s ago 7m 164M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:25:13.701 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (7m) 16s ago 7m 216M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:25:13.701 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (7m) 16s ago 7m 187M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:25:13.701 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (6m) 16s ago 6m 183M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:25:13.701 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (40s) 16s ago 9m 46.5M - 2.33.4 514e6a882f6e d4de7064d592 2024-04-06T12:25:13.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.703+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2f9c06c7c0 msgr2=0x7f2f9c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:13.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.703+0000 7f2fb777e700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2f9c06c7c0 0x7f2f9c06ec80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2fac013560 tx=0x7f2fac009cb0).stop 2024-04-06T12:25:13.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.703+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00f79b0 msgr2=0x7f2fb010ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:13.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.703+0000 7f2fb777e700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00f79b0 0x7f2fb010ceb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2fa000e8f0 tx=0x7f2fa000b040).stop 2024-04-06T12:25:13.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.704+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 shutdown_connections 2024-04-06T12:25:13.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.704+0000 7f2fb777e700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2f9c06c7c0 0x7f2f9c06ec80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.704+0000 7f2fb777e700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb00f6710 0x7f2fb00610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:25:13.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.704+0000 7f2fb777e700 1 --2- 172.21.15.152:0/1669707895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb00f79b0 0x7f2fb010ceb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.704+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 >> 172.21.15.152:0/1669707895 conn(0x7f2fb00f1e70 msgr2=0x7f2fb00fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:13.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.704+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 shutdown_connections 2024-04-06T12:25:13.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.704+0000 7f2fb777e700 1 -- 172.21.15.152:0/1669707895 wait complete. 2024-04-06T12:25:13.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.819+0000 7f6334010700 1 -- 172.21.15.152:0/1195758255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 msgr2=0x7f632c0f8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:13.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.819+0000 7f6334010700 1 --2- 172.21.15.152:0/1195758255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 0x7f632c0f8190 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f63280047f0 tx=0x7f6328009cb0).stop 2024-04-06T12:25:13.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.819+0000 7f6334010700 1 -- 172.21.15.152:0/1195758255 shutdown_connections 2024-04-06T12:25:13.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.819+0000 7f6334010700 1 --2- 172.21.15.152:0/1195758255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f632c0f6a80 0x7f632c0f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.819+0000 7f6334010700 1 --2- 172.21.15.152:0/1195758255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 0x7f632c0f8190 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.819+0000 7f6334010700 1 -- 172.21.15.152:0/1195758255 >> 172.21.15.152:0/1195758255 conn(0x7f632c0f15d0 msgr2=0x7f632c0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:13.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.819+0000 7f6334010700 1 -- 172.21.15.152:0/1195758255 shutdown_connections 2024-04-06T12:25:13.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.819+0000 7f6334010700 1 -- 172.21.15.152:0/1195758255 wait complete. 2024-04-06T12:25:13.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f6334010700 1 Processor -- start 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f6334010700 1 -- start start 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f6334010700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f632c0f6a80 0x7f632c10e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f6334010700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 0x7f632c10eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f6334010700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c10f120 con 0x7f632c0f7d70 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f6334010700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c10f260 con 0x7f632c0f6a80 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f63315ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 0x7f632c10eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f6331dac700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f632c0f6a80 0x7f632c10e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f63315ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 0x7f632c10eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49066/0 (socket says 172.21.15.152:49066) 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.820+0000 7f63315ab700 1 -- 172.21.15.152:0/1532823404 learned_addr learned my addr 172.21.15.152:0/1532823404 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f63315ab700 1 -- 172.21.15.152:0/1532823404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f632c0f6a80 msgr2=0x7f632c10e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f63315ab700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f632c0f6a80 0x7f632c10e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f63315ab700 1 -- 172.21.15.152:0/1532823404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328005040 con 0x7f632c0f7d70 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f6331dac700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f632c0f6a80 0x7f632c10e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-06T12:25:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f63315ab700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 0x7f632c10eb70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f631c00e8f0 tx=0x7f631c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f6322ffd700 1 -- 172.21.15.152:0/1532823404 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631c007b40 con 0x7f632c0f7d70 2024-04-06T12:25:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f6322ffd700 1 -- 172.21.15.152:0/1532823404 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f631c00f040 con 0x7f632c0f7d70 2024-04-06T12:25:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632c113d00 con 0x7f632c0f7d70 2024-04-06T12:25:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c114260 con 0x7f632c0f7d70 2024-04-06T12:25:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.821+0000 7f6322ffd700 1 -- 172.21.15.152:0/1532823404 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631c014920 con 0x7f632c0f7d70 2024-04-06T12:25:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.822+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6310005150 con 0x7f632c0f7d70 2024-04-06T12:25:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.823+0000 7f6322ffd700 1 -- 172.21.15.152:0/1532823404 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 30) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f631c007ca0 con 0x7f632c0f7d70 2024-04-06T12:25:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.823+0000 7f6322ffd700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f631806c890 0x7f631806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.823+0000 7f6322ffd700 1 -- 172.21.15.152:0/1532823404 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f631c08b3f0 con 0x7f632c0f7d70 2024-04-06T12:25:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.823+0000 7f6331dac700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f631806c890 0x7f631806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:13.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.824+0000 7f6331dac700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f631806c890 0x7f631806ed50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6328009bc0 tx=0x7f6328009cb0).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:13.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:13.830+0000 7f6322ffd700 1 -- 172.21.15.152:0/1532823404 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f631c059350 con 0x7f632c0f7d70 2024-04-06T12:25:14.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:13 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:12.838335+0000 mgr.smithi152.lynahm (mgr.24477) 25 : audit [DBG] from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:14.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:13 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:12.838335+0000 mgr.smithi152.lynahm (mgr.24477) 25 : audit [DBG] from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:14.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.229+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6310005af0 con 0x7f632c0f7d70 2024-04-06T12:25:14.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.229+0000 7f6322ffd700 1 -- 172.21.15.152:0/1532823404 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f631c058ee0 con 0x7f632c0f7d70 2024-04-06T12:25:14.227 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:25:14.227 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:25:14.227 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:25:14.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:25:14.227 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:25:14.228 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:25:14.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:25:14.228 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:25:14.228 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:25:14.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:25:14.228 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:25:14.229 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:25:14.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:25:14.229 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:25:14.229 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 12, 2024-04-06T12:25:14.229 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:25:14.229 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:25:14.229 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:25:14.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f631806c890 msgr2=0x7f631806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:14.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f631806c890 0x7f631806ed50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6328009bc0 tx=0x7f6328009cb0).stop 2024-04-06T12:25:14.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 msgr2=0x7f632c10eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:14.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 0x7f632c10eb70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f631c00e8f0 tx=0x7f631c00b040).stop 2024-04-06T12:25:14.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 shutdown_connections 2024-04-06T12:25:14.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f632c0f6a80 0x7f632c10e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:14.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f631806c890 0x7f631806ed50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:14.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 --2- 172.21.15.152:0/1532823404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0f7d70 0x7f632c10eb70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:14.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 >> 172.21.15.152:0/1532823404 conn(0x7f632c0f15d0 msgr2=0x7f632c0f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:14.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 shutdown_connections 2024-04-06T12:25:14.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.232+0000 7f6334010700 1 -- 172.21.15.152:0/1532823404 wait complete. 2024-04-06T12:25:14.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.351+0000 7f7575bd0700 1 -- 172.21.15.152:0/968314336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7570061220 msgr2=0x7f75700fa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:14.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.351+0000 7f7575bd0700 1 --2- 172.21.15.152:0/968314336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7570061220 0x7f75700fa430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f75600047f0 tx=0x7f7560009cb0).stop 2024-04-06T12:25:14.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.352+0000 7f7575bd0700 1 -- 172.21.15.152:0/968314336 shutdown_connections 2024-04-06T12:25:14.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.352+0000 7f7575bd0700 1 --2- 172.21.15.152:0/968314336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75700fa9b0 0x7f75700fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:14.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.352+0000 7f7575bd0700 1 --2- 172.21.15.152:0/968314336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7570061220 0x7f75700fa430 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:14.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.352+0000 7f7575bd0700 1 -- 172.21.15.152:0/968314336 >> 172.21.15.152:0/968314336 conn(0x7f75700f1e50 msgr2=0x7f75700f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:14.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.352+0000 7f7575bd0700 1 -- 172.21.15.152:0/968314336 shutdown_connections 2024-04-06T12:25:14.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.352+0000 7f7575bd0700 1 -- 172.21.15.152:0/968314336 wait complete. 2024-04-06T12:25:14.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.352+0000 7f7575bd0700 1 Processor -- start 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f7575bd0700 1 -- start start 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f7575bd0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7570061220 0x7f75700f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f7575bd0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75700fa9b0 0x7f75700f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f7575bd0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700f8280 con 0x7f75700fa9b0 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f7575bd0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700f6820 con 0x7f7570061220 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f756effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75700fa9b0 0x7f75700f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f756f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7570061220 0x7f75700f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f756effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75700fa9b0 0x7f75700f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49078/0 (socket says 172.21.15.152:49078) 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f756effd700 1 -- 172.21.15.152:0/131690251 learned_addr learned my addr 172.21.15.152:0/131690251 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f756f7fe700 1 -- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75700fa9b0 msgr2=0x7f75700f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f756f7fe700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75700fa9b0 0x7f75700f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:14.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f756f7fe700 1 -- 172.21.15.152:0/131690251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564005040 con 0x7f7570061220 2024-04-06T12:25:14.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f756effd700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75700fa9b0 0x7f75700f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-06T12:25:14.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.353+0000 7f756f7fe700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7570061220 0x7f75700f7cd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f7560013560 tx=0x7f7560009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:14.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.354+0000 7f756cff9700 1 -- 172.21.15.152:0/131690251 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7560018070 con 0x7f7570061220 2024-04-06T12:25:14.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.354+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7560005040 con 0x7f7570061220 2024-04-06T12:25:14.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.354+0000 7f756cff9700 1 -- 172.21.15.152:0/131690251 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7560007e90 con 0x7f7570061220 2024-04-06T12:25:14.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.354+0000 7f756cff9700 1 -- 172.21.15.152:0/131690251 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7560012620 con 0x7f7570061220 2024-04-06T12:25:14.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.354+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75700f6e10 con 0x7f7570061220 2024-04-06T12:25:14.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.355+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75700f70f0 con 0x7f7570061220 2024-04-06T12:25:14.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.356+0000 7f756cff9700 1 -- 172.21.15.152:0/131690251 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 30) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f756001d420 con 0x7f7570061220 2024-04-06T12:25:14.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.356+0000 7f756cff9700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f755806c7c0 0x7f755806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:14.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.356+0000 7f756cff9700 1 -- 172.21.15.152:0/131690251 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f756008cfd0 con 0x7f7570061220 2024-04-06T12:25:14.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.356+0000 7f756effd700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f755806c7c0 0x7f755806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:14.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.357+0000 7f756effd700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f755806c7c0 0x7f755806ec80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f75640044e0 tx=0x7f756400b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:14.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.360+0000 7f756cff9700 1 -- 172.21.15.152:0/131690251 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f756005aeb0 con 0x7f7570061220 2024-04-06T12:25:14.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.668+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7570059120 con 0x7f755806c7c0 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.669+0000 7f756cff9700 1 -- 172.21.15.152:0/131690251 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f7570059120 con 0x7f755806c7c0 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "2/2 daemons upgraded", 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2024-04-06T12:25:14.666 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:25:14.667 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.671+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f755806c7c0 msgr2=0x7f755806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.671+0000 7f7575bd0700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f755806c7c0 0x7f755806ec80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f75640044e0 tx=0x7f756400b040).stop 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.671+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7570061220 msgr2=0x7f75700f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.671+0000 7f7575bd0700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7570061220 0x7f75700f7cd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f7560013560 tx=0x7f7560009cb0).stop 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.672+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 shutdown_connections 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.672+0000 7f7575bd0700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7570061220 0x7f75700f7cd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.672+0000 7f7575bd0700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f755806c7c0 0x7f755806ec80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.672+0000 7f7575bd0700 1 --2- 172.21.15.152:0/131690251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75700fa9b0 0x7f75700f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.672+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 >> 172.21.15.152:0/131690251 conn(0x7f75700f1e50 msgr2=0x7f75700f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.672+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 shutdown_connections 2024-04-06T12:25:14.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:14.672+0000 7f7575bd0700 1 -- 172.21.15.152:0/131690251 wait complete. 2024-04-06T12:25:14.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:13.114881+0000 mgr.smithi152.lynahm (mgr.24477) 26 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 204 op/s 2024-04-06T12:25:14.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:13.251363+0000 mgr.smithi152.lynahm (mgr.24477) 27 : audit [DBG] from='client.24525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:14.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:13.686732+0000 mgr.smithi152.lynahm (mgr.24477) 28 : audit [DBG] from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:14.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:14.229462+0000 mon.smithi152 (mon.0) 772 : audit [DBG] from='client.? 172.21.15.152:0/1532823404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:15.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:13.114881+0000 mgr.smithi152.lynahm (mgr.24477) 26 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 204 op/s 2024-04-06T12:25:15.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:13.251363+0000 mgr.smithi152.lynahm (mgr.24477) 27 : audit [DBG] from='client.24525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:15.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:13.686732+0000 mgr.smithi152.lynahm (mgr.24477) 28 : audit [DBG] from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:15.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:14.229462+0000 mon.smithi152 (mon.0) 772 : audit [DBG] from='client.? 172.21.15.152:0/1532823404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:15.594 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:15 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:14.668916+0000 mgr.smithi152.lynahm (mgr.24477) 29 : audit [DBG] from='client.24537 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:16.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:15 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:14.668916+0000 mgr.smithi152.lynahm (mgr.24477) 29 : audit [DBG] from='client.24537 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:16.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:15.115332+0000 mgr.smithi152.lynahm (mgr.24477) 30 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 260 op/s 2024-04-06T12:25:17.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:15.115332+0000 mgr.smithi152.lynahm (mgr.24477) 30 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 260 op/s 2024-04-06T12:25:18.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:17.115703+0000 mgr.smithi152.lynahm (mgr.24477) 31 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 157 op/s 2024-04-06T12:25:18.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:17.619317+0000 mon.smithi152 (mon.0) 773 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:18.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:17.626579+0000 mon.smithi152 (mon.0) 774 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:18.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:17.677455+0000 mon.smithi152 (mon.0) 775 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:25:18.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:17.677844+0000 mgr.smithi152.lynahm (mgr.24477) 32 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:25:18.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:17.684529+0000 mon.smithi152 (mon.0) 776 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:19.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:17.115703+0000 mgr.smithi152.lynahm (mgr.24477) 31 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 157 op/s 2024-04-06T12:25:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:17.619317+0000 mon.smithi152 (mon.0) 773 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:17.626579+0000 mon.smithi152 (mon.0) 774 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:17.677455+0000 mon.smithi152 (mon.0) 775 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:25:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:17.677844+0000 mgr.smithi152.lynahm (mgr.24477) 32 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:25:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:17.684529+0000 mon.smithi152 (mon.0) 776 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:19.948 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:19.252777+0000 mon.smithi152 (mon.0) 777 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:25:19.948 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:19.253609+0000 mon.smithi152 (mon.0) 778 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:25:19.948 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:19.254409+0000 mon.smithi152 (mon.0) 779 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:25:20.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:19.252777+0000 mon.smithi152 (mon.0) 777 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:25:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:19.253609+0000 mon.smithi152 (mon.0) 778 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:25:20.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:19.254409+0000 mon.smithi152 (mon.0) 779 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:25:20.865 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-06T12:25:20.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-06T12:25:20.891 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:19.116102+0000 mgr.smithi152.lynahm (mgr.24477) 33 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-04-06T12:25:20.891 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:19.252381+0000 mgr.smithi152.lynahm (mgr.24477) 34 : cephadm [INF] Upgrade: Updating mgr.smithi195.ausetj 2024-04-06T12:25:20.892 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:19.255226+0000 mgr.smithi152.lynahm (mgr.24477) 35 : cephadm [INF] Deploying daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:25:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:19.116102+0000 mgr.smithi152.lynahm (mgr.24477) 33 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-04-06T12:25:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:19.252381+0000 mgr.smithi152.lynahm (mgr.24477) 34 : cephadm [INF] Upgrade: Updating mgr.smithi195.ausetj 2024-04-06T12:25:21.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:19.255226+0000 mgr.smithi152.lynahm (mgr.24477) 35 : cephadm [INF] Deploying daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:25:21.156 DEBUG:teuthology.parallel:result is None 2024-04-06T12:25:21.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-06T12:25:21.233 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-06T12:25:21.234 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-06T12:25:21.272 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-06T12:25:21.272 DEBUG:teuthology.parallel:result is None 2024-04-06T12:25:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:21.116472+0000 mgr.smithi152.lynahm (mgr.24477) 36 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 195 op/s 2024-04-06T12:25:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:21.116472+0000 mgr.smithi152.lynahm (mgr.24477) 36 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 195 op/s 2024-04-06T12:25:23.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:23.213233+0000 mon.smithi152 (mon.0) 780 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:25:24.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:23.213233+0000 mon.smithi152 (mon.0) 780 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:25:25.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:23.116878+0000 mgr.smithi152.lynahm (mgr.24477) 37 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 886 KiB/s rd, 958 KiB/s wr, 148 op/s 2024-04-06T12:25:25.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:23.116878+0000 mgr.smithi152.lynahm (mgr.24477) 37 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 886 KiB/s rd, 958 KiB/s wr, 148 op/s 2024-04-06T12:25:26.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:24.874547+0000 mon.smithi152 (mon.0) 781 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:26.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:24.879154+0000 mon.smithi152 (mon.0) 782 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:26.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:24.883389+0000 mon.smithi152 (mon.0) 783 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:26.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:25.204577+0000 mon.smithi152 (mon.0) 784 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:26.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:25.209384+0000 mon.smithi152 (mon.0) 785 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:26.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:24.874547+0000 mon.smithi152 (mon.0) 781 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:24.879154+0000 mon.smithi152 (mon.0) 782 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:24.883389+0000 mon.smithi152 (mon.0) 783 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:25.204577+0000 mon.smithi152 (mon.0) 784 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:25.209384+0000 mon.smithi152 (mon.0) 785 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:27.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:25.117514+0000 mgr.smithi152.lynahm (mgr.24477) 38 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 197 op/s 2024-04-06T12:25:27.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:25.117514+0000 mgr.smithi152.lynahm (mgr.24477) 38 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 197 op/s 2024-04-06T12:25:29.136 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:27.118105+0000 mgr.smithi152.lynahm (mgr.24477) 39 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 653 KiB/s rd, 680 KiB/s wr, 141 op/s 2024-04-06T12:25:29.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:27.118105+0000 mgr.smithi152.lynahm (mgr.24477) 39 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 653 KiB/s rd, 680 KiB/s wr, 141 op/s 2024-04-06T12:25:30.295 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:29.039057+0000 mon.smithi152 (mon.0) 786 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:30.295 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:29.044226+0000 mon.smithi152 (mon.0) 787 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:30.295 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:29.118649+0000 mgr.smithi152.lynahm (mgr.24477) 40 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 653 KiB/s rd, 680 KiB/s wr, 142 op/s 2024-04-06T12:25:30.295 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:29.730556+0000 mon.smithi152 (mon.0) 788 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:30.296 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:29.736831+0000 mon.smithi152 (mon.0) 789 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:30.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:29.039057+0000 mon.smithi152 (mon.0) 786 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:30.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:29.044226+0000 mon.smithi152 (mon.0) 787 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:30.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:29.118649+0000 mgr.smithi152.lynahm (mgr.24477) 40 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 653 KiB/s rd, 680 KiB/s wr, 142 op/s 2024-04-06T12:25:30.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:29.730556+0000 mon.smithi152 (mon.0) 788 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:30.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:29.736831+0000 mon.smithi152 (mon.0) 789 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:31.119276+0000 mgr.smithi152.lynahm (mgr.24477) 41 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 357 KiB/s rd, 369 KiB/s wr, 89 op/s 2024-04-06T12:25:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:31.946236+0000 mon.smithi152 (mon.0) 790 : cluster [DBG] Standby manager daemon smithi195.ausetj restarted 2024-04-06T12:25:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:31.946406+0000 mon.smithi152 (mon.0) 791 : cluster [DBG] Standby manager daemon smithi195.ausetj started 2024-04-06T12:25:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:31.947942+0000 mon.smithi195 (mon.1) 90 : audit [DBG] from='mgr.? 172.21.15.195:0/1106940504' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:25:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:31.948360+0000 mon.smithi195 (mon.1) 91 : audit [DBG] from='mgr.? 172.21.15.195:0/1106940504' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:25:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:31.950211+0000 mon.smithi195 (mon.1) 92 : audit [DBG] from='mgr.? 172.21.15.195:0/1106940504' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:25:32.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:31.951126+0000 mon.smithi195 (mon.1) 93 : audit [DBG] from='mgr.? 172.21.15.195:0/1106940504' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:25:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:31.119276+0000 mgr.smithi152.lynahm (mgr.24477) 41 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 357 KiB/s rd, 369 KiB/s wr, 89 op/s 2024-04-06T12:25:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:31.946236+0000 mon.smithi152 (mon.0) 790 : cluster [DBG] Standby manager daemon smithi195.ausetj restarted 2024-04-06T12:25:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:31.946406+0000 mon.smithi152 (mon.0) 791 : cluster [DBG] Standby manager daemon smithi195.ausetj started 2024-04-06T12:25:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:31.947942+0000 mon.smithi195 (mon.1) 90 : audit [DBG] from='mgr.? 172.21.15.195:0/1106940504' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:25:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:31.948360+0000 mon.smithi195 (mon.1) 91 : audit [DBG] from='mgr.? 172.21.15.195:0/1106940504' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:25:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:31.950211+0000 mon.smithi195 (mon.1) 92 : audit [DBG] from='mgr.? 172.21.15.195:0/1106940504' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:25:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:31.951126+0000 mon.smithi195 (mon.1) 93 : audit [DBG] from='mgr.? 172.21.15.195:0/1106940504' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:25:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:32.186853+0000 mon.smithi152 (mon.0) 792 : cluster [DBG] mgrmap e31: smithi152.lynahm(active, since 39s), standbys: smithi195.ausetj 2024-04-06T12:25:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.065154+0000 mon.smithi152 (mon.0) 793 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.069956+0000 mon.smithi152 (mon.0) 794 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.070922+0000 mon.smithi152 (mon.0) 795 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:25:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.071781+0000 mon.smithi152 (mon.0) 796 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:25:33.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:33 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.078480+0000 mon.smithi152 (mon.0) 797 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:33.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:32.186853+0000 mon.smithi152 (mon.0) 792 : cluster [DBG] mgrmap e31: smithi152.lynahm(active, since 39s), standbys: smithi195.ausetj 2024-04-06T12:25:33.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.065154+0000 mon.smithi152 (mon.0) 793 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:33.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.069956+0000 mon.smithi152 (mon.0) 794 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:33.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.070922+0000 mon.smithi152 (mon.0) 795 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:25:33.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.071781+0000 mon.smithi152 (mon.0) 796 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:25:33.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:33 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.078480+0000 mon.smithi152 (mon.0) 797 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.490 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:33.119641+0000 mgr.smithi152.lynahm (mgr.24477) 42 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 306 KiB/s rd, 238 KiB/s wr, 51 op/s 2024-04-06T12:25:34.490 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.217253+0000 mon.smithi152 (mon.0) 798 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:34.490 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.219868+0000 mon.smithi152 (mon.0) 799 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.490 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:33.220547+0000 mgr.smithi152.lynahm (mgr.24477) 43 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.224958+0000 mon.smithi152 (mon.0) 800 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.225710+0000 mon.smithi152 (mon.0) 801 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.lynahm"}]: dispatch 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.229256+0000 mon.smithi152 (mon.0) 802 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.lynahm"}]': finished 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.229856+0000 mon.smithi152 (mon.0) 803 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.ausetj"}]: dispatch 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.233399+0000 mon.smithi152 (mon.0) 804 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.ausetj"}]': finished 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.235768+0000 mon.smithi152 (mon.0) 805 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:33.236350+0000 mgr.smithi152.lynahm (mgr.24477) 44 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.240503+0000 mon.smithi152 (mon.0) 806 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.241458+0000 mon.smithi152 (mon.0) 807 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:33.241980+0000 mgr.smithi152.lynahm (mgr.24477) 45 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.245919+0000 mon.smithi152 (mon.0) 808 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.246791+0000 mon.smithi152 (mon.0) 809 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:33.247304+0000 mgr.smithi152.lynahm (mgr.24477) 46 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-04-06T12:25:34.491 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.251260+0000 mon.smithi152 (mon.0) 810 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.252255+0000 mon.smithi152 (mon.0) 811 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:33.252767+0000 mgr.smithi152.lynahm (mgr.24477) 47 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.256267+0000 mon.smithi152 (mon.0) 812 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.257317+0000 mon.smithi152 (mon.0) 813 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:33.257833+0000 mgr.smithi152.lynahm (mgr.24477) 48 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.261328+0000 mon.smithi152 (mon.0) 814 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.262253+0000 mon.smithi152 (mon.0) 815 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:33.262746+0000 mgr.smithi152.lynahm (mgr.24477) 49 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.266450+0000 mon.smithi152 (mon.0) 816 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.267441+0000 mon.smithi152 (mon.0) 817 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:33.267947+0000 mgr.smithi152.lynahm (mgr.24477) 50 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-04-06T12:25:34.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:33.271511+0000 mon.smithi152 (mon.0) 818 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:33.119641+0000 mgr.smithi152.lynahm (mgr.24477) 42 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 306 KiB/s rd, 238 KiB/s wr, 51 op/s 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.217253+0000 mon.smithi152 (mon.0) 798 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.219868+0000 mon.smithi152 (mon.0) 799 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:33.220547+0000 mgr.smithi152.lynahm (mgr.24477) 43 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.224958+0000 mon.smithi152 (mon.0) 800 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.225710+0000 mon.smithi152 (mon.0) 801 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.lynahm"}]: dispatch 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.229256+0000 mon.smithi152 (mon.0) 802 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.lynahm"}]': finished 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.229856+0000 mon.smithi152 (mon.0) 803 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.ausetj"}]: dispatch 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.233399+0000 mon.smithi152 (mon.0) 804 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.ausetj"}]': finished 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.235768+0000 mon.smithi152 (mon.0) 805 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:33.236350+0000 mgr.smithi152.lynahm (mgr.24477) 44 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.240503+0000 mon.smithi152 (mon.0) 806 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.241458+0000 mon.smithi152 (mon.0) 807 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:33.241980+0000 mgr.smithi152.lynahm (mgr.24477) 45 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.245919+0000 mon.smithi152 (mon.0) 808 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.246791+0000 mon.smithi152 (mon.0) 809 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:33.247304+0000 mgr.smithi152.lynahm (mgr.24477) 46 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.251260+0000 mon.smithi152 (mon.0) 810 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.252255+0000 mon.smithi152 (mon.0) 811 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:33.252767+0000 mgr.smithi152.lynahm (mgr.24477) 47 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.256267+0000 mon.smithi152 (mon.0) 812 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.257317+0000 mon.smithi152 (mon.0) 813 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:33.257833+0000 mgr.smithi152.lynahm (mgr.24477) 48 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.261328+0000 mon.smithi152 (mon.0) 814 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.262253+0000 mon.smithi152 (mon.0) 815 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:33.262746+0000 mgr.smithi152.lynahm (mgr.24477) 49 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.266450+0000 mon.smithi152 (mon.0) 816 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:34.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.267441+0000 mon.smithi152 (mon.0) 817 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:34.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:33.267947+0000 mgr.smithi152.lynahm (mgr.24477) 50 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-04-06T12:25:34.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:33.271511+0000 mon.smithi152 (mon.0) 818 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:35.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:34.940072+0000 mgr.smithi152.lynahm (mgr.24477) 51 : cephadm [INF] Upgrade: Updating node-exporter.smithi152 (1/2) 2024-04-06T12:25:35.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:35 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:34.940638+0000 mgr.smithi152.lynahm (mgr.24477) 52 : cephadm [INF] Deploying daemon node-exporter.smithi152 on smithi152 2024-04-06T12:25:35.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:34.940072+0000 mgr.smithi152.lynahm (mgr.24477) 51 : cephadm [INF] Upgrade: Updating node-exporter.smithi152 (1/2) 2024-04-06T12:25:35.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:34.940638+0000 mgr.smithi152.lynahm (mgr.24477) 52 : cephadm [INF] Deploying daemon node-exporter.smithi152 on smithi152 2024-04-06T12:25:36.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:35.120122+0000 mgr.smithi152.lynahm (mgr.24477) 53 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 307 KiB/s rd, 238 KiB/s wr, 53 op/s 2024-04-06T12:25:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:35.120122+0000 mgr.smithi152.lynahm (mgr.24477) 53 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 307 KiB/s rd, 238 KiB/s wr, 53 op/s 2024-04-06T12:25:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:37.120497+0000 mgr.smithi152.lynahm (mgr.24477) 54 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 27 KiB/s wr, 3 op/s 2024-04-06T12:25:38.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:37.120497+0000 mgr.smithi152.lynahm (mgr.24477) 54 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 27 KiB/s wr, 3 op/s 2024-04-06T12:25:39.478 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:38.213246+0000 mon.smithi152 (mon.0) 819 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:25:39.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:38.213246+0000 mon.smithi152 (mon.0) 819 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:25:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:39.120883+0000 mgr.smithi152.lynahm (mgr.24477) 55 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 27 KiB/s wr, 3 op/s 2024-04-06T12:25:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:39.822277+0000 mon.smithi152 (mon.0) 820 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:39.828418+0000 mon.smithi152 (mon.0) 821 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:41.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:39.120883+0000 mgr.smithi152.lynahm (mgr.24477) 55 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 27 KiB/s wr, 3 op/s 2024-04-06T12:25:41.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:39.822277+0000 mon.smithi152 (mon.0) 820 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:41.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:39.828418+0000 mon.smithi152 (mon.0) 821 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:43.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:41.121307+0000 mgr.smithi152.lynahm (mgr.24477) 56 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 27 KiB/s wr, 3 op/s 2024-04-06T12:25:43.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:41.430958+0000 mgr.smithi152.lynahm (mgr.24477) 57 : cephadm [INF] Upgrade: Updating node-exporter.smithi195 (2/2) 2024-04-06T12:25:43.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:41.431389+0000 mgr.smithi152.lynahm (mgr.24477) 58 : cephadm [INF] Deploying daemon node-exporter.smithi195 on smithi195 2024-04-06T12:25:43.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:41.121307+0000 mgr.smithi152.lynahm (mgr.24477) 56 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 27 KiB/s wr, 3 op/s 2024-04-06T12:25:43.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:41.430958+0000 mgr.smithi152.lynahm (mgr.24477) 57 : cephadm [INF] Upgrade: Updating node-exporter.smithi195 (2/2) 2024-04-06T12:25:43.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:41.431389+0000 mgr.smithi152.lynahm (mgr.24477) 58 : cephadm [INF] Deploying daemon node-exporter.smithi195 on smithi195 2024-04-06T12:25:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 -- 172.21.15.152:0/1915612563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 msgr2=0x7ffa280f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 --2- 172.21.15.152:0/1915612563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 0x7ffa280f8f00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7ffa240047f0 tx=0x7ffa24009cb0).stop 2024-04-06T12:25:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 -- 172.21.15.152:0/1915612563 shutdown_connections 2024-04-06T12:25:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 --2- 172.21.15.152:0/1915612563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 0x7ffa280f8f00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 --2- 172.21.15.152:0/1915612563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa280f7800 0x7ffa280f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:44.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 -- 172.21.15.152:0/1915612563 >> 172.21.15.152:0/1915612563 conn(0x7ffa280f2f80 msgr2=0x7ffa280f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 -- 172.21.15.152:0/1915612563 shutdown_connections 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 -- 172.21.15.152:0/1915612563 wait complete. 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 Processor -- start 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.778+0000 7ffa2f678700 1 -- start start 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2f678700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa280f7800 0x7ffa28107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2f678700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 0x7ffa28108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2f678700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28108a20 con 0x7ffa280f8aa0 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2f678700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28108b60 con 0x7ffa280f7800 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 0x7ffa28108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 0x7ffa28108470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49264/0 (socket says 172.21.15.152:49264) 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2cc13700 1 -- 172.21.15.152:0/1287743772 learned_addr learned my addr 172.21.15.152:0/1287743772 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2d414700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa280f7800 0x7ffa28107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:44.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2cc13700 1 -- 172.21.15.152:0/1287743772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa280f7800 msgr2=0x7ffa28107f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2cc13700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa280f7800 0x7ffa28107f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2cc13700 1 -- 172.21.15.152:0/1287743772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24005040 con 0x7ffa280f8aa0 2024-04-06T12:25:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2cc13700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 0x7ffa28108470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ffa2400b120 tx=0x7ffa24009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa1e7fc700 1 -- 172.21.15.152:0/1287743772 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa2400e030 con 0x7ffa280f8aa0 2024-04-06T12:25:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa1e7fc700 1 -- 172.21.15.152:0/1287743772 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa24007e90 con 0x7ffa280f8aa0 2024-04-06T12:25:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2810d5a0 con 0x7ffa280f8aa0 2024-04-06T12:25:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa1e7fc700 1 -- 172.21.15.152:0/1287743772 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa24018070 con 0x7ffa280f8aa0 2024-04-06T12:25:44.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.779+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2810db60 con 0x7ffa280f8aa0 2024-04-06T12:25:44.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.781+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa280fffe0 con 0x7ffa280f8aa0 2024-04-06T12:25:44.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.781+0000 7ffa1e7fc700 1 -- 172.21.15.152:0/1287743772 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7ffa2401d960 con 0x7ffa280f8aa0 2024-04-06T12:25:44.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.781+0000 7ffa1e7fc700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ffa1406c7c0 0x7ffa1406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:44.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.781+0000 7ffa1e7fc700 1 -- 172.21.15.152:0/1287743772 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7ffa2408d010 con 0x7ffa280f8aa0 2024-04-06T12:25:44.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.781+0000 7ffa2d414700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ffa1406c7c0 0x7ffa1406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:44.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.781+0000 7ffa2d414700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ffa1406c7c0 0x7ffa1406ec80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ffa180041d0 tx=0x7ffa18009040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.786+0000 7ffa1e7fc700 1 -- 172.21.15.152:0/1287743772 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7ffa2405aef0 con 0x7ffa280f8aa0 2024-04-06T12:25:44.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.992+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa28059120 con 0x7ffa1406c7c0 2024-04-06T12:25:44.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.993+0000 7ffa1e7fc700 1 -- 172.21.15.152:0/1287743772 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7ffa28059120 con 0x7ffa1406c7c0 2024-04-06T12:25:44.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ffa1406c7c0 msgr2=0x7ffa1406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ffa1406c7c0 0x7ffa1406ec80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ffa180041d0 tx=0x7ffa18009040).stop 2024-04-06T12:25:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 msgr2=0x7ffa28108470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 0x7ffa28108470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ffa2400b120 tx=0x7ffa24009cb0).stop 2024-04-06T12:25:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 shutdown_connections 2024-04-06T12:25:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa280f7800 0x7ffa28107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ffa1406c7c0 0x7ffa1406ec80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 --2- 172.21.15.152:0/1287743772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa280f8aa0 0x7ffa28108470 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 >> 172.21.15.152:0/1287743772 conn(0x7ffa280f2f80 msgr2=0x7ffa280fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:45.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 shutdown_connections 2024-04-06T12:25:45.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:44.995+0000 7ffa2f678700 1 -- 172.21.15.152:0/1287743772 wait complete. 2024-04-06T12:25:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:25:45.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.096+0000 7f5ff10ec700 1 -- 172.21.15.152:0/1208260426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f7990 msgr2=0x7f5fec0f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.096+0000 7f5ff10ec700 1 --2- 172.21.15.152:0/1208260426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f7990 0x7f5fec0f7df0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f5fdc0047f0 tx=0x7f5fdc009cb0).stop 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.096+0000 7f5ff10ec700 1 -- 172.21.15.152:0/1208260426 shutdown_connections 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.096+0000 7f5ff10ec700 1 --2- 172.21.15.152:0/1208260426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f7990 0x7f5fec0f7df0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.096+0000 7f5ff10ec700 1 --2- 172.21.15.152:0/1208260426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0f66f0 0x7f5fec0f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.096+0000 7f5ff10ec700 1 -- 172.21.15.152:0/1208260426 >> 172.21.15.152:0/1208260426 conn(0x7f5fec0f1e50 msgr2=0x7f5fec0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.096+0000 7f5ff10ec700 1 -- 172.21.15.152:0/1208260426 shutdown_connections 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.096+0000 7f5ff10ec700 1 -- 172.21.15.152:0/1208260426 wait complete. 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5ff10ec700 1 Processor -- start 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5ff10ec700 1 -- start start 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5ff10ec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f66f0 0x7f5fec106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:45.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5ff10ec700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0f7990 0x7f5fec1073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5ff10ec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec107950 con 0x7f5fec0f66f0 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5ff10ec700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec107a90 con 0x7f5fec0f7990 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5fead9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f66f0 0x7f5fec106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5fead9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f66f0 0x7f5fec106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49276/0 (socket says 172.21.15.152:49276) 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5fead9d700 1 -- 172.21.15.152:0/4090448679 learned_addr learned my addr 172.21.15.152:0/4090448679 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5fea59c700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0f7990 0x7f5fec1073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5fead9d700 1 -- 172.21.15.152:0/4090448679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0f7990 msgr2=0x7f5fec1073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.097+0000 7f5fead9d700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0f7990 0x7f5fec1073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.098+0000 7f5fead9d700 1 -- 172.21.15.152:0/4090448679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc005040 con 0x7f5fec0f66f0 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.098+0000 7f5fead9d700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f66f0 0x7f5fec106eb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f5fe0002780 tx=0x7f5fe0009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.098+0000 7f5fd3fff700 1 -- 172.21.15.152:0/4090448679 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe0007b40 con 0x7f5fec0f66f0 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.098+0000 7f5fd3fff700 1 -- 172.21.15.152:0/4090448679 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5fe000f040 con 0x7f5fec0f66f0 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.098+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec10c4e0 con 0x7f5fec0f66f0 2024-04-06T12:25:45.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.098+0000 7f5fd3fff700 1 -- 172.21.15.152:0/4090448679 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe0014820 con 0x7f5fec0f66f0 2024-04-06T12:25:45.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.098+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec10caa0 con 0x7f5fec0f66f0 2024-04-06T12:25:45.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.099+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec0feed0 con 0x7f5fec0f66f0 2024-04-06T12:25:45.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.099+0000 7f5fd3fff700 1 -- 172.21.15.152:0/4090448679 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f5fe0007ca0 con 0x7f5fec0f66f0 2024-04-06T12:25:45.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.100+0000 7f5fd3fff700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5fd406c7c0 0x7f5fd406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:45.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.100+0000 7f5fd3fff700 1 -- 172.21.15.152:0/4090448679 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f5fe008b910 con 0x7f5fec0f66f0 2024-04-06T12:25:45.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.100+0000 7f5fea59c700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5fd406c7c0 0x7f5fd406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:45.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.100+0000 7f5fea59c700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5fd406c7c0 0x7f5fd406ec80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f5fdc004f10 tx=0x7f5fdc00b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:45.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.104+0000 7f5fd3fff700 1 -- 172.21.15.152:0/4090448679 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f5fe00597f0 con 0x7f5fec0f66f0 2024-04-06T12:25:45.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:43.121866+0000 mgr.smithi152.lynahm (mgr.24477) 59 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-06T12:25:45.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:43.121866+0000 mgr.smithi152.lynahm (mgr.24477) 59 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-06T12:25:45.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.310+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fec059120 con 0x7f5fd406c7c0 2024-04-06T12:25:45.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.311+0000 7f5fd3fff700 1 -- 172.21.15.152:0/4090448679 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f5fec059120 con 0x7f5fd406c7c0 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5fd406c7c0 msgr2=0x7f5fd406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5fd406c7c0 0x7f5fd406ec80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f5fdc004f10 tx=0x7f5fdc00b040).stop 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f66f0 msgr2=0x7f5fec106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f66f0 0x7f5fec106eb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f5fe0002780 tx=0x7f5fe0009ee0).stop 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 shutdown_connections 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f5fd406c7c0 0x7f5fd406ec80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fec0f66f0 0x7f5fec106eb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 --2- 172.21.15.152:0/4090448679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0f7990 0x7f5fec1073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 >> 172.21.15.152:0/4090448679 conn(0x7f5fec0f1e50 msgr2=0x7f5fec0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 shutdown_connections 2024-04-06T12:25:45.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.313+0000 7f5ff10ec700 1 -- 172.21.15.152:0/4090448679 wait complete. 2024-04-06T12:25:45.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.413+0000 7f10eeef1700 1 -- 172.21.15.152:0/3049308792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f6ff0 msgr2=0x7f10e80f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.413+0000 7f10eeef1700 1 --2- 172.21.15.152:0/3049308792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f6ff0 0x7f10e80f7a20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f10d40047f0 tx=0x7f10d4009cb0).stop 2024-04-06T12:25:45.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.413+0000 7f10eeef1700 1 -- 172.21.15.152:0/3049308792 shutdown_connections 2024-04-06T12:25:45.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.413+0000 7f10eeef1700 1 --2- 172.21.15.152:0/3049308792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f6ff0 0x7f10e80f7a20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.413+0000 7f10eeef1700 1 --2- 172.21.15.152:0/3049308792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e80f66e0 0x7f10e80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.413+0000 7f10eeef1700 1 -- 172.21.15.152:0/3049308792 >> 172.21.15.152:0/3049308792 conn(0x7f10e80f1ee0 msgr2=0x7f10e80f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:45.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.413+0000 7f10eeef1700 1 -- 172.21.15.152:0/3049308792 shutdown_connections 2024-04-06T12:25:45.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.413+0000 7f10eeef1700 1 -- 172.21.15.152:0/3049308792 wait complete. 2024-04-06T12:25:45.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.414+0000 7f10eeef1700 1 Processor -- start 2024-04-06T12:25:45.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.414+0000 7f10eeef1700 1 -- start start 2024-04-06T12:25:45.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.414+0000 7f10eeef1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f66e0 0x7f10e8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:45.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.414+0000 7f10eeef1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e80f6ff0 0x7f10e810cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:45.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.414+0000 7f10eeef1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e810d280 con 0x7f10e80f66e0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.414+0000 7f10eeef1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e810d3c0 con 0x7f10e80f6ff0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10ecc8d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f66e0 0x7f10e8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10ecc8d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f66e0 0x7f10e8061610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49296/0 (socket says 172.21.15.152:49296) 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10ecc8d700 1 -- 172.21.15.152:0/2017880902 learned_addr learned my addr 172.21.15.152:0/2017880902 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10e7fff700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e80f6ff0 0x7f10e810cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10ecc8d700 1 -- 172.21.15.152:0/2017880902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e80f6ff0 msgr2=0x7f10e810cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10ecc8d700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e80f6ff0 0x7f10e810cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10ecc8d700 1 -- 172.21.15.152:0/2017880902 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4005040 con 0x7f10e80f66e0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10ecc8d700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f66e0 0x7f10e8061610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f10dc0027a0 tx=0x7f10dc002b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10e5ffb700 1 -- 172.21.15.152:0/2017880902 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10dc002db0 con 0x7f10e80f66e0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e810d620 con 0x7f10e80f66e0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10e5ffb700 1 -- 172.21.15.152:0/2017880902 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10dc00f040 con 0x7f10e80f66e0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10e5ffb700 1 -- 172.21.15.152:0/2017880902 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10dc00d870 con 0x7f10e80f66e0 2024-04-06T12:25:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.415+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e810db60 con 0x7f10e80f66e0 2024-04-06T12:25:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.416+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e80feee0 con 0x7f10e80f66e0 2024-04-06T12:25:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.417+0000 7f10e5ffb700 1 -- 172.21.15.152:0/2017880902 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f10dc009110 con 0x7f10e80f66e0 2024-04-06T12:25:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.417+0000 7f10e5ffb700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f10d806c7c0 0x7f10d806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.417+0000 7f10e5ffb700 1 -- 172.21.15.152:0/2017880902 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f10dc08b690 con 0x7f10e80f66e0 2024-04-06T12:25:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.417+0000 7f10e7fff700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f10d806c7c0 0x7f10d806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:45.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.417+0000 7f10e7fff700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f10d806c7c0 0x7f10d806ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f10d4000c00 tx=0x7f10d400b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:45.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.422+0000 7f10e5ffb700 1 -- 172.21.15.152:0/2017880902 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f10dc059570 con 0x7f10e80f66e0 2024-04-06T12:25:45.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.617+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10e8059120 con 0x7f10d806c7c0 2024-04-06T12:25:45.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.627+0000 7f10e5ffb700 1 -- 172.21.15.152:0/2017880902 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f10e8059120 con 0x7f10d806c7c0 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (2m) 45s ago 10m 17.2M - 0.23.0 ba2b418f427c ff669aad1b5a 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (10m) 45s ago 10m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (10m) 16s ago 10m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (95s) 45s ago 10m 46.3M - 8.3.5 dad864ee21e9 bec520698642 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (5m) 45s ago 5m 219M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (5m) 45s ago 5m 236M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (5m) 16s ago 5m 13.6M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (5m) 16s ago 5m 14.3M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:25:45.625 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (66s) 45s ago 12m 470M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (21s) 16s ago 10m 69.9M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (12m) 45s ago 12m 52.2M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (10m) 16s ago 10m 46.1M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 starting - - - - 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (86s) 16s ago 10m 18.6M - 1.3.1 1dbe0e931976 716ffb27d0e7 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (9m) 45s ago 9m 185M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (8m) 45s ago 8m 198M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (8m) 45s ago 8m 164M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (8m) 16s ago 8m 230M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (7m) 16s ago 7m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (7m) 16s ago 7m 196M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:25:45.626 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (28s) 16s ago 9m 49.3M - 2.33.4 514e6a882f6e da550260a4bf 2024-04-06T12:25:45.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f10d806c7c0 msgr2=0x7f10d806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f10d806c7c0 0x7f10d806ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f10d4000c00 tx=0x7f10d400b040).stop 2024-04-06T12:25:45.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f66e0 msgr2=0x7f10e8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f66e0 0x7f10e8061610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f10dc0027a0 tx=0x7f10dc002b60).stop 2024-04-06T12:25:45.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 shutdown_connections 2024-04-06T12:25:45.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f10d806c7c0 0x7f10d806ec80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80f66e0 0x7f10e8061610 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 --2- 172.21.15.152:0/2017880902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e80f6ff0 0x7f10e810cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 >> 172.21.15.152:0/2017880902 conn(0x7f10e80f1ee0 msgr2=0x7f10e80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:45.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 shutdown_connections 2024-04-06T12:25:45.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.629+0000 7f10eeef1700 1 -- 172.21.15.152:0/2017880902 wait complete. 2024-04-06T12:25:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.727+0000 7f942a1b1700 1 -- 172.21.15.152:0/4122936257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 msgr2=0x7f94240f7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.727+0000 7f942a1b1700 1 --2- 172.21.15.152:0/4122936257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 0x7f94240f7bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f94140047f0 tx=0x7f9414009cb0).stop 2024-04-06T12:25:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.727+0000 7f942a1b1700 1 -- 172.21.15.152:0/4122936257 shutdown_connections 2024-04-06T12:25:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.727+0000 7f942a1b1700 1 --2- 172.21.15.152:0/4122936257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94240f80e0 0x7f94240f8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.727+0000 7f942a1b1700 1 --2- 172.21.15.152:0/4122936257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 0x7f94240f7bf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.727+0000 7f942a1b1700 1 -- 172.21.15.152:0/4122936257 >> 172.21.15.152:0/4122936257 conn(0x7f94240f2fb0 msgr2=0x7f94240f53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.727+0000 7f942a1b1700 1 -- 172.21.15.152:0/4122936257 shutdown_connections 2024-04-06T12:25:45.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.727+0000 7f942a1b1700 1 -- 172.21.15.152:0/4122936257 wait complete. 2024-04-06T12:25:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f942a1b1700 1 Processor -- start 2024-04-06T12:25:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f942a1b1700 1 -- start start 2024-04-06T12:25:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f942a1b1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 0x7f9424107fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f942a1b1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94240f80e0 0x7f94241084a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f942a1b1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9424108a50 con 0x7f94240f77d0 2024-04-06T12:25:45.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f942a1b1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9424108b90 con 0x7f94240f80e0 2024-04-06T12:25:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f94237fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 0x7f9424107fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f94237fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 0x7f9424107fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49314/0 (socket says 172.21.15.152:49314) 2024-04-06T12:25:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f94237fe700 1 -- 172.21.15.152:0/3850020405 learned_addr learned my addr 172.21.15.152:0/3850020405 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.728+0000 7f9422ffd700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94240f80e0 0x7f94241084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.729+0000 7f94237fe700 1 -- 172.21.15.152:0/3850020405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94240f80e0 msgr2=0x7f94241084a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.729+0000 7f94237fe700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94240f80e0 0x7f94241084a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.729+0000 7f94237fe700 1 -- 172.21.15.152:0/3850020405 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414005040 con 0x7f94240f77d0 2024-04-06T12:25:45.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.729+0000 7f94237fe700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 0x7f9424107fb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9414013620 tx=0x7f9414009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.729+0000 7f9420ff9700 1 -- 172.21.15.152:0/3850020405 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f941400e070 con 0x7f94240f77d0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.729+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942410d5d0 con 0x7f94240f77d0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.729+0000 7f9420ff9700 1 -- 172.21.15.152:0/3850020405 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9414007e90 con 0x7f94240f77d0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.729+0000 7f9420ff9700 1 -- 172.21.15.152:0/3850020405 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9414018070 con 0x7f94240f77d0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.729+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942410db90 con 0x7f94240f77d0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.730+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9424100000 con 0x7f94240f77d0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.730+0000 7f9420ff9700 1 -- 172.21.15.152:0/3850020405 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f941401d420 con 0x7f94240f77d0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.731+0000 7f9420ff9700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f940c06c7c0 0x7f940c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.731+0000 7f9420ff9700 1 -- 172.21.15.152:0/3850020405 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f941408c770 con 0x7f94240f77d0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.731+0000 7f9422ffd700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f940c06c7c0 0x7f940c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.731+0000 7f9422ffd700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f940c06c7c0 0x7f940c06ec80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9418004de0 tx=0x7f941800b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:45.735+0000 7f9420ff9700 1 -- 172.21.15.152:0/3850020405 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f941405a650 con 0x7f94240f77d0 2024-04-06T12:25:46.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.013+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f94240598f0 con 0x7f94240f77d0 2024-04-06T12:25:46.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.014+0000 7f9420ff9700 1 -- 172.21.15.152:0/3850020405 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f941405a1e0 con 0x7f94240f77d0 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:25:46.012 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:25:46.013 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:25:46.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:25:46.013 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:25:46.013 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 12, 2024-04-06T12:25:46.013 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:25:46.013 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:25:46.013 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f940c06c7c0 msgr2=0x7f940c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f940c06c7c0 0x7f940c06ec80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9418004de0 tx=0x7f941800b040).stop 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 msgr2=0x7f9424107fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 0x7f9424107fb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9414013620 tx=0x7f9414009cb0).stop 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 shutdown_connections 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f940c06c7c0 0x7f940c06ec80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94240f77d0 0x7f9424107fb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 --2- 172.21.15.152:0/3850020405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94240f80e0 0x7f94241084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 >> 172.21.15.152:0/3850020405 conn(0x7f94240f2fb0 msgr2=0x7f94240fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 shutdown_connections 2024-04-06T12:25:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.016+0000 7f942a1b1700 1 -- 172.21.15.152:0/3850020405 wait complete. 2024-04-06T12:25:46.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.120+0000 7f7a65ce6700 1 -- 172.21.15.152:0/978983699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 msgr2=0x7f7a600f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:46.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.120+0000 7f7a65ce6700 1 --2- 172.21.15.152:0/978983699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 0x7f7a600f7e30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f7a500047f0 tx=0x7f7a50009cb0).stop 2024-04-06T12:25:46.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.121+0000 7f7a65ce6700 1 -- 172.21.15.152:0/978983699 shutdown_connections 2024-04-06T12:25:46.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.121+0000 7f7a65ce6700 1 --2- 172.21.15.152:0/978983699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600f8cb0 0x7f7a600f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:46.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.121+0000 7f7a65ce6700 1 --2- 172.21.15.152:0/978983699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 0x7f7a600f7e30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:46.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.121+0000 7f7a65ce6700 1 -- 172.21.15.152:0/978983699 >> 172.21.15.152:0/978983699 conn(0x7f7a600f3150 msgr2=0x7f7a600f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:46.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.121+0000 7f7a65ce6700 1 -- 172.21.15.152:0/978983699 shutdown_connections 2024-04-06T12:25:46.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.121+0000 7f7a65ce6700 1 -- 172.21.15.152:0/978983699 wait complete. 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.121+0000 7f7a65ce6700 1 Processor -- start 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a65ce6700 1 -- start start 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a65ce6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 0x7f7a6006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a65ce6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600f8cb0 0x7f7a6006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a65ce6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6006cf80 con 0x7f7a600f7a10 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a65ce6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6006b520 con 0x7f7a600f8cb0 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a5f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 0x7f7a6006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a5f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 0x7f7a6006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:49334/0 (socket says 172.21.15.152:49334) 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a5f7fe700 1 -- 172.21.15.152:0/3998190483 learned_addr learned my addr 172.21.15.152:0/3998190483 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a5effd700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600f8cb0 0x7f7a6006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a5f7fe700 1 -- 172.21.15.152:0/3998190483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600f8cb0 msgr2=0x7f7a6006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a5f7fe700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600f8cb0 0x7f7a6006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:46.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a5f7fe700 1 -- 172.21.15.152:0/3998190483 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50005040 con 0x7f7a600f7a10 2024-04-06T12:25:46.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.122+0000 7f7a5f7fe700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 0x7f7a6006c9d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7a50013620 tx=0x7f7a50009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:46.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.123+0000 7f7a5cff9700 1 -- 172.21.15.152:0/3998190483 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a5000e070 con 0x7f7a600f7a10 2024-04-06T12:25:46.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.123+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6006b740 con 0x7f7a600f7a10 2024-04-06T12:25:46.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.123+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6006bca0 con 0x7f7a600f7a10 2024-04-06T12:25:46.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.123+0000 7f7a5cff9700 1 -- 172.21.15.152:0/3998190483 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a50007e90 con 0x7f7a600f7a10 2024-04-06T12:25:46.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.123+0000 7f7a5cff9700 1 -- 172.21.15.152:0/3998190483 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a50018070 con 0x7f7a600f7a10 2024-04-06T12:25:46.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.124+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c005150 con 0x7f7a600f7a10 2024-04-06T12:25:46.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.125+0000 7f7a5cff9700 1 -- 172.21.15.152:0/3998190483 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f7a500097f0 con 0x7f7a600f7a10 2024-04-06T12:25:46.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.125+0000 7f7a5cff9700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f7a4806c890 0x7f7a4806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:25:46.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.125+0000 7f7a5cff9700 1 -- 172.21.15.152:0/3998190483 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f7a5008c5f0 con 0x7f7a600f7a10 2024-04-06T12:25:46.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.125+0000 7f7a5effd700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f7a4806c890 0x7f7a4806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:25:46.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.126+0000 7f7a5effd700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f7a4806c890 0x7f7a4806ed50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7a54004dc0 tx=0x7f7a5400b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:25:46.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.134+0000 7f7a5cff9700 1 -- 172.21.15.152:0/3998190483 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f7a5005a410 con 0x7f7a600f7a10 2024-04-06T12:25:46.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.364+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a4c000bf0 con 0x7f7a4806c890 2024-04-06T12:25:46.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.365+0000 7f7a5cff9700 1 -- 172.21.15.152:0/3998190483 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f7a4c000bf0 con 0x7f7a4806c890 2024-04-06T12:25:46.363 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:25:46.363 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:25:46.363 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:25:46.363 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:25:46.363 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:25:46.363 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2024-04-06T12:25:46.363 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:25:46.363 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "2/2 daemons upgraded", 2024-04-06T12:25:46.363 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-06T12:25:46.364 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:25:46.364 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:25:46.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f7a4806c890 msgr2=0x7f7a4806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:46.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f7a4806c890 0x7f7a4806ed50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7a54004dc0 tx=0x7f7a5400b040).stop 2024-04-06T12:25:46.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 msgr2=0x7f7a6006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:25:46.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 0x7f7a6006c9d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7a50013620 tx=0x7f7a50009cb0).stop 2024-04-06T12:25:46.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 shutdown_connections 2024-04-06T12:25:46.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f7a4806c890 0x7f7a4806ed50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:46.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a600f7a10 0x7f7a6006c9d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:46.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 --2- 172.21.15.152:0/3998190483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a600f8cb0 0x7f7a6006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:25:46.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 >> 172.21.15.152:0/3998190483 conn(0x7f7a600f3150 msgr2=0x7f7a600fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:25:46.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 shutdown_connections 2024-04-06T12:25:46.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:25:46.367+0000 7f7a65ce6700 1 -- 172.21.15.152:0/3998190483 wait complete. 2024-04-06T12:25:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:44.993871+0000 mgr.smithi152.lynahm (mgr.24477) 60 : audit [DBG] from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:45.122524+0000 mgr.smithi152.lynahm (mgr.24477) 61 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-06T12:25:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:45.311766+0000 mgr.smithi152.lynahm (mgr.24477) 62 : audit [DBG] from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:45.619423+0000 mgr.smithi152.lynahm (mgr.24477) 63 : audit [DBG] from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:45.876869+0000 mon.smithi152 (mon.0) 822 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:45.880622+0000 mon.smithi152 (mon.0) 823 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:47.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:45.918498+0000 mon.smithi152 (mon.0) 824 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:47.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:46.014753+0000 mon.smithi152 (mon.0) 825 : audit [DBG] from='client.? 172.21.15.152:0/3850020405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:44.993871+0000 mgr.smithi152.lynahm (mgr.24477) 60 : audit [DBG] from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:45.122524+0000 mgr.smithi152.lynahm (mgr.24477) 61 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-06T12:25:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:45.311766+0000 mgr.smithi152.lynahm (mgr.24477) 62 : audit [DBG] from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:45.619423+0000 mgr.smithi152.lynahm (mgr.24477) 63 : audit [DBG] from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:45.876869+0000 mon.smithi152 (mon.0) 822 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:45.880622+0000 mon.smithi152 (mon.0) 823 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:45.918498+0000 mon.smithi152 (mon.0) 824 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:47.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:46.014753+0000 mon.smithi152 (mon.0) 825 : audit [DBG] from='client.? 172.21.15.152:0/3850020405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:48.176 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:46.365909+0000 mgr.smithi152.lynahm (mgr.24477) 64 : audit [DBG] from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:48.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:47 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:46.365909+0000 mgr.smithi152.lynahm (mgr.24477) 64 : audit [DBG] from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:25:49.013 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:47.122875+0000 mgr.smithi152.lynahm (mgr.24477) 65 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:25:49.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:47.122875+0000 mgr.smithi152.lynahm (mgr.24477) 65 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:25:50.994 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:49.123333+0000 mgr.smithi152.lynahm (mgr.24477) 66 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:25:50.994 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:49.646444+0000 mon.smithi152 (mon.0) 826 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:50.995 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:49.652181+0000 mon.smithi152 (mon.0) 827 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:50.995 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:50.289327+0000 mon.smithi152 (mon.0) 828 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:50.995 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:50.293960+0000 mon.smithi152 (mon.0) 829 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:51.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:49.123333+0000 mgr.smithi152.lynahm (mgr.24477) 66 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:25:51.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:49.646444+0000 mon.smithi152 (mon.0) 826 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:51.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:49.652181+0000 mon.smithi152 (mon.0) 827 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:51.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:50.289327+0000 mon.smithi152 (mon.0) 828 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:51.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:50.293960+0000 mon.smithi152 (mon.0) 829 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:52.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:51.053728+0000 mon.smithi152 (mon.0) 830 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:52.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:51.058165+0000 mon.smithi152 (mon.0) 831 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:52.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:51.123699+0000 mgr.smithi152.lynahm (mgr.24477) 67 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-06T12:25:52.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:51.691395+0000 mon.smithi152 (mon.0) 832 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:52.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:51.695127+0000 mon.smithi152 (mon.0) 833 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:52.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:51.053728+0000 mon.smithi152 (mon.0) 830 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:52.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:51.058165+0000 mon.smithi152 (mon.0) 831 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:52.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:51.123699+0000 mgr.smithi152.lynahm (mgr.24477) 67 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-06T12:25:52.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:51.691395+0000 mon.smithi152 (mon.0) 832 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:52.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:51.695127+0000 mon.smithi152 (mon.0) 833 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:54.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:53.124104+0000 mgr.smithi152.lynahm (mgr.24477) 68 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:25:54.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:53.213440+0000 mon.smithi152 (mon.0) 834 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:25:54.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:53.376899+0000 mon.smithi152 (mon.0) 835 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:54.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:53.381250+0000 mon.smithi152 (mon.0) 836 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:54.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:53.124104+0000 mgr.smithi152.lynahm (mgr.24477) 68 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:25:54.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:53.213440+0000 mon.smithi152 (mon.0) 834 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:25:54.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:53.376899+0000 mon.smithi152 (mon.0) 835 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:54.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:53.381250+0000 mon.smithi152 (mon.0) 836 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:55.124811+0000 mgr.smithi152.lynahm (mgr.24477) 69 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.271232+0000 mon.smithi152 (mon.0) 837 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.275305+0000 mon.smithi152 (mon.0) 838 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.276123+0000 mon.smithi152 (mon.0) 839 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.276726+0000 mon.smithi152 (mon.0) 840 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.280488+0000 mon.smithi152 (mon.0) 841 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.417631+0000 mon.smithi152 (mon.0) 842 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.420047+0000 mon.smithi152 (mon.0) 843 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.422343+0000 mon.smithi152 (mon.0) 844 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.423256+0000 mon.smithi152 (mon.0) 845 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.424104+0000 mon.smithi152 (mon.0) 846 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.424927+0000 mon.smithi152 (mon.0) 847 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.425761+0000 mon.smithi152 (mon.0) 848 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.426632+0000 mon.smithi152 (mon.0) 849 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.427604+0000 mon.smithi152 (mon.0) 850 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:25:55.428819+0000 mon.smithi152 (mon.0) 851 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:55.124811+0000 mgr.smithi152.lynahm (mgr.24477) 69 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.271232+0000 mon.smithi152 (mon.0) 837 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.275305+0000 mon.smithi152 (mon.0) 838 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.276123+0000 mon.smithi152 (mon.0) 839 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.276726+0000 mon.smithi152 (mon.0) 840 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.280488+0000 mon.smithi152 (mon.0) 841 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.417631+0000 mon.smithi152 (mon.0) 842 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.420047+0000 mon.smithi152 (mon.0) 843 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.422343+0000 mon.smithi152 (mon.0) 844 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.423256+0000 mon.smithi152 (mon.0) 845 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.424104+0000 mon.smithi152 (mon.0) 846 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.424927+0000 mon.smithi152 (mon.0) 847 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.425761+0000 mon.smithi152 (mon.0) 848 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.426632+0000 mon.smithi152 (mon.0) 849 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.427604+0000 mon.smithi152 (mon.0) 850 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:56.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:25:55.428819+0000 mon.smithi152 (mon.0) 851 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:25:58.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:56.997097+0000 mgr.smithi152.lynahm (mgr.24477) 70 : cephadm [INF] Upgrade: Updating prometheus.smithi195 2024-04-06T12:25:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:57.125096+0000 mgr.smithi152.lynahm (mgr.24477) 71 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:25:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:25:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:25:57.214018+0000 mgr.smithi152.lynahm (mgr.24477) 72 : cephadm [INF] Deploying daemon prometheus.smithi195 on smithi195 2024-04-06T12:25:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:56.997097+0000 mgr.smithi152.lynahm (mgr.24477) 70 : cephadm [INF] Upgrade: Updating prometheus.smithi195 2024-04-06T12:25:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:57.125096+0000 mgr.smithi152.lynahm (mgr.24477) 71 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:25:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:25:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:25:57.214018+0000 mgr.smithi152.lynahm (mgr.24477) 72 : cephadm [INF] Deploying daemon prometheus.smithi195 on smithi195 2024-04-06T12:26:00.474 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:25:59.125525+0000 mgr.smithi152.lynahm (mgr.24477) 73 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:25:59.125525+0000 mgr.smithi152.lynahm (mgr.24477) 73 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:01.125964+0000 mgr.smithi152.lynahm (mgr.24477) 74 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-06T12:26:02.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:01.125964+0000 mgr.smithi152.lynahm (mgr.24477) 74 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-06T12:26:03.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:02.464012+0000 mon.smithi152 (mon.0) 852 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:03.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:02.468832+0000 mon.smithi152 (mon.0) 853 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:03.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:03 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:02.490602+0000 mon.smithi152 (mon.0) 854 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:03.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:02.464012+0000 mon.smithi152 (mon.0) 852 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:03.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:02.468832+0000 mon.smithi152 (mon.0) 853 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:03.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:03 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:02.490602+0000 mon.smithi152 (mon.0) 854 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:04.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:03.126342+0000 mgr.smithi152.lynahm (mgr.24477) 75 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:04.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:03.126342+0000 mgr.smithi152.lynahm (mgr.24477) 75 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:06.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:05.126842+0000 mgr.smithi152.lynahm (mgr.24477) 76 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:06.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:06.120575+0000 mon.smithi152 (mon.0) 855 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:06.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:06.125691+0000 mon.smithi152 (mon.0) 856 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:06.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:05.126842+0000 mgr.smithi152.lynahm (mgr.24477) 76 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:06.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:06.120575+0000 mon.smithi152 (mon.0) 855 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:06.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:06.125691+0000 mon.smithi152 (mon.0) 856 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:08.013 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:06.760655+0000 mon.smithi152 (mon.0) 857 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:08.013 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:07 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:06.765637+0000 mon.smithi152 (mon.0) 858 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:08.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:06.760655+0000 mon.smithi152 (mon.0) 857 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:08.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:06.765637+0000 mon.smithi152 (mon.0) 858 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:09.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:07.127239+0000 mgr.smithi152.lynahm (mgr.24477) 77 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:09.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:08.213875+0000 mon.smithi152 (mon.0) 859 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:26:09.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:07.127239+0000 mgr.smithi152.lynahm (mgr.24477) 77 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:09.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:08.213875+0000 mon.smithi152 (mon.0) 859 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:26:11.023 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:09.127929+0000 mgr.smithi152.lynahm (mgr.24477) 78 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:11.023 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:09.995318+0000 mon.smithi152 (mon.0) 860 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:11.023 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.002148+0000 mon.smithi152 (mon.0) 861 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:11.023 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.003035+0000 mon.smithi152 (mon.0) 862 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.003819+0000 mon.smithi152 (mon.0) 863 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.008302+0000 mon.smithi152 (mon.0) 864 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.145614+0000 mon.smithi152 (mon.0) 865 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.151864+0000 mon.smithi152 (mon.0) 866 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.154408+0000 mon.smithi152 (mon.0) 867 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.156952+0000 mon.smithi152 (mon.0) 868 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.157892+0000 mon.smithi152 (mon.0) 869 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.158809+0000 mon.smithi152 (mon.0) 870 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.159791+0000 mon.smithi152 (mon.0) 871 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.160814+0000 mon.smithi152 (mon.0) 872 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.161800+0000 mon.smithi152 (mon.0) 873 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.162852+0000 mon.smithi152 (mon.0) 874 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.164091+0000 mon.smithi152 (mon.0) 875 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.024 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.165196+0000 mon.smithi152 (mon.0) 876 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:09.127929+0000 mgr.smithi152.lynahm (mgr.24477) 78 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:09.995318+0000 mon.smithi152 (mon.0) 860 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.002148+0000 mon.smithi152 (mon.0) 861 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.003035+0000 mon.smithi152 (mon.0) 862 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.003819+0000 mon.smithi152 (mon.0) 863 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.008302+0000 mon.smithi152 (mon.0) 864 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.145614+0000 mon.smithi152 (mon.0) 865 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.151864+0000 mon.smithi152 (mon.0) 866 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.154408+0000 mon.smithi152 (mon.0) 867 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.156952+0000 mon.smithi152 (mon.0) 868 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.157892+0000 mon.smithi152 (mon.0) 869 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.158809+0000 mon.smithi152 (mon.0) 870 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.159791+0000 mon.smithi152 (mon.0) 871 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.160814+0000 mon.smithi152 (mon.0) 872 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.051 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.161800+0000 mon.smithi152 (mon.0) 873 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.051 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.162852+0000 mon.smithi152 (mon.0) 874 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.051 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.164091+0000 mon.smithi152 (mon.0) 875 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:11.051 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.165196+0000 mon.smithi152 (mon.0) 876 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:12.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:10.146122+0000 mgr.smithi152.lynahm (mgr.24477) 79 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:26:12.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:11 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:10.146122+0000 mgr.smithi152.lynahm (mgr.24477) 79 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-06T12:26:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:11.128291+0000 mgr.smithi152.lynahm (mgr.24477) 80 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:26:11.733192+0000 mgr.smithi152.lynahm (mgr.24477) 81 : cephadm [INF] Upgrade: Updating alertmanager.smithi152 2024-04-06T12:26:13.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:26:11.740002+0000 mgr.smithi152.lynahm (mgr.24477) 82 : cephadm [INF] Deploying daemon alertmanager.smithi152 on smithi152 2024-04-06T12:26:13.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:11.128291+0000 mgr.smithi152.lynahm (mgr.24477) 80 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:13.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:26:11.733192+0000 mgr.smithi152.lynahm (mgr.24477) 81 : cephadm [INF] Upgrade: Updating alertmanager.smithi152 2024-04-06T12:26:13.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:26:11.740002+0000 mgr.smithi152.lynahm (mgr.24477) 82 : cephadm [INF] Deploying daemon alertmanager.smithi152 on smithi152 2024-04-06T12:26:14.927 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:13.128737+0000 mgr.smithi152.lynahm (mgr.24477) 83 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:15.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:13.128737+0000 mgr.smithi152.lynahm (mgr.24477) 83 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:16.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.470+0000 7fc3634a6700 1 -- 172.21.15.152:0/802799753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f8cb0 msgr2=0x7fc35c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.470+0000 7fc3634a6700 1 --2- 172.21.15.152:0/802799753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f8cb0 0x7fc35c0f9110 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fc3580047f0 tx=0x7fc358009cb0).stop 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.470+0000 7fc3634a6700 1 -- 172.21.15.152:0/802799753 shutdown_connections 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.470+0000 7fc3634a6700 1 --2- 172.21.15.152:0/802799753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f8cb0 0x7fc35c0f9110 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.470+0000 7fc3634a6700 1 --2- 172.21.15.152:0/802799753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc35c0f7a10 0x7fc35c0f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.470+0000 7fc3634a6700 1 -- 172.21.15.152:0/802799753 >> 172.21.15.152:0/802799753 conn(0x7fc35c0f3150 msgr2=0x7fc35c0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc3634a6700 1 -- 172.21.15.152:0/802799753 shutdown_connections 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc3634a6700 1 -- 172.21.15.152:0/802799753 wait complete. 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc3634a6700 1 Processor -- start 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc3634a6700 1 -- start start 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc3634a6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f7a10 0x7fc35c108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc3634a6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc35c0f8cb0 0x7fc35c108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc3634a6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c108c30 con 0x7fc35c0f7a10 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc3634a6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c108d70 con 0x7fc35c0f8cb0 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc361242700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f7a10 0x7fc35c108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc361242700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f7a10 0x7fc35c108190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46834/0 (socket says 172.21.15.152:46834) 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.471+0000 7fc361242700 1 -- 172.21.15.152:0/2723122594 learned_addr learned my addr 172.21.15.152:0/2723122594 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc360a41700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc35c0f8cb0 0x7fc35c108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc361242700 1 -- 172.21.15.152:0/2723122594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc35c0f8cb0 msgr2=0x7fc35c108680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc361242700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc35c0f8cb0 0x7fc35c108680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc361242700 1 -- 172.21.15.152:0/2723122594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358005040 con 0x7fc35c0f7a10 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc360a41700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc35c0f8cb0 0x7fc35c108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc361242700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f7a10 0x7fc35c108190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fc350002770 tx=0x7fc350002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc34e7fc700 1 -- 172.21.15.152:0/2723122594 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc350007b40 con 0x7fc35c0f7a10 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc34e7fc700 1 -- 172.21.15.152:0/2723122594 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc35000f040 con 0x7fc35c0f7a10 2024-04-06T12:26:16.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c10d810 con 0x7fc35c0f7a10 2024-04-06T12:26:16.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc34e7fc700 1 -- 172.21.15.152:0/2723122594 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc35000d830 con 0x7fc35c0f7a10 2024-04-06T12:26:16.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.472+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c10dd50 con 0x7fc35c0f7a10 2024-04-06T12:26:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.473+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c05fb50 con 0x7fc35c0f7a10 2024-04-06T12:26:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.473+0000 7fc34e7fc700 1 -- 172.21.15.152:0/2723122594 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7fc350007ca0 con 0x7fc35c0f7a10 2024-04-06T12:26:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.474+0000 7fc34e7fc700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc34806c7c0 0x7fc34806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.474+0000 7fc34e7fc700 1 -- 172.21.15.152:0/2723122594 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fc35008b5e0 con 0x7fc35c0f7a10 2024-04-06T12:26:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.474+0000 7fc360a41700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc34806c7c0 0x7fc34806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:26:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.474+0000 7fc360a41700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc34806c7c0 0x7fc34806ec80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc3580043d0 tx=0x7fc35800b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:16.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.479+0000 7fc34e7fc700 1 -- 172.21.15.152:0/2723122594 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fc3500594c0 con 0x7fc35c0f7a10 2024-04-06T12:26:16.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.719+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc35c059120 con 0x7fc34806c7c0 2024-04-06T12:26:16.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.721+0000 7fc34e7fc700 1 -- 172.21.15.152:0/2723122594 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fc35c059120 con 0x7fc34806c7c0 2024-04-06T12:26:16.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc34806c7c0 msgr2=0x7fc34806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:16.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc34806c7c0 0x7fc34806ec80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc3580043d0 tx=0x7fc35800b040).stop 2024-04-06T12:26:16.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f7a10 msgr2=0x7fc35c108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:16.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f7a10 0x7fc35c108190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fc350002770 tx=0x7fc350002b30).stop 2024-04-06T12:26:16.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 shutdown_connections 2024-04-06T12:26:16.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc34806c7c0 0x7fc34806ec80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:16.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c0f7a10 0x7fc35c108190 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:16.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 --2- 172.21.15.152:0/2723122594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc35c0f8cb0 0x7fc35c108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:16.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 >> 172.21.15.152:0/2723122594 conn(0x7fc35c0f3150 msgr2=0x7fc35c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:16.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 shutdown_connections 2024-04-06T12:26:16.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.723+0000 7fc3634a6700 1 -- 172.21.15.152:0/2723122594 wait complete. 2024-04-06T12:26:16.731 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:26:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.831+0000 7f127b9c2700 1 -- 172.21.15.152:0/3837981882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1274061280 msgr2=0x7f12740fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.831+0000 7f127b9c2700 1 --2- 172.21.15.152:0/3837981882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1274061280 0x7f12740fa3d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f12700047f0 tx=0x7f1270009cb0).stop 2024-04-06T12:26:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.831+0000 7f127b9c2700 1 -- 172.21.15.152:0/3837981882 shutdown_connections 2024-04-06T12:26:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.831+0000 7f127b9c2700 1 --2- 172.21.15.152:0/3837981882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12740fa950 0x7f12740fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.831+0000 7f127b9c2700 1 --2- 172.21.15.152:0/3837981882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1274061280 0x7f12740fa3d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.831+0000 7f127b9c2700 1 -- 172.21.15.152:0/3837981882 >> 172.21.15.152:0/3837981882 conn(0x7f12740f1e50 msgr2=0x7f12740f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.831+0000 7f127b9c2700 1 -- 172.21.15.152:0/3837981882 shutdown_connections 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.831+0000 7f127b9c2700 1 -- 172.21.15.152:0/3837981882 wait complete. 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f127b9c2700 1 Processor -- start 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f127b9c2700 1 -- start start 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f127b9c2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1274061280 0x7f1274107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f127b9c2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12740fa950 0x7f1274108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f127b9c2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1274108a00 con 0x7f12740fa950 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f127b9c2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1274108b40 con 0x7f1274061280 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f1278f5d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12740fa950 0x7f1274108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f1278f5d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12740fa950 0x7f1274108450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46852/0 (socket says 172.21.15.152:46852) 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f1278f5d700 1 -- 172.21.15.152:0/1115809904 learned_addr learned my addr 172.21.15.152:0/1115809904 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f127975e700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1274061280 0x7f1274107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f1278f5d700 1 -- 172.21.15.152:0/1115809904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1274061280 msgr2=0x7f1274107f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:16.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f1278f5d700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1274061280 0x7f1274107f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f1278f5d700 1 -- 172.21.15.152:0/1115809904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270005040 con 0x7f12740fa950 2024-04-06T12:26:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.832+0000 7f1278f5d700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12740fa950 0x7f1274108450 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f126400c710 tx=0x7f1264007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.833+0000 7f126a7fc700 1 -- 172.21.15.152:0/1115809904 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f126400e680 con 0x7f12740fa950 2024-04-06T12:26:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.833+0000 7f126a7fc700 1 -- 172.21.15.152:0/1115809904 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f126400ec90 con 0x7f12740fa950 2024-04-06T12:26:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.833+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127410d5e0 con 0x7f12740fa950 2024-04-06T12:26:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.833+0000 7f126a7fc700 1 -- 172.21.15.152:0/1115809904 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1264013d40 con 0x7f12740fa950 2024-04-06T12:26:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.833+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127410dba0 con 0x7f12740fa950 2024-04-06T12:26:16.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.834+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12740fffe0 con 0x7f12740fa950 2024-04-06T12:26:16.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.834+0000 7f126a7fc700 1 -- 172.21.15.152:0/1115809904 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f126400e7e0 con 0x7f12740fa950 2024-04-06T12:26:16.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.835+0000 7f126a7fc700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f126006c7c0 0x7f126006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:16.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.835+0000 7f126a7fc700 1 -- 172.21.15.152:0/1115809904 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f126408b700 con 0x7f12740fa950 2024-04-06T12:26:16.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.835+0000 7f127975e700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f126006c7c0 0x7f126006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:26:16.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.835+0000 7f127975e700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f126006c7c0 0x7f126006ec80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1270004f10 tx=0x7f127000b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:16.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:16.841+0000 7f126a7fc700 1 -- 172.21.15.152:0/1115809904 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f12640596f0 con 0x7f12740fa950 2024-04-06T12:26:17.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:15.129459+0000 mgr.smithi152.lynahm (mgr.24477) 84 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:17.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:15.129459+0000 mgr.smithi152.lynahm (mgr.24477) 84 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:17.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.064+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1274059120 con 0x7f126006c7c0 2024-04-06T12:26:17.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.065+0000 7f126a7fc700 1 -- 172.21.15.152:0/1115809904 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1274059120 con 0x7f126006c7c0 2024-04-06T12:26:17.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.067+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f126006c7c0 msgr2=0x7f126006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.067+0000 7f127b9c2700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f126006c7c0 0x7f126006ec80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1270004f10 tx=0x7f127000b040).stop 2024-04-06T12:26:17.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.067+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12740fa950 msgr2=0x7f1274108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.067+0000 7f127b9c2700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12740fa950 0x7f1274108450 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f126400c710 tx=0x7f1264007ec0).stop 2024-04-06T12:26:17.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.067+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 shutdown_connections 2024-04-06T12:26:17.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.067+0000 7f127b9c2700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1274061280 0x7f1274107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.067+0000 7f127b9c2700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f126006c7c0 0x7f126006ec80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.067+0000 7f127b9c2700 1 --2- 172.21.15.152:0/1115809904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12740fa950 0x7f1274108450 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.067+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 >> 172.21.15.152:0/1115809904 conn(0x7f12740f1e50 msgr2=0x7f12740f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:17.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.068+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 shutdown_connections 2024-04-06T12:26:17.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.068+0000 7f127b9c2700 1 -- 172.21.15.152:0/1115809904 wait complete. 2024-04-06T12:26:17.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.168+0000 7f23d1a90700 1 -- 172.21.15.152:0/780983292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f7990 msgr2=0x7f23cc0f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.168+0000 7f23d1a90700 1 --2- 172.21.15.152:0/780983292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f7990 0x7f23cc0f7df0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f23c00047f0 tx=0x7f23c0009cb0).stop 2024-04-06T12:26:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.168+0000 7f23d1a90700 1 -- 172.21.15.152:0/780983292 shutdown_connections 2024-04-06T12:26:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.168+0000 7f23d1a90700 1 --2- 172.21.15.152:0/780983292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f7990 0x7f23cc0f7df0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.168+0000 7f23d1a90700 1 --2- 172.21.15.152:0/780983292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23cc0f66f0 0x7f23cc0f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.168+0000 7f23d1a90700 1 -- 172.21.15.152:0/780983292 >> 172.21.15.152:0/780983292 conn(0x7f23cc0f1e50 msgr2=0x7f23cc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.168+0000 7f23d1a90700 1 -- 172.21.15.152:0/780983292 shutdown_connections 2024-04-06T12:26:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.168+0000 7f23d1a90700 1 -- 172.21.15.152:0/780983292 wait complete. 2024-04-06T12:26:17.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23d1a90700 1 Processor -- start 2024-04-06T12:26:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23d1a90700 1 -- start start 2024-04-06T12:26:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23d1a90700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f66f0 0x7f23cc107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23d1a90700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23cc0f7990 0x7f23cc108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23d1a90700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc1089f0 con 0x7f23cc0f66f0 2024-04-06T12:26:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23d1a90700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc108b30 con 0x7f23cc0f7990 2024-04-06T12:26:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23cb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f66f0 0x7f23cc107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23cb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f66f0 0x7f23cc107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46880/0 (socket says 172.21.15.152:46880) 2024-04-06T12:26:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23cb7fe700 1 -- 172.21.15.152:0/863553018 learned_addr learned my addr 172.21.15.152:0/863553018 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:26:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.169+0000 7f23caffd700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23cc0f7990 0x7f23cc108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.170+0000 7f23cb7fe700 1 -- 172.21.15.152:0/863553018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23cc0f7990 msgr2=0x7f23cc108440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.170+0000 7f23cb7fe700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23cc0f7990 0x7f23cc108440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.170+0000 7f23cb7fe700 1 -- 172.21.15.152:0/863553018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0005040 con 0x7f23cc0f66f0 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.170+0000 7f23cb7fe700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f66f0 0x7f23cc107f50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f23bc00c790 tx=0x7f23bc007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.170+0000 7f23c8f74700 1 -- 172.21.15.152:0/863553018 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23bc00e680 con 0x7f23cc0f66f0 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.170+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23cc10d5d0 con 0x7f23cc0f66f0 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.170+0000 7f23c8f74700 1 -- 172.21.15.152:0/863553018 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23bc00ec90 con 0x7f23cc0f66f0 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.170+0000 7f23c8f74700 1 -- 172.21.15.152:0/863553018 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23bc013e20 con 0x7f23cc0f66f0 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.170+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23cc10db90 con 0x7f23cc0f66f0 2024-04-06T12:26:17.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.171+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23cc0feeb0 con 0x7f23cc0f66f0 2024-04-06T12:26:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.172+0000 7f23c8f74700 1 -- 172.21.15.152:0/863553018 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f23bc00e7e0 con 0x7f23cc0f66f0 2024-04-06T12:26:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.172+0000 7f23c8f74700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f23b406c760 0x7f23b406ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.172+0000 7f23c8f74700 1 -- 172.21.15.152:0/863553018 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f23bc08bb70 con 0x7f23cc0f66f0 2024-04-06T12:26:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.172+0000 7f23caffd700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f23b406c760 0x7f23b406ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:26:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.172+0000 7f23caffd700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f23b406c760 0x7f23b406ec20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f23c0004f10 tx=0x7f23c000b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:17.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.179+0000 7f23c8f74700 1 -- 172.21.15.152:0/863553018 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f23bc059b60 con 0x7f23cc0f66f0 2024-04-06T12:26:17.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.385+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f23cc0fbdd0 con 0x7f23b406c760 2024-04-06T12:26:17.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.397+0000 7f23c8f74700 1 -- 172.21.15.152:0/863553018 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f23cc0fbdd0 con 0x7f23b406c760 2024-04-06T12:26:17.396 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:26:17.396 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (3m) 26s ago 11m 17.7M - 0.23.0 ba2b418f427c ff669aad1b5a 2024-04-06T12:26:17.396 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (11m) 26s ago 11m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:26:17.397 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (10m) 11s ago 10m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:26:17.397 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (2m) 26s ago 11m 45.4M - 8.3.5 dad864ee21e9 bec520698642 2024-04-06T12:26:17.397 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (6m) 26s ago 6m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:26:17.397 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (6m) 26s ago 6m 163M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:26:17.397 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (6m) 11s ago 6m 13.7M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:26:17.397 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (6m) 11s ago 6m 14.5M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:26:17.398 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (97s) 26s ago 12m 495M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:26:17.398 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (53s) 11s ago 10m 447M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:26:17.398 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (12m) 26s ago 13m 56.0M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:26:17.398 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (10m) 11s ago 10m 50.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:26:17.398 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (38s) 26s ago 11m 3363k - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:26:17.398 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (32s) 11s ago 10m 7121k - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:26:17.398 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (10m) 26s ago 10m 203M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:26:17.399 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (9m) 26s ago 9m 216M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:26:17.399 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (9m) 26s ago 9m 180M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:26:17.399 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (8m) 11s ago 8m 230M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:26:17.399 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (8m) 11s ago 8m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:26:17.399 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (7m) 11s ago 7m 196M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:26:17.399 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (15s) 11s ago 10m 36.1M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:26:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f23b406c760 msgr2=0x7f23b406ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f23b406c760 0x7f23b406ec20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f23c0004f10 tx=0x7f23c000b040).stop 2024-04-06T12:26:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f66f0 msgr2=0x7f23cc107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f66f0 0x7f23cc107f50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f23bc00c790 tx=0x7f23bc007f10).stop 2024-04-06T12:26:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 shutdown_connections 2024-04-06T12:26:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f23b406c760 0x7f23b406ec20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23cc0f66f0 0x7f23cc107f50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 --2- 172.21.15.152:0/863553018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23cc0f7990 0x7f23cc108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 >> 172.21.15.152:0/863553018 conn(0x7f23cc0f1e50 msgr2=0x7f23cc060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:17.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 shutdown_connections 2024-04-06T12:26:17.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.400+0000 7f23d1a90700 1 -- 172.21.15.152:0/863553018 wait complete. 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.500+0000 7ff4a592a700 1 -- 172.21.15.152:0/2385515328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 msgr2=0x7ff4a00f8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.500+0000 7ff4a592a700 1 --2- 172.21.15.152:0/2385515328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 0x7ff4a00f8bf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7ff4900047f0 tx=0x7ff490009cb0).stop 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.500+0000 7ff4a592a700 1 -- 172.21.15.152:0/2385515328 shutdown_connections 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.500+0000 7ff4a592a700 1 --2- 172.21.15.152:0/2385515328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 0x7ff4a00f8bf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.500+0000 7ff4a592a700 1 --2- 172.21.15.152:0/2385515328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4a00f5ad0 0x7ff4a00f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.500+0000 7ff4a592a700 1 -- 172.21.15.152:0/2385515328 >> 172.21.15.152:0/2385515328 conn(0x7ff4a00f1610 msgr2=0x7ff4a00f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.500+0000 7ff4a592a700 1 -- 172.21.15.152:0/2385515328 shutdown_connections 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.500+0000 7ff4a592a700 1 -- 172.21.15.152:0/2385515328 wait complete. 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff4a592a700 1 Processor -- start 2024-04-06T12:26:17.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff4a592a700 1 -- start start 2024-04-06T12:26:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff4a592a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4a00f5ad0 0x7ff4a00f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff4a592a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 0x7ff4a00f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff4a592a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00f8a50 con 0x7ff4a00f6470 2024-04-06T12:26:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff4a592a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00f6ff0 con 0x7ff4a00f5ad0 2024-04-06T12:26:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff49e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 0x7ff4a00f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff49e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 0x7ff4a00f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46908/0 (socket says 172.21.15.152:46908) 2024-04-06T12:26:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff49e7fc700 1 -- 172.21.15.152:0/802244202 learned_addr learned my addr 172.21.15.152:0/802244202 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:26:17.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.501+0000 7ff49effd700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4a00f5ad0 0x7ff4a00f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.502+0000 7ff49e7fc700 1 -- 172.21.15.152:0/802244202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4a00f5ad0 msgr2=0x7ff4a00f84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.502+0000 7ff49e7fc700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4a00f5ad0 0x7ff4a00f84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.502+0000 7ff49e7fc700 1 -- 172.21.15.152:0/802244202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490005040 con 0x7ff4a00f6470 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.502+0000 7ff49e7fc700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 0x7ff4a00f6b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7ff49000b120 tx=0x7ff490009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.502+0000 7ff497fff700 1 -- 172.21.15.152:0/802244202 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff49000e030 con 0x7ff4a00f6470 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.502+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a00f7210 con 0x7ff4a00f6470 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.502+0000 7ff497fff700 1 -- 172.21.15.152:0/802244202 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff490007e90 con 0x7ff4a00f6470 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.502+0000 7ff497fff700 1 -- 172.21.15.152:0/802244202 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff490018070 con 0x7ff4a00f6470 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.502+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a00f7770 con 0x7ff4a00f6470 2024-04-06T12:26:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.503+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a00ffff0 con 0x7ff4a00f6470 2024-04-06T12:26:17.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.504+0000 7ff497fff700 1 -- 172.21.15.152:0/802244202 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7ff49001d420 con 0x7ff4a00f6470 2024-04-06T12:26:17.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.504+0000 7ff497fff700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff48c06c7c0 0x7ff48c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:17.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.504+0000 7ff49effd700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff48c06c7c0 0x7ff48c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:26:17.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.504+0000 7ff497fff700 1 -- 172.21.15.152:0/802244202 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7ff49008ceb0 con 0x7ff4a00f6470 2024-04-06T12:26:17.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.505+0000 7ff49effd700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff48c06c7c0 0x7ff48c06ec80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff4a0060880 tx=0x7ff488009040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:17.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.509+0000 7ff497fff700 1 -- 172.21.15.152:0/802244202 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7ff49005ad90 con 0x7ff4a00f6470 2024-04-06T12:26:17.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.795+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff4a00598f0 con 0x7ff4a00f6470 2024-04-06T12:26:17.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.796+0000 7ff497fff700 1 -- 172.21.15.152:0/802244202 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7ff49005a920 con 0x7ff4a00f6470 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:26:17.794 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:26:17.795 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:26:17.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:26:17.795 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:26:17.795 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 12, 2024-04-06T12:26:17.795 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:26:17.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:26:17.795 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:26:17.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff48c06c7c0 msgr2=0x7ff48c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff48c06c7c0 0x7ff48c06ec80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff4a0060880 tx=0x7ff488009040).stop 2024-04-06T12:26:17.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 msgr2=0x7ff4a00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 0x7ff4a00f6b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7ff49000b120 tx=0x7ff490009cb0).stop 2024-04-06T12:26:17.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 shutdown_connections 2024-04-06T12:26:17.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4a00f5ad0 0x7ff4a00f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff48c06c7c0 0x7ff48c06ec80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 --2- 172.21.15.152:0/802244202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4a00f6470 0x7ff4a00f6b00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 >> 172.21.15.152:0/802244202 conn(0x7ff4a00f1610 msgr2=0x7ff4a00fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:17.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 shutdown_connections 2024-04-06T12:26:17.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.798+0000 7ff4a592a700 1 -- 172.21.15.152:0/802244202 wait complete. 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.904+0000 7f1a46979700 1 -- 172.21.15.152:0/1292362782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 msgr2=0x7f1a400f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.904+0000 7f1a46979700 1 --2- 172.21.15.152:0/1292362782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 0x7f1a400f7df0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f1a340047f0 tx=0x7f1a34009cb0).stop 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.904+0000 7f1a46979700 1 -- 172.21.15.152:0/1292362782 shutdown_connections 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.904+0000 7f1a46979700 1 --2- 172.21.15.152:0/1292362782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 0x7f1a400f7df0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.904+0000 7f1a46979700 1 --2- 172.21.15.152:0/1292362782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a400f66f0 0x7f1a400f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.904+0000 7f1a46979700 1 -- 172.21.15.152:0/1292362782 >> 172.21.15.152:0/1292362782 conn(0x7f1a400f1e50 msgr2=0x7f1a400f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.904+0000 7f1a46979700 1 -- 172.21.15.152:0/1292362782 shutdown_connections 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.904+0000 7f1a46979700 1 -- 172.21.15.152:0/1292362782 wait complete. 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a46979700 1 Processor -- start 2024-04-06T12:26:17.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a46979700 1 -- start start 2024-04-06T12:26:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a46979700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a400f66f0 0x7f1a40107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a46979700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 0x7f1a40108480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a46979700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40108a30 con 0x7f1a400f7990 2024-04-06T12:26:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a46979700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40108b70 con 0x7f1a400f66f0 2024-04-06T12:26:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a3f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 0x7f1a40108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a3f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 0x7f1a40108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46940/0 (socket says 172.21.15.152:46940) 2024-04-06T12:26:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a3f7fe700 1 -- 172.21.15.152:0/3666839031 learned_addr learned my addr 172.21.15.152:0/3666839031 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:26:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.905+0000 7f1a3ffff700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a400f66f0 0x7f1a40107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.906+0000 7f1a3f7fe700 1 -- 172.21.15.152:0/3666839031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a400f66f0 msgr2=0x7f1a40107f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:17.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.906+0000 7f1a3f7fe700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a400f66f0 0x7f1a40107f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:17.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.906+0000 7f1a3f7fe700 1 -- 172.21.15.152:0/3666839031 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34005040 con 0x7f1a400f7990 2024-04-06T12:26:17.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.906+0000 7f1a3f7fe700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 0x7f1a40108480 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f1a34013620 tx=0x7f1a34009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:17.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.906+0000 7f1a3d7fa700 1 -- 172.21.15.152:0/3666839031 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a3400e070 con 0x7f1a400f7990 2024-04-06T12:26:17.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.906+0000 7f1a3d7fa700 1 -- 172.21.15.152:0/3666839031 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a34007e90 con 0x7f1a400f7990 2024-04-06T12:26:17.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.906+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4010d5b0 con 0x7f1a400f7990 2024-04-06T12:26:17.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.906+0000 7f1a3d7fa700 1 -- 172.21.15.152:0/3666839031 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a34018070 con 0x7f1a400f7990 2024-04-06T12:26:17.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.906+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4010db70 con 0x7f1a400f7990 2024-04-06T12:26:17.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.907+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a400feed0 con 0x7f1a400f7990 2024-04-06T12:26:17.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.908+0000 7f1a3d7fa700 1 -- 172.21.15.152:0/3666839031 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90781+0+0 (secure 0 0 0) 0x7f1a3401d420 con 0x7f1a400f7990 2024-04-06T12:26:17.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.908+0000 7f1a3d7fa700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1a2806c7c0 0x7f1a2806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:17.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.908+0000 7f1a3d7fa700 1 -- 172.21.15.152:0/3666839031 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f1a3408c770 con 0x7f1a400f7990 2024-04-06T12:26:17.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.908+0000 7f1a3ffff700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1a2806c7c0 0x7f1a2806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:26:17.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.909+0000 7f1a3ffff700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1a2806c7c0 0x7f1a2806ec80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1a400f77f0 tx=0x7f1a3000b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:17.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:17.914+0000 7f1a3d7fa700 1 -- 172.21.15.152:0/3666839031 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f1a3405a650 con 0x7f1a400f7990 2024-04-06T12:26:18.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:17 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:16.721515+0000 mgr.smithi152.lynahm (mgr.24477) 85 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:18.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:17 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:16.721515+0000 mgr.smithi152.lynahm (mgr.24477) 85 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:18.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.144+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a400ff090 con 0x7f1a2806c7c0 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.145+0000 7f1a3d7fa700 1 -- 172.21.15.152:0/3666839031 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1a400ff090 con 0x7f1a2806c7c0 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "2/2 daemons upgraded", 2024-04-06T12:26:18.143 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading alertmanager daemons", 2024-04-06T12:26:18.144 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:26:18.144 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:26:18.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.147+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1a2806c7c0 msgr2=0x7f1a2806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:18.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.147+0000 7f1a46979700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1a2806c7c0 0x7f1a2806ec80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1a400f77f0 tx=0x7f1a3000b040).stop 2024-04-06T12:26:18.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.147+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 msgr2=0x7f1a40108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:18.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.147+0000 7f1a46979700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 0x7f1a40108480 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f1a34013620 tx=0x7f1a34009cb0).stop 2024-04-06T12:26:18.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.147+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 shutdown_connections 2024-04-06T12:26:18.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.147+0000 7f1a46979700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a400f66f0 0x7f1a40107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:18.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.147+0000 7f1a46979700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1a2806c7c0 0x7f1a2806ec80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:18.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.147+0000 7f1a46979700 1 --2- 172.21.15.152:0/3666839031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400f7990 0x7f1a40108480 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:18.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.147+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 >> 172.21.15.152:0/3666839031 conn(0x7f1a400f1e50 msgr2=0x7f1a40060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:18.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.148+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 shutdown_connections 2024-04-06T12:26:18.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:18.148+0000 7f1a46979700 1 -- 172.21.15.152:0/3666839031 wait complete. 2024-04-06T12:26:19.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:17.066259+0000 mgr.smithi152.lynahm (mgr.24477) 86 : audit [DBG] from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:17.129803+0000 mgr.smithi152.lynahm (mgr.24477) 87 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:17.387159+0000 mgr.smithi152.lynahm (mgr.24477) 88 : audit [DBG] from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:17.796845+0000 mon.smithi152 (mon.0) 877 : audit [DBG] from='client.? 172.21.15.152:0/802244202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:17.817924+0000 mon.smithi152 (mon.0) 878 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:17.824213+0000 mon.smithi152 (mon.0) 879 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:19.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:17.867275+0000 mon.smithi152 (mon.0) 880 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:17.066259+0000 mgr.smithi152.lynahm (mgr.24477) 86 : audit [DBG] from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:17.129803+0000 mgr.smithi152.lynahm (mgr.24477) 87 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:17.387159+0000 mgr.smithi152.lynahm (mgr.24477) 88 : audit [DBG] from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:17.796845+0000 mon.smithi152 (mon.0) 877 : audit [DBG] from='client.? 172.21.15.152:0/802244202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:17.817924+0000 mon.smithi152 (mon.0) 878 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:17.824213+0000 mon.smithi152 (mon.0) 879 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:19.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:17.867275+0000 mon.smithi152 (mon.0) 880 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:20.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:18.145951+0000 mgr.smithi152.lynahm (mgr.24477) 89 : audit [DBG] from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:20.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:19 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:18.145951+0000 mgr.smithi152.lynahm (mgr.24477) 89 : audit [DBG] from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:21.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:19.130256+0000 mgr.smithi152.lynahm (mgr.24477) 90 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:21.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:19.130256+0000 mgr.smithi152.lynahm (mgr.24477) 90 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:23.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:21.130688+0000 mgr.smithi152.lynahm (mgr.24477) 91 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:21.745792+0000 mon.smithi152 (mon.0) 881 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:21.751824+0000 mon.smithi152 (mon.0) 882 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:22.446845+0000 mon.smithi152 (mon.0) 883 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:23.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:22.450927+0000 mon.smithi152 (mon.0) 884 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:21.130688+0000 mgr.smithi152.lynahm (mgr.24477) 91 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:21.745792+0000 mon.smithi152 (mon.0) 881 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:21.751824+0000 mon.smithi152 (mon.0) 882 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:22.446845+0000 mon.smithi152 (mon.0) 883 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:23.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:22.450927+0000 mon.smithi152 (mon.0) 884 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:23.084181+0000 mon.smithi152 (mon.0) 885 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:23.088133+0000 mon.smithi152 (mon.0) 886 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:23.131058+0000 mgr.smithi152.lynahm (mgr.24477) 92 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:23.213966+0000 mon.smithi152 (mon.0) 887 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:26:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:23.084181+0000 mon.smithi152 (mon.0) 885 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:23.088133+0000 mon.smithi152 (mon.0) 886 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:23.131058+0000 mgr.smithi152.lynahm (mgr.24477) 92 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:23.213966+0000 mon.smithi152 (mon.0) 887 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:26:25.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:24.096875+0000 mon.smithi152 (mon.0) 888 : cluster [DBG] mgrmap e32: smithi152.lynahm(active, since 90s), standbys: smithi195.ausetj 2024-04-06T12:26:25.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:24.096875+0000 mon.smithi152 (mon.0) 888 : cluster [DBG] mgrmap e32: smithi152.lynahm(active, since 90s), standbys: smithi195.ausetj 2024-04-06T12:26:26.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:25.131473+0000 mgr.smithi152.lynahm (mgr.24477) 93 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T12:26:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:25.131473+0000 mgr.smithi152.lynahm (mgr.24477) 93 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T12:26:27.920 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.563659+0000 mon.smithi152 (mon.0) 889 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.568157+0000 mon.smithi152 (mon.0) 890 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.568907+0000 mon.smithi152 (mon.0) 891 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.569561+0000 mon.smithi152 (mon.0) 892 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.573779+0000 mon.smithi152 (mon.0) 893 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.709596+0000 mon.smithi152 (mon.0) 894 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.709956+0000 mgr.smithi152.lynahm (mgr.24477) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.715377+0000 mon.smithi152 (mon.0) 895 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.717606+0000 mon.smithi152 (mon.0) 896 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.719709+0000 mon.smithi152 (mon.0) 897 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.720530+0000 mon.smithi152 (mon.0) 898 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.721351+0000 mon.smithi152 (mon.0) 899 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.722159+0000 mon.smithi152 (mon.0) 900 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.922 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.722957+0000 mon.smithi152 (mon.0) 901 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.922 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.723763+0000 mon.smithi152 (mon.0) 902 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.922 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.724658+0000 mon.smithi152 (mon.0) 903 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.922 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.725769+0000 mon.smithi152 (mon.0) 904 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.922 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.726746+0000 mon.smithi152 (mon.0) 905 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:27.922 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:26.727711+0000 mon.smithi152 (mon.0) 906 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.563659+0000 mon.smithi152 (mon.0) 889 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:28.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.568157+0000 mon.smithi152 (mon.0) 890 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:28.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.568907+0000 mon.smithi152 (mon.0) 891 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:28.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.569561+0000 mon.smithi152 (mon.0) 892 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:28.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.573779+0000 mon.smithi152 (mon.0) 893 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:28.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.709596+0000 mon.smithi152 (mon.0) 894 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:26:28.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.709956+0000 mgr.smithi152.lynahm (mgr.24477) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-06T12:26:28.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.715377+0000 mon.smithi152 (mon.0) 895 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.717606+0000 mon.smithi152 (mon.0) 896 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.719709+0000 mon.smithi152 (mon.0) 897 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.720530+0000 mon.smithi152 (mon.0) 898 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.721351+0000 mon.smithi152 (mon.0) 899 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.722159+0000 mon.smithi152 (mon.0) 900 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.722957+0000 mon.smithi152 (mon.0) 901 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.723763+0000 mon.smithi152 (mon.0) 902 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.724658+0000 mon.smithi152 (mon.0) 903 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.725769+0000 mon.smithi152 (mon.0) 904 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.726746+0000 mon.smithi152 (mon.0) 905 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:27 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:26.727711+0000 mon.smithi152 (mon.0) 906 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:28.940 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:28 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:27.131787+0000 mgr.smithi152.lynahm (mgr.24477) 95 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-06T12:26:29.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:28 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:27.131787+0000 mgr.smithi152.lynahm (mgr.24477) 95 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-06T12:26:29.670 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:26:28.245254+0000 mgr.smithi152.lynahm (mgr.24477) 96 : cephadm [INF] Upgrade: Updating grafana.smithi152 2024-04-06T12:26:29.670 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:29 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:26:28.257703+0000 mgr.smithi152.lynahm (mgr.24477) 97 : cephadm [INF] Deploying daemon grafana.smithi152 on smithi152 2024-04-06T12:26:30.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:26:28.245254+0000 mgr.smithi152.lynahm (mgr.24477) 96 : cephadm [INF] Upgrade: Updating grafana.smithi152 2024-04-06T12:26:30.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:29 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:26:28.257703+0000 mgr.smithi152.lynahm (mgr.24477) 97 : cephadm [INF] Deploying daemon grafana.smithi152 on smithi152 2024-04-06T12:26:30.893 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:30 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:29.132425+0000 mgr.smithi152.lynahm (mgr.24477) 98 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T12:26:31.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:29.132425+0000 mgr.smithi152.lynahm (mgr.24477) 98 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T12:26:33.006 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:31.132758+0000 mgr.smithi152.lynahm (mgr.24477) 99 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-06T12:26:33.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:32 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:31.132758+0000 mgr.smithi152.lynahm (mgr.24477) 99 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-06T12:26:34.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:33.074533+0000 mon.smithi152 (mon.0) 907 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:34.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:33.078541+0000 mon.smithi152 (mon.0) 908 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:34.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:33.081569+0000 mon.smithi152 (mon.0) 909 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:34.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:34 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:33.133091+0000 mgr.smithi152.lynahm (mgr.24477) 100 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-06T12:26:34.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:33.074533+0000 mon.smithi152 (mon.0) 907 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:34.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:33.078541+0000 mon.smithi152 (mon.0) 908 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:34.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:33.081569+0000 mon.smithi152 (mon.0) 909 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:34.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:34 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:33.133091+0000 mgr.smithi152.lynahm (mgr.24477) 100 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-06T12:26:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:36 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:35.133515+0000 mgr.smithi152.lynahm (mgr.24477) 101 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T12:26:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:36 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:35.133515+0000 mgr.smithi152.lynahm (mgr.24477) 101 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-06T12:26:38.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:37.134019+0000 mgr.smithi152.lynahm (mgr.24477) 102 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:38.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:37.511415+0000 mon.smithi152 (mon.0) 910 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:38.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:37.517821+0000 mon.smithi152 (mon.0) 911 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:38.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:38.151438+0000 mon.smithi152 (mon.0) 912 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:38.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:38.155555+0000 mon.smithi152 (mon.0) 913 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:38.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:38.214190+0000 mon.smithi152 (mon.0) 914 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:26:38.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:37.134019+0000 mgr.smithi152.lynahm (mgr.24477) 102 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:38.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:37.511415+0000 mon.smithi152 (mon.0) 910 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:38.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:37.517821+0000 mon.smithi152 (mon.0) 911 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:38.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:38.151438+0000 mon.smithi152 (mon.0) 912 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:38.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:38.155555+0000 mon.smithi152 (mon.0) 913 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:38.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:38.214190+0000 mon.smithi152 (mon.0) 914 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:26:40.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:40 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:39.134479+0000 mgr.smithi152.lynahm (mgr.24477) 103 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:40.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:39.134479+0000 mgr.smithi152.lynahm (mgr.24477) 103 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:41.134791+0000 mgr.smithi152.lynahm (mgr.24477) 104 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.232448+0000 mon.smithi152 (mon.0) 915 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.236503+0000 mon.smithi152 (mon.0) 916 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.237217+0000 mon.smithi152 (mon.0) 917 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.237835+0000 mon.smithi152 (mon.0) 918 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.241774+0000 mon.smithi152 (mon.0) 919 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.377701+0000 mon.smithi152 (mon.0) 920 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.378086+0000 mgr.smithi152.lynahm (mgr.24477) 105 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.383819+0000 mon.smithi152 (mon.0) 921 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.385955+0000 mon.smithi152 (mon.0) 922 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.388071+0000 mon.smithi152 (mon.0) 923 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.388909+0000 mon.smithi152 (mon.0) 924 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.389728+0000 mon.smithi152 (mon.0) 925 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.390505+0000 mon.smithi152 (mon.0) 926 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.391271+0000 mon.smithi152 (mon.0) 927 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.392042+0000 mon.smithi152 (mon.0) 928 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.392865+0000 mon.smithi152 (mon.0) 929 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.393924+0000 mon.smithi152 (mon.0) 930 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.394897+0000 mon.smithi152 (mon.0) 931 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.395833+0000 mon.smithi152 (mon.0) 932 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.396792+0000 mon.smithi152 (mon.0) 933 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.397673+0000 mon.smithi152 (mon.0) 934 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.398530+0000 mon.smithi152 (mon.0) 935 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:26:41.399032+0000 mgr.smithi152.lynahm (mgr.24477) 106 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.403283+0000 mon.smithi152 (mon.0) 936 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.404579+0000 mon.smithi152 (mon.0) 937 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-06T12:26:42.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.408701+0000 mon.smithi152 (mon.0) 938 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.409284+0000 mon.smithi152 (mon.0) 939 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.412631+0000 mon.smithi152 (mon.0) 940 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.413210+0000 mon.smithi152 (mon.0) 941 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.413656+0000 mon.smithi152 (mon.0) 942 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.414088+0000 mon.smithi152 (mon.0) 943 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.414514+0000 mon.smithi152 (mon.0) 944 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.417780+0000 mon.smithi152 (mon.0) 945 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.418363+0000 mon.smithi152 (mon.0) 946 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.421776+0000 mon.smithi152 (mon.0) 947 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.422350+0000 mon.smithi152 (mon.0) 948 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.422785+0000 mon.smithi152 (mon.0) 949 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.426155+0000 mon.smithi152 (mon.0) 950 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-06T12:26:42.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.426754+0000 mon.smithi152 (mon.0) 951 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.430182+0000 mon.smithi152 (mon.0) 952 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.430757+0000 mon.smithi152 (mon.0) 953 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.434048+0000 mon.smithi152 (mon.0) 954 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.434586+0000 mon.smithi152 (mon.0) 955 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.437866+0000 mon.smithi152 (mon.0) 956 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.438450+0000 mon.smithi152 (mon.0) 957 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.438922+0000 mon.smithi152 (mon.0) 958 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.439411+0000 mon.smithi152 (mon.0) 959 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.439868+0000 mon.smithi152 (mon.0) 960 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.440342+0000 mon.smithi152 (mon.0) 961 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.440774+0000 mon.smithi152 (mon.0) 962 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.441195+0000 mon.smithi152 (mon.0) 963 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.444362+0000 mon.smithi152 (mon.0) 964 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:26:41.445149+0000 mgr.smithi152.lynahm (mgr.24477) 107 : cephadm [INF] Upgrade: Complete! 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.447013+0000 mon.smithi152 (mon.0) 965 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.449857+0000 mon.smithi152 (mon.0) 966 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.450432+0000 mon.smithi152 (mon.0) 967 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.451843+0000 mon.smithi152 (mon.0) 968 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.452439+0000 mon.smithi152 (mon.0) 969 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.463706+0000 mon.smithi152 (mon.0) 970 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.600844+0000 mon.smithi152 (mon.0) 971 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.602215+0000 mon.smithi152 (mon.0) 972 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.602766+0000 mon.smithi152 (mon.0) 973 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:42.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:42 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:41.607196+0000 mon.smithi152 (mon.0) 974 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:41.134791+0000 mgr.smithi152.lynahm (mgr.24477) 104 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.232448+0000 mon.smithi152 (mon.0) 915 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.236503+0000 mon.smithi152 (mon.0) 916 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.237217+0000 mon.smithi152 (mon.0) 917 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.237835+0000 mon.smithi152 (mon.0) 918 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.241774+0000 mon.smithi152 (mon.0) 919 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.377701+0000 mon.smithi152 (mon.0) 920 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.378086+0000 mgr.smithi152.lynahm (mgr.24477) 105 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.383819+0000 mon.smithi152 (mon.0) 921 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.385955+0000 mon.smithi152 (mon.0) 922 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.388071+0000 mon.smithi152 (mon.0) 923 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.388909+0000 mon.smithi152 (mon.0) 924 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.389728+0000 mon.smithi152 (mon.0) 925 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.390505+0000 mon.smithi152 (mon.0) 926 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.391271+0000 mon.smithi152 (mon.0) 927 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.392042+0000 mon.smithi152 (mon.0) 928 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.392865+0000 mon.smithi152 (mon.0) 929 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.393924+0000 mon.smithi152 (mon.0) 930 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.394897+0000 mon.smithi152 (mon.0) 931 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.395833+0000 mon.smithi152 (mon.0) 932 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.396792+0000 mon.smithi152 (mon.0) 933 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.397673+0000 mon.smithi152 (mon.0) 934 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.398530+0000 mon.smithi152 (mon.0) 935 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:26:41.399032+0000 mgr.smithi152.lynahm (mgr.24477) 106 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.403283+0000 mon.smithi152 (mon.0) 936 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.404579+0000 mon.smithi152 (mon.0) 937 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.408701+0000 mon.smithi152 (mon.0) 938 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.409284+0000 mon.smithi152 (mon.0) 939 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.412631+0000 mon.smithi152 (mon.0) 940 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.413210+0000 mon.smithi152 (mon.0) 941 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.413656+0000 mon.smithi152 (mon.0) 942 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.414088+0000 mon.smithi152 (mon.0) 943 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.414514+0000 mon.smithi152 (mon.0) 944 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.417780+0000 mon.smithi152 (mon.0) 945 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-06T12:26:42.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.418363+0000 mon.smithi152 (mon.0) 946 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.421776+0000 mon.smithi152 (mon.0) 947 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.422350+0000 mon.smithi152 (mon.0) 948 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.422785+0000 mon.smithi152 (mon.0) 949 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.426155+0000 mon.smithi152 (mon.0) 950 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.426754+0000 mon.smithi152 (mon.0) 951 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.430182+0000 mon.smithi152 (mon.0) 952 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.430757+0000 mon.smithi152 (mon.0) 953 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.434048+0000 mon.smithi152 (mon.0) 954 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.434586+0000 mon.smithi152 (mon.0) 955 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.437866+0000 mon.smithi152 (mon.0) 956 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.438450+0000 mon.smithi152 (mon.0) 957 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.438922+0000 mon.smithi152 (mon.0) 958 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.439411+0000 mon.smithi152 (mon.0) 959 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.439868+0000 mon.smithi152 (mon.0) 960 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.440342+0000 mon.smithi152 (mon.0) 961 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.440774+0000 mon.smithi152 (mon.0) 962 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.441195+0000 mon.smithi152 (mon.0) 963 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.444362+0000 mon.smithi152 (mon.0) 964 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:26:41.445149+0000 mgr.smithi152.lynahm (mgr.24477) 107 : cephadm [INF] Upgrade: Complete! 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.447013+0000 mon.smithi152 (mon.0) 965 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.449857+0000 mon.smithi152 (mon.0) 966 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.450432+0000 mon.smithi152 (mon.0) 967 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.451843+0000 mon.smithi152 (mon.0) 968 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.452439+0000 mon.smithi152 (mon.0) 969 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.463706+0000 mon.smithi152 (mon.0) 970 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.600844+0000 mon.smithi152 (mon.0) 971 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:26:42.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.602215+0000 mon.smithi152 (mon.0) 972 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:26:42.554 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.602766+0000 mon.smithi152 (mon.0) 973 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:26:42.554 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:41.607196+0000 mon.smithi152 (mon.0) 974 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:43.135127+0000 mgr.smithi152.lynahm (mgr.24477) 108 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:44.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:44 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:43.236727+0000 mon.smithi152 (mon.0) 975 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:44.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:43.135127+0000 mgr.smithi152.lynahm (mgr.24477) 108 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:44.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:43.236727+0000 mon.smithi152 (mon.0) 975 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:26:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:46 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:45.135633+0000 mgr.smithi152.lynahm (mgr.24477) 109 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:46.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:45.135633+0000 mgr.smithi152.lynahm (mgr.24477) 109 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:48.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.263+0000 7f201272d700 1 -- 172.21.15.152:0/607945727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0611e0 msgr2=0x7f200c0fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:48.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.263+0000 7f201272d700 1 --2- 172.21.15.152:0/607945727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0611e0 0x7f200c0fa470 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f1ffc0047f0 tx=0x7f1ffc009cb0).stop 2024-04-06T12:26:48.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.263+0000 7f201272d700 1 -- 172.21.15.152:0/607945727 shutdown_connections 2024-04-06T12:26:48.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.263+0000 7f201272d700 1 --2- 172.21.15.152:0/607945727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0fa960 0x7f200c0fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:48.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.263+0000 7f201272d700 1 --2- 172.21.15.152:0/607945727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0611e0 0x7f200c0fa470 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:48.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.263+0000 7f201272d700 1 -- 172.21.15.152:0/607945727 >> 172.21.15.152:0/607945727 conn(0x7f200c0f1e50 msgr2=0x7f200c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:48.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.263+0000 7f201272d700 1 -- 172.21.15.152:0/607945727 shutdown_connections 2024-04-06T12:26:48.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.263+0000 7f201272d700 1 -- 172.21.15.152:0/607945727 wait complete. 2024-04-06T12:26:48.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f201272d700 1 Processor -- start 2024-04-06T12:26:48.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f201272d700 1 -- start start 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f201272d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0611e0 0x7f200c107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f201272d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0fa960 0x7f200c108480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f201272d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c108a30 con 0x7f200c0fa960 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f201272d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c108b70 con 0x7f200c0611e0 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f200b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0fa960 0x7f200c108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f200b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0fa960 0x7f200c108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56536/0 (socket says 172.21.15.152:56536) 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f200b7fe700 1 -- 172.21.15.152:0/3468766276 learned_addr learned my addr 172.21.15.152:0/3468766276 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.264+0000 7f200bfff700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0611e0 0x7f200c107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.265+0000 7f200b7fe700 1 -- 172.21.15.152:0/3468766276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0611e0 msgr2=0x7f200c107f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:48.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.265+0000 7f200b7fe700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0611e0 0x7f200c107f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:48.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.265+0000 7f200b7fe700 1 -- 172.21.15.152:0/3468766276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc005040 con 0x7f200c0fa960 2024-04-06T12:26:48.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.265+0000 7f200b7fe700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0fa960 0x7f200c108480 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f200000c790 tx=0x7f2000007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:48.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.265+0000 7f20097fa700 1 -- 172.21.15.152:0/3468766276 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f200000e680 con 0x7f200c0fa960 2024-04-06T12:26:48.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.265+0000 7f20097fa700 1 -- 172.21.15.152:0/3468766276 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f200000ec90 con 0x7f200c0fa960 2024-04-06T12:26:48.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.265+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c10d610 con 0x7f200c0fa960 2024-04-06T12:26:48.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.265+0000 7f20097fa700 1 -- 172.21.15.152:0/3468766276 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2000012cf0 con 0x7f200c0fa960 2024-04-06T12:26:48.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.265+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c10dbd0 con 0x7f200c0fa960 2024-04-06T12:26:48.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.266+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c100010 con 0x7f200c0fa960 2024-04-06T12:26:48.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.266+0000 7f20097fa700 1 -- 172.21.15.152:0/3468766276 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f2000012500 con 0x7f200c0fa960 2024-04-06T12:26:48.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.267+0000 7f20097fa700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1ff406c6a0 0x7f1ff406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:48.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.267+0000 7f20097fa700 1 -- 172.21.15.152:0/3468766276 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f200008b020 con 0x7f200c0fa960 2024-04-06T12:26:48.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.267+0000 7f200bfff700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1ff406c6a0 0x7f1ff406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:26:48.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.267+0000 7f200bfff700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1ff406c6a0 0x7f1ff406eb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1ffc004f10 tx=0x7f1ffc00b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:48.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.272+0000 7f20097fa700 1 -- 172.21.15.152:0/3468766276 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f2000059120 con 0x7f200c0fa960 2024-04-06T12:26:48.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.480+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f200c059120 con 0x7f1ff406c6a0 2024-04-06T12:26:48.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.481+0000 7f20097fa700 1 -- 172.21.15.152:0/3468766276 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f200c059120 con 0x7f1ff406c6a0 2024-04-06T12:26:48.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1ff406c6a0 msgr2=0x7f1ff406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:48.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1ff406c6a0 0x7f1ff406eb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1ffc004f10 tx=0x7f1ffc00b040).stop 2024-04-06T12:26:48.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0fa960 msgr2=0x7f200c108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:48.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0fa960 0x7f200c108480 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f200000c790 tx=0x7f2000007f50).stop 2024-04-06T12:26:48.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 shutdown_connections 2024-04-06T12:26:48.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0611e0 0x7f200c107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f1ff406c6a0 0x7f1ff406eb60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 --2- 172.21.15.152:0/3468766276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f200c0fa960 0x7f200c108480 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 >> 172.21.15.152:0/3468766276 conn(0x7f200c0f1e50 msgr2=0x7f200c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 shutdown_connections 2024-04-06T12:26:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:48.483+0000 7f201272d700 1 -- 172.21.15.152:0/3468766276 wait complete. 2024-04-06T12:26:48.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:48 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:47.136179+0000 mgr.smithi152.lynahm (mgr.24477) 110 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:48.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:47.136179+0000 mgr.smithi152.lynahm (mgr.24477) 110 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:49.246 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-04-06T12:26:49.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:49 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:48.482200+0000 mgr.smithi152.lynahm (mgr.24477) 111 : audit [DBG] from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:49.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:49 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:48.482200+0000 mgr.smithi152.lynahm (mgr.24477) 111 : audit [DBG] from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:26:50.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:50 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:49.136685+0000 mgr.smithi152.lynahm (mgr.24477) 112 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:49.136685+0000 mgr.smithi152.lynahm (mgr.24477) 112 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:51.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.382+0000 7f21dbe0c700 1 -- 172.21.15.152:0/143024583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 msgr2=0x7f21d40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:51.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.382+0000 7f21dbe0c700 1 --2- 172.21.15.152:0/143024583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 0x7f21d40fcbd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f21d00047f0 tx=0x7f21d0009cb0).stop 2024-04-06T12:26:51.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.383+0000 7f21dbe0c700 1 -- 172.21.15.152:0/143024583 shutdown_connections 2024-04-06T12:26:51.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.383+0000 7f21dbe0c700 1 --2- 172.21.15.152:0/143024583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d40fd150 0x7f21d40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:26:51.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.383+0000 7f21dbe0c700 1 --2- 172.21.15.152:0/143024583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 0x7f21d40fcbd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.383+0000 7f21dbe0c700 1 -- 172.21.15.152:0/143024583 >> 172.21.15.152:0/143024583 conn(0x7f21d4070590 msgr2=0x7f21d40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.383+0000 7f21dbe0c700 1 -- 172.21.15.152:0/143024583 shutdown_connections 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.383+0000 7f21dbe0c700 1 -- 172.21.15.152:0/143024583 wait complete. 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.383+0000 7f21dbe0c700 1 Processor -- start 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.383+0000 7f21dbe0c700 1 -- start start 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21dbe0c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 0x7f21d410cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21dbe0c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d40fd150 0x7f21d410d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21dbe0c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d410daf0 con 0x7f21d40fc7f0 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21dbe0c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4107110 con 0x7f21d40fd150 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21d9ba8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 0x7f21d410cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21d9ba8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 0x7f21d410cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56546/0 (socket says 172.21.15.152:56546) 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21d9ba8700 1 -- 172.21.15.152:0/2928995795 learned_addr learned my addr 172.21.15.152:0/2928995795 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21d93a7700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d40fd150 0x7f21d410d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:51.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21d9ba8700 1 -- 172.21.15.152:0/2928995795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d40fd150 msgr2=0x7f21d410d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21d9ba8700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d40fd150 0x7f21d410d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21d9ba8700 1 -- 172.21.15.152:0/2928995795 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0005040 con 0x7f21d40fc7f0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21d93a7700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d40fd150 0x7f21d410d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21d9ba8700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 0x7f21d410cf70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f21d000b120 tx=0x7f21d0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21caffd700 1 -- 172.21.15.152:0/2928995795 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d000e030 con 0x7f21d40fc7f0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d4107360 con 0x7f21d40fc7f0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21caffd700 1 -- 172.21.15.152:0/2928995795 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f21d0007e90 con 0x7f21d40fc7f0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21caffd700 1 -- 172.21.15.152:0/2928995795 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d0018070 con 0x7f21d40fc7f0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.384+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d4107840 con 0x7f21d40fc7f0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.385+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d405f590 con 0x7f21d40fc7f0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.386+0000 7f21caffd700 1 -- 172.21.15.152:0/2928995795 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f21d001d420 con 0x7f21d40fc7f0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.386+0000 7f21caffd700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f21c006c6a0 0x7f21c006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.387+0000 7f21d93a7700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f21c006c6a0 0x7f21c006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.387+0000 7f21caffd700 1 -- 172.21.15.152:0/2928995795 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f21d008cc00 con 0x7f21d40fc7f0 2024-04-06T12:26:51.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.387+0000 7f21d93a7700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f21c006c6a0 0x7f21c006eb60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f21d41088b0 tx=0x7f21c4008040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:51.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.391+0000 7f21caffd700 1 -- 172.21.15.152:0/2928995795 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f21d0092020 con 0x7f21d40fc7f0 2024-04-06T12:26:51.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.654+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f21d41085f0 con 0x7f21d40fc7f0 2024-04-06T12:26:51.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.655+0000 7f21caffd700 1 -- 172.21.15.152:0/2928995795 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f21d005ad00 con 0x7f21d40fc7f0 2024-04-06T12:26:51.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.657+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f21c006c6a0 msgr2=0x7f21c006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:51.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.657+0000 7f21dbe0c700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f21c006c6a0 0x7f21c006eb60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f21d41088b0 tx=0x7f21c4008040).stop 2024-04-06T12:26:51.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.657+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 msgr2=0x7f21d410cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:51.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.657+0000 7f21dbe0c700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 0x7f21d410cf70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f21d000b120 tx=0x7f21d0009cb0).stop 2024-04-06T12:26:51.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.657+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 shutdown_connections 2024-04-06T12:26:51.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.657+0000 7f21dbe0c700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f21c006c6a0 0x7f21c006eb60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:51.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.657+0000 7f21dbe0c700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21d40fc7f0 0x7f21d410cf70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:51.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.657+0000 7f21dbe0c700 1 --2- 172.21.15.152:0/2928995795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d40fd150 0x7f21d410d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:51.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.657+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 >> 172.21.15.152:0/2928995795 conn(0x7f21d4070590 msgr2=0x7f21d40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:51.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.658+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 shutdown_connections 2024-04-06T12:26:51.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:51.658+0000 7f21dbe0c700 1 -- 172.21.15.152:0/2928995795 wait complete. 2024-04-06T12:26:51.665 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:26:52.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-04-06T12:26:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:51.137021+0000 mgr.smithi152.lynahm (mgr.24477) 113 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:52 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:51.656256+0000 mon.smithi152 (mon.0) 976 : audit [DBG] from='client.? 172.21.15.152:0/2928995795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:51.137021+0000 mgr.smithi152.lynahm (mgr.24477) 113 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:51.656256+0000 mon.smithi152 (mon.0) 976 : audit [DBG] from='client.? 172.21.15.152:0/2928995795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:53 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:53.214325+0000 mon.smithi152 (mon.0) 977 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:26:53.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:53.214325+0000 mon.smithi152 (mon.0) 977 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:26:54.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.369+0000 7f224e05c700 1 -- 172.21.15.152:0/3540385393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 msgr2=0x7f22480f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:54.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.369+0000 7f224e05c700 1 --2- 172.21.15.152:0/3540385393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 0x7f22480f7a30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f223c0047f0 tx=0x7f223c009cb0).stop 2024-04-06T12:26:54.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 -- 172.21.15.152:0/3540385393 shutdown_connections 2024-04-06T12:26:54.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 --2- 172.21.15.152:0/3540385393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 0x7f22480f7a30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:54.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 --2- 172.21.15.152:0/3540385393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22480fd8f0 0x7f22480fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:26:54.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 -- 172.21.15.152:0/3540385393 >> 172.21.15.152:0/3540385393 conn(0x7f22480f34b0 msgr2=0x7f22480f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 -- 172.21.15.152:0/3540385393 shutdown_connections 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 -- 172.21.15.152:0/3540385393 wait complete. 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 Processor -- start 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 -- start start 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22480fd8f0 0x7f224810e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.370+0000 7f224e05c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 0x7f224810e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f224e05c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224810ebf0 con 0x7f22480fe250 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f224e05c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2248108210 con 0x7f22480fd8f0 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2246ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 0x7f224810e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2246ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 0x7f224810e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40486/0 (socket says 172.21.15.152:40486) 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2246ffd700 1 -- 172.21.15.152:0/559839956 learned_addr learned my addr 172.21.15.152:0/559839956 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f22477fe700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22480fd8f0 0x7f224810e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2246ffd700 1 -- 172.21.15.152:0/559839956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22480fd8f0 msgr2=0x7f224810e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:54.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2246ffd700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22480fd8f0 0x7f224810e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2246ffd700 1 -- 172.21.15.152:0/559839956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c005040 con 0x7f22480fe250 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f22477fe700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22480fd8f0 0x7f224810e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2246ffd700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 0x7f224810e560 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f223c0099f0 tx=0x7f223c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2244ff9700 1 -- 172.21.15.152:0/559839956 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223c00e030 con 0x7f22480fe250 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2244ff9700 1 -- 172.21.15.152:0/559839956 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f223c007e90 con 0x7f22480fe250 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2248108460 con 0x7f22480fe250 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f2244ff9700 1 -- 172.21.15.152:0/559839956 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223c018070 con 0x7f22480fe250 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.371+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2248108940 con 0x7f22480fe250 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.372+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224805fdb0 con 0x7f22480fe250 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.373+0000 7f2244ff9700 1 -- 172.21.15.152:0/559839956 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f223c01d420 con 0x7f22480fe250 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.373+0000 7f2244ff9700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f223006c6a0 0x7f223006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.373+0000 7f2244ff9700 1 -- 172.21.15.152:0/559839956 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f223c08cbf0 con 0x7f22480fe250 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.373+0000 7f22477fe700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f223006c6a0 0x7f223006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:26:54.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.374+0000 7f22477fe700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f223006c6a0 0x7f223006eb60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f223800a900 tx=0x7f2238008040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:54.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.378+0000 7f2244ff9700 1 -- 172.21.15.152:0/559839956 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f223c05acf0 con 0x7f22480fe250 2024-04-06T12:26:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:54 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:53.137449+0000 mgr.smithi152.lynahm (mgr.24477) 114 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:53.137449+0000 mgr.smithi152.lynahm (mgr.24477) 114 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.643+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2248047540 con 0x7f22480fe250 2024-04-06T12:26:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.644+0000 7f2244ff9700 1 -- 172.21.15.152:0/559839956 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f223c05a880 con 0x7f22480fe250 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f223006c6a0 msgr2=0x7f223006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f223006c6a0 0x7f223006eb60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f223800a900 tx=0x7f2238008040).stop 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 msgr2=0x7f224810e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 0x7f224810e560 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f223c0099f0 tx=0x7f223c009cb0).stop 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 shutdown_connections 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22480fd8f0 0x7f224810e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f223006c6a0 0x7f223006eb60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 --2- 172.21.15.152:0/559839956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480fe250 0x7f224810e560 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 >> 172.21.15.152:0/559839956 conn(0x7f22480f34b0 msgr2=0x7f22480fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 shutdown_connections 2024-04-06T12:26:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:54.646+0000 7f224e05c700 1 -- 172.21.15.152:0/559839956 wait complete. 2024-04-06T12:26:54.654 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)" 2024-04-06T12:26:55.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:55 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:54.645032+0000 mon.smithi152 (mon.0) 978 : audit [DBG] from='client.? 172.21.15.152:0/559839956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:55.400 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-04-06T12:26:55.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:55 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:54.645032+0000 mon.smithi152 (mon.0) 978 : audit [DBG] from='client.? 172.21.15.152:0/559839956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:56 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:55.138050+0000 mgr.smithi152.lynahm (mgr.24477) 115 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:55.138050+0000 mgr.smithi152.lynahm (mgr.24477) 115 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:26:57.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.428+0000 7f3426bac700 1 -- 172.21.15.152:0/3389041438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fe250 msgr2=0x7f34200f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:57.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.428+0000 7f3426bac700 1 --2- 172.21.15.152:0/3389041438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fe250 0x7f34200f7a30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f340c0047f0 tx=0x7f340c009cb0).stop 2024-04-06T12:26:57.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.429+0000 7f3426bac700 1 -- 172.21.15.152:0/3389041438 shutdown_connections 2024-04-06T12:26:57.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.429+0000 7f3426bac700 1 --2- 172.21.15.152:0/3389041438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fe250 0x7f34200f7a30 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:57.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.429+0000 7f3426bac700 1 --2- 172.21.15.152:0/3389041438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34200fd8f0 0x7f34200fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:57.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.429+0000 7f3426bac700 1 -- 172.21.15.152:0/3389041438 >> 172.21.15.152:0/3389041438 conn(0x7f34200f34b0 msgr2=0x7f34200f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:57.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.429+0000 7f3426bac700 1 -- 172.21.15.152:0/3389041438 shutdown_connections 2024-04-06T12:26:57.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.429+0000 7f3426bac700 1 -- 172.21.15.152:0/3389041438 wait complete. 2024-04-06T12:26:57.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.429+0000 7f3426bac700 1 Processor -- start 2024-04-06T12:26:57.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.429+0000 7f3426bac700 1 -- start start 2024-04-06T12:26:57.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3426bac700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fd8f0 0x7f342010e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3426bac700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34200fe250 0x7f342010e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3426bac700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342010ec30 con 0x7f34200fd8f0 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3426bac700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342010ed70 con 0x7f34200fe250 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3424948700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fd8f0 0x7f342010e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3424948700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fd8f0 0x7f342010e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40494/0 (socket says 172.21.15.152:40494) 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3424948700 1 -- 172.21.15.152:0/2722056700 learned_addr learned my addr 172.21.15.152:0/2722056700 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3424948700 1 -- 172.21.15.152:0/2722056700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34200fe250 msgr2=0x7f342010e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3424948700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34200fe250 0x7f342010e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3424948700 1 -- 172.21.15.152:0/2722056700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c005040 con 0x7f34200fd8f0 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3424948700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fd8f0 0x7f342010e140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f341400e910 tx=0x7f341400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f341dffb700 1 -- 172.21.15.152:0/2722056700 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f341400eeb0 con 0x7f34200fd8f0 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f341dffb700 1 -- 172.21.15.152:0/2722056700 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f341400f040 con 0x7f34200fd8f0 2024-04-06T12:26:57.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.430+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34201083a0 con 0x7f34200fd8f0 2024-04-06T12:26:57.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.431+0000 7f341dffb700 1 -- 172.21.15.152:0/2722056700 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f341400c8a0 con 0x7f34200fd8f0 2024-04-06T12:26:57.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.431+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3420108960 con 0x7f34200fd8f0 2024-04-06T12:26:57.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.432+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342005f590 con 0x7f34200fd8f0 2024-04-06T12:26:57.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.432+0000 7f341dffb700 1 -- 172.21.15.152:0/2722056700 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f34140090d0 con 0x7f34200fd8f0 2024-04-06T12:26:57.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.432+0000 7f341dffb700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f341006c6a0 0x7f341006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:26:57.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.432+0000 7f341dffb700 1 -- 172.21.15.152:0/2722056700 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f341408b220 con 0x7f34200fd8f0 2024-04-06T12:26:57.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.432+0000 7f341ffff700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f341006c6a0 0x7f341006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:26:57.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.433+0000 7f341ffff700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f341006c6a0 0x7f341006eb60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f340c004e60 tx=0x7f340c009cb0).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:26:57.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.437+0000 7f341dffb700 1 -- 172.21.15.152:0/2722056700 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f3414059320 con 0x7f34200fd8f0 2024-04-06T12:26:57.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.704+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f34200ffc40 con 0x7f34200fd8f0 2024-04-06T12:26:57.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.705+0000 7f341dffb700 1 -- 172.21.15.152:0/2722056700 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f3414058eb0 con 0x7f34200fd8f0 2024-04-06T12:26:57.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f341006c6a0 msgr2=0x7f341006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:57.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f341006c6a0 0x7f341006eb60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f340c004e60 tx=0x7f340c009cb0).stop 2024-04-06T12:26:57.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fd8f0 msgr2=0x7f342010e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:26:57.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fd8f0 0x7f342010e140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f341400e910 tx=0x7f341400b040).stop 2024-04-06T12:26:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 shutdown_connections 2024-04-06T12:26:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f341006c6a0 0x7f341006eb60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34200fd8f0 0x7f342010e140 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:26:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 --2- 172.21.15.152:0/2722056700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34200fe250 0x7f342010e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:26:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 >> 172.21.15.152:0/2722056700 conn(0x7f34200f34b0 msgr2=0x7f34200fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:26:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 shutdown_connections 2024-04-06T12:26:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:26:57.707+0000 7f3426bac700 1 -- 172.21.15.152:0/2722056700 wait complete. 2024-04-06T12:26:57.715 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:26:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:57.138364+0000 mgr.smithi152.lynahm (mgr.24477) 116 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:26:58 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:26:57.705967+0000 mon.smithi152 (mon.0) 979 : audit [DBG] from='client.? 172.21.15.152:0/2722056700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:26:58.398 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-04-06T12:26:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:57.138364+0000 mgr.smithi152.lynahm (mgr.24477) 116 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:26:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:26:58 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:26:57.705967+0000 mon.smithi152 (mon.0) 979 : audit [DBG] from='client.? 172.21.15.152:0/2722056700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:00.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.332+0000 7fd288c57700 1 -- 172.21.15.152:0/130627067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fc7f0 msgr2=0x7fd2840fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:00.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.332+0000 7fd288c57700 1 --2- 172.21.15.152:0/130627067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fc7f0 0x7fd2840fcbd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fd2740047f0 tx=0x7fd274009cb0).stop 2024-04-06T12:27:00.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.332+0000 7fd288c57700 1 -- 172.21.15.152:0/130627067 shutdown_connections 2024-04-06T12:27:00.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.332+0000 7fd288c57700 1 --2- 172.21.15.152:0/130627067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2840fd150 0x7fd2840f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.332+0000 7fd288c57700 1 --2- 172.21.15.152:0/130627067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fc7f0 0x7fd2840fcbd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.332+0000 7fd288c57700 1 -- 172.21.15.152:0/130627067 >> 172.21.15.152:0/130627067 conn(0x7fd284070590 msgr2=0x7fd2840f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.332+0000 7fd288c57700 1 -- 172.21.15.152:0/130627067 shutdown_connections 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.332+0000 7fd288c57700 1 -- 172.21.15.152:0/130627067 wait complete. 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.333+0000 7fd288c57700 1 Processor -- start 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.333+0000 7fd288c57700 1 -- start start 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.333+0000 7fd288c57700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2840fc7f0 0x7fd2841090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.333+0000 7fd288c57700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fd150 0x7fd2841095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.333+0000 7fd288c57700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd284109ad0 con 0x7fd2840fd150 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.333+0000 7fd288c57700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd284109c10 con 0x7fd2840fc7f0 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.333+0000 7fd281d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fd150 0x7fd2841095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd281d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fd150 0x7fd2841095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40520/0 (socket says 172.21.15.152:40520) 2024-04-06T12:27:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd281d9b700 1 -- 172.21.15.152:0/1104440669 learned_addr learned my addr 172.21.15.152:0/1104440669 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd28259c700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2840fc7f0 0x7fd2841090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd281d9b700 1 -- 172.21.15.152:0/1104440669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2840fc7f0 msgr2=0x7fd2841090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd281d9b700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2840fc7f0 0x7fd2841090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd281d9b700 1 -- 172.21.15.152:0/1104440669 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274005040 con 0x7fd2840fd150 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd281d9b700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fd150 0x7fd2841095e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fd26c00c710 tx=0x7fd26c007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd27b7fe700 1 -- 172.21.15.152:0/1104440669 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd26c00e680 con 0x7fd2840fd150 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd284109ec0 con 0x7fd2840fd150 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd27b7fe700 1 -- 172.21.15.152:0/1104440669 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd26c00ec90 con 0x7fd2840fd150 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd27b7fe700 1 -- 172.21.15.152:0/1104440669 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd26c013d40 con 0x7fd2840fd150 2024-04-06T12:27:00.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.334+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2841124b0 con 0x7fd2840fd150 2024-04-06T12:27:00.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.335+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28405f590 con 0x7fd2840fd150 2024-04-06T12:27:00.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.336+0000 7fd27b7fe700 1 -- 172.21.15.152:0/1104440669 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7fd26c00e7e0 con 0x7fd2840fd150 2024-04-06T12:27:00.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.336+0000 7fd27b7fe700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fd27006c6a0 0x7fd27006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:00.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.336+0000 7fd27b7fe700 1 -- 172.21.15.152:0/1104440669 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fd26c08b520 con 0x7fd2840fd150 2024-04-06T12:27:00.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.336+0000 7fd28259c700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fd27006c6a0 0x7fd27006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:00.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.337+0000 7fd28259c700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fd27006c6a0 0x7fd27006eb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd274007cf0 tx=0x7fd27400b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:00.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.341+0000 7fd27b7fe700 1 -- 172.21.15.152:0/1104440669 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fd26c055b90 con 0x7fd2840fd150 2024-04-06T12:27:00.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:26:59.138816+0000 mgr.smithi152.lynahm (mgr.24477) 117 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:00.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:00.546+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46", "target": ["mon-mgr", ""]}) v1 -- 0x7fd284059120 con 0x7fd27006c6a0 2024-04-06T12:27:00.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:00 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:26:59.138816+0000 mgr.smithi152.lynahm (mgr.24477) 117 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:01.375 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:00.547882+0000 mgr.smithi152.lynahm (mgr.24477) 118 : audit [DBG] from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:01.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:01 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:00.547882+0000 mgr.smithi152.lynahm (mgr.24477) 118 : audit [DBG] from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:02.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.065+0000 7fd27b7fe700 1 -- 172.21.15.152:0/1104440669 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5081 (secure 0 0 0) 0x7fd284059120 con 0x7fd27006c6a0 2024-04-06T12:27:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fd27006c6a0 msgr2=0x7fd27006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fd27006c6a0 0x7fd27006eb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd274007cf0 tx=0x7fd27400b040).stop 2024-04-06T12:27:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fd150 msgr2=0x7fd2841095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fd150 0x7fd2841095e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fd26c00c710 tx=0x7fd26c007ec0).stop 2024-04-06T12:27:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 shutdown_connections 2024-04-06T12:27:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2840fc7f0 0x7fd2841090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fd27006c6a0 0x7fd27006eb60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 --2- 172.21.15.152:0/1104440669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2840fd150 0x7fd2841095e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 >> 172.21.15.152:0/1104440669 conn(0x7fd284070590 msgr2=0x7fd2840fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 shutdown_connections 2024-04-06T12:27:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:02.067+0000 7fd288c57700 1 -- 172.21.15.152:0/1104440669 wait complete. 2024-04-06T12:27:02.076 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:27:02.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:02 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:01.139157+0000 mgr.smithi152.lynahm (mgr.24477) 119 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:02.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:02 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:01.139157+0000 mgr.smithi152.lynahm (mgr.24477) 119 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:02.736 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph orch ps' 2024-04-06T12:27:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:04 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:03.139450+0000 mgr.smithi152.lynahm (mgr.24477) 120 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:04.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:04 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:03.139450+0000 mgr.smithi152.lynahm (mgr.24477) 120 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:04.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.823+0000 7fc83ff8a700 1 -- 172.21.15.152:0/4234638608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fc7f0 msgr2=0x7fc8380fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:04.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.823+0000 7fc83ff8a700 1 --2- 172.21.15.152:0/4234638608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fc7f0 0x7fc8380fcbd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fc82c0047f0 tx=0x7fc82c009cb0).stop 2024-04-06T12:27:04.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.823+0000 7fc83ff8a700 1 -- 172.21.15.152:0/4234638608 shutdown_connections 2024-04-06T12:27:04.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.823+0000 7fc83ff8a700 1 --2- 172.21.15.152:0/4234638608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8380fd150 0x7fc8380f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.823+0000 7fc83ff8a700 1 --2- 172.21.15.152:0/4234638608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fc7f0 0x7fc8380fcbd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.823+0000 7fc83ff8a700 1 -- 172.21.15.152:0/4234638608 >> 172.21.15.152:0/4234638608 conn(0x7fc838070590 msgr2=0x7fc8380f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.823+0000 7fc83ff8a700 1 -- 172.21.15.152:0/4234638608 shutdown_connections 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.823+0000 7fc83ff8a700 1 -- 172.21.15.152:0/4234638608 wait complete. 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83ff8a700 1 Processor -- start 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83ff8a700 1 -- start start 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83ff8a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8380fc7f0 0x7fc83810e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83ff8a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fd150 0x7fc83810e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83ff8a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83810eb30 con 0x7fc8380fd150 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83ff8a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83810ec70 con 0x7fc8380fc7f0 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83d525700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fd150 0x7fc83810e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:04.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83d525700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fd150 0x7fc83810e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53618/0 (socket says 172.21.15.152:53618) 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83d525700 1 -- 172.21.15.152:0/3243883670 learned_addr learned my addr 172.21.15.152:0/3243883670 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83dd26700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8380fc7f0 0x7fc83810e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83d525700 1 -- 172.21.15.152:0/3243883670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8380fc7f0 msgr2=0x7fc83810e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83d525700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8380fc7f0 0x7fc83810e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.824+0000 7fc83d525700 1 -- 172.21.15.152:0/3243883670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c005040 con 0x7fc8380fd150 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.825+0000 7fc83d525700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fd150 0x7fc83810e530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fc83400c790 tx=0x7fc834007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.825+0000 7fc82affd700 1 -- 172.21.15.152:0/3243883670 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8340106f0 con 0x7fc8380fd150 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.825+0000 7fc82affd700 1 -- 172.21.15.152:0/3243883670 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc834010d00 con 0x7fc8380fd150 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.825+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc838108300 con 0x7fc8380fd150 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.825+0000 7fc82affd700 1 -- 172.21.15.152:0/3243883670 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc834012d50 con 0x7fc8380fd150 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.825+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8381088c0 con 0x7fc8380fd150 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.826+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83805f590 con 0x7fc8380fd150 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.826+0000 7fc82affd700 1 -- 172.21.15.152:0/3243883670 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7fc834012570 con 0x7fc8380fd150 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.827+0000 7fc82affd700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc82406c6a0 0x7fc82406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:04.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.827+0000 7fc83dd26700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc82406c6a0 0x7fc82406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.827+0000 7fc82affd700 1 -- 172.21.15.152:0/3243883670 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fc83408b090 con 0x7fc8380fd150 2024-04-06T12:27:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.827+0000 7fc83dd26700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc82406c6a0 0x7fc82406eb60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc82c004f10 tx=0x7fc82c00b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:04.832+0000 7fc82affd700 1 -- 172.21.15.152:0/3243883670 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fc834059190 con 0x7fc8380fd150 2024-04-06T12:27:05.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.027+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc838108f60 con 0x7fc82406c6a0 2024-04-06T12:27:05.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.037+0000 7fc82affd700 1 -- 172.21.15.152:0/3243883670 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc838108f60 con 0x7fc82406c6a0 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (48s) 27s ago 12m 16.7M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (12m) 27s ago 12m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (11m) 43s ago 11m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (32s) 27s ago 11m 39.2M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (6m) 27s ago 6m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (7m) 27s ago 7m 162M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (6m) 43s ago 6m 13.8M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (6m) 43s ago 6m 14.6M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (2m) 27s ago 13m 499M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:27:05.035 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (100s) 43s ago 11m 447M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (13m) 27s ago 13m 59.5M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (11m) 43s ago 11m 52.0M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (85s) 27s ago 11m 8808k - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (79s) 43s ago 11m 13.5M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (10m) 27s ago 10m 203M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (10m) 27s ago 10m 217M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (9m) 27s ago 9m 179M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (9m) 43s ago 9m 230M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (9m) 43s ago 9m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (8m) 43s ago 8m 195M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:27:05.036 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (63s) 43s ago 11m 41.9M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:27:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc82406c6a0 msgr2=0x7fc82406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc82406c6a0 0x7fc82406eb60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc82c004f10 tx=0x7fc82c00b040).stop 2024-04-06T12:27:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fd150 msgr2=0x7fc83810e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fd150 0x7fc83810e530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fc83400c790 tx=0x7fc834007f50).stop 2024-04-06T12:27:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 shutdown_connections 2024-04-06T12:27:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8380fc7f0 0x7fc83810e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc82406c6a0 0x7fc82406eb60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 --2- 172.21.15.152:0/3243883670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8380fd150 0x7fc83810e530 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:05.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 >> 172.21.15.152:0/3243883670 conn(0x7fc838070590 msgr2=0x7fc838060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:05.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 shutdown_connections 2024-04-06T12:27:05.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:05.039+0000 7fc83ff8a700 1 -- 172.21.15.152:0/3243883670 wait complete. 2024-04-06T12:27:05.718 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-06T12:27:05.718 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:27:05.719 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-04-06T12:27:06.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:05.028872+0000 mgr.smithi152.lynahm (mgr.24477) 121 : audit [DBG] from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:06.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:05.140169+0000 mgr.smithi152.lynahm (mgr.24477) 122 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:05.028872+0000 mgr.smithi152.lynahm (mgr.24477) 121 : audit [DBG] from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:06 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:05.140169+0000 mgr.smithi152.lynahm (mgr.24477) 122 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:07.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.725+0000 7fb4418ec700 1 -- 172.21.15.152:0/600158825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 msgr2=0x7fb43c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:07.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.725+0000 7fb4418ec700 1 --2- 172.21.15.152:0/600158825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 0x7fb43c0fcbd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fb4300047f0 tx=0x7fb430009cb0).stop 2024-04-06T12:27:07.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.725+0000 7fb4418ec700 1 -- 172.21.15.152:0/600158825 shutdown_connections 2024-04-06T12:27:07.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.725+0000 7fb4418ec700 1 --2- 172.21.15.152:0/600158825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43c0fd150 0x7fb43c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:07.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.725+0000 7fb4418ec700 1 --2- 172.21.15.152:0/600158825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 0x7fb43c0fcbd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:07.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.725+0000 7fb4418ec700 1 -- 172.21.15.152:0/600158825 >> 172.21.15.152:0/600158825 conn(0x7fb43c0f23b0 msgr2=0x7fb43c0f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:07.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.725+0000 7fb4418ec700 1 -- 172.21.15.152:0/600158825 shutdown_connections 2024-04-06T12:27:07.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.725+0000 7fb4418ec700 1 -- 172.21.15.152:0/600158825 wait complete. 2024-04-06T12:27:07.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.725+0000 7fb4418ec700 1 Processor -- start 2024-04-06T12:27:07.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb4418ec700 1 -- start start 2024-04-06T12:27:07.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb4418ec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 0x7fb43c109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:07.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb4418ec700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43c0fd150 0x7fb43c109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:07.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb4418ec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c109af0 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb4418ec700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c109c30 con 0x7fb43c0fd150 2024-04-06T12:27:07.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb43affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 0x7fb43c109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:07.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb43affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 0x7fb43c109110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53640/0 (socket says 172.21.15.152:53640) 2024-04-06T12:27:07.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb43affd700 1 -- 172.21.15.152:0/3814498639 learned_addr learned my addr 172.21.15.152:0/3814498639 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:07.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb43a7fc700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43c0fd150 0x7fb43c109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:07.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb43affd700 1 -- 172.21.15.152:0/3814498639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43c0fd150 msgr2=0x7fb43c109600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:07.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb43affd700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43c0fd150 0x7fb43c109600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:07.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb43affd700 1 -- 172.21.15.152:0/3814498639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430005040 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb43affd700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 0x7fb43c109110 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fb430005010 tx=0x7fb430009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:07.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb423fff700 1 -- 172.21.15.152:0/3814498639 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43000e030 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c109e80 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.726+0000 7fb423fff700 1 -- 172.21.15.152:0/3814498639 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb430007e90 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.727+0000 7fb423fff700 1 -- 172.21.15.152:0/3814498639 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb430018070 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.727+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c112470 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.728+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c060370 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.728+0000 7fb423fff700 1 -- 172.21.15.152:0/3814498639 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7fb43001d670 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.728+0000 7fb423fff700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fb42406c6a0 0x7fb42406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:07.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.728+0000 7fb423fff700 1 -- 172.21.15.152:0/3814498639 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fb43008c9d0 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.729+0000 7fb43a7fc700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fb42406c6a0 0x7fb42406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:07.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.729+0000 7fb43a7fc700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fb42406c6a0 0x7fb42406eb60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb43c061490 tx=0x7fb42c00b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:07.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.733+0000 7fb423fff700 1 -- 172.21.15.152:0/3814498639 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fb430057040 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.922+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fb43c0feb80 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.926+0000 7fb423fff700 1 -- 172.21.15.152:0/3814498639 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v49)=0 v49) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb43005a660 con 0x7fb43c0fc7f0 2024-04-06T12:27:07.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fb42406c6a0 msgr2=0x7fb42406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:07.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fb42406c6a0 0x7fb42406eb60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb43c061490 tx=0x7fb42c00b040).stop 2024-04-06T12:27:07.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 msgr2=0x7fb43c109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:07.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 0x7fb43c109110 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fb430005010 tx=0x7fb430009cb0).stop 2024-04-06T12:27:07.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 shutdown_connections 2024-04-06T12:27:07.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fb42406c6a0 0x7fb42406eb60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:07.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c0fc7f0 0x7fb43c109110 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:07.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 --2- 172.21.15.152:0/3814498639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43c0fd150 0x7fb43c109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:07.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 >> 172.21.15.152:0/3814498639 conn(0x7fb43c0f23b0 msgr2=0x7fb43c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:07.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 shutdown_connections 2024-04-06T12:27:07.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:07.929+0000 7fb4418ec700 1 -- 172.21.15.152:0/3814498639 wait complete. 2024-04-06T12:27:08.657 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-06T12:27:08.658 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:27:08.658 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-06T12:27:09.177 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:07.140491+0000 mgr.smithi152.lynahm (mgr.24477) 123 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:09.177 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:07.927737+0000 mon.smithi152 (mon.0) 980 : audit [INF] from='client.? 172.21.15.152:0/3814498639' entity='client.admin' 2024-04-06T12:27:09.177 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:07.963571+0000 mon.smithi152 (mon.0) 981 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:09.177 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:08.214682+0000 mon.smithi152 (mon.0) 982 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:27:09.177 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:08.380865+0000 mon.smithi152 (mon.0) 983 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:09.177 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:08.381609+0000 mon.smithi152 (mon.0) 984 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:27:09.177 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:08.386128+0000 mon.smithi152 (mon.0) 985 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:09.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:07.140491+0000 mgr.smithi152.lynahm (mgr.24477) 123 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:09.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:07.927737+0000 mon.smithi152 (mon.0) 980 : audit [INF] from='client.? 172.21.15.152:0/3814498639' entity='client.admin' 2024-04-06T12:27:09.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:07.963571+0000 mon.smithi152 (mon.0) 981 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:09.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:08.214682+0000 mon.smithi152 (mon.0) 982 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:27:09.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:08.380865+0000 mon.smithi152 (mon.0) 983 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:09.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:08.381609+0000 mon.smithi152 (mon.0) 984 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:27:09.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:08 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:08.386128+0000 mon.smithi152 (mon.0) 985 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:10.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 -- 172.21.15.152:0/3374768647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fd150 msgr2=0x7f46240f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:10.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 --2- 172.21.15.152:0/3374768647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fd150 0x7f46240f6930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f46140047f0 tx=0x7f4614009cb0).stop 2024-04-06T12:27:10.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 -- 172.21.15.152:0/3374768647 shutdown_connections 2024-04-06T12:27:10.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 --2- 172.21.15.152:0/3374768647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fd150 0x7f46240f6930 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:10.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 --2- 172.21.15.152:0/3374768647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46240fc7f0 0x7f46240fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:27:10.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 -- 172.21.15.152:0/3374768647 >> 172.21.15.152:0/3374768647 conn(0x7f46240f23b0 msgr2=0x7f46240f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:10.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 -- 172.21.15.152:0/3374768647 shutdown_connections 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 -- 172.21.15.152:0/3374768647 wait complete. 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 Processor -- start 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.620+0000 7f462a5b1700 1 -- start start 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f462a5b1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fc7f0 0x7f4624109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f462a5b1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46240fd150 0x7f4624109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f462a5b1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624109bf0 con 0x7f46240fc7f0 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f462a5b1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624109d30 con 0x7f46240fd150 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f4623fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fc7f0 0x7f4624109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f4623fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fc7f0 0x7f4624109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53658/0 (socket says 172.21.15.152:53658) 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f4623fff700 1 -- 172.21.15.152:0/4084212456 learned_addr learned my addr 172.21.15.152:0/4084212456 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:10.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f46237fe700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46240fd150 0x7f4624109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f4623fff700 1 -- 172.21.15.152:0/4084212456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46240fd150 msgr2=0x7f4624109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f4623fff700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46240fd150 0x7f4624109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f4623fff700 1 -- 172.21.15.152:0/4084212456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614005040 con 0x7f46240fc7f0 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.621+0000 7f46237fe700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46240fd150 0x7f4624109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.622+0000 7f4623fff700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fc7f0 0x7f4624109180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f461800b4b0 tx=0x7f46180090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.622+0000 7f46217fa700 1 -- 172.21.15.152:0/4084212456 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4618002500 con 0x7f46240fc7f0 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.622+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4624109fe0 con 0x7f46240fc7f0 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.622+0000 7f46217fa700 1 -- 172.21.15.152:0/4084212456 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4618002b10 con 0x7f46240fc7f0 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.622+0000 7f46217fa700 1 -- 172.21.15.152:0/4084212456 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4618012cf0 con 0x7f46240fc7f0 2024-04-06T12:27:10.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.622+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4624112570 con 0x7f46240fc7f0 2024-04-06T12:27:10.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.623+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4624060370 con 0x7f46240fc7f0 2024-04-06T12:27:10.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.623+0000 7f46217fa700 1 -- 172.21.15.152:0/4084212456 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f4618002660 con 0x7f46240fc7f0 2024-04-06T12:27:10.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.624+0000 7f46217fa700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f460c06c6a0 0x7f460c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:10.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.624+0000 7f46217fa700 1 -- 172.21.15.152:0/4084212456 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f461808b820 con 0x7f46240fc7f0 2024-04-06T12:27:10.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.624+0000 7f46237fe700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f460c06c6a0 0x7f460c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:10.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.624+0000 7f46237fe700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f460c06c6a0 0x7f460c06eb60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4614004f10 tx=0x7f461400b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:10.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.629+0000 7f46217fa700 1 -- 172.21.15.152:0/4084212456 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f4618055e90 con 0x7f46240fc7f0 2024-04-06T12:27:10.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.820+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f4624061270 con 0x7f46240fc7f0 2024-04-06T12:27:10.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.820+0000 7f46217fa700 1 -- 172.21.15.152:0/4084212456 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v49)=0 v49) v1 ==== 155+0+0 (secure 0 0 0) 0x7f46180594b0 con 0x7f46240fc7f0 2024-04-06T12:27:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.822+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f460c06c6a0 msgr2=0x7f460c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.822+0000 7f462a5b1700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f460c06c6a0 0x7f460c06eb60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4614004f10 tx=0x7f461400b040).stop 2024-04-06T12:27:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.822+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fc7f0 msgr2=0x7f4624109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.822+0000 7f462a5b1700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fc7f0 0x7f4624109180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f461800b4b0 tx=0x7f46180090f0).stop 2024-04-06T12:27:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.823+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 shutdown_connections 2024-04-06T12:27:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.823+0000 7f462a5b1700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f460c06c6a0 0x7f460c06eb60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.823+0000 7f462a5b1700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46240fc7f0 0x7f4624109180 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.823+0000 7f462a5b1700 1 --2- 172.21.15.152:0/4084212456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46240fd150 0x7f4624109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.823+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 >> 172.21.15.152:0/4084212456 conn(0x7f46240f23b0 msgr2=0x7f46240fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.823+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 shutdown_connections 2024-04-06T12:27:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:10.823+0000 7f462a5b1700 1 -- 172.21.15.152:0/4084212456 wait complete. 2024-04-06T12:27:11.173 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:10 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:09.140923+0000 mgr.smithi152.lynahm (mgr.24477) 124 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:11.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:10 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:09.140923+0000 mgr.smithi152.lynahm (mgr.24477) 124 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:11.532 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-06T12:27:13.111 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:11.141299+0000 mgr.smithi152.lynahm (mgr.24477) 125 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:13.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:12 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:11.141299+0000 mgr.smithi152.lynahm (mgr.24477) 125 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:13.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.626+0000 7feefbe4c700 1 -- 172.21.15.152:0/505630188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fe250 msgr2=0x7feef40f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:13.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.626+0000 7feefbe4c700 1 --2- 172.21.15.152:0/505630188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fe250 0x7feef40f7a30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7feef00047f0 tx=0x7feef0009cb0).stop 2024-04-06T12:27:13.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.626+0000 7feefbe4c700 1 -- 172.21.15.152:0/505630188 shutdown_connections 2024-04-06T12:27:13.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.626+0000 7feefbe4c700 1 --2- 172.21.15.152:0/505630188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fe250 0x7feef40f7a30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:13.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.626+0000 7feefbe4c700 1 --2- 172.21.15.152:0/505630188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef40fd8f0 0x7feef40fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:27:13.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.626+0000 7feefbe4c700 1 -- 172.21.15.152:0/505630188 >> 172.21.15.152:0/505630188 conn(0x7feef40f34b0 msgr2=0x7feef40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:13.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.626+0000 7feefbe4c700 1 -- 172.21.15.152:0/505630188 shutdown_connections 2024-04-06T12:27:13.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.626+0000 7feefbe4c700 1 -- 172.21.15.152:0/505630188 wait complete. 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feefbe4c700 1 Processor -- start 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feefbe4c700 1 -- start start 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feefbe4c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fd8f0 0x7feef410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feefbe4c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef40fe250 0x7feef410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feefbe4c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef410ebb0 con 0x7feef40fd8f0 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feefbe4c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef41081d0 con 0x7feef40fe250 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feef9be8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fd8f0 0x7feef410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feef9be8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fd8f0 0x7feef410e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53974/0 (socket says 172.21.15.152:53974) 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feef9be8700 1 -- 172.21.15.152:0/2823570184 learned_addr learned my addr 172.21.15.152:0/2823570184 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.627+0000 7feef93e7700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef40fe250 0x7feef410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feef9be8700 1 -- 172.21.15.152:0/2823570184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef40fe250 msgr2=0x7feef410e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feef9be8700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef40fe250 0x7feef410e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:13.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feef9be8700 1 -- 172.21.15.152:0/2823570184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0005040 con 0x7feef40fd8f0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feef93e7700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef40fe250 0x7feef410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feef9be8700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fd8f0 0x7feef410e030 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7feee800b4b0 tx=0x7feee80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feee6ffd700 1 -- 172.21.15.152:0/2823570184 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee8002500 con 0x7feef40fd8f0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef4108480 con 0x7feef40fd8f0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feee6ffd700 1 -- 172.21.15.152:0/2823570184 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feee8002b10 con 0x7feef40fd8f0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feee6ffd700 1 -- 172.21.15.152:0/2823570184 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee8012cf0 con 0x7feef40fd8f0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.628+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef41089c0 con 0x7feef40fd8f0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.629+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef405f590 con 0x7feef40fd8f0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.630+0000 7feee6ffd700 1 -- 172.21.15.152:0/2823570184 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7feee8002660 con 0x7feef40fd8f0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.630+0000 7feee6ffd700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7feee006c6a0 0x7feee006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.630+0000 7feee6ffd700 1 -- 172.21.15.152:0/2823570184 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7feee808b830 con 0x7feef40fd8f0 2024-04-06T12:27:13.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.630+0000 7feef93e7700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7feee006c6a0 0x7feee006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:13.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.630+0000 7feef93e7700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7feee006c6a0 0x7feee006eb60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7feef0004f10 tx=0x7feef000b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:13.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.635+0000 7feee6ffd700 1 -- 172.21.15.152:0/2823570184 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7feee8059930 con 0x7feef40fd8f0 2024-04-06T12:27:13.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.821+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7feef4047540 con 0x7feef40fd8f0 2024-04-06T12:27:13.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.822+0000 7feee6ffd700 1 -- 172.21.15.152:0/2823570184 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v49)=0 v49) v1 ==== 163+0+0 (secure 0 0 0) 0x7feee80594c0 con 0x7feef40fd8f0 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7feee006c6a0 msgr2=0x7feee006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7feee006c6a0 0x7feee006eb60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7feef0004f10 tx=0x7feef000b040).stop 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fd8f0 msgr2=0x7feef410e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fd8f0 0x7feef410e030 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7feee800b4b0 tx=0x7feee80090f0).stop 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 shutdown_connections 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7feee006c6a0 0x7feee006eb60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feef40fd8f0 0x7feef410e030 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 --2- 172.21.15.152:0/2823570184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feef40fe250 0x7feef410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 >> 172.21.15.152:0/2823570184 conn(0x7feef40f34b0 msgr2=0x7feef40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:13.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 shutdown_connections 2024-04-06T12:27:13.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:13.824+0000 7feefbe4c700 1 -- 172.21.15.152:0/2823570184 wait complete. 2024-04-06T12:27:14.538 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-06T12:27:15.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:14 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:13.141629+0000 mgr.smithi152.lynahm (mgr.24477) 126 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:15.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:13.141629+0000 mgr.smithi152.lynahm (mgr.24477) 126 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.575+0000 7fa0af21e700 1 -- 172.21.15.152:0/1676909185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 msgr2=0x7fa0a80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.575+0000 7fa0af21e700 1 --2- 172.21.15.152:0/1676909185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 0x7fa0a80f6930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fa0940047f0 tx=0x7fa094009cb0).stop 2024-04-06T12:27:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.575+0000 7fa0af21e700 1 -- 172.21.15.152:0/1676909185 shutdown_connections 2024-04-06T12:27:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 --2- 172.21.15.152:0/1676909185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 0x7fa0a80f6930 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 --2- 172.21.15.152:0/1676909185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a80fc7f0 0x7fa0a80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 -- 172.21.15.152:0/1676909185 >> 172.21.15.152:0/1676909185 conn(0x7fa0a8070590 msgr2=0x7fa0a80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 -- 172.21.15.152:0/1676909185 shutdown_connections 2024-04-06T12:27:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 -- 172.21.15.152:0/1676909185 wait complete. 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 Processor -- start 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 -- start start 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a80fc7f0 0x7fa0a810ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 0x7fa0a810d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a810d9c0 con 0x7fa0a80fd150 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.576+0000 7fa0af21e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a810db00 con 0x7fa0a80fc7f0 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 0x7fa0a810d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 0x7fa0a810d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53990/0 (socket says 172.21.15.152:53990) 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a7fff700 1 -- 172.21.15.152:0/3151823874 learned_addr learned my addr 172.21.15.152:0/3151823874 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0acfba700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a80fc7f0 0x7fa0a810ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a7fff700 1 -- 172.21.15.152:0/3151823874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a80fc7f0 msgr2=0x7fa0a810ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a7fff700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a80fc7f0 0x7fa0a810ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a7fff700 1 -- 172.21.15.152:0/3151823874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa094005040 con 0x7fa0a80fd150 2024-04-06T12:27:16.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a7fff700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 0x7fa0a810d3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fa0940099f0 tx=0x7fa094009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a5ffb700 1 -- 172.21.15.152:0/3151823874 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa09400e030 con 0x7fa0a80fd150 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a5ffb700 1 -- 172.21.15.152:0/3151823874 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa094007e90 con 0x7fa0a80fd150 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a8107130 con 0x7fa0a80fd150 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0a5ffb700 1 -- 172.21.15.152:0/3151823874 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa094018070 con 0x7fa0a80fd150 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.577+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a8107690 con 0x7fa0a80fd150 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.578+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a805f590 con 0x7fa0a80fd150 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.579+0000 7fa0a5ffb700 1 -- 172.21.15.152:0/3151823874 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7fa0940094c0 con 0x7fa0a80fd150 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.579+0000 7fa0a5ffb700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fa09806c6a0 0x7fa09806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.579+0000 7fa0a5ffb700 1 -- 172.21.15.152:0/3151823874 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fa09408c9c0 con 0x7fa0a80fd150 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.579+0000 7fa0acfba700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fa09806c6a0 0x7fa09806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.580+0000 7fa0acfba700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fa09806c6a0 0x7fa09806eb60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa09c004dc0 tx=0x7fa09c00b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.584+0000 7fa0a5ffb700 1 -- 172.21.15.152:0/3151823874 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fa09405aac0 con 0x7fa0a80fd150 2024-04-06T12:27:16.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.774+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fa0a8047540 con 0x7fa0a80fd150 2024-04-06T12:27:16.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.775+0000 7fa0a5ffb700 1 -- 172.21.15.152:0/3151823874 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v49)=0 v49) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa09405a650 con 0x7fa0a80fd150 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fa09806c6a0 msgr2=0x7fa09806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fa09806c6a0 0x7fa09806eb60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa09c004dc0 tx=0x7fa09c00b040).stop 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 msgr2=0x7fa0a810d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 0x7fa0a810d3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fa0940099f0 tx=0x7fa094009cb0).stop 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 shutdown_connections 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a80fc7f0 0x7fa0a810ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fa09806c6a0 0x7fa09806eb60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 --2- 172.21.15.152:0/3151823874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0a80fd150 0x7fa0a810d3c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 >> 172.21.15.152:0/3151823874 conn(0x7fa0a8070590 msgr2=0x7fa0a80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 shutdown_connections 2024-04-06T12:27:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:16.777+0000 7fa0af21e700 1 -- 172.21.15.152:0/3151823874 wait complete. 2024-04-06T12:27:17.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:16 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:15.142158+0000 mgr.smithi152.lynahm (mgr.24477) 127 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:17.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:16 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:15.142158+0000 mgr.smithi152.lynahm (mgr.24477) 127 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:17.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-06T12:27:19.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:18 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:17.142656+0000 mgr.smithi152.lynahm (mgr.24477) 128 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:19.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:18 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:17.142656+0000 mgr.smithi152.lynahm (mgr.24477) 128 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:19.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 -- 172.21.15.152:0/2763101844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 msgr2=0x7fbd740fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:19.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 --2- 172.21.15.152:0/2763101844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 0x7fbd740fcbd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fbd640047f0 tx=0x7fbd64009cb0).stop 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 -- 172.21.15.152:0/2763101844 shutdown_connections 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 --2- 172.21.15.152:0/2763101844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd740fd150 0x7fbd740f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 --2- 172.21.15.152:0/2763101844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 0x7fbd740fcbd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 -- 172.21.15.152:0/2763101844 >> 172.21.15.152:0/2763101844 conn(0x7fbd74070590 msgr2=0x7fbd740f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 -- 172.21.15.152:0/2763101844 shutdown_connections 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 -- 172.21.15.152:0/2763101844 wait complete. 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 Processor -- start 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.948+0000 7fbd7b728700 1 -- start start 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd7b728700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 0x7fbd7410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd7b728700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd740fd150 0x7fbd7410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd7b728700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7410ec00 con 0x7fbd740fc7f0 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd7b728700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74108220 con 0x7fbd740fd150 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd794c4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 0x7fbd7410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd794c4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 0x7fbd7410e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53998/0 (socket says 172.21.15.152:53998) 2024-04-06T12:27:19.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd794c4700 1 -- 172.21.15.152:0/3349384091 learned_addr learned my addr 172.21.15.152:0/3349384091 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd78cc3700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd740fd150 0x7fbd7410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd794c4700 1 -- 172.21.15.152:0/3349384091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd740fd150 msgr2=0x7fbd7410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd794c4700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd740fd150 0x7fbd7410e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd794c4700 1 -- 172.21.15.152:0/3349384091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd64005040 con 0x7fbd740fc7f0 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd794c4700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 0x7fbd7410e080 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fbd6400b120 tx=0x7fbd64009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd6a7fc700 1 -- 172.21.15.152:0/3349384091 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd6400e030 con 0x7fbd740fc7f0 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd6a7fc700 1 -- 172.21.15.152:0/3349384091 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd64007e90 con 0x7fbd740fc7f0 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd74108470 con 0x7fbd740fc7f0 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd6a7fc700 1 -- 172.21.15.152:0/3349384091 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd64018070 con 0x7fbd740fc7f0 2024-04-06T12:27:19.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.949+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd74108950 con 0x7fbd740fc7f0 2024-04-06T12:27:19.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.950+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7405f590 con 0x7fbd740fc7f0 2024-04-06T12:27:19.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.951+0000 7fbd6a7fc700 1 -- 172.21.15.152:0/3349384091 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7fbd6401d420 con 0x7fbd740fc7f0 2024-04-06T12:27:19.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.951+0000 7fbd6a7fc700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fbd6006c6a0 0x7fbd6006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:19.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.951+0000 7fbd6a7fc700 1 -- 172.21.15.152:0/3349384091 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fbd6408ccc0 con 0x7fbd740fc7f0 2024-04-06T12:27:19.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.951+0000 7fbd78cc3700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fbd6006c6a0 0x7fbd6006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:19.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.952+0000 7fbd78cc3700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fbd6006c6a0 0x7fbd6006eb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fbd741099c0 tx=0x7fbd70008040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:19.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:19.956+0000 7fbd6a7fc700 1 -- 172.21.15.152:0/3349384091 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fbd64092020 con 0x7fbd740fc7f0 2024-04-06T12:27:20.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.162+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd74108f90 con 0x7fbd6006c6a0 2024-04-06T12:27:20.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.167+0000 7fbd6a7fc700 1 -- 172.21.15.152:0/3349384091 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fbd74108f90 con 0x7fbd6006c6a0 2024-04-06T12:27:20.165 INFO:teuthology.orchestra.run.smithi152.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:27:20.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fbd6006c6a0 msgr2=0x7fbd6006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fbd6006c6a0 0x7fbd6006eb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fbd741099c0 tx=0x7fbd70008040).stop 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 msgr2=0x7fbd7410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 0x7fbd7410e080 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fbd6400b120 tx=0x7fbd64009cb0).stop 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 shutdown_connections 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fbd6006c6a0 0x7fbd6006eb60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740fc7f0 0x7fbd7410e080 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 --2- 172.21.15.152:0/3349384091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd740fd150 0x7fbd7410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 >> 172.21.15.152:0/3349384091 conn(0x7fbd74070590 msgr2=0x7fbd74060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 shutdown_connections 2024-04-06T12:27:20.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:20.170+0000 7fbd7b728700 1 -- 172.21.15.152:0/3349384091 wait complete. 2024-04-06T12:27:20.941 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-06T12:27:20.941 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:27:20.941 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-06T12:27:21.187 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:19.143136+0000 mgr.smithi152.lynahm (mgr.24477) 129 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:21.187 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:20.168523+0000 mon.smithi152 (mon.0) 986 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:21.187 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:20.212419+0000 mon.smithi152 (mon.0) 987 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:21.187 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:20.213903+0000 mon.smithi152 (mon.0) 988 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:21.187 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:20.214467+0000 mon.smithi152 (mon.0) 989 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:27:21.187 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:20 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:20.219200+0000 mon.smithi152 (mon.0) 990 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:21.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:19.143136+0000 mgr.smithi152.lynahm (mgr.24477) 129 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:21.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:20.168523+0000 mon.smithi152 (mon.0) 986 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:21.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:20.212419+0000 mon.smithi152 (mon.0) 987 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:21.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:20.213903+0000 mon.smithi152 (mon.0) 988 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:21.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:20.214467+0000 mon.smithi152 (mon.0) 989 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:27:21.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:20 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:20.219200+0000 mon.smithi152 (mon.0) 990 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:22.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:20.164140+0000 mgr.smithi152.lynahm (mgr.24477) 130 : audit [DBG] from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:22.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:27:20.164630+0000 mgr.smithi152.lynahm (mgr.24477) 131 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:27:22.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:21 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:27:20.356860+0000 mgr.smithi152.lynahm (mgr.24477) 132 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:27:22.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:20.164140+0000 mgr.smithi152.lynahm (mgr.24477) 130 : audit [DBG] from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:22.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:20.164630+0000 mgr.smithi152.lynahm (mgr.24477) 131 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:27:22.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:21 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:20.356860+0000 mgr.smithi152.lynahm (mgr.24477) 132 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:27:23.180 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:22 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:21.143439+0000 mgr.smithi152.lynahm (mgr.24477) 133 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:23.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:21.143439+0000 mgr.smithi152.lynahm (mgr.24477) 133 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:23.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.789+0000 7f873609a700 1 -- 172.21.15.152:0/736590941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fc7f0 msgr2=0x7f87300fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:23.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.789+0000 7f873609a700 1 --2- 172.21.15.152:0/736590941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fc7f0 0x7f87300fcbd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f87200047f0 tx=0x7f8720009cb0).stop 2024-04-06T12:27:23.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.789+0000 7f873609a700 1 -- 172.21.15.152:0/736590941 shutdown_connections 2024-04-06T12:27:23.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.789+0000 7f873609a700 1 --2- 172.21.15.152:0/736590941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87300fd150 0x7f87300f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:23.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.789+0000 7f873609a700 1 --2- 172.21.15.152:0/736590941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fc7f0 0x7f87300fcbd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:23.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.789+0000 7f873609a700 1 -- 172.21.15.152:0/736590941 >> 172.21.15.152:0/736590941 conn(0x7f8730070590 msgr2=0x7f87300f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:23.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.789+0000 7f873609a700 1 -- 172.21.15.152:0/736590941 shutdown_connections 2024-04-06T12:27:23.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.789+0000 7f873609a700 1 -- 172.21.15.152:0/736590941 wait complete. 2024-04-06T12:27:23.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.790+0000 7f873609a700 1 Processor -- start 2024-04-06T12:27:23.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.790+0000 7f873609a700 1 -- start start 2024-04-06T12:27:23.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.790+0000 7f873609a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87300fc7f0 0x7f873010cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:23.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.790+0000 7f873609a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fd150 0x7f873010d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:23.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.790+0000 7f873609a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873010da20 con 0x7f87300fd150 2024-04-06T12:27:23.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.790+0000 7f873609a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873010db60 con 0x7f87300fc7f0 2024-04-06T12:27:23.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fd150 0x7f873010d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:23.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fd150 0x7f873010d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40056/0 (socket says 172.21.15.152:40056) 2024-04-06T12:27:23.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872effd700 1 -- 172.21.15.152:0/1694444199 learned_addr learned my addr 172.21.15.152:0/1694444199 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:23.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872f7fe700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87300fc7f0 0x7f873010cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:23.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872effd700 1 -- 172.21.15.152:0/1694444199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87300fc7f0 msgr2=0x7f873010cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:23.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872effd700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87300fc7f0 0x7f873010cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:23.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872effd700 1 -- 172.21.15.152:0/1694444199 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720005040 con 0x7f87300fd150 2024-04-06T12:27:23.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872effd700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fd150 0x7f873010d420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f8718002820 tx=0x7f8718009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:23.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872cff9700 1 -- 172.21.15.152:0/1694444199 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8718007b40 con 0x7f87300fd150 2024-04-06T12:27:23.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872cff9700 1 -- 172.21.15.152:0/1694444199 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f871800f040 con 0x7f87300fd150 2024-04-06T12:27:23.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87301071f0 con 0x7f87300fd150 2024-04-06T12:27:23.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f872cff9700 1 -- 172.21.15.152:0/1694444199 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8718014910 con 0x7f87300fd150 2024-04-06T12:27:23.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.791+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87301077b0 con 0x7f87300fd150 2024-04-06T12:27:23.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.792+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873005f590 con 0x7f87300fd150 2024-04-06T12:27:23.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.793+0000 7f872cff9700 1 -- 172.21.15.152:0/1694444199 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f8718007ca0 con 0x7f87300fd150 2024-04-06T12:27:23.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.793+0000 7f872cff9700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f871c06c6a0 0x7f871c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:23.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.793+0000 7f872cff9700 1 -- 172.21.15.152:0/1694444199 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f871808b100 con 0x7f87300fd150 2024-04-06T12:27:23.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.793+0000 7f872f7fe700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f871c06c6a0 0x7f871c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:23.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.794+0000 7f872f7fe700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f871c06c6a0 0x7f871c06eb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8720004f10 tx=0x7f872000b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:23.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:23.798+0000 7f872cff9700 1 -- 172.21.15.152:0/1694444199 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f8718059200 con 0x7f87300fd150 2024-04-06T12:27:24.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.009+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8730107a30 con 0x7f871c06c6a0 2024-04-06T12:27:24.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.010+0000 7f872cff9700 1 -- 172.21.15.152:0/1694444199 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8730107a30 con 0x7f871c06c6a0 2024-04-06T12:27:24.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.012+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f871c06c6a0 msgr2=0x7f871c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.012+0000 7f873609a700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f871c06c6a0 0x7f871c06eb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8720004f10 tx=0x7f872000b040).stop 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.012+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fd150 msgr2=0x7f873010d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.012+0000 7f873609a700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fd150 0x7f873010d420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f8718002820 tx=0x7f8718009f20).stop 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.013+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 shutdown_connections 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.013+0000 7f873609a700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87300fc7f0 0x7f873010cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.013+0000 7f873609a700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f871c06c6a0 0x7f871c06eb60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.013+0000 7f873609a700 1 --2- 172.21.15.152:0/1694444199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87300fd150 0x7f873010d420 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.013+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 >> 172.21.15.152:0/1694444199 conn(0x7f8730070590 msgr2=0x7f87300fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.013+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 shutdown_connections 2024-04-06T12:27:24.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.013+0000 7f873609a700 1 -- 172.21.15.152:0/1694444199 wait complete. 2024-04-06T12:27:24.021 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:27:24.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.117+0000 7f766ecb8700 1 -- 172.21.15.152:0/500616262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 msgr2=0x7f766806b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.117+0000 7f766ecb8700 1 --2- 172.21.15.152:0/500616262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 0x7f766806b170 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f765c0047f0 tx=0x7f765c009cb0).stop 2024-04-06T12:27:24.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.117+0000 7f766ecb8700 1 -- 172.21.15.152:0/500616262 shutdown_connections 2024-04-06T12:27:24.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.117+0000 7f766ecb8700 1 --2- 172.21.15.152:0/500616262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f766806b660 0x7f766806bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.117+0000 7f766ecb8700 1 --2- 172.21.15.152:0/500616262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 0x7f766806b170 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.117+0000 7f766ecb8700 1 -- 172.21.15.152:0/500616262 >> 172.21.15.152:0/500616262 conn(0x7f76680f34b0 msgr2=0x7f76680f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.120+0000 7f766ecb8700 1 -- 172.21.15.152:0/500616262 shutdown_connections 2024-04-06T12:27:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.120+0000 7f766ecb8700 1 -- 172.21.15.152:0/500616262 wait complete. 2024-04-06T12:27:24.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.120+0000 7f766ecb8700 1 Processor -- start 2024-04-06T12:27:24.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.120+0000 7f766ecb8700 1 -- start start 2024-04-06T12:27:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f766ecb8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f766806b660 0x7f7668114640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f766ecb8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 0x7f7668114b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f766ecb8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7668115130 con 0x7f766806cc20 2024-04-06T12:27:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f766ecb8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7668115270 con 0x7f766806b660 2024-04-06T12:27:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f7667fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 0x7f7668114b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f7667fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 0x7f7668114b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40078/0 (socket says 172.21.15.152:40078) 2024-04-06T12:27:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f7667fff700 1 -- 172.21.15.152:0/3396619783 learned_addr learned my addr 172.21.15.152:0/3396619783 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f766ca54700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f766806b660 0x7f7668114640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f7667fff700 1 -- 172.21.15.152:0/3396619783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f766806b660 msgr2=0x7f7668114640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f7667fff700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f766806b660 0x7f7668114640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f7667fff700 1 -- 172.21.15.152:0/3396619783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c005040 con 0x7f766806cc20 2024-04-06T12:27:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f7667fff700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 0x7f7668114b30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f765400c790 tx=0x7f765400cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.121+0000 7f7665ffb700 1 -- 172.21.15.152:0/3396619783 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76540106f0 con 0x7f766806cc20 2024-04-06T12:27:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.122+0000 7f7665ffb700 1 -- 172.21.15.152:0/3396619783 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7654010d00 con 0x7f766806cc20 2024-04-06T12:27:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.122+0000 7f7665ffb700 1 -- 172.21.15.152:0/3396619783 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7654012e50 con 0x7f766806cc20 2024-04-06T12:27:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.122+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766810e940 con 0x7f766806cc20 2024-04-06T12:27:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.122+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766810ee30 con 0x7f766806cc20 2024-04-06T12:27:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.123+0000 7f7665ffb700 1 -- 172.21.15.152:0/3396619783 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f7654010850 con 0x7f766806cc20 2024-04-06T12:27:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.123+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766805f590 con 0x7f766806cc20 2024-04-06T12:27:24.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.124+0000 7f7665ffb700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f765806c6a0 0x7f765806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:24.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.124+0000 7f7665ffb700 1 -- 172.21.15.152:0/3396619783 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f765408b090 con 0x7f766806cc20 2024-04-06T12:27:24.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.124+0000 7f766ca54700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f765806c6a0 0x7f765806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:24.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.125+0000 7f766ca54700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f765806c6a0 0x7f765806eb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f765c000c00 tx=0x7f765c00b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:24.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.129+0000 7f7665ffb700 1 -- 172.21.15.152:0/3396619783 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f7654059190 con 0x7f766806cc20 2024-04-06T12:27:24.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:23.214983+0000 mon.smithi152 (mon.0) 991 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:27:24.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:23.229540+0000 mon.smithi152 (mon.0) 992 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:24.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:23.230877+0000 mon.smithi152 (mon.0) 993 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:24.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:23.235388+0000 mon.smithi152 (mon.0) 994 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:24.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:23.236790+0000 mon.smithi152 (mon.0) 995 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:24.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:23.240779+0000 mon.smithi152 (mon.0) 996 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:24.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:23 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:23.241782+0000 mon.smithi152 (mon.0) 997 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-06T12:27:24.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:23.214983+0000 mon.smithi152 (mon.0) 991 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:27:24.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:23.229540+0000 mon.smithi152 (mon.0) 992 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:24.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:23.230877+0000 mon.smithi152 (mon.0) 993 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:24.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:23.235388+0000 mon.smithi152 (mon.0) 994 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:24.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:23.236790+0000 mon.smithi152 (mon.0) 995 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:24.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:23.240779+0000 mon.smithi152 (mon.0) 996 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:24.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:23.241782+0000 mon.smithi152 (mon.0) 997 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-06T12:27:24.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.343+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f766810f100 con 0x7f765806c6a0 2024-04-06T12:27:24.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.344+0000 7f7665ffb700 1 -- 172.21.15.152:0/3396619783 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f766810f100 con 0x7f765806c6a0 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f765806c6a0 msgr2=0x7f765806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f765806c6a0 0x7f765806eb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f765c000c00 tx=0x7f765c00b040).stop 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 msgr2=0x7f7668114b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 0x7f7668114b30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f765400c790 tx=0x7f765400cb50).stop 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 shutdown_connections 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f766806b660 0x7f7668114640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f765806c6a0 0x7f765806eb60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 --2- 172.21.15.152:0/3396619783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f766806cc20 0x7f7668114b30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 >> 172.21.15.152:0/3396619783 conn(0x7f76680f34b0 msgr2=0x7f7668106c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 shutdown_connections 2024-04-06T12:27:24.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.347+0000 7f766ecb8700 1 -- 172.21.15.152:0/3396619783 wait complete. 2024-04-06T12:27:24.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 -- 172.21.15.152:0/2754071447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fe210 msgr2=0x7f0e340f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 --2- 172.21.15.152:0/2754071447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fe210 0x7f0e340f5f80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f0e300047f0 tx=0x7f0e30009cb0).stop 2024-04-06T12:27:24.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 -- 172.21.15.152:0/2754071447 shutdown_connections 2024-04-06T12:27:24.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 --2- 172.21.15.152:0/2754071447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fe210 0x7f0e340f5f80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 --2- 172.21.15.152:0/2754071447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e340fd8b0 0x7f0e340fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:27:24.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 -- 172.21.15.152:0/2754071447 >> 172.21.15.152:0/2754071447 conn(0x7f0e3406ce40 msgr2=0x7f0e3406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:24.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 -- 172.21.15.152:0/2754071447 shutdown_connections 2024-04-06T12:27:24.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 -- 172.21.15.152:0/2754071447 wait complete. 2024-04-06T12:27:24.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 Processor -- start 2024-04-06T12:27:24.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.452+0000 7f0e3c071700 1 -- start start 2024-04-06T12:27:24.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e3c071700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fd8b0 0x7f0e3410e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:24.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e3c071700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e340fe210 0x7f0e3410e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:24.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e3c071700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3410ebf0 con 0x7f0e340fd8b0 2024-04-06T12:27:24.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e3c071700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e34108260 con 0x7f0e340fe210 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e39e0d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fd8b0 0x7f0e3410e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e39e0d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fd8b0 0x7f0e3410e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40100/0 (socket says 172.21.15.152:40100) 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e39e0d700 1 -- 172.21.15.152:0/3421984733 learned_addr learned my addr 172.21.15.152:0/3421984733 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e3960c700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e340fe210 0x7f0e3410e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e39e0d700 1 -- 172.21.15.152:0/3421984733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e340fe210 msgr2=0x7f0e3410e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e39e0d700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e340fe210 0x7f0e3410e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e39e0d700 1 -- 172.21.15.152:0/3421984733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e30005040 con 0x7f0e340fd8b0 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e39e0d700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fd8b0 0x7f0e3410e070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f0e2800b4b0 tx=0x7f0e280090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e26ffd700 1 -- 172.21.15.152:0/3421984733 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e28002500 con 0x7f0e340fd8b0 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e26ffd700 1 -- 172.21.15.152:0/3421984733 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e28002b10 con 0x7f0e340fd8b0 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e34108510 con 0x7f0e340fd8b0 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e26ffd700 1 -- 172.21.15.152:0/3421984733 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e28012cf0 con 0x7f0e340fd8b0 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.453+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e34108a50 con 0x7f0e340fd8b0 2024-04-06T12:27:24.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.454+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e34060670 con 0x7f0e340fd8b0 2024-04-06T12:27:24.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.455+0000 7f0e26ffd700 1 -- 172.21.15.152:0/3421984733 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f0e28002660 con 0x7f0e340fd8b0 2024-04-06T12:27:24.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.455+0000 7f0e26ffd700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f0e2006c6a0 0x7f0e2006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:24.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.456+0000 7f0e26ffd700 1 -- 172.21.15.152:0/3421984733 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f0e2808b8f0 con 0x7f0e340fd8b0 2024-04-06T12:27:24.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.456+0000 7f0e3960c700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f0e2006c6a0 0x7f0e2006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:24.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.456+0000 7f0e3960c700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f0e2006c6a0 0x7f0e2006eb60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0e30007cf0 tx=0x7f0e3000b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:24.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.460+0000 7f0e26ffd700 1 -- 172.21.15.152:0/3421984733 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f0e28059930 con 0x7f0e340fd8b0 2024-04-06T12:27:24.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.667+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e34109760 con 0x7f0e2006c6a0 2024-04-06T12:27:24.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.678+0000 7f0e26ffd700 1 -- 172.21.15.152:0/3421984733 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0e34109760 con 0x7f0e2006c6a0 2024-04-06T12:27:24.676 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:27:24.676 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (67s) 47s ago 12m 16.7M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:27:24.676 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (12m) 47s ago 12m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:27:24.676 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (11m) 62s ago 11m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:27:24.676 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (52s) 47s ago 12m 39.2M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (7m) 47s ago 7m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (7m) 47s ago 7m 162M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (7m) 62s ago 7m 13.8M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (7m) 62s ago 7m 14.6M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (2m) 47s ago 13m 499M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (2m) 62s ago 11m 447M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (14m) 47s ago 14m 59.5M 2048M 16.2.15-1-g8963e9de 727f386679cb e3764b960024 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (11m) 62s ago 11m 52.0M 2048M 16.2.15-1-g8963e9de 727f386679cb 2fb68a318ff3 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (105s) 47s ago 12m 8808k - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (99s) 62s ago 11m 13.5M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (11m) 47s ago 11m 203M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (10m) 47s ago 10m 217M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (10m) 47s ago 10m 179M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:27:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (9m) 62s ago 9m 230M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:27:24.678 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (9m) 62s ago 9m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:27:24.678 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (8m) 62s ago 8m 195M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:27:24.678 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (82s) 62s ago 11m 41.9M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:27:24.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.680+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f0e2006c6a0 msgr2=0x7f0e2006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.680+0000 7f0e3c071700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f0e2006c6a0 0x7f0e2006eb60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0e30007cf0 tx=0x7f0e3000b040).stop 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.680+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fd8b0 msgr2=0x7f0e3410e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.680+0000 7f0e3c071700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fd8b0 0x7f0e3410e070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f0e2800b4b0 tx=0x7f0e280090f0).stop 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.681+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 shutdown_connections 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.681+0000 7f0e3c071700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f0e2006c6a0 0x7f0e2006eb60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.681+0000 7f0e3c071700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e340fd8b0 0x7f0e3410e070 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.681+0000 7f0e3c071700 1 --2- 172.21.15.152:0/3421984733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e340fe210 0x7f0e3410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.681+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 >> 172.21.15.152:0/3421984733 conn(0x7f0e3406ce40 msgr2=0x7f0e34100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.681+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 shutdown_connections 2024-04-06T12:27:24.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.681+0000 7f0e3c071700 1 -- 172.21.15.152:0/3421984733 wait complete. 2024-04-06T12:27:24.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 -- 172.21.15.152:0/230842533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fe250 msgr2=0x7f8e6c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 --2- 172.21.15.152:0/230842533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fe250 0x7f8e6c0f7a30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f8e5c0047f0 tx=0x7f8e5c009cb0).stop 2024-04-06T12:27:24.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 -- 172.21.15.152:0/230842533 shutdown_connections 2024-04-06T12:27:24.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 --2- 172.21.15.152:0/230842533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fe250 0x7f8e6c0f7a30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 --2- 172.21.15.152:0/230842533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0fd8f0 0x7f8e6c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 -- 172.21.15.152:0/230842533 >> 172.21.15.152:0/230842533 conn(0x7f8e6c0f34b0 msgr2=0x7f8e6c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 -- 172.21.15.152:0/230842533 shutdown_connections 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 -- 172.21.15.152:0/230842533 wait complete. 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 Processor -- start 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.780+0000 7f8e73b2f700 1 -- start start 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e73b2f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fd8f0 0x7f8e6c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e73b2f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0fe250 0x7f8e6c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e73b2f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c10eae0 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e73b2f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c10ec20 con 0x7f8e6c0fe250 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e718cb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fd8f0 0x7f8e6c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e718cb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fd8f0 0x7f8e6c10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40114/0 (socket says 172.21.15.152:40114) 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e718cb700 1 -- 172.21.15.152:0/4225666642 learned_addr learned my addr 172.21.15.152:0/4225666642 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:24.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e718cb700 1 -- 172.21.15.152:0/4225666642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0fe250 msgr2=0x7f8e6c10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:24.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e718cb700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0fe250 0x7f8e6c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:27:24.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e718cb700 1 -- 172.21.15.152:0/4225666642 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c005040 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e718cb700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fd8f0 0x7f8e6c10dff0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f8e6800c790 tx=0x7f8e6800cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:24.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e62ffd700 1 -- 172.21.15.152:0/4225666642 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e680106f0 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e62ffd700 1 -- 172.21.15.152:0/4225666642 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e68010d00 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c1082b0 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e62ffd700 1 -- 172.21.15.152:0/4225666642 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e68012e50 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.781+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c108870 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.782+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c05f590 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.783+0000 7f8e62ffd700 1 -- 172.21.15.152:0/4225666642 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f8e68010850 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.783+0000 7f8e62ffd700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f8e5806c6a0 0x7f8e5806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:24.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.783+0000 7f8e62ffd700 1 -- 172.21.15.152:0/4225666642 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f8e6808b150 con 0x7f8e6c0fd8f0 2024-04-06T12:27:24.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.783+0000 7f8e710ca700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f8e5806c6a0 0x7f8e5806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:24.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.784+0000 7f8e710ca700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f8e5806c6a0 0x7f8e5806eb60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8e6c109930 tx=0x7f8e5c009cb0).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:24.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:24.788+0000 7f8e62ffd700 1 -- 172.21.15.152:0/4225666642 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f8e68059190 con 0x7f8e6c0fd8f0 2024-04-06T12:27:25.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:23.143840+0000 mgr.smithi152.lynahm (mgr.24477) 134 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:27:23.229863+0000 mgr.smithi152.lynahm (mgr.24477) 135 : cephadm [INF] Upgrade: Target is version 18.2.2-1086-g052adcad (reef) 2024-04-06T12:27:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:27:23.229922+0000 mgr.smithi152.lynahm (mgr.24477) 136 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e'] 2024-04-06T12:27:25.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:24 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:27:23.237341+0000 mgr.smithi152.lynahm (mgr.24477) 137 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-04-06T12:27:25.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.059+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8e6c109770 con 0x7f8e6c0fd8f0 2024-04-06T12:27:25.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.059+0000 7f8e62ffd700 1 -- 172.21.15.152:0/4225666642 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f8e6c109770 con 0x7f8e6c0fd8f0 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:27:25.058 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:27:25.059 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:27:25.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:27:25.059 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:27:25.059 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 12, 2024-04-06T12:27:25.059 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:27:25.059 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:27:25.059 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:27:25.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f8e5806c6a0 msgr2=0x7f8e5806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f8e5806c6a0 0x7f8e5806eb60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8e6c109930 tx=0x7f8e5c009cb0).stop 2024-04-06T12:27:25.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fd8f0 msgr2=0x7f8e6c10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fd8f0 0x7f8e6c10dff0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f8e6800c790 tx=0x7f8e6800cb50).stop 2024-04-06T12:27:25.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 shutdown_connections 2024-04-06T12:27:25.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f8e5806c6a0 0x7f8e5806eb60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e6c0fd8f0 0x7f8e6c10dff0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 --2- 172.21.15.152:0/4225666642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0fe250 0x7f8e6c10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:27:25.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 >> 172.21.15.152:0/4225666642 conn(0x7f8e6c0f34b0 msgr2=0x7f8e6c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:25.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 shutdown_connections 2024-04-06T12:27:25.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.062+0000 7f8e73b2f700 1 -- 172.21.15.152:0/4225666642 wait complete. 2024-04-06T12:27:25.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.163+0000 7f2d4edba700 1 -- 172.21.15.152:0/3030305251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f9200 msgr2=0x7f2d48101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.163+0000 7f2d4edba700 1 --2- 172.21.15.152:0/3030305251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f9200 0x7f2d48101910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f2d340047f0 tx=0x7f2d34009cb0).stop 2024-04-06T12:27:25.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.163+0000 7f2d4edba700 1 -- 172.21.15.152:0/3030305251 shutdown_connections 2024-04-06T12:27:25.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.163+0000 7f2d4edba700 1 --2- 172.21.15.152:0/3030305251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f9200 0x7f2d48101910 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.163+0000 7f2d4edba700 1 --2- 172.21.15.152:0/3030305251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d480f88a0 0x7f2d480f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.163+0000 7f2d4edba700 1 -- 172.21.15.152:0/3030305251 >> 172.21.15.152:0/3030305251 conn(0x7f2d48070590 msgr2=0x7f2d480f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:25.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.163+0000 7f2d4edba700 1 -- 172.21.15.152:0/3030305251 shutdown_connections 2024-04-06T12:27:25.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.163+0000 7f2d4edba700 1 -- 172.21.15.152:0/3030305251 wait complete. 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d4edba700 1 Processor -- start 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d4edba700 1 -- start start 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d4edba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f88a0 0x7f2d480f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d4edba700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d480f9200 0x7f2d480f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d4edba700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480f7230 con 0x7f2d480f88a0 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d4edba700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480f7370 con 0x7f2d480f9200 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d4cb56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f88a0 0x7f2d480f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d4cb56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f88a0 0x7f2d480f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40132/0 (socket says 172.21.15.152:40132) 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d4cb56700 1 -- 172.21.15.152:0/4208619335 learned_addr learned my addr 172.21.15.152:0/4208619335 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:25.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.164+0000 7f2d47fff700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d480f9200 0x7f2d480f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.165+0000 7f2d4cb56700 1 -- 172.21.15.152:0/4208619335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d480f9200 msgr2=0x7f2d480f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.165+0000 7f2d4cb56700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d480f9200 0x7f2d480f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.165+0000 7f2d4cb56700 1 -- 172.21.15.152:0/4208619335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34005040 con 0x7f2d480f88a0 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.165+0000 7f2d4cb56700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f88a0 0x7f2d480f6850 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f2d3c00e910 tx=0x7f2d3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.165+0000 7f2d45ffb700 1 -- 172.21.15.152:0/4208619335 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d3c007b40 con 0x7f2d480f88a0 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.165+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d480f75c0 con 0x7f2d480f88a0 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.165+0000 7f2d45ffb700 1 -- 172.21.15.152:0/4208619335 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d3c00f040 con 0x7f2d480f88a0 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.165+0000 7f2d45ffb700 1 -- 172.21.15.152:0/4208619335 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d3c014920 con 0x7f2d480f88a0 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.165+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d481147d0 con 0x7f2d480f88a0 2024-04-06T12:27:25.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.166+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4805f590 con 0x7f2d480f88a0 2024-04-06T12:27:25.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.166+0000 7f2d45ffb700 1 -- 172.21.15.152:0/4208619335 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7f2d3c007ca0 con 0x7f2d480f88a0 2024-04-06T12:27:25.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.167+0000 7f2d45ffb700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2d3806c6a0 0x7f2d3806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:25.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.167+0000 7f2d45ffb700 1 -- 172.21.15.152:0/4208619335 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f2d3c08b180 con 0x7f2d480f88a0 2024-04-06T12:27:25.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.167+0000 7f2d47fff700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2d3806c6a0 0x7f2d3806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:25.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.167+0000 7f2d47fff700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2d3806c6a0 0x7f2d3806eb60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2d480f7ff0 tx=0x7f2d34009cb0).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:25.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.172+0000 7f2d45ffb700 1 -- 172.21.15.152:0/4208619335 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7f2d3c0557f0 con 0x7f2d480f88a0 2024-04-06T12:27:25.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:23.143840+0000 mgr.smithi152.lynahm (mgr.24477) 134 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:25.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:23.229863+0000 mgr.smithi152.lynahm (mgr.24477) 135 : cephadm [INF] Upgrade: Target is version 18.2.2-1086-g052adcad (reef) 2024-04-06T12:27:25.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:23.229922+0000 mgr.smithi152.lynahm (mgr.24477) 136 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e'] 2024-04-06T12:27:25.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:24 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:23.237341+0000 mgr.smithi152.lynahm (mgr.24477) 137 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-04-06T12:27:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.426+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2d480f7e30 con 0x7f2d480f88a0 2024-04-06T12:27:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.426+0000 7f2d45ffb700 1 -- 172.21.15.152:0/4208619335 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1778 (secure 0 0 0) 0x7f2d3c058e10 con 0x7f2d480f88a0 2024-04-06T12:27:25.424 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:27:25.424 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:27:25.424 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:27:25.424 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:27:25.424 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:27:25.425 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:25.426 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:25.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:27:25.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:27:25.427 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:27:25.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:27:25.427 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:25.427 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.428+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2d3806c6a0 msgr2=0x7f2d3806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.428+0000 7f2d4edba700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2d3806c6a0 0x7f2d3806eb60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2d480f7ff0 tx=0x7f2d34009cb0).stop 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.428+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f88a0 msgr2=0x7f2d480f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.428+0000 7f2d4edba700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f88a0 0x7f2d480f6850 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f2d3c00e910 tx=0x7f2d3c00b040).stop 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.428+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 shutdown_connections 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.428+0000 7f2d4edba700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7f2d3806c6a0 0x7f2d3806eb60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.429+0000 7f2d4edba700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d480f88a0 0x7f2d480f6850 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.429+0000 7f2d4edba700 1 --2- 172.21.15.152:0/4208619335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d480f9200 0x7f2d480f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.429+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 >> 172.21.15.152:0/4208619335 conn(0x7f2d48070590 msgr2=0x7f2d48100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.429+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 shutdown_connections 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.429+0000 7f2d4edba700 1 -- 172.21.15.152:0/4208619335 wait complete. 2024-04-06T12:27:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:27:25.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.536+0000 7fc326bbc700 1 -- 172.21.15.152:0/1254763160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 msgr2=0x7fc3200fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.536+0000 7fc326bbc700 1 --2- 172.21.15.152:0/1254763160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 0x7fc3200fdcf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fc3140047f0 tx=0x7fc314009cb0).stop 2024-04-06T12:27:25.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.536+0000 7fc326bbc700 1 -- 172.21.15.152:0/1254763160 shutdown_connections 2024-04-06T12:27:25.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.536+0000 7fc326bbc700 1 --2- 172.21.15.152:0/1254763160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3200fe270 0x7fc3200f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.536+0000 7fc326bbc700 1 --2- 172.21.15.152:0/1254763160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 0x7fc3200fdcf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.536+0000 7fc326bbc700 1 -- 172.21.15.152:0/1254763160 >> 172.21.15.152:0/1254763160 conn(0x7fc3200f3530 msgr2=0x7fc3200f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:25.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.536+0000 7fc326bbc700 1 -- 172.21.15.152:0/1254763160 shutdown_connections 2024-04-06T12:27:25.535 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.536+0000 7fc326bbc700 1 -- 172.21.15.152:0/1254763160 wait complete. 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.537+0000 7fc326bbc700 1 Processor -- start 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.537+0000 7fc326bbc700 1 -- start start 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.537+0000 7fc326bbc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 0x7fc32010e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.537+0000 7fc326bbc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3200fe270 0x7fc32010e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.537+0000 7fc326bbc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32010eba0 con 0x7fc3200fd910 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.537+0000 7fc326bbc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32010ece0 con 0x7fc3200fe270 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.537+0000 7fc324958700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 0x7fc32010e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.537+0000 7fc324958700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 0x7fc32010e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40142/0 (socket says 172.21.15.152:40142) 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.537+0000 7fc324958700 1 -- 172.21.15.152:0/3501242343 learned_addr learned my addr 172.21.15.152:0/3501242343 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.538+0000 7fc324958700 1 -- 172.21.15.152:0/3501242343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3200fe270 msgr2=0x7fc32010e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.538+0000 7fc324958700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3200fe270 0x7fc32010e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.538+0000 7fc324958700 1 -- 172.21.15.152:0/3501242343 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314005040 con 0x7fc3200fd910 2024-04-06T12:27:25.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.538+0000 7fc324958700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 0x7fc32010e0b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fc314005010 tx=0x7fc314009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.538+0000 7fc31dffb700 1 -- 172.21.15.152:0/3501242343 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc31400e030 con 0x7fc3200fd910 2024-04-06T12:27:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.538+0000 7fc31dffb700 1 -- 172.21.15.152:0/3501242343 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc314007e90 con 0x7fc3200fd910 2024-04-06T12:27:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.538+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc320108310 con 0x7fc3200fd910 2024-04-06T12:27:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.538+0000 7fc31dffb700 1 -- 172.21.15.152:0/3501242343 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc314018070 con 0x7fc3200fd910 2024-04-06T12:27:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.538+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3201087f0 con 0x7fc3200fd910 2024-04-06T12:27:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.539+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32005f570 con 0x7fc3200fd910 2024-04-06T12:27:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.540+0000 7fc31dffb700 1 -- 172.21.15.152:0/3501242343 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7fc31401d6e0 con 0x7fc3200fd910 2024-04-06T12:27:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.540+0000 7fc31dffb700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc31006c630 0x7fc31006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.540+0000 7fc31dffb700 1 -- 172.21.15.152:0/3501242343 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fc31408ca00 con 0x7fc3200fd910 2024-04-06T12:27:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.540+0000 7fc31ffff700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc31006c630 0x7fc31006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.541+0000 7fc31ffff700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc31006c630 0x7fc31006eaf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc3201099f0 tx=0x7fc30c009b60).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:25.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.545+0000 7fc31dffb700 1 -- 172.21.15.152:0/3501242343 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7fc31405ab00 con 0x7fc3200fd910 2024-04-06T12:27:25.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.771+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 --> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3200ffc60 con 0x7fc31006c630 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.772+0000 7fc31dffb700 1 -- 172.21.15.152:0/3501242343 <== mgr.24477 v2:172.21.15.152:6800/2887118719 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fc3200ffc60 con 0x7fc31006c630 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "2/21 daemons upgraded", 2024-04-06T12:27:25.770 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading mon daemons", 2024-04-06T12:27:25.771 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:27:25.771 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:27:25.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.774+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc31006c630 msgr2=0x7fc31006eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.774+0000 7fc326bbc700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc31006c630 0x7fc31006eaf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc3201099f0 tx=0x7fc30c009b60).stop 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.774+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 msgr2=0x7fc32010e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.774+0000 7fc326bbc700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 0x7fc32010e0b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fc314005010 tx=0x7fc314009cb0).stop 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.775+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 shutdown_connections 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.775+0000 7fc326bbc700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7fc31006c630 0x7fc31006eaf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.775+0000 7fc326bbc700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200fd910 0x7fc32010e0b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.775+0000 7fc326bbc700 1 --2- 172.21.15.152:0/3501242343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3200fe270 0x7fc32010e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.775+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 >> 172.21.15.152:0/3501242343 conn(0x7fc3200f3530 msgr2=0x7fc3200fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.775+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 shutdown_connections 2024-04-06T12:27:25.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.775+0000 7fc326bbc700 1 -- 172.21.15.152:0/3501242343 wait complete. 2024-04-06T12:27:25.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.875+0000 7ff219554700 1 -- 172.21.15.152:0/3044507781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fc7f0 msgr2=0x7ff2140fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.875+0000 7ff219554700 1 --2- 172.21.15.152:0/3044507781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fc7f0 0x7ff2140fcbd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7ff2040047f0 tx=0x7ff204009cb0).stop 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.875+0000 7ff219554700 1 -- 172.21.15.152:0/3044507781 shutdown_connections 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.875+0000 7ff219554700 1 --2- 172.21.15.152:0/3044507781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2140fd150 0x7ff2140f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.875+0000 7ff219554700 1 --2- 172.21.15.152:0/3044507781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fc7f0 0x7ff2140fcbd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.875+0000 7ff219554700 1 -- 172.21.15.152:0/3044507781 >> 172.21.15.152:0/3044507781 conn(0x7ff2140f23b0 msgr2=0x7ff2140f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.875+0000 7ff219554700 1 -- 172.21.15.152:0/3044507781 shutdown_connections 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.875+0000 7ff219554700 1 -- 172.21.15.152:0/3044507781 wait complete. 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.876+0000 7ff219554700 1 Processor -- start 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.876+0000 7ff219554700 1 -- start start 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.876+0000 7ff219554700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2140fc7f0 0x7ff214109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.876+0000 7ff219554700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fd150 0x7ff214109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.876+0000 7ff219554700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214109af0 con 0x7ff2140fd150 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.876+0000 7ff219554700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214109c30 con 0x7ff2140fc7f0 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.876+0000 7ff2127fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fd150 0x7ff214109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.876+0000 7ff2127fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fd150 0x7ff214109600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40160/0 (socket says 172.21.15.152:40160) 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.876+0000 7ff2127fc700 1 -- 172.21.15.152:0/1643618214 learned_addr learned my addr 172.21.15.152:0/1643618214 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff212ffd700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2140fc7f0 0x7ff214109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff2127fc700 1 -- 172.21.15.152:0/1643618214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2140fc7f0 msgr2=0x7ff214109110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff2127fc700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2140fc7f0 0x7ff214109110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff2127fc700 1 -- 172.21.15.152:0/1643618214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204005040 con 0x7ff2140fd150 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff2127fc700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fd150 0x7ff214109600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7ff1fc002780 tx=0x7ff1fc009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff20bfff700 1 -- 172.21.15.152:0/1643618214 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1fc007b40 con 0x7ff2140fd150 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff214109ee0 con 0x7ff2140fd150 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff20bfff700 1 -- 172.21.15.152:0/1643618214 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff1fc00f040 con 0x7ff2140fd150 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff20bfff700 1 -- 172.21.15.152:0/1643618214 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1fc014780 con 0x7ff2140fd150 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.877+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2141124d0 con 0x7ff2140fd150 2024-04-06T12:27:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.878+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214060370 con 0x7ff2140fd150 2024-04-06T12:27:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.878+0000 7ff20bfff700 1 -- 172.21.15.152:0/1643618214 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 90679+0+0 (secure 0 0 0) 0x7ff1fc007ca0 con 0x7ff2140fd150 2024-04-06T12:27:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.879+0000 7ff20bfff700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff20006c6a0 0x7ff20006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.879+0000 7ff20bfff700 1 -- 172.21.15.152:0/1643618214 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7ff1fc08b650 con 0x7ff2140fd150 2024-04-06T12:27:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.879+0000 7ff212ffd700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff20006c6a0 0x7ff20006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:25.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.879+0000 7ff212ffd700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff20006c6a0 0x7ff20006eb60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff204004f10 tx=0x7ff20400b040).ready entity=mgr.24477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:25.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:25.884+0000 7ff20bfff700 1 -- 172.21.15.152:0/1643618214 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181111 (secure 0 0 0) 0x7ff1fc055cc0 con 0x7ff2140fd150 2024-04-06T12:27:26.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.159+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff2140611d0 con 0x7ff2140fd150 2024-04-06T12:27:26.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.159+0000 7ff20bfff700 1 -- 172.21.15.152:0/1643618214 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff1fc0592e0 con 0x7ff2140fd150 2024-04-06T12:27:26.157 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:26.157 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:26.157 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:27:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff20006c6a0 msgr2=0x7ff20006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff20006c6a0 0x7ff20006eb60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff204004f10 tx=0x7ff20400b040).stop 2024-04-06T12:27:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fd150 msgr2=0x7ff214109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fd150 0x7ff214109600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7ff1fc002780 tx=0x7ff1fc009ee0).stop 2024-04-06T12:27:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 shutdown_connections 2024-04-06T12:27:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2140fc7f0 0x7ff214109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:26.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:6800/2887118719,v1:172.21.15.152:6801/2887118719] conn(0x7ff20006c6a0 0x7ff20006eb60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:26.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 --2- 172.21.15.152:0/1643618214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fd150 0x7ff214109600 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:26.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 >> 172.21.15.152:0/1643618214 conn(0x7ff2140f23b0 msgr2=0x7ff2140fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:26.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 shutdown_connections 2024-04-06T12:27:26.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:26.161+0000 7ff219554700 1 -- 172.21.15.152:0/1643618214 wait complete. 2024-04-06T12:27:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:24.011361+0000 mgr.smithi152.lynahm (mgr.24477) 138 : audit [DBG] from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:24.345250+0000 mgr.smithi152.lynahm (mgr.24477) 139 : audit [DBG] from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:24.669540+0000 mgr.smithi152.lynahm (mgr.24477) 140 : audit [DBG] from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:25.060682+0000 mon.smithi152 (mon.0) 998 : audit [DBG] from='client.? 172.21.15.152:0/4225666642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:25.213444+0000 mon.smithi152 (mon.0) 999 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:25.214187+0000 mon.smithi152 (mon.0) 1000 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:27:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:25.214720+0000 mon.smithi152 (mon.0) 1001 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:27:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:25.215229+0000 mon.smithi152 (mon.0) 1002 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:26.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:25 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:25.427400+0000 mon.smithi152 (mon.0) 1003 : audit [DBG] from='client.? 172.21.15.152:0/4208619335' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:27:26.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:24.011361+0000 mgr.smithi152.lynahm (mgr.24477) 138 : audit [DBG] from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:26.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:24.345250+0000 mgr.smithi152.lynahm (mgr.24477) 139 : audit [DBG] from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:26.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:24.669540+0000 mgr.smithi152.lynahm (mgr.24477) 140 : audit [DBG] from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:26.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:25.060682+0000 mon.smithi152 (mon.0) 998 : audit [DBG] from='client.? 172.21.15.152:0/4225666642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:26.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:25.213444+0000 mon.smithi152 (mon.0) 999 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:26.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:25.214187+0000 mon.smithi152 (mon.0) 1000 : audit [INF] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:27:26.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:25.214720+0000 mon.smithi152 (mon.0) 1001 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:27:26.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:25.215229+0000 mon.smithi152 (mon.0) 1002 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:26.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:25 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:25.427400+0000 mon.smithi152 (mon.0) 1003 : audit [DBG] from='client.? 172.21.15.152:0/4208619335' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:27:26.962 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:26 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:27:27.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cluster 2024-04-06T12:27:25.144416+0000 mgr.smithi152.lynahm (mgr.24477) 141 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:27.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:27:25.208921+0000 mgr.smithi152.lynahm (mgr.24477) 142 : cephadm [INF] Upgrade: Updating mon.smithi152 2024-04-06T12:27:27.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: cephadm 2024-04-06T12:27:25.216156+0000 mgr.smithi152.lynahm (mgr.24477) 143 : cephadm [INF] Deploying daemon mon.smithi152 on smithi152 2024-04-06T12:27:27.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:25.772947+0000 mgr.smithi152.lynahm (mgr.24477) 144 : audit [DBG] from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:27.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: audit 2024-04-06T12:27:26.160320+0000 mon.smithi152 (mon.0) 1004 : audit [DBG] from='client.? 172.21.15.152:0/1643618214' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:27:27.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:27:27.114+0000 7fbbaaa1e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-04-06T12:27:27.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[39718]: debug 2024-04-06T12:27:27.114+0000 7fbbaaa1e700 -1 mon.smithi152@0(leader) e2 *** Got Signal Terminated *** 2024-04-06T12:27:27.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:25.144416+0000 mgr.smithi152.lynahm (mgr.24477) 141 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:25.208921+0000 mgr.smithi152.lynahm (mgr.24477) 142 : cephadm [INF] Upgrade: Updating mon.smithi152 2024-04-06T12:27:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:25.216156+0000 mgr.smithi152.lynahm (mgr.24477) 143 : cephadm [INF] Deploying daemon mon.smithi152 on smithi152 2024-04-06T12:27:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:25.772947+0000 mgr.smithi152.lynahm (mgr.24477) 144 : audit [DBG] from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:26 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:26.160320+0000 mon.smithi152 (mon.0) 1004 : audit [DBG] from='client.? 172.21.15.152:0/1643618214' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:27:28.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:27 smithi152 bash[104431]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152 2024-04-06T12:27:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 systemd[1]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi152.service: Succeeded. 2024-04-06T12:27:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 systemd[1]: Stopped Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:27:28.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 systemd[1]: Starting Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:27:29.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: set uid:gid to 167:167 (ceph:ceph) 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable), process ceph-mon, pid 7 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: pidfile_write: ignore empty --pid-file 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: load: jerasure load: lrc 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: RocksDB version: 7.9.2 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Git sha 0 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Compile date 2024-04-03 02:24:10 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: DB SUMMARY 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: DB Session ID: CZ4ZKF470S3SZX2XXKIP 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: CURRENT file: CURRENT 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: IDENTITY file: IDENTITY 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: MANIFEST file: MANIFEST-000008 size: 1174 Bytes 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi152/store.db dir, Total Num: 1, files: 000026.sst 2024-04-06T12:27:29.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi152/store.db: 000024.log size: 2387308 ; 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.error_if_exists: 0 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.create_if_missing: 0 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.paranoid_checks: 1 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.env: 0x558a69c477a0 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.fs: PosixFileSystem 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.info_log: 0x558a6bcdd380 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_file_opening_threads: 16 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.statistics: (nil) 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.use_fsync: 0 2024-04-06T12:27:29.028 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_log_file_size: 0 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.keep_log_file_num: 1000 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.recycle_log_file_num: 0 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.allow_fallocate: 1 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.allow_mmap_reads: 0 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.allow_mmap_writes: 0 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.use_direct_reads: 0 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.create_missing_column_families: 0 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.db_log_dir: 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.wal_dir: 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-06T12:27:29.029 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.advise_random_on_open: 1 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.db_write_buffer_size: 0 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.write_buffer_manager: 0x558a6af54140 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.rate_limiter: (nil) 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.wal_recovery_mode: 2 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.enable_thread_tracking: 0 2024-04-06T12:27:29.030 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.enable_pipelined_write: 0 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.unordered_write: 0 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.row_cache: None 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.wal_filter: None 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.allow_ingest_behind: 0 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.two_write_queues: 0 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.manual_wal_flush: 0 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.wal_compression: 0 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.atomic_flush: 0 2024-04-06T12:27:29.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.log_readahead_size: 0 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.best_efforts_recovery: 0 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.allow_data_in_errors: 0 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.db_host_id: __hostname__ 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_background_jobs: 2 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_background_compactions: -1 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_subcompactions: 1 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-06T12:27:29.032 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_total_wal_size: 0 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_open_files: -1 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bytes_per_sync: 0 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_readahead_size: 0 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_background_flushes: -1 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Compression algorithms supported: 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-06T12:27:29.033 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: kZSTD supported: 0 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: kXpressCompression supported: 0 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: kLZ4HCCompression supported: 1 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: kZlibCompression supported: 1 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: kSnappyCompression supported: 1 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: kLZ4Compression supported: 1 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: kBZip2Compression supported: 0 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000008 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.merge_operator: 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_filter: None 2024-04-06T12:27:29.034 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_filter_factory: None 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.sst_partitioner_factory: None 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558a6bcdd4a0) 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks: 1 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_top_level_index_and_filter: 1 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_type: 0 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_index_type: 0 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_shortening: 1 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: checksum: 4 2024-04-06T12:27:29.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: no_block_cache: 0 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache: 0x558a6aff51f0 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_name: BinnedLRUCache 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_options: 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: capacity : 536870912 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_shard_bits : 4 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: strict_capacity_limit : 0 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: high_pri_pool_ratio: 0.000 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_compressed: (nil) 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: persistent_cache: (nil) 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size: 4096 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size_deviation: 10 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_restart_interval: 16 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_block_restart_interval: 1 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_block_size: 4096 2024-04-06T12:27:29.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: partition_filters: 0 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: use_delta_encoding: 1 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: filter_policy: bloomfilter 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: whole_key_filtering: 1 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: verify_compression: 0 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: read_amp_bytes_per_bit: 0 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: format_version: 5 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_index_compression: 1 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_align: 0 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_auto_readahead_size: 262144 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: prepopulate_block_cache: 0 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: initial_auto_readahead_size: 8192 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_file_reads_for_auto_readahead: 2 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.write_buffer_size: 33554432 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_write_buffer_number: 2 2024-04-06T12:27:29.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression: NoCompression 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression: Disabled 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.prefix_extractor: nullptr 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.num_levels: 7 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-06T12:27:29.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression_opts.level: 32767 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression_opts.strategy: 0 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression_opts.enabled: false 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-06T12:27:29.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.target_file_size_base: 67108864 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-06T12:27:29.040 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.arena_block_size: 1048576 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.disable_auto_compactions: 0 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.table_properties_collectors: 2024-04-06T12:27:29.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.inplace_update_support: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.bloom_locality: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.max_successive_merges: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.paranoid_file_checks: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.force_consistency_checks: 1 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.report_bg_io_stats: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.ttl: 2592000 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-06T12:27:29.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.enable_blob_files: false 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.min_blob_size: 0 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.blob_file_size: 268435456 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.blob_file_starting_level: 0 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-06T12:27:29.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 26.sst 2024-04-06T12:27:29.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 28, last_sequence is 11388, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-06T12:27:29.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 24 2024-04-06T12:27:29.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 165d1c8d-c1e4-417a-9c51-212265be53ca 2024-04-06T12:27:29.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712406448721488, "job": 1, "event": "recovery_started", "wal_files": [24]} 2024-04-06T12:27:29.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #24 mode 2 2024-04-06T12:27:29.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712406448727735, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 29, "file_size": 2381306, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11389, "largest_seqno": 11861, "table_properties": {"data_size": 2377313, "index_size": 2527, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 453, "raw_key_size": 3813, "raw_average_key_size": 21, "raw_value_size": 2371974, "raw_average_value_size": 13400, "num_data_blocks": 113, "num_entries": 177, "num_filter_entries": 177, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712406448, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "165d1c8d-c1e4-417a-9c51-212265be53ca", "db_session_id": "CZ4ZKF470S3SZX2XXKIP", "orig_file_number": 29, "seqno_to_time_mapping": "N/A"}} 2024-04-06T12:27:29.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712406448727859, "job": 1, "event": "recovery_finished"} 2024-04-06T12:27:29.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/version_set.cc:5047] Creating manifest 31 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi152/store.db/000024.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558a6b092000 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: DB pointer 0x558a6b080000 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** DB Stats ** 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T12:27:29.045 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L0 1/0 2.27 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 668.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L6 1/0 27.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Sum 2/0 29.59 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 668.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 668.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 668.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-04-06T12:27:29.046 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative compaction: 0.00 GB write, 214.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval compaction: 0.00 GB write, 214.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache BinnedLRUCache@0x558a6aff51f0#7 capacity: 512.00 MB usage: 3.08 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.50 KB,9.53674e-05%) IndexBlock(1,2.58 KB,0.000491738%) Misc(1,0.00 KB,0%) 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-06T12:27:29.047 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: starting mon.smithi152 rank 0 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi152 fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: mon.smithi152@-1(???) e2 preinit fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: mon.smithi152@-1(???).mds e11 new map 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: mon.smithi152@-1(???).mds e11 print_map 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: e11 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: legacy client fscid: 1 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Filesystem 'cephfs' (1) 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: fs_name cephfs 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: epoch 11 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:27:29.048 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: tableserver 0 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: root 0 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_timeout 60 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_autoclose 300 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_file_size 1099511627776 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_xattr_size 65536 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: required_client_features {} 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure 0 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure_osd_epoch 0 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_mds 1 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: in 0 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: up {0=14434} 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: failed 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: damaged 2024-04-06T12:27:29.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: stopped 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_pools [3] 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_pool 2 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: inline_data enabled 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: balancer 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: bal_rank_mask -1 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: standby_count_wanted 1 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Standby daemons: 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:29.050 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:29.051 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: mon.smithi152@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-06T12:27:29.051 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: mon.smithi152@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-06T12:27:29.051 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: mon.smithi152@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-06T12:27:29.051 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: mon.smithi152@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-06T12:27:29.051 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 ceph-mon[104634]: mon.smithi152@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-04-06T12:27:29.051 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 bash[104597]: 7ba55ae8d3b124a978659e8a6051073c0bf833c94219808c29c42df50f0fd700 2024-04-06T12:27:29.051 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:28 smithi152 systemd[1]: Started Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:27:30.513 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:27.121142+0000 mon.smithi195 (mon.1) 94 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:27.123549+0000 mon.smithi195 (mon.1) 95 : audit [DBG] from='mgr.24477 172.21.15.152:0/1903047490' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:27.144774+0000 mgr.smithi152.lynahm (mgr.24477) 145 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:29.145174+0000 mgr.smithi152.lynahm (mgr.24477) 146 : cluster [DBG] pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.142210+0000 mon.smithi152 (mon.0) 1 : cluster [INF] mon.smithi152 calling monitor election 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.155914+0000 mon.smithi152 (mon.0) 2 : cluster [INF] mon.smithi152 is new leader, mons smithi152,smithi195 in quorum (ranks 0,1) 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.160934+0000 mon.smithi152 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.161530+0000 mon.smithi152 (mon.0) 4 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.161568+0000 mon.smithi152 (mon.0) 5 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.162723+0000 mon.smithi152 (mon.0) 6 : cluster [DBG] mgrmap e32: smithi152.lynahm(active, since 2m), standbys: smithi195.ausetj 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.179497+0000 mon.smithi152 (mon.0) 7 : cluster [DBG] mgrmap e33: smithi152.lynahm(active, since 2m), standbys: smithi195.ausetj 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.179533+0000 mon.smithi152 (mon.0) 8 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:30.514 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.179546+0000 mon.smithi152 (mon.0) 9 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:30.515 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:30.179555+0000 mon.smithi152 (mon.0) 10 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:27:30.515 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:30 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:30.179627+0000 mon.smithi152 (mon.0) 11 : audit [INF] from='mgr.24477 ' entity='' 2024-04-06T12:27:37.120 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:36.942147+0000 mon.smithi152 (mon.0) 12 : cluster [DBG] Standby manager daemon smithi195.ausetj restarted 2024-04-06T12:27:37.120 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:36.942227+0000 mon.smithi152 (mon.0) 13 : cluster [DBG] Standby manager daemon smithi195.ausetj started 2024-04-06T12:27:37.120 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:36.943759+0000 mon.smithi195 (mon.1) 96 : audit [DBG] from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:27:37.120 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:36.944272+0000 mon.smithi195 (mon.1) 97 : audit [DBG] from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:27:37.120 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:36.946109+0000 mon.smithi195 (mon.1) 98 : audit [DBG] from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:27:37.120 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:37 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:36.947172+0000 mon.smithi195 (mon.1) 99 : audit [DBG] from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:27:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:36.997955+0000 mon.smithi152 (mon.0) 14 : cluster [DBG] mgrmap e34: smithi152.lynahm(active, since 2m), standbys: smithi195.ausetj 2024-04-06T12:27:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:36.998337+0000 mon.smithi152 (mon.0) 15 : cluster [INF] Active manager daemon smithi152.lynahm restarted 2024-04-06T12:27:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:36.998663+0000 mon.smithi152 (mon.0) 16 : cluster [INF] Activating manager daemon smithi152.lynahm 2024-04-06T12:27:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:37.007949+0000 mon.smithi152 (mon.0) 17 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:37.008380+0000 mon.smithi152 (mon.0) 18 : cluster [DBG] mgrmap e35: smithi152.lynahm(active, starting, since 0.00981782s), standbys: smithi195.ausetj 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.010844+0000 mon.smithi152 (mon.0) 19 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.011051+0000 mon.smithi152 (mon.0) 20 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.011273+0000 mon.smithi152 (mon.0) 21 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.011572+0000 mon.smithi152 (mon.0) 22 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.011839+0000 mon.smithi152 (mon.0) 23 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.012113+0000 mon.smithi152 (mon.0) 24 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.012583+0000 mon.smithi152 (mon.0) 25 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.012751+0000 mon.smithi152 (mon.0) 26 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi195.ausetj", "id": "smithi195.ausetj"}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.012952+0000 mon.smithi152 (mon.0) 27 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.013154+0000 mon.smithi152 (mon.0) 28 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.013362+0000 mon.smithi152 (mon.0) 29 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:27:38.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.013553+0000 mon.smithi152 (mon.0) 30 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.013817+0000 mon.smithi152 (mon.0) 31 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.014074+0000 mon.smithi152 (mon.0) 32 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.014281+0000 mon.smithi152 (mon.0) 33 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.014548+0000 mon.smithi152 (mon.0) 34 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.014895+0000 mon.smithi152 (mon.0) 35 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:37.032990+0000 mon.smithi152 (mon.0) 36 : cluster [INF] Manager daemon smithi152.lynahm is now available 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.055734+0000 mon.smithi152 (mon.0) 37 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.077803+0000 mon.smithi152 (mon.0) 38 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.087179+0000 mon.smithi152 (mon.0) 39 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:37.102373+0000 mon.smithi152 (mon.0) 40 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/trash_purge_schedule"}]: dispatch 2024-04-06T12:27:38.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:38 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:37.198877+0000 mgr.smithi152.lynahm (mgr.34104) 1 : cephadm [INF] [06/Apr/2024:12:27:37] ENGINE Bus STARTING 2024-04-06T12:27:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:37.350239+0000 mgr.smithi152.lynahm (mgr.34104) 2 : cephadm [INF] [06/Apr/2024:12:27:37] ENGINE Serving on http://172.21.15.152:8765 2024-04-06T12:27:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:37.514860+0000 mgr.smithi152.lynahm (mgr.34104) 3 : cephadm [INF] [06/Apr/2024:12:27:37] ENGINE Serving on https://172.21.15.152:7150 2024-04-06T12:27:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:37.515077+0000 mgr.smithi152.lynahm (mgr.34104) 4 : cephadm [INF] [06/Apr/2024:12:27:37] ENGINE Bus STARTED 2024-04-06T12:27:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:38.013047+0000 mon.smithi152 (mon.0) 41 : cluster [DBG] mgrmap e36: smithi152.lynahm(active, since 1.01449s), standbys: smithi195.ausetj 2024-04-06T12:27:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:38.019111+0000 mgr.smithi152.lynahm (mgr.34104) 5 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:40.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:39.013721+0000 mgr.smithi152.lynahm (mgr.34104) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:40.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:39.746217+0000 mon.smithi152 (mon.0) 42 : cluster [DBG] mgrmap e37: smithi152.lynahm(active, since 2s), standbys: smithi195.ausetj 2024-04-06T12:27:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:41.014041+0000 mgr.smithi152.lynahm (mgr.34104) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:41.066289+0000 mon.smithi152 (mon.0) 43 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:41.072829+0000 mon.smithi152 (mon.0) 44 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:41.708469+0000 mon.smithi152 (mon.0) 45 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:41.712303+0000 mon.smithi152 (mon.0) 46 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:42.020964+0000 mon.smithi152 (mon.0) 47 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:42.026998+0000 mon.smithi152 (mon.0) 48 : cluster [DBG] mgrmap e38: smithi152.lynahm(active, since 5s), standbys: smithi195.ausetj 2024-04-06T12:27:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:42.032542+0000 mon.smithi152 (mon.0) 49 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:44.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:42.666054+0000 mon.smithi152 (mon.0) 50 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:44.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:42.670385+0000 mon.smithi152 (mon.0) 51 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:44.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:43.014279+0000 mgr.smithi152.lynahm (mgr.34104) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:46.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:45.014742+0000 mgr.smithi152.lynahm (mgr.34104) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-06T12:27:47.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:46.391571+0000 mgr.smithi152.lynahm (mgr.34104) 10 : cephadm [INF] Detected new or changed devices on smithi152 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:46.395846+0000 mon.smithi152 (mon.0) 52 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:46.400189+0000 mon.smithi152 (mon.0) 53 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:46.401430+0000 mon.smithi152 (mon.0) 54 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:46.402068+0000 mon.smithi152 (mon.0) 55 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:46.402981+0000 mgr.smithi152.lynahm (mgr.34104) 11 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:46.403143+0000 mgr.smithi152.lynahm (mgr.34104) 12 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:46.667439+0000 mgr.smithi152.lynahm (mgr.34104) 13 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:46.667586+0000 mgr.smithi152.lynahm (mgr.34104) 14 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:46.931571+0000 mgr.smithi152.lynahm (mgr.34104) 15 : cephadm [INF] Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:46.931702+0000 mgr.smithi152.lynahm (mgr.34104) 16 : cephadm [INF] Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:47.015087+0000 mgr.smithi152.lynahm (mgr.34104) 17 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:47.195696+0000 mgr.smithi152.lynahm (mgr.34104) 18 : cephadm [INF] Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:47.196215+0000 mgr.smithi152.lynahm (mgr.34104) 19 : cephadm [INF] Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:48.769 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:47.465653+0000 mon.smithi152 (mon.0) 56 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:48.769 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:47.468650+0000 mon.smithi152 (mon.0) 57 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:48.769 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:47.471829+0000 mon.smithi152 (mon.0) 58 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:48.769 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:47.475070+0000 mon.smithi152 (mon.0) 59 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:48.770 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:47.479119+0000 mon.smithi152 (mon.0) 60 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:48.770 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:47.584438+0000 mon.smithi152 (mon.0) 61 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:48.770 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:47.586664+0000 mon.smithi152 (mon.0) 62 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:48.770 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:47.587575+0000 mon.smithi152 (mon.0) 63 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-06T12:27:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cluster 2024-04-06T12:27:49.015597+0000 mgr.smithi152.lynahm (mgr.34104) 20 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-06T12:27:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:49.205672+0000 mgr.smithi152.lynahm (mgr.34104) 21 : cephadm [INF] Upgrade: Updating mon.smithi195 2024-04-06T12:27:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:49.212723+0000 mon.smithi152 (mon.0) 64 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:49.213650+0000 mon.smithi152 (mon.0) 65 : audit [INF] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:27:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:49.214303+0000 mon.smithi152 (mon.0) 66 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:27:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: audit 2024-04-06T12:27:49.215081+0000 mon.smithi152 (mon.0) 67 : audit [DBG] from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: cephadm 2024-04-06T12:27:49.216044+0000 mgr.smithi152.lynahm (mgr.34104) 22 : cephadm [INF] Deploying daemon mon.smithi195 on smithi195 2024-04-06T12:27:51.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:50 smithi195 systemd[1]: Stopping Ceph mon.smithi195 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:27:51.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: debug 2024-04-06T12:27:51.152+0000 7fced14d5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi195 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-04-06T12:27:51.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[42856]: debug 2024-04-06T12:27:51.152+0000 7fced14d5700 -1 mon.smithi195@1(peon) e2 *** Got Signal Terminated *** 2024-04-06T12:27:52.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:51 smithi195 bash[85782]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195 2024-04-06T12:27:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:52 smithi195 systemd[1]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi195.service: Succeeded. 2024-04-06T12:27:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:52 smithi195 systemd[1]: Stopped Ceph mon.smithi195 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:27:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:52 smithi195 systemd[1]: Starting Ceph mon.smithi195 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: set uid:gid to 167:167 (ceph:ceph) 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable), process ceph-mon, pid 7 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: pidfile_write: ignore empty --pid-file 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: load: jerasure load: lrc 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: RocksDB version: 7.9.2 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Git sha 0 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Compile date 2024-04-03 02:24:10 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: DB SUMMARY 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: DB Session ID: 3S5FRV0LKORQRBAT9DW4 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: CURRENT file: CURRENT 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: IDENTITY file: IDENTITY 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: MANIFEST file: MANIFEST-000005 size: 1193 Bytes 2024-04-06T12:27:53.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi195/store.db dir, Total Num: 1, files: 000025.sst 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi195/store.db: 000023.log size: 7412836 ; 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.error_if_exists: 0 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.create_if_missing: 0 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.paranoid_checks: 1 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.env: 0x5580d622b7a0 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.fs: PosixFileSystem 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.info_log: 0x5580d91c3380 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_file_opening_threads: 16 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.statistics: (nil) 2024-04-06T12:27:53.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.use_fsync: 0 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_log_file_size: 0 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.keep_log_file_num: 1000 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.recycle_log_file_num: 0 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.allow_fallocate: 1 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.allow_mmap_reads: 0 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.allow_mmap_writes: 0 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.use_direct_reads: 0 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.create_missing_column_families: 0 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.db_log_dir: 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.wal_dir: 2024-04-06T12:27:53.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.advise_random_on_open: 1 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.db_write_buffer_size: 0 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.write_buffer_manager: 0x5580d843a140 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-06T12:27:53.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.rate_limiter: (nil) 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.wal_recovery_mode: 2 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.enable_thread_tracking: 0 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.enable_pipelined_write: 0 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.unordered_write: 0 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.row_cache: None 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.wal_filter: None 2024-04-06T12:27:53.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.allow_ingest_behind: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.two_write_queues: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.manual_wal_flush: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.wal_compression: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.atomic_flush: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.log_readahead_size: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.best_efforts_recovery: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.allow_data_in_errors: 0 2024-04-06T12:27:53.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.db_host_id: __hostname__ 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_background_jobs: 2 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_background_compactions: -1 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_subcompactions: 1 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_total_wal_size: 0 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_open_files: -1 2024-04-06T12:27:53.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bytes_per_sync: 0 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_readahead_size: 0 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_background_flushes: -1 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Compression algorithms supported: 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: kZSTD supported: 0 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: kXpressCompression supported: 0 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: kLZ4HCCompression supported: 1 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: kZlibCompression supported: 1 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: kSnappyCompression supported: 1 2024-04-06T12:27:53.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: kLZ4Compression supported: 1 2024-04-06T12:27:53.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: kBZip2Compression supported: 0 2024-04-06T12:27:53.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-06T12:27:53.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000005 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.merge_operator: 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_filter: None 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_filter_factory: None 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.sst_partitioner_factory: None 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5580d91c34a0) 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks: 1 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-06T12:27:53.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_top_level_index_and_filter: 1 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_type: 0 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_index_type: 0 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_shortening: 1 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: checksum: 4 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: no_block_cache: 0 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache: 0x5580d84db1f0 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_name: BinnedLRUCache 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_options: 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: capacity : 536870912 2024-04-06T12:27:53.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: num_shard_bits : 4 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: strict_capacity_limit : 0 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: high_pri_pool_ratio: 0.000 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_compressed: (nil) 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: persistent_cache: (nil) 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size: 4096 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size_deviation: 10 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_restart_interval: 16 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_block_restart_interval: 1 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: metadata_block_size: 4096 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: partition_filters: 0 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: use_delta_encoding: 1 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: filter_policy: bloomfilter 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: whole_key_filtering: 1 2024-04-06T12:27:53.312 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: verify_compression: 0 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: read_amp_bytes_per_bit: 0 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: format_version: 5 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_index_compression: 1 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_align: 0 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_auto_readahead_size: 262144 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: prepopulate_block_cache: 0 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: initial_auto_readahead_size: 8192 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: num_file_reads_for_auto_readahead: 2 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.write_buffer_size: 33554432 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_write_buffer_number: 2 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression: NoCompression 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression: Disabled 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.prefix_extractor: nullptr 2024-04-06T12:27:53.313 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.num_levels: 7 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-06T12:27:53.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression_opts.level: 32767 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression_opts.strategy: 0 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression_opts.enabled: false 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.target_file_size_base: 67108864 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-06T12:27:53.315 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.arena_block_size: 1048576 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.disable_auto_compactions: 0 2024-04-06T12:27:53.316 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.table_properties_collectors: 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.inplace_update_support: 0 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-06T12:27:53.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.bloom_locality: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.max_successive_merges: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.paranoid_file_checks: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.force_consistency_checks: 1 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.report_bg_io_stats: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.ttl: 2592000 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.enable_blob_files: false 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.min_blob_size: 0 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.blob_file_size: 268435456 2024-04-06T12:27:53.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-06T12:27:53.319 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-06T12:27:53.319 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-06T12:27:53.319 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-06T12:27:53.319 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-06T12:27:53.319 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.blob_file_starting_level: 0 2024-04-06T12:27:53.319 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-06T12:27:53.319 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 25.sst 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 27, last_sequence is 11920, log_number is 23,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 23 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a2e191a1-0a7e-4771-b84c-b354edc86aff 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712406473033751, "job": 1, "event": "recovery_started", "wal_files": [23]} 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #23 mode 2 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712406473049081, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 28, "file_size": 4863921, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11925, "largest_seqno": 12879, "table_properties": {"data_size": 4857634, "index_size": 4436, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 837, "raw_key_size": 6565, "raw_average_key_size": 21, "raw_value_size": 4848355, "raw_average_value_size": 15690, "num_data_blocks": 195, "num_entries": 309, "num_filter_entries": 309, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712406473, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a2e191a1-0a7e-4771-b84c-b354edc86aff", "db_session_id": "3S5FRV0LKORQRBAT9DW4", "orig_file_number": 28, "seqno_to_time_mapping": "N/A"}} 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712406473049216, "job": 1, "event": "recovery_finished"} 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/version_set.cc:5047] Creating manifest 30 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi195/store.db/000023.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5580d8578000 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: DB pointer 0x5580d8566000 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-06T12:27:53.320 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** DB Stats ** 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L0 1/0 4.64 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 735.2 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L6 1/0 27.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-06T12:27:53.321 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Sum 2/0 31.96 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 735.2 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-06T12:27:53.322 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 735.2 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-06T12:27:53.322 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-04-06T12:27:53.322 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-04-06T12:27:53.322 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-06T12:27:53.322 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-06T12:27:53.322 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 735.2 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative compaction: 0.00 GB write, 255.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval compaction: 0.00 GB write, 255.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Block cache BinnedLRUCache@0x5580d84db1f0#7 capacity: 512.00 MB usage: 5.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-06T12:27:53.323 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.91 KB,0.000172853%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: starting mon.smithi195 rank 1 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi195 fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: mon.smithi195@-1(???) e2 preinit fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: mon.smithi195@-1(???).mds e11 new map 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: mon.smithi195@-1(???).mds e11 print_map 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: e11 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: legacy client fscid: 1 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Filesystem 'cephfs' (1) 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: fs_name cephfs 2024-04-06T12:27:53.324 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: epoch 11 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: tableserver 0 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: root 0 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: session_timeout 60 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: session_autoclose 300 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_file_size 1099511627776 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_xattr_size 65536 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: required_client_features {} 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: last_failure 0 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: last_failure_osd_epoch 0 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_mds 1 2024-04-06T12:27:53.325 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: in 0 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: up {0=14434} 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: failed 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: damaged 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: stopped 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_pools [3] 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: metadata_pool 2 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: inline_data enabled 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: balancer 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: bal_rank_mask -1 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: standby_count_wanted 1 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-04-06T12:27:53.326 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Standby daemons: 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: mon.smithi195@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: mon.smithi195@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: mon.smithi195@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: mon.smithi195@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 ceph-mon[85980]: mon.smithi195@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 bash[85941]: 4e919860905a5b0f73d710459447422bf188f98622ba2484429b4c43db8c05e1 2024-04-06T12:27:53.327 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:53 smithi195 systemd[1]: Started Ceph mon.smithi195 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:27:55.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mkfs f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:27:55.255 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mkfs f2af90de-f40e-11ee-b649-cb9ed24678a4 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Reconfiguring prometheus.smithi195 (dependencies changed)... 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Reconfiguring daemon prometheus.smithi195 on smithi195 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Updating mgr.smithi195.ausetj 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Deploying daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all mgr 2024-04-06T12:27:55.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all rgw 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all rbd-mirror 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all ceph-exporter 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all iscsi 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all nfs 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all nvmeof 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Updating node-exporter.smithi152 (1/2) 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Deploying daemon node-exporter.smithi152 on smithi152 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Updating node-exporter.smithi195 (2/2) 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Deploying daemon node-exporter.smithi195 on smithi195 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Updating prometheus.smithi195 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Deploying daemon prometheus.smithi195 on smithi195 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Updating alertmanager.smithi152 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Deploying daemon alertmanager.smithi152 on smithi152 2024-04-06T12:27:55.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Updating grafana.smithi152 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Deploying daemon grafana.smithi152 on smithi152 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Finalizing container_image settings 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Complete! 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v63: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v64: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v65: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v66: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v67: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v68: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v69: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.301 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v70: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v71: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v72: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v73: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v74: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v75: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v76: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Target is version 18.2.2-1086-g052adcad (reef) 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e'] 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all mgr 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.302 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Updating mon.smithi152 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Deploying daemon mon.smithi152 on smithi152 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mon.smithi152 calling monitor election 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mon.smithi152 is new leader, mons smithi152,smithi195 in quorum (ranks 0,1) 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: monmap e2: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: osdmap e48: 6 total, 6 up, 6 in 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mgrmap e32: smithi152.lynahm(active, since 2m), standbys: smithi195.ausetj 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mgrmap e33: smithi152.lynahm(active, since 2m), standbys: smithi195.ausetj 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.24477 ' entity='' 2024-04-06T12:27:55.303 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Standby manager daemon smithi195.ausetj restarted 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Standby manager daemon smithi195.ausetj started 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mgrmap e34: smithi152.lynahm(active, since 2m), standbys: smithi195.ausetj 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Active manager daemon smithi152.lynahm restarted 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Activating manager daemon smithi152.lynahm 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: osdmap e49: 6 total, 6 up, 6 in 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mgrmap e35: smithi152.lynahm(active, starting, since 0.00981782s), standbys: smithi195.ausetj 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:27:55.304 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:27:55.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:27:55.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:27:55.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi195.ausetj", "id": "smithi195.ausetj"}]: dispatch 2024-04-06T12:27:55.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:27:55.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:27:55.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:27:55.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:27:55.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:27:55.305 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Manager daemon smithi152.lynahm is now available 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/trash_purge_schedule"}]: dispatch 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: [06/Apr/2024:12:27:37] ENGINE Bus STARTING 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: [06/Apr/2024:12:27:37] ENGINE Serving on http://172.21.15.152:8765 2024-04-06T12:27:55.306 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: [06/Apr/2024:12:27:37] ENGINE Serving on https://172.21.15.152:7150 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: [06/Apr/2024:12:27:37] ENGINE Bus STARTED 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mgrmap e36: smithi152.lynahm(active, since 1.01449s), standbys: smithi195.ausetj 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v3: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mgrmap e37: smithi152.lynahm(active, since 2s), standbys: smithi195.ausetj 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mgrmap e38: smithi152.lynahm(active, since 5s), standbys: smithi195.ausetj 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.307 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v7: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Detected new or changed devices on smithi152 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:55.308 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v8: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v9: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Upgrade: Updating mon.smithi195 2024-04-06T12:27:55.309 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Deploying daemon mon.smithi195 on smithi195 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mon.smithi152 calling monitor election 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mon.smithi195 calling monitor election 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mon.smithi152 is new leader, mons smithi152,smithi195 in quorum (ranks 0,1) 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: monmap e3: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-06T12:27:55.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:27:55.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: osdmap e49: 6 total, 6 up, 6 in 2024-04-06T12:27:55.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: mgrmap e38: smithi152.lynahm(active, since 17s), standbys: smithi195.ausetj 2024-04-06T12:27:55.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:27:55.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:55.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:55 smithi195 ceph-mon[85980]: pgmap v12: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Reconfiguring prometheus.smithi195 (dependencies changed)... 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Reconfiguring daemon prometheus.smithi195 on smithi195 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Updating mgr.smithi195.ausetj 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Deploying daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all mgr 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all rgw 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all rbd-mirror 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-06T12:27:55.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all ceph-exporter 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all iscsi 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all nfs 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all nvmeof 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Updating node-exporter.smithi152 (1/2) 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Deploying daemon node-exporter.smithi152 on smithi152 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Updating node-exporter.smithi195 (2/2) 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Deploying daemon node-exporter.smithi195 on smithi195 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Updating prometheus.smithi195 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Deploying daemon prometheus.smithi195 on smithi195 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Updating alertmanager.smithi152 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Deploying daemon alertmanager.smithi152 on smithi152 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Updating grafana.smithi152 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Deploying daemon grafana.smithi152 on smithi152 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Finalizing container_image settings 2024-04-06T12:27:55.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Complete! 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v63: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v64: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v65: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v66: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v67: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v68: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v69: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v70: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v71: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v72: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v73: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v74: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v75: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v76: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:052adcadd0534eddb0d73c5afbc083a84cd9dc46 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Target is version 18.2.2-1086-g052adcad (reef) 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e'] 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all mgr 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Updating mon.smithi152 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Deploying daemon mon.smithi152 on smithi152 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:27:55.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mon.smithi152 calling monitor election 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mon.smithi152 is new leader, mons smithi152,smithi195 in quorum (ranks 0,1) 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: monmap e2: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: osdmap e48: 6 total, 6 up, 6 in 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mgrmap e32: smithi152.lynahm(active, since 2m), standbys: smithi195.ausetj 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mgrmap e33: smithi152.lynahm(active, since 2m), standbys: smithi195.ausetj 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.24477 ' entity='' 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Standby manager daemon smithi195.ausetj restarted 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Standby manager daemon smithi195.ausetj started 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/crt"}]: dispatch 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-06T12:27:55.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.ausetj/key"}]: dispatch 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.? 172.21.15.195:0/1631266248' entity='mgr.smithi195.ausetj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mgrmap e34: smithi152.lynahm(active, since 2m), standbys: smithi195.ausetj 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Active manager daemon smithi152.lynahm restarted 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Activating manager daemon smithi152.lynahm 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: osdmap e49: 6 total, 6 up, 6 in 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mgrmap e35: smithi152.lynahm(active, starting, since 0.00981782s), standbys: smithi195.ausetj 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi152.lynahm", "id": "smithi152.lynahm"}]: dispatch 2024-04-06T12:27:55.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr metadata", "who": "smithi195.ausetj", "id": "smithi195.ausetj"}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Manager daemon smithi152.lynahm is now available 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/mirror_snapshot_schedule"}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.lynahm/trash_purge_schedule"}]: dispatch 2024-04-06T12:27:55.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: [06/Apr/2024:12:27:37] ENGINE Bus STARTING 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: [06/Apr/2024:12:27:37] ENGINE Serving on http://172.21.15.152:8765 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: [06/Apr/2024:12:27:37] ENGINE Serving on https://172.21.15.152:7150 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: [06/Apr/2024:12:27:37] ENGINE Bus STARTED 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mgrmap e36: smithi152.lynahm(active, since 1.01449s), standbys: smithi195.ausetj 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v3: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mgrmap e37: smithi152.lynahm(active, since 2s), standbys: smithi195.ausetj 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mgrmap e38: smithi152.lynahm(active, since 5s), standbys: smithi195.ausetj 2024-04-06T12:27:55.534 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v7: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Detected new or changed devices on smithi152 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi152:/etc/ceph/ceph.conf 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.conf 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:55.535 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v8: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Updating smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v9: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Upgrade: Updating mon.smithi195 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.536 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Deploying daemon mon.smithi195 on smithi195 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mon.smithi152 calling monitor election 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mon.smithi195 calling monitor election 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mon.smithi152 is new leader, mons smithi152,smithi195 in quorum (ranks 0,1) 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: monmap e3: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: osdmap e49: 6 total, 6 up, 6 in 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: mgrmap e38: smithi152.lynahm(active, since 17s), standbys: smithi195.ausetj 2024-04-06T12:27:55.537 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.538 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:55.538 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:27:55.538 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.538 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:55.538 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:27:55.538 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:55 smithi152 ceph-mon[104634]: pgmap v12: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-06T12:27:56.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.276+0000 7fc6da6f4700 1 -- 172.21.15.152:0/842013697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 msgr2=0x7fc6d40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:56.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.276+0000 7fc6da6f4700 1 --2- 172.21.15.152:0/842013697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 0x7fc6d40f6930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc6bc0047f0 tx=0x7fc6bc009cb0).stop 2024-04-06T12:27:56.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.276+0000 7fc6da6f4700 1 -- 172.21.15.152:0/842013697 shutdown_connections 2024-04-06T12:27:56.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.276+0000 7fc6da6f4700 1 --2- 172.21.15.152:0/842013697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 0x7fc6d40f6930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.276+0000 7fc6da6f4700 1 --2- 172.21.15.152:0/842013697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.276+0000 7fc6da6f4700 1 -- 172.21.15.152:0/842013697 >> 172.21.15.152:0/842013697 conn(0x7fc6d4070590 msgr2=0x7fc6d40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.276+0000 7fc6da6f4700 1 -- 172.21.15.152:0/842013697 shutdown_connections 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.276+0000 7fc6da6f4700 1 -- 172.21.15.152:0/842013697 wait complete. 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6da6f4700 1 Processor -- start 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6da6f4700 1 -- start start 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6da6f4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6da6f4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6da6f4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d410eab0 con 0x7fc6d40fd150 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6da6f4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d410ebf0 con 0x7fc6d40fc7f0 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6cbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6cbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47192/0 (socket says 172.21.15.152:47192) 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6cbfff700 1 -- 172.21.15.152:0/506465924 learned_addr learned my addr 172.21.15.152:0/506465924 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.277+0000 7fc6d3fff700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:56.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6cbfff700 1 -- 172.21.15.152:0/506465924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 msgr2=0x7fc6d410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6d3fff700 1 -- 172.21.15.152:0/506465924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 msgr2=0x7fc6d410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6d3fff700 1 -- 172.21.15.152:0/506465924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 msgr2=0x7fc6d410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6d3fff700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6d3fff700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410dfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6cbfff700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410dfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6cbfff700 1 -- 172.21.15.152:0/506465924 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc005040 con 0x7fc6d40fd150 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6cbfff700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc6bc0099f0 tx=0x7fc6bc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6d1ffb700 1 -- 172.21.15.152:0/506465924 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6bc00e030 con 0x7fc6d40fd150 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6d1ffb700 1 -- 172.21.15.152:0/506465924 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6bc007e90 con 0x7fc6d40fd150 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6d1ffb700 1 -- 172.21.15.152:0/506465924 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6bc018070 con 0x7fc6d40fd150 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d4108220 con 0x7fc6d40fd150 2024-04-06T12:27:56.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.278+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d4108780 con 0x7fc6d40fd150 2024-04-06T12:27:56.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.279+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d405f590 con 0x7fc6d40fd150 2024-04-06T12:27:56.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.279+0000 7fc6d1ffb700 1 -- 172.21.15.152:0/506465924 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fc6bc009590 con 0x7fc6d40fd150 2024-04-06T12:27:56.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.280+0000 7fc6d1ffb700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc6c006cb60 0x7fc6c006f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:56.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.280+0000 7fc6d1ffb700 1 -- 172.21.15.152:0/506465924 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fc6bc08d210 con 0x7fc6d40fd150 2024-04-06T12:27:56.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.280+0000 7fc6d3fff700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc6c006cb60 0x7fc6c006f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:56.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.280+0000 7fc6d3fff700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc6c006cb60 0x7fc6c006f020 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fc6c4009fd0 tx=0x7fc6c4009d90).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:56.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.285+0000 7fc6d1ffb700 1 -- 172.21.15.152:0/506465924 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fc6bc05ac00 con 0x7fc6d40fd150 2024-04-06T12:27:56.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.490+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6d4108e10 con 0x7fc6c006cb60 2024-04-06T12:27:56.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.491+0000 7fc6d1ffb700 1 -- 172.21.15.152:0/506465924 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fc6d4108e10 con 0x7fc6c006cb60 2024-04-06T12:27:56.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc6c006cb60 msgr2=0x7fc6c006f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:56.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc6c006cb60 0x7fc6c006f020 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fc6c4009fd0 tx=0x7fc6c4009d90).stop 2024-04-06T12:27:56.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 msgr2=0x7fc6d410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:56.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc6bc0099f0 tx=0x7fc6bc009cb0).stop 2024-04-06T12:27:56.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 shutdown_connections 2024-04-06T12:27:56.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc6c006cb60 0x7fc6c006f020 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 --2- 172.21.15.152:0/506465924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e4b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 >> 172.21.15.152:0/506465924 conn(0x7fc6d4070590 msgr2=0x7fc6d4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:56.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 shutdown_connections 2024-04-06T12:27:56.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.493+0000 7fc6da6f4700 1 -- 172.21.15.152:0/506465924 wait complete. 2024-04-06T12:27:56.501 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:27:56.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.593+0000 7f2a6c22c700 1 -- 172.21.15.152:0/721076306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 msgr2=0x7f2a640f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:56.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.593+0000 7f2a6c22c700 1 --2- 172.21.15.152:0/721076306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 0x7f2a640f8d10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2a540047f0 tx=0x7f2a54009cb0).stop 2024-04-06T12:27:56.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.593+0000 7f2a6c22c700 1 -- 172.21.15.152:0/721076306 shutdown_connections 2024-04-06T12:27:56.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.593+0000 7f2a6c22c700 1 --2- 172.21.15.152:0/721076306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 0x7f2a641019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.593+0000 7f2a6c22c700 1 --2- 172.21.15.152:0/721076306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 0x7f2a640f8d10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.593+0000 7f2a6c22c700 1 -- 172.21.15.152:0/721076306 >> 172.21.15.152:0/721076306 conn(0x7f2a640f2400 msgr2=0x7f2a640f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:56.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.593+0000 7f2a6c22c700 1 -- 172.21.15.152:0/721076306 shutdown_connections 2024-04-06T12:27:56.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.593+0000 7f2a6c22c700 1 -- 172.21.15.152:0/721076306 wait complete. 2024-04-06T12:27:56.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a6c22c700 1 Processor -- start 2024-04-06T12:27:56.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a6c22c700 1 -- start start 2024-04-06T12:27:56.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a6c22c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 0x7f2a6410e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a6c22c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 0x7f2a6410e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a6c22c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6410eb00 con 0x7f2a640f8930 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a6c22c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6410ec40 con 0x7f2a640f9290 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a69fc8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 0x7f2a6410e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a69fc8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 0x7f2a6410e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47208/0 (socket says 172.21.15.152:47208) 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a69fc8700 1 -- 172.21.15.152:0/675144297 learned_addr learned my addr 172.21.15.152:0/675144297 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a697c7700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 0x7f2a6410e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a697c7700 1 -- 172.21.15.152:0/675144297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 msgr2=0x7f2a6410e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a697c7700 1 -- 172.21.15.152:0/675144297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 msgr2=0x7f2a6410e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a697c7700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 0x7f2a6410e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a697c7700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 0x7f2a6410e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:27:56.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a69fc8700 1 -- 172.21.15.152:0/675144297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 msgr2=0x7f2a6410e500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a69fc8700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 0x7f2a6410e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a69fc8700 1 -- 172.21.15.152:0/675144297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54005040 con 0x7f2a640f8930 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a69fc8700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 0x7f2a6410e010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2a54009380 tx=0x7f2a54009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.594+0000 7f2a5affd700 1 -- 172.21.15.152:0/675144297 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a5400e070 con 0x7f2a640f8930 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.595+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a64108270 con 0x7f2a640f8930 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.595+0000 7f2a5affd700 1 -- 172.21.15.152:0/675144297 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a54007e90 con 0x7f2a640f8930 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.595+0000 7f2a5affd700 1 -- 172.21.15.152:0/675144297 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a54018070 con 0x7f2a640f8930 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.595+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a64108750 con 0x7f2a640f8930 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.595+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6405f090 con 0x7f2a640f8930 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.596+0000 7f2a5affd700 1 -- 172.21.15.152:0/675144297 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f2a5401d420 con 0x7f2a640f8930 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.596+0000 7f2a5affd700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f2a5006cbc0 0x7f2a5006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.597+0000 7f2a697c7700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f2a5006cbc0 0x7f2a5006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.597+0000 7f2a5affd700 1 -- 172.21.15.152:0/675144297 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f2a5408cb50 con 0x7f2a640f8930 2024-04-06T12:27:56.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.597+0000 7f2a697c7700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f2a5006cbc0 0x7f2a5006f080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2a60009fd0 tx=0x7f2a60009df0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:56.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.601+0000 7f2a5affd700 1 -- 172.21.15.152:0/675144297 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f2a5405a540 con 0x7f2a640f8930 2024-04-06T12:27:56.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.804+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a640fee60 con 0x7f2a5006cbc0 2024-04-06T12:27:56.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.805+0000 7f2a5affd700 1 -- 172.21.15.152:0/675144297 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f2a640fee60 con 0x7f2a5006cbc0 2024-04-06T12:27:56.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f2a5006cbc0 msgr2=0x7f2a5006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:56.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f2a5006cbc0 0x7f2a5006f080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2a60009fd0 tx=0x7f2a60009df0).stop 2024-04-06T12:27:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 msgr2=0x7f2a6410e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 0x7f2a6410e010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2a54009380 tx=0x7f2a54009cb0).stop 2024-04-06T12:27:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 shutdown_connections 2024-04-06T12:27:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f2a5006cbc0 0x7f2a5006f080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a640f8930 0x7f2a6410e010 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 --2- 172.21.15.152:0/675144297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a640f9290 0x7f2a6410e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 >> 172.21.15.152:0/675144297 conn(0x7f2a640f2400 msgr2=0x7f2a640fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 shutdown_connections 2024-04-06T12:27:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.808+0000 7f2a6c22c700 1 -- 172.21.15.152:0/675144297 wait complete. 2024-04-06T12:27:56.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.906+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/2139223529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 msgr2=0x7f8cd80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:56.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.906+0000 7f8cdeb3e700 1 --2- 172.21.15.152:0/2139223529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 0x7f8cd80fcbd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8ccc0047f0 tx=0x7f8ccc009cb0).stop 2024-04-06T12:27:56.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.906+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/2139223529 shutdown_connections 2024-04-06T12:27:56.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.906+0000 7f8cdeb3e700 1 --2- 172.21.15.152:0/2139223529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd80fd150 0x7f8cd80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.906+0000 7f8cdeb3e700 1 --2- 172.21.15.152:0/2139223529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 0x7f8cd80fcbd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.906+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/2139223529 >> 172.21.15.152:0/2139223529 conn(0x7f8cd8070590 msgr2=0x7f8cd80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:56.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.906+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/2139223529 shutdown_connections 2024-04-06T12:27:56.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.906+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/2139223529 wait complete. 2024-04-06T12:27:56.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.907+0000 7f8cdeb3e700 1 Processor -- start 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.907+0000 7f8cdeb3e700 1 -- start start 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.907+0000 7f8cdeb3e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 0x7f8cd81090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.907+0000 7f8cdeb3e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd80fd150 0x7f8cd81095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.907+0000 7f8cdeb3e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8109ac0 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.907+0000 7f8cdeb3e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8109c00 con 0x7f8cd80fd150 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.907+0000 7f8cdc8da700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 0x7f8cd81090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.907+0000 7f8cdc8da700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 0x7f8cd81090e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47222/0 (socket says 172.21.15.152:47222) 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.907+0000 7f8cdc8da700 1 -- 172.21.15.152:0/786044226 learned_addr learned my addr 172.21.15.152:0/786044226 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cd7fff700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd80fd150 0x7f8cd81095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cdc8da700 1 -- 172.21.15.152:0/786044226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd80fd150 msgr2=0x7f8cd81095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cdc8da700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd80fd150 0x7f8cd81095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cdc8da700 1 -- 172.21.15.152:0/786044226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc005040 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cdc8da700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 0x7f8cd81090e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8ccc005010 tx=0x7f8ccc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:56.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cd5ffb700 1 -- 172.21.15.152:0/786044226 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc00e030 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cd5ffb700 1 -- 172.21.15.152:0/786044226 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ccc007e90 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cd5ffb700 1 -- 172.21.15.152:0/786044226 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc018070 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd8109e50 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.908+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd8112440 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.909+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd805f590 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.909+0000 7f8cd5ffb700 1 -- 172.21.15.152:0/786044226 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f8ccc01d6e0 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.910+0000 7f8cd5ffb700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8cc806cbc0 0x7f8cc806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:56.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.910+0000 7f8cd5ffb700 1 -- 172.21.15.152:0/786044226 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f8ccc08d1f0 con 0x7f8cd80fc7f0 2024-04-06T12:27:56.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.910+0000 7f8cd7fff700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8cc806cbc0 0x7f8cc806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:56.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.910+0000 7f8cd7fff700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8cc806cbc0 0x7f8cc806f080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8cc4009fd0 tx=0x7f8cc4009df0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:56.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:56.915+0000 7f8cd5ffb700 1 -- 172.21.15.152:0/786044226 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f8ccc05abe0 con 0x7f8cd80fc7f0 2024-04-06T12:27:57.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.112+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cd8059120 con 0x7f8cc806cbc0 2024-04-06T12:27:57.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.122+0000 7f8cd5ffb700 1 -- 172.21.15.152:0/786044226 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8cd8059120 con 0x7f8cc806cbc0 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (100s) 15s ago 13m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (13m) 15s ago 13m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (12m) 16s ago 12m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (84s) 15s ago 12m 83.0M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (7m) 15s ago 7m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (7m) 15s ago 7m 162M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (7m) 16s ago 7m 14.3M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (7m) 16s ago 7m 15.0M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (3m) 15s ago 14m 471M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:27:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (2m) 16s ago 12m 445M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (28s) 15s ago 14m 27.3M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 starting - - - 2048M 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 15s ago 12m 16.7M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 16s ago 12m 16.4M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (11m) 15s ago 11m 203M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (11m) 15s ago 11m 217M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (10m) 15s ago 10m 179M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (10m) 16s ago 10m 229M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (9m) 16s ago 9m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (9m) 16s ago 9m 195M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:27:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (115s) 16s ago 12m 53.5M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:27:57.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8cc806cbc0 msgr2=0x7f8cc806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8cc806cbc0 0x7f8cc806f080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8cc4009fd0 tx=0x7f8cc4009df0).stop 2024-04-06T12:27:57.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 msgr2=0x7f8cd81090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 0x7f8cd81090e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8ccc005010 tx=0x7f8ccc009cb0).stop 2024-04-06T12:27:57.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 shutdown_connections 2024-04-06T12:27:57.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8cc806cbc0 0x7f8cc806f080 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cd80fc7f0 0x7f8cd81090e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 --2- 172.21.15.152:0/786044226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd80fd150 0x7f8cd81095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 >> 172.21.15.152:0/786044226 conn(0x7f8cd8070590 msgr2=0x7f8cd80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:57.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 shutdown_connections 2024-04-06T12:27:57.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.124+0000 7f8cdeb3e700 1 -- 172.21.15.152:0/786044226 wait complete. 2024-04-06T12:27:57.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.225+0000 7f42f6258700 1 -- 172.21.15.152:0/488631789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 msgr2=0x7f42f00fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.225+0000 7f42f6258700 1 --2- 172.21.15.152:0/488631789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 0x7f42f00fcbd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f42d8004810 tx=0x7f42d8009cb0).stop 2024-04-06T12:27:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.225+0000 7f42f6258700 1 -- 172.21.15.152:0/488631789 shutdown_connections 2024-04-06T12:27:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.225+0000 7f42f6258700 1 --2- 172.21.15.152:0/488631789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f00fd150 0x7f42f00f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.225+0000 7f42f6258700 1 --2- 172.21.15.152:0/488631789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 0x7f42f00fcbd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.225+0000 7f42f6258700 1 -- 172.21.15.152:0/488631789 >> 172.21.15.152:0/488631789 conn(0x7f42f00f23b0 msgr2=0x7f42f00f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.225+0000 7f42f6258700 1 -- 172.21.15.152:0/488631789 shutdown_connections 2024-04-06T12:27:57.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.225+0000 7f42f6258700 1 -- 172.21.15.152:0/488631789 wait complete. 2024-04-06T12:27:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.225+0000 7f42f6258700 1 Processor -- start 2024-04-06T12:27:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42f6258700 1 -- start start 2024-04-06T12:27:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42f6258700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 0x7f42f01103d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42f6258700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f00fd150 0x7f42f01108c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42f6258700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f0110ec0 con 0x7f42f00fc7f0 2024-04-06T12:27:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42f6258700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f0111000 con 0x7f42f00fd150 2024-04-06T12:27:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ef7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 0x7f42f01103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ef7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 0x7f42f01103d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47236/0 (socket says 172.21.15.152:47236) 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ef7fe700 1 -- 172.21.15.152:0/3830264691 learned_addr learned my addr 172.21.15.152:0/3830264691 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42eeffd700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f00fd150 0x7f42f01108c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ef7fe700 1 -- 172.21.15.152:0/3830264691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f00fd150 msgr2=0x7f42f01108c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ef7fe700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f00fd150 0x7f42f01108c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ef7fe700 1 -- 172.21.15.152:0/3830264691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8005040 con 0x7f42f00fc7f0 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42eeffd700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f00fd150 0x7f42f01108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ef7fe700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 0x7f42f01103d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f42d8000c00 tx=0x7f42d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ecff9700 1 -- 172.21.15.152:0/3830264691 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d80094c0 con 0x7f42f00fc7f0 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ecff9700 1 -- 172.21.15.152:0/3830264691 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f42d8004290 con 0x7f42f00fc7f0 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f010a630 con 0x7f42f00fc7f0 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42ecff9700 1 -- 172.21.15.152:0/3830264691 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42d800f450 con 0x7f42f00fc7f0 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.226+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f010ab10 con 0x7f42f00fc7f0 2024-04-06T12:27:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.227+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f0060390 con 0x7f42f00fc7f0 2024-04-06T12:27:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.228+0000 7f42ecff9700 1 -- 172.21.15.152:0/3830264691 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f42d8018040 con 0x7f42f00fc7f0 2024-04-06T12:27:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.228+0000 7f42ecff9700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f42dc06cbc0 0x7f42dc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.228+0000 7f42eeffd700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f42dc06cbc0 0x7f42dc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.228+0000 7f42ecff9700 1 -- 172.21.15.152:0/3830264691 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f42d808cf20 con 0x7f42f00fc7f0 2024-04-06T12:27:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.229+0000 7f42eeffd700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f42dc06cbc0 0x7f42dc06f080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f42f010bd10 tx=0x7f42e000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:57.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.233+0000 7f42ecff9700 1 -- 172.21.15.152:0/3830264691 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f42d80c02c0 con 0x7f42f00fc7f0 2024-04-06T12:27:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.499+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f42f010bb40 con 0x7f42f00fc7f0 2024-04-06T12:27:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.499+0000 7f42ecff9700 1 -- 172.21.15.152:0/3830264691 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f42d805a9d0 con 0x7f42f00fc7f0 2024-04-06T12:27:57.497 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:27:57.497 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:27:57.497 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:27:57.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 10, 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 4 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:27:57.498 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:27:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.501+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f42dc06cbc0 msgr2=0x7f42dc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.501+0000 7f42f6258700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f42dc06cbc0 0x7f42dc06f080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f42f010bd10 tx=0x7f42e000b040).stop 2024-04-06T12:27:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.501+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 msgr2=0x7f42f01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.501+0000 7f42f6258700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 0x7f42f01103d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f42d8000c00 tx=0x7f42d8009cb0).stop 2024-04-06T12:27:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.501+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 shutdown_connections 2024-04-06T12:27:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.501+0000 7f42f6258700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f42dc06cbc0 0x7f42dc06f080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.501+0000 7f42f6258700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42f00fc7f0 0x7f42f01103d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.501+0000 7f42f6258700 1 --2- 172.21.15.152:0/3830264691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f00fd150 0x7f42f01108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.501+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 >> 172.21.15.152:0/3830264691 conn(0x7f42f00f23b0 msgr2=0x7f42f00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:57.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.502+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 shutdown_connections 2024-04-06T12:27:57.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.502+0000 7f42f6258700 1 -- 172.21.15.152:0/3830264691 wait complete. 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.600+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2492344754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fe230 msgr2=0x7fb6e00f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.600+0000 7fb6e4d91700 1 --2- 172.21.15.152:0/2492344754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fe230 0x7fb6e00f5f80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb6d00047f0 tx=0x7fb6d0009cb0).stop 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.600+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2492344754 shutdown_connections 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.600+0000 7fb6e4d91700 1 --2- 172.21.15.152:0/2492344754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fe230 0x7fb6e00f5f80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.600+0000 7fb6e4d91700 1 --2- 172.21.15.152:0/2492344754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fd8d0 0x7fb6e00fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.600+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2492344754 >> 172.21.15.152:0/2492344754 conn(0x7fb6e006cea0 msgr2=0x7fb6e006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.600+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2492344754 shutdown_connections 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.600+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2492344754 wait complete. 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6e4d91700 1 Processor -- start 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6e4d91700 1 -- start start 2024-04-06T12:27:57.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6e4d91700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fd8d0 0x7fb6e010e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6e4d91700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fe230 0x7fb6e010e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6e4d91700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e010ebc0 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6e4d91700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e010ed00 con 0x7fb6e00fe230 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6de59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fd8d0 0x7fb6e010e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6de59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fd8d0 0x7fb6e010e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47248/0 (socket says 172.21.15.152:47248) 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6de59c700 1 -- 172.21.15.152:0/2863967725 learned_addr learned my addr 172.21.15.152:0/2863967725 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6ddd9b700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fe230 0x7fb6e010e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6ddd9b700 1 -- 172.21.15.152:0/2863967725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fe230 msgr2=0x7fb6e010e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6ddd9b700 1 -- 172.21.15.152:0/2863967725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fe230 msgr2=0x7fb6e010e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6ddd9b700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fe230 0x7fb6e010e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6ddd9b700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fe230 0x7fb6e010e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:27:57.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6de59c700 1 -- 172.21.15.152:0/2863967725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fe230 msgr2=0x7fb6e010e5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-06T12:27:57.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6de59c700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fe230 0x7fb6e010e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.601+0000 7fb6de59c700 1 -- 172.21.15.152:0/2863967725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0005040 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.602+0000 7fb6de59c700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fd8d0 0x7fb6e010e0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb6d400c790 tx=0x7fb6d400cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:57.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.602+0000 7fb6cf7fe700 1 -- 172.21.15.152:0/2863967725 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d40106f0 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.602+0000 7fb6cf7fe700 1 -- 172.21.15.152:0/2863967725 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb6d4010d00 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.602+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e0108390 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.602+0000 7fb6cf7fe700 1 -- 172.21.15.152:0/2863967725 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d4012e50 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.602+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e01088d0 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.603+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e0047540 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.603+0000 7fb6cf7fe700 1 -- 172.21.15.152:0/2863967725 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fb6d4010850 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.603+0000 7fb6cf7fe700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb6c806cbc0 0x7fb6c806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:57.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.603+0000 7fb6cf7fe700 1 -- 172.21.15.152:0/2863967725 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fb6d408b710 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.604+0000 7fb6ddd9b700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb6c806cbc0 0x7fb6c806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:57.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.604+0000 7fb6ddd9b700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb6c806cbc0 0x7fb6c806f080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb6d0004f10 tx=0x7fb6d000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:57.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.608+0000 7fb6cf7fe700 1 -- 172.21.15.152:0/2863967725 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fb6d4059210 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.837+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb6e0109780 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.838+0000 7fb6cf7fe700 1 -- 172.21.15.152:0/2863967725 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fb6d4016770 con 0x7fb6e00fd8d0 2024-04-06T12:27:57.836 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:27:57.836 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:27:57.836 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:27:57.836 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:27:57.836 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:27:57.836 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:27:57.836 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:27:57.836 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:27:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:57.839 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:27:57.839 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:27:57.839 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:27:57.839 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:27:57.839 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:57.839 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb6c806cbc0 msgr2=0x7fb6c806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb6c806cbc0 0x7fb6c806f080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb6d0004f10 tx=0x7fb6d000b040).stop 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fd8d0 msgr2=0x7fb6e010e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fd8d0 0x7fb6e010e0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb6d400c790 tx=0x7fb6d400cb50).stop 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 shutdown_connections 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb6c806cbc0 0x7fb6c806f080 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e00fd8d0 0x7fb6e010e0d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 --2- 172.21.15.152:0/2863967725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6e00fe230 0x7fb6e010e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 >> 172.21.15.152:0/2863967725 conn(0x7fb6e006cea0 msgr2=0x7fb6e0100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 shutdown_connections 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.840+0000 7fb6e4d91700 1 -- 172.21.15.152:0/2863967725 wait complete. 2024-04-06T12:27:57.840 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:27:57.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 -- 172.21.15.152:0/1421583120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 msgr2=0x7f4cc40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 --2- 172.21.15.152:0/1421583120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 0x7f4cc40fcbd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4cb40047f0 tx=0x7f4cb4009cb0).stop 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 -- 172.21.15.152:0/1421583120 shutdown_connections 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 --2- 172.21.15.152:0/1421583120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 0x7f4cc40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 --2- 172.21.15.152:0/1421583120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 0x7f4cc40fcbd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 -- 172.21.15.152:0/1421583120 >> 172.21.15.152:0/1421583120 conn(0x7f4cc4070590 msgr2=0x7f4cc40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 -- 172.21.15.152:0/1421583120 shutdown_connections 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 -- 172.21.15.152:0/1421583120 wait complete. 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 Processor -- start 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.940+0000 7f4ccc38c700 1 -- start start 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4ccc38c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 0x7f4cc41101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4ccc38c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 0x7f4cc41106e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:57.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4ccc38c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4110ce0 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4ccc38c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4110e20 con 0x7f4cc40fd150 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cca128700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 0x7f4cc41101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cca128700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 0x7f4cc41101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47264/0 (socket says 172.21.15.152:47264) 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cca128700 1 -- 172.21.15.152:0/2138615702 learned_addr learned my addr 172.21.15.152:0/2138615702 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cc9927700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 0x7f4cc41106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cc9927700 1 -- 172.21.15.152:0/2138615702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 msgr2=0x7f4cc41106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cc9927700 1 -- 172.21.15.152:0/2138615702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 msgr2=0x7f4cc41106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cc9927700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 0x7f4cc41106e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cca128700 1 -- 172.21.15.152:0/2138615702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 msgr2=0x7f4cc41106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:57.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cc9927700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 0x7f4cc41106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-06T12:27:57.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cca128700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 0x7f4cc41106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:57.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cca128700 1 -- 172.21.15.152:0/2138615702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb4005040 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cca128700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 0x7f4cc41101f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4cb40043a0 tx=0x7f4cb4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:57.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cbb7fe700 1 -- 172.21.15.152:0/2138615702 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cb400e030 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc410a450 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cbb7fe700 1 -- 172.21.15.152:0/2138615702 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4cb4007e90 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4cbb7fe700 1 -- 172.21.15.152:0/2138615702 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cb4018070 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.941+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc410a9b0 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.942+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc405f590 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.943+0000 7f4cbb7fe700 1 -- 172.21.15.152:0/2138615702 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f4cb4009590 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.943+0000 7f4cbb7fe700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cb006cb50 0x7f4cb006f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:57.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.943+0000 7f4cbb7fe700 1 -- 172.21.15.152:0/2138615702 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f4cb408d290 con 0x7f4cc40fc7f0 2024-04-06T12:27:57.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.943+0000 7f4cc9927700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cb006cb50 0x7f4cb006f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:57.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.944+0000 7f4cc9927700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cb006cb50 0x7f4cb006f010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4cc0009fd0 tx=0x7f4cc0009df0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:57.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:57.948+0000 7f4cbb7fe700 1 -- 172.21.15.152:0/2138615702 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f4cb405ac80 con 0x7f4cc40fc7f0 2024-04-06T12:27:58.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.162+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cc410b040 con 0x7f4cb006cb50 2024-04-06T12:27:58.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.163+0000 7f4cbb7fe700 1 -- 172.21.15.152:0/2138615702 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4cc410b040 con 0x7f4cb006cb50 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: "mon" 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "4/21 daemons upgraded", 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading mon daemons", 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:27:58.161 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cb006cb50 msgr2=0x7f4cb006f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cb006cb50 0x7f4cb006f010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4cc0009fd0 tx=0x7f4cc0009df0).stop 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 msgr2=0x7f4cc41101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 0x7f4cc41101f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4cb40043a0 tx=0x7f4cb4009cb0).stop 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 shutdown_connections 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cb006cb50 0x7f4cb006f010 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc40fc7f0 0x7f4cc41101f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 --2- 172.21.15.152:0/2138615702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cc40fd150 0x7f4cc41106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 >> 172.21.15.152:0/2138615702 conn(0x7f4cc4070590 msgr2=0x7f4cc4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 shutdown_connections 2024-04-06T12:27:58.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.165+0000 7f4ccc38c700 1 -- 172.21.15.152:0/2138615702 wait complete. 2024-04-06T12:27:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 -- 172.21.15.152:0/622254709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 msgr2=0x7f4d680fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 --2- 172.21.15.152:0/622254709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 0x7f4d680fcbd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4d5c0047f0 tx=0x7f4d5c009cb0).stop 2024-04-06T12:27:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 -- 172.21.15.152:0/622254709 shutdown_connections 2024-04-06T12:27:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 --2- 172.21.15.152:0/622254709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d680fd150 0x7f4d680f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 --2- 172.21.15.152:0/622254709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 0x7f4d680fcbd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 -- 172.21.15.152:0/622254709 >> 172.21.15.152:0/622254709 conn(0x7f4d68070590 msgr2=0x7f4d680f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 -- 172.21.15.152:0/622254709 shutdown_connections 2024-04-06T12:27:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 -- 172.21.15.152:0/622254709 wait complete. 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 Processor -- start 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.265+0000 7f4d6c9db700 1 -- start start 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6c9db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 0x7f4d68107040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6c9db700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d680fd150 0x7f4d68107530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6c9db700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680614e0 con 0x7f4d680fc7f0 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6c9db700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68107a20 con 0x7f4d680fd150 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 0x7f4d68107040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 0x7f4d68107040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47292/0 (socket says 172.21.15.152:47292) 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6659c700 1 -- 172.21.15.152:0/221824404 learned_addr learned my addr 172.21.15.152:0/221824404 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d65d9b700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d680fd150 0x7f4d68107530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6659c700 1 -- 172.21.15.152:0/221824404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d680fd150 msgr2=0x7f4d68107530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:58.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6659c700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d680fd150 0x7f4d68107530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6659c700 1 -- 172.21.15.152:0/221824404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c005040 con 0x7f4d680fc7f0 2024-04-06T12:27:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6659c700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 0x7f4d68107040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4d5c009380 tx=0x7f4d5c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d577fe700 1 -- 172.21.15.152:0/221824404 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d5c018070 con 0x7f4d680fc7f0 2024-04-06T12:27:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d577fe700 1 -- 172.21.15.152:0/221824404 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d5c007e90 con 0x7f4d680fc7f0 2024-04-06T12:27:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d68107c70 con 0x7f4d680fc7f0 2024-04-06T12:27:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d577fe700 1 -- 172.21.15.152:0/221824404 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d5c0123c0 con 0x7f4d680fc7f0 2024-04-06T12:27:58.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.266+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d68114870 con 0x7f4d680fc7f0 2024-04-06T12:27:58.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.267+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6805f590 con 0x7f4d680fc7f0 2024-04-06T12:27:58.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.268+0000 7f4d577fe700 1 -- 172.21.15.152:0/221824404 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f4d5c012520 con 0x7f4d680fc7f0 2024-04-06T12:27:58.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.268+0000 7f4d577fe700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4d5006cbc0 0x7f4d5006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:27:58.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.268+0000 7f4d577fe700 1 -- 172.21.15.152:0/221824404 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f4d5c08ca80 con 0x7f4d680fc7f0 2024-04-06T12:27:58.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.268+0000 7f4d65d9b700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4d5006cbc0 0x7f4d5006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:27:58.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.268+0000 7f4d65d9b700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4d5006cbc0 0x7f4d5006f080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4d681091a0 tx=0x7f4d5800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:27:58.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.272+0000 7f4d577fe700 1 -- 172.21.15.152:0/221824404 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f4d5c0569e0 con 0x7f4d680fc7f0 2024-04-06T12:27:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:58 smithi152 ceph-mon[104634]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:58 smithi152 ceph-mon[104634]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:58 smithi152 ceph-mon[104634]: pgmap v13: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:58 smithi152 ceph-mon[104634]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:58 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3830264691' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:58 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2863967725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:27:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:58.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:58.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.539+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4d68060cc0 con 0x7f4d680fc7f0 2024-04-06T12:27:58.536 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.540+0000 7f4d577fe700 1 -- 172.21.15.152:0/221824404 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4d5c05a000 con 0x7f4d680fc7f0 2024-04-06T12:27:58.536 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:58.537 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:27:58.537 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4d5006cbc0 msgr2=0x7f4d5006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4d5006cbc0 0x7f4d5006f080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4d681091a0 tx=0x7f4d5800b040).stop 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 msgr2=0x7f4d68107040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 0x7f4d68107040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4d5c009380 tx=0x7f4d5c009cb0).stop 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 shutdown_connections 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4d5006cbc0 0x7f4d5006f080 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d680fc7f0 0x7f4d68107040 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 --2- 172.21.15.152:0/221824404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d680fd150 0x7f4d68107530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 >> 172.21.15.152:0/221824404 conn(0x7f4d68070590 msgr2=0x7f4d680fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 shutdown_connections 2024-04-06T12:27:58.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:27:58.542+0000 7f4d6c9db700 1 -- 172.21.15.152:0/221824404 wait complete. 2024-04-06T12:27:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:58 smithi195 ceph-mon[85980]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:58 smithi195 ceph-mon[85980]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:58 smithi195 ceph-mon[85980]: pgmap v13: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:27:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:58 smithi195 ceph-mon[85980]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:58 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3830264691' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:27:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:58 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2863967725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:27:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:59.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:59 smithi195 ceph-mon[85980]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:59.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:59 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/221824404' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:27:59.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:59 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:59.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:27:59 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:59.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:59 smithi152 ceph-mon[104634]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:27:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:59 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/221824404' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:27:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:59 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:27:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:27:59 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:00.119 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:00 smithi195 ceph-mon[85980]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:00.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:00 smithi152 ceph-mon[104634]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:02 smithi195 ceph-mon[85980]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:02 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:02 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:02 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:02 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:28:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:02 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:02 smithi152 ceph-mon[104634]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:02 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:02.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:02 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:02.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:02 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:02.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:02 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:28:02.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:02 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:03.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:03 smithi152 ceph-mon[104634]: Detected new or changed devices on smithi195 2024-04-06T12:28:03.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:03 smithi152 ceph-mon[104634]: Reconfiguring mon.smithi152 (monmap changed)... 2024-04-06T12:28:03.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:03 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:28:03.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:03 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:28:03.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:03 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:03.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:03 smithi152 ceph-mon[104634]: Reconfiguring daemon mon.smithi152 on smithi152 2024-04-06T12:28:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:03 smithi195 ceph-mon[85980]: Detected new or changed devices on smithi195 2024-04-06T12:28:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:03 smithi195 ceph-mon[85980]: Reconfiguring mon.smithi152 (monmap changed)... 2024-04-06T12:28:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:03 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:28:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:03 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:28:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:03 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:03.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:03 smithi195 ceph-mon[85980]: Reconfiguring daemon mon.smithi152 on smithi152 2024-04-06T12:28:04.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:04 smithi152 ceph-mon[104634]: pgmap v16: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:04.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:04 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:04.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:04 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:04.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:04 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.lynahm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:28:04.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:04 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:28:04.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:04 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:04.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:04 smithi195 ceph-mon[85980]: pgmap v16: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:04.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:04 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:04.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:04 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:04.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:04 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.lynahm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:28:04.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:04 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:28:04.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:04 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:05.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:05 smithi152 ceph-mon[104634]: Reconfiguring mgr.smithi152.lynahm (monmap changed)... 2024-04-06T12:28:05.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:05 smithi152 ceph-mon[104634]: Reconfiguring daemon mgr.smithi152.lynahm on smithi152 2024-04-06T12:28:05.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:05 smithi195 ceph-mon[85980]: Reconfiguring mgr.smithi152.lynahm (monmap changed)... 2024-04-06T12:28:05.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:05 smithi195 ceph-mon[85980]: Reconfiguring daemon mgr.smithi152.lynahm on smithi152 2024-04-06T12:28:06.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:06 smithi152 ceph-mon[104634]: pgmap v17: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-06T12:28:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:28:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:06 smithi195 ceph-mon[85980]: pgmap v17: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-06T12:28:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:28:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:07.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:07 smithi152 ceph-mon[104634]: Reconfiguring crash.smithi152 (monmap changed)... 2024-04-06T12:28:07.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:07 smithi152 ceph-mon[104634]: Reconfiguring daemon crash.smithi152 on smithi152 2024-04-06T12:28:07.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:07.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:07.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-06T12:28:07.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:07.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:28:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:07 smithi195 ceph-mon[85980]: Reconfiguring crash.smithi152 (monmap changed)... 2024-04-06T12:28:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:07 smithi195 ceph-mon[85980]: Reconfiguring daemon crash.smithi152 on smithi152 2024-04-06T12:28:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-06T12:28:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:28:08.464 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:08 smithi152 ceph-mon[104634]: Reconfiguring osd.0 (monmap changed)... 2024-04-06T12:28:08.464 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:08 smithi152 ceph-mon[104634]: Reconfiguring daemon osd.0 on smithi152 2024-04-06T12:28:08.464 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:08 smithi152 ceph-mon[104634]: pgmap v18: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:08 smithi195 ceph-mon[85980]: Reconfiguring osd.0 (monmap changed)... 2024-04-06T12:28:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:08 smithi195 ceph-mon[85980]: Reconfiguring daemon osd.0 on smithi152 2024-04-06T12:28:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:08 smithi195 ceph-mon[85980]: pgmap v18: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:10.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:10.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:10.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:09 smithi152 ceph-mon[104634]: Reconfiguring osd.1 (monmap changed)... 2024-04-06T12:28:10.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-06T12:28:10.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:10.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:09 smithi152 ceph-mon[104634]: Reconfiguring daemon osd.1 on smithi152 2024-04-06T12:28:10.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:09 smithi152 ceph-mon[104634]: pgmap v19: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:10.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:10.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:10.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:09 smithi195 ceph-mon[85980]: Reconfiguring osd.1 (monmap changed)... 2024-04-06T12:28:10.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-06T12:28:10.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:10.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:09 smithi195 ceph-mon[85980]: Reconfiguring daemon osd.1 on smithi152 2024-04-06T12:28:10.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:09 smithi195 ceph-mon[85980]: pgmap v19: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:11.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:11 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:11.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:11 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:11.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:11 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-06T12:28:11.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:11 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:11.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:11 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:11 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:11 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-06T12:28:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:11 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:12 smithi152 ceph-mon[104634]: Reconfiguring osd.2 (monmap changed)... 2024-04-06T12:28:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:12 smithi152 ceph-mon[104634]: Reconfiguring daemon osd.2 on smithi152 2024-04-06T12:28:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:12 smithi152 ceph-mon[104634]: pgmap v20: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:12 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:12 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:12 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.spbxnv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:28:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:12 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:12 smithi195 ceph-mon[85980]: Reconfiguring osd.2 (monmap changed)... 2024-04-06T12:28:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:12 smithi195 ceph-mon[85980]: Reconfiguring daemon osd.2 on smithi152 2024-04-06T12:28:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:12 smithi195 ceph-mon[85980]: pgmap v20: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:12 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:12 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:12 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.spbxnv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:28:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:12 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:13.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:13 smithi152 ceph-mon[104634]: Reconfiguring mds.cephfs.smithi152.spbxnv (monmap changed)... 2024-04-06T12:28:13.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:13 smithi152 ceph-mon[104634]: Reconfiguring daemon mds.cephfs.smithi152.spbxnv on smithi152 2024-04-06T12:28:13.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:13 smithi152 ceph-mon[104634]: pgmap v21: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:13.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:13 smithi195 ceph-mon[85980]: Reconfiguring mds.cephfs.smithi152.spbxnv (monmap changed)... 2024-04-06T12:28:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:13 smithi195 ceph-mon[85980]: Reconfiguring daemon mds.cephfs.smithi152.spbxnv on smithi152 2024-04-06T12:28:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:13 smithi195 ceph-mon[85980]: pgmap v21: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:14.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:14 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:14.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:14 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:14.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:14 smithi152 ceph-mon[104634]: Reconfiguring mds.cephfs.smithi152.mxtfph (monmap changed)... 2024-04-06T12:28:14.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:14 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mxtfph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:28:14.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:14 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:14.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:14 smithi152 ceph-mon[104634]: Reconfiguring daemon mds.cephfs.smithi152.mxtfph on smithi152 2024-04-06T12:28:14.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:14 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:14.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:14 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:14.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:14 smithi195 ceph-mon[85980]: Reconfiguring mds.cephfs.smithi152.mxtfph (monmap changed)... 2024-04-06T12:28:14.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:14 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mxtfph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:28:14.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:14 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:14.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:14 smithi195 ceph-mon[85980]: Reconfiguring daemon mds.cephfs.smithi152.mxtfph on smithi152 2024-04-06T12:28:16.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:15 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:16.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:15 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:16.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:15 smithi152 ceph-mon[104634]: Reconfiguring crash.smithi195 (monmap changed)... 2024-04-06T12:28:16.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:15 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:28:16.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:15 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:16.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:15 smithi152 ceph-mon[104634]: Reconfiguring daemon crash.smithi195 on smithi195 2024-04-06T12:28:16.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:15 smithi152 ceph-mon[104634]: pgmap v22: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:16.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:15 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:16.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:15 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:16.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:15 smithi195 ceph-mon[85980]: Reconfiguring crash.smithi195 (monmap changed)... 2024-04-06T12:28:16.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:15 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:28:16.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:15 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:16.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:15 smithi195 ceph-mon[85980]: Reconfiguring daemon crash.smithi195 on smithi195 2024-04-06T12:28:16.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:15 smithi195 ceph-mon[85980]: pgmap v22: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:18.021 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:17 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:18.021 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:17 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:18.021 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:17 smithi195 ceph-mon[85980]: Reconfiguring mgr.smithi195.ausetj (monmap changed)... 2024-04-06T12:28:18.021 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:17 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:28:18.021 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:17 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:28:18.021 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:17 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:18.021 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:17 smithi195 ceph-mon[85980]: Reconfiguring daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:28:18.021 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:17 smithi195 ceph-mon[85980]: pgmap v23: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:18.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:17 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:18.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:17 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:18.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:17 smithi152 ceph-mon[104634]: Reconfiguring mgr.smithi195.ausetj (monmap changed)... 2024-04-06T12:28:18.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:17 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.ausetj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-06T12:28:18.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:17 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-06T12:28:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:17 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:17 smithi152 ceph-mon[104634]: Reconfiguring daemon mgr.smithi195.ausetj on smithi195 2024-04-06T12:28:18.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:17 smithi152 ceph-mon[104634]: pgmap v23: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:19 smithi152 ceph-mon[104634]: Reconfiguring mon.smithi195 (monmap changed)... 2024-04-06T12:28:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:28:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:28:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:19 smithi152 ceph-mon[104634]: Reconfiguring daemon mon.smithi195 on smithi195 2024-04-06T12:28:19.538 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:19.538 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:19.538 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:19 smithi195 ceph-mon[85980]: Reconfiguring mon.smithi195 (monmap changed)... 2024-04-06T12:28:19.538 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-06T12:28:19.538 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-06T12:28:19.538 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:19.538 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:19 smithi195 ceph-mon[85980]: Reconfiguring daemon mon.smithi195 on smithi195 2024-04-06T12:28:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:20 smithi195 ceph-mon[85980]: pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:20.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:20.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:20.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-06T12:28:20.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:20.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:20 smithi152 ceph-mon[104634]: pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:20.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:20.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:20.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-06T12:28:20.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:21.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:21 smithi195 ceph-mon[85980]: Reconfiguring osd.3 (monmap changed)... 2024-04-06T12:28:21.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:21 smithi195 ceph-mon[85980]: Reconfiguring daemon osd.3 on smithi195 2024-04-06T12:28:21.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:21 smithi152 ceph-mon[104634]: Reconfiguring osd.3 (monmap changed)... 2024-04-06T12:28:21.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:21 smithi152 ceph-mon[104634]: Reconfiguring daemon osd.3 on smithi195 2024-04-06T12:28:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:22 smithi152 ceph-mon[104634]: pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:22 smithi152 ceph-mon[104634]: Reconfiguring osd.4 (monmap changed)... 2024-04-06T12:28:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-06T12:28:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:22 smithi152 ceph-mon[104634]: Reconfiguring daemon osd.4 on smithi195 2024-04-06T12:28:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:28:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:22 smithi195 ceph-mon[85980]: pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:22 smithi195 ceph-mon[85980]: Reconfiguring osd.4 (monmap changed)... 2024-04-06T12:28:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-06T12:28:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:22 smithi195 ceph-mon[85980]: Reconfiguring daemon osd.4 on smithi195 2024-04-06T12:28:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:28:24.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:24.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:24.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:23 smithi152 ceph-mon[104634]: Reconfiguring osd.5 (monmap changed)... 2024-04-06T12:28:24.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-06T12:28:24.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:24.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:23 smithi152 ceph-mon[104634]: Reconfiguring daemon osd.5 on smithi195 2024-04-06T12:28:24.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:23 smithi152 ceph-mon[104634]: pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:24.026 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:24.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:24.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:23 smithi195 ceph-mon[85980]: Reconfiguring osd.5 (monmap changed)... 2024-04-06T12:28:24.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-06T12:28:24.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:24.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:23 smithi195 ceph-mon[85980]: Reconfiguring daemon osd.5 on smithi195 2024-04-06T12:28:24.027 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:23 smithi195 ceph-mon[85980]: pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:25.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:25 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:25 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:25 smithi152 ceph-mon[104634]: Reconfiguring mds.cephfs.smithi195.akamqf (monmap changed)... 2024-04-06T12:28:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:25 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.akamqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:28:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:25 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:25 smithi152 ceph-mon[104634]: Reconfiguring daemon mds.cephfs.smithi195.akamqf on smithi195 2024-04-06T12:28:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:25 smithi152 ceph-mon[104634]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:25.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:25 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:25.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:25 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:25.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:25 smithi195 ceph-mon[85980]: Reconfiguring mds.cephfs.smithi195.akamqf (monmap changed)... 2024-04-06T12:28:25.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:25 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.akamqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:28:25.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:25 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:25.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:25 smithi195 ceph-mon[85980]: Reconfiguring daemon mds.cephfs.smithi195.akamqf on smithi195 2024-04-06T12:28:25.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:25 smithi195 ceph-mon[85980]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:27.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:26 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:27.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:26 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:27.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:26 smithi152 ceph-mon[104634]: Reconfiguring mds.cephfs.smithi195.ttgcpp (monmap changed)... 2024-04-06T12:28:27.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:26 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.ttgcpp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:28:27.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:26 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:27.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:26 smithi152 ceph-mon[104634]: Reconfiguring daemon mds.cephfs.smithi195.ttgcpp on smithi195 2024-04-06T12:28:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:26 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:26 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:26 smithi195 ceph-mon[85980]: Reconfiguring mds.cephfs.smithi195.ttgcpp (monmap changed)... 2024-04-06T12:28:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:26 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.ttgcpp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:28:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:26 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:27.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:26 smithi195 ceph-mon[85980]: Reconfiguring daemon mds.cephfs.smithi195.ttgcpp on smithi195 2024-04-06T12:28:28.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:28.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:28.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:28.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:28:28.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:28.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:28.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:28.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2024-04-06T12:28:28.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2024-04-06T12:28:28.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]: dispatch 2024-04-06T12:28:28.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:27 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]': finished 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2024-04-06T12:28:28.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]: dispatch 2024-04-06T12:28:28.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:27 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]': finished 2024-04-06T12:28:28.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.647+0000 7f89de577700 1 -- 172.21.15.152:0/1286703840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fe270 msgr2=0x7f89d80f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:28.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.647+0000 7f89de577700 1 --2- 172.21.15.152:0/1286703840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fe270 0x7f89d80f7a50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f89c00047f0 tx=0x7f89c0009cb0).stop 2024-04-06T12:28:28.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.647+0000 7f89de577700 1 -- 172.21.15.152:0/1286703840 shutdown_connections 2024-04-06T12:28:28.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.647+0000 7f89de577700 1 --2- 172.21.15.152:0/1286703840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fe270 0x7f89d80f7a50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:28.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.647+0000 7f89de577700 1 --2- 172.21.15.152:0/1286703840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89d80fd910 0x7f89d80fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:28.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.647+0000 7f89de577700 1 -- 172.21.15.152:0/1286703840 >> 172.21.15.152:0/1286703840 conn(0x7f89d80f3510 msgr2=0x7f89d80f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:28.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.647+0000 7f89de577700 1 -- 172.21.15.152:0/1286703840 shutdown_connections 2024-04-06T12:28:28.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.647+0000 7f89de577700 1 -- 172.21.15.152:0/1286703840 wait complete. 2024-04-06T12:28:28.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89de577700 1 Processor -- start 2024-04-06T12:28:28.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89de577700 1 -- start start 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89de577700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fd910 0x7f89d810dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89de577700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89d80fe270 0x7f89d810e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89de577700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d810eac0 con 0x7f89d80fd910 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89de577700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d810ec00 con 0x7f89d80fe270 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fd910 0x7f89d810dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fd910 0x7f89d810dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34410/0 (socket says 172.21.15.152:34410) 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d7fff700 1 -- 172.21.15.152:0/2322666436 learned_addr learned my addr 172.21.15.152:0/2322666436 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89cffff700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89d80fe270 0x7f89d810e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d7fff700 1 -- 172.21.15.152:0/2322666436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89d80fe270 msgr2=0x7f89d810e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d7fff700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89d80fe270 0x7f89d810e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d7fff700 1 -- 172.21.15.152:0/2322666436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0005040 con 0x7f89d80fd910 2024-04-06T12:28:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d7fff700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fd910 0x7f89d810dfd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f89c800c790 tx=0x7f89c8004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:28.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d5ffb700 1 -- 172.21.15.152:0/2322666436 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c80106f0 con 0x7f89d80fd910 2024-04-06T12:28:28.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d8108290 con 0x7f89d80fd910 2024-04-06T12:28:28.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d5ffb700 1 -- 172.21.15.152:0/2322666436 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89c8010d00 con 0x7f89d80fd910 2024-04-06T12:28:28.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89d5ffb700 1 -- 172.21.15.152:0/2322666436 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c8012da0 con 0x7f89d80fd910 2024-04-06T12:28:28.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.648+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d8108850 con 0x7f89d80fd910 2024-04-06T12:28:28.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.650+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d8060650 con 0x7f89d80fd910 2024-04-06T12:28:28.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.650+0000 7f89d5ffb700 1 -- 172.21.15.152:0/2322666436 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f89c8012400 con 0x7f89d80fd910 2024-04-06T12:28:28.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.650+0000 7f89d5ffb700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f89c406cbc0 0x7f89c406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:28.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.651+0000 7f89d5ffb700 1 -- 172.21.15.152:0/2322666436 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f89c808b760 con 0x7f89d80fd910 2024-04-06T12:28:28.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.651+0000 7f89cffff700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f89c406cbc0 0x7f89c406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:28.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.651+0000 7f89cffff700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f89c406cbc0 0x7f89c406f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f89c0004f10 tx=0x7f89c000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:28.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.655+0000 7f89d5ffb700 1 -- 172.21.15.152:0/2322666436 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f89c8059260 con 0x7f89d80fd910 2024-04-06T12:28:28.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.864+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89d8108ad0 con 0x7f89c406cbc0 2024-04-06T12:28:28.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.865+0000 7f89d5ffb700 1 -- 172.21.15.152:0/2322666436 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f89d8108ad0 con 0x7f89c406cbc0 2024-04-06T12:28:28.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f89c406cbc0 msgr2=0x7f89c406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:28.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f89c406cbc0 0x7f89c406f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f89c0004f10 tx=0x7f89c000b040).stop 2024-04-06T12:28:28.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fd910 msgr2=0x7f89d810dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:28.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fd910 0x7f89d810dfd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f89c800c790 tx=0x7f89c8004330).stop 2024-04-06T12:28:28.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 shutdown_connections 2024-04-06T12:28:28.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f89c406cbc0 0x7f89c406f080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:28.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d80fd910 0x7f89d810dfd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:28.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 --2- 172.21.15.152:0/2322666436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89d80fe270 0x7f89d810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:28.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 >> 172.21.15.152:0/2322666436 conn(0x7f89d80f3510 msgr2=0x7f89d80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:28.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 shutdown_connections 2024-04-06T12:28:28.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.867+0000 7f89de577700 1 -- 172.21.15.152:0/2322666436 wait complete. 2024-04-06T12:28:28.875 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:28:28.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.984+0000 7f39e2022700 1 -- 172.21.15.152:0/4167238404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 msgr2=0x7f39dc0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:28.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.984+0000 7f39e2022700 1 --2- 172.21.15.152:0/4167238404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 0x7f39dc0f8c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f39cc0047f0 tx=0x7f39cc009cb0).stop 2024-04-06T12:28:28.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.984+0000 7f39e2022700 1 -- 172.21.15.152:0/4167238404 shutdown_connections 2024-04-06T12:28:28.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.984+0000 7f39e2022700 1 --2- 172.21.15.152:0/4167238404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39dc0f9200 0x7f39dc101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:28.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.984+0000 7f39e2022700 1 --2- 172.21.15.152:0/4167238404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 0x7f39dc0f8c80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:28.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.984+0000 7f39e2022700 1 -- 172.21.15.152:0/4167238404 >> 172.21.15.152:0/4167238404 conn(0x7f39dc070590 msgr2=0x7f39dc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:28.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.984+0000 7f39e2022700 1 -- 172.21.15.152:0/4167238404 shutdown_connections 2024-04-06T12:28:28.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.984+0000 7f39e2022700 1 -- 172.21.15.152:0/4167238404 wait complete. 2024-04-06T12:28:28.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.984+0000 7f39e2022700 1 Processor -- start 2024-04-06T12:28:28.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39e2022700 1 -- start start 2024-04-06T12:28:28.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39e2022700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 0x7f39dc10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39e2022700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39dc0f9200 0x7f39dc10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39e2022700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc10eb10 con 0x7f39dc0f88a0 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39e2022700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc10ec50 con 0x7f39dc0f9200 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39db7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 0x7f39dc10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39db7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 0x7f39dc10e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34420/0 (socket says 172.21.15.152:34420) 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39db7fe700 1 -- 172.21.15.152:0/4070586951 learned_addr learned my addr 172.21.15.152:0/4070586951 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39daffd700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39dc0f9200 0x7f39dc10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39db7fe700 1 -- 172.21.15.152:0/4070586951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39dc0f9200 msgr2=0x7f39dc10e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39db7fe700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39dc0f9200 0x7f39dc10e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39db7fe700 1 -- 172.21.15.152:0/4070586951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc005040 con 0x7f39dc0f88a0 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.985+0000 7f39db7fe700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 0x7f39dc10e020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f39cc00b120 tx=0x7f39cc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:28.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.986+0000 7f39d8ff9700 1 -- 172.21.15.152:0/4070586951 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39cc00e030 con 0x7f39dc0f88a0 2024-04-06T12:28:28.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.986+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39dc108280 con 0x7f39dc0f88a0 2024-04-06T12:28:28.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.986+0000 7f39d8ff9700 1 -- 172.21.15.152:0/4070586951 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39cc007e90 con 0x7f39dc0f88a0 2024-04-06T12:28:28.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.986+0000 7f39d8ff9700 1 -- 172.21.15.152:0/4070586951 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39cc018070 con 0x7f39dc0f88a0 2024-04-06T12:28:28.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.986+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc108760 con 0x7f39dc0f88a0 2024-04-06T12:28:28.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.987+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc05f590 con 0x7f39dc0f88a0 2024-04-06T12:28:28.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.988+0000 7f39d8ff9700 1 -- 172.21.15.152:0/4070586951 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f39cc01d420 con 0x7f39dc0f88a0 2024-04-06T12:28:28.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.988+0000 7f39d8ff9700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f39c406cbc0 0x7f39c406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:28.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.988+0000 7f39d8ff9700 1 -- 172.21.15.152:0/4070586951 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f39cc08d800 con 0x7f39dc0f88a0 2024-04-06T12:28:28.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.988+0000 7f39daffd700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f39c406cbc0 0x7f39c406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:28.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.989+0000 7f39daffd700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f39c406cbc0 0x7f39c406f080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f39dc109960 tx=0x7f39d0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:28.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:28.992+0000 7f39d8ff9700 1 -- 172.21.15.152:0/4070586951 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f39cc05b130 con 0x7f39dc0f88a0 2024-04-06T12:28:29.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:28 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all mon 2024-04-06T12:28:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.216+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39dc0fedd0 con 0x7f39c406cbc0 2024-04-06T12:28:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.217+0000 7f39d8ff9700 1 -- 172.21.15.152:0/4070586951 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f39dc0fedd0 con 0x7f39c406cbc0 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f39c406cbc0 msgr2=0x7f39c406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f39c406cbc0 0x7f39c406f080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f39dc109960 tx=0x7f39d0009040).stop 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 msgr2=0x7f39dc10e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 0x7f39dc10e020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f39cc00b120 tx=0x7f39cc009cb0).stop 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 shutdown_connections 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f39c406cbc0 0x7f39c406f080 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc0f88a0 0x7f39dc10e020 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 --2- 172.21.15.152:0/4070586951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39dc0f9200 0x7f39dc10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 >> 172.21.15.152:0/4070586951 conn(0x7f39dc070590 msgr2=0x7f39dc0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 shutdown_connections 2024-04-06T12:28:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.219+0000 7f39e2022700 1 -- 172.21.15.152:0/4070586951 wait complete. 2024-04-06T12:28:29.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:28 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all mon 2024-04-06T12:28:29.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.320+0000 7f5d18805700 1 -- 172.21.15.152:0/2097782475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 msgr2=0x7f5d140f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.320+0000 7f5d18805700 1 --2- 172.21.15.152:0/2097782475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 0x7f5d140f8c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5d080047f0 tx=0x7f5d08009cb0).stop 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.320+0000 7f5d18805700 1 -- 172.21.15.152:0/2097782475 shutdown_connections 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.320+0000 7f5d18805700 1 --2- 172.21.15.152:0/2097782475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d140f9200 0x7f5d14101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.320+0000 7f5d18805700 1 --2- 172.21.15.152:0/2097782475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 0x7f5d140f8c80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.320+0000 7f5d18805700 1 -- 172.21.15.152:0/2097782475 >> 172.21.15.152:0/2097782475 conn(0x7f5d14070590 msgr2=0x7f5d140f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.320+0000 7f5d18805700 1 -- 172.21.15.152:0/2097782475 shutdown_connections 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.320+0000 7f5d18805700 1 -- 172.21.15.152:0/2097782475 wait complete. 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d18805700 1 Processor -- start 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d18805700 1 -- start start 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d18805700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 0x7f5d140f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d18805700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d140f9200 0x7f5d140f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d18805700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140f7230 con 0x7f5d140f88a0 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d18805700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140f7370 con 0x7f5d140f9200 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d1259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 0x7f5d140f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:29.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d1259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 0x7f5d140f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34442/0 (socket says 172.21.15.152:34442) 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d1259c700 1 -- 172.21.15.152:0/776134995 learned_addr learned my addr 172.21.15.152:0/776134995 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d11d9b700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d140f9200 0x7f5d140f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d1259c700 1 -- 172.21.15.152:0/776134995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d140f9200 msgr2=0x7f5d140f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.321+0000 7f5d1259c700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d140f9200 0x7f5d140f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.322+0000 7f5d1259c700 1 -- 172.21.15.152:0/776134995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d08005040 con 0x7f5d140f88a0 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.322+0000 7f5d11d9b700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d140f9200 0x7f5d140f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.322+0000 7f5d1259c700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 0x7f5d140f6850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5d0800b120 tx=0x7f5d08009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.322+0000 7f5d037fe700 1 -- 172.21.15.152:0/776134995 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d0800e030 con 0x7f5d140f88a0 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.322+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d140f75c0 con 0x7f5d140f88a0 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.322+0000 7f5d037fe700 1 -- 172.21.15.152:0/776134995 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5d08007e90 con 0x7f5d140f88a0 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.322+0000 7f5d037fe700 1 -- 172.21.15.152:0/776134995 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d08018070 con 0x7f5d140f88a0 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.322+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d14114630 con 0x7f5d140f88a0 2024-04-06T12:28:29.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.323+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1405f590 con 0x7f5d140f88a0 2024-04-06T12:28:29.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.324+0000 7f5d037fe700 1 -- 172.21.15.152:0/776134995 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f5d0801d420 con 0x7f5d140f88a0 2024-04-06T12:28:29.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.324+0000 7f5d037fe700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cfc06cbc0 0x7f5cfc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:29.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.324+0000 7f5d037fe700 1 -- 172.21.15.152:0/776134995 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f5d0808d740 con 0x7f5d140f88a0 2024-04-06T12:28:29.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.324+0000 7f5d11d9b700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cfc06cbc0 0x7f5cfc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:29.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.324+0000 7f5d11d9b700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cfc06cbc0 0x7f5cfc06f080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5d140f7ff0 tx=0x7f5d04009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:29.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.328+0000 7f5d037fe700 1 -- 172.21.15.152:0/776134995 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f5d080576a0 con 0x7f5d140f88a0 2024-04-06T12:28:29.533 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.535+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d14059120 con 0x7f5cfc06cbc0 2024-04-06T12:28:29.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.546+0000 7f5d037fe700 1 -- 172.21.15.152:0/776134995 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5d14059120 con 0x7f5cfc06cbc0 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (2m) 47s ago 13m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (13m) 47s ago 13m 6647k - 16.2.15-1-g8963e9de 727f386679cb 41aae06cd0fa 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (13m) 31s ago 13m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6d83676becdd 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (117s) 47s ago 13m 83.0M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (8m) 47s ago 8m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (8m) 47s ago 8m 162M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (8m) 31s ago 8m 14.6M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (8m) 31s ago 8m 15.5M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (3m) 47s ago 14m 471M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:28:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (3m) 31s ago 13m 447M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (61s) 47s ago 15m 27.3M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (37s) 31s ago 12m 24.3M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 47s ago 13m 16.7M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 31s ago 12m 16.7M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (12m) 47s ago 12m 203M 1910M 16.2.15-1-g8963e9de 727f386679cb aed714728328 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (11m) 47s ago 11m 217M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (11m) 47s ago 11m 179M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (10m) 31s ago 10m 230M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (10m) 31s ago 10m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (9m) 31s ago 9m 196M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:28:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (2m) 31s ago 12m 53.5M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:28:29.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cfc06cbc0 msgr2=0x7f5cfc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cfc06cbc0 0x7f5cfc06f080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5d140f7ff0 tx=0x7f5d04009040).stop 2024-04-06T12:28:29.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 msgr2=0x7f5d140f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 0x7f5d140f6850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5d0800b120 tx=0x7f5d08009cb0).stop 2024-04-06T12:28:29.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 shutdown_connections 2024-04-06T12:28:29.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cfc06cbc0 0x7f5cfc06f080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d140f88a0 0x7f5d140f6850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 --2- 172.21.15.152:0/776134995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d140f9200 0x7f5d140f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 >> 172.21.15.152:0/776134995 conn(0x7f5d14070590 msgr2=0x7f5d140fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:29.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.548+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 shutdown_connections 2024-04-06T12:28:29.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.549+0000 7f5d18805700 1 -- 172.21.15.152:0/776134995 wait complete. 2024-04-06T12:28:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.648+0000 7f8bbe04c700 1 -- 172.21.15.152:0/298260003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 msgr2=0x7f8bb80f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.648+0000 7f8bbe04c700 1 --2- 172.21.15.152:0/298260003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 0x7f8bb80f7a50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8ba80047f0 tx=0x7f8ba8009cb0).stop 2024-04-06T12:28:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.648+0000 7f8bbe04c700 1 -- 172.21.15.152:0/298260003 shutdown_connections 2024-04-06T12:28:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.648+0000 7f8bbe04c700 1 --2- 172.21.15.152:0/298260003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 0x7f8bb80f7a50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.648+0000 7f8bbe04c700 1 --2- 172.21.15.152:0/298260003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fd910 0x7f8bb80fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.648+0000 7f8bbe04c700 1 -- 172.21.15.152:0/298260003 >> 172.21.15.152:0/298260003 conn(0x7f8bb80f3530 msgr2=0x7f8bb80f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.648+0000 7f8bbe04c700 1 -- 172.21.15.152:0/298260003 shutdown_connections 2024-04-06T12:28:29.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.648+0000 7f8bbe04c700 1 -- 172.21.15.152:0/298260003 wait complete. 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bbe04c700 1 Processor -- start 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bbe04c700 1 -- start start 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bbe04c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fd910 0x7f8bb810dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bbe04c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 0x7f8bb810e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bbe04c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb810eae0 con 0x7f8bb80fe270 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bbe04c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb810ec20 con 0x7f8bb80fd910 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bb6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 0x7f8bb810e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bb6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 0x7f8bb810e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34448/0 (socket says 172.21.15.152:34448) 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bb6ffd700 1 -- 172.21.15.152:0/3786702659 learned_addr learned my addr 172.21.15.152:0/3786702659 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:28:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bb77fe700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fd910 0x7f8bb810dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bb6ffd700 1 -- 172.21.15.152:0/3786702659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fd910 msgr2=0x7f8bb810dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bb6ffd700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fd910 0x7f8bb810dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.649+0000 7f8bb6ffd700 1 -- 172.21.15.152:0/3786702659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8005040 con 0x7f8bb80fe270 2024-04-06T12:28:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.650+0000 7f8bb6ffd700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 0x7f8bb810e4e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8ba8000c00 tx=0x7f8ba8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.650+0000 7f8bb4ff9700 1 -- 172.21.15.152:0/3786702659 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba800e030 con 0x7f8bb80fe270 2024-04-06T12:28:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.650+0000 7f8bb4ff9700 1 -- 172.21.15.152:0/3786702659 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ba8007e90 con 0x7f8bb80fe270 2024-04-06T12:28:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.650+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb8108250 con 0x7f8bb80fe270 2024-04-06T12:28:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.650+0000 7f8bb4ff9700 1 -- 172.21.15.152:0/3786702659 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba8018070 con 0x7f8bb80fe270 2024-04-06T12:28:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.650+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb81087b0 con 0x7f8bb80fe270 2024-04-06T12:28:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.651+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb805f570 con 0x7f8bb80fe270 2024-04-06T12:28:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.651+0000 7f8bb4ff9700 1 -- 172.21.15.152:0/3786702659 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f8ba801d420 con 0x7f8bb80fe270 2024-04-06T12:28:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.651+0000 7f8bb4ff9700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8ba406cbc0 0x7f8ba406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:29.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.652+0000 7f8bb4ff9700 1 -- 172.21.15.152:0/3786702659 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f8ba808d0b0 con 0x7f8bb80fe270 2024-04-06T12:28:29.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.652+0000 7f8bb77fe700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8ba406cbc0 0x7f8ba406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:29.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.652+0000 7f8bb77fe700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8ba406cbc0 0x7f8ba406f080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8ba0004dc0 tx=0x7f8ba000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:29.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.656+0000 7f8bb4ff9700 1 -- 172.21.15.152:0/3786702659 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f8ba805ab60 con 0x7f8bb80fe270 2024-04-06T12:28:29.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.937+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8bb8047540 con 0x7f8bb80fe270 2024-04-06T12:28:29.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.938+0000 7f8bb4ff9700 1 -- 172.21.15.152:0/3786702659 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f8ba805a6f0 con 0x7f8bb80fe270 2024-04-06T12:28:29.936 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:28:29.936 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:28:29.936 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:28:29.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:28:29.936 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:28:29.936 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 10, 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 4 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:28:29.937 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:28:29.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8ba406cbc0 msgr2=0x7f8ba406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8ba406cbc0 0x7f8ba406f080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8ba0004dc0 tx=0x7f8ba000b040).stop 2024-04-06T12:28:29.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 msgr2=0x7f8bb810e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:29.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 0x7f8bb810e4e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8ba8000c00 tx=0x7f8ba8009cb0).stop 2024-04-06T12:28:29.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 shutdown_connections 2024-04-06T12:28:29.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8ba406cbc0 0x7f8ba406f080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb80fd910 0x7f8bb810dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 --2- 172.21.15.152:0/3786702659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb80fe270 0x7f8bb810e4e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:29.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 >> 172.21.15.152:0/3786702659 conn(0x7f8bb80f3530 msgr2=0x7f8bb80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:29.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 shutdown_connections 2024-04-06T12:28:29.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:29.940+0000 7f8bbe04c700 1 -- 172.21.15.152:0/3786702659 wait complete. 2024-04-06T12:28:30.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:29 smithi152 ceph-mon[104634]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:28:30.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:29 smithi152 ceph-mon[104634]: Upgrade: Updating crash.smithi152 (1/2) 2024-04-06T12:28:30.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:29 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:30.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:29 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:28:30.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:29 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:30.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:29 smithi152 ceph-mon[104634]: Deploying daemon crash.smithi152 on smithi152 2024-04-06T12:28:30.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:29 smithi152 ceph-mon[104634]: pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:30.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:29 smithi152 ceph-mon[104634]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:28:30.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:29 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3786702659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:30.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.043+0000 7f5e186a5700 1 -- 172.21.15.152:0/1896938669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fc7f0 msgr2=0x7f5e100fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.043+0000 7f5e186a5700 1 --2- 172.21.15.152:0/1896938669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fc7f0 0x7f5e100fcbd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5e0c0047f0 tx=0x7f5e0c009cb0).stop 2024-04-06T12:28:30.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 -- 172.21.15.152:0/1896938669 shutdown_connections 2024-04-06T12:28:30.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 --2- 172.21.15.152:0/1896938669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e100fd150 0x7f5e100f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 --2- 172.21.15.152:0/1896938669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fc7f0 0x7f5e100fcbd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 -- 172.21.15.152:0/1896938669 >> 172.21.15.152:0/1896938669 conn(0x7f5e10070590 msgr2=0x7f5e100f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:30.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 -- 172.21.15.152:0/1896938669 shutdown_connections 2024-04-06T12:28:30.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 -- 172.21.15.152:0/1896938669 wait complete. 2024-04-06T12:28:30.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 Processor -- start 2024-04-06T12:28:30.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 -- start start 2024-04-06T12:28:30.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e100fc7f0 0x7f5e100f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:30.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fd150 0x7f5e100f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:30.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100fac10 con 0x7f5e100fd150 2024-04-06T12:28:30.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.044+0000 7f5e186a5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100f9740 con 0x7f5e100fc7f0 2024-04-06T12:28:30.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e15c40700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fd150 0x7f5e100f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e15c40700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fd150 0x7f5e100f9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34466/0 (socket says 172.21.15.152:34466) 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e15c40700 1 -- 172.21.15.152:0/4095565976 learned_addr learned my addr 172.21.15.152:0/4095565976 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e16441700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e100fc7f0 0x7f5e100f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e15c40700 1 -- 172.21.15.152:0/4095565976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e100fc7f0 msgr2=0x7f5e100f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e15c40700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e100fc7f0 0x7f5e100f8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e15c40700 1 -- 172.21.15.152:0/4095565976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c005040 con 0x7f5e100fd150 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e15c40700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fd150 0x7f5e100f9250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5e0000c710 tx=0x7f5e00007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e077fe700 1 -- 172.21.15.152:0/4095565976 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0000e680 con 0x7f5e100fd150 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e077fe700 1 -- 172.21.15.152:0/4095565976 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e0000ec90 con 0x7f5e100fd150 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e100f9990 con 0x7f5e100fd150 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e077fe700 1 -- 172.21.15.152:0/4095565976 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e00013cd0 con 0x7f5e100fd150 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.045+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e10114680 con 0x7f5e100fd150 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.046+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1005f590 con 0x7f5e100fd150 2024-04-06T12:28:30.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.046+0000 7f5e077fe700 1 -- 172.21.15.152:0/4095565976 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f5e00013410 con 0x7f5e100fd150 2024-04-06T12:28:30.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.047+0000 7f5e077fe700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5dfc06cbc0 0x7f5dfc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:30.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.047+0000 7f5e077fe700 1 -- 172.21.15.152:0/4095565976 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f5e0008c140 con 0x7f5e100fd150 2024-04-06T12:28:30.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.047+0000 7f5e16441700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5dfc06cbc0 0x7f5dfc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:30.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.047+0000 7f5e16441700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5dfc06cbc0 0x7f5dfc06f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5e0c004f10 tx=0x7f5e0c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:30.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.051+0000 7f5e077fe700 1 -- 172.21.15.152:0/4095565976 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f5e000561b0 con 0x7f5e100fd150 2024-04-06T12:28:30.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.285+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e10103590 con 0x7f5e100fd150 2024-04-06T12:28:30.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.285+0000 7f5e077fe700 1 -- 172.21.15.152:0/4095565976 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f5e000597d0 con 0x7f5e100fd150 2024-04-06T12:28:30.283 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:28:30.284 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:28:30.284 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:28:30.284 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:28:30.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:28:30.284 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:28:30.284 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:28:30.284 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:28:30.284 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:28:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:28:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:28:30.287 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:28:30.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5dfc06cbc0 msgr2=0x7f5dfc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5dfc06cbc0 0x7f5dfc06f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5e0c004f10 tx=0x7f5e0c00b040).stop 2024-04-06T12:28:30.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fd150 msgr2=0x7f5e100f9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fd150 0x7f5e100f9250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5e0000c710 tx=0x7f5e00007ec0).stop 2024-04-06T12:28:30.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 shutdown_connections 2024-04-06T12:28:30.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5dfc06cbc0 0x7f5dfc06f080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e100fc7f0 0x7f5e100f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 --2- 172.21.15.152:0/4095565976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e100fd150 0x7f5e100f9250 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 >> 172.21.15.152:0/4095565976 conn(0x7f5e10070590 msgr2=0x7f5e10060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:30.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 shutdown_connections 2024-04-06T12:28:30.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.288+0000 7f5e186a5700 1 -- 172.21.15.152:0/4095565976 wait complete. 2024-04-06T12:28:30.289 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:28:30.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:29 smithi195 ceph-mon[85980]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:28:30.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:29 smithi195 ceph-mon[85980]: Upgrade: Updating crash.smithi152 (1/2) 2024-04-06T12:28:30.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:29 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:30.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:29 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:28:30.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:29 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:30.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:29 smithi195 ceph-mon[85980]: Deploying daemon crash.smithi152 on smithi152 2024-04-06T12:28:30.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:29 smithi195 ceph-mon[85980]: pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:30.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:29 smithi195 ceph-mon[85980]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:28:30.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:29 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3786702659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:30.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.388+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1550562338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 msgr2=0x7f1d140f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.388+0000 7f1d1c02d700 1 --2- 172.21.15.152:0/1550562338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 0x7f1d140f7a50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1d100047f0 tx=0x7f1d10009cb0).stop 2024-04-06T12:28:30.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.388+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1550562338 shutdown_connections 2024-04-06T12:28:30.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.388+0000 7f1d1c02d700 1 --2- 172.21.15.152:0/1550562338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 0x7f1d140f7a50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.388+0000 7f1d1c02d700 1 --2- 172.21.15.152:0/1550562338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d140fd910 0x7f1d140fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.388+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1550562338 >> 172.21.15.152:0/1550562338 conn(0x7f1d140f3530 msgr2=0x7f1d140f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:30.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.388+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1550562338 shutdown_connections 2024-04-06T12:28:30.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.388+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1550562338 wait complete. 2024-04-06T12:28:30.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d1c02d700 1 Processor -- start 2024-04-06T12:28:30.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d1c02d700 1 -- start start 2024-04-06T12:28:30.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d1c02d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d140fd910 0x7f1d1410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:30.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d1c02d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 0x7f1d1410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:30.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d1c02d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1410eab0 con 0x7f1d140fe270 2024-04-06T12:28:30.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d1c02d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1410ebf0 con 0x7f1d140fd910 2024-04-06T12:28:30.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d195c8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 0x7f1d1410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:30.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d195c8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 0x7f1d1410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34486/0 (socket says 172.21.15.152:34486) 2024-04-06T12:28:30.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d195c8700 1 -- 172.21.15.152:0/1023841543 learned_addr learned my addr 172.21.15.152:0/1023841543 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d19dc9700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d140fd910 0x7f1d1410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d195c8700 1 -- 172.21.15.152:0/1023841543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d140fd910 msgr2=0x7f1d1410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d195c8700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d140fd910 0x7f1d1410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d195c8700 1 -- 172.21.15.152:0/1023841543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10005040 con 0x7f1d140fe270 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.389+0000 7f1d19dc9700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d140fd910 0x7f1d1410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.390+0000 7f1d195c8700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 0x7f1d1410e4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1d100099f0 tx=0x7f1d10009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.390+0000 7f1d0affd700 1 -- 172.21.15.152:0/1023841543 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d1000e030 con 0x7f1d140fe270 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.390+0000 7f1d0affd700 1 -- 172.21.15.152:0/1023841543 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d10007e90 con 0x7f1d140fe270 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.390+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d14108220 con 0x7f1d140fe270 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.390+0000 7f1d0affd700 1 -- 172.21.15.152:0/1023841543 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d10018070 con 0x7f1d140fe270 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.390+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d14108780 con 0x7f1d140fe270 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.391+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1405f570 con 0x7f1d140fe270 2024-04-06T12:28:30.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.391+0000 7f1d0affd700 1 -- 172.21.15.152:0/1023841543 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f1d1001d420 con 0x7f1d140fe270 2024-04-06T12:28:30.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.391+0000 7f1d0affd700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1d0006cbc0 0x7f1d0006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:30.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.392+0000 7f1d0affd700 1 -- 172.21.15.152:0/1023841543 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f1d1008d410 con 0x7f1d140fe270 2024-04-06T12:28:30.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.392+0000 7f1d19dc9700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1d0006cbc0 0x7f1d0006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:30.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.392+0000 7f1d19dc9700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1d0006cbc0 0x7f1d0006f080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1d040041d0 tx=0x7f1d04009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:30.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.396+0000 7f1d0affd700 1 -- 172.21.15.152:0/1023841543 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f1d1005ae00 con 0x7f1d140fe270 2024-04-06T12:28:30.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.615+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d140ffc60 con 0x7f1d0006cbc0 2024-04-06T12:28:30.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.616+0000 7f1d0affd700 1 -- 172.21.15.152:0/1023841543 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f1d140ffc60 con 0x7f1d0006cbc0 2024-04-06T12:28:30.614 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:28:30.614 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:28:30.614 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:28:30.615 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:28:30.615 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:28:30.615 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:28:30.615 INFO:teuthology.orchestra.run.smithi152.stdout: "mon" 2024-04-06T12:28:30.615 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:28:30.615 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "4/21 daemons upgraded", 2024-04-06T12:28:30.615 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading crash daemons", 2024-04-06T12:28:30.615 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:28:30.615 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1d0006cbc0 msgr2=0x7f1d0006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1d0006cbc0 0x7f1d0006f080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1d040041d0 tx=0x7f1d04009040).stop 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 msgr2=0x7f1d1410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 0x7f1d1410e4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1d100099f0 tx=0x7f1d10009cb0).stop 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 shutdown_connections 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1d0006cbc0 0x7f1d0006f080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d140fd910 0x7f1d1410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 --2- 172.21.15.152:0/1023841543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d140fe270 0x7f1d1410e4b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 >> 172.21.15.152:0/1023841543 conn(0x7f1d140f3530 msgr2=0x7f1d140fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 shutdown_connections 2024-04-06T12:28:30.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.619+0000 7f1d1c02d700 1 -- 172.21.15.152:0/1023841543 wait complete. 2024-04-06T12:28:30.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.723+0000 7f8e68375700 1 -- 172.21.15.152:0/370488364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 msgr2=0x7f8e60103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.723+0000 7f8e68375700 1 --2- 172.21.15.152:0/370488364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 0x7f8e60103d60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8e50004820 tx=0x7f8e50009cb0).stop 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.723+0000 7f8e68375700 1 -- 172.21.15.152:0/370488364 shutdown_connections 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.723+0000 7f8e68375700 1 --2- 172.21.15.152:0/370488364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 0x7f8e60103d60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.723+0000 7f8e68375700 1 --2- 172.21.15.152:0/370488364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e600f66f0 0x7f8e600f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.723+0000 7f8e68375700 1 -- 172.21.15.152:0/370488364 >> 172.21.15.152:0/370488364 conn(0x7f8e60070590 msgr2=0x7f8e600f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.723+0000 7f8e68375700 1 -- 172.21.15.152:0/370488364 shutdown_connections 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.723+0000 7f8e68375700 1 -- 172.21.15.152:0/370488364 wait complete. 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e68375700 1 Processor -- start 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e68375700 1 -- start start 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e68375700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e600f66f0 0x7f8e60110350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e68375700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 0x7f8e60110840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e68375700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e60110e40 con 0x7f8e600f6fc0 2024-04-06T12:28:30.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e68375700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e60110f80 con 0x7f8e600f66f0 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e65910700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 0x7f8e60110840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e65910700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 0x7f8e60110840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34504/0 (socket says 172.21.15.152:34504) 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e65910700 1 -- 172.21.15.152:0/3971304690 learned_addr learned my addr 172.21.15.152:0/3971304690 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e66111700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e600f66f0 0x7f8e60110350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e65910700 1 -- 172.21.15.152:0/3971304690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e600f66f0 msgr2=0x7f8e60110350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e65910700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e600f66f0 0x7f8e60110350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.724+0000 7f8e65910700 1 -- 172.21.15.152:0/3971304690 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e50005040 con 0x7f8e600f6fc0 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.725+0000 7f8e65910700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 0x7f8e60110840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8e50005010 tx=0x7f8e50009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.725+0000 7f8e577fe700 1 -- 172.21.15.152:0/3971304690 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e5000e030 con 0x7f8e600f6fc0 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.725+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6010a5b0 con 0x7f8e600f6fc0 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.725+0000 7f8e577fe700 1 -- 172.21.15.152:0/3971304690 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e50007e90 con 0x7f8e600f6fc0 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.725+0000 7f8e577fe700 1 -- 172.21.15.152:0/3971304690 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e50018070 con 0x7f8e600f6fc0 2024-04-06T12:28:30.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.725+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6010aa90 con 0x7f8e600f6fc0 2024-04-06T12:28:30.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.726+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6005f590 con 0x7f8e600f6fc0 2024-04-06T12:28:30.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.726+0000 7f8e577fe700 1 -- 172.21.15.152:0/3971304690 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f8e5001d420 con 0x7f8e600f6fc0 2024-04-06T12:28:30.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.727+0000 7f8e577fe700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8e4c06cbc0 0x7f8e4c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:28:30.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.727+0000 7f8e577fe700 1 -- 172.21.15.152:0/3971304690 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f8e5008d170 con 0x7f8e600f6fc0 2024-04-06T12:28:30.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.727+0000 7f8e66111700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8e4c06cbc0 0x7f8e4c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:28:30.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.727+0000 7f8e66111700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8e4c06cbc0 0x7f8e4c06f080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8e5c004de0 tx=0x7f8e5c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:28:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:30.732+0000 7f8e577fe700 1 -- 172.21.15.152:0/3971304690 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f8e5005ab60 con 0x7f8e600f6fc0 2024-04-06T12:28:30.967 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:30 smithi152 ceph-mon[104634]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:28:30.967 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:30 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/4095565976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:28:31.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.040+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8e60047540 con 0x7f8e600f6fc0 2024-04-06T12:28:31.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.040+0000 7f8e577fe700 1 -- 172.21.15.152:0/3971304690 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f8e5005a6f0 con 0x7f8e600f6fc0 2024-04-06T12:28:31.039 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:28:31.039 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:28:31.039 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:28:31.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.042+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8e4c06cbc0 msgr2=0x7f8e4c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:31.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.042+0000 7f8e68375700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8e4c06cbc0 0x7f8e4c06f080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f8e5c004de0 tx=0x7f8e5c00b040).stop 2024-04-06T12:28:31.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.042+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 msgr2=0x7f8e60110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:28:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.042+0000 7f8e68375700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 0x7f8e60110840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8e50005010 tx=0x7f8e50009cb0).stop 2024-04-06T12:28:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.042+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 shutdown_connections 2024-04-06T12:28:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.042+0000 7f8e68375700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8e4c06cbc0 0x7f8e4c06f080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.042+0000 7f8e68375700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e600f66f0 0x7f8e60110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.042+0000 7f8e68375700 1 --2- 172.21.15.152:0/3971304690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e600f6fc0 0x7f8e60110840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:28:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.042+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 >> 172.21.15.152:0/3971304690 conn(0x7f8e60070590 msgr2=0x7f8e6006da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:28:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.043+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 shutdown_connections 2024-04-06T12:28:31.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:28:31.043+0000 7f8e68375700 1 -- 172.21.15.152:0/3971304690 wait complete. 2024-04-06T12:28:31.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:30 smithi195 ceph-mon[85980]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:28:31.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:30 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/4095565976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:28:32.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:31 smithi152 ceph-mon[104634]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:28:32.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:31 smithi152 ceph-mon[104634]: pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:32.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:31 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3971304690' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:28:32.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:31 smithi195 ceph-mon[85980]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:28:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:31 smithi195 ceph-mon[85980]: pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:32.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:31 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3971304690' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:28:33.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:33 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:33.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:33 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:33.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:33 smithi195 ceph-mon[85980]: pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:34.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:33 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:34.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:33 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:34.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:33 smithi152 ceph-mon[104634]: pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:35.524 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:35 smithi195 ceph-mon[85980]: Upgrade: Updating crash.smithi195 (2/2) 2024-04-06T12:28:35.524 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:35 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:35.525 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:35 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:28:35.525 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:35 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:35.525 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:35 smithi195 ceph-mon[85980]: Deploying daemon crash.smithi195 on smithi195 2024-04-06T12:28:35.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:35 smithi152 ceph-mon[104634]: Upgrade: Updating crash.smithi195 (2/2) 2024-04-06T12:28:35.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:35 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:35.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:35 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-06T12:28:35.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:35 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:35.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:35 smithi152 ceph-mon[104634]: Deploying daemon crash.smithi195 on smithi195 2024-04-06T12:28:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:36 smithi195 ceph-mon[85980]: pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:36 smithi152 ceph-mon[104634]: pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:37.479 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:28:37.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:28:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:38 smithi152 ceph-mon[104634]: pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:28:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:38 smithi195 ceph-mon[85980]: pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:28:40.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:39 smithi152 ceph-mon[104634]: pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:40.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:39 smithi195 ceph-mon[85980]: pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:42.453 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:42 smithi195 ceph-mon[85980]: pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:42.453 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:42.453 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:42.453 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:42.453 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:42 smithi152 ceph-mon[104634]: pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:43.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:43 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:43.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:43 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:43.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:43 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:43.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:43 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:43.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:43 smithi195 ceph-mon[85980]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:43.559 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:43 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:43.559 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:43 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:43.559 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:43 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:43.559 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:43 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:43.559 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:43 smithi152 ceph-mon[104634]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:46.160 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:46 smithi152 ceph-mon[104634]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:46.160 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:46 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:46.160 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:46 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:46.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:46 smithi195 ceph-mon[85980]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:46.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:46 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:46.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:46 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:47.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:47.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all crash 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]: dispatch 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]': finished 2024-04-06T12:28:47.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-06T12:28:47.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-06T12:28:47.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: Upgrade: osd.0 is safe to restart 2024-04-06T12:28:47.777 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:47 smithi152 ceph-mon[104634]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:47.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all crash 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]: dispatch 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]': finished 2024-04-06T12:28:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-06T12:28:47.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-06T12:28:47.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: Upgrade: osd.0 is safe to restart 2024-04-06T12:28:47.800 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:47 smithi195 ceph-mon[85980]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:49.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:49 smithi152 ceph-mon[104634]: Upgrade: Updating osd.0 2024-04-06T12:28:49.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:49.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-06T12:28:49.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:49.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:49 smithi152 ceph-mon[104634]: Deploying daemon osd.0 on smithi152 2024-04-06T12:28:49.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:49 smithi195 ceph-mon[85980]: Upgrade: Updating osd.0 2024-04-06T12:28:49.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:49.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-06T12:28:49.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:28:49.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:49 smithi195 ceph-mon[85980]: Deploying daemon osd.0 on smithi152 2024-04-06T12:28:50.422 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:50 smithi152 ceph-mon[104634]: pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:50.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:50 smithi195 ceph-mon[85980]: pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:28:51.684 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:51 smithi152 systemd[1]: Stopping Ceph osd.0 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:28:52.025 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[52810]: debug 2024-04-06T12:28:51.685+0000 7fe7b8140700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-06T12:28:52.025 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[52810]: debug 2024-04-06T12:28:51.685+0000 7fe7b8140700 -1 osd.0 49 *** Got signal Terminated *** 2024-04-06T12:28:52.026 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:51 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[52810]: debug 2024-04-06T12:28:51.685+0000 7fe7b8140700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:28:52.481 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:52 smithi152 ceph-mon[104634]: pgmap v40: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:52.482 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:52 smithi152 ceph-mon[104634]: osd.0 marked itself down and dead 2024-04-06T12:28:52.482 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:28:52.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:52 smithi195 ceph-mon[85980]: pgmap v40: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:28:52.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:52 smithi195 ceph-mon[85980]: osd.0 marked itself down and dead 2024-04-06T12:28:52.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:28:52.775 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:52 smithi152 bash[118312]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0 2024-04-06T12:28:53.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:53 smithi152 ceph-mon[104634]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:28:53.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:53 smithi152 ceph-mon[104634]: osdmap e50: 6 total, 5 up, 6 in 2024-04-06T12:28:53.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:53 smithi152 ceph-mon[104634]: osdmap e51: 6 total, 5 up, 6 in 2024-04-06T12:28:53.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:53 smithi195 ceph-mon[85980]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:28:53.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:53 smithi195 ceph-mon[85980]: osdmap e50: 6 total, 5 up, 6 in 2024-04-06T12:28:53.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:53 smithi195 ceph-mon[85980]: osdmap e51: 6 total, 5 up, 6 in 2024-04-06T12:28:54.485 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:54 smithi152 ceph-mon[104634]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T12:28:54.486 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:54 smithi152 ceph-mon[104634]: Health check failed: Reduced data availability: 33 pgs peering (PG_AVAILABILITY) 2024-04-06T12:28:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:54 smithi195 ceph-mon[85980]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T12:28:54.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:54 smithi195 ceph-mon[85980]: Health check failed: Reduced data availability: 33 pgs peering (PG_AVAILABILITY) 2024-04-06T12:28:54.776 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:54 smithi152 systemd[1]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.0.service: Succeeded. 2024-04-06T12:28:54.776 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:54 smithi152 systemd[1]: Stopped Ceph osd.0 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:28:54.776 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:54 smithi152 systemd[1]: Starting Ceph osd.0 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:28:55.948 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:55 smithi152 bash[118582]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-06T12:28:55.948 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:55 smithi152 bash[118582]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-06T12:28:55.948 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:55 smithi152 bash[118582]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-06T12:28:55.948 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:55 smithi152 bash[118582]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-06T12:28:55.948 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:55 smithi152 bash[118582]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-06T12:28:55.948 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:55 smithi152 bash[118582]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-06T12:28:55.949 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:55 smithi152 bash[118582]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-06T12:28:56.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:56 smithi152 ceph-mon[104634]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T12:28:56.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:56 smithi195 ceph-mon[85980]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T12:28:57.276 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:56 smithi152 bash[118844]: f7dc11131ce5c48977ecd47b9ed6bcfd3c2d190d833a1cd7023bb4a8d78441ad 2024-04-06T12:28:57.276 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:56 smithi152 systemd[1]: Started Ceph osd.0 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:28:57.701 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:28:57 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[118858]: 2024-04-06T12:28:57.331+0000 7fe195f94640 -1 Falling back to public interface 2024-04-06T12:28:58.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:58.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:58.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:28:58.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:57 smithi152 ceph-mon[104634]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T12:28:58.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:58.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:28:58.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:28:58.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:57 smithi195 ceph-mon[85980]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T12:29:00.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:28:59 smithi152 ceph-mon[104634]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:00.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:28:59 smithi195 ceph-mon[85980]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:01.009 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:00 smithi152 ceph-mon[104634]: Health check failed: Degraded data redundancy: 52/267 objects degraded (19.476%), 19 pgs degraded (PG_DEGRADED) 2024-04-06T12:29:01.009 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:00 smithi152 ceph-mon[104634]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 33 pgs peering) 2024-04-06T12:29:01.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:00 smithi195 ceph-mon[85980]: Health check failed: Degraded data redundancy: 52/267 objects degraded (19.476%), 19 pgs degraded (PG_DEGRADED) 2024-04-06T12:29:01.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:00 smithi195 ceph-mon[85980]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 33 pgs peering) 2024-04-06T12:29:01.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.151+0000 7f0139e4e700 1 -- 172.21.15.152:0/50521085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01340f9200 msgr2=0x7f0134101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.151+0000 7f0139e4e700 1 --2- 172.21.15.152:0/50521085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01340f9200 0x7f0134101910 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f011c004730 tx=0x7f011c009cb0).stop 2024-04-06T12:29:01.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.151+0000 7f0139e4e700 1 -- 172.21.15.152:0/50521085 shutdown_connections 2024-04-06T12:29:01.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.151+0000 7f0139e4e700 1 --2- 172.21.15.152:0/50521085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01340f9200 0x7f0134101910 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.151+0000 7f0139e4e700 1 --2- 172.21.15.152:0/50521085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01340f88a0 0x7f01340f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.151+0000 7f0139e4e700 1 -- 172.21.15.152:0/50521085 >> 172.21.15.152:0/50521085 conn(0x7f0134070590 msgr2=0x7f01340f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:01.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.151+0000 7f0139e4e700 1 -- 172.21.15.152:0/50521085 shutdown_connections 2024-04-06T12:29:01.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.151+0000 7f0139e4e700 1 -- 172.21.15.152:0/50521085 wait complete. 2024-04-06T12:29:01.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f0139e4e700 1 Processor -- start 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f0139e4e700 1 -- start start 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f0139e4e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01340f88a0 0x7f01340f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f0139e4e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01340f9200 0x7f01340f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f0139e4e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01340f7230 con 0x7f01340f88a0 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f0139e4e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01340f7370 con 0x7f01340f9200 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f01337fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01340f88a0 0x7f01340f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f01337fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01340f88a0 0x7f01340f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40490/0 (socket says 172.21.15.152:40490) 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f01337fe700 1 -- 172.21.15.152:0/376745365 learned_addr learned my addr 172.21.15.152:0/376745365 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f012bfff700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01340f9200 0x7f01340f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f01337fe700 1 -- 172.21.15.152:0/376745365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01340f9200 msgr2=0x7f01340f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f01337fe700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01340f9200 0x7f01340f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.152+0000 7f01337fe700 1 -- 172.21.15.152:0/376745365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124005040 con 0x7f01340f88a0 2024-04-06T12:29:01.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.153+0000 7f01337fe700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01340f88a0 0x7f01340f6850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0124009380 tx=0x7f0124009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:01.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.153+0000 7f01317fa700 1 -- 172.21.15.152:0/376745365 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f012400e560 con 0x7f01340f88a0 2024-04-06T12:29:01.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.153+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011c005040 con 0x7f01340f88a0 2024-04-06T12:29:01.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.153+0000 7f01317fa700 1 -- 172.21.15.152:0/376745365 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f012400f040 con 0x7f01340f88a0 2024-04-06T12:29:01.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.153+0000 7f01317fa700 1 -- 172.21.15.152:0/376745365 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0124014b00 con 0x7f01340f88a0 2024-04-06T12:29:01.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.153+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01341146d0 con 0x7f01340f88a0 2024-04-06T12:29:01.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.154+0000 7f01317fa700 1 -- 172.21.15.152:0/376745365 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f012400e6c0 con 0x7f01340f88a0 2024-04-06T12:29:01.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.154+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013405f590 con 0x7f01340f88a0 2024-04-06T12:29:01.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.155+0000 7f01317fa700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f012006cbc0 0x7f012006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.155+0000 7f01317fa700 1 -- 172.21.15.152:0/376745365 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f012408ba10 con 0x7f01340f88a0 2024-04-06T12:29:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.155+0000 7f012bfff700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f012006cbc0 0x7f012006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.155+0000 7f012bfff700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f012006cbc0 0x7f012006f080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f01340f7ff0 tx=0x7f011c016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.160+0000 7f01317fa700 1 -- 172.21.15.152:0/376745365 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f0124055970 con 0x7f01340f88a0 2024-04-06T12:29:01.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.370+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01340f7da0 con 0x7f012006cbc0 2024-04-06T12:29:01.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.371+0000 7f01317fa700 1 -- 172.21.15.152:0/376745365 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f01340f7da0 con 0x7f012006cbc0 2024-04-06T12:29:01.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.373+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f012006cbc0 msgr2=0x7f012006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.373+0000 7f0139e4e700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f012006cbc0 0x7f012006f080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f01340f7ff0 tx=0x7f011c016040).stop 2024-04-06T12:29:01.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.373+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01340f88a0 msgr2=0x7f01340f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.373+0000 7f0139e4e700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01340f88a0 0x7f01340f6850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0124009380 tx=0x7f0124009cb0).stop 2024-04-06T12:29:01.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.373+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 shutdown_connections 2024-04-06T12:29:01.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.373+0000 7f0139e4e700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f012006cbc0 0x7f012006f080 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.373+0000 7f0139e4e700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01340f88a0 0x7f01340f6850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.373+0000 7f0139e4e700 1 --2- 172.21.15.152:0/376745365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01340f9200 0x7f01340f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.373+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 >> 172.21.15.152:0/376745365 conn(0x7f0134070590 msgr2=0x7f01340fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:01.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.374+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 shutdown_connections 2024-04-06T12:29:01.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.374+0000 7f0139e4e700 1 -- 172.21.15.152:0/376745365 wait complete. 2024-04-06T12:29:01.383 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:29:01.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.492+0000 7f9783808700 1 -- 172.21.15.152:0/1057807192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f8930 msgr2=0x7f977c0f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.492+0000 7f9783808700 1 --2- 172.21.15.152:0/1057807192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f8930 0x7f977c0f8d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f97780047f0 tx=0x7f9778009cb0).stop 2024-04-06T12:29:01.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.492+0000 7f9783808700 1 -- 172.21.15.152:0/1057807192 shutdown_connections 2024-04-06T12:29:01.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.492+0000 7f9783808700 1 --2- 172.21.15.152:0/1057807192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977c0f9290 0x7f977c1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.492+0000 7f9783808700 1 --2- 172.21.15.152:0/1057807192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f8930 0x7f977c0f8d10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.492+0000 7f9783808700 1 -- 172.21.15.152:0/1057807192 >> 172.21.15.152:0/1057807192 conn(0x7f977c0f2400 msgr2=0x7f977c0f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.492+0000 7f9783808700 1 -- 172.21.15.152:0/1057807192 shutdown_connections 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.492+0000 7f9783808700 1 -- 172.21.15.152:0/1057807192 wait complete. 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.493+0000 7f9783808700 1 Processor -- start 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.493+0000 7f9783808700 1 -- start start 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.493+0000 7f9783808700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977c0f8930 0x7f977c10e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.493+0000 7f9783808700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f9290 0x7f977c10e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.493+0000 7f9783808700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c10eba0 con 0x7f977c0f9290 2024-04-06T12:29:01.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.493+0000 7f9783808700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c10ece0 con 0x7f977c0f8930 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f9780da3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f9290 0x7f977c10e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f9780da3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f9290 0x7f977c10e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40514/0 (socket says 172.21.15.152:40514) 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f9780da3700 1 -- 172.21.15.152:0/662529172 learned_addr learned my addr 172.21.15.152:0/662529172 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f97815a4700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977c0f8930 0x7f977c10e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f9780da3700 1 -- 172.21.15.152:0/662529172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977c0f8930 msgr2=0x7f977c10e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f9780da3700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977c0f8930 0x7f977c10e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f9780da3700 1 -- 172.21.15.152:0/662529172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778005040 con 0x7f977c0f9290 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f9780da3700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f9290 0x7f977c10e5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f976c00e8f0 tx=0x7f976c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f97727fc700 1 -- 172.21.15.152:0/662529172 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976c007b40 con 0x7f977c0f9290 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c108370 con 0x7f977c0f9290 2024-04-06T12:29:01.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f97727fc700 1 -- 172.21.15.152:0/662529172 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f976c00f040 con 0x7f977c0f9290 2024-04-06T12:29:01.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f97727fc700 1 -- 172.21.15.152:0/662529172 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976c014880 con 0x7f977c0f9290 2024-04-06T12:29:01.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.494+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c1088b0 con 0x7f977c0f9290 2024-04-06T12:29:01.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.496+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c05f510 con 0x7f977c0f9290 2024-04-06T12:29:01.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.496+0000 7f97727fc700 1 -- 172.21.15.152:0/662529172 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f976c01e440 con 0x7f977c0f9290 2024-04-06T12:29:01.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.497+0000 7f97727fc700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f976806cbc0 0x7f976806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:01.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.497+0000 7f97727fc700 1 -- 172.21.15.152:0/662529172 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f976c08bae0 con 0x7f977c0f9290 2024-04-06T12:29:01.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.501+0000 7f97815a4700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f976806cbc0 0x7f976806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:01.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.501+0000 7f97815a4700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f976806cbc0 0x7f976806f080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f97780047c0 tx=0x7f9778009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:01.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.504+0000 7f97727fc700 1 -- 172.21.15.152:0/662529172 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f976c0594d0 con 0x7f977c0f9290 2024-04-06T12:29:01.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.737+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f977c0fbec0 con 0x7f976806cbc0 2024-04-06T12:29:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.738+0000 7f97727fc700 1 -- 172.21.15.152:0/662529172 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f977c0fbec0 con 0x7f976806cbc0 2024-04-06T12:29:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.740+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f976806cbc0 msgr2=0x7f976806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.740+0000 7f9783808700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f976806cbc0 0x7f976806f080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f97780047c0 tx=0x7f9778009cb0).stop 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.740+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f9290 msgr2=0x7f977c10e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.740+0000 7f9783808700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f9290 0x7f977c10e5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f976c00e8f0 tx=0x7f976c00b040).stop 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.741+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 shutdown_connections 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.741+0000 7f9783808700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f976806cbc0 0x7f976806f080 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.741+0000 7f9783808700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977c0f8930 0x7f977c10e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.741+0000 7f9783808700 1 --2- 172.21.15.152:0/662529172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f977c0f9290 0x7f977c10e5a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.741+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 >> 172.21.15.152:0/662529172 conn(0x7f977c0f2400 msgr2=0x7f977c101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.741+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 shutdown_connections 2024-04-06T12:29:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.741+0000 7f9783808700 1 -- 172.21.15.152:0/662529172 wait complete. 2024-04-06T12:29:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.847+0000 7f68d0bcd700 1 -- 172.21.15.152:0/2925858132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fd8b0 msgr2=0x7f68cc0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.847+0000 7f68d0bcd700 1 --2- 172.21.15.152:0/2925858132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fd8b0 0x7f68cc0fdc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f68bc0047f0 tx=0x7f68bc009cb0).stop 2024-04-06T12:29:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.847+0000 7f68d0bcd700 1 -- 172.21.15.152:0/2925858132 shutdown_connections 2024-04-06T12:29:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.847+0000 7f68d0bcd700 1 --2- 172.21.15.152:0/2925858132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68cc0fe210 0x7f68cc0f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.847+0000 7f68d0bcd700 1 --2- 172.21.15.152:0/2925858132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fd8b0 0x7f68cc0fdc90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.847+0000 7f68d0bcd700 1 -- 172.21.15.152:0/2925858132 >> 172.21.15.152:0/2925858132 conn(0x7f68cc06ce40 msgr2=0x7f68cc06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.847+0000 7f68d0bcd700 1 -- 172.21.15.152:0/2925858132 shutdown_connections 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.847+0000 7f68d0bcd700 1 -- 172.21.15.152:0/2925858132 wait complete. 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68d0bcd700 1 Processor -- start 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68d0bcd700 1 -- start start 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68d0bcd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68cc0fd8b0 0x7f68cc0f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68d0bcd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fe210 0x7f68cc0f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68d0bcd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0f7c30 con 0x7f68cc0fe210 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68d0bcd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0f7d70 con 0x7f68cc0fd8b0 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68c9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fe210 0x7f68cc0f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68ca59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68cc0fd8b0 0x7f68cc0f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68c9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fe210 0x7f68cc0f7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40532/0 (socket says 172.21.15.152:40532) 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68c9d9b700 1 -- 172.21.15.152:0/961057197 learned_addr learned my addr 172.21.15.152:0/961057197 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68c9d9b700 1 -- 172.21.15.152:0/961057197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68cc0fd8b0 msgr2=0x7f68cc0f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68c9d9b700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68cc0fd8b0 0x7f68cc0f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.848+0000 7f68c9d9b700 1 -- 172.21.15.152:0/961057197 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc005040 con 0x7f68cc0fe210 2024-04-06T12:29:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.849+0000 7f68c9d9b700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fe210 0x7f68cc0f7740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f68c00041d0 tx=0x7f68c0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.849+0000 7f68bb7fe700 1 -- 172.21.15.152:0/961057197 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c0007b40 con 0x7f68cc0fe210 2024-04-06T12:29:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.849+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc0f8020 con 0x7f68cc0fe210 2024-04-06T12:29:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.849+0000 7f68bb7fe700 1 -- 172.21.15.152:0/961057197 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68c000f040 con 0x7f68cc0fe210 2024-04-06T12:29:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.849+0000 7f68bb7fe700 1 -- 172.21.15.152:0/961057197 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c00137d0 con 0x7f68cc0fe210 2024-04-06T12:29:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.849+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc114660 con 0x7f68cc0fe210 2024-04-06T12:29:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.850+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc060670 con 0x7f68cc0fe210 2024-04-06T12:29:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.850+0000 7f68bb7fe700 1 -- 172.21.15.152:0/961057197 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f68c0007ca0 con 0x7f68cc0fe210 2024-04-06T12:29:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.851+0000 7f68bb7fe700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f68b406cbc0 0x7f68b406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.851+0000 7f68bb7fe700 1 -- 172.21.15.152:0/961057197 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f68c008b980 con 0x7f68cc0fe210 2024-04-06T12:29:01.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.851+0000 7f68ca59c700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f68b406cbc0 0x7f68b406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:01.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.851+0000 7f68ca59c700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f68b406cbc0 0x7f68b406f080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f68bc004f10 tx=0x7f68bc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:01.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:01.859+0000 7f68bb7fe700 1 -- 172.21.15.152:0/961057197 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f68c00558e0 con 0x7f68cc0fe210 2024-04-06T12:29:02.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:01 smithi152 ceph-mon[104634]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:02.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:01 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:02.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:01 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:02.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:01 smithi195 ceph-mon[85980]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:02.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:01 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:02.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:01 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:02.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.103+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f68cc0f8840 con 0x7f68b406cbc0 2024-04-06T12:29:02.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.122+0000 7f68bb7fe700 1 -- 172.21.15.152:0/961057197 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f68cc0f8840 con 0x7f68b406cbc0 2024-04-06T12:29:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:29:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (2m) 0s ago 14m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:29:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (30s) 0s ago 14m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:29:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (25s) 20s ago 13m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:29:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (2m) 0s ago 13m 83.9M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:29:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (8m) 0s ago 8m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (8m) 0s ago 8m 160M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (8m) 20s ago 8m 14.7M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (8m) 20s ago 8m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (4m) 0s ago 15m 493M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (3m) 20s ago 13m 448M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (93s) 0s ago 15m 42.9M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (69s) 20s ago 13m 34.0M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 0s ago 13m 16.8M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (3m) 20s ago 13m 17.1M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (5s) 0s ago 12m 13.9M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (12m) 0s ago 12m 217M 1910M 16.2.15-1-g8963e9de 727f386679cb 753ab2374ab9 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (11m) 0s ago 11m 178M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (11m) 20s ago 11m 230M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (10m) 20s ago 10m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:29:02.121 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (10m) 20s ago 10m 196M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:29:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (3m) 20s ago 13m 57.8M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:29:02.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f68b406cbc0 msgr2=0x7f68b406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f68b406cbc0 0x7f68b406f080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f68bc004f10 tx=0x7f68bc00b040).stop 2024-04-06T12:29:02.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fe210 msgr2=0x7f68cc0f7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fe210 0x7f68cc0f7740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f68c00041d0 tx=0x7f68c0009f60).stop 2024-04-06T12:29:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 shutdown_connections 2024-04-06T12:29:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f68b406cbc0 0x7f68b406f080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68cc0fd8b0 0x7f68cc0f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 --2- 172.21.15.152:0/961057197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68cc0fe210 0x7f68cc0f7740 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 >> 172.21.15.152:0/961057197 conn(0x7f68cc06ce40 msgr2=0x7f68cc100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 shutdown_connections 2024-04-06T12:29:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.124+0000 7f68d0bcd700 1 -- 172.21.15.152:0/961057197 wait complete. 2024-04-06T12:29:02.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.233+0000 7fca93084700 1 -- 172.21.15.152:0/4263308559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fe270 msgr2=0x7fca8c0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.233+0000 7fca93084700 1 --2- 172.21.15.152:0/4263308559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fe270 0x7fca8c0f7a50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fca780047f0 tx=0x7fca78009cb0).stop 2024-04-06T12:29:02.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.233+0000 7fca93084700 1 -- 172.21.15.152:0/4263308559 shutdown_connections 2024-04-06T12:29:02.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.233+0000 7fca93084700 1 --2- 172.21.15.152:0/4263308559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fe270 0x7fca8c0f7a50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.233+0000 7fca93084700 1 --2- 172.21.15.152:0/4263308559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca8c0fd910 0x7fca8c0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.233+0000 7fca93084700 1 -- 172.21.15.152:0/4263308559 >> 172.21.15.152:0/4263308559 conn(0x7fca8c0f3530 msgr2=0x7fca8c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:02.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.234+0000 7fca93084700 1 -- 172.21.15.152:0/4263308559 shutdown_connections 2024-04-06T12:29:02.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.234+0000 7fca93084700 1 -- 172.21.15.152:0/4263308559 wait complete. 2024-04-06T12:29:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.235+0000 7fca93084700 1 Processor -- start 2024-04-06T12:29:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.235+0000 7fca93084700 1 -- start start 2024-04-06T12:29:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.235+0000 7fca93084700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fd910 0x7fca8c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.235+0000 7fca93084700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca8c0fe270 0x7fca8c10e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.235+0000 7fca93084700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c10eab0 con 0x7fca8c0fd910 2024-04-06T12:29:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.235+0000 7fca93084700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c10ebf0 con 0x7fca8c0fe270 2024-04-06T12:29:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.235+0000 7fca90e20700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fd910 0x7fca8c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.235+0000 7fca90e20700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fd910 0x7fca8c10dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40556/0 (socket says 172.21.15.152:40556) 2024-04-06T12:29:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.235+0000 7fca90e20700 1 -- 172.21.15.152:0/60944043 learned_addr learned my addr 172.21.15.152:0/60944043 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:02.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca8bfff700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca8c0fe270 0x7fca8c10e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:02.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca90e20700 1 -- 172.21.15.152:0/60944043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca8c0fe270 msgr2=0x7fca8c10e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca90e20700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca8c0fe270 0x7fca8c10e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca90e20700 1 -- 172.21.15.152:0/60944043 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78005040 con 0x7fca8c0fd910 2024-04-06T12:29:02.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca8bfff700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca8c0fe270 0x7fca8c10e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:29:02.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca90e20700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fd910 0x7fca8c10dfc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fca800041d0 tx=0x7fca80009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:02.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca89ffb700 1 -- 172.21.15.152:0/60944043 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca80007b40 con 0x7fca8c0fd910 2024-04-06T12:29:02.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c108280 con 0x7fca8c0fd910 2024-04-06T12:29:02.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca89ffb700 1 -- 172.21.15.152:0/60944043 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca8000f040 con 0x7fca8c0fd910 2024-04-06T12:29:02.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca89ffb700 1 -- 172.21.15.152:0/60944043 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8000d800 con 0x7fca8c0fd910 2024-04-06T12:29:02.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.236+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c108840 con 0x7fca8c0fd910 2024-04-06T12:29:02.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.238+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c05f570 con 0x7fca8c0fd910 2024-04-06T12:29:02.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.238+0000 7fca89ffb700 1 -- 172.21.15.152:0/60944043 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fca80007ca0 con 0x7fca8c0fd910 2024-04-06T12:29:02.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.238+0000 7fca89ffb700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fca7c06cbc0 0x7fca7c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:02.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.238+0000 7fca89ffb700 1 -- 172.21.15.152:0/60944043 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fca8008ba70 con 0x7fca8c0fd910 2024-04-06T12:29:02.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.239+0000 7fca8bfff700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fca7c06cbc0 0x7fca7c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:02.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.239+0000 7fca8bfff700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fca7c06cbc0 0x7fca7c06f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fca780043d0 tx=0x7fca7800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.243+0000 7fca89ffb700 1 -- 172.21.15.152:0/60944043 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fca80059460 con 0x7fca8c0fd910 2024-04-06T12:29:02.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.547+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fca8c047540 con 0x7fca8c0fd910 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.548+0000 7fca89ffb700 1 -- 172.21.15.152:0/60944043 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7fca80058ff0 con 0x7fca8c0fd910 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:29:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 5 2024-04-06T12:29:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:29:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:29:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:29:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:29:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:29:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 9, 2024-04-06T12:29:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 4 2024-04-06T12:29:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:29:02.547 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:29:02.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.550+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fca7c06cbc0 msgr2=0x7fca7c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.550+0000 7fca93084700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fca7c06cbc0 0x7fca7c06f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fca780043d0 tx=0x7fca7800b040).stop 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.551+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fd910 msgr2=0x7fca8c10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.551+0000 7fca93084700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fd910 0x7fca8c10dfc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fca800041d0 tx=0x7fca80009f60).stop 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.551+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 shutdown_connections 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.551+0000 7fca93084700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fca7c06cbc0 0x7fca7c06f080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.551+0000 7fca93084700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c0fd910 0x7fca8c10dfc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.551+0000 7fca93084700 1 --2- 172.21.15.152:0/60944043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca8c0fe270 0x7fca8c10e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.551+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 >> 172.21.15.152:0/60944043 conn(0x7fca8c0f3530 msgr2=0x7fca8c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.551+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 shutdown_connections 2024-04-06T12:29:02.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.551+0000 7fca93084700 1 -- 172.21.15.152:0/60944043 wait complete. 2024-04-06T12:29:02.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.663+0000 7fc942bd3700 1 -- 172.21.15.152:0/1300140440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fd170 msgr2=0x7fc93c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.663+0000 7fc942bd3700 1 --2- 172.21.15.152:0/1300140440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fd170 0x7fc93c0f6950 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fc9240047f0 tx=0x7fc924009cb0).stop 2024-04-06T12:29:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.663+0000 7fc942bd3700 1 -- 172.21.15.152:0/1300140440 shutdown_connections 2024-04-06T12:29:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.663+0000 7fc942bd3700 1 --2- 172.21.15.152:0/1300140440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fd170 0x7fc93c0f6950 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.663+0000 7fc942bd3700 1 --2- 172.21.15.152:0/1300140440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0fc810 0x7fc93c0fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.663+0000 7fc942bd3700 1 -- 172.21.15.152:0/1300140440 >> 172.21.15.152:0/1300140440 conn(0x7fc93c0f2410 msgr2=0x7fc93c0f4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.663+0000 7fc942bd3700 1 -- 172.21.15.152:0/1300140440 shutdown_connections 2024-04-06T12:29:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.664+0000 7fc942bd3700 1 -- 172.21.15.152:0/1300140440 wait complete. 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.664+0000 7fc942bd3700 1 Processor -- start 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.664+0000 7fc942bd3700 1 -- start start 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.664+0000 7fc942bd3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fc810 0x7fc93c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.664+0000 7fc942bd3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0fd170 0x7fc93c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.664+0000 7fc942bd3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c061560 con 0x7fc93c0fc810 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.664+0000 7fc942bd3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c107940 con 0x7fc93c0fd170 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc94096f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fc810 0x7fc93c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc94096f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fc810 0x7fc93c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37890/0 (socket says 172.21.15.152:37890) 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc94096f700 1 -- 172.21.15.152:0/3192272572 learned_addr learned my addr 172.21.15.152:0/3192272572 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc93bfff700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0fd170 0x7fc93c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc94096f700 1 -- 172.21.15.152:0/3192272572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0fd170 msgr2=0x7fc93c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc94096f700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0fd170 0x7fc93c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc94096f700 1 -- 172.21.15.152:0/3192272572 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc924005040 con 0x7fc93c0fc810 2024-04-06T12:29:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc94096f700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fc810 0x7fc93c106f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc93400ec20 tx=0x7fc93400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc939ffb700 1 -- 172.21.15.152:0/3192272572 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9340092e0 con 0x7fc93c0fc810 2024-04-06T12:29:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc939ffb700 1 -- 172.21.15.152:0/3192272572 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc93400f040 con 0x7fc93c0fc810 2024-04-06T12:29:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc939ffb700 1 -- 172.21.15.152:0/3192272572 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc93400cb30 con 0x7fc93c0fc810 2024-04-06T12:29:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c107c20 con 0x7fc93c0fc810 2024-04-06T12:29:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.665+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c114790 con 0x7fc93c0fc810 2024-04-06T12:29:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.666+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c05f4f0 con 0x7fc93c0fc810 2024-04-06T12:29:02.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.668+0000 7fc939ffb700 1 -- 172.21.15.152:0/3192272572 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fc934009440 con 0x7fc93c0fc810 2024-04-06T12:29:02.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.668+0000 7fc939ffb700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92806cbc0 0x7fc92806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:02.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.669+0000 7fc939ffb700 1 -- 172.21.15.152:0/3192272572 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fc93408c110 con 0x7fc93c0fc810 2024-04-06T12:29:02.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.669+0000 7fc93bfff700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92806cbc0 0x7fc92806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:02.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.669+0000 7fc93bfff700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92806cbc0 0x7fc92806f080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc93c060f60 tx=0x7fc92400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:02.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.672+0000 7fc939ffb700 1 -- 172.21.15.152:0/3192272572 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fc934059af0 con 0x7fc93c0fc810 2024-04-06T12:29:02.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.919+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc93c047540 con 0x7fc93c0fc810 2024-04-06T12:29:02.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.920+0000 7fc939ffb700 1 -- 172.21.15.152:0/3192272572 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fc934059680 con 0x7fc93c0fc810 2024-04-06T12:29:02.918 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:29:02.918 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:29:02.918 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:29:02.918 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:29:02.918 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:29:02.918 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:29:02.919 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:29:02.920 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:29:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:29:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:29:02.921 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:29:02.921 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:29:02.921 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:29:02.921 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92806cbc0 msgr2=0x7fc92806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92806cbc0 0x7fc92806f080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc93c060f60 tx=0x7fc92400b040).stop 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fc810 msgr2=0x7fc93c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fc810 0x7fc93c106f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc93400ec20 tx=0x7fc93400b040).stop 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 shutdown_connections 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92806cbc0 0x7fc92806f080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0fc810 0x7fc93c106f60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 --2- 172.21.15.152:0/3192272572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0fd170 0x7fc93c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 >> 172.21.15.152:0/3192272572 conn(0x7fc93c0f2410 msgr2=0x7fc93c0fabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 shutdown_connections 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:02.922+0000 7fc942bd3700 1 -- 172.21.15.152:0/3192272572 wait complete. 2024-04-06T12:29:02.922 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:29:03.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.026+0000 7f77b59bb700 1 -- 172.21.15.152:0/30649921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 msgr2=0x7f77b00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:03.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.026+0000 7f77b59bb700 1 --2- 172.21.15.152:0/30649921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 0x7f77b00f6930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f77980047f0 tx=0x7f7798009cb0).stop 2024-04-06T12:29:03.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.026+0000 7f77b59bb700 1 -- 172.21.15.152:0/30649921 shutdown_connections 2024-04-06T12:29:03.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.026+0000 7f77b59bb700 1 --2- 172.21.15.152:0/30649921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 0x7f77b00f6930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.026+0000 7f77b59bb700 1 --2- 172.21.15.152:0/30649921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77b00fc7f0 0x7f77b00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.026+0000 7f77b59bb700 1 -- 172.21.15.152:0/30649921 >> 172.21.15.152:0/30649921 conn(0x7f77b0070590 msgr2=0x7f77b00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.026+0000 7f77b59bb700 1 -- 172.21.15.152:0/30649921 shutdown_connections 2024-04-06T12:29:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.026+0000 7f77b59bb700 1 -- 172.21.15.152:0/30649921 wait complete. 2024-04-06T12:29:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77b59bb700 1 Processor -- start 2024-04-06T12:29:03.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77b59bb700 1 -- start start 2024-04-06T12:29:03.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77b59bb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77b00fc7f0 0x7f77b01090a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:03.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77b59bb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 0x7f77b0109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:03.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77b59bb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0109a80 con 0x7f77b00fd150 2024-04-06T12:29:03.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77b59bb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0109bc0 con 0x7f77b00fc7f0 2024-04-06T12:29:03.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77ae7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 0x7f77b0109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:03.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77ae7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 0x7f77b0109590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37908/0 (socket says 172.21.15.152:37908) 2024-04-06T12:29:03.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77ae7fc700 1 -- 172.21.15.152:0/4029547116 learned_addr learned my addr 172.21.15.152:0/4029547116 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:03.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77aeffd700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77b00fc7f0 0x7f77b01090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:03.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77ae7fc700 1 -- 172.21.15.152:0/4029547116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77b00fc7f0 msgr2=0x7f77b01090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:03.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77ae7fc700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77b00fc7f0 0x7f77b01090a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.027+0000 7f77ae7fc700 1 -- 172.21.15.152:0/4029547116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798005040 con 0x7f77b00fd150 2024-04-06T12:29:03.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:02 smithi152 ceph-mon[104634]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:03.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:02 smithi152 ceph-mon[104634]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:03.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:02 smithi152 ceph-mon[104634]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:03.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:02 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:03.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:02 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:03.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:02 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/60944043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.028+0000 7f77ae7fc700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 0x7f77b0109590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f77980099f0 tx=0x7f7798009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.028+0000 7f77a7fff700 1 -- 172.21.15.152:0/4029547116 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f779800e030 con 0x7f77b00fd150 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.028+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b0109e10 con 0x7f77b00fd150 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.028+0000 7f77a7fff700 1 -- 172.21.15.152:0/4029547116 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7798007e90 con 0x7f77b00fd150 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.028+0000 7f77a7fff700 1 -- 172.21.15.152:0/4029547116 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7798018070 con 0x7f77b00fd150 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.028+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b0112400 con 0x7f77b00fd150 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.029+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b005f590 con 0x7f77b00fd150 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.029+0000 7f77a7fff700 1 -- 172.21.15.152:0/4029547116 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f77980094c0 con 0x7f77b00fd150 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.030+0000 7f77a7fff700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f779c06cbc0 0x7f779c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.030+0000 7f77a7fff700 1 -- 172.21.15.152:0/4029547116 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f779808d1e0 con 0x7f77b00fd150 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.030+0000 7f77aeffd700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f779c06cbc0 0x7f779c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.030+0000 7f77aeffd700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f779c06cbc0 0x7f779c06f080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f77a0007f30 tx=0x7f77a0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.034+0000 7f77a7fff700 1 -- 172.21.15.152:0/4029547116 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f7798057140 con 0x7f77b00fd150 2024-04-06T12:29:03.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:02 smithi195 ceph-mon[85980]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:03.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:02 smithi195 ceph-mon[85980]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:03.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:02 smithi195 ceph-mon[85980]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:03.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:02 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:03.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:02 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:03.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:02 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/60944043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:03.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.249+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77b0059120 con 0x7f779c06cbc0 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.250+0000 7f77a7fff700 1 -- 172.21.15.152:0/4029547116 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f77b0059120 con 0x7f779c06cbc0 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stdout: "crash" 2024-04-06T12:29:03.248 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:29:03.249 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "7/21 daemons upgraded", 2024-04-06T12:29:03.249 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2024-04-06T12:29:03.249 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:29:03.249 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:29:03.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f779c06cbc0 msgr2=0x7f779c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:03.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f779c06cbc0 0x7f779c06f080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f77a0007f30 tx=0x7f77a0009040).stop 2024-04-06T12:29:03.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 msgr2=0x7f77b0109590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:03.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 0x7f77b0109590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f77980099f0 tx=0x7f7798009cb0).stop 2024-04-06T12:29:03.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 shutdown_connections 2024-04-06T12:29:03.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f779c06cbc0 0x7f779c06f080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77b00fc7f0 0x7f77b01090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 --2- 172.21.15.152:0/4029547116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77b00fd150 0x7f77b0109590 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 >> 172.21.15.152:0/4029547116 conn(0x7f77b0070590 msgr2=0x7f77b00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:03.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 shutdown_connections 2024-04-06T12:29:03.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.252+0000 7f77b59bb700 1 -- 172.21.15.152:0/4029547116 wait complete. 2024-04-06T12:29:03.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.354+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/3347197381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 msgr2=0x7ff3e80f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:03.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.354+0000 7ff3ef3c9700 1 --2- 172.21.15.152:0/3347197381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 0x7ff3e80f7a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff3d80047f0 tx=0x7ff3d8009cb0).stop 2024-04-06T12:29:03.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.354+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/3347197381 shutdown_connections 2024-04-06T12:29:03.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.354+0000 7ff3ef3c9700 1 --2- 172.21.15.152:0/3347197381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 0x7ff3e80f7a30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.354+0000 7ff3ef3c9700 1 --2- 172.21.15.152:0/3347197381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80fd8f0 0x7ff3e80fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.354+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/3347197381 >> 172.21.15.152:0/3347197381 conn(0x7ff3e80f34b0 msgr2=0x7ff3e80f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:03.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.354+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/3347197381 shutdown_connections 2024-04-06T12:29:03.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.354+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/3347197381 wait complete. 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ef3c9700 1 Processor -- start 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ef3c9700 1 -- start start 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ef3c9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80fd8f0 0x7ff3e810e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ef3c9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 0x7ff3e810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ef3c9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e810eb70 con 0x7ff3e80fe250 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ef3c9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e810ecb0 con 0x7ff3e80fd8f0 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ec964700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 0x7ff3e810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ec964700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 0x7ff3e810e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37926/0 (socket says 172.21.15.152:37926) 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ec964700 1 -- 172.21.15.152:0/2596775559 learned_addr learned my addr 172.21.15.152:0/2596775559 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:03.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ed165700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80fd8f0 0x7ff3e810e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ec964700 1 -- 172.21.15.152:0/2596775559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80fd8f0 msgr2=0x7ff3e810e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ec964700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80fd8f0 0x7ff3e810e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ec964700 1 -- 172.21.15.152:0/2596775559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d8005040 con 0x7ff3e80fe250 2024-04-06T12:29:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.355+0000 7ff3ec964700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 0x7ff3e810e570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff3d80099f0 tx=0x7ff3d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.356+0000 7ff3de7fc700 1 -- 172.21.15.152:0/2596775559 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3d800e030 con 0x7ff3e80fe250 2024-04-06T12:29:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.356+0000 7ff3de7fc700 1 -- 172.21.15.152:0/2596775559 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff3d8007e90 con 0x7ff3e80fe250 2024-04-06T12:29:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.356+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e81082e0 con 0x7ff3e80fe250 2024-04-06T12:29:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.356+0000 7ff3de7fc700 1 -- 172.21.15.152:0/2596775559 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3d8018070 con 0x7ff3e80fe250 2024-04-06T12:29:03.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.356+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e81087c0 con 0x7ff3e80fe250 2024-04-06T12:29:03.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.357+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e805f590 con 0x7ff3e80fe250 2024-04-06T12:29:03.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.357+0000 7ff3de7fc700 1 -- 172.21.15.152:0/2596775559 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90954+0+0 (secure 0 0 0) 0x7ff3d80094c0 con 0x7ff3e80fe250 2024-04-06T12:29:03.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.358+0000 7ff3de7fc700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff3d406cbc0 0x7ff3d406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:03.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.358+0000 7ff3ed165700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff3d406cbc0 0x7ff3d406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:03.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.358+0000 7ff3de7fc700 1 -- 172.21.15.152:0/2596775559 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7ff3d808d1e0 con 0x7ff3e80fe250 2024-04-06T12:29:03.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.358+0000 7ff3ed165700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff3d406cbc0 0x7ff3d406f080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff3e4004dc0 tx=0x7ff3e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:03.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.362+0000 7ff3de7fc700 1 -- 172.21.15.152:0/2596775559 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7ff3d805abd0 con 0x7ff3e80fe250 2024-04-06T12:29:03.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.654+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff3e8047540 con 0x7ff3e80fe250 2024-04-06T12:29:03.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.654+0000 7ff3de7fc700 1 -- 172.21.15.152:0/2596775559 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1517 (secure 0 0 0) 0x7ff3d805a760 con 0x7ff3e80fe250 2024-04-06T12:29:03.652 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 52/267 objects degraded (19.476%), 19 pgs degraded 2024-04-06T12:29:03.652 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:29:03.652 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:29:03.652 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-06T12:29:03.652 INFO:teuthology.orchestra.run.smithi152.stdout: osd.0 (root=default,host=smithi152) is down 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 52/267 objects degraded (19.476%), 19 pgs degraded 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-04-06T12:29:03.653 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-04-06T12:29:03.654 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-04-06T12:29:03.654 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-04-06T12:29:03.654 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-04-06T12:29:03.654 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-04-06T12:29:03.654 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-04-06T12:29:03.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.656+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff3d406cbc0 msgr2=0x7ff3d406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:03.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff3d406cbc0 0x7ff3d406f080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff3e4004dc0 tx=0x7ff3e400b040).stop 2024-04-06T12:29:03.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 msgr2=0x7ff3e810e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:03.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 0x7ff3e810e570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff3d80099f0 tx=0x7ff3d8009cb0).stop 2024-04-06T12:29:03.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 shutdown_connections 2024-04-06T12:29:03.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff3d406cbc0 0x7ff3d406f080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80fd8f0 0x7ff3e810e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 --2- 172.21.15.152:0/2596775559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3e80fe250 0x7ff3e810e570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:03.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 >> 172.21.15.152:0/2596775559 conn(0x7ff3e80f34b0 msgr2=0x7ff3e80fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:03.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 shutdown_connections 2024-04-06T12:29:03.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:03.657+0000 7ff3ef3c9700 1 -- 172.21.15.152:0/2596775559 wait complete. 2024-04-06T12:29:04.016 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:03 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3192272572' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:29:04.016 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:03 smithi152 ceph-mon[104634]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:04.016 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:03 smithi152 ceph-mon[104634]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:04.016 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:03 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2596775559' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:29:04.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:03 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3192272572' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:29:04.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:03 smithi195 ceph-mon[85980]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:04.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:03 smithi195 ceph-mon[85980]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:04.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:03 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2596775559' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:29:06.275 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:29:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[118858]: 2024-04-06T12:29:06.163+0000 7fe195f94640 -1 osd.0 0 read_superblock omap replica is missing. 2024-04-06T12:29:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:06 smithi152 ceph-mon[104634]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 774 B/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:29:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:29:06.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:06 smithi195 ceph-mon[85980]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 774 B/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:29:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:29:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:06.775 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:29:06 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[118858]: 2024-04-06T12:29:06.467+0000 7fe195f94640 -1 osd.0 49 log_to_monitors true 2024-04-06T12:29:07.526 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[118858]: 2024-04-06T12:29:07.115+0000 7fe1873ed700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T12:29:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:29:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-06T12:29:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-06T12:29:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-06T12:29:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: from='osd.0 [v2:172.21.15.152:6802/2874592048,v1:172.21.15.152:6803/2874592048]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-06T12:29:07.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:07.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:29:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:29:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:07.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-06T12:29:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-06T12:29:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-06T12:29:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: from='osd.0 [v2:172.21.15.152:6802/2874592048,v1:172.21.15.152:6803/2874592048]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-06T12:29:07.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:07.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:29:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:08 smithi152 ceph-mon[104634]: pgmap v50: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:08 smithi152 ceph-mon[104634]: from='osd.0 [v2:172.21.15.152:6802/2874592048,v1:172.21.15.152:6803/2874592048]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-06T12:29:08.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:08 smithi152 ceph-mon[104634]: osdmap e52: 6 total, 5 up, 6 in 2024-04-06T12:29:08.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:08 smithi152 ceph-mon[104634]: from='osd.0 [v2:172.21.15.152:6802/2874592048,v1:172.21.15.152:6803/2874592048]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:29:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:08 smithi195 ceph-mon[85980]: pgmap v50: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:08 smithi195 ceph-mon[85980]: from='osd.0 [v2:172.21.15.152:6802/2874592048,v1:172.21.15.152:6803/2874592048]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-06T12:29:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:08 smithi195 ceph-mon[85980]: osdmap e52: 6 total, 5 up, 6 in 2024-04-06T12:29:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:08 smithi195 ceph-mon[85980]: from='osd.0 [v2:172.21.15.152:6802/2874592048,v1:172.21.15.152:6803/2874592048]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:29:09.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:09 smithi152 ceph-mon[104634]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:29:09.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:09 smithi152 ceph-mon[104634]: osd.0 [v2:172.21.15.152:6802/2874592048,v1:172.21.15.152:6803/2874592048] boot 2024-04-06T12:29:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:09 smithi152 ceph-mon[104634]: osdmap e53: 6 total, 6 up, 6 in 2024-04-06T12:29:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:29:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:09 smithi152 ceph-mon[104634]: mgrmap e39: smithi152.lynahm(active, since 91s), standbys: smithi195.ausetj 2024-04-06T12:29:09.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:09 smithi152 ceph-mon[104634]: osdmap e54: 6 total, 6 up, 6 in 2024-04-06T12:29:09.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:09 smithi195 ceph-mon[85980]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:29:09.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:09 smithi195 ceph-mon[85980]: osd.0 [v2:172.21.15.152:6802/2874592048,v1:172.21.15.152:6803/2874592048] boot 2024-04-06T12:29:09.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:09 smithi195 ceph-mon[85980]: osdmap e53: 6 total, 6 up, 6 in 2024-04-06T12:29:09.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-06T12:29:09.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:09 smithi195 ceph-mon[85980]: mgrmap e39: smithi152.lynahm(active, since 91s), standbys: smithi195.ausetj 2024-04-06T12:29:09.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:09 smithi195 ceph-mon[85980]: osdmap e54: 6 total, 6 up, 6 in 2024-04-06T12:29:10.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:10 smithi152 ceph-mon[104634]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 383 B/s wr, 2 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:10.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:10 smithi195 ceph-mon[85980]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 383 B/s wr, 2 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:12.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:12 smithi152 ceph-mon[104634]: pgmap v55: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:12 smithi195 ceph-mon[85980]: pgmap v55: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s; 52/267 objects degraded (19.476%) 2024-04-06T12:29:13.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:13 smithi152 ceph-mon[104634]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/267 objects degraded (19.476%), 19 pgs degraded) 2024-04-06T12:29:13.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:13 smithi195 ceph-mon[85980]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/267 objects degraded (19.476%), 19 pgs degraded) 2024-04-06T12:29:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:14 smithi152 ceph-mon[104634]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s; 46 B/s, 0 objects/s recovering 2024-04-06T12:29:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:14 smithi195 ceph-mon[85980]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s; 46 B/s, 0 objects/s recovering 2024-04-06T12:29:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:16 smithi152 ceph-mon[104634]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 386 B/s wr, 2 op/s; 35 B/s, 0 objects/s recovering 2024-04-06T12:29:16.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:16 smithi195 ceph-mon[85980]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 386 B/s wr, 2 op/s; 35 B/s, 0 objects/s recovering 2024-04-06T12:29:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:18 smithi152 ceph-mon[104634]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 343 B/s rd, 0 op/s; 31 B/s, 0 objects/s recovering 2024-04-06T12:29:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:18 smithi195 ceph-mon[85980]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 343 B/s rd, 0 op/s; 31 B/s, 0 objects/s recovering 2024-04-06T12:29:20.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:19 smithi152 ceph-mon[104634]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 819 B/s rd, 1 op/s; 28 B/s, 0 objects/s recovering 2024-04-06T12:29:20.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:19 smithi195 ceph-mon[85980]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 819 B/s rd, 1 op/s; 28 B/s, 0 objects/s recovering 2024-04-06T12:29:22.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:22 smithi152 ceph-mon[104634]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 685 B/s rd, 1 op/s; 23 B/s, 0 objects/s recovering 2024-04-06T12:29:22.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-06T12:29:22.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:22 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-06T12:29:22.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:22 smithi152 ceph-mon[104634]: Upgrade: osd.1 is safe to restart 2024-04-06T12:29:22.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:22.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:29:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:22 smithi195 ceph-mon[85980]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 685 B/s rd, 1 op/s; 23 B/s, 0 objects/s recovering 2024-04-06T12:29:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-06T12:29:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:22 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-06T12:29:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:22 smithi195 ceph-mon[85980]: Upgrade: osd.1 is safe to restart 2024-04-06T12:29:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:29:23.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:23.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:23.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-06T12:29:23.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:29:23.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-06T12:29:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:29:24.143 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:24 smithi152 ceph-mon[104634]: Upgrade: Updating osd.1 2024-04-06T12:29:24.143 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:24 smithi152 ceph-mon[104634]: Deploying daemon osd.1 on smithi152 2024-04-06T12:29:24.143 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:24 smithi152 ceph-mon[104634]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 23 B/s, 0 objects/s recovering 2024-04-06T12:29:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:24 smithi195 ceph-mon[85980]: Upgrade: Updating osd.1 2024-04-06T12:29:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:24 smithi195 ceph-mon[85980]: Deploying daemon osd.1 on smithi152 2024-04-06T12:29:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:24 smithi195 ceph-mon[85980]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 23 B/s, 0 objects/s recovering 2024-04-06T12:29:26.115 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:26 smithi152 ceph-mon[104634]: pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:29:26.115 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:25 smithi152 systemd[1]: Stopping Ceph osd.1 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:29:26.525 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[59165]: debug 2024-04-06T12:29:26.116+0000 7fc8c6407700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-06T12:29:26.525 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[59165]: debug 2024-04-06T12:29:26.116+0000 7fc8c6407700 -1 osd.1 54 *** Got signal Terminated *** 2024-04-06T12:29:26.525 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:26 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[59165]: debug 2024-04-06T12:29:26.116+0000 7fc8c6407700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:29:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:26 smithi195 ceph-mon[85980]: pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:29:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:27 smithi152 ceph-mon[104634]: osd.1 marked itself down and dead 2024-04-06T12:29:27.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:27 smithi195 ceph-mon[85980]: osd.1 marked itself down and dead 2024-04-06T12:29:27.776 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:27 smithi152 bash[125585]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1 2024-04-06T12:29:28.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:28 smithi152 ceph-mon[104634]: pgmap v63: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:29:28.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:28 smithi152 ceph-mon[104634]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:29:28.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:28 smithi152 ceph-mon[104634]: osdmap e55: 6 total, 5 up, 6 in 2024-04-06T12:29:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:28 smithi195 ceph-mon[85980]: pgmap v63: 65 pgs: 65 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:29:28.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:28 smithi195 ceph-mon[85980]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:29:28.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:28 smithi195 ceph-mon[85980]: osdmap e55: 6 total, 5 up, 6 in 2024-04-06T12:29:29.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:29 smithi152 ceph-mon[104634]: osdmap e56: 6 total, 5 up, 6 in 2024-04-06T12:29:29.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:29 smithi195 ceph-mon[85980]: osdmap e56: 6 total, 5 up, 6 in 2024-04-06T12:29:29.776 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:29 smithi152 systemd[1]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.1.service: Succeeded. 2024-04-06T12:29:29.776 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:29 smithi152 systemd[1]: Stopped Ceph osd.1 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:29:29.776 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:29 smithi152 systemd[1]: Starting Ceph osd.1 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:29:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:30 smithi152 ceph-mon[104634]: pgmap v66: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-04-06T12:29:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:30 smithi152 ceph-mon[104634]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-04-06T12:29:30.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:30 smithi195 ceph-mon[85980]: pgmap v66: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-04-06T12:29:30.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:30 smithi195 ceph-mon[85980]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-04-06T12:29:30.970 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:30 smithi152 bash[125856]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-06T12:29:30.970 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:30 smithi152 bash[125856]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-06T12:29:30.970 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:30 smithi152 bash[125856]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-06T12:29:30.970 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:30 smithi152 bash[125856]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-06T12:29:30.970 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:30 smithi152 bash[125856]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-06T12:29:30.970 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:30 smithi152 bash[125856]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-06T12:29:30.970 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:30 smithi152 bash[125856]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-06T12:29:31.832 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:31 smithi152 ceph-osd[126151]: -- 172.21.15.152:0/1021181457 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562a3cc631e0 con 0x562a3cc33000 2024-04-06T12:29:32.112 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:31 smithi152 bash[126113]: 4e01281def3c097a4445d0ef853319e171c9561839f320de9782f82e66542122 2024-04-06T12:29:32.112 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:31 smithi152 systemd[1]: Started Ceph osd.1 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:29:32.525 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:32 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[126127]: 2024-04-06T12:29:32.249+0000 7f6899ad7640 -1 Falling back to public interface 2024-04-06T12:29:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:32 smithi152 ceph-mon[104634]: pgmap v67: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-04-06T12:29:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:32 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:32 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:32.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:32 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:29:32.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:32 smithi195 ceph-mon[85980]: pgmap v67: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-04-06T12:29:32.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:32 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:32.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:32 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:32.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:32 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:29:33.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:33 smithi152 ceph-mon[104634]: Health check failed: Degraded data redundancy: 36/267 objects degraded (13.483%), 13 pgs degraded (PG_DEGRADED) 2024-04-06T12:29:33.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:33 smithi152 ceph-mon[104634]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-04-06T12:29:33.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:33 smithi195 ceph-mon[85980]: Health check failed: Degraded data redundancy: 36/267 objects degraded (13.483%), 13 pgs degraded (PG_DEGRADED) 2024-04-06T12:29:33.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:33 smithi195 ceph-mon[85980]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-04-06T12:29:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.764+0000 7fbe58d99700 1 -- 172.21.15.152:0/2459062586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fe250 msgr2=0x7fbe540f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.764+0000 7fbe58d99700 1 --2- 172.21.15.152:0/2459062586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fe250 0x7fbe540f7a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fbe440047f0 tx=0x7fbe44009cb0).stop 2024-04-06T12:29:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.764+0000 7fbe58d99700 1 -- 172.21.15.152:0/2459062586 shutdown_connections 2024-04-06T12:29:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.764+0000 7fbe58d99700 1 --2- 172.21.15.152:0/2459062586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fe250 0x7fbe540f7a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.764+0000 7fbe58d99700 1 --2- 172.21.15.152:0/2459062586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe540fd8f0 0x7fbe540fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.764+0000 7fbe58d99700 1 -- 172.21.15.152:0/2459062586 >> 172.21.15.152:0/2459062586 conn(0x7fbe540f34b0 msgr2=0x7fbe540f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.764+0000 7fbe58d99700 1 -- 172.21.15.152:0/2459062586 shutdown_connections 2024-04-06T12:29:33.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.764+0000 7fbe58d99700 1 -- 172.21.15.152:0/2459062586 wait complete. 2024-04-06T12:29:33.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.765+0000 7fbe58d99700 1 Processor -- start 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.765+0000 7fbe58d99700 1 -- start start 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.765+0000 7fbe58d99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fd8f0 0x7fbe5410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.765+0000 7fbe58d99700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe540fe250 0x7fbe5410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.765+0000 7fbe58d99700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5410eb70 con 0x7fbe540fd8f0 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.765+0000 7fbe58d99700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5410ecb0 con 0x7fbe540fe250 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fd8f0 0x7fbe5410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fd8f0 0x7fbe5410e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54176/0 (socket says 172.21.15.152:54176) 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe5259c700 1 -- 172.21.15.152:0/2798266436 learned_addr learned my addr 172.21.15.152:0/2798266436 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe51d9b700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe540fe250 0x7fbe5410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe5259c700 1 -- 172.21.15.152:0/2798266436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe540fe250 msgr2=0x7fbe5410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe5259c700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe540fe250 0x7fbe5410e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:33.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe5259c700 1 -- 172.21.15.152:0/2798266436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44005040 con 0x7fbe540fd8f0 2024-04-06T12:29:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe5259c700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fd8f0 0x7fbe5410e080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fbe48002770 tx=0x7fbe48002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe437fe700 1 -- 172.21.15.152:0/2798266436 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe48007b40 con 0x7fbe540fd8f0 2024-04-06T12:29:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe437fe700 1 -- 172.21.15.152:0/2798266436 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe4800f040 con 0x7fbe540fd8f0 2024-04-06T12:29:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe54108340 con 0x7fbe540fd8f0 2024-04-06T12:29:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe437fe700 1 -- 172.21.15.152:0/2798266436 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe48014820 con 0x7fbe540fd8f0 2024-04-06T12:29:33.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.766+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe54108880 con 0x7fbe540fd8f0 2024-04-06T12:29:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.767+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5405f590 con 0x7fbe540fd8f0 2024-04-06T12:29:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.768+0000 7fbe437fe700 1 -- 172.21.15.152:0/2798266436 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbe48007ca0 con 0x7fbe540fd8f0 2024-04-06T12:29:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.768+0000 7fbe437fe700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbe3c06cab0 0x7fbe3c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.768+0000 7fbe51d9b700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbe3c06cab0 0x7fbe3c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.769+0000 7fbe437fe700 1 -- 172.21.15.152:0/2798266436 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fbe4808b8e0 con 0x7fbe540fd8f0 2024-04-06T12:29:33.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.769+0000 7fbe51d9b700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbe3c06cab0 0x7fbe3c06ef70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbe541099c0 tx=0x7fbe44009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:33.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:33.773+0000 7fbe437fe700 1 -- 172.21.15.152:0/2798266436 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fbe480594f0 con 0x7fbe540fd8f0 2024-04-06T12:29:34.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.007+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe54108b00 con 0x7fbe3c06cab0 2024-04-06T12:29:34.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.008+0000 7fbe437fe700 1 -- 172.21.15.152:0/2798266436 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fbe54108b00 con 0x7fbe3c06cab0 2024-04-06T12:29:34.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbe3c06cab0 msgr2=0x7fbe3c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbe3c06cab0 0x7fbe3c06ef70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbe541099c0 tx=0x7fbe44009cb0).stop 2024-04-06T12:29:34.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fd8f0 msgr2=0x7fbe5410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fd8f0 0x7fbe5410e080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fbe48002770 tx=0x7fbe48002a80).stop 2024-04-06T12:29:34.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 shutdown_connections 2024-04-06T12:29:34.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbe3c06cab0 0x7fbe3c06ef70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe540fd8f0 0x7fbe5410e080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 --2- 172.21.15.152:0/2798266436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe540fe250 0x7fbe5410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 >> 172.21.15.152:0/2798266436 conn(0x7fbe540f34b0 msgr2=0x7fbe540fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:34.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 shutdown_connections 2024-04-06T12:29:34.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.010+0000 7fbe58d99700 1 -- 172.21.15.152:0/2798266436 wait complete. 2024-04-06T12:29:34.018 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:29:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.110+0000 7f368d4a7700 1 -- 172.21.15.152:0/2820912969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fc7f0 msgr2=0x7f36880fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.110+0000 7f368d4a7700 1 --2- 172.21.15.152:0/2820912969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fc7f0 0x7f36880fcbd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f36780047f0 tx=0x7f3678009cb0).stop 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.110+0000 7f368d4a7700 1 -- 172.21.15.152:0/2820912969 shutdown_connections 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.110+0000 7f368d4a7700 1 --2- 172.21.15.152:0/2820912969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36880fd150 0x7f36880f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.110+0000 7f368d4a7700 1 --2- 172.21.15.152:0/2820912969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fc7f0 0x7f36880fcbd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.110+0000 7f368d4a7700 1 -- 172.21.15.152:0/2820912969 >> 172.21.15.152:0/2820912969 conn(0x7f3688070590 msgr2=0x7f36880f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.110+0000 7f368d4a7700 1 -- 172.21.15.152:0/2820912969 shutdown_connections 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.110+0000 7f368d4a7700 1 -- 172.21.15.152:0/2820912969 wait complete. 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.111+0000 7f368d4a7700 1 Processor -- start 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.111+0000 7f368d4a7700 1 -- start start 2024-04-06T12:29:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.111+0000 7f368d4a7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36880fc7f0 0x7f36880f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.111+0000 7f368d4a7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fd150 0x7f36880f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.111+0000 7f368d4a7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880f8f20 con 0x7f36880fd150 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.111+0000 7f368d4a7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880f9060 con 0x7f36880fc7f0 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f36867fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fd150 0x7f36880f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f36867fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fd150 0x7f36880f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54202/0 (socket says 172.21.15.152:54202) 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f36867fc700 1 -- 172.21.15.152:0/1676218806 learned_addr learned my addr 172.21.15.152:0/1676218806 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f3686ffd700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36880fc7f0 0x7f36880f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f36867fc700 1 -- 172.21.15.152:0/1676218806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36880fc7f0 msgr2=0x7f36880f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f36867fc700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36880fc7f0 0x7f36880f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f36867fc700 1 -- 172.21.15.152:0/1676218806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678005040 con 0x7f36880fd150 2024-04-06T12:29:34.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f36867fc700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fd150 0x7f36880f8a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f367c00e940 tx=0x7f367c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:34.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f366ffff700 1 -- 172.21.15.152:0/1676218806 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f367c007b40 con 0x7f36880fd150 2024-04-06T12:29:34.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36880f92e0 con 0x7f36880fd150 2024-04-06T12:29:34.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f366ffff700 1 -- 172.21.15.152:0/1676218806 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f367c00f040 con 0x7f36880fd150 2024-04-06T12:29:34.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f366ffff700 1 -- 172.21.15.152:0/1676218806 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f367c0148e0 con 0x7f36880fd150 2024-04-06T12:29:34.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.112+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36881147c0 con 0x7f36880fd150 2024-04-06T12:29:34.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.113+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368805f590 con 0x7f36880fd150 2024-04-06T12:29:34.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.114+0000 7f366ffff700 1 -- 172.21.15.152:0/1676218806 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f367c007ca0 con 0x7f36880fd150 2024-04-06T12:29:34.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.114+0000 7f366ffff700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f367006caa0 0x7f367006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:34.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.114+0000 7f366ffff700 1 -- 172.21.15.152:0/1676218806 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f367c08b820 con 0x7f36880fd150 2024-04-06T12:29:34.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.115+0000 7f3686ffd700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f367006caa0 0x7f367006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:34.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.115+0000 7f3686ffd700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f367006caa0 0x7f367006ef60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f36780047c0 tx=0x7f3678009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:34.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.118+0000 7f366ffff700 1 -- 172.21.15.152:0/1676218806 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f367c0559a0 con 0x7f36880fd150 2024-04-06T12:29:34.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.378+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36880fb5a0 con 0x7f367006caa0 2024-04-06T12:29:34.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.379+0000 7f366ffff700 1 -- 172.21.15.152:0/1676218806 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f36880fb5a0 con 0x7f367006caa0 2024-04-06T12:29:34.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f367006caa0 msgr2=0x7f367006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f367006caa0 0x7f367006ef60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f36780047c0 tx=0x7f3678009cb0).stop 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fd150 msgr2=0x7f36880f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fd150 0x7f36880f8a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f367c00e940 tx=0x7f367c00b040).stop 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 shutdown_connections 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f367006caa0 0x7f367006ef60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36880fc7f0 0x7f36880f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 --2- 172.21.15.152:0/1676218806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36880fd150 0x7f36880f8a30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 >> 172.21.15.152:0/1676218806 conn(0x7f3688070590 msgr2=0x7f3688060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 shutdown_connections 2024-04-06T12:29:34.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.382+0000 7f368d4a7700 1 -- 172.21.15.152:0/1676218806 wait complete. 2024-04-06T12:29:34.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.491+0000 7f890b51e700 1 -- 172.21.15.152:0/41148744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 msgr2=0x7f89040f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.491+0000 7f890b51e700 1 --2- 172.21.15.152:0/41148744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 0x7f89040f8c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f88f40047f0 tx=0x7f88f4009cb0).stop 2024-04-06T12:29:34.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.491+0000 7f890b51e700 1 -- 172.21.15.152:0/41148744 shutdown_connections 2024-04-06T12:29:34.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.491+0000 7f890b51e700 1 --2- 172.21.15.152:0/41148744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89040f9200 0x7f8904101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.491+0000 7f890b51e700 1 --2- 172.21.15.152:0/41148744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 0x7f89040f8c80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.491+0000 7f890b51e700 1 -- 172.21.15.152:0/41148744 >> 172.21.15.152:0/41148744 conn(0x7f8904070590 msgr2=0x7f89040f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:34.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.491+0000 7f890b51e700 1 -- 172.21.15.152:0/41148744 shutdown_connections 2024-04-06T12:29:34.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.491+0000 7f890b51e700 1 -- 172.21.15.152:0/41148744 wait complete. 2024-04-06T12:29:34.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f890b51e700 1 Processor -- start 2024-04-06T12:29:34.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f890b51e700 1 -- start start 2024-04-06T12:29:34.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f890b51e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 0x7f890410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:34.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f890b51e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89040f9200 0x7f890410e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:34.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f890b51e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890410eb30 con 0x7f89040f88a0 2024-04-06T12:29:34.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f890b51e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890410ec70 con 0x7f89040f9200 2024-04-06T12:29:34.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f89092ba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 0x7f890410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f89092ba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 0x7f890410e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54234/0 (socket says 172.21.15.152:54234) 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f89092ba700 1 -- 172.21.15.152:0/408052679 learned_addr learned my addr 172.21.15.152:0/408052679 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f89092ba700 1 -- 172.21.15.152:0/408052679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89040f9200 msgr2=0x7f890410e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f8908ab9700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89040f9200 0x7f890410e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f89092ba700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89040f9200 0x7f890410e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.492+0000 7f89092ba700 1 -- 172.21.15.152:0/408052679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f4005040 con 0x7f89040f88a0 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.493+0000 7f89092ba700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 0x7f890410e040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f88f4005010 tx=0x7f88f4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.493+0000 7f88fa7fc700 1 -- 172.21.15.152:0/408052679 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f400e030 con 0x7f89040f88a0 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.493+0000 7f88fa7fc700 1 -- 172.21.15.152:0/408052679 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88f4007e90 con 0x7f89040f88a0 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.493+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89041082a0 con 0x7f89040f88a0 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.493+0000 7f88fa7fc700 1 -- 172.21.15.152:0/408052679 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f4018070 con 0x7f89040f88a0 2024-04-06T12:29:34.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.493+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8904108780 con 0x7f89040f88a0 2024-04-06T12:29:34.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.494+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890405f590 con 0x7f89040f88a0 2024-04-06T12:29:34.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.494+0000 7f88fa7fc700 1 -- 172.21.15.152:0/408052679 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f88f401d6e0 con 0x7f89040f88a0 2024-04-06T12:29:34.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.495+0000 7f88fa7fc700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f88f006ca30 0x7f88f006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:34.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.495+0000 7f8908ab9700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f88f006ca30 0x7f88f006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:34.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.495+0000 7f88fa7fc700 1 -- 172.21.15.152:0/408052679 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f88f408cfa0 con 0x7f89040f88a0 2024-04-06T12:29:34.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.495+0000 7f8908ab9700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f88f006ca30 0x7f88f006eef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8904109980 tx=0x7f890000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:34.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.499+0000 7f88fa7fc700 1 -- 172.21.15.152:0/408052679 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f88f405a920 con 0x7f89040f88a0 2024-04-06T12:29:34.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:34 smithi152 ceph-mon[104634]: pgmap v68: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:34 smithi195 ceph-mon[85980]: pgmap v68: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:34.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.701+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f89040fedd0 con 0x7f88f006ca30 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.711+0000 7f88fa7fc700 1 -- 172.21.15.152:0/408052679 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f89040fedd0 con 0x7f88f006ca30 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (3m) 33s ago 14m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (62s) 33s ago 14m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (57s) 53s ago 14m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (3m) 33s ago 14m 83.9M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (9m) 33s ago 9m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (9m) 33s ago 9m 160M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (9m) 53s ago 9m 14.7M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:29:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (9m) 53s ago 9m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (4m) 33s ago 16m 493M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (4m) 53s ago 14m 448M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (2m) 33s ago 16m 42.9M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (102s) 53s ago 14m 34.0M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 33s ago 14m 16.8M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (3m) 53s ago 13m 17.1M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (38s) 33s ago 13m 13.9M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 starting - - - 1910M 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (12m) 33s ago 12m 178M 1910M 16.2.15-1-g8963e9de 727f386679cb 884da7e56875 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (11m) 53s ago 11m 230M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (11m) 53s ago 11m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (11m) 53s ago 11m 196M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:29:34.710 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (3m) 53s ago 13m 57.8M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:29:34.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f88f006ca30 msgr2=0x7f88f006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f88f006ca30 0x7f88f006eef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8904109980 tx=0x7f890000b040).stop 2024-04-06T12:29:34.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 msgr2=0x7f890410e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 0x7f890410e040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f88f4005010 tx=0x7f88f4009cb0).stop 2024-04-06T12:29:34.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 shutdown_connections 2024-04-06T12:29:34.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f88f006ca30 0x7f88f006eef0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89040f88a0 0x7f890410e040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 --2- 172.21.15.152:0/408052679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89040f9200 0x7f890410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 >> 172.21.15.152:0/408052679 conn(0x7f8904070590 msgr2=0x7f89040fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:34.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 shutdown_connections 2024-04-06T12:29:34.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.714+0000 7f890b51e700 1 -- 172.21.15.152:0/408052679 wait complete. 2024-04-06T12:29:34.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.832+0000 7f858c35e700 1 -- 172.21.15.152:0/2788442590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fe250 msgr2=0x7f85840f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.832+0000 7f858c35e700 1 --2- 172.21.15.152:0/2788442590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fe250 0x7f85840f7a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f85740047f0 tx=0x7f8574009cb0).stop 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.832+0000 7f858c35e700 1 -- 172.21.15.152:0/2788442590 shutdown_connections 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.832+0000 7f858c35e700 1 --2- 172.21.15.152:0/2788442590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fe250 0x7f85840f7a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.832+0000 7f858c35e700 1 --2- 172.21.15.152:0/2788442590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840fd8f0 0x7f85840fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.832+0000 7f858c35e700 1 -- 172.21.15.152:0/2788442590 >> 172.21.15.152:0/2788442590 conn(0x7f85840f34b0 msgr2=0x7f85840f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.833+0000 7f858c35e700 1 -- 172.21.15.152:0/2788442590 shutdown_connections 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.833+0000 7f858c35e700 1 -- 172.21.15.152:0/2788442590 wait complete. 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.833+0000 7f858c35e700 1 Processor -- start 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.833+0000 7f858c35e700 1 -- start start 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858c35e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fd8f0 0x7f8584110220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858c35e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840fe250 0x7f8584110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858c35e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8584110d10 con 0x7f85840fd8f0 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858c35e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8584110e50 con 0x7f85840fe250 2024-04-06T12:29:34.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858a0fa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fd8f0 0x7f8584110220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:34.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858a0fa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fd8f0 0x7f8584110220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54260/0 (socket says 172.21.15.152:54260) 2024-04-06T12:29:34.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858a0fa700 1 -- 172.21.15.152:0/703610982 learned_addr learned my addr 172.21.15.152:0/703610982 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:34.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858a0fa700 1 -- 172.21.15.152:0/703610982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840fe250 msgr2=0x7f8584110710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:34.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f85898f9700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840fe250 0x7f8584110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:34.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858a0fa700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840fe250 0x7f8584110710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:34.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858a0fa700 1 -- 172.21.15.152:0/703610982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574005040 con 0x7f85840fd8f0 2024-04-06T12:29:34.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.834+0000 7f858a0fa700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fd8f0 0x7f8584110220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f85800041d0 tx=0x7f8580009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:34.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.835+0000 7f857b7fe700 1 -- 172.21.15.152:0/703610982 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8580007b40 con 0x7f85840fd8f0 2024-04-06T12:29:34.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.835+0000 7f857b7fe700 1 -- 172.21.15.152:0/703610982 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f858000f040 con 0x7f85840fd8f0 2024-04-06T12:29:34.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.835+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858410a4e0 con 0x7f85840fd8f0 2024-04-06T12:29:34.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.835+0000 7f857b7fe700 1 -- 172.21.15.152:0/703610982 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f858000d800 con 0x7f85840fd8f0 2024-04-06T12:29:34.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.835+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858410aa20 con 0x7f85840fd8f0 2024-04-06T12:29:34.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.836+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858405f590 con 0x7f85840fd8f0 2024-04-06T12:29:34.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.837+0000 7f857b7fe700 1 -- 172.21.15.152:0/703610982 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8580007ca0 con 0x7f85840fd8f0 2024-04-06T12:29:34.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.837+0000 7f857b7fe700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006cb80 0x7f857006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:34.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.837+0000 7f857b7fe700 1 -- 172.21.15.152:0/703610982 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f858008b7d0 con 0x7f85840fd8f0 2024-04-06T12:29:34.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.838+0000 7f85898f9700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006cb80 0x7f857006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:34.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.838+0000 7f85898f9700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006cb80 0x7f857006f040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8574000c00 tx=0x7f8574009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:34.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:34.843+0000 7f857b7fe700 1 -- 172.21.15.152:0/703610982 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f8580059320 con 0x7f85840fd8f0 2024-04-06T12:29:35.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.128+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f85840fca70 con 0x7f85840fd8f0 2024-04-06T12:29:35.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.129+0000 7f857b7fe700 1 -- 172.21.15.152:0/703610982 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f8580058eb0 con 0x7f85840fd8f0 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4, 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:29:35.127 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:29:35.128 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:29:35.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:29:35.128 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:29:35.128 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 8, 2024-04-06T12:29:35.128 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 5 2024-04-06T12:29:35.128 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:29:35.128 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006cb80 msgr2=0x7f857006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006cb80 0x7f857006f040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8574000c00 tx=0x7f8574009cb0).stop 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fd8f0 msgr2=0x7f8584110220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fd8f0 0x7f8584110220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f85800041d0 tx=0x7f8580009f60).stop 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 shutdown_connections 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006cb80 0x7f857006f040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840fd8f0 0x7f8584110220 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 --2- 172.21.15.152:0/703610982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840fe250 0x7f8584110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 >> 172.21.15.152:0/703610982 conn(0x7f85840f34b0 msgr2=0x7f858406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 shutdown_connections 2024-04-06T12:29:35.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.131+0000 7f858c35e700 1 -- 172.21.15.152:0/703610982 wait complete. 2024-04-06T12:29:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.239+0000 7f638e3c3700 1 -- 172.21.15.152:0/2284850890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fc7f0 msgr2=0x7f63880fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.239+0000 7f638e3c3700 1 --2- 172.21.15.152:0/2284850890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fc7f0 0x7f63880fcbd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f63780047f0 tx=0x7f6378009cb0).stop 2024-04-06T12:29:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.239+0000 7f638e3c3700 1 -- 172.21.15.152:0/2284850890 shutdown_connections 2024-04-06T12:29:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.239+0000 7f638e3c3700 1 --2- 172.21.15.152:0/2284850890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63880fd150 0x7f63880f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.240+0000 7f638e3c3700 1 --2- 172.21.15.152:0/2284850890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fc7f0 0x7f63880fcbd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.240+0000 7f638e3c3700 1 -- 172.21.15.152:0/2284850890 >> 172.21.15.152:0/2284850890 conn(0x7f6388070590 msgr2=0x7f63880f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.240+0000 7f638e3c3700 1 -- 172.21.15.152:0/2284850890 shutdown_connections 2024-04-06T12:29:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.240+0000 7f638e3c3700 1 -- 172.21.15.152:0/2284850890 wait complete. 2024-04-06T12:29:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.240+0000 7f638e3c3700 1 Processor -- start 2024-04-06T12:29:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.240+0000 7f638e3c3700 1 -- start start 2024-04-06T12:29:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f638e3c3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63880fc7f0 0x7f63881090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f638e3c3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fd150 0x7f63881095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f638e3c3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6388109ab0 con 0x7f63880fd150 2024-04-06T12:29:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f638e3c3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6388109bf0 con 0x7f63880fc7f0 2024-04-06T12:29:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f63877fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fd150 0x7f63881095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f63877fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fd150 0x7f63881095c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54286/0 (socket says 172.21.15.152:54286) 2024-04-06T12:29:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f6387fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63880fc7f0 0x7f63881090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f63877fe700 1 -- 172.21.15.152:0/1228314675 learned_addr learned my addr 172.21.15.152:0/1228314675 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f63877fe700 1 -- 172.21.15.152:0/1228314675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63880fc7f0 msgr2=0x7f63881090d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f63877fe700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63880fc7f0 0x7f63881090d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f63877fe700 1 -- 172.21.15.152:0/1228314675 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6378005040 con 0x7f63880fd150 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.241+0000 7f63877fe700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fd150 0x7f63881095c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f637c002780 tx=0x7f637c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.242+0000 7f63857fa700 1 -- 172.21.15.152:0/1228314675 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f637c007b40 con 0x7f63880fd150 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.242+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6388109ea0 con 0x7f63880fd150 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.242+0000 7f63857fa700 1 -- 172.21.15.152:0/1228314675 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f637c00f040 con 0x7f63880fd150 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.242+0000 7f63857fa700 1 -- 172.21.15.152:0/1228314675 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f637c014780 con 0x7f63880fd150 2024-04-06T12:29:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.242+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63881124c0 con 0x7f63880fd150 2024-04-06T12:29:35.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.243+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638805f590 con 0x7f63880fd150 2024-04-06T12:29:35.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.243+0000 7f63857fa700 1 -- 172.21.15.152:0/1228314675 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f637c007ca0 con 0x7f63880fd150 2024-04-06T12:29:35.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.244+0000 7f63857fa700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f637006caa0 0x7f637006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:35.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.244+0000 7f63857fa700 1 -- 172.21.15.152:0/1228314675 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f637c08bbf0 con 0x7f63880fd150 2024-04-06T12:29:35.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.244+0000 7f6387fff700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f637006caa0 0x7f637006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:35.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.244+0000 7f6387fff700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f637006caa0 0x7f637006ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6378004f10 tx=0x7f637800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:35.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.248+0000 7f63857fa700 1 -- 172.21.15.152:0/1228314675 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f637c055d70 con 0x7f63880fd150 2024-04-06T12:29:35.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.496+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6388047540 con 0x7f63880fd150 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.497+0000 7f63857fa700 1 -- 172.21.15.152:0/1228314675 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f637c059390 con 0x7f63880fd150 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:29:35.495 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:29:35.496 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:29:35.497 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:29:35.498 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:29:35.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f637006caa0 msgr2=0x7f637006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f637006caa0 0x7f637006ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6378004f10 tx=0x7f637800b040).stop 2024-04-06T12:29:35.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fd150 msgr2=0x7f63881095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fd150 0x7f63881095c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f637c002780 tx=0x7f637c009ee0).stop 2024-04-06T12:29:35.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 shutdown_connections 2024-04-06T12:29:35.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f637006caa0 0x7f637006ef60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63880fc7f0 0x7f63881090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 --2- 172.21.15.152:0/1228314675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63880fd150 0x7f63881095c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 >> 172.21.15.152:0/1228314675 conn(0x7f6388070590 msgr2=0x7f63880fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:35.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 shutdown_connections 2024-04-06T12:29:35.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.499+0000 7f638e3c3700 1 -- 172.21.15.152:0/1228314675 wait complete. 2024-04-06T12:29:35.499 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:29:35.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:35 smithi152 ceph-mon[104634]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:35.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:35 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/703610982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:35.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:35 smithi195 ceph-mon[85980]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:35.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:35 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/703610982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:35.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.610+0000 7ff92b20e700 1 -- 172.21.15.152:0/1581336995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9240fe270 msgr2=0x7ff9240f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.610+0000 7ff92b20e700 1 --2- 172.21.15.152:0/1581336995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9240fe270 0x7ff9240f7a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff9100047f0 tx=0x7ff910009cb0).stop 2024-04-06T12:29:35.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.610+0000 7ff92b20e700 1 -- 172.21.15.152:0/1581336995 shutdown_connections 2024-04-06T12:29:35.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.610+0000 7ff92b20e700 1 --2- 172.21.15.152:0/1581336995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9240fe270 0x7ff9240f7a50 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0x7ff9100047f0 tx=0x7ff910009cb0).stop 2024-04-06T12:29:35.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.610+0000 7ff92b20e700 1 --2- 172.21.15.152:0/1581336995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9240fd910 0x7ff9240fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.610+0000 7ff92b20e700 1 -- 172.21.15.152:0/1581336995 >> 172.21.15.152:0/1581336995 conn(0x7ff9240f3510 msgr2=0x7ff9240f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:35.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.611+0000 7ff92b20e700 1 -- 172.21.15.152:0/1581336995 shutdown_connections 2024-04-06T12:29:35.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.611+0000 7ff92b20e700 1 -- 172.21.15.152:0/1581336995 wait complete. 2024-04-06T12:29:35.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.611+0000 7ff92b20e700 1 Processor -- start 2024-04-06T12:29:35.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff92b20e700 1 -- start start 2024-04-06T12:29:35.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff92b20e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9240fd910 0x7ff92406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff92b20e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92406b5c0 0x7ff92406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff92b20e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92406cee0 con 0x7ff9240fd910 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff92b20e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9241146f0 con 0x7ff92406b5c0 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff928faa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9240fd910 0x7ff92406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff923fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92406b5c0 0x7ff92406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff928faa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9240fd910 0x7ff92406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54302/0 (socket says 172.21.15.152:54302) 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff923fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92406b5c0 0x7ff92406ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:59840/0 (socket says 172.21.15.152:59840) 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff928faa700 1 -- 172.21.15.152:0/4114876912 learned_addr learned my addr 172.21.15.152:0/4114876912 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff923fff700 1 -- 172.21.15.152:0/4114876912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9240fd910 msgr2=0x7ff92406b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff923fff700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9240fd910 0x7ff92406b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.612+0000 7ff923fff700 1 -- 172.21.15.152:0/4114876912 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910005040 con 0x7ff92406b5c0 2024-04-06T12:29:35.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.613+0000 7ff923fff700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92406b5c0 0x7ff92406ba40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff9240f8ac0 tx=0x7ff91000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:35.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.613+0000 7ff921ffb700 1 -- 172.21.15.152:0/4114876912 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff910019070 con 0x7ff92406b5c0 2024-04-06T12:29:35.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.613+0000 7ff921ffb700 1 -- 172.21.15.152:0/4114876912 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff910007e90 con 0x7ff92406b5c0 2024-04-06T12:29:35.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.613+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff924114830 con 0x7ff92406b5c0 2024-04-06T12:29:35.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.613+0000 7ff921ffb700 1 -- 172.21.15.152:0/4114876912 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91001dc30 con 0x7ff92406b5c0 2024-04-06T12:29:35.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.613+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff924114cc0 con 0x7ff92406b5c0 2024-04-06T12:29:35.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.614+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff924060650 con 0x7ff92406b5c0 2024-04-06T12:29:35.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.615+0000 7ff921ffb700 1 -- 172.21.15.152:0/4114876912 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff9100263a0 con 0x7ff92406b5c0 2024-04-06T12:29:35.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.616+0000 7ff921ffb700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff91406caa0 0x7ff91406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:35.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.616+0000 7ff921ffb700 1 -- 172.21.15.152:0/4114876912 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7ff91008c900 con 0x7ff92406b5c0 2024-04-06T12:29:35.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.616+0000 7ff928faa700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff91406caa0 0x7ff91406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:35.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.616+0000 7ff928faa700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff91406caa0 0x7ff91406ef60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff918004990 tx=0x7ff91800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:35.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.621+0000 7ff921ffb700 1 -- 172.21.15.152:0/4114876912 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7ff910056b40 con 0x7ff92406b5c0 2024-04-06T12:29:35.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.853+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff92406c600 con 0x7ff91406caa0 2024-04-06T12:29:35.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.854+0000 7ff921ffb700 1 -- 172.21.15.152:0/4114876912 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff92406c600 con 0x7ff91406caa0 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "crash" 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "7/21 daemons upgraded", 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:29:35.855 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:29:35.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff91406caa0 msgr2=0x7ff91406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff91406caa0 0x7ff91406ef60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff918004990 tx=0x7ff91800b040).stop 2024-04-06T12:29:35.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92406b5c0 msgr2=0x7ff92406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92406b5c0 0x7ff92406ba40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff9240f8ac0 tx=0x7ff91000b040).stop 2024-04-06T12:29:35.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 shutdown_connections 2024-04-06T12:29:35.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff91406caa0 0x7ff91406ef60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9240fd910 0x7ff92406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 --2- 172.21.15.152:0/4114876912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92406b5c0 0x7ff92406ba40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 >> 172.21.15.152:0/4114876912 conn(0x7ff9240f3510 msgr2=0x7ff9240fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:35.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 shutdown_connections 2024-04-06T12:29:35.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.856+0000 7ff92b20e700 1 -- 172.21.15.152:0/4114876912 wait complete. 2024-04-06T12:29:35.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.955+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/43209469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 msgr2=0x7f5ef00f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.955+0000 7f5ef6c4b700 1 --2- 172.21.15.152:0/43209469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 0x7f5ef00f6960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5edc0047f0 tx=0x7f5edc009cb0).stop 2024-04-06T12:29:35.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.955+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/43209469 shutdown_connections 2024-04-06T12:29:35.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.955+0000 7f5ef6c4b700 1 --2- 172.21.15.152:0/43209469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 0x7f5ef00f6960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.955+0000 7f5ef6c4b700 1 --2- 172.21.15.152:0/43209469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ef00fc820 0x7f5ef00fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.955+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/43209469 >> 172.21.15.152:0/43209469 conn(0x7f5ef00f2400 msgr2=0x7f5ef00f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:35.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/43209469 shutdown_connections 2024-04-06T12:29:35.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/43209469 wait complete. 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5ef6c4b700 1 Processor -- start 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5ef6c4b700 1 -- start start 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5ef6c4b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ef00fc820 0x7f5ef0110390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5ef6c4b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 0x7f5ef0110880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5ef6c4b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0110e80 con 0x7f5ef00fd180 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5ef6c4b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0110fc0 con 0x7f5ef00fc820 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5eeffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 0x7f5ef0110880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5eeffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 0x7f5ef0110880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54322/0 (socket says 172.21.15.152:54322) 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.956+0000 7f5eeffff700 1 -- 172.21.15.152:0/488149037 learned_addr learned my addr 172.21.15.152:0/488149037 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:29:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5ef49e7700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ef00fc820 0x7f5ef0110390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5eeffff700 1 -- 172.21.15.152:0/488149037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ef00fc820 msgr2=0x7f5ef0110390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5eeffff700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ef00fc820 0x7f5ef0110390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5eeffff700 1 -- 172.21.15.152:0/488149037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc005040 con 0x7f5ef00fd180 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5eeffff700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 0x7f5ef0110880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f5edc0099f0 tx=0x7f5edc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5eedffb700 1 -- 172.21.15.152:0/488149037 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5edc00e030 con 0x7f5ef00fd180 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef010a5f0 con 0x7f5ef00fd180 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5eedffb700 1 -- 172.21.15.152:0/488149037 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5edc007e90 con 0x7f5ef00fd180 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5eedffb700 1 -- 172.21.15.152:0/488149037 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5edc018070 con 0x7f5ef00fd180 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.957+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef010aad0 con 0x7f5ef00fd180 2024-04-06T12:29:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.958+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef0060330 con 0x7f5ef00fd180 2024-04-06T12:29:35.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.959+0000 7f5eedffb700 1 -- 172.21.15.152:0/488149037 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5edc01d420 con 0x7f5ef00fd180 2024-04-06T12:29:35.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.959+0000 7f5eedffb700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5ee006caa0 0x7f5ee006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:29:35.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.959+0000 7f5eedffb700 1 -- 172.21.15.152:0/488149037 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f5edc08d180 con 0x7f5ef00fd180 2024-04-06T12:29:35.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.959+0000 7f5ef49e7700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5ee006caa0 0x7f5ee006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:29:35.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.959+0000 7f5ef49e7700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5ee006caa0 0x7f5ee006ef60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5ee4004ac0 tx=0x7f5ee4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:29:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:35.964+0000 7f5eedffb700 1 -- 172.21.15.152:0/488149037 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f5edc05ad90 con 0x7f5ef00fd180 2024-04-06T12:29:36.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.244+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5ef0047540 con 0x7f5ef00fd180 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.245+0000 7f5eedffb700 1 -- 172.21.15.152:0/488149037 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1182 (secure 0 0 0) 0x7f5edc05a920 con 0x7f5ef00fd180 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 36/267 objects degraded (13.483%), 13 pgs degraded 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout: osd.1 (root=default,host=smithi152) is down 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 36/267 objects degraded (13.483%), 13 pgs degraded 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-04-06T12:29:36.243 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-04-06T12:29:36.244 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-04-06T12:29:36.244 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-04-06T12:29:36.244 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-04-06T12:29:36.244 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-04-06T12:29:36.244 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-04-06T12:29:36.244 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-04-06T12:29:36.244 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-04-06T12:29:36.244 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-04-06T12:29:36.244 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5ee006caa0 msgr2=0x7f5ee006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5ee006caa0 0x7f5ee006ef60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5ee4004ac0 tx=0x7f5ee4009040).stop 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 msgr2=0x7f5ef0110880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 0x7f5ef0110880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f5edc0099f0 tx=0x7f5edc009cb0).stop 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 shutdown_connections 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5ee006caa0 0x7f5ee006ef60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ef00fc820 0x7f5ef0110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 --2- 172.21.15.152:0/488149037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef00fd180 0x7f5ef0110880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 >> 172.21.15.152:0/488149037 conn(0x7f5ef00f2400 msgr2=0x7f5ef00fabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 shutdown_connections 2024-04-06T12:29:36.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:29:36.247+0000 7f5ef6c4b700 1 -- 172.21.15.152:0/488149037 wait complete. 2024-04-06T12:29:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:36 smithi152 ceph-mon[104634]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:36 smithi152 ceph-mon[104634]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:36.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:36 smithi152 ceph-mon[104634]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:36.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:36 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1228314675' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:29:36.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:36 smithi195 ceph-mon[85980]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:36.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:36 smithi195 ceph-mon[85980]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:36.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:36 smithi195 ceph-mon[85980]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:36.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:36 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1228314675' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:29:37.525 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[126127]: 2024-04-06T12:29:37.165+0000 7f6899ad7640 -1 osd.1 0 read_superblock omap replica is missing. 2024-04-06T12:29:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:37 smithi152 ceph-mon[104634]: from='client.44167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:37 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/488149037' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:29:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:29:37.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:37 smithi195 ceph-mon[85980]: from='client.44167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:29:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:37 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/488149037' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:29:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:29:37.871 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:37 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[126127]: 2024-04-06T12:29:37.564+0000 7f6899ad7640 -1 osd.1 54 log_to_monitors true 2024-04-06T12:29:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:38 smithi152 ceph-mon[104634]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:38 smithi152 ceph-mon[104634]: from='osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-06T12:29:38.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:38 smithi195 ceph-mon[85980]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:38.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:38 smithi195 ceph-mon[85980]: from='osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-06T12:29:39.525 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:29:39 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[126127]: 2024-04-06T12:29:39.237+0000 7f6886f28700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T12:29:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:39 smithi152 ceph-mon[104634]: from='osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-06T12:29:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:39 smithi152 ceph-mon[104634]: osdmap e57: 6 total, 5 up, 6 in 2024-04-06T12:29:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:39 smithi152 ceph-mon[104634]: from='osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:29:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:39 smithi152 ceph-mon[104634]: pgmap v72: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:39 smithi152 ceph-mon[104634]: from='osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342]' entity='osd.1' 2024-04-06T12:29:39.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:39 smithi195 ceph-mon[85980]: from='osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-06T12:29:39.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:39 smithi195 ceph-mon[85980]: osdmap e57: 6 total, 5 up, 6 in 2024-04-06T12:29:39.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:39 smithi195 ceph-mon[85980]: from='osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:29:39.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:39 smithi195 ceph-mon[85980]: pgmap v72: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:39.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:39 smithi195 ceph-mon[85980]: from='osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342]' entity='osd.1' 2024-04-06T12:29:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:40 smithi152 ceph-mon[104634]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:29:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:40 smithi152 ceph-mon[104634]: osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342] boot 2024-04-06T12:29:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:40 smithi152 ceph-mon[104634]: osdmap e58: 6 total, 6 up, 6 in 2024-04-06T12:29:41.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:40 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:29:41.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:40 smithi195 ceph-mon[85980]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:29:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:40 smithi195 ceph-mon[85980]: osd.1 [v2:172.21.15.152:6810/697648342,v1:172.21.15.152:6811/697648342] boot 2024-04-06T12:29:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:40 smithi195 ceph-mon[85980]: osdmap e58: 6 total, 6 up, 6 in 2024-04-06T12:29:41.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:40 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-06T12:29:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: pgmap v74: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: osdmap e59: 6 total, 6 up, 6 in 2024-04-06T12:29:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:29:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:29:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:29:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:42.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:42 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: pgmap v74: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 36/267 objects degraded (13.483%) 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: osdmap e59: 6 total, 6 up, 6 in 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:29:42.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:42 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-06T12:29:43.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:43 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-06T12:29:43.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:43 smithi152 ceph-mon[104634]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-06T12:29:43.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:43 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-06T12:29:43.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:43 smithi195 ceph-mon[85980]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-06T12:29:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:44 smithi152 ceph-mon[104634]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 18/267 objects degraded (6.742%) 2024-04-06T12:29:44.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:44 smithi152 ceph-mon[104634]: Health check update: Degraded data redundancy: 18/267 objects degraded (6.742%), 7 pgs degraded (PG_DEGRADED) 2024-04-06T12:29:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:44 smithi195 ceph-mon[85980]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 18/267 objects degraded (6.742%) 2024-04-06T12:29:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:44 smithi195 ceph-mon[85980]: Health check update: Degraded data redundancy: 18/267 objects degraded (6.742%), 7 pgs degraded (PG_DEGRADED) 2024-04-06T12:29:45.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:45 smithi195 ceph-mon[85980]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 768 B/s rd, 1 op/s 2024-04-06T12:29:45.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:45 smithi195 ceph-mon[85980]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 7 pgs degraded) 2024-04-06T12:29:45.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:45 smithi152 ceph-mon[104634]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 768 B/s rd, 1 op/s 2024-04-06T12:29:45.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:45 smithi152 ceph-mon[104634]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 7 pgs degraded) 2024-04-06T12:29:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:48 smithi152 ceph-mon[104634]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T12:29:48.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:48 smithi195 ceph-mon[85980]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 0 op/s 2024-04-06T12:29:50.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:49 smithi152 ceph-mon[104634]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-06T12:29:50.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:49 smithi195 ceph-mon[85980]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-06T12:29:52.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:52 smithi152 ceph-mon[104634]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T12:29:52.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:52.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:29:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:52 smithi195 ceph-mon[85980]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T12:29:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:52.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:29:53.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:53 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:53.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:53 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:54 smithi152 ceph-mon[104634]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-06T12:29:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:54 smithi195 ceph-mon[85980]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-06T12:29:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:56 smithi152 ceph-mon[104634]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:29:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:56 smithi195 ceph-mon[85980]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:29:57.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-06T12:29:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-06T12:29:58.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:58 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-06T12:29:58.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:58 smithi152 ceph-mon[104634]: Upgrade: osd.2 is safe to restart 2024-04-06T12:29:58.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:58 smithi152 ceph-mon[104634]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:29:58.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:58.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-06T12:29:58.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:29:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:58 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-06T12:29:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:58 smithi195 ceph-mon[85980]: Upgrade: osd.2 is safe to restart 2024-04-06T12:29:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:58 smithi195 ceph-mon[85980]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:29:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:29:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-06T12:29:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:29:59.482 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:59 smithi152 ceph-mon[104634]: Upgrade: Updating osd.2 2024-04-06T12:29:59.482 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:29:59 smithi152 ceph-mon[104634]: Deploying daemon osd.2 on smithi152 2024-04-06T12:29:59.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:59 smithi195 ceph-mon[85980]: Upgrade: Updating osd.2 2024-04-06T12:29:59.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:29:59 smithi195 ceph-mon[85980]: Deploying daemon osd.2 on smithi152 2024-04-06T12:30:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:00 smithi152 ceph-mon[104634]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:30:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:00 smithi152 ceph-mon[104634]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:30:00.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:00 smithi195 ceph-mon[85980]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:30:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:00 smithi195 ceph-mon[85980]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:30:01.525 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:01 smithi152 systemd[1]: Stopping Ceph osd.2 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:30:01.526 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[65311]: debug 2024-04-06T12:30:01.506+0000 7f03ff907700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-06T12:30:01.526 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[65311]: debug 2024-04-06T12:30:01.506+0000 7f03ff907700 -1 osd.2 59 *** Got signal Terminated *** 2024-04-06T12:30:01.526 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[65311]: debug 2024-04-06T12:30:01.506+0000 7f03ff907700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:30:02.478 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:02 smithi152 ceph-mon[104634]: pgmap v85: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:30:02.479 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:02 smithi152 ceph-mon[104634]: osd.2 marked itself down and dead 2024-04-06T12:30:02.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:02 smithi195 ceph-mon[85980]: pgmap v85: 65 pgs: 65 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:30:02.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:02 smithi195 ceph-mon[85980]: osd.2 marked itself down and dead 2024-04-06T12:30:02.775 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:02 smithi152 bash[132261]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2 2024-04-06T12:30:03.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:03 smithi152 ceph-mon[104634]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:30:03.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:03 smithi152 ceph-mon[104634]: osdmap e60: 6 total, 5 up, 6 in 2024-04-06T12:30:03.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:03 smithi195 ceph-mon[85980]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:30:03.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:03 smithi195 ceph-mon[85980]: osdmap e60: 6 total, 5 up, 6 in 2024-04-06T12:30:04.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:04 smithi195 ceph-mon[85980]: pgmap v87: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T12:30:04.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:04 smithi195 ceph-mon[85980]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-06T12:30:04.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:04 smithi195 ceph-mon[85980]: osdmap e61: 6 total, 5 up, 6 in 2024-04-06T12:30:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:04 smithi152 ceph-mon[104634]: pgmap v87: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T12:30:04.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:04 smithi152 ceph-mon[104634]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-06T12:30:04.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:04 smithi152 ceph-mon[104634]: osdmap e61: 6 total, 5 up, 6 in 2024-04-06T12:30:05.026 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:04 smithi152 systemd[1]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.2.service: Succeeded. 2024-04-06T12:30:05.026 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:04 smithi152 systemd[1]: Stopped Ceph osd.2 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:30:05.026 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:04 smithi152 systemd[1]: Starting Ceph osd.2 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:30:05.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:05 smithi152 ceph-mon[104634]: Health check failed: Degraded data redundancy: 15/267 objects degraded (5.618%), 3 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:05.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:05 smithi195 ceph-mon[85980]: Health check failed: Degraded data redundancy: 15/267 objects degraded (5.618%), 3 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:06.025 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:05 smithi152 bash[132534]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-06T12:30:06.025 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:05 smithi152 bash[132534]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-06T12:30:06.025 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:05 smithi152 bash[132534]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-06T12:30:06.025 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:05 smithi152 bash[132534]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-06T12:30:06.026 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:05 smithi152 bash[132534]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-06T12:30:06.026 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:05 smithi152 bash[132534]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-06T12:30:06.026 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:05 smithi152 bash[132534]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-06T12:30:06.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:06 smithi152 ceph-mon[104634]: pgmap v89: 65 pgs: 3 active+undersized+degraded, 12 peering, 3 stale+active+clean, 4 active+undersized, 43 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 15/267 objects degraded (5.618%) 2024-04-06T12:30:06.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.352+0000 7f93c3456700 1 -- 172.21.15.152:0/188213073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 msgr2=0x7f93bc0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:06.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.352+0000 7f93c3456700 1 --2- 172.21.15.152:0/188213073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 0x7f93bc0f7a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f93ac0047f0 tx=0x7f93ac009cb0).stop 2024-04-06T12:30:06.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.352+0000 7f93c3456700 1 -- 172.21.15.152:0/188213073 shutdown_connections 2024-04-06T12:30:06.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.352+0000 7f93c3456700 1 --2- 172.21.15.152:0/188213073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 0x7f93bc0f7a30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.352+0000 7f93c3456700 1 --2- 172.21.15.152:0/188213073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93bc0fd8f0 0x7f93bc0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.352+0000 7f93c3456700 1 -- 172.21.15.152:0/188213073 >> 172.21.15.152:0/188213073 conn(0x7f93bc0f34b0 msgr2=0x7f93bc0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:06.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.352+0000 7f93c3456700 1 -- 172.21.15.152:0/188213073 shutdown_connections 2024-04-06T12:30:06.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.352+0000 7f93c3456700 1 -- 172.21.15.152:0/188213073 wait complete. 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c3456700 1 Processor -- start 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c3456700 1 -- start start 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c3456700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93bc0fd8f0 0x7f93bc06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c3456700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 0x7f93bc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c3456700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc06bab0 con 0x7f93bc0fe250 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c3456700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc06bbf0 con 0x7f93bc0fd8f0 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c09f1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 0x7f93bc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c09f1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 0x7f93bc06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53996/0 (socket says 172.21.15.152:53996) 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c09f1700 1 -- 172.21.15.152:0/1611603827 learned_addr learned my addr 172.21.15.152:0/1611603827 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c11f2700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93bc0fd8f0 0x7f93bc06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c09f1700 1 -- 172.21.15.152:0/1611603827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93bc0fd8f0 msgr2=0x7f93bc06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c09f1700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93bc0fd8f0 0x7f93bc06b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c09f1700 1 -- 172.21.15.152:0/1611603827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac005040 con 0x7f93bc0fe250 2024-04-06T12:30:06.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93c09f1700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 0x7f93bc06b5c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f93ac000c00 tx=0x7f93ac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:06.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.353+0000 7f93b27fc700 1 -- 172.21.15.152:0/1611603827 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93ac018070 con 0x7f93bc0fe250 2024-04-06T12:30:06.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.354+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc06be40 con 0x7f93bc0fe250 2024-04-06T12:30:06.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.354+0000 7f93b27fc700 1 -- 172.21.15.152:0/1611603827 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93ac007e90 con 0x7f93bc0fe250 2024-04-06T12:30:06.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.354+0000 7f93b27fc700 1 -- 172.21.15.152:0/1611603827 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93ac01de20 con 0x7f93bc0fe250 2024-04-06T12:30:06.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.354+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc114740 con 0x7f93bc0fe250 2024-04-06T12:30:06.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.355+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc05f590 con 0x7f93bc0fe250 2024-04-06T12:30:06.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.355+0000 7f93b27fc700 1 -- 172.21.15.152:0/1611603827 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f93ac01d420 con 0x7f93bc0fe250 2024-04-06T12:30:06.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.355+0000 7f93b27fc700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f93a806ca30 0x7f93a806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:06.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.355+0000 7f93b27fc700 1 -- 172.21.15.152:0/1611603827 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f93ac08c890 con 0x7f93bc0fe250 2024-04-06T12:30:06.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.355+0000 7f93c11f2700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f93a806ca30 0x7f93a806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:06.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.356+0000 7f93c11f2700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f93a806ca30 0x7f93a806eef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f93b80048b0 tx=0x7f93b800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:06.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.360+0000 7f93b27fc700 1 -- 172.21.15.152:0/1611603827 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f93ac056a10 con 0x7f93bc0fe250 2024-04-06T12:30:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:06 smithi195 ceph-mon[85980]: pgmap v89: 65 pgs: 3 active+undersized+degraded, 12 peering, 3 stale+active+clean, 4 active+undersized, 43 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 15/267 objects degraded (5.618%) 2024-04-06T12:30:06.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.589+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93bc059120 con 0x7f93a806ca30 2024-04-06T12:30:06.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.590+0000 7f93b27fc700 1 -- 172.21.15.152:0/1611603827 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f93bc059120 con 0x7f93a806ca30 2024-04-06T12:30:06.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f93a806ca30 msgr2=0x7f93a806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f93a806ca30 0x7f93a806eef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f93b80048b0 tx=0x7f93b800b040).stop 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 msgr2=0x7f93bc06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 0x7f93bc06b5c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f93ac000c00 tx=0x7f93ac009cb0).stop 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 shutdown_connections 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f93a806ca30 0x7f93a806eef0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93bc0fd8f0 0x7f93bc06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 --2- 172.21.15.152:0/1611603827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93bc0fe250 0x7f93bc06b5c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 >> 172.21.15.152:0/1611603827 conn(0x7f93bc0f34b0 msgr2=0x7f93bc0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 shutdown_connections 2024-04-06T12:30:06.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.593+0000 7f93c3456700 1 -- 172.21.15.152:0/1611603827 wait complete. 2024-04-06T12:30:06.601 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:30:06.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.693+0000 7f22110ed700 1 -- 172.21.15.152:0/1582932841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 msgr2=0x7f220c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:06.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.693+0000 7f22110ed700 1 --2- 172.21.15.152:0/1582932841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 0x7f220c0fcbd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f22000047f0 tx=0x7f2200009cb0).stop 2024-04-06T12:30:06.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.693+0000 7f22110ed700 1 -- 172.21.15.152:0/1582932841 shutdown_connections 2024-04-06T12:30:06.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.693+0000 7f22110ed700 1 --2- 172.21.15.152:0/1582932841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f220c0fd150 0x7f220c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.693+0000 7f22110ed700 1 --2- 172.21.15.152:0/1582932841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 0x7f220c0fcbd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.693+0000 7f22110ed700 1 -- 172.21.15.152:0/1582932841 >> 172.21.15.152:0/1582932841 conn(0x7f220c070590 msgr2=0x7f220c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:06.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.694+0000 7f22110ed700 1 -- 172.21.15.152:0/1582932841 shutdown_connections 2024-04-06T12:30:06.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.694+0000 7f22110ed700 1 -- 172.21.15.152:0/1582932841 wait complete. 2024-04-06T12:30:06.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.694+0000 7f22110ed700 1 Processor -- start 2024-04-06T12:30:06.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f22110ed700 1 -- start start 2024-04-06T12:30:06.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f22110ed700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 0x7f220c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:06.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f22110ed700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f220c0fd150 0x7f220c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:06.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f22110ed700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c10eae0 con 0x7f220c0fc7f0 2024-04-06T12:30:06.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f22110ed700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c10ec20 con 0x7f220c0fd150 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f220ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 0x7f220c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f220ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 0x7f220c10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54018/0 (socket says 172.21.15.152:54018) 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f220ad9d700 1 -- 172.21.15.152:0/1628715578 learned_addr learned my addr 172.21.15.152:0/1628715578 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f220a59c700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f220c0fd150 0x7f220c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f220ad9d700 1 -- 172.21.15.152:0/1628715578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f220c0fd150 msgr2=0x7f220c10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f220ad9d700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f220c0fd150 0x7f220c10e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f220ad9d700 1 -- 172.21.15.152:0/1628715578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200005040 con 0x7f220c0fc7f0 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f220ad9d700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 0x7f220c10dff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2200005010 tx=0x7f2200009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f21f3fff700 1 -- 172.21.15.152:0/1628715578 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f220000e030 con 0x7f220c0fc7f0 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f21f3fff700 1 -- 172.21.15.152:0/1628715578 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2200007e90 con 0x7f220c0fc7f0 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.695+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c108250 con 0x7f220c0fc7f0 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.696+0000 7f21f3fff700 1 -- 172.21.15.152:0/1628715578 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2200018070 con 0x7f220c0fc7f0 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.696+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c1087b0 con 0x7f220c0fc7f0 2024-04-06T12:30:06.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.697+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c05f590 con 0x7f220c0fc7f0 2024-04-06T12:30:06.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.697+0000 7f21f3fff700 1 -- 172.21.15.152:0/1628715578 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f220001d670 con 0x7f220c0fc7f0 2024-04-06T12:30:06.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.697+0000 7f21f3fff700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f21f406caa0 0x7f21f406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:06.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.698+0000 7f21f3fff700 1 -- 172.21.15.152:0/1628715578 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f220008cf70 con 0x7f220c0fc7f0 2024-04-06T12:30:06.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.698+0000 7f220a59c700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f21f406caa0 0x7f21f406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:06.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.698+0000 7f220a59c700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f21f406caa0 0x7f21f406ef60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f220c109930 tx=0x7f21fc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:06.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.702+0000 7f21f3fff700 1 -- 172.21.15.152:0/1628715578 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f22000c02c0 con 0x7f220c0fc7f0 2024-04-06T12:30:06.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.918+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f220c108df0 con 0x7f21f406caa0 2024-04-06T12:30:06.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.919+0000 7f21f3fff700 1 -- 172.21.15.152:0/1628715578 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f220c108df0 con 0x7f21f406caa0 2024-04-06T12:30:06.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.921+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f21f406caa0 msgr2=0x7f21f406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:06.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.921+0000 7f22110ed700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f21f406caa0 0x7f21f406ef60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f220c109930 tx=0x7f21fc00b040).stop 2024-04-06T12:30:06.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.922+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 msgr2=0x7f220c10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:06.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.922+0000 7f22110ed700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 0x7f220c10dff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2200005010 tx=0x7f2200009cb0).stop 2024-04-06T12:30:06.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.922+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 shutdown_connections 2024-04-06T12:30:06.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.922+0000 7f22110ed700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f21f406caa0 0x7f21f406ef60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.922+0000 7f22110ed700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f220c0fc7f0 0x7f220c10dff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.922+0000 7f22110ed700 1 --2- 172.21.15.152:0/1628715578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f220c0fd150 0x7f220c10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:06.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.922+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 >> 172.21.15.152:0/1628715578 conn(0x7f220c070590 msgr2=0x7f220c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:06.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.922+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 shutdown_connections 2024-04-06T12:30:06.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:06.922+0000 7f22110ed700 1 -- 172.21.15.152:0/1628715578 wait complete. 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.025+0000 7f4d09e67700 1 -- 172.21.15.152:0/981003339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f91f0 msgr2=0x7f4d04101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.025+0000 7f4d09e67700 1 --2- 172.21.15.152:0/981003339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f91f0 0x7f4d04101990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4cf80047f0 tx=0x7f4cf8009cb0).stop 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.025+0000 7f4d09e67700 1 -- 172.21.15.152:0/981003339 shutdown_connections 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.025+0000 7f4d09e67700 1 --2- 172.21.15.152:0/981003339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f91f0 0x7f4d04101990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.025+0000 7f4d09e67700 1 --2- 172.21.15.152:0/981003339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d040f8920 0x7f4d040f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.025+0000 7f4d09e67700 1 -- 172.21.15.152:0/981003339 >> 172.21.15.152:0/981003339 conn(0x7f4d04070590 msgr2=0x7f4d040f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.025+0000 7f4d09e67700 1 -- 172.21.15.152:0/981003339 shutdown_connections 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.025+0000 7f4d09e67700 1 -- 172.21.15.152:0/981003339 wait complete. 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.026+0000 7f4d09e67700 1 Processor -- start 2024-04-06T12:30:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.026+0000 7f4d09e67700 1 -- start start 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d09e67700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f8920 0x7f4d0410e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d09e67700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d040f91f0 0x7f4d0410e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d09e67700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0410eb00 con 0x7f4d040f8920 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d09e67700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0410ec40 con 0x7f4d040f91f0 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d037fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f8920 0x7f4d0410e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d037fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f8920 0x7f4d0410e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54042/0 (socket says 172.21.15.152:54042) 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d037fe700 1 -- 172.21.15.152:0/1038190639 learned_addr learned my addr 172.21.15.152:0/1038190639 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d02ffd700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d040f91f0 0x7f4d0410e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d037fe700 1 -- 172.21.15.152:0/1038190639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d040f91f0 msgr2=0x7f4d0410e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d037fe700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d040f91f0 0x7f4d0410e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d037fe700 1 -- 172.21.15.152:0/1038190639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8005040 con 0x7f4d040f8920 2024-04-06T12:30:07.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d037fe700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f8920 0x7f4d0410e010 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f4cf40041d0 tx=0x7f4cf4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:07.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d00ff9700 1 -- 172.21.15.152:0/1038190639 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf4002d90 con 0x7f4d040f8920 2024-04-06T12:30:07.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d041082d0 con 0x7f4d040f8920 2024-04-06T12:30:07.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d00ff9700 1 -- 172.21.15.152:0/1038190639 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4cf400f040 con 0x7f4d040f8920 2024-04-06T12:30:07.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d00ff9700 1 -- 172.21.15.152:0/1038190639 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf400d800 con 0x7f4d040f8920 2024-04-06T12:30:07.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.027+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d04108810 con 0x7f4d040f8920 2024-04-06T12:30:07.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.028+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0405f590 con 0x7f4d040f8920 2024-04-06T12:30:07.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.029+0000 7f4d00ff9700 1 -- 172.21.15.152:0/1038190639 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4cf400dac0 con 0x7f4d040f8920 2024-04-06T12:30:07.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.029+0000 7f4d00ff9700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cec06caa0 0x7f4cec06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:07.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.029+0000 7f4d00ff9700 1 -- 172.21.15.152:0/1038190639 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f4cf408bd60 con 0x7f4d040f8920 2024-04-06T12:30:07.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.029+0000 7f4d02ffd700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cec06caa0 0x7f4cec06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:07.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.030+0000 7f4d02ffd700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cec06caa0 0x7f4cec06ef60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4cf8004f10 tx=0x7f4cf800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:07.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.034+0000 7f4d00ff9700 1 -- 172.21.15.152:0/1038190639 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f4cf4059970 con 0x7f4d040f8920 2024-04-06T12:30:07.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.272+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d04108a90 con 0x7f4cec06caa0 2024-04-06T12:30:07.275 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:06 smithi152 ceph-osd[132886]: -- 172.21.15.152:0/1912061135 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562c542a51e0 con 0x562c54275000 2024-04-06T12:30:07.275 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:07 smithi152 bash[132820]: 36456f3aa1ebdc4f3ad1c3385b44f3182691d7b1dd942a5922ba92f6e652aa5b 2024-04-06T12:30:07.275 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:07 smithi152 systemd[1]: Started Ceph osd.2 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:30:07.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.288+0000 7f4d00ff9700 1 -- 172.21.15.152:0/1038190639 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4d04108a90 con 0x7f4cec06caa0 2024-04-06T12:30:07.286 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:30:07.286 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (3m) 30s ago 15m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:30:07.286 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (95s) 30s ago 15m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:30:07.286 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (90s) 85s ago 14m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:30:07.286 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (3m) 30s ago 15m 90.2M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:30:07.286 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (9m) 30s ago 9m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:30:07.286 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (10m) 30s ago 10m 160M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (10m) 85s ago 10m 14.7M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (9m) 85s ago 9m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (5m) 30s ago 16m 495M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (4m) 85s ago 14m 448M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (2m) 30s ago 16m 45.0M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (2m) 85s ago 14m 34.0M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 30s ago 14m 17.1M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (4m) 85s ago 14m 17.1M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (70s) 30s ago 13m 84.7M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (35s) 30s ago 13m 11.2M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 4e01281def3c 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 starting - - - 1910M 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (12m) 85s ago 12m 230M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (12m) 85s ago 12m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:30:07.287 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (11m) 85s ago 11m 196M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:30:07.288 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (4m) 85s ago 14m 57.8M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:30:07.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cec06caa0 msgr2=0x7f4cec06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cec06caa0 0x7f4cec06ef60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4cf8004f10 tx=0x7f4cf800b040).stop 2024-04-06T12:30:07.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f8920 msgr2=0x7f4d0410e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f8920 0x7f4d0410e010 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f4cf40041d0 tx=0x7f4cf4009f60).stop 2024-04-06T12:30:07.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 shutdown_connections 2024-04-06T12:30:07.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4cec06caa0 0x7f4cec06ef60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d040f8920 0x7f4d0410e010 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 --2- 172.21.15.152:0/1038190639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d040f91f0 0x7f4d0410e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 >> 172.21.15.152:0/1038190639 conn(0x7f4d04070590 msgr2=0x7f4d040fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:07.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 shutdown_connections 2024-04-06T12:30:07.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.290+0000 7f4d09e67700 1 -- 172.21.15.152:0/1038190639 wait complete. 2024-04-06T12:30:07.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.406+0000 7f0562f40700 1 -- 172.21.15.152:0/3220402182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fc7f0 msgr2=0x7f055c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.406+0000 7f0562f40700 1 --2- 172.21.15.152:0/3220402182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fc7f0 0x7f055c0fcbd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f05500047f0 tx=0x7f0550009cb0).stop 2024-04-06T12:30:07.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.406+0000 7f0562f40700 1 -- 172.21.15.152:0/3220402182 shutdown_connections 2024-04-06T12:30:07.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.406+0000 7f0562f40700 1 --2- 172.21.15.152:0/3220402182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0fd150 0x7f055c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.406+0000 7f0562f40700 1 --2- 172.21.15.152:0/3220402182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fc7f0 0x7f055c0fcbd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.406+0000 7f0562f40700 1 -- 172.21.15.152:0/3220402182 >> 172.21.15.152:0/3220402182 conn(0x7f055c070590 msgr2=0x7f055c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:07.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.406+0000 7f0562f40700 1 -- 172.21.15.152:0/3220402182 shutdown_connections 2024-04-06T12:30:07.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.406+0000 7f0562f40700 1 -- 172.21.15.152:0/3220402182 wait complete. 2024-04-06T12:30:07.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.406+0000 7f0562f40700 1 Processor -- start 2024-04-06T12:30:07.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f0562f40700 1 -- start start 2024-04-06T12:30:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f0562f40700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0fc7f0 0x7f055c1091f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f0562f40700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fd150 0x7f055c1096e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f0562f40700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c109bd0 con 0x7f055c0fd150 2024-04-06T12:30:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f0562f40700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c109d10 con 0x7f055c0fc7f0 2024-04-06T12:30:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f055bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fd150 0x7f055c1096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f055bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fd150 0x7f055c1096e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54058/0 (socket says 172.21.15.152:54058) 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f055bfff700 1 -- 172.21.15.152:0/511128772 learned_addr learned my addr 172.21.15.152:0/511128772 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f0560cdc700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0fc7f0 0x7f055c1091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f055bfff700 1 -- 172.21.15.152:0/511128772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0fc7f0 msgr2=0x7f055c1091f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f055bfff700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0fc7f0 0x7f055c1091f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f055bfff700 1 -- 172.21.15.152:0/511128772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550005040 con 0x7f055c0fd150 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f055bfff700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fd150 0x7f055c1096e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f054800e8c0 tx=0x7f054800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.407+0000 7f0559ffb700 1 -- 172.21.15.152:0/511128772 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0548007b40 con 0x7f055c0fd150 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.408+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c109fc0 con 0x7f055c0fd150 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.408+0000 7f0559ffb700 1 -- 172.21.15.152:0/511128772 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f054800f040 con 0x7f055c0fd150 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.408+0000 7f0559ffb700 1 -- 172.21.15.152:0/511128772 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0548014830 con 0x7f055c0fd150 2024-04-06T12:30:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.408+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c1125b0 con 0x7f055c0fd150 2024-04-06T12:30:07.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.409+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c05f590 con 0x7f055c0fd150 2024-04-06T12:30:07.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.409+0000 7f0559ffb700 1 -- 172.21.15.152:0/511128772 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0548009070 con 0x7f055c0fd150 2024-04-06T12:30:07.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.410+0000 7f0559ffb700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f054c06caa0 0x7f054c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:07.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.410+0000 7f0559ffb700 1 -- 172.21.15.152:0/511128772 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f054808b6b0 con 0x7f055c0fd150 2024-04-06T12:30:07.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.410+0000 7f0560cdc700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f054c06caa0 0x7f054c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:07.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.410+0000 7f0560cdc700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f054c06caa0 0x7f054c06ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f05500047c0 tx=0x7f0550009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.415+0000 7f0559ffb700 1 -- 172.21.15.152:0/511128772 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f0548055830 con 0x7f055c0fd150 2024-04-06T12:30:07.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.701+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f055c0feb80 con 0x7f055c0fd150 2024-04-06T12:30:07.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.701+0000 7f0559ffb700 1 -- 172.21.15.152:0/511128772 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f0548058e50 con 0x7f055c0fd150 2024-04-06T12:30:07.701 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:30:07.701 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:30:07.701 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:30:07.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:30:07.701 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:30:07.701 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 3, 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 7, 2024-04-06T12:30:07.702 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 6 2024-04-06T12:30:07.703 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:30:07.703 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:30:07.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.703+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f054c06caa0 msgr2=0x7f054c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.703+0000 7f0562f40700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f054c06caa0 0x7f054c06ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f05500047c0 tx=0x7f0550009cb0).stop 2024-04-06T12:30:07.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.703+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fd150 msgr2=0x7f055c1096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.703+0000 7f0562f40700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fd150 0x7f055c1096e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f054800e8c0 tx=0x7f054800b040).stop 2024-04-06T12:30:07.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.703+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 shutdown_connections 2024-04-06T12:30:07.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.703+0000 7f0562f40700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f054c06caa0 0x7f054c06ef60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.703+0000 7f0562f40700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0fc7f0 0x7f055c1091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.703+0000 7f0562f40700 1 --2- 172.21.15.152:0/511128772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f055c0fd150 0x7f055c1096e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.703+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 >> 172.21.15.152:0/511128772 conn(0x7f055c070590 msgr2=0x7f055c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:07.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.704+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 shutdown_connections 2024-04-06T12:30:07.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.704+0000 7f0562f40700 1 -- 172.21.15.152:0/511128772 wait complete. 2024-04-06T12:30:07.776 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:07 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[132860]: 2024-04-06T12:30:07.477+0000 7f2ec3b44640 -1 Falling back to public interface 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.811+0000 7f4f34149700 1 -- 172.21.15.152:0/877824475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b9e0 msgr2=0x7f4f2c103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.811+0000 7f4f34149700 1 --2- 172.21.15.152:0/877824475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b9e0 0x7f4f2c103cc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4f1c0047f0 tx=0x7f4f1c009cb0).stop 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.811+0000 7f4f34149700 1 -- 172.21.15.152:0/877824475 shutdown_connections 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.811+0000 7f4f34149700 1 --2- 172.21.15.152:0/877824475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b9e0 0x7f4f2c103cc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.811+0000 7f4f34149700 1 --2- 172.21.15.152:0/877824475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f2c06b110 0x7f4f2c06b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.811+0000 7f4f34149700 1 -- 172.21.15.152:0/877824475 >> 172.21.15.152:0/877824475 conn(0x7f4f2c0f3510 msgr2=0x7f4f2c0f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.811+0000 7f4f34149700 1 -- 172.21.15.152:0/877824475 shutdown_connections 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.811+0000 7f4f34149700 1 -- 172.21.15.152:0/877824475 wait complete. 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f34149700 1 Processor -- start 2024-04-06T12:30:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f34149700 1 -- start start 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f34149700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b110 0x7f4f2c1103b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f34149700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f2c06b9e0 0x7f4f2c1108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f34149700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c110ea0 con 0x7f4f2c06b110 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f34149700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c110fe0 con 0x7f4f2c06b9e0 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f31ee5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b110 0x7f4f2c1103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f31ee5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b110 0x7f4f2c1103b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54080/0 (socket says 172.21.15.152:54080) 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f31ee5700 1 -- 172.21.15.152:0/4238753985 learned_addr learned my addr 172.21.15.152:0/4238753985 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f316e4700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f2c06b9e0 0x7f4f2c1108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f31ee5700 1 -- 172.21.15.152:0/4238753985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f2c06b9e0 msgr2=0x7f4f2c1108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.812+0000 7f4f31ee5700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f2c06b9e0 0x7f4f2c1108a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.813+0000 7f4f31ee5700 1 -- 172.21.15.152:0/4238753985 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c005040 con 0x7f4f2c06b110 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.813+0000 7f4f31ee5700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b110 0x7f4f2c1103b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4f2800e910 tx=0x7f4f2800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.813+0000 7f4f22ffd700 1 -- 172.21.15.152:0/4238753985 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f28007b40 con 0x7f4f2c06b110 2024-04-06T12:30:07.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.813+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c10a610 con 0x7f4f2c06b110 2024-04-06T12:30:07.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.813+0000 7f4f22ffd700 1 -- 172.21.15.152:0/4238753985 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f2800f040 con 0x7f4f2c06b110 2024-04-06T12:30:07.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.813+0000 7f4f22ffd700 1 -- 172.21.15.152:0/4238753985 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f28014920 con 0x7f4f2c06b110 2024-04-06T12:30:07.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.813+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c10ab50 con 0x7f4f2c06b110 2024-04-06T12:30:07.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.814+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c060650 con 0x7f4f2c06b110 2024-04-06T12:30:07.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.814+0000 7f4f22ffd700 1 -- 172.21.15.152:0/4238753985 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4f28007ca0 con 0x7f4f2c06b110 2024-04-06T12:30:07.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.815+0000 7f4f22ffd700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4f1806caa0 0x7f4f1806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:07.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.815+0000 7f4f22ffd700 1 -- 172.21.15.152:0/4238753985 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f4f2808b720 con 0x7f4f2c06b110 2024-04-06T12:30:07.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.815+0000 7f4f316e4700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4f1806caa0 0x7f4f1806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:07.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.815+0000 7f4f316e4700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4f1806caa0 0x7f4f1806ef60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4f2c10bcf0 tx=0x7f4f1c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:07.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:07.819+0000 7f4f22ffd700 1 -- 172.21.15.152:0/4238753985 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f4f28059330 con 0x7f4f2c06b110 2024-04-06T12:30:08.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.058+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4f2c10baf0 con 0x7f4f2c06b110 2024-04-06T12:30:08.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.059+0000 7f4f22ffd700 1 -- 172.21.15.152:0/4238753985 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f4f28055020 con 0x7f4f2c06b110 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:30:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:30:08.058 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:30:08.059 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:30:08.060 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:30:08.060 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:30:08.060 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:30:08.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4f1806caa0 msgr2=0x7f4f1806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4f1806caa0 0x7f4f1806ef60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4f2c10bcf0 tx=0x7f4f1c009cb0).stop 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b110 msgr2=0x7f4f2c1103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b110 0x7f4f2c1103b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4f2800e910 tx=0x7f4f2800b040).stop 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 shutdown_connections 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4f1806caa0 0x7f4f1806ef60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c06b110 0x7f4f2c1103b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 --2- 172.21.15.152:0/4238753985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f2c06b9e0 0x7f4f2c1108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 >> 172.21.15.152:0/4238753985 conn(0x7f4f2c0f3510 msgr2=0x7f4f2c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 shutdown_connections 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.061+0000 7f4f34149700 1 -- 172.21.15.152:0/4238753985 wait complete. 2024-04-06T12:30:08.061 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.163+0000 7fee22780700 1 -- 172.21.15.152:0/3662031015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f88a0 msgr2=0x7fee1c0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.163+0000 7fee22780700 1 --2- 172.21.15.152:0/3662031015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f88a0 0x7fee1c0f8c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fee040047f0 tx=0x7fee04009cb0).stop 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.163+0000 7fee22780700 1 -- 172.21.15.152:0/3662031015 shutdown_connections 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.163+0000 7fee22780700 1 --2- 172.21.15.152:0/3662031015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c0f9200 0x7fee1c101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.163+0000 7fee22780700 1 --2- 172.21.15.152:0/3662031015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f88a0 0x7fee1c0f8c80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.163+0000 7fee22780700 1 -- 172.21.15.152:0/3662031015 >> 172.21.15.152:0/3662031015 conn(0x7fee1c070590 msgr2=0x7fee1c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.163+0000 7fee22780700 1 -- 172.21.15.152:0/3662031015 shutdown_connections 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.163+0000 7fee22780700 1 -- 172.21.15.152:0/3662031015 wait complete. 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee22780700 1 Processor -- start 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee22780700 1 -- start start 2024-04-06T12:30:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee22780700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c0f88a0 0x7fee1c10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee22780700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f9200 0x7fee1c10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee22780700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c10eb10 con 0x7fee1c0f9200 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee22780700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c10ec50 con 0x7fee1c0f88a0 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee1b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f9200 0x7fee1c10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee1b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f9200 0x7fee1c10e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54110/0 (socket says 172.21.15.152:54110) 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee1b7fe700 1 -- 172.21.15.152:0/403133068 learned_addr learned my addr 172.21.15.152:0/403133068 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee1bfff700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c0f88a0 0x7fee1c10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee1b7fe700 1 -- 172.21.15.152:0/403133068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c0f88a0 msgr2=0x7fee1c10e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee1b7fe700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c0f88a0 0x7fee1c10e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.164+0000 7fee1b7fe700 1 -- 172.21.15.152:0/403133068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04005040 con 0x7fee1c0f9200 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.165+0000 7fee1b7fe700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f9200 0x7fee1c10e510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fee0c0041d0 tx=0x7fee0c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.165+0000 7fee197fa700 1 -- 172.21.15.152:0/403133068 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0c007b40 con 0x7fee1c0f9200 2024-04-06T12:30:08.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.165+0000 7fee197fa700 1 -- 172.21.15.152:0/403133068 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee0c00f040 con 0x7fee1c0f9200 2024-04-06T12:30:08.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.165+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c1082e0 con 0x7fee1c0f9200 2024-04-06T12:30:08.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.165+0000 7fee197fa700 1 -- 172.21.15.152:0/403133068 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0c0147b0 con 0x7fee1c0f9200 2024-04-06T12:30:08.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.165+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c108820 con 0x7fee1c0f9200 2024-04-06T12:30:08.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.166+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c05f590 con 0x7fee1c0f9200 2024-04-06T12:30:08.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.166+0000 7fee197fa700 1 -- 172.21.15.152:0/403133068 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fee0c0149e0 con 0x7fee1c0f9200 2024-04-06T12:30:08.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.166+0000 7fee197fa700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fee0806caa0 0x7fee0806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:08.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.167+0000 7fee1bfff700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fee0806caa0 0x7fee0806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:08.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.167+0000 7fee197fa700 1 -- 172.21.15.152:0/403133068 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fee0c08bc40 con 0x7fee1c0f9200 2024-04-06T12:30:08.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.167+0000 7fee1bfff700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fee0806caa0 0x7fee0806ef60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fee04004f10 tx=0x7fee0400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:08.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.171+0000 7fee197fa700 1 -- 172.21.15.152:0/403133068 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fee0c059900 con 0x7fee1c0f9200 2024-04-06T12:30:08.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: pgmap v90: 65 pgs: 3 active+undersized+degraded, 12 peering, 3 stale+active+clean, 4 active+undersized, 43 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 15/267 objects degraded (5.618%) 2024-04-06T12:30:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:30:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:30:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/511128772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:08.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:08 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/4238753985' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:30:08.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.396+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee1c108af0 con 0x7fee0806caa0 2024-04-06T12:30:08.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.397+0000 7fee197fa700 1 -- 172.21.15.152:0/403133068 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fee1c108af0 con 0x7fee0806caa0 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "crash" 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "8/21 daemons upgraded", 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:30:08.395 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fee0806caa0 msgr2=0x7fee0806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fee0806caa0 0x7fee0806ef60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fee04004f10 tx=0x7fee0400b040).stop 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f9200 msgr2=0x7fee1c10e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f9200 0x7fee1c10e510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fee0c0041d0 tx=0x7fee0c009f60).stop 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 shutdown_connections 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fee0806caa0 0x7fee0806ef60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c0f88a0 0x7fee1c10e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 --2- 172.21.15.152:0/403133068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee1c0f9200 0x7fee1c10e510 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 >> 172.21.15.152:0/403133068 conn(0x7fee1c070590 msgr2=0x7fee1c0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 shutdown_connections 2024-04-06T12:30:08.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.399+0000 7fee22780700 1 -- 172.21.15.152:0/403133068 wait complete. 2024-04-06T12:30:08.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.498+0000 7fe46b168700 1 -- 172.21.15.152:0/1910237017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 msgr2=0x7fe4640f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.498+0000 7fe46b168700 1 --2- 172.21.15.152:0/1910237017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 0x7fe4640f7a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe4500047f0 tx=0x7fe450009cb0).stop 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.498+0000 7fe46b168700 1 -- 172.21.15.152:0/1910237017 shutdown_connections 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.498+0000 7fe46b168700 1 --2- 172.21.15.152:0/1910237017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 0x7fe4640f7a30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.498+0000 7fe46b168700 1 --2- 172.21.15.152:0/1910237017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4640fd8f0 0x7fe4640fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.498+0000 7fe46b168700 1 -- 172.21.15.152:0/1910237017 >> 172.21.15.152:0/1910237017 conn(0x7fe4640f34b0 msgr2=0x7fe4640f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.498+0000 7fe46b168700 1 -- 172.21.15.152:0/1910237017 shutdown_connections 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.498+0000 7fe46b168700 1 -- 172.21.15.152:0/1910237017 wait complete. 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe46b168700 1 Processor -- start 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe46b168700 1 -- start start 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe46b168700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4640fd8f0 0x7fe46410e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe46b168700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 0x7fe46410e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:08.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe46b168700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46410ec30 con 0x7fe4640fe250 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe46b168700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46410ed70 con 0x7fe4640fd8f0 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe463fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 0x7fe46410e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe463fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 0x7fe46410e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54128/0 (socket says 172.21.15.152:54128) 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe463fff700 1 -- 172.21.15.152:0/832161987 learned_addr learned my addr 172.21.15.152:0/832161987 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe468f04700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4640fd8f0 0x7fe46410e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.499+0000 7fe463fff700 1 -- 172.21.15.152:0/832161987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4640fd8f0 msgr2=0x7fe46410e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.500+0000 7fe463fff700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4640fd8f0 0x7fe46410e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.500+0000 7fe463fff700 1 -- 172.21.15.152:0/832161987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450005040 con 0x7fe4640fe250 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.500+0000 7fe463fff700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 0x7fe46410e630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe450000c00 tx=0x7fe450009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.500+0000 7fe461ffb700 1 -- 172.21.15.152:0/832161987 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe450018070 con 0x7fe4640fe250 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.500+0000 7fe461ffb700 1 -- 172.21.15.152:0/832161987 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe450007e90 con 0x7fe4640fe250 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.500+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4641083a0 con 0x7fe4640fe250 2024-04-06T12:30:08.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.500+0000 7fe461ffb700 1 -- 172.21.15.152:0/832161987 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45001de20 con 0x7fe4640fe250 2024-04-06T12:30:08.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.500+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe464108900 con 0x7fe4640fe250 2024-04-06T12:30:08.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.501+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46405f590 con 0x7fe4640fe250 2024-04-06T12:30:08.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.501+0000 7fe461ffb700 1 -- 172.21.15.152:0/832161987 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe45001d420 con 0x7fe4640fe250 2024-04-06T12:30:08.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.502+0000 7fe461ffb700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe45406ca30 0x7fe45406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:08.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.502+0000 7fe461ffb700 1 -- 172.21.15.152:0/832161987 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fe45008c830 con 0x7fe4640fe250 2024-04-06T12:30:08.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.502+0000 7fe468f04700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe45406ca30 0x7fe45406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:08.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.502+0000 7fe468f04700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe45406ca30 0x7fe45406eef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe458004ee0 tx=0x7fe45800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:08.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.508+0000 7fe461ffb700 1 -- 172.21.15.152:0/832161987 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fe45005a440 con 0x7fe4640fe250 2024-04-06T12:30:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: pgmap v90: 65 pgs: 3 active+undersized+degraded, 12 peering, 3 stale+active+clean, 4 active+undersized, 43 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 15/267 objects degraded (5.618%) 2024-04-06T12:30:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:30:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:30:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/511128772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:08 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/4238753985' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:30:08.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.789+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe464109860 con 0x7fe4640fe250 2024-04-06T12:30:08.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.790+0000 7fe461ffb700 1 -- 172.21.15.152:0/832161987 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+887 (secure 0 0 0) 0x7fe450059fd0 con 0x7fe4640fe250 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 2 pgs peering; Degraded data redundancy: 15/267 objects degraded (5.618%), 3 pgs degraded 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout: osd.2 (root=default,host=smithi152) is down 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 2 pgs peering 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.c is stuck peering for 5m, current state peering, last acting [3,0] 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout: pg 3.1e is stuck peering for 4m, current state peering, last acting [3,1] 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 15/267 objects degraded (5.618%), 3 pgs degraded 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-04-06T12:30:08.788 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe45406ca30 msgr2=0x7fe45406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe45406ca30 0x7fe45406eef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe458004ee0 tx=0x7fe45800b040).stop 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 msgr2=0x7fe46410e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 0x7fe46410e630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe450000c00 tx=0x7fe450009cb0).stop 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 shutdown_connections 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe45406ca30 0x7fe45406eef0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4640fd8f0 0x7fe46410e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 --2- 172.21.15.152:0/832161987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640fe250 0x7fe46410e630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 >> 172.21.15.152:0/832161987 conn(0x7fe4640f34b0 msgr2=0x7fe4640fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 shutdown_connections 2024-04-06T12:30:08.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:08.792+0000 7fe46b168700 1 -- 172.21.15.152:0/832161987 wait complete. 2024-04-06T12:30:09.465 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:09 smithi152 ceph-mon[104634]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:09.465 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:09 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/832161987' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:30:09.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:09 smithi195 ceph-mon[85980]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:09.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:09 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/832161987' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:30:10.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:10 smithi152 ceph-mon[104634]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:10.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:10 smithi152 ceph-mon[104634]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-06T12:30:10.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:10 smithi152 ceph-mon[104634]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-06T12:30:10.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:10 smithi195 ceph-mon[85980]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:10.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:10 smithi195 ceph-mon[85980]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-06T12:30:10.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:10 smithi195 ceph-mon[85980]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-06T12:30:12.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:12 smithi152 ceph-mon[104634]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-06T12:30:12.374 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:12 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:12.374 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:12 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:12.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:12 smithi195 ceph-mon[85980]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-06T12:30:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:12 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:12.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:12 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:12.705 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[132860]: 2024-04-06T12:30:12.375+0000 7f2ec3b44640 -1 osd.2 0 read_superblock omap replica is missing. 2024-04-06T12:30:13.021 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:12 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[132860]: 2024-04-06T12:30:12.707+0000 7f2ec3b44640 -1 osd.2 59 log_to_monitors true 2024-04-06T12:30:13.275 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:30:13 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[132860]: 2024-04-06T12:30:13.218+0000 7f2eb4f9d700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T12:30:13.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:13 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:13.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:13 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:13.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:13 smithi152 ceph-mon[104634]: from='osd.2 [v2:172.21.15.152:6818/426029450,v1:172.21.15.152:6819/426029450]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T12:30:13.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:13 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:13 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:13 smithi195 ceph-mon[85980]: from='osd.2 [v2:172.21.15.152:6818/426029450,v1:172.21.15.152:6819/426029450]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-06T12:30:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:14 smithi152 ceph-mon[104634]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-06T12:30:14.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:14 smithi152 ceph-mon[104634]: from='osd.2 [v2:172.21.15.152:6818/426029450,v1:172.21.15.152:6819/426029450]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-06T12:30:14.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:14 smithi152 ceph-mon[104634]: osdmap e62: 6 total, 5 up, 6 in 2024-04-06T12:30:14.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:14 smithi152 ceph-mon[104634]: from='osd.2 [v2:172.21.15.152:6818/426029450,v1:172.21.15.152:6819/426029450]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:30:14.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:14 smithi152 ceph-mon[104634]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:14 smithi195 ceph-mon[85980]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-06T12:30:14.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:14 smithi195 ceph-mon[85980]: from='osd.2 [v2:172.21.15.152:6818/426029450,v1:172.21.15.152:6819/426029450]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-06T12:30:14.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:14 smithi195 ceph-mon[85980]: osdmap e62: 6 total, 5 up, 6 in 2024-04-06T12:30:14.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:14 smithi195 ceph-mon[85980]: from='osd.2 [v2:172.21.15.152:6818/426029450,v1:172.21.15.152:6819/426029450]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-04-06T12:30:14.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:14 smithi195 ceph-mon[85980]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:15.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:15 smithi152 ceph-mon[104634]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:30:15.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:15 smithi152 ceph-mon[104634]: osd.2 [v2:172.21.15.152:6818/426029450,v1:172.21.15.152:6819/426029450] boot 2024-04-06T12:30:15.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:15 smithi152 ceph-mon[104634]: osdmap e63: 6 total, 6 up, 6 in 2024-04-06T12:30:15.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:15 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:30:15.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:15 smithi152 ceph-mon[104634]: osdmap e64: 6 total, 6 up, 6 in 2024-04-06T12:30:15.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:15 smithi195 ceph-mon[85980]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:30:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:15 smithi195 ceph-mon[85980]: osd.2 [v2:172.21.15.152:6818/426029450,v1:172.21.15.152:6819/426029450] boot 2024-04-06T12:30:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:15 smithi195 ceph-mon[85980]: osdmap e63: 6 total, 6 up, 6 in 2024-04-06T12:30:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:15 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-06T12:30:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:15 smithi195 ceph-mon[85980]: osdmap e64: 6 total, 6 up, 6 in 2024-04-06T12:30:16.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 35/267 objects degraded (13.109%) 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-06T12:30:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 35/267 objects degraded (13.109%) 2024-04-06T12:30:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:30:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:30:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:30:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:16.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-06T12:30:17.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:17 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-06T12:30:17.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:17 smithi152 ceph-mon[104634]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-06T12:30:17.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:17 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:17.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:17 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-06T12:30:17.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:17 smithi195 ceph-mon[85980]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-06T12:30:17.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:17 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:18 smithi152 ceph-mon[104634]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-06T12:30:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:18 smithi195 ceph-mon[85980]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-06T12:30:20.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:19 smithi195 ceph-mon[85980]: pgmap v99: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T12:30:20.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:19 smithi152 ceph-mon[104634]: pgmap v99: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s 2024-04-06T12:30:21.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:20 smithi195 ceph-mon[85980]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded) 2024-04-06T12:30:21.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:20 smithi152 ceph-mon[104634]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded) 2024-04-06T12:30:22.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:21 smithi195 ceph-mon[85980]: pgmap v100: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 652 B/s rd, 0 op/s 2024-04-06T12:30:22.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:21 smithi152 ceph-mon[104634]: pgmap v100: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 652 B/s rd, 0 op/s 2024-04-06T12:30:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:30:23.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:23.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:30:24.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:24 smithi152 ceph-mon[104634]: pgmap v101: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-04-06T12:30:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:24 smithi195 ceph-mon[85980]: pgmap v101: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-04-06T12:30:26.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:26 smithi152 ceph-mon[104634]: pgmap v102: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T12:30:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:26 smithi195 ceph-mon[85980]: pgmap v102: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-04-06T12:30:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:28 smithi152 ceph-mon[104634]: pgmap v103: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 864 B/s rd, 0 op/s 2024-04-06T12:30:28.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:28 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:28 smithi195 ceph-mon[85980]: pgmap v103: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 864 B/s rd, 0 op/s 2024-04-06T12:30:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:28 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:30.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:29 smithi195 ceph-mon[85980]: pgmap v104: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T12:30:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:29 smithi152 ceph-mon[104634]: pgmap v104: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-06T12:30:31.506 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:31 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-06T12:30:31.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:31 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-06T12:30:32.218 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:32 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-06T12:30:32.218 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:32 smithi195 ceph-mon[85980]: Upgrade: osd.3 is safe to restart 2024-04-06T12:30:32.218 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:32 smithi195 ceph-mon[85980]: pgmap v105: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:30:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:32 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-06T12:30:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:32 smithi152 ceph-mon[104634]: Upgrade: osd.3 is safe to restart 2024-04-06T12:30:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:32 smithi152 ceph-mon[104634]: pgmap v105: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:30:34.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:33 smithi152 ceph-mon[104634]: Upgrade: Updating osd.3 2024-04-06T12:30:34.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:33 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:34.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:33 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-06T12:30:34.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:33 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:30:34.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:33 smithi152 ceph-mon[104634]: Deploying daemon osd.3 on smithi195 2024-04-06T12:30:34.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:33 smithi152 ceph-mon[104634]: pgmap v106: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:30:34.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:33 smithi195 ceph-mon[85980]: Upgrade: Updating osd.3 2024-04-06T12:30:34.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:33 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:34.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:33 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-06T12:30:34.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:33 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:30:34.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:33 smithi195 ceph-mon[85980]: Deploying daemon osd.3 on smithi195 2024-04-06T12:30:34.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:33 smithi195 ceph-mon[85980]: pgmap v106: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:30:35.708 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:35 smithi195 systemd[1]: Stopping Ceph osd.3 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:30:36.048 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[48933]: debug 2024-04-06T12:30:35.957+0000 7fc727ac7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-06T12:30:36.049 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[48933]: debug 2024-04-06T12:30:35.957+0000 7fc727ac7700 -1 osd.3 64 *** Got signal Terminated *** 2024-04-06T12:30:36.049 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[48933]: debug 2024-04-06T12:30:35.957+0000 7fc727ac7700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:30:36.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:36 smithi195 ceph-mon[85980]: pgmap v107: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-06T12:30:36.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:36 smithi195 ceph-mon[85980]: osd.3 marked itself down and dead 2024-04-06T12:30:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:36 smithi152 ceph-mon[104634]: pgmap v107: 65 pgs: 65 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-06T12:30:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:36 smithi152 ceph-mon[104634]: osd.3 marked itself down and dead 2024-04-06T12:30:36.798 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:36 smithi195 bash[98053]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3 2024-04-06T12:30:37.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: osdmap e65: 6 total, 5 up, 6 in 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [0, 2]}]: dispatch 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 3]}]: dispatch 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 2]}]: dispatch 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [1, 3]}]: dispatch 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 3]}]: dispatch 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:37.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:30:37.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: osdmap e65: 6 total, 5 up, 6 in 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [0, 2]}]: dispatch 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 3]}]: dispatch 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 2]}]: dispatch 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [1, 3]}]: dispatch 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 3]}]: dispatch 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:37.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:30:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:38 smithi195 ceph-mon[85980]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T12:30:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-04-06T12:30:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [0, 2]}]': finished 2024-04-06T12:30:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-04-06T12:30:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 3]}]': finished 2024-04-06T12:30:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 2]}]': finished 2024-04-06T12:30:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [1, 3]}]': finished 2024-04-06T12:30:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 3]}]': finished 2024-04-06T12:30:38.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:38 smithi195 ceph-mon[85980]: osdmap e66: 6 total, 5 up, 6 in 2024-04-06T12:30:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:38 smithi152 ceph-mon[104634]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-06T12:30:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-04-06T12:30:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [0, 2]}]': finished 2024-04-06T12:30:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-04-06T12:30:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 3]}]': finished 2024-04-06T12:30:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 2]}]': finished 2024-04-06T12:30:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [1, 3]}]': finished 2024-04-06T12:30:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 3]}]': finished 2024-04-06T12:30:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:38 smithi152 ceph-mon[104634]: osdmap e66: 6 total, 5 up, 6 in 2024-04-06T12:30:38.798 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:38 smithi195 systemd[1]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.3.service: Succeeded. 2024-04-06T12:30:38.799 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:38 smithi195 systemd[1]: Stopped Ceph osd.3 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:30:38.799 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:38 smithi195 systemd[1]: Starting Ceph osd.3 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:30:38.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.907+0000 7f81b4398700 1 -- 172.21.15.152:0/2134994271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fe270 msgr2=0x7f81ac0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:38.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.907+0000 7f81b4398700 1 --2- 172.21.15.152:0/2134994271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fe270 0x7f81ac0f7a50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f81a80047f0 tx=0x7f81a8009cb0).stop 2024-04-06T12:30:38.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.907+0000 7f81b4398700 1 -- 172.21.15.152:0/2134994271 shutdown_connections 2024-04-06T12:30:38.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.907+0000 7f81b4398700 1 --2- 172.21.15.152:0/2134994271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fe270 0x7f81ac0f7a50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:38.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.907+0000 7f81b4398700 1 --2- 172.21.15.152:0/2134994271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81ac0fd910 0x7f81ac0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:38.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.907+0000 7f81b4398700 1 -- 172.21.15.152:0/2134994271 >> 172.21.15.152:0/2134994271 conn(0x7f81ac0f3530 msgr2=0x7f81ac0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:38.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.907+0000 7f81b4398700 1 -- 172.21.15.152:0/2134994271 shutdown_connections 2024-04-06T12:30:38.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.907+0000 7f81b4398700 1 -- 172.21.15.152:0/2134994271 wait complete. 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.908+0000 7f81b4398700 1 Processor -- start 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.908+0000 7f81b4398700 1 -- start start 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.908+0000 7f81b4398700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fd910 0x7f81ac06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.908+0000 7f81b4398700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81ac0fe270 0x7f81ac06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.908+0000 7f81b4398700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac06bab0 con 0x7f81ac0fd910 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.908+0000 7f81b4398700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac06bbf0 con 0x7f81ac0fe270 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.908+0000 7f81b2134700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fd910 0x7f81ac06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.908+0000 7f81b2134700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fd910 0x7f81ac06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40678/0 (socket says 172.21.15.152:40678) 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.908+0000 7f81b2134700 1 -- 172.21.15.152:0/3151328890 learned_addr learned my addr 172.21.15.152:0/3151328890 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f81b1933700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81ac0fe270 0x7f81ac06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f81b2134700 1 -- 172.21.15.152:0/3151328890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81ac0fe270 msgr2=0x7f81ac06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f81b2134700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81ac0fe270 0x7f81ac06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:38.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f81b2134700 1 -- 172.21.15.152:0/3151328890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8005040 con 0x7f81ac0fd910 2024-04-06T12:30:38.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f81b2134700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fd910 0x7f81ac06b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f81a000e910 tx=0x7f81a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:38.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f819f7fe700 1 -- 172.21.15.152:0/3151328890 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a000eeb0 con 0x7f81ac0fd910 2024-04-06T12:30:38.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f819f7fe700 1 -- 172.21.15.152:0/3151328890 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81a000f040 con 0x7f81ac0fd910 2024-04-06T12:30:38.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac06be40 con 0x7f81ac0fd910 2024-04-06T12:30:38.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f819f7fe700 1 -- 172.21.15.152:0/3151328890 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a000c8a0 con 0x7f81ac0fd910 2024-04-06T12:30:38.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.909+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ac114790 con 0x7f81ac0fd910 2024-04-06T12:30:38.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.910+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac05f570 con 0x7f81ac0fd910 2024-04-06T12:30:38.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.911+0000 7f819f7fe700 1 -- 172.21.15.152:0/3151328890 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f81a00090d0 con 0x7f81ac0fd910 2024-04-06T12:30:38.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.911+0000 7f819f7fe700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819806caa0 0x7f819806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:38.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.911+0000 7f819f7fe700 1 -- 172.21.15.152:0/3151328890 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f81a008b970 con 0x7f81ac0fd910 2024-04-06T12:30:38.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.911+0000 7f81b1933700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819806caa0 0x7f819806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:38.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.912+0000 7f81b1933700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819806caa0 0x7f819806ef60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f81a8004e60 tx=0x7f81a800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:38.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:38.916+0000 7f819f7fe700 1 -- 172.21.15.152:0/3151328890 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f81a0055940 con 0x7f81ac0fd910 2024-04-06T12:30:39.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.124+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81ac059120 con 0x7f819806caa0 2024-04-06T12:30:39.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.125+0000 7f819f7fe700 1 -- 172.21.15.152:0/3151328890 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f81ac059120 con 0x7f819806caa0 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819806caa0 msgr2=0x7f819806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819806caa0 0x7f819806ef60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f81a8004e60 tx=0x7f81a800b040).stop 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fd910 msgr2=0x7f81ac06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fd910 0x7f81ac06b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f81a000e910 tx=0x7f81a000b040).stop 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 shutdown_connections 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819806caa0 0x7f819806ef60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81ac0fd910 0x7f81ac06b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 --2- 172.21.15.152:0/3151328890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81ac0fe270 0x7f81ac06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 >> 172.21.15.152:0/3151328890 conn(0x7f81ac0f3530 msgr2=0x7f81ac0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:39.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 shutdown_connections 2024-04-06T12:30:39.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.130+0000 7f81b4398700 1 -- 172.21.15.152:0/3151328890 wait complete. 2024-04-06T12:30:39.129 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:39 smithi195 ceph-mon[85980]: osdmap e67: 6 total, 5 up, 6 in 2024-04-06T12:30:39.129 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:39 smithi195 ceph-mon[85980]: osdmap e68: 6 total, 5 up, 6 in 2024-04-06T12:30:39.144 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:30:39.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.258+0000 7ff3905e4700 1 -- 172.21.15.152:0/230911375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3881047d0 msgr2=0x7ff388071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.258+0000 7ff3905e4700 1 --2- 172.21.15.152:0/230911375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3881047d0 0x7ff388071ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff3780047f0 tx=0x7ff378009cb0).stop 2024-04-06T12:30:39.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.258+0000 7ff3905e4700 1 -- 172.21.15.152:0/230911375 shutdown_connections 2024-04-06T12:30:39.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.258+0000 7ff3905e4700 1 --2- 172.21.15.152:0/230911375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3881047d0 0x7ff388071ab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.258+0000 7ff3905e4700 1 --2- 172.21.15.152:0/230911375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff388103f00 0x7ff3881042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.258+0000 7ff3905e4700 1 -- 172.21.15.152:0/230911375 >> 172.21.15.152:0/230911375 conn(0x7ff38806d6f0 msgr2=0x7ff38806fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:39.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.258+0000 7ff3905e4700 1 -- 172.21.15.152:0/230911375 shutdown_connections 2024-04-06T12:30:39.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.258+0000 7ff3905e4700 1 -- 172.21.15.152:0/230911375 wait complete. 2024-04-06T12:30:39.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff3905e4700 1 Processor -- start 2024-04-06T12:30:39.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff3905e4700 1 -- start start 2024-04-06T12:30:39.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff3905e4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388103f00 0x7ff388114730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:39.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff3905e4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3881047d0 0x7ff388114c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:39.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff3905e4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388115220 con 0x7ff388103f00 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff3905e4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388115360 con 0x7ff3881047d0 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff38e380700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388103f00 0x7ff388114730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff38e380700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388103f00 0x7ff388114730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40696/0 (socket says 172.21.15.152:40696) 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff38e380700 1 -- 172.21.15.152:0/798308167 learned_addr learned my addr 172.21.15.152:0/798308167 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff38db7f700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3881047d0 0x7ff388114c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff38e380700 1 -- 172.21.15.152:0/798308167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3881047d0 msgr2=0x7ff388114c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff38e380700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3881047d0 0x7ff388114c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff38e380700 1 -- 172.21.15.152:0/798308167 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378005040 con 0x7ff388103f00 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.259+0000 7ff38db7f700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3881047d0 0x7ff388114c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.260+0000 7ff38e380700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388103f00 0x7ff388114730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff38400e910 tx=0x7ff38400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.260+0000 7ff37f7fe700 1 -- 172.21.15.152:0/798308167 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff384007b40 con 0x7ff388103f00 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.260+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38810e9c0 con 0x7ff388103f00 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.260+0000 7ff37f7fe700 1 -- 172.21.15.152:0/798308167 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff38400f040 con 0x7ff388103f00 2024-04-06T12:30:39.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.260+0000 7ff37f7fe700 1 -- 172.21.15.152:0/798308167 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff384014920 con 0x7ff388103f00 2024-04-06T12:30:39.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.260+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38810ef50 con 0x7ff388103f00 2024-04-06T12:30:39.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.261+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38805f570 con 0x7ff388103f00 2024-04-06T12:30:39.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.262+0000 7ff37f7fe700 1 -- 172.21.15.152:0/798308167 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff384007ca0 con 0x7ff388103f00 2024-04-06T12:30:39.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.262+0000 7ff37f7fe700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff37406caa0 0x7ff37406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:39.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.262+0000 7ff37f7fe700 1 -- 172.21.15.152:0/798308167 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6465+0+0 (secure 0 0 0) 0x7ff38408b9e0 con 0x7ff388103f00 2024-04-06T12:30:39.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.262+0000 7ff38db7f700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff37406caa0 0x7ff37406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:39.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.263+0000 7ff38db7f700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff37406caa0 0x7ff37406ef60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff38810fbd0 tx=0x7ff378009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:39.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.267+0000 7ff37f7fe700 1 -- 172.21.15.152:0/798308167 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7ff384059440 con 0x7ff388103f00 2024-04-06T12:30:39.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.506+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff388101130 con 0x7ff37406caa0 2024-04-06T12:30:39.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.507+0000 7ff37f7fe700 1 -- 172.21.15.152:0/798308167 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff388101130 con 0x7ff37406caa0 2024-04-06T12:30:39.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff37406caa0 msgr2=0x7ff37406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff37406caa0 0x7ff37406ef60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff38810fbd0 tx=0x7ff378009cb0).stop 2024-04-06T12:30:39.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388103f00 msgr2=0x7ff388114730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388103f00 0x7ff388114730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff38400e910 tx=0x7ff38400b040).stop 2024-04-06T12:30:39.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 shutdown_connections 2024-04-06T12:30:39.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff37406caa0 0x7ff37406ef60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388103f00 0x7ff388114730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 --2- 172.21.15.152:0/798308167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3881047d0 0x7ff388114c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 >> 172.21.15.152:0/798308167 conn(0x7ff38806d6f0 msgr2=0x7ff3881075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:39.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 shutdown_connections 2024-04-06T12:30:39.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.509+0000 7ff3905e4700 1 -- 172.21.15.152:0/798308167 wait complete. 2024-04-06T12:30:39.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:39 smithi152 ceph-mon[104634]: osdmap e67: 6 total, 5 up, 6 in 2024-04-06T12:30:39.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:39 smithi152 ceph-mon[104634]: osdmap e68: 6 total, 5 up, 6 in 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.608+0000 7f858c749700 1 -- 172.21.15.152:0/2442270604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840f91f0 msgr2=0x7f8584101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.608+0000 7f858c749700 1 --2- 172.21.15.152:0/2442270604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840f91f0 0x7f8584101990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f85740047f0 tx=0x7f8574009cb0).stop 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.608+0000 7f858c749700 1 -- 172.21.15.152:0/2442270604 shutdown_connections 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.608+0000 7f858c749700 1 --2- 172.21.15.152:0/2442270604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840f91f0 0x7f8584101990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.608+0000 7f858c749700 1 --2- 172.21.15.152:0/2442270604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840f8920 0x7f85840f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.608+0000 7f858c749700 1 -- 172.21.15.152:0/2442270604 >> 172.21.15.152:0/2442270604 conn(0x7f8584070590 msgr2=0x7f85840f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.608+0000 7f858c749700 1 -- 172.21.15.152:0/2442270604 shutdown_connections 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.608+0000 7f858c749700 1 -- 172.21.15.152:0/2442270604 wait complete. 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.609+0000 7f858c749700 1 Processor -- start 2024-04-06T12:30:39.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.609+0000 7f858c749700 1 -- start start 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f858c749700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840f8920 0x7f858410e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f858c749700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840f91f0 0x7f858410e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f858c749700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858410ec10 con 0x7f85840f91f0 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f858c749700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858410ed50 con 0x7f85840f8920 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f8589ce4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840f91f0 0x7f858410e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f858a4e5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840f8920 0x7f858410e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f8589ce4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840f91f0 0x7f858410e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40720/0 (socket says 172.21.15.152:40720) 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f8589ce4700 1 -- 172.21.15.152:0/620190221 learned_addr learned my addr 172.21.15.152:0/620190221 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f858a4e5700 1 -- 172.21.15.152:0/620190221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840f91f0 msgr2=0x7f858410e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f858a4e5700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840f91f0 0x7f858410e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f858a4e5700 1 -- 172.21.15.152:0/620190221 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574005040 con 0x7f85840f8920 2024-04-06T12:30:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f858a4e5700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840f8920 0x7f858410e120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f858000e870 tx=0x7f858000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.610+0000 7f857b7fe700 1 -- 172.21.15.152:0/620190221 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8580007b40 con 0x7f85840f8920 2024-04-06T12:30:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.611+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85841083d0 con 0x7f85840f8920 2024-04-06T12:30:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.611+0000 7f857b7fe700 1 -- 172.21.15.152:0/620190221 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f858000f040 con 0x7f85840f8920 2024-04-06T12:30:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.611+0000 7f857b7fe700 1 -- 172.21.15.152:0/620190221 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8580014860 con 0x7f85840f8920 2024-04-06T12:30:39.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.611+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8584108910 con 0x7f85840f8920 2024-04-06T12:30:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.612+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858405f590 con 0x7f85840f8920 2024-04-06T12:30:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.612+0000 7f857b7fe700 1 -- 172.21.15.152:0/620190221 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8580007ca0 con 0x7f85840f8920 2024-04-06T12:30:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.612+0000 7f857b7fe700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006caa0 0x7f857006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.612+0000 7f857b7fe700 1 -- 172.21.15.152:0/620190221 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f858008b960 con 0x7f85840f8920 2024-04-06T12:30:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.612+0000 7f8589ce4700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006caa0 0x7f857006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:39.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.613+0000 7f8589ce4700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006caa0 0x7f857006ef60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8584109a60 tx=0x7f857400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.618+0000 7f857b7fe700 1 -- 172.21.15.152:0/620190221 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f85800593c0 con 0x7f85840f8920 2024-04-06T12:30:39.798 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:39 smithi195 bash[98328]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-06T12:30:39.799 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:39 smithi195 bash[98328]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-06T12:30:39.799 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:39 smithi195 bash[98328]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-06T12:30:39.799 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:39 smithi195 bash[98328]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-06T12:30:39.799 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:39 smithi195 bash[98328]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-06T12:30:39.799 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:39 smithi195 bash[98328]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-06T12:30:39.799 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:39 smithi195 bash[98328]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-06T12:30:39.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.816+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f85840fef80 con 0x7f857006caa0 2024-04-06T12:30:39.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.825+0000 7f857b7fe700 1 -- 172.21.15.152:0/620190221 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f85840fef80 con 0x7f857006caa0 2024-04-06T12:30:39.823 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (4m) 28s ago 15m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (2m) 28s ago 15m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (2m) 118s ago 15m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (4m) 28s ago 15m 90.5M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (10m) 28s ago 10m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (10m) 28s ago 10m 160M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (10m) 118s ago 10m 14.7M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (10m) 118s ago 10m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (6m) 28s ago 17m 496M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (5m) 118s ago 15m 448M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (3m) 28s ago 17m 47.2M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (2m) 118s ago 15m 34.0M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:30:39.824 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 28s ago 15m 17.0M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:30:39.825 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (4m) 118s ago 14m 17.1M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:30:39.825 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (103s) 28s ago 14m 85.4M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:30:39.825 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (68s) 28s ago 13m 89.0M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 4e01281def3c 2024-04-06T12:30:39.826 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (33s) 28s ago 13m 11.0M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 36456f3aa1eb 2024-04-06T12:30:39.826 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (13m) 118s ago 13m 230M 2251M 16.2.15-1-g8963e9de 727f386679cb 775dc3faa5b4 2024-04-06T12:30:39.826 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (12m) 118s ago 12m 197M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:30:39.826 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (12m) 118s ago 12m 196M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:30:39.826 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (4m) 118s ago 14m 57.8M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:30:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006caa0 msgr2=0x7f857006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006caa0 0x7f857006ef60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8584109a60 tx=0x7f857400b040).stop 2024-04-06T12:30:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840f8920 msgr2=0x7f858410e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840f8920 0x7f858410e120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f858000e870 tx=0x7f858000b040).stop 2024-04-06T12:30:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 shutdown_connections 2024-04-06T12:30:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f857006caa0 0x7f857006ef60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85840f8920 0x7f858410e120 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 --2- 172.21.15.152:0/620190221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85840f91f0 0x7f858410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 >> 172.21.15.152:0/620190221 conn(0x7f8584070590 msgr2=0x7f85840fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:39.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 shutdown_connections 2024-04-06T12:30:39.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.828+0000 7f858c749700 1 -- 172.21.15.152:0/620190221 wait complete. 2024-04-06T12:30:39.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.926+0000 7f4a23be3700 1 -- 172.21.15.152:0/2469128116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fd8c0 msgr2=0x7f4a1c0fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.926+0000 7f4a23be3700 1 --2- 172.21.15.152:0/2469128116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fd8c0 0x7f4a1c0fdca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4a180047f0 tx=0x7f4a18009cb0).stop 2024-04-06T12:30:39.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.926+0000 7f4a23be3700 1 -- 172.21.15.152:0/2469128116 shutdown_connections 2024-04-06T12:30:39.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.926+0000 7f4a23be3700 1 --2- 172.21.15.152:0/2469128116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a1c0fe220 0x7f4a1c0f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.926+0000 7f4a23be3700 1 --2- 172.21.15.152:0/2469128116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fd8c0 0x7f4a1c0fdca0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.926+0000 7f4a23be3700 1 -- 172.21.15.152:0/2469128116 >> 172.21.15.152:0/2469128116 conn(0x7f4a1c0f34a0 msgr2=0x7f4a1c0f58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:39.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.926+0000 7f4a23be3700 1 -- 172.21.15.152:0/2469128116 shutdown_connections 2024-04-06T12:30:39.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.926+0000 7f4a23be3700 1 -- 172.21.15.152:0/2469128116 wait complete. 2024-04-06T12:30:39.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.927+0000 7f4a23be3700 1 Processor -- start 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.927+0000 7f4a23be3700 1 -- start start 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a23be3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a1c0fd8c0 0x7f4a1c10e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a23be3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fe220 0x7f4a1c10e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a23be3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c10ec30 con 0x7f4a1c0fe220 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a23be3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c10ed70 con 0x7f4a1c0fd8c0 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a2117e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fe220 0x7f4a1c10e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a2117e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fe220 0x7f4a1c10e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40742/0 (socket says 172.21.15.152:40742) 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a2117e700 1 -- 172.21.15.152:0/1244965840 learned_addr learned my addr 172.21.15.152:0/1244965840 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a2197f700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a1c0fd8c0 0x7f4a1c10e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a2117e700 1 -- 172.21.15.152:0/1244965840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a1c0fd8c0 msgr2=0x7f4a1c10e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a2117e700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a1c0fd8c0 0x7f4a1c10e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a2117e700 1 -- 172.21.15.152:0/1244965840 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18005040 con 0x7f4a1c0fe220 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a2117e700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fe220 0x7f4a1c10e630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4a0c00e940 tx=0x7f4a0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a12ffd700 1 -- 172.21.15.152:0/1244965840 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a0c00ee80 con 0x7f4a1c0fe220 2024-04-06T12:30:39.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a12ffd700 1 -- 172.21.15.152:0/1244965840 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a0c00f040 con 0x7f4a1c0fe220 2024-04-06T12:30:39.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a12ffd700 1 -- 172.21.15.152:0/1244965840 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a0c00c810 con 0x7f4a1c0fe220 2024-04-06T12:30:39.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c1083a0 con 0x7f4a1c0fe220 2024-04-06T12:30:39.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.928+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c108960 con 0x7f4a1c0fe220 2024-04-06T12:30:39.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.929+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c060390 con 0x7f4a1c0fe220 2024-04-06T12:30:39.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.930+0000 7f4a12ffd700 1 -- 172.21.15.152:0/1244965840 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4a0c0090d0 con 0x7f4a1c0fe220 2024-04-06T12:30:39.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.930+0000 7f4a12ffd700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4a0806ca30 0x7f4a0806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:39.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.930+0000 7f4a2197f700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4a0806ca30 0x7f4a0806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:39.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.931+0000 7f4a12ffd700 1 -- 172.21.15.152:0/1244965840 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f4a0c08b9c0 con 0x7f4a1c0fe220 2024-04-06T12:30:39.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.931+0000 7f4a2197f700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4a0806ca30 0x7f4a0806eef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4a18004e60 tx=0x7f4a1800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:39.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:39.935+0000 7f4a12ffd700 1 -- 172.21.15.152:0/1244965840 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f4a0c059420 con 0x7f4a1c0fe220 2024-04-06T12:30:40.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.202+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4a1c0ffc50 con 0x7f4a1c0fe220 2024-04-06T12:30:40.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.203+0000 7f4a12ffd700 1 -- 172.21.15.152:0/1244965840 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f4a0c0093d0 con 0x7f4a1c0fe220 2024-04-06T12:30:40.201 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:30:40.201 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:30:40.201 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:30:40.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:30:40.201 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:30:40.201 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:30:40.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2, 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 3 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6, 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 7 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:30:40.202 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:30:40.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4a0806ca30 msgr2=0x7f4a0806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4a0806ca30 0x7f4a0806eef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4a18004e60 tx=0x7f4a1800b040).stop 2024-04-06T12:30:40.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fe220 msgr2=0x7f4a1c10e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fe220 0x7f4a1c10e630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4a0c00e940 tx=0x7f4a0c00b040).stop 2024-04-06T12:30:40.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 shutdown_connections 2024-04-06T12:30:40.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f4a0806ca30 0x7f4a0806eef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a1c0fd8c0 0x7f4a1c10e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 --2- 172.21.15.152:0/1244965840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a1c0fe220 0x7f4a1c10e630 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 >> 172.21.15.152:0/1244965840 conn(0x7f4a1c0f34a0 msgr2=0x7f4a1c0fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:40.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 shutdown_connections 2024-04-06T12:30:40.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.205+0000 7f4a23be3700 1 -- 172.21.15.152:0/1244965840 wait complete. 2024-04-06T12:30:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 -- 172.21.15.152:0/3111361231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 msgr2=0x7fa0cc0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 --2- 172.21.15.152:0/3111361231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 0x7fa0cc0f7a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fa0c80047f0 tx=0x7fa0c8009cb0).stop 2024-04-06T12:30:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 -- 172.21.15.152:0/3111361231 shutdown_connections 2024-04-06T12:30:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 --2- 172.21.15.152:0/3111361231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 0x7fa0cc0f7a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 --2- 172.21.15.152:0/3111361231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0cc0fd8f0 0x7fa0cc0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 -- 172.21.15.152:0/3111361231 >> 172.21.15.152:0/3111361231 conn(0x7fa0cc0f34b0 msgr2=0x7fa0cc0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 -- 172.21.15.152:0/3111361231 shutdown_connections 2024-04-06T12:30:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 -- 172.21.15.152:0/3111361231 wait complete. 2024-04-06T12:30:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 Processor -- start 2024-04-06T12:30:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.304+0000 7fa0d460f700 1 -- start start 2024-04-06T12:30:40.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d460f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0cc0fd8f0 0x7fa0cc10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:40.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d460f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 0x7fa0cc10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:40.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d460f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc10eb70 con 0x7fa0cc0fe250 2024-04-06T12:30:40.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d460f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc10ecb0 con 0x7fa0cc0fd8f0 2024-04-06T12:30:40.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d1baa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 0x7fa0cc10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d1baa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 0x7fa0cc10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40768/0 (socket says 172.21.15.152:40768) 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d1baa700 1 -- 172.21.15.152:0/3991822036 learned_addr learned my addr 172.21.15.152:0/3991822036 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d23ab700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0cc0fd8f0 0x7fa0cc10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d1baa700 1 -- 172.21.15.152:0/3991822036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0cc0fd8f0 msgr2=0x7fa0cc10e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d1baa700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0cc0fd8f0 0x7fa0cc10e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d1baa700 1 -- 172.21.15.152:0/3991822036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c8005040 con 0x7fa0cc0fe250 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d1baa700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 0x7fa0cc10e570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa0c80099f0 tx=0x7fa0c8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0c37fe700 1 -- 172.21.15.152:0/3991822036 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c800e030 con 0x7fa0cc0fe250 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc1082e0 con 0x7fa0cc0fe250 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0c37fe700 1 -- 172.21.15.152:0/3991822036 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0c8007e90 con 0x7fa0cc0fe250 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc1087c0 con 0x7fa0cc0fe250 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.305+0000 7fa0c37fe700 1 -- 172.21.15.152:0/3991822036 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c8018070 con 0x7fa0cc0fe250 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.306+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc05f590 con 0x7fa0cc0fe250 2024-04-06T12:30:40.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.307+0000 7fa0c37fe700 1 -- 172.21.15.152:0/3991822036 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa0c8009590 con 0x7fa0cc0fe250 2024-04-06T12:30:40.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.307+0000 7fa0c37fe700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fa0b806ca30 0x7fa0b806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:40.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.307+0000 7fa0c37fe700 1 -- 172.21.15.152:0/3991822036 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fa0c808d1a0 con 0x7fa0cc0fe250 2024-04-06T12:30:40.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.307+0000 7fa0d23ab700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fa0b806ca30 0x7fa0b806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:40.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.308+0000 7fa0d23ab700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fa0b806ca30 0x7fa0b806eef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa0bc009170 tx=0x7fa0bc009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:40.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.312+0000 7fa0c37fe700 1 -- 172.21.15.152:0/3991822036 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fa0c805abf0 con 0x7fa0cc0fe250 2024-04-06T12:30:40.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:40 smithi152 ceph-mon[104634]: pgmap v112: 65 pgs: 4 remapped+peering, 12 active+undersized+degraded, 9 peering, 16 active+undersized, 24 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 44/267 objects degraded (16.479%) 2024-04-06T12:30:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:40 smithi152 ceph-mon[104634]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:40 smithi152 ceph-mon[104634]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-04-06T12:30:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:40 smithi152 ceph-mon[104634]: Health check failed: Degraded data redundancy: 44/267 objects degraded (16.479%), 12 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:40.526 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:40 smithi195 ceph-mon[85980]: pgmap v112: 65 pgs: 4 remapped+peering, 12 active+undersized+degraded, 9 peering, 16 active+undersized, 24 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 44/267 objects degraded (16.479%) 2024-04-06T12:30:40.526 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:40 smithi195 ceph-mon[85980]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:40.526 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:40 smithi195 ceph-mon[85980]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-04-06T12:30:40.526 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:40 smithi195 ceph-mon[85980]: Health check failed: Degraded data redundancy: 44/267 objects degraded (16.479%), 12 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:40.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.546+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa0cc047540 con 0x7fa0cc0fe250 2024-04-06T12:30:40.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.546+0000 7fa0c37fe700 1 -- 172.21.15.152:0/3991822036 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fa0c805a780 con 0x7fa0cc0fe250 2024-04-06T12:30:40.544 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:30:40.544 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:30:40.544 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:30:40.544 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:30:40.545 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:30:40.546 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:30:40.547 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:30:40.547 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:30:40.547 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:30:40.547 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:30:40.547 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:30:40.547 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:30:40.547 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:30:40.547 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:30:40.547 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fa0b806ca30 msgr2=0x7fa0b806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fa0b806ca30 0x7fa0b806eef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa0bc009170 tx=0x7fa0bc009d60).stop 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 msgr2=0x7fa0cc10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 0x7fa0cc10e570 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa0c80099f0 tx=0x7fa0c8009cb0).stop 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 shutdown_connections 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fa0b806ca30 0x7fa0b806eef0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0cc0fd8f0 0x7fa0cc10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 --2- 172.21.15.152:0/3991822036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0cc0fe250 0x7fa0cc10e570 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 >> 172.21.15.152:0/3991822036 conn(0x7fa0cc0f34b0 msgr2=0x7fa0cc0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:40.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 shutdown_connections 2024-04-06T12:30:40.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.548+0000 7fa0d460f700 1 -- 172.21.15.152:0/3991822036 wait complete. 2024-04-06T12:30:40.549 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:30:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.654+0000 7f00dc532700 1 -- 172.21.15.152:0/3052226876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fc7f0 msgr2=0x7f00d40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.654+0000 7f00dc532700 1 --2- 172.21.15.152:0/3052226876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fc7f0 0x7f00d40fcbd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f00c40047f0 tx=0x7f00c4009cb0).stop 2024-04-06T12:30:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.654+0000 7f00dc532700 1 -- 172.21.15.152:0/3052226876 shutdown_connections 2024-04-06T12:30:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.654+0000 7f00dc532700 1 --2- 172.21.15.152:0/3052226876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00d40fd150 0x7f00d40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.654+0000 7f00dc532700 1 --2- 172.21.15.152:0/3052226876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fc7f0 0x7f00d40fcbd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.654+0000 7f00dc532700 1 -- 172.21.15.152:0/3052226876 >> 172.21.15.152:0/3052226876 conn(0x7f00d40f23b0 msgr2=0x7f00d40f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:40.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.654+0000 7f00dc532700 1 -- 172.21.15.152:0/3052226876 shutdown_connections 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.654+0000 7f00dc532700 1 -- 172.21.15.152:0/3052226876 wait complete. 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00dc532700 1 Processor -- start 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00dc532700 1 -- start start 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00dc532700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00d40fc7f0 0x7f00d410d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00dc532700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fd150 0x7f00d410d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00dc532700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d410db50 con 0x7f00d40fd150 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00dc532700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d410dc90 con 0x7f00d40fc7f0 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00d9acd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fd150 0x7f00d410d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00d9acd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fd150 0x7f00d410d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40780/0 (socket says 172.21.15.152:40780) 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00d9acd700 1 -- 172.21.15.152:0/2907742713 learned_addr learned my addr 172.21.15.152:0/2907742713 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.655+0000 7f00da2ce700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00d40fc7f0 0x7f00d410d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.656+0000 7f00d9acd700 1 -- 172.21.15.152:0/2907742713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00d40fc7f0 msgr2=0x7f00d410d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.656+0000 7f00d9acd700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00d40fc7f0 0x7f00d410d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.656+0000 7f00d9acd700 1 -- 172.21.15.152:0/2907742713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c4005040 con 0x7f00d40fd150 2024-04-06T12:30:40.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.656+0000 7f00d9acd700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fd150 0x7f00d410d550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f00d000e940 tx=0x7f00d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:40.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.656+0000 7f00cb7fe700 1 -- 172.21.15.152:0/2907742713 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d0007b40 con 0x7f00d40fd150 2024-04-06T12:30:40.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.656+0000 7f00cb7fe700 1 -- 172.21.15.152:0/2907742713 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f00d000f040 con 0x7f00d40fd150 2024-04-06T12:30:40.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.656+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d41072c0 con 0x7f00d40fd150 2024-04-06T12:30:40.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.656+0000 7f00cb7fe700 1 -- 172.21.15.152:0/2907742713 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d00148e0 con 0x7f00d40fd150 2024-04-06T12:30:40.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.656+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d4107880 con 0x7f00d40fd150 2024-04-06T12:30:40.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.657+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d4060370 con 0x7f00d40fd150 2024-04-06T12:30:40.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.657+0000 7f00cb7fe700 1 -- 172.21.15.152:0/2907742713 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f00d0007ca0 con 0x7f00d40fd150 2024-04-06T12:30:40.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.658+0000 7f00cb7fe700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f00c006caa0 0x7f00c006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:40.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.658+0000 7f00cb7fe700 1 -- 172.21.15.152:0/2907742713 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f00d008b820 con 0x7f00d40fd150 2024-04-06T12:30:40.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.658+0000 7f00da2ce700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f00c006caa0 0x7f00c006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:40.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.658+0000 7f00da2ce700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f00c006caa0 0x7f00c006ef60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f00c40047c0 tx=0x7f00c4009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:40.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.662+0000 7f00cb7fe700 1 -- 172.21.15.152:0/2907742713 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f00d0059270 con 0x7f00d40fd150 2024-04-06T12:30:40.798 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:40 smithi195 ceph-osd[98645]: -- 172.21.15.195:0/4256761322 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56539fcdd1e0 con 0x56539fcad000 2024-04-06T12:30:40.798 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:40 smithi195 bash[98607]: b41c5ddebdba2d313829648489c1d27a063ea160f6ccb91b202416638a506b9c 2024-04-06T12:30:40.799 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:40 smithi195 systemd[1]: Started Ceph osd.3 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:30:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.876+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00d4107af0 con 0x7f00c006caa0 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.877+0000 7f00cb7fe700 1 -- 172.21.15.152:0/2907742713 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f00d4107af0 con 0x7f00c006caa0 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "crash" 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "9/21 daemons upgraded", 2024-04-06T12:30:40.875 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2024-04-06T12:30:40.876 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:30:40.876 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:30:40.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f00c006caa0 msgr2=0x7f00c006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f00c006caa0 0x7f00c006ef60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f00c40047c0 tx=0x7f00c4009cb0).stop 2024-04-06T12:30:40.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fd150 msgr2=0x7f00d410d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fd150 0x7f00d410d550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f00d000e940 tx=0x7f00d000b040).stop 2024-04-06T12:30:40.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 shutdown_connections 2024-04-06T12:30:40.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f00c006caa0 0x7f00c006ef60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00d40fc7f0 0x7f00d410d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 --2- 172.21.15.152:0/2907742713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d40fd150 0x7f00d410d550 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 >> 172.21.15.152:0/2907742713 conn(0x7f00d40f23b0 msgr2=0x7f00d40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:40.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 shutdown_connections 2024-04-06T12:30:40.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.879+0000 7f00dc532700 1 -- 172.21.15.152:0/2907742713 wait complete. 2024-04-06T12:30:40.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.980+0000 7fed93b79700 1 -- 172.21.15.152:0/2255207055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 msgr2=0x7fed8c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.980+0000 7fed93b79700 1 --2- 172.21.15.152:0/2255207055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 0x7fed8c0fcbd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fed7c0047f0 tx=0x7fed7c009cb0).stop 2024-04-06T12:30:40.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.980+0000 7fed93b79700 1 -- 172.21.15.152:0/2255207055 shutdown_connections 2024-04-06T12:30:40.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.980+0000 7fed93b79700 1 --2- 172.21.15.152:0/2255207055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fd150 0x7fed8c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.980+0000 7fed93b79700 1 --2- 172.21.15.152:0/2255207055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 0x7fed8c0fcbd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.980+0000 7fed93b79700 1 -- 172.21.15.152:0/2255207055 >> 172.21.15.152:0/2255207055 conn(0x7fed8c070590 msgr2=0x7fed8c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:40.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.980+0000 7fed93b79700 1 -- 172.21.15.152:0/2255207055 shutdown_connections 2024-04-06T12:30:40.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.980+0000 7fed93b79700 1 -- 172.21.15.152:0/2255207055 wait complete. 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed93b79700 1 Processor -- start 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed93b79700 1 -- start start 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed93b79700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 0x7fed8c1090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed93b79700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fd150 0x7fed8c1095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed93b79700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c109ab0 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed93b79700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c109bf0 con 0x7fed8c0fd150 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed91915700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 0x7fed8c1090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed91915700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 0x7fed8c1090d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40798/0 (socket says 172.21.15.152:40798) 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed91915700 1 -- 172.21.15.152:0/2883046521 learned_addr learned my addr 172.21.15.152:0/2883046521 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.981+0000 7fed91114700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fd150 0x7fed8c1095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:40.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed91915700 1 -- 172.21.15.152:0/2883046521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fd150 msgr2=0x7fed8c1095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed91915700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fd150 0x7fed8c1095c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed91915700 1 -- 172.21.15.152:0/2883046521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c005040 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed91114700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fd150 0x7fed8c1095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed91915700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 0x7fed8c1090d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fed7c005010 tx=0x7fed7c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed82ffd700 1 -- 172.21.15.152:0/2883046521 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7c00e030 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c109e40 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed82ffd700 1 -- 172.21.15.152:0/2883046521 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fed7c007e90 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed82ffd700 1 -- 172.21.15.152:0/2883046521 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7c018070 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.982+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c112430 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.983+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c05f590 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.983+0000 7fed82ffd700 1 -- 172.21.15.152:0/2883046521 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fed7c01d6e0 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.984+0000 7fed82ffd700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fed7806ca30 0x7fed7806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:30:40.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.984+0000 7fed82ffd700 1 -- 172.21.15.152:0/2883046521 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fed7c08d160 con 0x7fed8c0fc7f0 2024-04-06T12:30:40.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.984+0000 7fed91114700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fed7806ca30 0x7fed7806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:30:40.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.984+0000 7fed91114700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fed7806ca30 0x7fed7806eef0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fed8c060f00 tx=0x7fed88009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:30:40.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:40.988+0000 7fed82ffd700 1 -- 172.21.15.152:0/2883046521 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fed7c05abb0 con 0x7fed8c0fc7f0 2024-04-06T12:30:41.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.258+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fed8c047540 con 0x7fed8c0fc7f0 2024-04-06T12:30:41.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.258+0000 7fed82ffd700 1 -- 172.21.15.152:0/2883046521 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1631 (secure 0 0 0) 0x7fed7c05a740 con 0x7fed8c0fc7f0 2024-04-06T12:30:41.256 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 5 pgs peering; Degraded data redundancy: 44/267 objects degraded (16.479%), 12 pgs degraded 2024-04-06T12:30:41.256 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: osd.3 (root=default,host=smithi195) is down 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 5 pgs peering 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: pg 1.0 is stuck peering for 2m, current state peering, last acting [0,1] 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.0 is stuck peering for 5m, current state remapped+peering, last acting [1,0] 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.5 is stuck peering for 5m, current state peering, last acting [0,4] 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.8 is stuck peering for 5m, current state peering, last acting [5,2] 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: pg 3.15 is stuck peering for 5m, current state peering, last acting [0,4] 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 44/267 objects degraded (16.479%), 12 pgs degraded 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-04-06T12:30:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-04-06T12:30:41.258 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-04-06T12:30:41.258 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-04-06T12:30:41.258 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-04-06T12:30:41.258 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-04-06T12:30:41.258 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-04-06T12:30:41.258 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-04-06T12:30:41.258 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-04-06T12:30:41.258 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fed7806ca30 msgr2=0x7fed7806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fed7806ca30 0x7fed7806eef0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fed8c060f00 tx=0x7fed88009d60).stop 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 msgr2=0x7fed8c1090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 0x7fed8c1090d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fed7c005010 tx=0x7fed7c009cb0).stop 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 shutdown_connections 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fed7806ca30 0x7fed7806eef0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed8c0fc7f0 0x7fed8c1090d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 --2- 172.21.15.152:0/2883046521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fd150 0x7fed8c1095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 >> 172.21.15.152:0/2883046521 conn(0x7fed8c070590 msgr2=0x7fed8c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:30:41.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.260+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 shutdown_connections 2024-04-06T12:30:41.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:30:41.261+0000 7fed93b79700 1 -- 172.21.15.152:0/2883046521 wait complete. 2024-04-06T12:30:41.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:41 smithi152 ceph-mon[104634]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:41.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:41 smithi152 ceph-mon[104634]: from='client.44213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:41.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:41 smithi152 ceph-mon[104634]: osdmap e69: 6 total, 5 up, 6 in 2024-04-06T12:30:41.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:41 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1244965840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:41.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:41 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3991822036' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:30:41.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:41 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:41.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:41 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:41.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:41 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:30:41.548 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[98622]: 2024-04-06T12:30:41.214+0000 7f07320ab640 -1 Falling back to public interface 2024-04-06T12:30:41.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:41 smithi195 ceph-mon[85980]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:41.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:41 smithi195 ceph-mon[85980]: from='client.44213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:41.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:41 smithi195 ceph-mon[85980]: osdmap e69: 6 total, 5 up, 6 in 2024-04-06T12:30:41.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:41 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1244965840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:41.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:41 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3991822036' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:30:41.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:41 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:41.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:41 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:41.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:41 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:30:42.477 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:42 smithi195 ceph-mon[85980]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:42.477 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:42 smithi195 ceph-mon[85980]: pgmap v115: 65 pgs: 4 remapped+peering, 12 active+undersized+degraded, 9 peering, 16 active+undersized, 24 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 44/267 objects degraded (16.479%) 2024-04-06T12:30:42.477 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:42 smithi195 ceph-mon[85980]: osdmap e70: 6 total, 5 up, 6 in 2024-04-06T12:30:42.477 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:42 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2883046521' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:30:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:42 smithi152 ceph-mon[104634]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:30:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:42 smithi152 ceph-mon[104634]: pgmap v115: 65 pgs: 4 remapped+peering, 12 active+undersized+degraded, 9 peering, 16 active+undersized, 24 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 44/267 objects degraded (16.479%) 2024-04-06T12:30:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:42 smithi152 ceph-mon[104634]: osdmap e70: 6 total, 5 up, 6 in 2024-04-06T12:30:42.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:42 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2883046521' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:30:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:44 smithi152 ceph-mon[104634]: pgmap v117: 65 pgs: 3 active+clean+remapped, 4 remapped+peering, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 53/267 objects degraded (19.850%); 1/267 objects misplaced (0.375%); 829 KiB/s, 49 objects/s recovering 2024-04-06T12:30:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:44 smithi195 ceph-mon[85980]: pgmap v117: 65 pgs: 3 active+clean+remapped, 4 remapped+peering, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 53/267 objects degraded (19.850%); 1/267 objects misplaced (0.375%); 829 KiB/s, 49 objects/s recovering 2024-04-06T12:30:46.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:45 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:46.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:45 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:46.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:45 smithi152 ceph-mon[104634]: pgmap v118: 65 pgs: 7 active+clean+remapped, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 53/267 objects degraded (19.850%); 6/267 objects misplaced (2.247%); 3.3 MiB/s, 44 objects/s recovering 2024-04-06T12:30:46.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:45 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:46.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:45 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:46.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:45 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:46.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:45 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:46.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:45 smithi195 ceph-mon[85980]: pgmap v118: 65 pgs: 7 active+clean+remapped, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 53/267 objects degraded (19.850%); 6/267 objects misplaced (2.247%); 3.3 MiB/s, 44 objects/s recovering 2024-04-06T12:30:46.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:45 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:46.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:45 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:46.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:46 smithi195 ceph-mon[85980]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-06T12:30:47.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:46 smithi152 ceph-mon[104634]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-06T12:30:47.205 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[98622]: 2024-04-06T12:30:47.102+0000 7f07320ab640 -1 osd.3 0 read_superblock omap replica is missing. 2024-04-06T12:30:47.798 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[98622]: 2024-04-06T12:30:47.480+0000 7f07320ab640 -1 osd.3 64 log_to_monitors true 2024-04-06T12:30:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:47 smithi195 ceph-mon[85980]: pgmap v119: 65 pgs: 7 active+clean+remapped, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 644 B/s rd, 1 op/s; 53/267 objects degraded (19.850%); 6/267 objects misplaced (2.247%); 2.5 MiB/s, 33 objects/s recovering 2024-04-06T12:30:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:47 smithi195 ceph-mon[85980]: from='osd.3 [v2:172.21.15.195:6800/2677078036,v1:172.21.15.195:6801/2677078036]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T12:30:47.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:47 smithi195 ceph-mon[85980]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T12:30:48.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:47 smithi152 ceph-mon[104634]: pgmap v119: 65 pgs: 7 active+clean+remapped, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 644 B/s rd, 1 op/s; 53/267 objects degraded (19.850%); 6/267 objects misplaced (2.247%); 2.5 MiB/s, 33 objects/s recovering 2024-04-06T12:30:48.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:47 smithi152 ceph-mon[104634]: from='osd.3 [v2:172.21.15.195:6800/2677078036,v1:172.21.15.195:6801/2677078036]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T12:30:48.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:47 smithi152 ceph-mon[104634]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-06T12:30:48.683 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:30:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[98622]: 2024-04-06T12:30:48.418+0000 7f071f4fc700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T12:30:49.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:48 smithi152 ceph-mon[104634]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-06T12:30:49.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:48 smithi152 ceph-mon[104634]: osdmap e71: 6 total, 5 up, 6 in 2024-04-06T12:30:49.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:48 smithi152 ceph-mon[104634]: from='osd.3 [v2:172.21.15.195:6800/2677078036,v1:172.21.15.195:6801/2677078036]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:30:49.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:48 smithi152 ceph-mon[104634]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:30:49.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:48 smithi152 ceph-mon[104634]: from='osd.3 ' entity='osd.3' 2024-04-06T12:30:49.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:48 smithi195 ceph-mon[85980]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-06T12:30:49.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:48 smithi195 ceph-mon[85980]: osdmap e71: 6 total, 5 up, 6 in 2024-04-06T12:30:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:48 smithi195 ceph-mon[85980]: from='osd.3 [v2:172.21.15.195:6800/2677078036,v1:172.21.15.195:6801/2677078036]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:30:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:48 smithi195 ceph-mon[85980]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:30:49.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:48 smithi195 ceph-mon[85980]: from='osd.3 ' entity='osd.3' 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: Health check update: Degraded data redundancy: 53/267 objects degraded (19.850%), 15 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: pgmap v121: 65 pgs: 7 active+clean+remapped, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 53/267 objects degraded (19.850%); 6/267 objects misplaced (2.247%); 2.5 MiB/s, 33 objects/s recovering 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:50.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-06T12:30:50.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-06T12:30:50.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-04-06T12:30:50.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:30:50.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: osd.3 [v2:172.21.15.195:6800/2677078036,v1:172.21.15.195:6801/2677078036] boot 2024-04-06T12:30:50.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: osdmap e72: 6 total, 6 up, 6 in 2024-04-06T12:30:50.027 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:30:50.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: Health check update: Degraded data redundancy: 53/267 objects degraded (19.850%), 15 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: pgmap v121: 65 pgs: 7 active+clean+remapped, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 53/267 objects degraded (19.850%); 6/267 objects misplaced (2.247%); 2.5 MiB/s, 33 objects/s recovering 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-06T12:30:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-04-06T12:30:50.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:30:50.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: osd.3 [v2:172.21.15.195:6800/2677078036,v1:172.21.15.195:6801/2677078036] boot 2024-04-06T12:30:50.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: osdmap e72: 6 total, 6 up, 6 in 2024-04-06T12:30:50.050 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-06T12:30:51.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:51 smithi152 ceph-mon[104634]: osdmap e73: 6 total, 6 up, 6 in 2024-04-06T12:30:51.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:51 smithi152 ceph-mon[104634]: pgmap v124: 65 pgs: 7 active+clean+remapped, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 53/267 objects degraded (19.850%); 6/267 objects misplaced (2.247%) 2024-04-06T12:30:51.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:51 smithi195 ceph-mon[85980]: osdmap e73: 6 total, 6 up, 6 in 2024-04-06T12:30:51.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:51 smithi195 ceph-mon[85980]: pgmap v124: 65 pgs: 7 active+clean+remapped, 15 active+undersized+degraded, 19 active+undersized, 24 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 53/267 objects degraded (19.850%); 6/267 objects misplaced (2.247%) 2024-04-06T12:30:52.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:52 smithi152 ceph-mon[104634]: osdmap e74: 6 total, 6 up, 6 in 2024-04-06T12:30:52.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:52.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:30:52.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:52 smithi195 ceph-mon[85980]: osdmap e74: 6 total, 6 up, 6 in 2024-04-06T12:30:52.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:30:52.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:30:53.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:53 smithi152 ceph-mon[104634]: osdmap e75: 6 total, 6 up, 6 in 2024-04-06T12:30:53.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:53 smithi152 ceph-mon[104634]: pgmap v127: 65 pgs: 3 active+clean+remapped, 1 peering, 5 active+undersized+degraded, 4 active+undersized, 52 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 op/s; 15/267 objects degraded (5.618%); 3/267 objects misplaced (1.124%); 0 B/s, 60 objects/s recovering 2024-04-06T12:30:53.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:53 smithi195 ceph-mon[85980]: osdmap e75: 6 total, 6 up, 6 in 2024-04-06T12:30:53.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:53 smithi195 ceph-mon[85980]: pgmap v127: 65 pgs: 3 active+clean+remapped, 1 peering, 5 active+undersized+degraded, 4 active+undersized, 52 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 op/s; 15/267 objects degraded (5.618%); 3/267 objects misplaced (1.124%); 0 B/s, 60 objects/s recovering 2024-04-06T12:30:54.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:54 smithi152 ceph-mon[104634]: osdmap e76: 6 total, 6 up, 6 in 2024-04-06T12:30:54.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:54 smithi152 ceph-mon[104634]: Health check update: Degraded data redundancy: 15/267 objects degraded (5.618%), 5 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:54.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:54 smithi195 ceph-mon[85980]: osdmap e76: 6 total, 6 up, 6 in 2024-04-06T12:30:54.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:54 smithi195 ceph-mon[85980]: Health check update: Degraded data redundancy: 15/267 objects degraded (5.618%), 5 pgs degraded (PG_DEGRADED) 2024-04-06T12:30:55.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:55 smithi152 ceph-mon[104634]: osdmap e77: 6 total, 6 up, 6 in 2024-04-06T12:30:55.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:55 smithi152 ceph-mon[104634]: pgmap v130: 65 pgs: 1 active+undersized+remapped, 2 peering, 62 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 0 B/s, 198 objects/s recovering 2024-04-06T12:30:55.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:55 smithi195 ceph-mon[85980]: osdmap e77: 6 total, 6 up, 6 in 2024-04-06T12:30:55.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:55 smithi195 ceph-mon[85980]: pgmap v130: 65 pgs: 1 active+undersized+remapped, 2 peering, 62 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 0 B/s, 198 objects/s recovering 2024-04-06T12:30:56.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:56 smithi152 ceph-mon[104634]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/267 objects degraded (5.618%), 5 pgs degraded) 2024-04-06T12:30:56.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:56 smithi195 ceph-mon[85980]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/267 objects degraded (5.618%), 5 pgs degraded) 2024-04-06T12:30:57.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:57 smithi152 ceph-mon[104634]: pgmap v131: 65 pgs: 1 active+undersized+remapped, 2 peering, 62 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 544 B/s rd, 1 op/s; 0 B/s, 140 objects/s recovering 2024-04-06T12:30:57.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:57 smithi195 ceph-mon[85980]: pgmap v131: 65 pgs: 1 active+undersized+remapped, 2 peering, 62 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 544 B/s rd, 1 op/s; 0 B/s, 140 objects/s recovering 2024-04-06T12:31:00.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:30:59 smithi195 ceph-mon[85980]: pgmap v132: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 119 objects/s recovering 2024-04-06T12:31:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:30:59 smithi152 ceph-mon[104634]: pgmap v132: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 119 objects/s recovering 2024-04-06T12:31:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:02 smithi152 ceph-mon[104634]: pgmap v133: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 0 B/s, 68 objects/s recovering 2024-04-06T12:31:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:02 smithi195 ceph-mon[85980]: pgmap v133: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 0 B/s, 68 objects/s recovering 2024-04-06T12:31:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:04 smithi152 ceph-mon[104634]: pgmap v134: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T12:31:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:04 smithi195 ceph-mon[85980]: pgmap v134: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T12:31:05.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:05 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-06T12:31:05.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:05 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-06T12:31:06.396 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:06 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-06T12:31:06.397 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:06 smithi195 ceph-mon[85980]: Upgrade: osd.4 is safe to restart 2024-04-06T12:31:06.397 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:06 smithi195 ceph-mon[85980]: pgmap v135: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 963 B/s rd, 1 op/s 2024-04-06T12:31:06.397 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:06.397 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-06T12:31:06.397 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:06 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:06.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:06 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-06T12:31:06.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:06 smithi152 ceph-mon[104634]: Upgrade: osd.4 is safe to restart 2024-04-06T12:31:06.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:06 smithi152 ceph-mon[104634]: pgmap v135: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 963 B/s rd, 1 op/s 2024-04-06T12:31:06.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:06.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-06T12:31:06.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:06 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:07.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:07 smithi195 ceph-mon[85980]: Upgrade: Updating osd.4 2024-04-06T12:31:07.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:07 smithi195 ceph-mon[85980]: Deploying daemon osd.4 on smithi195 2024-04-06T12:31:07.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:07.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:31:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:07 smithi152 ceph-mon[104634]: Upgrade: Updating osd.4 2024-04-06T12:31:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:07 smithi152 ceph-mon[104634]: Deploying daemon osd.4 on smithi195 2024-04-06T12:31:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:07.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:31:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:08 smithi152 ceph-mon[104634]: pgmap v136: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:31:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:08 smithi195 ceph-mon[85980]: pgmap v136: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:31:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:09.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:09 smithi195 systemd[1]: Stopping Ceph osd.4 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:31:09.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[54543]: debug 2024-04-06T12:31:09.431+0000 7f9a8b5a3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-06T12:31:09.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[54543]: debug 2024-04-06T12:31:09.431+0000 7f9a8b5a3700 -1 osd.4 77 *** Got signal Terminated *** 2024-04-06T12:31:09.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[54543]: debug 2024-04-06T12:31:09.431+0000 7f9a8b5a3700 -1 osd.4 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:31:10.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:09 smithi195 ceph-mon[85980]: pgmap v137: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:31:10.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:09 smithi195 ceph-mon[85980]: osd.4 marked itself down and dead 2024-04-06T12:31:10.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:09 smithi152 ceph-mon[104634]: pgmap v137: 65 pgs: 65 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:31:10.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:09 smithi152 ceph-mon[104634]: osd.4 marked itself down and dead 2024-04-06T12:31:10.548 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:10 smithi195 bash[104290]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4 2024-04-06T12:31:11.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:10 smithi195 ceph-mon[85980]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:31:11.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:10 smithi195 ceph-mon[85980]: osdmap e78: 6 total, 5 up, 6 in 2024-04-06T12:31:11.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:10 smithi152 ceph-mon[104634]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:31:11.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:10 smithi152 ceph-mon[104634]: osdmap e78: 6 total, 5 up, 6 in 2024-04-06T12:31:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 -- 172.21.15.152:0/1045829096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 msgr2=0x7fef5c0f7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 --2- 172.21.15.152:0/1045829096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 0x7fef5c0f7a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fef4c0047f0 tx=0x7fef4c009cb0).stop 2024-04-06T12:31:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 -- 172.21.15.152:0/1045829096 shutdown_connections 2024-04-06T12:31:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 --2- 172.21.15.152:0/1045829096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 0x7fef5c0f7a00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 --2- 172.21.15.152:0/1045829096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c0fd8c0 0x7fef5c0fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 -- 172.21.15.152:0/1045829096 >> 172.21.15.152:0/1045829096 conn(0x7fef5c0f34a0 msgr2=0x7fef5c0f58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 -- 172.21.15.152:0/1045829096 shutdown_connections 2024-04-06T12:31:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 -- 172.21.15.152:0/1045829096 wait complete. 2024-04-06T12:31:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 Processor -- start 2024-04-06T12:31:11.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.374+0000 7fef63603700 1 -- start start 2024-04-06T12:31:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef63603700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c0fd8c0 0x7fef5c10dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef63603700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 0x7fef5c10e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef63603700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c10eac0 con 0x7fef5c0fe220 2024-04-06T12:31:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef63603700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c10ec00 con 0x7fef5c0fd8c0 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef60b9e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 0x7fef5c10e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef60b9e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 0x7fef5c10e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35710/0 (socket says 172.21.15.152:35710) 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef60b9e700 1 -- 172.21.15.152:0/3768367977 learned_addr learned my addr 172.21.15.152:0/3768367977 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef6139f700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c0fd8c0 0x7fef5c10dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef60b9e700 1 -- 172.21.15.152:0/3768367977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c0fd8c0 msgr2=0x7fef5c10dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef60b9e700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c0fd8c0 0x7fef5c10dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef60b9e700 1 -- 172.21.15.152:0/3768367977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c005040 con 0x7fef5c0fe220 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef60b9e700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 0x7fef5c10e4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fef4c0099f0 tx=0x7fef4c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef527fc700 1 -- 172.21.15.152:0/3768367977 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef4c00e030 con 0x7fef5c0fe220 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef527fc700 1 -- 172.21.15.152:0/3768367977 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef4c007e90 con 0x7fef5c0fe220 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c108230 con 0x7fef5c0fe220 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef527fc700 1 -- 172.21.15.152:0/3768367977 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef4c018070 con 0x7fef5c0fe220 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.375+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c108710 con 0x7fef5c0fe220 2024-04-06T12:31:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.376+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c060390 con 0x7fef5c0fe220 2024-04-06T12:31:11.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.377+0000 7fef527fc700 1 -- 172.21.15.152:0/3768367977 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fef4c0094c0 con 0x7fef5c0fe220 2024-04-06T12:31:11.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.377+0000 7fef527fc700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fef4806caa0 0x7fef4806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:11.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.377+0000 7fef527fc700 1 -- 172.21.15.152:0/3768367977 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6250+0+0 (secure 0 0 0) 0x7fef4c08d070 con 0x7fef5c0fe220 2024-04-06T12:31:11.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.377+0000 7fef6139f700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fef4806caa0 0x7fef4806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:11.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.378+0000 7fef6139f700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fef4806caa0 0x7fef4806ef60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fef58004e60 tx=0x7fef5800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:11.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.382+0000 7fef527fc700 1 -- 172.21.15.152:0/3768367977 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fef4c05abb0 con 0x7fef5c0fe220 2024-04-06T12:31:11.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.584+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef5c109760 con 0x7fef4806caa0 2024-04-06T12:31:11.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.586+0000 7fef527fc700 1 -- 172.21.15.152:0/3768367977 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fef5c109760 con 0x7fef4806caa0 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fef4806caa0 msgr2=0x7fef4806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fef4806caa0 0x7fef4806ef60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fef58004e60 tx=0x7fef5800b040).stop 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 msgr2=0x7fef5c10e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 0x7fef5c10e4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fef4c0099f0 tx=0x7fef4c009cb0).stop 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 shutdown_connections 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fef4806caa0 0x7fef4806ef60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c0fd8c0 0x7fef5c10dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 --2- 172.21.15.152:0/3768367977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c0fe220 0x7fef5c10e4c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 >> 172.21.15.152:0/3768367977 conn(0x7fef5c0f34a0 msgr2=0x7fef5c0fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 shutdown_connections 2024-04-06T12:31:11.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.588+0000 7fef63603700 1 -- 172.21.15.152:0/3768367977 wait complete. 2024-04-06T12:31:11.596 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:31:11.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.688+0000 7f531df76700 1 -- 172.21.15.152:0/1011116855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 msgr2=0x7f53180f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.688+0000 7f531df76700 1 --2- 172.21.15.152:0/1011116855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 0x7f53180f6930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f53080047f0 tx=0x7f5308009cb0).stop 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.688+0000 7f531df76700 1 -- 172.21.15.152:0/1011116855 shutdown_connections 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.688+0000 7f531df76700 1 --2- 172.21.15.152:0/1011116855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 0x7f53180f6930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.688+0000 7f531df76700 1 --2- 172.21.15.152:0/1011116855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180fc7f0 0x7f53180fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.688+0000 7f531df76700 1 -- 172.21.15.152:0/1011116855 >> 172.21.15.152:0/1011116855 conn(0x7f5318070590 msgr2=0x7f53180f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.688+0000 7f531df76700 1 -- 172.21.15.152:0/1011116855 shutdown_connections 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.688+0000 7f531df76700 1 -- 172.21.15.152:0/1011116855 wait complete. 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f531df76700 1 Processor -- start 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f531df76700 1 -- start start 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f531df76700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180fc7f0 0x7f53181090a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f531df76700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 0x7f5318109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f531df76700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5318109a80 con 0x7f53180fd150 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f531df76700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5318109bc0 con 0x7f53180fc7f0 2024-04-06T12:31:11.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f5316ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 0x7f5318109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f5316ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 0x7f5318109590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35726/0 (socket says 172.21.15.152:35726) 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f5316ffd700 1 -- 172.21.15.152:0/2601802092 learned_addr learned my addr 172.21.15.152:0/2601802092 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f53177fe700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180fc7f0 0x7f53181090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f5316ffd700 1 -- 172.21.15.152:0/2601802092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180fc7f0 msgr2=0x7f53181090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f5316ffd700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180fc7f0 0x7f53181090a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f5316ffd700 1 -- 172.21.15.152:0/2601802092 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5308005040 con 0x7f53180fd150 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.689+0000 7f5316ffd700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 0x7f5318109590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f53080099f0 tx=0x7f5308009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.690+0000 7f5314ff9700 1 -- 172.21.15.152:0/2601802092 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f530800e030 con 0x7f53180fd150 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.690+0000 7f5314ff9700 1 -- 172.21.15.152:0/2601802092 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5308007e90 con 0x7f53180fd150 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.690+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5318109e10 con 0x7f53180fd150 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.690+0000 7f5314ff9700 1 -- 172.21.15.152:0/2601802092 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5308018070 con 0x7f53180fd150 2024-04-06T12:31:11.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.690+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5318112380 con 0x7f53180fd150 2024-04-06T12:31:11.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.691+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531805f590 con 0x7f53180fd150 2024-04-06T12:31:11.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.692+0000 7f5314ff9700 1 -- 172.21.15.152:0/2601802092 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f53080094c0 con 0x7f53180fd150 2024-04-06T12:31:11.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.692+0000 7f5314ff9700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f530006caa0 0x7f530006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:11.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.692+0000 7f5314ff9700 1 -- 172.21.15.152:0/2601802092 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6250+0+0 (secure 0 0 0) 0x7f530808d3a0 con 0x7f53180fd150 2024-04-06T12:31:11.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.692+0000 7f53177fe700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f530006caa0 0x7f530006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:11.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.692+0000 7f53177fe700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f530006caa0 0x7f530006ef60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f530c004e60 tx=0x7f530c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:11.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.696+0000 7f5314ff9700 1 -- 172.21.15.152:0/2601802092 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f5308057450 con 0x7f53180fd150 2024-04-06T12:31:11.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:11 smithi195 ceph-mon[85980]: osdmap e79: 6 total, 5 up, 6 in 2024-04-06T12:31:11.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:11 smithi195 ceph-mon[85980]: pgmap v140: 65 pgs: 6 stale+active+clean, 59 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-06T12:31:11.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.902+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53180610e0 con 0x7f530006caa0 2024-04-06T12:31:11.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.903+0000 7f5314ff9700 1 -- 172.21.15.152:0/2601802092 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f53180610e0 con 0x7f530006caa0 2024-04-06T12:31:11.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.905+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f530006caa0 msgr2=0x7f530006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:11.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.905+0000 7f531df76700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f530006caa0 0x7f530006ef60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f530c004e60 tx=0x7f530c00b040).stop 2024-04-06T12:31:11.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.905+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 msgr2=0x7f5318109590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:11.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.905+0000 7f531df76700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 0x7f5318109590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f53080099f0 tx=0x7f5308009cb0).stop 2024-04-06T12:31:11.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.905+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 shutdown_connections 2024-04-06T12:31:11.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.905+0000 7f531df76700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f530006caa0 0x7f530006ef60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.905+0000 7f531df76700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53180fc7f0 0x7f53181090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.905+0000 7f531df76700 1 --2- 172.21.15.152:0/2601802092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53180fd150 0x7f5318109590 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:11.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.906+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 >> 172.21.15.152:0/2601802092 conn(0x7f5318070590 msgr2=0x7f53180fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:11.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.906+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 shutdown_connections 2024-04-06T12:31:11.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:11.906+0000 7f531df76700 1 -- 172.21.15.152:0/2601802092 wait complete. 2024-04-06T12:31:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/1459089571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f8960 msgr2=0x7fbd440f8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 --2- 172.21.15.152:0/1459089571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f8960 0x7fbd440f8d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fbd38004820 tx=0x7fbd38009cb0).stop 2024-04-06T12:31:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/1459089571 shutdown_connections 2024-04-06T12:31:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 --2- 172.21.15.152:0/1459089571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd440f9230 0x7fbd441019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 --2- 172.21.15.152:0/1459089571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f8960 0x7fbd440f8d40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/1459089571 >> 172.21.15.152:0/1459089571 conn(0x7fbd44070590 msgr2=0x7fbd440f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/1459089571 shutdown_connections 2024-04-06T12:31:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/1459089571 wait complete. 2024-04-06T12:31:12.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 Processor -- start 2024-04-06T12:31:12.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.005+0000 7fbd4a3b6700 1 -- start start 2024-04-06T12:31:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd4a3b6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd440f8960 0x7fbd4410e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd4a3b6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f9230 0x7fbd4410e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd4a3b6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4410eb40 con 0x7fbd440f9230 2024-04-06T12:31:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd4a3b6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4410ec80 con 0x7fbd440f8960 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd437fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f9230 0x7fbd4410e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd437fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f9230 0x7fbd4410e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35750/0 (socket says 172.21.15.152:35750) 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd437fe700 1 -- 172.21.15.152:0/3401611139 learned_addr learned my addr 172.21.15.152:0/3401611139 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd43fff700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd440f8960 0x7fbd4410e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd437fe700 1 -- 172.21.15.152:0/3401611139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd440f8960 msgr2=0x7fbd4410e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd437fe700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd440f8960 0x7fbd4410e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd437fe700 1 -- 172.21.15.152:0/3401611139 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38005040 con 0x7fbd440f9230 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd43fff700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd440f8960 0x7fbd4410e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd437fe700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f9230 0x7fbd4410e540 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fbd340041d0 tx=0x7fbd34009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd417fa700 1 -- 172.21.15.152:0/3401611139 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd34007b40 con 0x7fbd440f9230 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd417fa700 1 -- 172.21.15.152:0/3401611139 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd3400f040 con 0x7fbd440f9230 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd44108310 con 0x7fbd440f9230 2024-04-06T12:31:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd417fa700 1 -- 172.21.15.152:0/3401611139 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd3400d800 con 0x7fbd440f9230 2024-04-06T12:31:12.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.006+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd44108850 con 0x7fbd440f9230 2024-04-06T12:31:12.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.007+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4405f590 con 0x7fbd440f9230 2024-04-06T12:31:12.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.008+0000 7fbd417fa700 1 -- 172.21.15.152:0/3401611139 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbd34007ca0 con 0x7fbd440f9230 2024-04-06T12:31:12.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.008+0000 7fbd417fa700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbd2c06caa0 0x7fbd2c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:12.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.008+0000 7fbd417fa700 1 -- 172.21.15.152:0/3401611139 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6250+0+0 (secure 0 0 0) 0x7fbd3408b8f0 con 0x7fbd440f9230 2024-04-06T12:31:12.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.008+0000 7fbd43fff700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbd2c06caa0 0x7fbd2c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:12.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.009+0000 7fbd43fff700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbd2c06caa0 0x7fbd2c06ef60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fbd38004580 tx=0x7fbd3800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:12.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.013+0000 7fbd417fa700 1 -- 172.21.15.152:0/3401611139 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fbd34059430 con 0x7fbd440f9230 2024-04-06T12:31:12.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.212+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd44108ad0 con 0x7fbd2c06caa0 2024-04-06T12:31:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.221+0000 7fbd417fa700 1 -- 172.21.15.152:0/3401611139 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fbd44108ad0 con 0x7fbd2c06caa0 2024-04-06T12:31:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:31:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (4m) 60s ago 16m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:31:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (2m) 60s ago 16m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:31:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (2m) 27s ago 15m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:31:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (4m) 60s ago 16m 90.5M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:31:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (11m) 60s ago 11m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (11m) 60s ago 11m 160M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (11m) 27s ago 11m 15.3M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (10m) 27s ago 10m 16.2M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (6m) 60s ago 17m 496M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (5m) 27s ago 15m 449M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (3m) 60s ago 17m 47.2M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (3m) 27s ago 15m 38.1M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 60s ago 16m 17.0M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 27s ago 15m 17.0M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (2m) 60s ago 14m 85.4M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (100s) 60s ago 14m 89.0M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 4e01281def3c 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (65s) 60s ago 13m 11.0M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 36456f3aa1eb 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (31s) 27s ago 13m 10.7M 2251M 18.2.2-1086-g052adcad 87261d5ece5a b41c5ddebdba 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (13m) 27s ago 13m 198M 2251M 16.2.15-1-g8963e9de 727f386679cb 51349e032f6c 2024-04-06T12:31:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (12m) 27s ago 12m 192M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:31:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (5m) 27s ago 15m 60.0M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:31:12.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.223+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbd2c06caa0 msgr2=0x7fbd2c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.223+0000 7fbd4a3b6700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbd2c06caa0 0x7fbd2c06ef60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fbd38004580 tx=0x7fbd3800b040).stop 2024-04-06T12:31:12.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.223+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f9230 msgr2=0x7fbd4410e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.223+0000 7fbd4a3b6700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f9230 0x7fbd4410e540 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fbd340041d0 tx=0x7fbd34009f60).stop 2024-04-06T12:31:12.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.224+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 shutdown_connections 2024-04-06T12:31:12.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.224+0000 7fbd4a3b6700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbd2c06caa0 0x7fbd2c06ef60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.224+0000 7fbd4a3b6700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd440f8960 0x7fbd4410e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.224+0000 7fbd4a3b6700 1 --2- 172.21.15.152:0/3401611139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd440f9230 0x7fbd4410e540 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.224+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 >> 172.21.15.152:0/3401611139 conn(0x7fbd44070590 msgr2=0x7fbd440fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:12.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.224+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 shutdown_connections 2024-04-06T12:31:12.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.224+0000 7fbd4a3b6700 1 -- 172.21.15.152:0/3401611139 wait complete. 2024-04-06T12:31:12.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:11 smithi152 ceph-mon[104634]: osdmap e79: 6 total, 5 up, 6 in 2024-04-06T12:31:12.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:11 smithi152 ceph-mon[104634]: pgmap v140: 65 pgs: 6 stale+active+clean, 59 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-06T12:31:12.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.323+0000 7f099a179700 1 -- 172.21.15.152:0/1129483559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fc7f0 msgr2=0x7f09940fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.323+0000 7f099a179700 1 --2- 172.21.15.152:0/1129483559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fc7f0 0x7f09940fcbd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f097c0047f0 tx=0x7f097c009cb0).stop 2024-04-06T12:31:12.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.323+0000 7f099a179700 1 -- 172.21.15.152:0/1129483559 shutdown_connections 2024-04-06T12:31:12.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.323+0000 7f099a179700 1 --2- 172.21.15.152:0/1129483559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09940fd150 0x7f09940f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.323+0000 7f099a179700 1 --2- 172.21.15.152:0/1129483559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fc7f0 0x7f09940fcbd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.323+0000 7f099a179700 1 -- 172.21.15.152:0/1129483559 >> 172.21.15.152:0/1129483559 conn(0x7f0994070590 msgr2=0x7f09940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:12.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.323+0000 7f099a179700 1 -- 172.21.15.152:0/1129483559 shutdown_connections 2024-04-06T12:31:12.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.323+0000 7f099a179700 1 -- 172.21.15.152:0/1129483559 wait complete. 2024-04-06T12:31:12.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f099a179700 1 Processor -- start 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f099a179700 1 -- start start 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f099a179700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09940fc7f0 0x7f099410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f099a179700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fd150 0x7f099410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f099a179700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099410eae0 con 0x7f09940fd150 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f099a179700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099410ec20 con 0x7f09940fc7f0 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f0992ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fd150 0x7f099410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f0992ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fd150 0x7f099410e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39834/0 (socket says 172.21.15.152:39834) 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f0992ffd700 1 -- 172.21.15.152:0/4248916431 learned_addr learned my addr 172.21.15.152:0/4248916431 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.324+0000 7f09937fe700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09940fc7f0 0x7f099410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.325+0000 7f0992ffd700 1 -- 172.21.15.152:0/4248916431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09940fc7f0 msgr2=0x7f099410dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.325+0000 7f0992ffd700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09940fc7f0 0x7f099410dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.325+0000 7f0992ffd700 1 -- 172.21.15.152:0/4248916431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c005040 con 0x7f09940fd150 2024-04-06T12:31:12.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.325+0000 7f0992ffd700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fd150 0x7f099410e4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0984002780 tx=0x7f0984009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:12.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.325+0000 7f0990ff9700 1 -- 172.21.15.152:0/4248916431 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0984007b40 con 0x7f09940fd150 2024-04-06T12:31:12.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.325+0000 7f0990ff9700 1 -- 172.21.15.152:0/4248916431 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f098400f040 con 0x7f09940fd150 2024-04-06T12:31:12.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.325+0000 7f0990ff9700 1 -- 172.21.15.152:0/4248916431 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0984014780 con 0x7f09940fd150 2024-04-06T12:31:12.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.325+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09941082b0 con 0x7f09940fd150 2024-04-06T12:31:12.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.325+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0994108820 con 0x7f09940fd150 2024-04-06T12:31:12.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.326+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099405f590 con 0x7f09940fd150 2024-04-06T12:31:12.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.326+0000 7f0990ff9700 1 -- 172.21.15.152:0/4248916431 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0984007ca0 con 0x7f09940fd150 2024-04-06T12:31:12.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.327+0000 7f0990ff9700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f098006caa0 0x7f098006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:12.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.327+0000 7f0990ff9700 1 -- 172.21.15.152:0/4248916431 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6250+0+0 (secure 0 0 0) 0x7f098408bd80 con 0x7f09940fd150 2024-04-06T12:31:12.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.327+0000 7f09937fe700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f098006caa0 0x7f098006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:12.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.327+0000 7f09937fe700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f098006caa0 0x7f098006ef60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f097c004f10 tx=0x7f097c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:12.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.331+0000 7f0990ff9700 1 -- 172.21.15.152:0/4248916431 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f0984059800 con 0x7f09940fd150 2024-04-06T12:31:12.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:12 smithi195 systemd[1]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.4.service: Succeeded. 2024-04-06T12:31:12.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:12 smithi195 systemd[1]: Stopped Ceph osd.4 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:31:12.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:12 smithi195 systemd[1]: Starting Ceph osd.4 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:31:12.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.597+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0994108f10 con 0x7f09940fd150 2024-04-06T12:31:12.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.597+0000 7f0990ff9700 1 -- 172.21.15.152:0/4248916431 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f0984059390 con 0x7f09940fd150 2024-04-06T12:31:12.595 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:31:12.595 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:31:12.595 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:31:12.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:31:12.595 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:31:12.595 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:31:12.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 4 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 5, 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 8 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:31:12.596 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:31:12.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.599+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f098006caa0 msgr2=0x7f098006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.599+0000 7f099a179700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f098006caa0 0x7f098006ef60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f097c004f10 tx=0x7f097c00b040).stop 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.599+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fd150 msgr2=0x7f099410e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.599+0000 7f099a179700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fd150 0x7f099410e4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0984002780 tx=0x7f0984009ee0).stop 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.599+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 shutdown_connections 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.599+0000 7f099a179700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f098006caa0 0x7f098006ef60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.599+0000 7f099a179700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09940fc7f0 0x7f099410dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.599+0000 7f099a179700 1 --2- 172.21.15.152:0/4248916431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09940fd150 0x7f099410e4e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.599+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 >> 172.21.15.152:0/4248916431 conn(0x7f0994070590 msgr2=0x7f0994060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.600+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 shutdown_connections 2024-04-06T12:31:12.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.600+0000 7f099a179700 1 -- 172.21.15.152:0/4248916431 wait complete. 2024-04-06T12:31:12.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.698+0000 7f34bc54b700 1 -- 172.21.15.152:0/2844248630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fc7f0 msgr2=0x7f34b40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.698+0000 7f34bc54b700 1 --2- 172.21.15.152:0/2844248630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fc7f0 0x7f34b40fcbd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f34a80047f0 tx=0x7f34a8009cb0).stop 2024-04-06T12:31:12.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.698+0000 7f34bc54b700 1 -- 172.21.15.152:0/2844248630 shutdown_connections 2024-04-06T12:31:12.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.698+0000 7f34bc54b700 1 --2- 172.21.15.152:0/2844248630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34b40fd150 0x7f34b40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.698+0000 7f34bc54b700 1 --2- 172.21.15.152:0/2844248630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fc7f0 0x7f34b40fcbd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.698+0000 7f34bc54b700 1 -- 172.21.15.152:0/2844248630 >> 172.21.15.152:0/2844248630 conn(0x7f34b4070590 msgr2=0x7f34b40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.698+0000 7f34bc54b700 1 -- 172.21.15.152:0/2844248630 shutdown_connections 2024-04-06T12:31:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.698+0000 7f34bc54b700 1 -- 172.21.15.152:0/2844248630 wait complete. 2024-04-06T12:31:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34bc54b700 1 Processor -- start 2024-04-06T12:31:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34bc54b700 1 -- start start 2024-04-06T12:31:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34bc54b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34b40fc7f0 0x7f34b4110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34bc54b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fd150 0x7f34b41107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34bc54b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b4110df0 con 0x7f34b40fd150 2024-04-06T12:31:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34bc54b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b4110f30 con 0x7f34b40fc7f0 2024-04-06T12:31:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34b9ae6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fd150 0x7f34b41107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34b9ae6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fd150 0x7f34b41107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39848/0 (socket says 172.21.15.152:39848) 2024-04-06T12:31:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34b9ae6700 1 -- 172.21.15.152:0/3117095195 learned_addr learned my addr 172.21.15.152:0/3117095195 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.699+0000 7f34ba2e7700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34b40fc7f0 0x7f34b4110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34b9ae6700 1 -- 172.21.15.152:0/3117095195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34b40fc7f0 msgr2=0x7f34b4110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34b9ae6700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34b40fc7f0 0x7f34b4110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34b9ae6700 1 -- 172.21.15.152:0/3117095195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a8005040 con 0x7f34b40fd150 2024-04-06T12:31:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34ba2e7700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34b40fc7f0 0x7f34b4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:31:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34b9ae6700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fd150 0x7f34b41107f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f34b000e940 tx=0x7f34b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34a77fe700 1 -- 172.21.15.152:0/3117095195 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b000ee80 con 0x7f34b40fd150 2024-04-06T12:31:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b410a5a0 con 0x7f34b40fd150 2024-04-06T12:31:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34a77fe700 1 -- 172.21.15.152:0/3117095195 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34b000f040 con 0x7f34b40fd150 2024-04-06T12:31:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34a77fe700 1 -- 172.21.15.152:0/3117095195 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b000c810 con 0x7f34b40fd150 2024-04-06T12:31:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.700+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b410ab60 con 0x7f34b40fd150 2024-04-06T12:31:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.701+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b405f590 con 0x7f34b40fd150 2024-04-06T12:31:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.701+0000 7f34a77fe700 1 -- 172.21.15.152:0/3117095195 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f34b00090d0 con 0x7f34b40fd150 2024-04-06T12:31:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.702+0000 7f34a77fe700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f34a006ca30 0x7f34a006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.702+0000 7f34a77fe700 1 -- 172.21.15.152:0/3117095195 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6250+0+0 (secure 0 0 0) 0x7f34b008b8e0 con 0x7f34b40fd150 2024-04-06T12:31:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.702+0000 7f34ba2e7700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f34a006ca30 0x7f34a006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.702+0000 7f34ba2e7700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f34a006ca30 0x7f34a006eef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f34a8004e60 tx=0x7f34a800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:12.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.706+0000 7f34a77fe700 1 -- 172.21.15.152:0/3117095195 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f34b0055990 con 0x7f34b40fd150 2024-04-06T12:31:12.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.937+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f34b4047540 con 0x7f34b40fd150 2024-04-06T12:31:12.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.937+0000 7f34a77fe700 1 -- 172.21.15.152:0/3117095195 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f34b00093d0 con 0x7f34b40fd150 2024-04-06T12:31:12.935 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:31:12.936 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:31:12.936 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:31:12.936 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:31:12.936 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:31:12.936 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:31:12.936 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:31:12.936 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:31:12.936 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:31:12.937 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:31:12.937 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:31:12.937 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:31:12.937 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:31:12.938 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:31:12.938 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:31:12.938 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:31:12.941 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:31:12.941 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:31:12.941 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:31:12.941 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:31:12.942 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:31:12.943 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:31:12.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:31:12.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:31:12.943 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:31:12.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:31:12.943 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:31:12.943 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f34a006ca30 msgr2=0x7f34a006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f34a006ca30 0x7f34a006eef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f34a8004e60 tx=0x7f34a800b040).stop 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fd150 msgr2=0x7f34b41107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fd150 0x7f34b41107f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f34b000e940 tx=0x7f34b000b040).stop 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 shutdown_connections 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f34a006ca30 0x7f34a006eef0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34b40fc7f0 0x7f34b4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 --2- 172.21.15.152:0/3117095195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b40fd150 0x7f34b41107f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 >> 172.21.15.152:0/3117095195 conn(0x7f34b4070590 msgr2=0x7f34b4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:12.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 shutdown_connections 2024-04-06T12:31:12.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:12.940+0000 7f34bc54b700 1 -- 172.21.15.152:0/3117095195 wait complete. 2024-04-06T12:31:12.945 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:31:13.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.040+0000 7fb42a0cd700 1 -- 172.21.15.152:0/3597803082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 msgr2=0x7fb4240f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.040+0000 7fb42a0cd700 1 --2- 172.21.15.152:0/3597803082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 0x7fb4240f7a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fb4180047f0 tx=0x7fb418009cb0).stop 2024-04-06T12:31:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.040+0000 7fb42a0cd700 1 -- 172.21.15.152:0/3597803082 shutdown_connections 2024-04-06T12:31:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.040+0000 7fb42a0cd700 1 --2- 172.21.15.152:0/3597803082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 0x7fb4240f7a30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.040+0000 7fb42a0cd700 1 --2- 172.21.15.152:0/3597803082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4240fd8f0 0x7fb4240fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.040+0000 7fb42a0cd700 1 -- 172.21.15.152:0/3597803082 >> 172.21.15.152:0/3597803082 conn(0x7fb4240f34b0 msgr2=0x7fb4240f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.040+0000 7fb42a0cd700 1 -- 172.21.15.152:0/3597803082 shutdown_connections 2024-04-06T12:31:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.040+0000 7fb42a0cd700 1 -- 172.21.15.152:0/3597803082 wait complete. 2024-04-06T12:31:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.041+0000 7fb42a0cd700 1 Processor -- start 2024-04-06T12:31:13.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.041+0000 7fb42a0cd700 1 -- start start 2024-04-06T12:31:13.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.041+0000 7fb42a0cd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4240fd8f0 0x7fb42410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.041+0000 7fb42a0cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 0x7fb42410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.041+0000 7fb42a0cd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42410eb70 con 0x7fb4240fe250 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.041+0000 7fb42a0cd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42410ecb0 con 0x7fb4240fd8f0 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb422ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 0x7fb42410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb4237fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4240fd8f0 0x7fb42410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb422ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 0x7fb42410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39866/0 (socket says 172.21.15.152:39866) 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb422ffd700 1 -- 172.21.15.152:0/1411401441 learned_addr learned my addr 172.21.15.152:0/1411401441 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb422ffd700 1 -- 172.21.15.152:0/1411401441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4240fd8f0 msgr2=0x7fb42410e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb422ffd700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4240fd8f0 0x7fb42410e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb422ffd700 1 -- 172.21.15.152:0/1411401441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb418005040 con 0x7fb4240fe250 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb422ffd700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 0x7fb42410e570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb4180099f0 tx=0x7fb418009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb420ff9700 1 -- 172.21.15.152:0/1411401441 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb41800e030 con 0x7fb4240fe250 2024-04-06T12:31:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4241082e0 con 0x7fb4240fe250 2024-04-06T12:31:13.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb420ff9700 1 -- 172.21.15.152:0/1411401441 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb418007e90 con 0x7fb4240fe250 2024-04-06T12:31:13.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb420ff9700 1 -- 172.21.15.152:0/1411401441 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb418018070 con 0x7fb4240fe250 2024-04-06T12:31:13.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.042+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4241087c0 con 0x7fb4240fe250 2024-04-06T12:31:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.043+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42405f590 con 0x7fb4240fe250 2024-04-06T12:31:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.043+0000 7fb420ff9700 1 -- 172.21.15.152:0/1411401441 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb4180094c0 con 0x7fb4240fe250 2024-04-06T12:31:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.044+0000 7fb420ff9700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb40c06caa0 0x7fb40c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.044+0000 7fb420ff9700 1 -- 172.21.15.152:0/1411401441 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6250+0+0 (secure 0 0 0) 0x7fb41808d030 con 0x7fb4240fe250 2024-04-06T12:31:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.044+0000 7fb4237fe700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb40c06caa0 0x7fb40c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.044+0000 7fb4237fe700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb40c06caa0 0x7fb40c06ef60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb414004dc0 tx=0x7fb41400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:13.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.048+0000 7fb420ff9700 1 -- 172.21.15.152:0/1411401441 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fb41805ab70 con 0x7fb4240fe250 2024-04-06T12:31:13.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:12 smithi195 ceph-mon[85980]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:13.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:12 smithi195 ceph-mon[85980]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:13.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:12 smithi195 ceph-mon[85980]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:13.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:12 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/4248916431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:13.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.256+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb424109810 con 0x7fb40c06caa0 2024-04-06T12:31:13.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.257+0000 7fb420ff9700 1 -- 172.21.15.152:0/1411401441 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb424109810 con 0x7fb40c06caa0 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "crash" 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "10/21 daemons upgraded", 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2024-04-06T12:31:13.255 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:31:13.256 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb40c06caa0 msgr2=0x7fb40c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb40c06caa0 0x7fb40c06ef60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb414004dc0 tx=0x7fb41400b040).stop 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 msgr2=0x7fb42410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 0x7fb42410e570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb4180099f0 tx=0x7fb418009cb0).stop 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 shutdown_connections 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb40c06caa0 0x7fb40c06ef60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4240fd8f0 0x7fb42410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 --2- 172.21.15.152:0/1411401441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4240fe250 0x7fb42410e570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 >> 172.21.15.152:0/1411401441 conn(0x7fb4240f34b0 msgr2=0x7fb4240fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:13.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 shutdown_connections 2024-04-06T12:31:13.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.259+0000 7fb42a0cd700 1 -- 172.21.15.152:0/1411401441 wait complete. 2024-04-06T12:31:13.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:12 smithi152 ceph-mon[104634]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:13.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:12 smithi152 ceph-mon[104634]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:13.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:12 smithi152 ceph-mon[104634]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:13.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:12 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/4248916431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:13.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.358+0000 7f9392338700 1 -- 172.21.15.152:0/873516916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fe270 msgr2=0x7f938c0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:13.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.358+0000 7f9392338700 1 --2- 172.21.15.152:0/873516916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fe270 0x7f938c0f7a50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f93800047f0 tx=0x7f9380009cb0).stop 2024-04-06T12:31:13.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.358+0000 7f9392338700 1 -- 172.21.15.152:0/873516916 shutdown_connections 2024-04-06T12:31:13.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.358+0000 7f9392338700 1 --2- 172.21.15.152:0/873516916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fe270 0x7f938c0f7a50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.358+0000 7f9392338700 1 --2- 172.21.15.152:0/873516916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fd910 0x7f938c0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.358+0000 7f9392338700 1 -- 172.21.15.152:0/873516916 >> 172.21.15.152:0/873516916 conn(0x7f938c0f3530 msgr2=0x7f938c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:13.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.358+0000 7f9392338700 1 -- 172.21.15.152:0/873516916 shutdown_connections 2024-04-06T12:31:13.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.359+0000 7f9392338700 1 -- 172.21.15.152:0/873516916 wait complete. 2024-04-06T12:31:13.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.359+0000 7f9392338700 1 Processor -- start 2024-04-06T12:31:13.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.359+0000 7f9392338700 1 -- start start 2024-04-06T12:31:13.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.359+0000 7f9392338700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fd910 0x7f938c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:13.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.359+0000 7f9392338700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fe270 0x7f938c10e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.359+0000 7f9392338700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c10eab0 con 0x7f938c0fd910 2024-04-06T12:31:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.359+0000 7f9392338700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c10ebf0 con 0x7f938c0fe270 2024-04-06T12:31:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f938bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fd910 0x7f938c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f938bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fd910 0x7f938c10dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39876/0 (socket says 172.21.15.152:39876) 2024-04-06T12:31:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f938bfff700 1 -- 172.21.15.152:0/383362920 learned_addr learned my addr 172.21.15.152:0/383362920 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:13.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f938b7fe700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fe270 0x7f938c10e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f938bfff700 1 -- 172.21.15.152:0/383362920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fe270 msgr2=0x7f938c10e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f938bfff700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fe270 0x7f938c10e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f938bfff700 1 -- 172.21.15.152:0/383362920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9380005040 con 0x7f938c0fd910 2024-04-06T12:31:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f938bfff700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fd910 0x7f938c10dfc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f937c0041d0 tx=0x7f937c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f93897fa700 1 -- 172.21.15.152:0/383362920 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937c007b40 con 0x7f938c0fd910 2024-04-06T12:31:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f93897fa700 1 -- 172.21.15.152:0/383362920 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f937c00f040 con 0x7f938c0fd910 2024-04-06T12:31:13.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c108280 con 0x7f938c0fd910 2024-04-06T12:31:13.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f93897fa700 1 -- 172.21.15.152:0/383362920 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937c00d800 con 0x7f938c0fd910 2024-04-06T12:31:13.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.360+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c108840 con 0x7f938c0fd910 2024-04-06T12:31:13.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.361+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c05f570 con 0x7f938c0fd910 2024-04-06T12:31:13.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.362+0000 7f93897fa700 1 -- 172.21.15.152:0/383362920 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f937c009110 con 0x7f938c0fd910 2024-04-06T12:31:13.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.362+0000 7f93897fa700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f937406caa0 0x7f937406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:13.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.362+0000 7f93897fa700 1 -- 172.21.15.152:0/383362920 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6250+0+0 (secure 0 0 0) 0x7f937c08b7e0 con 0x7f938c0fd910 2024-04-06T12:31:13.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.362+0000 7f938b7fe700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f937406caa0 0x7f937406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:13.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.363+0000 7f938b7fe700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f937406caa0 0x7f937406ef60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9380004f10 tx=0x7f938000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:13.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.367+0000 7f93897fa700 1 -- 172.21.15.152:0/383362920 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f937c059320 con 0x7f938c0fd910 2024-04-06T12:31:13.548 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:13 smithi195 bash[104559]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-06T12:31:13.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:13 smithi195 bash[104559]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-06T12:31:13.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:13 smithi195 bash[104559]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-06T12:31:13.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:13 smithi195 bash[104559]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-06T12:31:13.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:13 smithi195 bash[104559]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-06T12:31:13.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:13 smithi195 bash[104559]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-06T12:31:13.549 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:13 smithi195 bash[104559]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-06T12:31:13.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.633+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f938c047540 con 0x7f938c0fd910 2024-04-06T12:31:13.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.633+0000 7f93897fa700 1 -- 172.21.15.152:0/383362920 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+290 (secure 0 0 0) 0x7f937c058eb0 con 0x7f938c0fd910 2024-04-06T12:31:13.631 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-04-06T12:31:13.632 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:31:13.632 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:31:13.632 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-06T12:31:13.632 INFO:teuthology.orchestra.run.smithi152.stdout: osd.4 (root=default,host=smithi195) is down 2024-04-06T12:31:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f937406caa0 msgr2=0x7f937406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f937406caa0 0x7f937406ef60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9380004f10 tx=0x7f938000b040).stop 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fd910 msgr2=0x7f938c10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fd910 0x7f938c10dfc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f937c0041d0 tx=0x7f937c009f60).stop 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 shutdown_connections 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f937406caa0 0x7f937406ef60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f938c0fd910 0x7f938c10dfc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 --2- 172.21.15.152:0/383362920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fe270 0x7f938c10e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 >> 172.21.15.152:0/383362920 conn(0x7f938c0f3530 msgr2=0x7f938c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 shutdown_connections 2024-04-06T12:31:13.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:13.636+0000 7f9392338700 1 -- 172.21.15.152:0/383362920 wait complete. 2024-04-06T12:31:14.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:13 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3117095195' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:31:14.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:13 smithi195 ceph-mon[85980]: pgmap v141: 65 pgs: 11 active+undersized+degraded, 2 stale+active+clean, 12 active+undersized, 40 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 38/267 objects degraded (14.232%) 2024-04-06T12:31:14.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:13 smithi195 ceph-mon[85980]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:14.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:13 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/383362920' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:31:14.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:13 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3117095195' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:31:14.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:13 smithi152 ceph-mon[104634]: pgmap v141: 65 pgs: 11 active+undersized+degraded, 2 stale+active+clean, 12 active+undersized, 40 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 38/267 objects degraded (14.232%) 2024-04-06T12:31:14.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:13 smithi152 ceph-mon[104634]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:14.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:13 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/383362920' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:31:14.798 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:14 smithi195 ceph-osd[104881]: -- 172.21.15.195:0/1554234289 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a3986091e0 con 0x55a3985d9000 2024-04-06T12:31:14.798 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:14 smithi195 bash[104843]: 887060bd04bc59afbc41356683a256fbef2c4d514f3b0b8252025e04da319e6d 2024-04-06T12:31:14.798 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:14 smithi195 systemd[1]: Started Ceph osd.4 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:31:15.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:14 smithi152 ceph-mon[104634]: Health check failed: Degraded data redundancy: 38/267 objects degraded (14.232%), 11 pgs degraded (PG_DEGRADED) 2024-04-06T12:31:15.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:14 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:15.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:14 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:15.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:14 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:15.290 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:14 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:31:14.992+0000 7f8689438640 -1 Falling back to public interface 2024-04-06T12:31:15.290 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:14 smithi195 ceph-mon[85980]: Health check failed: Degraded data redundancy: 38/267 objects degraded (14.232%), 11 pgs degraded (PG_DEGRADED) 2024-04-06T12:31:15.290 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:14 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:15.290 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:14 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:15.290 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:14 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:16.072 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:15 smithi195 ceph-mon[85980]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:16.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:15 smithi152 ceph-mon[104634]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:18 smithi152 ceph-mon[104634]: pgmap v143: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:18 smithi195 ceph-mon[85980]: pgmap v143: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:19.475 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:19.475 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:19.475 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:19.475 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:20 smithi195 ceph-mon[85980]: pgmap v144: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 552 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:20.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:20 smithi152 ceph-mon[104634]: pgmap v144: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 552 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:22.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:22 smithi195 ceph-mon[85980]: pgmap v145: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 498 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:22.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:22.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:31:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:22 smithi152 ceph-mon[104634]: pgmap v145: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 498 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:31:23.114 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:22 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:31:22.819+0000 7f8689438640 -1 osd.4 0 read_superblock omap replica is missing. 2024-04-06T12:31:23.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='osd.4 [v2:172.21.15.195:6808/4141179082,v1:172.21.15.195:6809/4141179082]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T12:31:23.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:23 smithi152 ceph-mon[104634]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T12:31:23.548 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:31:23.116+0000 7f8689438640 -1 osd.4 77 log_to_monitors true 2024-04-06T12:31:23.548 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:31:23.275+0000 7f867a891700 -1 osd.4 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='osd.4 [v2:172.21.15.195:6808/4141179082,v1:172.21.15.195:6809/4141179082]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T12:31:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:23 smithi195 ceph-mon[85980]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-06T12:31:24.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:24 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-06T12:31:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:24 smithi152 ceph-mon[104634]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-04-06T12:31:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:24 smithi152 ceph-mon[104634]: pgmap v146: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:24 smithi152 ceph-mon[104634]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-06T12:31:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:24 smithi152 ceph-mon[104634]: osdmap e80: 6 total, 5 up, 6 in 2024-04-06T12:31:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:24 smithi152 ceph-mon[104634]: from='osd.4 [v2:172.21.15.195:6808/4141179082,v1:172.21.15.195:6809/4141179082]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:31:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:24 smithi152 ceph-mon[104634]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:31:24.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:24 smithi152 ceph-mon[104634]: Health check update: Degraded data redundancy: 45/267 objects degraded (16.854%), 15 pgs degraded (PG_DEGRADED) 2024-04-06T12:31:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:24 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-06T12:31:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:24 smithi195 ceph-mon[85980]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-04-06T12:31:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:24 smithi195 ceph-mon[85980]: pgmap v146: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:24 smithi195 ceph-mon[85980]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-06T12:31:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:24 smithi195 ceph-mon[85980]: osdmap e80: 6 total, 5 up, 6 in 2024-04-06T12:31:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:24 smithi195 ceph-mon[85980]: from='osd.4 [v2:172.21.15.195:6808/4141179082,v1:172.21.15.195:6809/4141179082]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:31:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:24 smithi195 ceph-mon[85980]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:31:24.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:24 smithi195 ceph-mon[85980]: Health check update: Degraded data redundancy: 45/267 objects degraded (16.854%), 15 pgs degraded (PG_DEGRADED) 2024-04-06T12:31:25.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:25 smithi195 ceph-mon[85980]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:31:25.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:25 smithi195 ceph-mon[85980]: osd.4 [v2:172.21.15.195:6808/4141179082,v1:172.21.15.195:6809/4141179082] boot 2024-04-06T12:31:25.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:25 smithi195 ceph-mon[85980]: osdmap e81: 6 total, 6 up, 6 in 2024-04-06T12:31:25.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:25 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:31:25.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:25 smithi195 ceph-mon[85980]: osdmap e82: 6 total, 6 up, 6 in 2024-04-06T12:31:25.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:25 smithi152 ceph-mon[104634]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:31:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:25 smithi152 ceph-mon[104634]: osd.4 [v2:172.21.15.195:6808/4141179082,v1:172.21.15.195:6809/4141179082] boot 2024-04-06T12:31:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:25 smithi152 ceph-mon[104634]: osdmap e81: 6 total, 6 up, 6 in 2024-04-06T12:31:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:25 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-06T12:31:25.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:25 smithi152 ceph-mon[104634]: osdmap e82: 6 total, 6 up, 6 in 2024-04-06T12:31:26.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:26 smithi195 ceph-mon[85980]: pgmap v149: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:26.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:26 smithi152 ceph-mon[104634]: pgmap v149: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:27.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:27 smithi195 ceph-mon[85980]: pgmap v151: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:27.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:27 smithi152 ceph-mon[104634]: pgmap v151: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 45/267 objects degraded (16.854%) 2024-04-06T12:31:30.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:29 smithi195 ceph-mon[85980]: pgmap v152: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 2 op/s 2024-04-06T12:31:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:29 smithi152 ceph-mon[104634]: pgmap v152: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 2 op/s 2024-04-06T12:31:31.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:30 smithi195 ceph-mon[85980]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/267 objects degraded (16.854%), 15 pgs degraded) 2024-04-06T12:31:31.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:30 smithi152 ceph-mon[104634]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/267 objects degraded (16.854%), 15 pgs degraded) 2024-04-06T12:31:32.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:31 smithi152 ceph-mon[104634]: pgmap v153: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 524 B/s rd, 1 op/s 2024-04-06T12:31:32.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:31 smithi195 ceph-mon[85980]: pgmap v153: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 524 B/s rd, 1 op/s 2024-04-06T12:31:34.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:34 smithi152 ceph-mon[104634]: pgmap v154: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T12:31:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:34 smithi195 ceph-mon[85980]: pgmap v154: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-06T12:31:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:36 smithi152 ceph-mon[104634]: pgmap v155: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-04-06T12:31:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:36 smithi195 ceph-mon[85980]: pgmap v155: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-04-06T12:31:38.263 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:38 smithi195 ceph-mon[85980]: pgmap v156: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 780 B/s rd, 1 op/s 2024-04-06T12:31:38.263 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:38.263 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:31:38.263 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:38.263 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:38 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-06T12:31:38.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:38 smithi152 ceph-mon[104634]: pgmap v156: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 780 B/s rd, 1 op/s 2024-04-06T12:31:38.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:31:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:38.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:38 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-06T12:31:39.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:39 smithi195 ceph-mon[85980]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-06T12:31:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:39 smithi195 ceph-mon[85980]: Upgrade: osd.5 is safe to restart 2024-04-06T12:31:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:39 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:39 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-06T12:31:39.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:39 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:39.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:39 smithi152 ceph-mon[104634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-06T12:31:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:39 smithi152 ceph-mon[104634]: Upgrade: osd.5 is safe to restart 2024-04-06T12:31:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:39 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:39 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-06T12:31:39.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:39 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:40.446 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:40 smithi195 ceph-mon[85980]: Upgrade: Updating osd.5 2024-04-06T12:31:40.447 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:40 smithi195 ceph-mon[85980]: Deploying daemon osd.5 on smithi195 2024-04-06T12:31:40.447 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:40 smithi195 ceph-mon[85980]: pgmap v157: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:31:40.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:40 smithi152 ceph-mon[104634]: Upgrade: Updating osd.5 2024-04-06T12:31:40.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:40 smithi152 ceph-mon[104634]: Deploying daemon osd.5 on smithi195 2024-04-06T12:31:40.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:40 smithi152 ceph-mon[104634]: pgmap v157: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:31:42.418 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:42 smithi195 ceph-mon[85980]: pgmap v158: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:31:42.418 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:42 smithi195 systemd[1]: Stopping Ceph osd.5 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:31:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:42 smithi152 ceph-mon[104634]: pgmap v158: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:31:42.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[60120]: debug 2024-04-06T12:31:42.419+0000 7f9952a78700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-04-06T12:31:42.799 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[60120]: debug 2024-04-06T12:31:42.419+0000 7f9952a78700 -1 osd.5 82 *** Got signal Terminated *** 2024-04-06T12:31:42.799 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[60120]: debug 2024-04-06T12:31:42.419+0000 7f9952a78700 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:31:43.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:43 smithi195 ceph-mon[85980]: osd.5 marked itself down and dead 2024-04-06T12:31:43.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:43 smithi152 ceph-mon[104634]: osd.5 marked itself down and dead 2024-04-06T12:31:43.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.744+0000 7ff745ff3700 1 -- 172.21.15.152:0/2794943453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 msgr2=0x7ff7400f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:43.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.744+0000 7ff745ff3700 1 --2- 172.21.15.152:0/2794943453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 0x7ff7400f7ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ff7300047f0 tx=0x7ff730009cb0).stop 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.744+0000 7ff745ff3700 1 -- 172.21.15.152:0/2794943453 shutdown_connections 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.744+0000 7ff745ff3700 1 --2- 172.21.15.152:0/2794943453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 0x7ff7400f7ab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.744+0000 7ff745ff3700 1 --2- 172.21.15.152:0/2794943453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7400fd970 0x7ff7400fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.744+0000 7ff745ff3700 1 -- 172.21.15.152:0/2794943453 >> 172.21.15.152:0/2794943453 conn(0x7ff7400f3550 msgr2=0x7ff7400f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.744+0000 7ff745ff3700 1 -- 172.21.15.152:0/2794943453 shutdown_connections 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.744+0000 7ff745ff3700 1 -- 172.21.15.152:0/2794943453 wait complete. 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.745+0000 7ff745ff3700 1 Processor -- start 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.745+0000 7ff745ff3700 1 -- start start 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.745+0000 7ff745ff3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7400fd970 0x7ff74006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.745+0000 7ff745ff3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 0x7ff74006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.745+0000 7ff745ff3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74006bab0 con 0x7ff7400fe2d0 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.745+0000 7ff745ff3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74006bbf0 con 0x7ff7400fd970 2024-04-06T12:31:43.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.745+0000 7ff73effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 0x7ff74006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 0x7ff74006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51944/0 (socket says 172.21.15.152:51944) 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73effd700 1 -- 172.21.15.152:0/1642632772 learned_addr learned my addr 172.21.15.152:0/1642632772 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73f7fe700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7400fd970 0x7ff74006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73effd700 1 -- 172.21.15.152:0/1642632772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7400fd970 msgr2=0x7ff74006b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73effd700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7400fd970 0x7ff74006b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73effd700 1 -- 172.21.15.152:0/1642632772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730005040 con 0x7ff7400fe2d0 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73effd700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 0x7ff74006b5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff7300099f0 tx=0x7ff730009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73cff9700 1 -- 172.21.15.152:0/1642632772 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff73000e030 con 0x7ff7400fe2d0 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74006be40 con 0x7ff7400fe2d0 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73cff9700 1 -- 172.21.15.152:0/1642632772 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff730007e90 con 0x7ff7400fe2d0 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff73cff9700 1 -- 172.21.15.152:0/1642632772 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff730018070 con 0x7ff7400fe2d0 2024-04-06T12:31:43.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.746+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7401145f0 con 0x7ff7400fe2d0 2024-04-06T12:31:43.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.747+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff740060370 con 0x7ff7400fe2d0 2024-04-06T12:31:43.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.748+0000 7ff73cff9700 1 -- 172.21.15.152:0/1642632772 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff7300094c0 con 0x7ff7400fe2d0 2024-04-06T12:31:43.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.748+0000 7ff73cff9700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff72806caa0 0x7ff72806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:43.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.748+0000 7ff73cff9700 1 -- 172.21.15.152:0/1642632772 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6250+0+0 (secure 0 0 0) 0x7ff73008d0f0 con 0x7ff7400fe2d0 2024-04-06T12:31:43.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.748+0000 7ff73f7fe700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff72806caa0 0x7ff72806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:43.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.749+0000 7ff73f7fe700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff72806caa0 0x7ff72806ef60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff734004de0 tx=0x7ff73400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:43.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.753+0000 7ff73cff9700 1 -- 172.21.15.152:0/1642632772 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7ff7300570e0 con 0x7ff7400fe2d0 2024-04-06T12:31:43.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:43 smithi195 bash[111293]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5 2024-04-06T12:31:43.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.960+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff740059120 con 0x7ff72806caa0 2024-04-06T12:31:43.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.961+0000 7ff73cff9700 1 -- 172.21.15.152:0/1642632772 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff740059120 con 0x7ff72806caa0 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff72806caa0 msgr2=0x7ff72806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff72806caa0 0x7ff72806ef60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff734004de0 tx=0x7ff73400b040).stop 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 msgr2=0x7ff74006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 0x7ff74006b5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff7300099f0 tx=0x7ff730009cb0).stop 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 shutdown_connections 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff72806caa0 0x7ff72806ef60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7400fd970 0x7ff74006b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 --2- 172.21.15.152:0/1642632772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7400fe2d0 0x7ff74006b5c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 >> 172.21.15.152:0/1642632772 conn(0x7ff7400f3550 msgr2=0x7ff7400fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:43.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 shutdown_connections 2024-04-06T12:31:43.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:43.963+0000 7ff745ff3700 1 -- 172.21.15.152:0/1642632772 wait complete. 2024-04-06T12:31:43.971 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:31:44.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.062+0000 7f0cbf02e700 1 -- 172.21.15.152:0/3813794492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fe250 msgr2=0x7f0cb80f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.062+0000 7f0cbf02e700 1 --2- 172.21.15.152:0/3813794492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fe250 0x7f0cb80f7a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f0ca40047f0 tx=0x7f0ca4009cb0).stop 2024-04-06T12:31:44.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.062+0000 7f0cbf02e700 1 -- 172.21.15.152:0/3813794492 shutdown_connections 2024-04-06T12:31:44.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.062+0000 7f0cbf02e700 1 --2- 172.21.15.152:0/3813794492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fe250 0x7f0cb80f7a30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.062+0000 7f0cbf02e700 1 --2- 172.21.15.152:0/3813794492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cb80fd8f0 0x7f0cb80fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.062+0000 7f0cbf02e700 1 -- 172.21.15.152:0/3813794492 >> 172.21.15.152:0/3813794492 conn(0x7f0cb80f34b0 msgr2=0x7f0cb80f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:44.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.062+0000 7f0cbf02e700 1 -- 172.21.15.152:0/3813794492 shutdown_connections 2024-04-06T12:31:44.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.062+0000 7f0cbf02e700 1 -- 172.21.15.152:0/3813794492 wait complete. 2024-04-06T12:31:44.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbf02e700 1 Processor -- start 2024-04-06T12:31:44.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbf02e700 1 -- start start 2024-04-06T12:31:44.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbf02e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fd8f0 0x7f0cb8110220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:44.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbf02e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cb80fe250 0x7f0cb8110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:44.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbf02e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8110d10 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbf02e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8110e50 con 0x7f0cb80fe250 2024-04-06T12:31:44.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbcdca700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fd8f0 0x7f0cb8110220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:44.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbcdca700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fd8f0 0x7f0cb8110220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51962/0 (socket says 172.21.15.152:51962) 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbcdca700 1 -- 172.21.15.152:0/1913154067 learned_addr learned my addr 172.21.15.152:0/1913154067 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cb7fff700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cb80fe250 0x7f0cb8110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbcdca700 1 -- 172.21.15.152:0/1913154067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cb80fe250 msgr2=0x7f0cb8110710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.063+0000 7f0cbcdca700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cb80fe250 0x7f0cb8110710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.064+0000 7f0cbcdca700 1 -- 172.21.15.152:0/1913154067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4005040 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.064+0000 7f0cbcdca700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fd8f0 0x7f0cb8110220 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0cac00c790 tx=0x7f0cac00cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.064+0000 7f0cb5ffb700 1 -- 172.21.15.152:0/1913154067 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cac0106f0 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.064+0000 7f0cb5ffb700 1 -- 172.21.15.152:0/1913154067 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cac010d00 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.064+0000 7f0cb5ffb700 1 -- 172.21.15.152:0/1913154067 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cac012e50 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.064+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb810a4e0 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.064+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb810aa20 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.065+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb805f590 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.065+0000 7f0cb5ffb700 1 -- 172.21.15.152:0/1913154067 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0cac010850 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.066+0000 7f0cb5ffb700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ca806caa0 0x7f0ca806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:44.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.066+0000 7f0cb5ffb700 1 -- 172.21.15.152:0/1913154067 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6250+0+0 (secure 0 0 0) 0x7f0cac08b670 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.066+0000 7f0cb7fff700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ca806caa0 0x7f0ca806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:44.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.066+0000 7f0cb7fff700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ca806caa0 0x7f0ca806ef60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0ca4004f10 tx=0x7f0ca400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:44.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.070+0000 7f0cb5ffb700 1 -- 172.21.15.152:0/1913154067 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f0cac0591b0 con 0x7f0cb80fd8f0 2024-04-06T12:31:44.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.286+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cb810b9b0 con 0x7f0ca806caa0 2024-04-06T12:31:44.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.287+0000 7f0cb5ffb700 1 -- 172.21.15.152:0/1913154067 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0cb810b9b0 con 0x7f0ca806caa0 2024-04-06T12:31:44.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ca806caa0 msgr2=0x7f0ca806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ca806caa0 0x7f0ca806ef60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0ca4004f10 tx=0x7f0ca400b040).stop 2024-04-06T12:31:44.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fd8f0 msgr2=0x7f0cb8110220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fd8f0 0x7f0cb8110220 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0cac00c790 tx=0x7f0cac00cb50).stop 2024-04-06T12:31:44.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 shutdown_connections 2024-04-06T12:31:44.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ca806caa0 0x7f0ca806ef60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb80fd8f0 0x7f0cb8110220 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 --2- 172.21.15.152:0/1913154067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cb80fe250 0x7f0cb8110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 >> 172.21.15.152:0/1913154067 conn(0x7f0cb80f34b0 msgr2=0x7f0cb806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:44.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 shutdown_connections 2024-04-06T12:31:44.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.289+0000 7f0cbf02e700 1 -- 172.21.15.152:0/1913154067 wait complete. 2024-04-06T12:31:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.388+0000 7f85c2b62700 1 -- 172.21.15.152:0/2179852309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fd910 msgr2=0x7f85bc0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.388+0000 7f85c2b62700 1 --2- 172.21.15.152:0/2179852309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fd910 0x7f85bc0fdcf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f85b00047f0 tx=0x7f85b0009cb0).stop 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.388+0000 7f85c2b62700 1 -- 172.21.15.152:0/2179852309 shutdown_connections 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.388+0000 7f85c2b62700 1 --2- 172.21.15.152:0/2179852309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85bc0fe270 0x7f85bc0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.388+0000 7f85c2b62700 1 --2- 172.21.15.152:0/2179852309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fd910 0x7f85bc0fdcf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.388+0000 7f85c2b62700 1 -- 172.21.15.152:0/2179852309 >> 172.21.15.152:0/2179852309 conn(0x7f85bc0f3530 msgr2=0x7f85bc0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.388+0000 7f85c2b62700 1 -- 172.21.15.152:0/2179852309 shutdown_connections 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.388+0000 7f85c2b62700 1 -- 172.21.15.152:0/2179852309 wait complete. 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85c2b62700 1 Processor -- start 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85c2b62700 1 -- start start 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85c2b62700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85bc0fd910 0x7f85bc10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85c2b62700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fe270 0x7f85bc10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85c2b62700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc10ead0 con 0x7f85bc0fe270 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85c2b62700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc10ec10 con 0x7f85bc0fd910 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85bbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fe270 0x7f85bc10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85bbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fe270 0x7f85bc10e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51980/0 (socket says 172.21.15.152:51980) 2024-04-06T12:31:44.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85bbfff700 1 -- 172.21.15.152:0/3523934127 learned_addr learned my addr 172.21.15.152:0/3523934127 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85c08fe700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85bc0fd910 0x7f85bc10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85bbfff700 1 -- 172.21.15.152:0/3523934127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85bc0fd910 msgr2=0x7f85bc10dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85bbfff700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85bc0fd910 0x7f85bc10dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85bbfff700 1 -- 172.21.15.152:0/3523934127 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0005040 con 0x7f85bc0fe270 2024-04-06T12:31:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85bbfff700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fe270 0x7f85bc10e4d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f85a80044e0 tx=0x7f85a8002a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.389+0000 7f85b9ffb700 1 -- 172.21.15.152:0/3523934127 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a8007b40 con 0x7f85bc0fe270 2024-04-06T12:31:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.390+0000 7f85b9ffb700 1 -- 172.21.15.152:0/3523934127 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85a800f040 con 0x7f85bc0fe270 2024-04-06T12:31:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.390+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc1082a0 con 0x7f85bc0fe270 2024-04-06T12:31:44.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.390+0000 7f85b9ffb700 1 -- 172.21.15.152:0/3523934127 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a8014850 con 0x7f85bc0fe270 2024-04-06T12:31:44.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.390+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc1087e0 con 0x7f85bc0fe270 2024-04-06T12:31:44.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.391+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc05f570 con 0x7f85bc0fe270 2024-04-06T12:31:44.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.391+0000 7f85b9ffb700 1 -- 172.21.15.152:0/3523934127 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f85a8009110 con 0x7f85bc0fe270 2024-04-06T12:31:44.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.392+0000 7f85b9ffb700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f85ac06cab0 0x7f85ac06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:44.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.392+0000 7f85b9ffb700 1 -- 172.21.15.152:0/3523934127 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6250+0+0 (secure 0 0 0) 0x7f85a808b830 con 0x7f85bc0fe270 2024-04-06T12:31:44.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.392+0000 7f85c08fe700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f85ac06cab0 0x7f85ac06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:44.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.392+0000 7f85c08fe700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f85ac06cab0 0x7f85ac06ef70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f85b0004f10 tx=0x7f85b0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:44.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.396+0000 7f85b9ffb700 1 -- 172.21.15.152:0/3523934127 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f85a8059370 con 0x7f85bc0fe270 2024-04-06T12:31:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:44 smithi152 ceph-mon[104634]: pgmap v159: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:31:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:44 smithi152 ceph-mon[104634]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:31:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:44 smithi152 ceph-mon[104634]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2024-04-06T12:31:44.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:44 smithi152 ceph-mon[104634]: osdmap e83: 6 total, 5 up, 6 in 2024-04-06T12:31:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:44 smithi195 ceph-mon[85980]: pgmap v159: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:31:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:44 smithi195 ceph-mon[85980]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-06T12:31:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:44 smithi195 ceph-mon[85980]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2024-04-06T12:31:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:44 smithi195 ceph-mon[85980]: osdmap e83: 6 total, 5 up, 6 in 2024-04-06T12:31:44.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.594+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f85bc108ab0 con 0x7f85ac06cab0 2024-04-06T12:31:44.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.604+0000 7f85b9ffb700 1 -- 172.21.15.152:0/3523934127 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f85bc108ab0 con 0x7f85ac06cab0 2024-04-06T12:31:44.601 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:31:44.601 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (5m) 93s ago 16m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (3m) 93s ago 16m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (3m) 26s ago 16m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (5m) 93s ago 16m 90.5M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (11m) 93s ago 11m 100M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (11m) 93s ago 11m 160M - 16.2.15-1-g8963e9de 727f386679cb 83af7d217504 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (11m) 26s ago 11m 15.4M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (11m) 26s ago 11m 16.3M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (7m) 93s ago 18m 496M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (6m) 26s ago 16m 449M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (4m) 93s ago 18m 47.2M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (3m) 26s ago 16m 38.8M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 93s ago 16m 17.0M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 26s ago 16m 17.4M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:31:44.602 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (2m) 93s ago 15m 85.4M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:31:44.603 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (2m) 93s ago 14m 89.0M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 4e01281def3c 2024-04-06T12:31:44.603 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (98s) 93s ago 14m 11.0M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 36456f3aa1eb 2024-04-06T12:31:44.603 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (64s) 26s ago 14m 120M 2251M 18.2.2-1086-g052adcad 87261d5ece5a b41c5ddebdba 2024-04-06T12:31:44.603 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (30s) 26s ago 13m 13.9M 2251M 18.2.2-1086-g052adcad 87261d5ece5a 887060bd04bc 2024-04-06T12:31:44.603 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (13m) 26s ago 13m 195M 2251M 16.2.15-1-g8963e9de 727f386679cb b72c8971178f 2024-04-06T12:31:44.603 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (5m) 26s ago 15m 60.0M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f85ac06cab0 msgr2=0x7f85ac06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f85ac06cab0 0x7f85ac06ef70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f85b0004f10 tx=0x7f85b0009cb0).stop 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fe270 msgr2=0x7f85bc10e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fe270 0x7f85bc10e4d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f85a80044e0 tx=0x7f85a8002a50).stop 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 shutdown_connections 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f85ac06cab0 0x7f85ac06ef70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85bc0fd910 0x7f85bc10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 --2- 172.21.15.152:0/3523934127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85bc0fe270 0x7f85bc10e4d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 >> 172.21.15.152:0/3523934127 conn(0x7f85bc0f3530 msgr2=0x7f85bc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 shutdown_connections 2024-04-06T12:31:44.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.606+0000 7f85c2b62700 1 -- 172.21.15.152:0/3523934127 wait complete. 2024-04-06T12:31:44.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.703+0000 7f9002d79700 1 -- 172.21.15.152:0/508215277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 msgr2=0x7f8ffc0f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.703+0000 7f9002d79700 1 --2- 172.21.15.152:0/508215277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 0x7f8ffc0f6980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f8fe80047f0 tx=0x7f8fe8009cb0).stop 2024-04-06T12:31:44.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.703+0000 7f9002d79700 1 -- 172.21.15.152:0/508215277 shutdown_connections 2024-04-06T12:31:44.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.703+0000 7f9002d79700 1 --2- 172.21.15.152:0/508215277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 0x7f8ffc0f6980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.703+0000 7f9002d79700 1 --2- 172.21.15.152:0/508215277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc0fc830 0x7f8ffc0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.703+0000 7f9002d79700 1 -- 172.21.15.152:0/508215277 >> 172.21.15.152:0/508215277 conn(0x7f8ffc06c760 msgr2=0x7f8ffc06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:44.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.703+0000 7f9002d79700 1 -- 172.21.15.152:0/508215277 shutdown_connections 2024-04-06T12:31:44.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.703+0000 7f9002d79700 1 -- 172.21.15.152:0/508215277 wait complete. 2024-04-06T12:31:44.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f9002d79700 1 Processor -- start 2024-04-06T12:31:44.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f9002d79700 1 -- start start 2024-04-06T12:31:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f9002d79700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc0fc830 0x7f8ffc107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f9002d79700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 0x7f8ffc107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f9002d79700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0614e0 con 0x7f8ffc0fd190 2024-04-06T12:31:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f9002d79700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc107a30 con 0x7f8ffc0fc830 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f8ffbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 0x7f8ffc107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f8ffbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 0x7f8ffc107540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51996/0 (socket says 172.21.15.152:51996) 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f8ffbfff700 1 -- 172.21.15.152:0/1018152408 learned_addr learned my addr 172.21.15.152:0/1018152408 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f9000b15700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc0fc830 0x7f8ffc107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f8ffbfff700 1 -- 172.21.15.152:0/1018152408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc0fc830 msgr2=0x7f8ffc107050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f8ffbfff700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc0fc830 0x7f8ffc107050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f8ffbfff700 1 -- 172.21.15.152:0/1018152408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8005040 con 0x7f8ffc0fd190 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.704+0000 7f8ffbfff700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 0x7f8ffc107540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8fe8000c00 tx=0x7f8fe8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.705+0000 7f8ff9ffb700 1 -- 172.21.15.152:0/1018152408 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe8018070 con 0x7f8ffc0fd190 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.705+0000 7f8ff9ffb700 1 -- 172.21.15.152:0/1018152408 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fe8007e90 con 0x7f8ffc0fd190 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.705+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc107cb0 con 0x7f8ffc0fd190 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.705+0000 7f8ff9ffb700 1 -- 172.21.15.152:0/1018152408 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe801de20 con 0x7f8ffc0fd190 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.705+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc114880 con 0x7f8ffc0fd190 2024-04-06T12:31:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.706+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ffc05f570 con 0x7f8ffc0fd190 2024-04-06T12:31:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.706+0000 7f8ff9ffb700 1 -- 172.21.15.152:0/1018152408 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8fe801d420 con 0x7f8ffc0fd190 2024-04-06T12:31:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.707+0000 7f8ff9ffb700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8fec06ca30 0x7f8fec06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.707+0000 7f8ff9ffb700 1 -- 172.21.15.152:0/1018152408 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6250+0+0 (secure 0 0 0) 0x7f8fe808c900 con 0x7f8ffc0fd190 2024-04-06T12:31:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.707+0000 7f9000b15700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8fec06ca30 0x7f8fec06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.707+0000 7f9000b15700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8fec06ca30 0x7f8fec06eef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f8ff0004ee0 tx=0x7f8ff000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:44.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.711+0000 7f8ff9ffb700 1 -- 172.21.15.152:0/1018152408 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f8fe805a440 con 0x7f8ffc0fd190 2024-04-06T12:31:44.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.976+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ffc0febc0 con 0x7f8ffc0fd190 2024-04-06T12:31:44.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.977+0000 7f8ff9ffb700 1 -- 172.21.15.152:0/1018152408 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+740 (secure 0 0 0) 0x7f8fe8059fd0 con 0x7f8ffc0fd190 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 5 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-04-06T12:31:44.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:31:44.976 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:31:44.976 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4, 2024-04-06T12:31:44.976 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 9 2024-04-06T12:31:44.976 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:31:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8fec06ca30 msgr2=0x7f8fec06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8fec06ca30 0x7f8fec06eef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f8ff0004ee0 tx=0x7f8ff000b040).stop 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 msgr2=0x7f8ffc107540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 0x7f8ffc107540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8fe8000c00 tx=0x7f8fe8009cb0).stop 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 shutdown_connections 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f8fec06ca30 0x7f8fec06eef0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ffc0fc830 0x7f8ffc107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 --2- 172.21.15.152:0/1018152408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ffc0fd190 0x7f8ffc107540 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 >> 172.21.15.152:0/1018152408 conn(0x7f8ffc06c760 msgr2=0x7f8ffc0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 shutdown_connections 2024-04-06T12:31:44.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:44.979+0000 7f9002d79700 1 -- 172.21.15.152:0/1018152408 wait complete. 2024-04-06T12:31:45.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.077+0000 7efd67f60700 1 -- 172.21.15.152:0/1926915157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fc7f0 msgr2=0x7efd600fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.077+0000 7efd67f60700 1 --2- 172.21.15.152:0/1926915157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fc7f0 0x7efd600fcbd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7efd500047f0 tx=0x7efd50009cb0).stop 2024-04-06T12:31:45.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.077+0000 7efd67f60700 1 -- 172.21.15.152:0/1926915157 shutdown_connections 2024-04-06T12:31:45.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.077+0000 7efd67f60700 1 --2- 172.21.15.152:0/1926915157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd600fd150 0x7efd600f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.077+0000 7efd67f60700 1 --2- 172.21.15.152:0/1926915157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fc7f0 0x7efd600fcbd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.077+0000 7efd67f60700 1 -- 172.21.15.152:0/1926915157 >> 172.21.15.152:0/1926915157 conn(0x7efd60070590 msgr2=0x7efd600f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:45.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.077+0000 7efd67f60700 1 -- 172.21.15.152:0/1926915157 shutdown_connections 2024-04-06T12:31:45.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.077+0000 7efd67f60700 1 -- 172.21.15.152:0/1926915157 wait complete. 2024-04-06T12:31:45.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.078+0000 7efd67f60700 1 Processor -- start 2024-04-06T12:31:45.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.078+0000 7efd67f60700 1 -- start start 2024-04-06T12:31:45.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.078+0000 7efd67f60700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd600fc7f0 0x7efd6010cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:45.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.078+0000 7efd67f60700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fd150 0x7efd6010d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:45.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.078+0000 7efd67f60700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6010da20 con 0x7efd600fd150 2024-04-06T12:31:45.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.078+0000 7efd67f60700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6010db60 con 0x7efd600fc7f0 2024-04-06T12:31:45.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.078+0000 7efd654fb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fd150 0x7efd6010d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:45.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd654fb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fd150 0x7efd6010d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52016/0 (socket says 172.21.15.152:52016) 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd654fb700 1 -- 172.21.15.152:0/1055326761 learned_addr learned my addr 172.21.15.152:0/1055326761 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd65cfc700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd600fc7f0 0x7efd6010cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd654fb700 1 -- 172.21.15.152:0/1055326761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd600fc7f0 msgr2=0x7efd6010cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd654fb700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd600fc7f0 0x7efd6010cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd654fb700 1 -- 172.21.15.152:0/1055326761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50005040 con 0x7efd600fd150 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd65cfc700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd600fc7f0 0x7efd6010cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd654fb700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fd150 0x7efd6010d420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7efd5c00e9a0 tx=0x7efd5c004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd56ffd700 1 -- 172.21.15.152:0/1055326761 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd5c00cb90 con 0x7efd600fd150 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd56ffd700 1 -- 172.21.15.152:0/1055326761 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd5c00ccf0 con 0x7efd600fd150 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd601071f0 con 0x7efd600fd150 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd56ffd700 1 -- 172.21.15.152:0/1055326761 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd5c010630 con 0x7efd600fd150 2024-04-06T12:31:45.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.079+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd601077b0 con 0x7efd600fd150 2024-04-06T12:31:45.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.080+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6005f590 con 0x7efd600fd150 2024-04-06T12:31:45.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.081+0000 7efd56ffd700 1 -- 172.21.15.152:0/1055326761 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7efd5c011a20 con 0x7efd600fd150 2024-04-06T12:31:45.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.081+0000 7efd56ffd700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efd4c06caa0 0x7efd4c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:45.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.081+0000 7efd56ffd700 1 -- 172.21.15.152:0/1055326761 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6250+0+0 (secure 0 0 0) 0x7efd5c08e350 con 0x7efd600fd150 2024-04-06T12:31:45.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.081+0000 7efd65cfc700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efd4c06caa0 0x7efd4c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:45.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.081+0000 7efd65cfc700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efd4c06caa0 0x7efd4c06ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7efd50007cf0 tx=0x7efd5000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:45.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.085+0000 7efd56ffd700 1 -- 172.21.15.152:0/1055326761 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7efd5c05be90 con 0x7efd600fd150 2024-04-06T12:31:45.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:45 smithi195 ceph-mon[85980]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:45.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:45 smithi195 ceph-mon[85980]: osdmap e84: 6 total, 5 up, 6 in 2024-04-06T12:31:45.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:45 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1018152408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:45.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.316+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd60047540 con 0x7efd600fd150 2024-04-06T12:31:45.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.317+0000 7efd56ffd700 1 -- 172.21.15.152:0/1055326761 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1879 (secure 0 0 0) 0x7efd5c05ba20 con 0x7efd600fd150 2024-04-06T12:31:45.314 INFO:teuthology.orchestra.run.smithi152.stdout:e11 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 11 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:20:16.059877+0000 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:31:45.315 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14434} 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:31:45.316 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/3429506423,v1:172.21.15.152:6827/3429506423] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:14444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1106454067,v1:172.21.15.152:6829/1106454067] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:24273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:31:45.317 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:31:45.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efd4c06caa0 msgr2=0x7efd4c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efd4c06caa0 0x7efd4c06ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7efd50007cf0 tx=0x7efd5000b040).stop 2024-04-06T12:31:45.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fd150 msgr2=0x7efd6010d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fd150 0x7efd6010d420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7efd5c00e9a0 tx=0x7efd5c004330).stop 2024-04-06T12:31:45.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 shutdown_connections 2024-04-06T12:31:45.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efd4c06caa0 0x7efd4c06ef60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd600fc7f0 0x7efd6010cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 --2- 172.21.15.152:0/1055326761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd600fd150 0x7efd6010d420 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 >> 172.21.15.152:0/1055326761 conn(0x7efd60070590 msgr2=0x7efd600fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:45.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 shutdown_connections 2024-04-06T12:31:45.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.319+0000 7efd67f60700 1 -- 172.21.15.152:0/1055326761 wait complete. 2024-04-06T12:31:45.319 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 11 2024-04-06T12:31:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.417+0000 7f0759079700 1 -- 172.21.15.152:0/3132912799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fe250 msgr2=0x7f07540f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.417+0000 7f0759079700 1 --2- 172.21.15.152:0/3132912799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fe250 0x7f07540f7a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f07440047f0 tx=0x7f0744009cb0).stop 2024-04-06T12:31:45.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.418+0000 7f0759079700 1 -- 172.21.15.152:0/3132912799 shutdown_connections 2024-04-06T12:31:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.418+0000 7f0759079700 1 --2- 172.21.15.152:0/3132912799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fe250 0x7f07540f7a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.418+0000 7f0759079700 1 --2- 172.21.15.152:0/3132912799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07540fd8f0 0x7f07540fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.418+0000 7f0759079700 1 -- 172.21.15.152:0/3132912799 >> 172.21.15.152:0/3132912799 conn(0x7f07540f34b0 msgr2=0x7f07540f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.418+0000 7f0759079700 1 -- 172.21.15.152:0/3132912799 shutdown_connections 2024-04-06T12:31:45.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.418+0000 7f0759079700 1 -- 172.21.15.152:0/3132912799 wait complete. 2024-04-06T12:31:45.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f0759079700 1 Processor -- start 2024-04-06T12:31:45.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f0759079700 1 -- start start 2024-04-06T12:31:45.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f0759079700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fd8f0 0x7f075410e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:45.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f0759079700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07540fe250 0x7f075410e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:45.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f0759079700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075410ec20 con 0x7f07540fd8f0 2024-04-06T12:31:45.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f0759079700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075410ed60 con 0x7f07540fe250 2024-04-06T12:31:45.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f0752d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fd8f0 0x7f075410e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:45.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f075259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07540fe250 0x7f075410e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:45.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f0752d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fd8f0 0x7f075410e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52026/0 (socket says 172.21.15.152:52026) 2024-04-06T12:31:45.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f0752d9d700 1 -- 172.21.15.152:0/732904288 learned_addr learned my addr 172.21.15.152:0/732904288 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:45.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.419+0000 7f075259c700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07540fe250 0x7f075410e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.152:45378/0 (socket says 172.21.15.152:45378) 2024-04-06T12:31:45.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f075259c700 1 -- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fd8f0 msgr2=0x7f075410e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f075259c700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fd8f0 0x7f075410e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f075259c700 1 -- 172.21.15.152:0/732904288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744005040 con 0x7f07540fe250 2024-04-06T12:31:45.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f0752d9d700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fd8f0 0x7f075410e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-06T12:31:45.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f075259c700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07540fe250 0x7f075410e620 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0744000c00 tx=0x7f0744009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:45.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f074bfff700 1 -- 172.21.15.152:0/732904288 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0744018070 con 0x7f07540fe250 2024-04-06T12:31:45.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0754108390 con 0x7f07540fe250 2024-04-06T12:31:45.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f074bfff700 1 -- 172.21.15.152:0/732904288 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0744007e90 con 0x7f07540fe250 2024-04-06T12:31:45.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f074bfff700 1 -- 172.21.15.152:0/732904288 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07440123c0 con 0x7f07540fe250 2024-04-06T12:31:45.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.420+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07541088f0 con 0x7f07540fe250 2024-04-06T12:31:45.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.421+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075405f590 con 0x7f07540fe250 2024-04-06T12:31:45.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.422+0000 7f074bfff700 1 -- 172.21.15.152:0/732904288 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f074401d420 con 0x7f07540fe250 2024-04-06T12:31:45.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.422+0000 7f074bfff700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f074006caa0 0x7f074006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:45.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.422+0000 7f074bfff700 1 -- 172.21.15.152:0/732904288 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6250+0+0 (secure 0 0 0) 0x7f074408ce40 con 0x7f07540fe250 2024-04-06T12:31:45.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.422+0000 7f0752d9d700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f074006caa0 0x7f074006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:45.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.422+0000 7f0752d9d700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f074006caa0 0x7f074006ef60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f073c007d30 tx=0x7f073c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:45.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.426+0000 7f074bfff700 1 -- 172.21.15.152:0/732904288 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f074405a9b0 con 0x7f07540fe250 2024-04-06T12:31:45.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:45 smithi152 ceph-mon[104634]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:45.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:45 smithi152 ceph-mon[104634]: osdmap e84: 6 total, 5 up, 6 in 2024-04-06T12:31:45.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:45 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1018152408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:45.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.631+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07540ffc40 con 0x7f074006caa0 2024-04-06T12:31:45.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.633+0000 7f074bfff700 1 -- 172.21.15.152:0/732904288 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f07540ffc40 con 0x7f074006caa0 2024-04-06T12:31:45.630 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:31:45.630 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: "crash" 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "11/21 daemons upgraded", 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:31:45.631 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f074006caa0 msgr2=0x7f074006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f074006caa0 0x7f074006ef60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f073c007d30 tx=0x7f073c00b040).stop 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07540fe250 msgr2=0x7f075410e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07540fe250 0x7f075410e620 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0744000c00 tx=0x7f0744009cb0).stop 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 shutdown_connections 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f074006caa0 0x7f074006ef60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07540fd8f0 0x7f075410e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 --2- 172.21.15.152:0/732904288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07540fe250 0x7f075410e620 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 >> 172.21.15.152:0/732904288 conn(0x7f07540f34b0 msgr2=0x7f07540fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 shutdown_connections 2024-04-06T12:31:45.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.635+0000 7f0759079700 1 -- 172.21.15.152:0/732904288 wait complete. 2024-04-06T12:31:45.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.733+0000 7f278d8f2700 1 -- 172.21.15.152:0/1916876791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fe250 msgr2=0x7f27880f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.733+0000 7f278d8f2700 1 --2- 172.21.15.152:0/1916876791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fe250 0x7f27880f7a30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f27700047f0 tx=0x7f2770009cb0).stop 2024-04-06T12:31:45.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.733+0000 7f278d8f2700 1 -- 172.21.15.152:0/1916876791 shutdown_connections 2024-04-06T12:31:45.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.733+0000 7f278d8f2700 1 --2- 172.21.15.152:0/1916876791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fe250 0x7f27880f7a30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.733+0000 7f278d8f2700 1 --2- 172.21.15.152:0/1916876791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880fd8f0 0x7f27880fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.733+0000 7f278d8f2700 1 -- 172.21.15.152:0/1916876791 >> 172.21.15.152:0/1916876791 conn(0x7f27880f34b0 msgr2=0x7f27880f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:45.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.733+0000 7f278d8f2700 1 -- 172.21.15.152:0/1916876791 shutdown_connections 2024-04-06T12:31:45.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.733+0000 7f278d8f2700 1 -- 172.21.15.152:0/1916876791 wait complete. 2024-04-06T12:31:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.733+0000 7f278d8f2700 1 Processor -- start 2024-04-06T12:31:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f278d8f2700 1 -- start start 2024-04-06T12:31:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f278d8f2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fd8f0 0x7f278810e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f278d8f2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880fe250 0x7f278810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f278d8f2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278810eb70 con 0x7f27880fd8f0 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f278d8f2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278810ecb0 con 0x7f27880fe250 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f2786ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fd8f0 0x7f278810e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f2786ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fd8f0 0x7f278810e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52036/0 (socket says 172.21.15.152:52036) 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f2786ffd700 1 -- 172.21.15.152:0/3588882013 learned_addr learned my addr 172.21.15.152:0/3588882013 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f27867fc700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880fe250 0x7f278810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f2786ffd700 1 -- 172.21.15.152:0/3588882013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880fe250 msgr2=0x7f278810e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f2786ffd700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880fe250 0x7f278810e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f2786ffd700 1 -- 172.21.15.152:0/3588882013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770005040 con 0x7f27880fd8f0 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f2786ffd700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fd8f0 0x7f278810e080 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f278000dad0 tx=0x7f2780004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f277ffff700 1 -- 172.21.15.152:0/3588882013 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f278000b750 con 0x7f27880fd8f0 2024-04-06T12:31:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f277ffff700 1 -- 172.21.15.152:0/3588882013 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f278000f040 con 0x7f27880fd8f0 2024-04-06T12:31:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.734+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2788108340 con 0x7f27880fd8f0 2024-04-06T12:31:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.735+0000 7f277ffff700 1 -- 172.21.15.152:0/3588882013 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2780013ba0 con 0x7f27880fd8f0 2024-04-06T12:31:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.735+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2788108880 con 0x7f27880fd8f0 2024-04-06T12:31:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.735+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278805f590 con 0x7f27880fd8f0 2024-04-06T12:31:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.736+0000 7f277ffff700 1 -- 172.21.15.152:0/3588882013 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f278000b8b0 con 0x7f27880fd8f0 2024-04-06T12:31:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.736+0000 7f277ffff700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f277406caa0 0x7f277406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:31:45.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.736+0000 7f277ffff700 1 -- 172.21.15.152:0/3588882013 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6250+0+0 (secure 0 0 0) 0x7f278008b700 con 0x7f27880fd8f0 2024-04-06T12:31:45.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.736+0000 7f27867fc700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f277406caa0 0x7f277406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:31:45.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.737+0000 7f27867fc700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f277406caa0 0x7f277406ef60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f27881099c0 tx=0x7f277000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:31:45.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:45.741+0000 7f277ffff700 1 -- 172.21.15.152:0/3588882013 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f27800592f0 con 0x7f27880fd8f0 2024-04-06T12:31:45.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:45 smithi195 systemd[1]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.5.service: Succeeded. 2024-04-06T12:31:45.799 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:45 smithi195 systemd[1]: Stopped Ceph osd.5 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:31:45.799 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:45 smithi195 systemd[1]: Starting Ceph osd.5 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:31:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.007+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2788047540 con 0x7f27880fd8f0 2024-04-06T12:31:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.007+0000 7f277ffff700 1 -- 172.21.15.152:0/3588882013 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1181 (secure 0 0 0) 0x7f2780058e80 con 0x7f27880fd8f0 2024-04-06T12:31:46.005 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running quincy or later but require_osd_release < quincy; Reduced data availability: 7 pgs peering 2024-04-06T12:31:46.005 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:31:46.005 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:31:46.005 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-06T12:31:46.005 INFO:teuthology.orchestra.run.smithi152.stdout: osd.5 (root=default,host=smithi195) is down 2024-04-06T12:31:46.005 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running quincy or later but require_osd_release < quincy 2024-04-06T12:31:46.005 INFO:teuthology.orchestra.run.smithi152.stdout: all OSDs are running quincy or later but require_osd_release < quincy 2024-04-06T12:31:46.006 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 7 pgs peering 2024-04-06T12:31:46.006 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.2 is stuck peering for 6m, current state peering, last acting [1,0] 2024-04-06T12:31:46.006 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.3 is stuck peering for 6m, current state peering, last acting [2,1] 2024-04-06T12:31:46.006 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.17 is stuck peering for 6m, current state peering, last acting [2,1] 2024-04-06T12:31:46.006 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.18 is stuck peering for 6m, current state peering, last acting [4,3] 2024-04-06T12:31:46.006 INFO:teuthology.orchestra.run.smithi152.stdout: pg 3.5 is stuck peering for 6m, current state peering, last acting [2,3] 2024-04-06T12:31:46.006 INFO:teuthology.orchestra.run.smithi152.stdout: pg 3.e is stuck peering for 6m, current state peering, last acting [4,1] 2024-04-06T12:31:46.006 INFO:teuthology.orchestra.run.smithi152.stdout: pg 3.1c is stuck peering for 6m, current state peering, last acting [4,1] 2024-04-06T12:31:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.009+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f277406caa0 msgr2=0x7f277406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.009+0000 7f278d8f2700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f277406caa0 0x7f277406ef60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f27881099c0 tx=0x7f277000b040).stop 2024-04-06T12:31:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.009+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fd8f0 msgr2=0x7f278810e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:31:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.009+0000 7f278d8f2700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fd8f0 0x7f278810e080 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f278000dad0 tx=0x7f2780004ee0).stop 2024-04-06T12:31:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.009+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 shutdown_connections 2024-04-06T12:31:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.009+0000 7f278d8f2700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f277406caa0 0x7f277406ef60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.009+0000 7f278d8f2700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27880fd8f0 0x7f278810e080 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:46.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.009+0000 7f278d8f2700 1 --2- 172.21.15.152:0/3588882013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27880fe250 0x7f278810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:31:46.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.009+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 >> 172.21.15.152:0/3588882013 conn(0x7f27880f34b0 msgr2=0x7f27880fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:31:46.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.010+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 shutdown_connections 2024-04-06T12:31:46.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:31:46.010+0000 7f278d8f2700 1 -- 172.21.15.152:0/3588882013 wait complete. 2024-04-06T12:31:46.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:46 smithi195 ceph-mon[85980]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:46.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:46 smithi195 ceph-mon[85980]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:46.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:46 smithi195 ceph-mon[85980]: pgmap v162: 65 pgs: 15 peering, 6 stale+active+clean, 44 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:31:46.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:46 smithi195 ceph-mon[85980]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-04-06T12:31:46.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:46 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1055326761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:31:46.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:46 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3588882013' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:31:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:46 smithi152 ceph-mon[104634]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:46 smithi152 ceph-mon[104634]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:46 smithi152 ceph-mon[104634]: pgmap v162: 65 pgs: 15 peering, 6 stale+active+clean, 44 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:31:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:46 smithi152 ceph-mon[104634]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-04-06T12:31:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:46 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1055326761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:31:46.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:46 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3588882013' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:31:46.766 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:46 smithi195 bash[111569]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-06T12:31:46.767 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:46 smithi195 bash[111569]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-06T12:31:46.767 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:46 smithi195 bash[111569]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-06T12:31:46.767 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:46 smithi195 bash[111569]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-06T12:31:46.767 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:46 smithi195 bash[111569]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-06T12:31:46.767 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:46 smithi195 bash[111569]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-06T12:31:46.767 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:46 smithi195 bash[111569]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-06T12:31:47.449 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:47 smithi195 ceph-mon[85980]: from='client.44285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:47.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:47 smithi152 ceph-mon[104634]: from='client.44285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:31:48.049 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:47 smithi195 ceph-osd[111862]: -- 172.21.15.195:0/3235973153 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d7a47931e0 con 0x55d7a4762c00 2024-04-06T12:31:48.049 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:47 smithi195 bash[111825]: f0ce150c2bbdebe1122cdc50812ed540f748fcc6cdd00a4603a88eb37b189396 2024-04-06T12:31:48.049 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:47 smithi195 systemd[1]: Started Ceph osd.5 for f2af90de-f40e-11ee-b649-cb9ed24678a4. 2024-04-06T12:31:48.388 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:31:48.109+0000 7f967625c640 -1 Falling back to public interface 2024-04-06T12:31:48.388 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:48 smithi195 ceph-mon[85980]: pgmap v163: 65 pgs: 15 peering, 6 stale+active+clean, 44 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-06T12:31:48.389 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:48 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:48.389 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:48 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:48.389 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:48 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:48 smithi152 ceph-mon[104634]: pgmap v163: 65 pgs: 15 peering, 6 stale+active+clean, 44 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-06T12:31:48.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:48 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:48.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:48 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:48.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:48 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:50.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:49 smithi152 ceph-mon[104634]: pgmap v164: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 2 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:50.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:49 smithi195 ceph-mon[85980]: pgmap v164: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 2 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:51.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:50 smithi195 ceph-mon[85980]: Health check failed: Degraded data redundancy: 43/267 objects degraded (16.105%), 14 pgs degraded (PG_DEGRADED) 2024-04-06T12:31:51.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:50 smithi195 ceph-mon[85980]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-04-06T12:31:51.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:50 smithi152 ceph-mon[104634]: Health check failed: Degraded data redundancy: 43/267 objects degraded (16.105%), 14 pgs degraded (PG_DEGRADED) 2024-04-06T12:31:51.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:50 smithi152 ceph-mon[104634]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-04-06T12:31:52.465 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:52 smithi195 ceph-mon[85980]: pgmap v165: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:52.465 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.465 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.465 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.465 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.465 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.465 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:31:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:52 smithi152 ceph-mon[104634]: pgmap v165: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:52.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:31:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:54 smithi152 ceph-mon[104634]: pgmap v166: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 718 B/s rd, 1 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:54 smithi195 ceph-mon[85980]: pgmap v166: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 718 B/s rd, 1 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:56.264 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:55 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:31:55.988+0000 7f967625c640 -1 osd.5 0 read_superblock omap replica is missing. 2024-04-06T12:31:56.264 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: pgmap v167: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 653 B/s rd, 1 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:56.264 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:56.264 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-06T12:31:56.265 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-06T12:31:56.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-06T12:31:56.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-06T12:31:56.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-06T12:31:56.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-06T12:31:56.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-06T12:31:56.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-06T12:31:56.266 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: pgmap v167: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 653 B/s rd, 1 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:56.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-06T12:31:56.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:56 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-04-06T12:31:56.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:31:56.265+0000 7f967625c640 -1 osd.5 82 log_to_monitors true 2024-04-06T12:31:57.217 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:31:56 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:31:56.869+0000 7f96676b5700 -1 osd.5 82 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-06T12:31:57.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all osd 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: Upgrade: Setting require_osd_release to 18 reef 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: from='osd.5 [v2:172.21.15.195:6816/666904784,v1:172.21.15.195:6817/666904784]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: osdmap e85: 6 total, 5 up, 6 in 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: from='osd.5 [v2:172.21.15.195:6816/666904784,v1:172.21.15.195:6817/666904784]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-06T12:31:57.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: osdmap e86: 6 total, 5 up, 6 in 2024-04-06T12:31:57.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:57.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all osd 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: Upgrade: Setting require_osd_release to 18 reef 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: from='osd.5 [v2:172.21.15.195:6816/666904784,v1:172.21.15.195:6817/666904784]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: osdmap e85: 6 total, 5 up, 6 in 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: from='osd.5 [v2:172.21.15.195:6816/666904784,v1:172.21.15.195:6817/666904784]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: osdmap e86: 6 total, 5 up, 6 in 2024-04-06T12:31:57.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: pgmap v170: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 2 up:standby 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: osd.5 [v2:172.21.15.195:6816/666904784,v1:172.21.15.195:6817/666904784] boot 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: osdmap e87: 6 total, 6 up, 6 in 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:58.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:31:58.489 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:58.489 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:58.489 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:58.489 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:58.489 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:58.489 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:58 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: pgmap v170: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 43/267 objects degraded (16.105%) 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 2 up:standby 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: osd.5 [v2:172.21.15.195:6816/666904784,v1:172.21.15.195:6817/666904784] boot 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: osdmap e87: 6 total, 6 up, 6 in 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:31:58.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:58.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:58.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:31:58.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:58 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:00.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:59 smithi152 ceph-mon[104634]: osdmap e88: 6 total, 6 up, 6 in 2024-04-06T12:32:00.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:59 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.152:6828/1788558838,v1:172.21.15.152:6829/1788558838] up:boot 2024-04-06T12:32:00.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:59 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 3 up:standby 2024-04-06T12:32:00.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:59 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:32:00.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:59 smithi152 ceph-mon[104634]: pgmap v173: 65 pgs: 8 peering, 9 active+undersized+degraded, 12 active+undersized, 36 active+clean; 259 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/267 objects degraded (11.610%) 2024-04-06T12:32:00.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:59 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:00.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:59 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.spbxnv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:32:00.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:31:59 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:00.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:59 smithi195 ceph-mon[85980]: osdmap e88: 6 total, 6 up, 6 in 2024-04-06T12:32:00.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:59 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.152:6828/1788558838,v1:172.21.15.152:6829/1788558838] up:boot 2024-04-06T12:32:00.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:59 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 3 up:standby 2024-04-06T12:32:00.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:59 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:32:00.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:59 smithi195 ceph-mon[85980]: pgmap v173: 65 pgs: 8 peering, 9 active+undersized+degraded, 12 active+undersized, 36 active+clean; 259 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/267 objects degraded (11.610%) 2024-04-06T12:32:00.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:59 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:00.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:59 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.spbxnv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:32:00.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:31:59 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:01.101 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:00 smithi152 ceph-mon[104634]: Upgrade: Updating mds.cephfs.smithi152.spbxnv 2024-04-06T12:32:01.101 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:00 smithi152 ceph-mon[104634]: Deploying daemon mds.cephfs.smithi152.spbxnv on smithi152 2024-04-06T12:32:01.101 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:00 smithi152 ceph-mon[104634]: Health check update: Degraded data redundancy: 31/267 objects degraded (11.610%), 9 pgs degraded (PG_DEGRADED) 2024-04-06T12:32:01.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:00 smithi195 ceph-mon[85980]: Upgrade: Updating mds.cephfs.smithi152.spbxnv 2024-04-06T12:32:01.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:00 smithi195 ceph-mon[85980]: Deploying daemon mds.cephfs.smithi152.spbxnv on smithi152 2024-04-06T12:32:01.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:00 smithi195 ceph-mon[85980]: Health check update: Degraded data redundancy: 31/267 objects degraded (11.610%), 9 pgs degraded (PG_DEGRADED) 2024-04-06T12:32:01.875 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:01 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[104611]: 2024-04-06T12:32:01.573+0000 7f56deaae700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:32:02.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:01 smithi152 ceph-mon[104634]: pgmap v174: 65 pgs: 8 peering, 9 active+undersized+degraded, 12 active+undersized, 36 active+clean; 259 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/267 objects degraded (11.610%) 2024-04-06T12:32:02.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:01 smithi152 ceph-mon[104634]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-06T12:32:02.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:01 smithi152 ceph-mon[104634]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:32:02.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:01 smithi152 ceph-mon[104634]: osdmap e89: 6 total, 6 up, 6 in 2024-04-06T12:32:02.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:01 smithi152 ceph-mon[104634]: Standby daemon mds.cephfs.smithi195.akamqf assigned to filesystem cephfs as rank 0 2024-04-06T12:32:02.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:01 smithi152 ceph-mon[104634]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-06T12:32:02.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:01 smithi152 ceph-mon[104634]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-06T12:32:02.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:01 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi195.akamqf=up:replay} 2 up:standby 2024-04-06T12:32:02.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:01 smithi195 ceph-mon[85980]: pgmap v174: 65 pgs: 8 peering, 9 active+undersized+degraded, 12 active+undersized, 36 active+clean; 259 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/267 objects degraded (11.610%) 2024-04-06T12:32:02.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:01 smithi195 ceph-mon[85980]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-06T12:32:02.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:01 smithi195 ceph-mon[85980]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:32:02.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:01 smithi195 ceph-mon[85980]: osdmap e89: 6 total, 6 up, 6 in 2024-04-06T12:32:02.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:01 smithi195 ceph-mon[85980]: Standby daemon mds.cephfs.smithi195.akamqf assigned to filesystem cephfs as rank 0 2024-04-06T12:32:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:01 smithi195 ceph-mon[85980]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-06T12:32:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:01 smithi195 ceph-mon[85980]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-06T12:32:02.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:01 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi195.akamqf=up:replay} 2 up:standby 2024-04-06T12:32:03.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:03 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:32:03.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:03 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:32:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:04 smithi152 ceph-mon[104634]: pgmap v176: 65 pgs: 8 peering, 57 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 4 op/s 2024-04-06T12:32:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:04 smithi152 ceph-mon[104634]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/267 objects degraded (11.610%), 9 pgs degraded) 2024-04-06T12:32:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:04 smithi195 ceph-mon[85980]: pgmap v176: 65 pgs: 8 peering, 57 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 4 op/s 2024-04-06T12:32:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:04 smithi195 ceph-mon[85980]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/267 objects degraded (11.610%), 9 pgs degraded) 2024-04-06T12:32:06.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:06 smithi152 ceph-mon[104634]: pgmap v177: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 5 op/s 2024-04-06T12:32:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:06 smithi195 ceph-mon[85980]: pgmap v177: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 5 op/s 2024-04-06T12:32:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:08 smithi152 ceph-mon[104634]: pgmap v178: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-06T12:32:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:32:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:08 smithi195 ceph-mon[85980]: pgmap v178: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-06T12:32:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:32:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:09 smithi152 ceph-mon[104634]: pgmap v179: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-06T12:32:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:09 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] up:boot 2024-04-06T12:32:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:09 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi195.akamqf=up:replay} 3 up:standby 2024-04-06T12:32:09.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:32:09.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:09.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:09.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:09.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:09 smithi195 ceph-mon[85980]: pgmap v179: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-06T12:32:09.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:09 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] up:boot 2024-04-06T12:32:09.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:09 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi195.akamqf=up:replay} 3 up:standby 2024-04-06T12:32:09.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:32:12.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:12 smithi152 ceph-mon[104634]: pgmap v180: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-06T12:32:12.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:12 smithi195 ceph-mon[85980]: pgmap v180: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-06T12:32:13.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:13 smithi152 ceph-mon[104634]: reconnect by client.24333 192.168.0.1:0/2299992592 after 0.000999981 2024-04-06T12:32:13.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:13 smithi152 ceph-mon[104634]: reconnect by client.14496 192.168.0.1:0/1847732670 after 0.000999981 2024-04-06T12:32:13.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:13 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] up:reconnect 2024-04-06T12:32:13.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:13 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi195.akamqf=up:reconnect} 3 up:standby 2024-04-06T12:32:13.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:13 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:13.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:13 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:13.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:13 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:13.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:13 smithi195 ceph-mon[85980]: reconnect by client.24333 192.168.0.1:0/2299992592 after 0.000999981 2024-04-06T12:32:13.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:13 smithi195 ceph-mon[85980]: reconnect by client.14496 192.168.0.1:0/1847732670 after 0.000999981 2024-04-06T12:32:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:13 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] up:reconnect 2024-04-06T12:32:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:13 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi195.akamqf=up:reconnect} 3 up:standby 2024-04-06T12:32:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:13 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:13 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:13.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:13 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:14 smithi152 ceph-mon[104634]: pgmap v181: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-06T12:32:14.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:14 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] up:rejoin 2024-04-06T12:32:14.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:14 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi195.akamqf=up:rejoin} 3 up:standby 2024-04-06T12:32:14.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:14 smithi152 ceph-mon[104634]: daemon mds.cephfs.smithi195.akamqf is now active in filesystem cephfs as rank 0 2024-04-06T12:32:14.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:14 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:14.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:14 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:14 smithi195 ceph-mon[85980]: pgmap v181: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-06T12:32:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:14 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] up:rejoin 2024-04-06T12:32:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:14 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi195.akamqf=up:rejoin} 3 up:standby 2024-04-06T12:32:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:14 smithi195 ceph-mon[85980]: daemon mds.cephfs.smithi195.akamqf is now active in filesystem cephfs as rank 0 2024-04-06T12:32:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:14 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:14 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:15.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:15 smithi152 ceph-mon[104634]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-06T12:32:15.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:15 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] up:active 2024-04-06T12:32:15.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:15 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi195.akamqf=up:active} 3 up:standby 2024-04-06T12:32:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:15 smithi195 ceph-mon[85980]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-06T12:32:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:15 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] up:active 2024-04-06T12:32:15.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:15 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi195.akamqf=up:active} 3 up:standby 2024-04-06T12:32:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.116+0000 7fe247e09700 1 -- 172.21.15.152:0/356244919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fd8f0 msgr2=0x7fe2400fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.116+0000 7fe247e09700 1 --2- 172.21.15.152:0/356244919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fd8f0 0x7fe2400fdcd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fe23c0047f0 tx=0x7fe23c009cb0).stop 2024-04-06T12:32:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.116+0000 7fe247e09700 1 -- 172.21.15.152:0/356244919 shutdown_connections 2024-04-06T12:32:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.116+0000 7fe247e09700 1 --2- 172.21.15.152:0/356244919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400fe250 0x7fe2400f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.116+0000 7fe247e09700 1 --2- 172.21.15.152:0/356244919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fd8f0 0x7fe2400fdcd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.116+0000 7fe247e09700 1 -- 172.21.15.152:0/356244919 >> 172.21.15.152:0/356244919 conn(0x7fe2400f34b0 msgr2=0x7fe2400f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.116+0000 7fe247e09700 1 -- 172.21.15.152:0/356244919 shutdown_connections 2024-04-06T12:32:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.116+0000 7fe247e09700 1 -- 172.21.15.152:0/356244919 wait complete. 2024-04-06T12:32:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe247e09700 1 Processor -- start 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe247e09700 1 -- start start 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe247e09700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400fd8f0 0x7fe24010e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe247e09700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fe250 0x7fe24010e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe247e09700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24010eaf0 con 0x7fe2400fe250 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe247e09700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24010ec30 con 0x7fe2400fd8f0 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe2453a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fe250 0x7fe24010e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe2453a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fe250 0x7fe24010e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40498/0 (socket says 172.21.15.152:40498) 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe2453a4700 1 -- 172.21.15.152:0/2674229809 learned_addr learned my addr 172.21.15.152:0/2674229809 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe245ba5700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400fd8f0 0x7fe24010e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe2453a4700 1 -- 172.21.15.152:0/2674229809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400fd8f0 msgr2=0x7fe24010e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe2453a4700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400fd8f0 0x7fe24010e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.117+0000 7fe2453a4700 1 -- 172.21.15.152:0/2674229809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c005040 con 0x7fe2400fe250 2024-04-06T12:32:16.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.118+0000 7fe2453a4700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fe250 0x7fe24010e4f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe23000c790 tx=0x7fe230007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:16.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.118+0000 7fe236ffd700 1 -- 172.21.15.152:0/2674229809 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe23000e680 con 0x7fe2400fe250 2024-04-06T12:32:16.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.118+0000 7fe236ffd700 1 -- 172.21.15.152:0/2674229809 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe23000ec90 con 0x7fe2400fe250 2024-04-06T12:32:16.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.118+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2401082c0 con 0x7fe2400fe250 2024-04-06T12:32:16.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.118+0000 7fe236ffd700 1 -- 172.21.15.152:0/2674229809 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe230012cf0 con 0x7fe2400fe250 2024-04-06T12:32:16.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.119+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe240108880 con 0x7fe2400fe250 2024-04-06T12:32:16.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.119+0000 7fe236ffd700 1 -- 172.21.15.152:0/2674229809 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe23001a360 con 0x7fe2400fe250 2024-04-06T12:32:16.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.120+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24005f590 con 0x7fe2400fe250 2024-04-06T12:32:16.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.120+0000 7fe236ffd700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe22c06caa0 0x7fe22c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:16.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.120+0000 7fe236ffd700 1 -- 172.21.15.152:0/2674229809 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6340+0+0 (secure 0 0 0) 0x7fe23008b580 con 0x7fe2400fe250 2024-04-06T12:32:16.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.120+0000 7fe245ba5700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe22c06caa0 0x7fe22c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:16.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.121+0000 7fe245ba5700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe22c06caa0 0x7fe22c06ef60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fe23c007cf0 tx=0x7fe23c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:16.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.125+0000 7fe236ffd700 1 -- 172.21.15.152:0/2674229809 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fe230058fd0 con 0x7fe2400fe250 2024-04-06T12:32:16.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.342+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe240108a70 con 0x7fe22c06caa0 2024-04-06T12:32:16.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.343+0000 7fe236ffd700 1 -- 172.21.15.152:0/2674229809 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe240108a70 con 0x7fe22c06caa0 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe22c06caa0 msgr2=0x7fe22c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe22c06caa0 0x7fe22c06ef60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fe23c007cf0 tx=0x7fe23c00b040).stop 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fe250 msgr2=0x7fe24010e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fe250 0x7fe24010e4f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe23000c790 tx=0x7fe230007f50).stop 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 shutdown_connections 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe22c06caa0 0x7fe22c06ef60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2400fd8f0 0x7fe24010e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 --2- 172.21.15.152:0/2674229809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2400fe250 0x7fe24010e4f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 >> 172.21.15.152:0/2674229809 conn(0x7fe2400f34b0 msgr2=0x7fe2400fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 shutdown_connections 2024-04-06T12:32:16.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.345+0000 7fe247e09700 1 -- 172.21.15.152:0/2674229809 wait complete. 2024-04-06T12:32:16.355 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:32:16.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.467+0000 7fb5ff69c700 1 -- 172.21.15.152:0/4109351923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 msgr2=0x7fb5f80ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.467+0000 7fb5ff69c700 1 --2- 172.21.15.152:0/4109351923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 0x7fb5f80ffed0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb5f40047f0 tx=0x7fb5f4009cb0).stop 2024-04-06T12:32:16.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.467+0000 7fb5ff69c700 1 -- 172.21.15.152:0/4109351923 shutdown_connections 2024-04-06T12:32:16.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.467+0000 7fb5ff69c700 1 --2- 172.21.15.152:0/4109351923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f81003c0 0x7fb5f80f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.467+0000 7fb5ff69c700 1 --2- 172.21.15.152:0/4109351923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 0x7fb5f80ffed0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.467+0000 7fb5ff69c700 1 -- 172.21.15.152:0/4109351923 >> 172.21.15.152:0/4109351923 conn(0x7fb5f80f5830 msgr2=0x7fb5f80f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:16.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.467+0000 7fb5ff69c700 1 -- 172.21.15.152:0/4109351923 shutdown_connections 2024-04-06T12:32:16.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.467+0000 7fb5ff69c700 1 -- 172.21.15.152:0/4109351923 wait complete. 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5ff69c700 1 Processor -- start 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5ff69c700 1 -- start start 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5ff69c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 0x7fb5f8110310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5ff69c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f81003c0 0x7fb5f8110800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5ff69c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8110e00 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5ff69c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8110f40 con 0x7fb5f81003c0 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5fd438700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 0x7fb5f8110310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5fd438700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 0x7fb5f8110310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40518/0 (socket says 172.21.15.152:40518) 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5fd438700 1 -- 172.21.15.152:0/3750261927 learned_addr learned my addr 172.21.15.152:0/3750261927 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:16.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5fcc37700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f81003c0 0x7fb5f8110800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5fd438700 1 -- 172.21.15.152:0/3750261927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f81003c0 msgr2=0x7fb5f8110800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5fd438700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f81003c0 0x7fb5f8110800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5fd438700 1 -- 172.21.15.152:0/3750261927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4005040 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.468+0000 7fb5fd438700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 0x7fb5f8110310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb5f4009380 tx=0x7fb5f4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.469+0000 7fb5ee7fc700 1 -- 172.21.15.152:0/3750261927 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f4018070 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.469+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f810a5e0 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.469+0000 7fb5ee7fc700 1 -- 172.21.15.152:0/3750261927 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5f4007e90 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.469+0000 7fb5ee7fc700 1 -- 172.21.15.152:0/3750261927 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f40123c0 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.469+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f810aac0 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.470+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f805f570 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.471+0000 7fb5ee7fc700 1 -- 172.21.15.152:0/3750261927 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb5f401d420 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.471+0000 7fb5ee7fc700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb5e406caa0 0x7fb5e406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:16.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.471+0000 7fb5ee7fc700 1 -- 172.21.15.152:0/3750261927 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6340+0+0 (secure 0 0 0) 0x7fb5f408cda0 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.471+0000 7fb5fcc37700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb5e406caa0 0x7fb5e406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:16.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.472+0000 7fb5fcc37700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb5e406caa0 0x7fb5e406ef60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb5f810bc50 tx=0x7fb5e800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:16.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.475+0000 7fb5ee7fc700 1 -- 172.21.15.152:0/3750261927 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fb5f405a800 con 0x7fb5f80ffaf0 2024-04-06T12:32:16.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:16 smithi152 ceph-mon[104634]: pgmap v182: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 4 op/s 2024-04-06T12:32:16.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:16 smithi195 ceph-mon[85980]: pgmap v182: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 4 op/s 2024-04-06T12:32:16.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.710+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5f80fccd0 con 0x7fb5e406caa0 2024-04-06T12:32:16.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.711+0000 7fb5ee7fc700 1 -- 172.21.15.152:0/3750261927 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb5f80fccd0 con 0x7fb5e406caa0 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb5e406caa0 msgr2=0x7fb5e406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb5e406caa0 0x7fb5e406ef60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb5f810bc50 tx=0x7fb5e800b040).stop 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 msgr2=0x7fb5f8110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 0x7fb5f8110310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb5f4009380 tx=0x7fb5f4009cb0).stop 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 shutdown_connections 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb5e406caa0 0x7fb5e406ef60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ffaf0 0x7fb5f8110310 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 --2- 172.21.15.152:0/3750261927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f81003c0 0x7fb5f8110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 >> 172.21.15.152:0/3750261927 conn(0x7fb5f80f5830 msgr2=0x7fb5f81031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 shutdown_connections 2024-04-06T12:32:16.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.714+0000 7fb5ff69c700 1 -- 172.21.15.152:0/3750261927 wait complete. 2024-04-06T12:32:16.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.816+0000 7f217cfd2700 1 -- 172.21.15.152:0/2008679374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 msgr2=0x7f21780fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.816+0000 7f217cfd2700 1 --2- 172.21.15.152:0/2008679374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 0x7f21780fcbd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f21680047f0 tx=0x7f2168009cb0).stop 2024-04-06T12:32:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.816+0000 7f217cfd2700 1 -- 172.21.15.152:0/2008679374 shutdown_connections 2024-04-06T12:32:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.816+0000 7f217cfd2700 1 --2- 172.21.15.152:0/2008679374 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21780fd150 0x7f21780f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.816+0000 7f217cfd2700 1 --2- 172.21.15.152:0/2008679374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 0x7f21780fcbd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.816+0000 7f217cfd2700 1 -- 172.21.15.152:0/2008679374 >> 172.21.15.152:0/2008679374 conn(0x7f2178070590 msgr2=0x7f21780f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.817+0000 7f217cfd2700 1 -- 172.21.15.152:0/2008679374 shutdown_connections 2024-04-06T12:32:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.817+0000 7f217cfd2700 1 -- 172.21.15.152:0/2008679374 wait complete. 2024-04-06T12:32:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.817+0000 7f217cfd2700 1 Processor -- start 2024-04-06T12:32:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.817+0000 7f217cfd2700 1 -- start start 2024-04-06T12:32:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217cfd2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 0x7f2178109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217cfd2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21780fd150 0x7f21781095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217cfd2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2178109ae0 con 0x7f21780fc7f0 2024-04-06T12:32:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217cfd2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2178109c20 con 0x7f21780fd150 2024-04-06T12:32:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 0x7f2178109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 0x7f2178109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40540/0 (socket says 172.21.15.152:40540) 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217659c700 1 -- 172.21.15.152:0/3446954085 learned_addr learned my addr 172.21.15.152:0/3446954085 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f2175d9b700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21780fd150 0x7f21781095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217659c700 1 -- 172.21.15.152:0/3446954085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21780fd150 msgr2=0x7f21781095f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217659c700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21780fd150 0x7f21781095f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217659c700 1 -- 172.21.15.152:0/3446954085 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2168005040 con 0x7f21780fc7f0 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f2175d9b700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21780fd150 0x7f21781095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217659c700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 0x7f2178109100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2168005010 tx=0x7f2168009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f21677fe700 1 -- 172.21.15.152:0/3446954085 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f216800e030 con 0x7f21780fc7f0 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2178109e70 con 0x7f21780fc7f0 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f21677fe700 1 -- 172.21.15.152:0/3446954085 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2168007e90 con 0x7f21780fc7f0 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f21677fe700 1 -- 172.21.15.152:0/3446954085 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2168018070 con 0x7f21780fc7f0 2024-04-06T12:32:16.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.818+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2178112460 con 0x7f21780fc7f0 2024-04-06T12:32:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.819+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217805f590 con 0x7f21780fc7f0 2024-04-06T12:32:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.820+0000 7f21677fe700 1 -- 172.21.15.152:0/3446954085 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2168009610 con 0x7f21780fc7f0 2024-04-06T12:32:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.820+0000 7f21677fe700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f216006ca30 0x7f216006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.820+0000 7f21677fe700 1 -- 172.21.15.152:0/3446954085 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f216808d0c0 con 0x7f21780fc7f0 2024-04-06T12:32:16.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.820+0000 7f2175d9b700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f216006ca30 0x7f216006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:16.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.820+0000 7f2175d9b700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f216006ca30 0x7f216006eef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f2178060f00 tx=0x7f216c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:16.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:16.824+0000 7f21677fe700 1 -- 172.21.15.152:0/3446954085 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f2168057110 con 0x7f21780fc7f0 2024-04-06T12:32:17.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.037+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2178059120 con 0x7f216006ca30 2024-04-06T12:32:17.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.047+0000 7f21677fe700 1 -- 172.21.15.152:0/3446954085 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2178059120 con 0x7f216006ca30 2024-04-06T12:32:17.045 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:32:17.045 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (6m) 3s ago 17m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:32:17.045 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (3m) 3s ago 17m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:32:17.045 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (3m) 25s ago 16m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:32:17.045 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (5m) 3s ago 17m 94.0M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:32:17.045 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (12m) 3s ago 12m 10.7M - 16.2.15-1-g8963e9de 727f386679cb b502e9f33ecf 2024-04-06T12:32:17.045 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (9s) 3s ago 12m 13.4M - 18.2.2-1086-g052adcad 87261d5ece5a 90254d845be3 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (12m) 25s ago 12m 15.6M - 16.2.15-1-g8963e9de 727f386679cb 8fd382d06a9a 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (12m) 25s ago 12m 16.4M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (7m) 3s ago 18m 504M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (6m) 25s ago 16m 450M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (4m) 3s ago 19m 54.1M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (4m) 25s ago 16m 40.7M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 3s ago 17m 17.1M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 25s ago 16m 17.5M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (3m) 3s ago 16m 99.2M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (2m) 3s ago 15m 102M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 4e01281def3c 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (2m) 3s ago 15m 108M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 36456f3aa1eb 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (96s) 25s ago 14m 121M 2251M 18.2.2-1086-g052adcad 87261d5ece5a b41c5ddebdba 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (62s) 25s ago 14m 82.9M 2251M 18.2.2-1086-g052adcad 87261d5ece5a 887060bd04bc 2024-04-06T12:32:17.046 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (29s) 25s ago 13m 11.4M 2251M 18.2.2-1086-g052adcad 87261d5ece5a f0ce150c2bbd 2024-04-06T12:32:17.047 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (6m) 25s ago 16m 60.0M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:32:17.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.049+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f216006ca30 msgr2=0x7f216006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.049+0000 7f217cfd2700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f216006ca30 0x7f216006eef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f2178060f00 tx=0x7f216c00b040).stop 2024-04-06T12:32:17.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.049+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 msgr2=0x7f2178109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.049+0000 7f217cfd2700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 0x7f2178109100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2168005010 tx=0x7f2168009cb0).stop 2024-04-06T12:32:17.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.050+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 shutdown_connections 2024-04-06T12:32:17.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.050+0000 7f217cfd2700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f216006ca30 0x7f216006eef0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.050+0000 7f217cfd2700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21780fc7f0 0x7f2178109100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.050+0000 7f217cfd2700 1 --2- 172.21.15.152:0/3446954085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21780fd150 0x7f21781095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.050+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 >> 172.21.15.152:0/3446954085 conn(0x7f2178070590 msgr2=0x7f21780fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:17.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.050+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 shutdown_connections 2024-04-06T12:32:17.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.050+0000 7f217cfd2700 1 -- 172.21.15.152:0/3446954085 wait complete. 2024-04-06T12:32:17.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.148+0000 7f6a26968700 1 -- 172.21.15.152:0/2593099523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fc7f0 msgr2=0x7f6a200fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.148+0000 7f6a26968700 1 --2- 172.21.15.152:0/2593099523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fc7f0 0x7f6a200fcbd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f6a100047f0 tx=0x7f6a10009cb0).stop 2024-04-06T12:32:17.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.148+0000 7f6a26968700 1 -- 172.21.15.152:0/2593099523 shutdown_connections 2024-04-06T12:32:17.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.148+0000 7f6a26968700 1 --2- 172.21.15.152:0/2593099523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a200fd150 0x7f6a200f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.148+0000 7f6a26968700 1 --2- 172.21.15.152:0/2593099523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fc7f0 0x7f6a200fcbd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.148+0000 7f6a26968700 1 -- 172.21.15.152:0/2593099523 >> 172.21.15.152:0/2593099523 conn(0x7f6a20070590 msgr2=0x7f6a200f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:17.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.148+0000 7f6a26968700 1 -- 172.21.15.152:0/2593099523 shutdown_connections 2024-04-06T12:32:17.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.148+0000 7f6a26968700 1 -- 172.21.15.152:0/2593099523 wait complete. 2024-04-06T12:32:17.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.149+0000 7f6a26968700 1 Processor -- start 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.149+0000 7f6a26968700 1 -- start start 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a26968700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a200fc7f0 0x7f6a2010cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a26968700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fd150 0x7f6a2010d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a26968700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2010da20 con 0x7f6a200fd150 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a26968700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2010db60 con 0x7f6a200fc7f0 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a1f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fd150 0x7f6a2010d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a1f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fd150 0x7f6a2010d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40560/0 (socket says 172.21.15.152:40560) 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a1f7fe700 1 -- 172.21.15.152:0/2156393035 learned_addr learned my addr 172.21.15.152:0/2156393035 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a1ffff700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a200fc7f0 0x7f6a2010cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a1f7fe700 1 -- 172.21.15.152:0/2156393035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a200fc7f0 msgr2=0x7f6a2010cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a1f7fe700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a200fc7f0 0x7f6a2010cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a1f7fe700 1 -- 172.21.15.152:0/2156393035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10005040 con 0x7f6a200fd150 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.150+0000 7f6a1f7fe700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fd150 0x7f6a2010d420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6a1400fa90 tx=0x7f6a14009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.151+0000 7f6a1d7fa700 1 -- 172.21.15.152:0/2156393035 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a14016070 con 0x7f6a200fd150 2024-04-06T12:32:17.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.151+0000 7f6a1d7fa700 1 -- 172.21.15.152:0/2156393035 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a14007d20 con 0x7f6a200fd150 2024-04-06T12:32:17.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.151+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a201071f0 con 0x7f6a200fd150 2024-04-06T12:32:17.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.151+0000 7f6a1d7fa700 1 -- 172.21.15.152:0/2156393035 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1400dcf0 con 0x7f6a200fd150 2024-04-06T12:32:17.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.151+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a201077b0 con 0x7f6a200fd150 2024-04-06T12:32:17.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.152+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2005f590 con 0x7f6a200fd150 2024-04-06T12:32:17.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.152+0000 7f6a1d7fa700 1 -- 172.21.15.152:0/2156393035 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6a14009110 con 0x7f6a200fd150 2024-04-06T12:32:17.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.153+0000 7f6a1d7fa700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f6a0806caa0 0x7f6a0806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:17.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.153+0000 7f6a1d7fa700 1 -- 172.21.15.152:0/2156393035 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f6a1408e0f0 con 0x7f6a200fd150 2024-04-06T12:32:17.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.153+0000 7f6a1ffff700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f6a0806caa0 0x7f6a0806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:17.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.153+0000 7f6a1ffff700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f6a0806caa0 0x7f6a0806ef60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6a10004f10 tx=0x7f6a1000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:17.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.157+0000 7f6a1d7fa700 1 -- 172.21.15.152:0/2156393035 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f6a1405bbd0 con 0x7f6a200fd150 2024-04-06T12:32:17.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.434+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6a20107df0 con 0x7f6a200fd150 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.435+0000 7f6a1d7fa700 1 -- 172.21.15.152:0/2156393035 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f6a1405b760 con 0x7f6a200fd150 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 6 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:32:17.433 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:32:17.434 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 3, 2024-04-06T12:32:17.434 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 1 2024-04-06T12:32:17.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:32:17.434 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:32:17.434 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 3, 2024-04-06T12:32:17.434 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 11 2024-04-06T12:32:17.434 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:32:17.434 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f6a0806caa0 msgr2=0x7f6a0806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f6a0806caa0 0x7f6a0806ef60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6a10004f10 tx=0x7f6a1000b040).stop 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fd150 msgr2=0x7f6a2010d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fd150 0x7f6a2010d420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6a1400fa90 tx=0x7f6a14009f20).stop 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 shutdown_connections 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f6a0806caa0 0x7f6a0806ef60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a200fc7f0 0x7f6a2010cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 --2- 172.21.15.152:0/2156393035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a200fd150 0x7f6a2010d420 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 >> 172.21.15.152:0/2156393035 conn(0x7f6a20070590 msgr2=0x7f6a200fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 shutdown_connections 2024-04-06T12:32:17.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.437+0000 7f6a26968700 1 -- 172.21.15.152:0/2156393035 wait complete. 2024-04-06T12:32:17.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.544+0000 7f9c2d274700 1 -- 172.21.15.152:0/1450327707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 msgr2=0x7f9c2806b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.544+0000 7f9c2d274700 1 --2- 172.21.15.152:0/1450327707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 0x7f9c2806b4d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9c180047f0 tx=0x7f9c18009cb0).stop 2024-04-06T12:32:17.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.544+0000 7f9c2d274700 1 -- 172.21.15.152:0/1450327707 shutdown_connections 2024-04-06T12:32:17.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.544+0000 7f9c2d274700 1 --2- 172.21.15.152:0/1450327707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c2806b9c0 0x7f9c28103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.544+0000 7f9c2d274700 1 --2- 172.21.15.152:0/1450327707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 0x7f9c2806b4d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.544+0000 7f9c2d274700 1 -- 172.21.15.152:0/1450327707 >> 172.21.15.152:0/1450327707 conn(0x7f9c280f34b0 msgr2=0x7f9c280f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:17.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.544+0000 7f9c2d274700 1 -- 172.21.15.152:0/1450327707 shutdown_connections 2024-04-06T12:32:17.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.544+0000 7f9c2d274700 1 -- 172.21.15.152:0/1450327707 wait complete. 2024-04-06T12:32:17.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.545+0000 7f9c2d274700 1 Processor -- start 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.545+0000 7f9c2d274700 1 -- start start 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c2d274700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 0x7f9c28110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c2d274700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c2806b9c0 0x7f9c281107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c2d274700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28110df0 con 0x7f9c2806b0f0 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c2d274700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28110f30 con 0x7f9c2806b9c0 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c26ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 0x7f9c28110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c26ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 0x7f9c28110300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40566/0 (socket says 172.21.15.152:40566) 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c26ffd700 1 -- 172.21.15.152:0/1811531103 learned_addr learned my addr 172.21.15.152:0/1811531103 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c267fc700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c2806b9c0 0x7f9c281107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c26ffd700 1 -- 172.21.15.152:0/1811531103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c2806b9c0 msgr2=0x7f9c281107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c26ffd700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c2806b9c0 0x7f9c281107f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.545 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c26ffd700 1 -- 172.21.15.152:0/1811531103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18005040 con 0x7f9c2806b0f0 2024-04-06T12:32:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c267fc700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c2806b9c0 0x7f9c281107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:32:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c26ffd700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 0x7f9c28110300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9c18005010 tx=0x7f9c18009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c0ffff700 1 -- 172.21.15.152:0/1811531103 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c1800e030 con 0x7f9c2806b0f0 2024-04-06T12:32:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2810a560 con 0x7f9c2806b0f0 2024-04-06T12:32:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c0ffff700 1 -- 172.21.15.152:0/1811531103 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c18007e90 con 0x7f9c2806b0f0 2024-04-06T12:32:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c0ffff700 1 -- 172.21.15.152:0/1811531103 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c18018070 con 0x7f9c2806b0f0 2024-04-06T12:32:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.546+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2810aa40 con 0x7f9c2806b0f0 2024-04-06T12:32:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.547+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2805f590 con 0x7f9c2806b0f0 2024-04-06T12:32:17.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.548+0000 7f9c0ffff700 1 -- 172.21.15.152:0/1811531103 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9c1801d6e0 con 0x7f9c2806b0f0 2024-04-06T12:32:17.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.548+0000 7f9c0ffff700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c1006ca30 0x7f9c1006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:17.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.548+0000 7f9c0ffff700 1 -- 172.21.15.152:0/1811531103 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f9c1808d140 con 0x7f9c2806b0f0 2024-04-06T12:32:17.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.548+0000 7f9c267fc700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c1006ca30 0x7f9c1006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:17.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.549+0000 7f9c267fc700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c1006ca30 0x7f9c1006eef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9c2810bc40 tx=0x7f9c1c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:17.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.553+0000 7f9c0ffff700 1 -- 172.21.15.152:0/1811531103 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f9c1805ac20 con 0x7f9c2806b0f0 2024-04-06T12:32:17.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.791+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9c2810b980 con 0x7f9c2806b0f0 2024-04-06T12:32:17.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.792+0000 7f9c0ffff700 1 -- 172.21.15.152:0/1811531103 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f9c1805a7b0 con 0x7f9c2806b0f0 2024-04-06T12:32:17.790 INFO:teuthology.orchestra.run.smithi152.stdout:e19 2024-04-06T12:32:17.790 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:32:17.790 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:32:17.790 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:32:17.790 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:32:17.790 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:32:17.790 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:32:17.790 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 19 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:32:14.142274+0000 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 89 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:32:17.791 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=24273} 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{0:24273} state up:active seq 185 join_fscid=1 addr [v2:172.21.15.195:6824/3550026836,v1:172.21.15.195:6825/3550026836] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:32:17.792 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:32:17.793 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:32:17.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:32:17.793 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:24289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:32:17.793 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/1788558838,v1:172.21.15.152:6829/1788558838] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:32:17.793 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:32:17.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.795+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c1006ca30 msgr2=0x7f9c1006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.795+0000 7f9c2d274700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c1006ca30 0x7f9c1006eef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9c2810bc40 tx=0x7f9c1c00b040).stop 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.795+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 msgr2=0x7f9c28110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.795+0000 7f9c2d274700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 0x7f9c28110300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9c18005010 tx=0x7f9c18009cb0).stop 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.795+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 shutdown_connections 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.795+0000 7f9c2d274700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c1006ca30 0x7f9c1006eef0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.795+0000 7f9c2d274700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2806b0f0 0x7f9c28110300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.795+0000 7f9c2d274700 1 --2- 172.21.15.152:0/1811531103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c2806b9c0 0x7f9c281107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.795+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 >> 172.21.15.152:0/1811531103 conn(0x7f9c280f34b0 msgr2=0x7f9c28101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.796+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 shutdown_connections 2024-04-06T12:32:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.796+0000 7f9c2d274700 1 -- 172.21.15.152:0/1811531103 wait complete. 2024-04-06T12:32:17.795 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 19 2024-04-06T12:32:17.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.910+0000 7f73a77b8700 1 -- 172.21.15.152:0/1387054448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 msgr2=0x7f73a0101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.910+0000 7f73a77b8700 1 --2- 172.21.15.152:0/1387054448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 0x7f73a0101910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f73900047f0 tx=0x7f7390009cb0).stop 2024-04-06T12:32:17.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.910+0000 7f73a77b8700 1 -- 172.21.15.152:0/1387054448 shutdown_connections 2024-04-06T12:32:17.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.910+0000 7f73a77b8700 1 --2- 172.21.15.152:0/1387054448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 0x7f73a0101910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.910+0000 7f73a77b8700 1 --2- 172.21.15.152:0/1387054448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73a00f88a0 0x7f73a00f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:32:17.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.910+0000 7f73a77b8700 1 -- 172.21.15.152:0/1387054448 >> 172.21.15.152:0/1387054448 conn(0x7f73a00f23d0 msgr2=0x7f73a00f47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:17.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.910+0000 7f73a77b8700 1 -- 172.21.15.152:0/1387054448 shutdown_connections 2024-04-06T12:32:17.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.910+0000 7f73a77b8700 1 -- 172.21.15.152:0/1387054448 wait complete. 2024-04-06T12:32:17.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.911+0000 7f73a77b8700 1 Processor -- start 2024-04-06T12:32:17.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.911+0000 7f73a77b8700 1 -- start start 2024-04-06T12:32:17.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.911+0000 7f73a77b8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73a00f88a0 0x7f73a010e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:17.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.911+0000 7f73a77b8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 0x7f73a010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:17.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.911+0000 7f73a77b8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a010ec10 con 0x7f73a00f9200 2024-04-06T12:32:17.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.911+0000 7f73a77b8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0108230 con 0x7f73a00f88a0 2024-04-06T12:32:17.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.911+0000 7f73a4d53700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 0x7f73a010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:17.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.911+0000 7f73a4d53700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 0x7f73a010e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40590/0 (socket says 172.21.15.152:40590) 2024-04-06T12:32:17.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.911+0000 7f73a4d53700 1 -- 172.21.15.152:0/1704794296 learned_addr learned my addr 172.21.15.152:0/1704794296 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:17.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73a5554700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73a00f88a0 0x7f73a010e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:17.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73a4d53700 1 -- 172.21.15.152:0/1704794296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73a00f88a0 msgr2=0x7f73a010e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:17.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73a4d53700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73a00f88a0 0x7f73a010e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:17.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73a4d53700 1 -- 172.21.15.152:0/1704794296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7390005040 con 0x7f73a00f9200 2024-04-06T12:32:17.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73a5554700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73a00f88a0 0x7f73a010e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:32:17.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73a4d53700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 0x7f73a010e580 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f7390013640 tx=0x7f7390009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:17.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73967fc700 1 -- 172.21.15.152:0/1704794296 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f739000e030 con 0x7f73a00f9200 2024-04-06T12:32:17.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a0108480 con 0x7f73a00f9200 2024-04-06T12:32:17.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73967fc700 1 -- 172.21.15.152:0/1704794296 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7390007e90 con 0x7f73a00f9200 2024-04-06T12:32:17.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73967fc700 1 -- 172.21.15.152:0/1704794296 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7390018070 con 0x7f73a00f9200 2024-04-06T12:32:17.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.912+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a0108960 con 0x7f73a00f9200 2024-04-06T12:32:17.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.913+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a0060390 con 0x7f73a00f9200 2024-04-06T12:32:17.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.914+0000 7f73967fc700 1 -- 172.21.15.152:0/1704794296 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f739001d420 con 0x7f73a00f9200 2024-04-06T12:32:17.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.914+0000 7f73967fc700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f738c06cab0 0x7f738c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:17.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.914+0000 7f73967fc700 1 -- 172.21.15.152:0/1704794296 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f739008d300 con 0x7f73a00f9200 2024-04-06T12:32:17.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.914+0000 7f73a5554700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f738c06cab0 0x7f738c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:17.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.915+0000 7f73a5554700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f738c06cab0 0x7f738c06ef70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f739c00a900 tx=0x7f739c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:17.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:17.922+0000 7f73967fc700 1 -- 172.21.15.152:0/1704794296 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f739005ad60 con 0x7f73a00f9200 2024-04-06T12:32:18.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.132+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73a0109780 con 0x7f738c06cab0 2024-04-06T12:32:18.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.133+0000 7f73967fc700 1 -- 172.21.15.152:0/1704794296 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f73a0109780 con 0x7f738c06cab0 2024-04-06T12:32:18.130 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "osd", 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "crash" 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "13/21 daemons upgraded", 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading mds daemons", 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:32:18.131 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f738c06cab0 msgr2=0x7f738c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f738c06cab0 0x7f738c06ef70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f739c00a900 tx=0x7f739c008040).stop 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 msgr2=0x7f73a010e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 0x7f73a010e580 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f7390013640 tx=0x7f7390009cb0).stop 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 shutdown_connections 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f738c06cab0 0x7f738c06ef70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73a00f88a0 0x7f73a010e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 --2- 172.21.15.152:0/1704794296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a00f9200 0x7f73a010e580 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 >> 172.21.15.152:0/1704794296 conn(0x7f73a00f23d0 msgr2=0x7f73a00fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 shutdown_connections 2024-04-06T12:32:18.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.135+0000 7f73a77b8700 1 -- 172.21.15.152:0/1704794296 wait complete. 2024-04-06T12:32:18.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.242+0000 7fc2765d9700 1 -- 172.21.15.152:0/4076556358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 msgr2=0x7fc2700f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.242+0000 7fc2765d9700 1 --2- 172.21.15.152:0/4076556358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 0x7fc2700f7a30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fc2640047f0 tx=0x7fc264009cb0).stop 2024-04-06T12:32:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.242+0000 7fc2765d9700 1 -- 172.21.15.152:0/4076556358 shutdown_connections 2024-04-06T12:32:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.242+0000 7fc2765d9700 1 --2- 172.21.15.152:0/4076556358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 0x7fc2700f7a30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.242+0000 7fc2765d9700 1 --2- 172.21.15.152:0/4076556358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2700fd8f0 0x7fc2700fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.242+0000 7fc2765d9700 1 -- 172.21.15.152:0/4076556358 >> 172.21.15.152:0/4076556358 conn(0x7fc2700f34b0 msgr2=0x7fc2700f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.242+0000 7fc2765d9700 1 -- 172.21.15.152:0/4076556358 shutdown_connections 2024-04-06T12:32:18.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.242+0000 7fc2765d9700 1 -- 172.21.15.152:0/4076556358 wait complete. 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.242+0000 7fc2765d9700 1 Processor -- start 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc2765d9700 1 -- start start 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc2765d9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2700fd8f0 0x7fc27010dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc2765d9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 0x7fc27010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc2765d9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27010eae0 con 0x7fc2700fe250 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc2765d9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27010ec20 con 0x7fc2700fd8f0 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc26f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 0x7fc27010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc26f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 0x7fc27010e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40608/0 (socket says 172.21.15.152:40608) 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc26f7fe700 1 -- 172.21.15.152:0/522087775 learned_addr learned my addr 172.21.15.152:0/522087775 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:18.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc26ffff700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2700fd8f0 0x7fc27010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:18.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc26f7fe700 1 -- 172.21.15.152:0/522087775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2700fd8f0 msgr2=0x7fc27010dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:18.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc26f7fe700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2700fd8f0 0x7fc27010dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:18.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.243+0000 7fc26f7fe700 1 -- 172.21.15.152:0/522087775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264005040 con 0x7fc2700fe250 2024-04-06T12:32:18.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.244+0000 7fc26f7fe700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 0x7fc27010e4e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fc2640099f0 tx=0x7fc264009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:18.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.244+0000 7fc26d7fa700 1 -- 172.21.15.152:0/522087775 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc26400e030 con 0x7fc2700fe250 2024-04-06T12:32:18.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.244+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc270108250 con 0x7fc2700fe250 2024-04-06T12:32:18.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.244+0000 7fc26d7fa700 1 -- 172.21.15.152:0/522087775 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc264007e90 con 0x7fc2700fe250 2024-04-06T12:32:18.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.244+0000 7fc26d7fa700 1 -- 172.21.15.152:0/522087775 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc264018070 con 0x7fc2700fe250 2024-04-06T12:32:18.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.244+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2701087b0 con 0x7fc2700fe250 2024-04-06T12:32:18.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.245+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27005f590 con 0x7fc2700fe250 2024-04-06T12:32:18.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.245+0000 7fc26d7fa700 1 -- 172.21.15.152:0/522087775 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc2640094c0 con 0x7fc2700fe250 2024-04-06T12:32:18.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.246+0000 7fc26d7fa700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc25806caa0 0x7fc25806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:18.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.246+0000 7fc26ffff700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc25806caa0 0x7fc25806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:18.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.246+0000 7fc26d7fa700 1 -- 172.21.15.152:0/522087775 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6340+0+0 (secure 0 0 0) 0x7fc26408d090 con 0x7fc2700fe250 2024-04-06T12:32:18.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.246+0000 7fc26ffff700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc25806caa0 0x7fc25806ef60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc260004de0 tx=0x7fc26000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.250+0000 7fc26d7fa700 1 -- 172.21.15.152:0/522087775 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fc26405ab70 con 0x7fc2700fe250 2024-04-06T12:32:18.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: pgmap v183: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 85 B/s wr, 3 op/s 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2156393035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:18.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.300 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:18 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1811531103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:32:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.527+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc270047540 con 0x7fc2700fe250 2024-04-06T12:32:18.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.527+0000 7fc26d7fa700 1 -- 172.21.15.152:0/522087775 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc26405a700 con 0x7fc2700fe250 2024-04-06T12:32:18.526 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:32:18.526 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:32:18.526 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:32:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: pgmap v183: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 85 B/s wr, 3 op/s 2024-04-06T12:32:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2156393035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:18 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1811531103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:32:18.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc25806caa0 msgr2=0x7fc25806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:18.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc25806caa0 0x7fc25806ef60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc260004de0 tx=0x7fc26000b040).stop 2024-04-06T12:32:18.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 msgr2=0x7fc27010e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:18.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 0x7fc27010e4e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fc2640099f0 tx=0x7fc264009cb0).stop 2024-04-06T12:32:18.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 shutdown_connections 2024-04-06T12:32:18.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc25806caa0 0x7fc25806ef60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:18.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2700fd8f0 0x7fc27010dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:18.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 --2- 172.21.15.152:0/522087775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2700fe250 0x7fc27010e4e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:18.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 >> 172.21.15.152:0/522087775 conn(0x7fc2700f34b0 msgr2=0x7fc2700fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:18.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 shutdown_connections 2024-04-06T12:32:18.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:18.530+0000 7fc2765d9700 1 -- 172.21.15.152:0/522087775 wait complete. 2024-04-06T12:32:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:19 smithi152 ceph-mon[104634]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:19 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/522087775' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:32:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:19 smithi195 ceph-mon[85980]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:19 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/522087775' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:32:20.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:20 smithi152 ceph-mon[104634]: pgmap v184: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 5.1 KiB/s wr, 8 op/s 2024-04-06T12:32:20.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:20 smithi152 ceph-mon[104634]: Upgrade: Updating mds.cephfs.smithi152.mxtfph 2024-04-06T12:32:20.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:20.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mxtfph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:32:20.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:20.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:20 smithi152 ceph-mon[104634]: Deploying daemon mds.cephfs.smithi152.mxtfph on smithi152 2024-04-06T12:32:20.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:20 smithi195 ceph-mon[85980]: pgmap v184: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 5.1 KiB/s wr, 8 op/s 2024-04-06T12:32:20.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:20 smithi195 ceph-mon[85980]: Upgrade: Updating mds.cephfs.smithi152.mxtfph 2024-04-06T12:32:20.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:20.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mxtfph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:32:20.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:20.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:20 smithi195 ceph-mon[85980]: Deploying daemon mds.cephfs.smithi152.mxtfph on smithi152 2024-04-06T12:32:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:22 smithi195 ceph-mon[85980]: pgmap v185: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-04-06T12:32:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:22 smithi195 ceph-mon[85980]: osdmap e90: 6 total, 6 up, 6 in 2024-04-06T12:32:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:32:22.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:22 smithi152 ceph-mon[104634]: pgmap v185: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-04-06T12:32:22.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:22 smithi152 ceph-mon[104634]: osdmap e90: 6 total, 6 up, 6 in 2024-04-06T12:32:22.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:22.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:32:23.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:23 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi195.akamqf=up:active} 2 up:standby 2024-04-06T12:32:23.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:23 smithi195 ceph-mon[85980]: pgmap v187: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.1 KiB/s wr, 7 op/s 2024-04-06T12:32:23.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:23 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi195.akamqf=up:active} 2 up:standby 2024-04-06T12:32:23.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:23 smithi152 ceph-mon[104634]: pgmap v187: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.1 KiB/s wr, 7 op/s 2024-04-06T12:32:25.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:24 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:32:25.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:24 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:32:26.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:25 smithi152 ceph-mon[104634]: pgmap v188: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2024-04-06T12:32:26.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:25 smithi195 ceph-mon[85980]: pgmap v188: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2024-04-06T12:32:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:28 smithi152 ceph-mon[104634]: pgmap v189: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2024-04-06T12:32:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:28 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.152:6828/367125625,v1:172.21.15.152:6829/367125625] up:boot 2024-04-06T12:32:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:28 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi195.akamqf=up:active} 3 up:standby 2024-04-06T12:32:28.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:28 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:32:28.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:28 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:28.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:28 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:28.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:28 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:28 smithi195 ceph-mon[85980]: pgmap v189: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2024-04-06T12:32:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:28 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.152:6828/367125625,v1:172.21.15.152:6829/367125625] up:boot 2024-04-06T12:32:28.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:28 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi195.akamqf=up:active} 3 up:standby 2024-04-06T12:32:28.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:28 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:32:28.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:28 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:28.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:28 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:28.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:28 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:29.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:29 smithi152 ceph-mon[104634]: pgmap v190: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:30.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:29 smithi195 ceph-mon[85980]: pgmap v190: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:32.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:31 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:32.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:31 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:32.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:31 smithi195 ceph-mon[85980]: pgmap v191: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:32.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:31 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:32.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:31 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:32.142 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:31 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:32.142 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:31 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:32.142 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:31 smithi152 ceph-mon[104634]: pgmap v191: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:32.142 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:31 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:32.142 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:31 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:34.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:34 smithi152 ceph-mon[104634]: pgmap v192: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:34 smithi195 ceph-mon[85980]: pgmap v192: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:36.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: pgmap v193: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:36.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:36 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: pgmap v193: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:36.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:36 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:38.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:37 smithi152 ceph-mon[104634]: Upgrade: Updating mds.cephfs.smithi195.akamqf 2024-04-06T12:32:38.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:38.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.akamqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:32:38.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:38.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:37 smithi152 ceph-mon[104634]: Deploying daemon mds.cephfs.smithi195.akamqf on smithi195 2024-04-06T12:32:38.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:32:38.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:37 smithi152 ceph-mon[104634]: pgmap v194: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:38.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:37 smithi195 ceph-mon[85980]: Upgrade: Updating mds.cephfs.smithi195.akamqf 2024-04-06T12:32:38.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:38.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.akamqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:32:38.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:38.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:37 smithi195 ceph-mon[85980]: Deploying daemon mds.cephfs.smithi195.akamqf on smithi195 2024-04-06T12:32:38.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:32:38.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:37 smithi195 ceph-mon[85980]: pgmap v194: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:39.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:38 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[104611]: 2024-04-06T12:32:38.698+0000 7f56deaae700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:32:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:38 smithi152 ceph-mon[104634]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-06T12:32:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:38 smithi152 ceph-mon[104634]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:32:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:38 smithi152 ceph-mon[104634]: osdmap e91: 6 total, 6 up, 6 in 2024-04-06T12:32:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:38 smithi152 ceph-mon[104634]: Standby daemon mds.cephfs.smithi195.ttgcpp assigned to filesystem cephfs as rank 0 2024-04-06T12:32:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:38 smithi152 ceph-mon[104634]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-06T12:32:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:38 smithi152 ceph-mon[104634]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-06T12:32:39.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:38 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi195.ttgcpp=up:replay} 2 up:standby 2024-04-06T12:32:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:38 smithi195 ceph-mon[85980]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-06T12:32:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:38 smithi195 ceph-mon[85980]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:32:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:38 smithi195 ceph-mon[85980]: osdmap e91: 6 total, 6 up, 6 in 2024-04-06T12:32:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:38 smithi195 ceph-mon[85980]: Standby daemon mds.cephfs.smithi195.ttgcpp assigned to filesystem cephfs as rank 0 2024-04-06T12:32:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:38 smithi195 ceph-mon[85980]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-06T12:32:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:38 smithi195 ceph-mon[85980]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-06T12:32:39.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:38 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi195.ttgcpp=up:replay} 2 up:standby 2024-04-06T12:32:40.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:39 smithi152 ceph-mon[104634]: pgmap v196: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:40.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:39 smithi195 ceph-mon[85980]: pgmap v196: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:42 smithi152 ceph-mon[104634]: pgmap v197: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:42.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:42 smithi195 ceph-mon[85980]: pgmap v197: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail 2024-04-06T12:32:44.502 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:44 smithi195 ceph-mon[85980]: pgmap v198: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 9.4 MiB/s rd, 2 op/s 2024-04-06T12:32:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:44 smithi152 ceph-mon[104634]: pgmap v198: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 9.4 MiB/s rd, 2 op/s 2024-04-06T12:32:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:46 smithi152 ceph-mon[104634]: pgmap v199: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-06T12:32:46.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:46 smithi195 ceph-mon[85980]: pgmap v199: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-06T12:32:48.504 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:48 smithi195 ceph-mon[85980]: pgmap v200: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-06T12:32:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:48 smithi152 ceph-mon[104634]: pgmap v200: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.648+0000 7f73021dc700 1 -- 172.21.15.152:0/4020818146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fd8f0 msgr2=0x7f72fc0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.648+0000 7f73021dc700 1 --2- 172.21.15.152:0/4020818146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fd8f0 0x7f72fc0fdcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f72ec009b60 tx=0x7f72ec004d10).stop 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.648+0000 7f73021dc700 1 -- 172.21.15.152:0/4020818146 shutdown_connections 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.648+0000 7f73021dc700 1 --2- 172.21.15.152:0/4020818146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72fc0fe250 0x7f72fc0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.648+0000 7f73021dc700 1 --2- 172.21.15.152:0/4020818146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fd8f0 0x7f72fc0fdcd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.648+0000 7f73021dc700 1 -- 172.21.15.152:0/4020818146 >> 172.21.15.152:0/4020818146 conn(0x7f72fc0f34b0 msgr2=0x7f72fc0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.648+0000 7f73021dc700 1 -- 172.21.15.152:0/4020818146 shutdown_connections 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.648+0000 7f73021dc700 1 -- 172.21.15.152:0/4020818146 wait complete. 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.649+0000 7f73021dc700 1 Processor -- start 2024-04-06T12:32:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.649+0000 7f73021dc700 1 -- start start 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.649+0000 7f73021dc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72fc0fd8f0 0x7f72fc06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f73021dc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fe250 0x7f72fc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f73021dc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc06bab0 con 0x7f72fc0fe250 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f73021dc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc06bbf0 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72faffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fe250 0x7f72fc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72faffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fe250 0x7f72fc06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36358/0 (socket says 172.21.15.152:36358) 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72fb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72fc0fd8f0 0x7f72fc06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72faffd700 1 -- 172.21.15.152:0/3852795667 learned_addr learned my addr 172.21.15.152:0/3852795667 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72fb7fe700 1 -- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fe250 msgr2=0x7f72fc06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:48.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72fb7fe700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fe250 0x7f72fc06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72fb7fe700 1 -- 172.21.15.152:0/3852795667 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec0097c0 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72faffd700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fe250 0x7f72fc06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-06T12:32:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72fb7fe700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72fc0fd8f0 0x7f72fc06b0d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f72ec004750 tx=0x7f72ec004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72f8ff9700 1 -- 172.21.15.152:0/3852795667 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72ec00e030 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc06be40 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72f8ff9700 1 -- 172.21.15.152:0/3852795667 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f72ec007e90 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f72f8ff9700 1 -- 172.21.15.152:0/3852795667 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72ec018070 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.650+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc1146f0 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.652+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc05f590 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.652+0000 7f72f8ff9700 1 -- 172.21.15.152:0/3852795667 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f72ec01d420 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.653+0000 7f72f8ff9700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f72e806caa0 0x7f72e806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:48.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.653+0000 7f72f8ff9700 1 -- 172.21.15.152:0/3852795667 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f72ec08d3a0 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.653+0000 7f72faffd700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f72e806caa0 0x7f72e806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:48.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.653+0000 7f72faffd700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f72e806caa0 0x7f72e806ef60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f72fc06c870 tx=0x7f72e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:48.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.662+0000 7f72f8ff9700 1 -- 172.21.15.152:0/3852795667 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f72ec0573a0 con 0x7f72fc0fd8f0 2024-04-06T12:32:48.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.870+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f72fc06ca50 con 0x7f72e806caa0 2024-04-06T12:32:48.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.871+0000 7f72f8ff9700 1 -- 172.21.15.152:0/3852795667 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f72fc06ca50 con 0x7f72e806caa0 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f72e806caa0 msgr2=0x7f72e806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f72e806caa0 0x7f72e806ef60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f72fc06c870 tx=0x7f72e400b040).stop 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72fc0fd8f0 msgr2=0x7f72fc06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72fc0fd8f0 0x7f72fc06b0d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f72ec004750 tx=0x7f72ec004d10).stop 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 shutdown_connections 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f72e806caa0 0x7f72e806ef60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72fc0fd8f0 0x7f72fc06b0d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 --2- 172.21.15.152:0/3852795667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72fc0fe250 0x7f72fc06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 >> 172.21.15.152:0/3852795667 conn(0x7f72fc0f34b0 msgr2=0x7f72fc0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 shutdown_connections 2024-04-06T12:32:48.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.873+0000 7f73021dc700 1 -- 172.21.15.152:0/3852795667 wait complete. 2024-04-06T12:32:48.881 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:32:48.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.973+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/639190466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 msgr2=0x7fcd440fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:48.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.973+0000 7fcd4bbcd700 1 --2- 172.21.15.152:0/639190466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 0x7fcd440fcbd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fcd340047f0 tx=0x7fcd34009cb0).stop 2024-04-06T12:32:48.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.973+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/639190466 shutdown_connections 2024-04-06T12:32:48.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.973+0000 7fcd4bbcd700 1 --2- 172.21.15.152:0/639190466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd440fd150 0x7fcd440f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:32:48.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.973+0000 7fcd4bbcd700 1 --2- 172.21.15.152:0/639190466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 0x7fcd440fcbd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:48.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.973+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/639190466 >> 172.21.15.152:0/639190466 conn(0x7fcd44070590 msgr2=0x7fcd440f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:48.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.973+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/639190466 shutdown_connections 2024-04-06T12:32:48.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.973+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/639190466 wait complete. 2024-04-06T12:32:48.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd4bbcd700 1 Processor -- start 2024-04-06T12:32:48.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd4bbcd700 1 -- start start 2024-04-06T12:32:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd4bbcd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 0x7fcd44109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:48.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd4bbcd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd440fd150 0x7fcd44109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd4bbcd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44109bb0 con 0x7fcd440fc7f0 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd4bbcd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44109cf0 con 0x7fcd440fd150 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd49969700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 0x7fcd44109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd49969700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 0x7fcd44109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36374/0 (socket says 172.21.15.152:36374) 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd49969700 1 -- 172.21.15.152:0/1190594269 learned_addr learned my addr 172.21.15.152:0/1190594269 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd49168700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd440fd150 0x7fcd44109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd49969700 1 -- 172.21.15.152:0/1190594269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd440fd150 msgr2=0x7fcd44109630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd49969700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd440fd150 0x7fcd44109630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd49969700 1 -- 172.21.15.152:0/1190594269 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd34005040 con 0x7fcd440fc7f0 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.974+0000 7fcd49969700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 0x7fcd44109140 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fcd3400b120 tx=0x7fcd34009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.975+0000 7fcd3affd700 1 -- 172.21.15.152:0/1190594269 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3400e030 con 0x7fcd440fc7f0 2024-04-06T12:32:48.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.975+0000 7fcd3affd700 1 -- 172.21.15.152:0/1190594269 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd34007e90 con 0x7fcd440fc7f0 2024-04-06T12:32:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.975+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd44109f40 con 0x7fcd440fc7f0 2024-04-06T12:32:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.975+0000 7fcd3affd700 1 -- 172.21.15.152:0/1190594269 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd34018070 con 0x7fcd440fc7f0 2024-04-06T12:32:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.975+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd44112480 con 0x7fcd440fc7f0 2024-04-06T12:32:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.976+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4405f590 con 0x7fcd440fc7f0 2024-04-06T12:32:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.976+0000 7fcd3affd700 1 -- 172.21.15.152:0/1190594269 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fcd3401d420 con 0x7fcd440fc7f0 2024-04-06T12:32:48.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.976+0000 7fcd3affd700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcd3006caa0 0x7fcd3006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.976+0000 7fcd3affd700 1 -- 172.21.15.152:0/1190594269 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fcd3408d260 con 0x7fcd440fc7f0 2024-04-06T12:32:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.976+0000 7fcd49168700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcd3006caa0 0x7fcd3006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:48.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.977+0000 7fcd49168700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcd3006caa0 0x7fcd3006ef60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fcd44060f00 tx=0x7fcd40009060).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:48.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:48.981+0000 7fcd3affd700 1 -- 172.21.15.152:0/1190594269 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fcd34057260 con 0x7fcd440fc7f0 2024-04-06T12:32:49.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.192+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd44060d50 con 0x7fcd3006caa0 2024-04-06T12:32:49.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.193+0000 7fcd3affd700 1 -- 172.21.15.152:0/1190594269 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcd44060d50 con 0x7fcd3006caa0 2024-04-06T12:32:49.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcd3006caa0 msgr2=0x7fcd3006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcd3006caa0 0x7fcd3006ef60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fcd44060f00 tx=0x7fcd40009060).stop 2024-04-06T12:32:49.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 msgr2=0x7fcd44109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 0x7fcd44109140 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fcd3400b120 tx=0x7fcd34009cb0).stop 2024-04-06T12:32:49.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 shutdown_connections 2024-04-06T12:32:49.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcd3006caa0 0x7fcd3006ef60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd440fc7f0 0x7fcd44109140 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 --2- 172.21.15.152:0/1190594269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd440fd150 0x7fcd44109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 >> 172.21.15.152:0/1190594269 conn(0x7fcd44070590 msgr2=0x7fcd440fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:49.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 shutdown_connections 2024-04-06T12:32:49.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.195+0000 7fcd4bbcd700 1 -- 172.21.15.152:0/1190594269 wait complete. 2024-04-06T12:32:49.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.294+0000 7f9c8bf45700 1 -- 172.21.15.152:0/957908156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 msgr2=0x7f9c840f70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.294+0000 7f9c8bf45700 1 --2- 172.21.15.152:0/957908156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 0x7f9c840f70d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f9c800047f0 tx=0x7f9c80009cb0).stop 2024-04-06T12:32:49.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.294+0000 7f9c8bf45700 1 -- 172.21.15.152:0/957908156 shutdown_connections 2024-04-06T12:32:49.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.294+0000 7f9c8bf45700 1 --2- 172.21.15.152:0/957908156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 0x7f9c840f70d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.294+0000 7f9c8bf45700 1 --2- 172.21.15.152:0/957908156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c840fb8b0 0x7f9c840fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.294+0000 7f9c8bf45700 1 -- 172.21.15.152:0/957908156 >> 172.21.15.152:0/957908156 conn(0x7f9c8406cea0 msgr2=0x7f9c8406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:49.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.294+0000 7f9c8bf45700 1 -- 172.21.15.152:0/957908156 shutdown_connections 2024-04-06T12:32:49.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.294+0000 7f9c8bf45700 1 -- 172.21.15.152:0/957908156 wait complete. 2024-04-06T12:32:49.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c8bf45700 1 Processor -- start 2024-04-06T12:32:49.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c8bf45700 1 -- start start 2024-04-06T12:32:49.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c8bf45700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c840fb8b0 0x7f9c8410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:49.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c8bf45700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 0x7f9c8410d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:49.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c8bf45700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8410db60 con 0x7f9c840fc210 2024-04-06T12:32:49.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c8bf45700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8410dca0 con 0x7f9c840fb8b0 2024-04-06T12:32:49.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c894e0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 0x7f9c8410d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:49.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c89ce1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c840fb8b0 0x7f9c8410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:49.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c894e0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 0x7f9c8410d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36392/0 (socket says 172.21.15.152:36392) 2024-04-06T12:32:49.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.295+0000 7f9c894e0700 1 -- 172.21.15.152:0/2938624184 learned_addr learned my addr 172.21.15.152:0/2938624184 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c894e0700 1 -- 172.21.15.152:0/2938624184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c840fb8b0 msgr2=0x7f9c8410d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c894e0700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c840fb8b0 0x7f9c8410d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c894e0700 1 -- 172.21.15.152:0/2938624184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80005040 con 0x7f9c840fc210 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c89ce1700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c840fb8b0 0x7f9c8410d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c894e0700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 0x7f9c8410d560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f9c80000c00 tx=0x7f9c80009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c76ffd700 1 -- 172.21.15.152:0/2938624184 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c80018070 con 0x7f9c840fc210 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c841072d0 con 0x7f9c840fc210 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c76ffd700 1 -- 172.21.15.152:0/2938624184 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c80007e90 con 0x7f9c840fc210 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c76ffd700 1 -- 172.21.15.152:0/2938624184 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c8001de20 con 0x7f9c840fc210 2024-04-06T12:32:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.296+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c841077b0 con 0x7f9c840fc210 2024-04-06T12:32:49.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.297+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c84047540 con 0x7f9c840fc210 2024-04-06T12:32:49.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.297+0000 7f9c76ffd700 1 -- 172.21.15.152:0/2938624184 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9c8001d420 con 0x7f9c840fc210 2024-04-06T12:32:49.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.298+0000 7f9c76ffd700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c7006ca30 0x7f9c7006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:49.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.298+0000 7f9c76ffd700 1 -- 172.21.15.152:0/2938624184 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f9c8008c9b0 con 0x7f9c840fc210 2024-04-06T12:32:49.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.298+0000 7f9c89ce1700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c7006ca30 0x7f9c7006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:49.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.298+0000 7f9c89ce1700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c7006ca30 0x7f9c7006eef0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9c78011510 tx=0x7f9c7800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:49.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.302+0000 7f9c76ffd700 1 -- 172.21.15.152:0/2938624184 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f9c8005a440 con 0x7f9c840fc210 2024-04-06T12:32:49.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.500+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c840feba0 con 0x7f9c7006ca30 2024-04-06T12:32:49.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.509+0000 7f9c76ffd700 1 -- 172.21.15.152:0/2938624184 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9c840feba0 con 0x7f9c7006ca30 2024-04-06T12:32:49.507 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:32:49.507 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (6m) 18s ago 18m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:32:49.507 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (4m) 18s ago 17m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:32:49.507 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (4m) 58s ago 17m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:32:49.507 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (6m) 18s ago 17m 93.9M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:32:49.507 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (22s) 18s ago 12m 14.6M - 18.2.2-1086-g052adcad 87261d5ece5a f51d76bed558 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (41s) 18s ago 12m 14.7M - 18.2.2-1086-g052adcad 87261d5ece5a 90254d845be3 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 starting - - - - 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (12m) 58s ago 12m 16.4M - 16.2.15-1-g8963e9de 727f386679cb 057a504b8abc 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (8m) 18s ago 19m 504M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (7m) 58s ago 17m 450M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (5m) 18s ago 19m 59.0M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (4m) 58s ago 17m 40.7M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (7m) 18s ago 17m 17.2M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 58s ago 17m 17.5M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (3m) 18s ago 16m 99.3M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (3m) 18s ago 16m 103M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 4e01281def3c 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (2m) 18s ago 15m 104M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 36456f3aa1eb 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (2m) 58s ago 15m 121M 2251M 18.2.2-1086-g052adcad 87261d5ece5a b41c5ddebdba 2024-04-06T12:32:49.508 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (95s) 58s ago 14m 82.9M 2251M 18.2.2-1086-g052adcad 87261d5ece5a 887060bd04bc 2024-04-06T12:32:49.509 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (62s) 58s ago 14m 11.4M 2251M 18.2.2-1086-g052adcad 87261d5ece5a f0ce150c2bbd 2024-04-06T12:32:49.509 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (6m) 58s ago 16m 60.0M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:32:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.511+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c7006ca30 msgr2=0x7f9c7006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.511+0000 7f9c8bf45700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c7006ca30 0x7f9c7006eef0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9c78011510 tx=0x7f9c7800b040).stop 2024-04-06T12:32:49.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.511+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 msgr2=0x7f9c8410d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.511+0000 7f9c8bf45700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 0x7f9c8410d560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f9c80000c00 tx=0x7f9c80009cb0).stop 2024-04-06T12:32:49.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.511+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 shutdown_connections 2024-04-06T12:32:49.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.511+0000 7f9c8bf45700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f9c7006ca30 0x7f9c7006eef0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.511+0000 7f9c8bf45700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c840fb8b0 0x7f9c8410d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.511+0000 7f9c8bf45700 1 --2- 172.21.15.152:0/2938624184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c840fc210 0x7f9c8410d560 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.511+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 >> 172.21.15.152:0/2938624184 conn(0x7f9c8406cea0 msgr2=0x7f9c840fad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:49.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.512+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 shutdown_connections 2024-04-06T12:32:49.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.512+0000 7f9c8bf45700 1 -- 172.21.15.152:0/2938624184 wait complete. 2024-04-06T12:32:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.609+0000 7f18780d9700 1 -- 172.21.15.152:0/2163087707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f8900 msgr2=0x7f18700f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.609+0000 7f18780d9700 1 --2- 172.21.15.152:0/2163087707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f8900 0x7f18700f8ce0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f18600047f0 tx=0x7f1860009cb0).stop 2024-04-06T12:32:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.609+0000 7f18780d9700 1 -- 172.21.15.152:0/2163087707 shutdown_connections 2024-04-06T12:32:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.609+0000 7f18780d9700 1 --2- 172.21.15.152:0/2163087707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18700f9260 0x7f1870101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.609+0000 7f18780d9700 1 --2- 172.21.15.152:0/2163087707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f8900 0x7f18700f8ce0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.609+0000 7f18780d9700 1 -- 172.21.15.152:0/2163087707 >> 172.21.15.152:0/2163087707 conn(0x7f1870070590 msgr2=0x7f18700f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.609+0000 7f18780d9700 1 -- 172.21.15.152:0/2163087707 shutdown_connections 2024-04-06T12:32:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.609+0000 7f18780d9700 1 -- 172.21.15.152:0/2163087707 wait complete. 2024-04-06T12:32:49.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f18780d9700 1 Processor -- start 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f18780d9700 1 -- start start 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f18780d9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18700f8900 0x7f187010e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f18780d9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f9260 0x7f187010e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f18780d9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187010eb30 con 0x7f18700f9260 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f18780d9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187010ec70 con 0x7f18700f8900 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f1875674700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f9260 0x7f187010e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f1875674700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f9260 0x7f187010e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36406/0 (socket says 172.21.15.152:36406) 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f1875674700 1 -- 172.21.15.152:0/1014024784 learned_addr learned my addr 172.21.15.152:0/1014024784 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f1875e75700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18700f8900 0x7f187010e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f1875674700 1 -- 172.21.15.152:0/1014024784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18700f8900 msgr2=0x7f187010e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f1875674700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18700f8900 0x7f187010e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f1875674700 1 -- 172.21.15.152:0/1014024784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1860005040 con 0x7f18700f9260 2024-04-06T12:32:49.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.610+0000 7f1875674700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f9260 0x7f187010e530 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f186c0041d0 tx=0x7f186c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:49.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.611+0000 7f1866ffd700 1 -- 172.21.15.152:0/1014024784 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f186c002d90 con 0x7f18700f9260 2024-04-06T12:32:49.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.611+0000 7f1866ffd700 1 -- 172.21.15.152:0/1014024784 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f186c00f040 con 0x7f18700f9260 2024-04-06T12:32:49.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.611+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1870108300 con 0x7f18700f9260 2024-04-06T12:32:49.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.611+0000 7f1866ffd700 1 -- 172.21.15.152:0/1014024784 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f186c00d800 con 0x7f18700f9260 2024-04-06T12:32:49.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.611+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1870108840 con 0x7f18700f9260 2024-04-06T12:32:49.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.611+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187005f590 con 0x7f18700f9260 2024-04-06T12:32:49.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.612+0000 7f1866ffd700 1 -- 172.21.15.152:0/1014024784 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f186c00dae0 con 0x7f18700f9260 2024-04-06T12:32:49.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.612+0000 7f1866ffd700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f185c06caa0 0x7f185c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:49.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.612+0000 7f1866ffd700 1 -- 172.21.15.152:0/1014024784 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f186c08bea0 con 0x7f18700f9260 2024-04-06T12:32:49.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.613+0000 7f1875e75700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f185c06caa0 0x7f185c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:49.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.613+0000 7f1875e75700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f185c06caa0 0x7f185c06ef60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f18600047c0 tx=0x7f186000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:49.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.617+0000 7f1866ffd700 1 -- 172.21.15.152:0/1014024784 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f186c059930 con 0x7f18700f9260 2024-04-06T12:32:49.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.886+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1870047540 con 0x7f18700f9260 2024-04-06T12:32:49.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.886+0000 7f1866ffd700 1 -- 172.21.15.152:0/1014024784 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f186c0594c0 con 0x7f18700f9260 2024-04-06T12:32:49.884 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:32:49.884 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:32:49.884 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:32:49.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 6 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 3 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 13 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:32:49.885 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:32:49.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.888+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f185c06caa0 msgr2=0x7f185c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.888+0000 7f18780d9700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f185c06caa0 0x7f185c06ef60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f18600047c0 tx=0x7f186000b040).stop 2024-04-06T12:32:49.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.888+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f9260 msgr2=0x7f187010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.888+0000 7f18780d9700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f9260 0x7f187010e530 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f186c0041d0 tx=0x7f186c009f60).stop 2024-04-06T12:32:49.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.889+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 shutdown_connections 2024-04-06T12:32:49.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.889+0000 7f18780d9700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f185c06caa0 0x7f185c06ef60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.889+0000 7f18780d9700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18700f8900 0x7f187010e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.889+0000 7f18780d9700 1 --2- 172.21.15.152:0/1014024784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18700f9260 0x7f187010e530 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.889+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 >> 172.21.15.152:0/1014024784 conn(0x7f1870070590 msgr2=0x7f18700fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:49.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.889+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 shutdown_connections 2024-04-06T12:32:49.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.889+0000 7f18780d9700 1 -- 172.21.15.152:0/1014024784 wait complete. 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.987+0000 7f81b785d700 1 -- 172.21.15.152:0/1057767399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 msgr2=0x7f81b00fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.987+0000 7f81b785d700 1 --2- 172.21.15.152:0/1057767399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 0x7f81b00fdcd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f81a40047f0 tx=0x7f81a4009cb0).stop 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.987+0000 7f81b785d700 1 -- 172.21.15.152:0/1057767399 shutdown_connections 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.987+0000 7f81b785d700 1 --2- 172.21.15.152:0/1057767399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81b00fe250 0x7f81b00f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.987+0000 7f81b785d700 1 --2- 172.21.15.152:0/1057767399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 0x7f81b00fdcd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.987+0000 7f81b785d700 1 -- 172.21.15.152:0/1057767399 >> 172.21.15.152:0/1057767399 conn(0x7f81b00f34b0 msgr2=0x7f81b00f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.987+0000 7f81b785d700 1 -- 172.21.15.152:0/1057767399 shutdown_connections 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.987+0000 7f81b785d700 1 -- 172.21.15.152:0/1057767399 wait complete. 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b785d700 1 Processor -- start 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b785d700 1 -- start start 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b785d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 0x7f81b010e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:49.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b785d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81b00fe250 0x7f81b010e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b785d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b010eb00 con 0x7f81b00fd8f0 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b785d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b010ec40 con 0x7f81b00fe250 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b55f9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 0x7f81b010e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b55f9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 0x7f81b010e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36432/0 (socket says 172.21.15.152:36432) 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b55f9700 1 -- 172.21.15.152:0/3851044431 learned_addr learned my addr 172.21.15.152:0/3851044431 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.988+0000 7f81b4df8700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81b00fe250 0x7f81b010e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.989+0000 7f81b55f9700 1 -- 172.21.15.152:0/3851044431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81b00fe250 msgr2=0x7f81b010e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.989+0000 7f81b55f9700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81b00fe250 0x7f81b010e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.989+0000 7f81b55f9700 1 -- 172.21.15.152:0/3851044431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4005040 con 0x7f81b00fd8f0 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.989+0000 7f81b55f9700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 0x7f81b010e010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f81a4005010 tx=0x7f81a4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.989+0000 7f81a27fc700 1 -- 172.21.15.152:0/3851044431 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a400e030 con 0x7f81b00fd8f0 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.989+0000 7f81a27fc700 1 -- 172.21.15.152:0/3851044431 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81a4007e90 con 0x7f81b00fd8f0 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.989+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b0108270 con 0x7f81b00fd8f0 2024-04-06T12:32:49.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.989+0000 7f81a27fc700 1 -- 172.21.15.152:0/3851044431 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a4018070 con 0x7f81b00fd8f0 2024-04-06T12:32:49.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.989+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b01087d0 con 0x7f81b00fd8f0 2024-04-06T12:32:49.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.990+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b005fdb0 con 0x7f81b00fd8f0 2024-04-06T12:32:49.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.990+0000 7f81a27fc700 1 -- 172.21.15.152:0/3851044431 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f81a401d670 con 0x7f81b00fd8f0 2024-04-06T12:32:49.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.991+0000 7f81a27fc700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819c06caa0 0x7f819c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:49.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.991+0000 7f81a27fc700 1 -- 172.21.15.152:0/3851044431 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6426+0+0 (secure 0 0 0) 0x7f81a408d020 con 0x7f81b00fd8f0 2024-04-06T12:32:49.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.991+0000 7f81b4df8700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819c06caa0 0x7f819c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:49.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.991+0000 7f81b4df8700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819c06caa0 0x7f819c06ef60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f81b0109950 tx=0x7f81ac00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:49.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:49.995+0000 7f81a27fc700 1 -- 172.21.15.152:0/3851044431 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f81a405aab0 con 0x7f81b00fd8f0 2024-04-06T12:32:50.025 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: from='client.44329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: pgmap v201: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-04-06T12:32:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.195:6824/2930845511,v1:172.21.15.195:6825/2930845511] up:boot 2024-04-06T12:32:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] up:reconnect 2024-04-06T12:32:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi195.ttgcpp=up:reconnect} 3 up:standby 2024-04-06T12:32:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:32:50.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:49 smithi152 ceph-mon[104634]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:50.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:50.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:50.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: from='client.44329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: pgmap v201: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-04-06T12:32:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.195:6824/2930845511,v1:172.21.15.195:6825/2930845511] up:boot 2024-04-06T12:32:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] up:reconnect 2024-04-06T12:32:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi195.ttgcpp=up:reconnect} 3 up:standby 2024-04-06T12:32:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:32:50.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:49 smithi195 ceph-mon[85980]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:50.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.232+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f81b00ffc40 con 0x7f81b00fd8f0 2024-04-06T12:32:50.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.232+0000 7f81a27fc700 1 -- 172.21.15.152:0/3851044431 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f81a405a640 con 0x7f81b00fd8f0 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:e25 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 25 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:32:50.230 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:32:50.154920+0000 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 91 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=24289} 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:32:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{0:24289} state up:rejoin seq 192 join_fscid=1 addr [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{-1:34414} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/367125625,v1:172.21.15.152:6829/367125625] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:32:50.232 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/2930845511,v1:172.21.15.195:6825/2930845511] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:32:50.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819c06caa0 msgr2=0x7f819c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819c06caa0 0x7f819c06ef60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f81b0109950 tx=0x7f81ac00b040).stop 2024-04-06T12:32:50.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 msgr2=0x7f81b010e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 0x7f81b010e010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f81a4005010 tx=0x7f81a4009cb0).stop 2024-04-06T12:32:50.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 shutdown_connections 2024-04-06T12:32:50.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f819c06caa0 0x7f819c06ef60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b00fd8f0 0x7f81b010e010 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 --2- 172.21.15.152:0/3851044431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81b00fe250 0x7f81b010e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 >> 172.21.15.152:0/3851044431 conn(0x7f81b00f34b0 msgr2=0x7f81b00fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:50.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 shutdown_connections 2024-04-06T12:32:50.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.234+0000 7f81b785d700 1 -- 172.21.15.152:0/3851044431 wait complete. 2024-04-06T12:32:50.235 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 25 2024-04-06T12:32:50.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.334+0000 7ff9cd35d700 1 -- 172.21.15.152:0/302703989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fd150 msgr2=0x7ff9c80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.334+0000 7ff9cd35d700 1 --2- 172.21.15.152:0/302703989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fd150 0x7ff9c80f6930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ff9bc0047f0 tx=0x7ff9bc009cb0).stop 2024-04-06T12:32:50.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.334+0000 7ff9cd35d700 1 -- 172.21.15.152:0/302703989 shutdown_connections 2024-04-06T12:32:50.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.334+0000 7ff9cd35d700 1 --2- 172.21.15.152:0/302703989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fd150 0x7ff9c80f6930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.334+0000 7ff9cd35d700 1 --2- 172.21.15.152:0/302703989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c80fc7f0 0x7ff9c80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.334+0000 7ff9cd35d700 1 -- 172.21.15.152:0/302703989 >> 172.21.15.152:0/302703989 conn(0x7ff9c80f23b0 msgr2=0x7ff9c80f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:50.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.334+0000 7ff9cd35d700 1 -- 172.21.15.152:0/302703989 shutdown_connections 2024-04-06T12:32:50.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.334+0000 7ff9cd35d700 1 -- 172.21.15.152:0/302703989 wait complete. 2024-04-06T12:32:50.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.335+0000 7ff9cd35d700 1 Processor -- start 2024-04-06T12:32:50.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.335+0000 7ff9cd35d700 1 -- start start 2024-04-06T12:32:50.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9cd35d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fc7f0 0x7ff9c810cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:50.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9cd35d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c80fd150 0x7ff9c810d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:50.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9cd35d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c810da60 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9cd35d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c810dba0 con 0x7ff9c80fd150 2024-04-06T12:32:50.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9c6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fc7f0 0x7ff9c810cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:50.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9c6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fc7f0 0x7ff9c810cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36450/0 (socket says 172.21.15.152:36450) 2024-04-06T12:32:50.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9c6ffd700 1 -- 172.21.15.152:0/3397348286 learned_addr learned my addr 172.21.15.152:0/3397348286 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9c67fc700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c80fd150 0x7ff9c810d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9c6ffd700 1 -- 172.21.15.152:0/3397348286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c80fd150 msgr2=0x7ff9c810d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9c6ffd700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c80fd150 0x7ff9c810d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9c6ffd700 1 -- 172.21.15.152:0/3397348286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc005040 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9c67fc700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c80fd150 0x7ff9c810d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9c6ffd700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fc7f0 0x7ff9c810cf70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7ff9b800c740 tx=0x7ff9b8007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9affff700 1 -- 172.21.15.152:0/3397348286 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b800e680 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9affff700 1 -- 172.21.15.152:0/3397348286 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9b800ec90 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c8107230 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9affff700 1 -- 172.21.15.152:0/3397348286 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b8013d60 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.336+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c8107770 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.337+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c8060370 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.338+0000 7ff9affff700 1 -- 172.21.15.152:0/3397348286 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff9b800e7e0 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.338+0000 7ff9affff700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff9b006caa0 0x7ff9b006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:50.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.338+0000 7ff9affff700 1 -- 172.21.15.152:0/3397348286 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6426+0+0 (secure 0 0 0) 0x7ff9b808c120 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.338+0000 7ff9c67fc700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff9b006caa0 0x7ff9b006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:50.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.339+0000 7ff9c67fc700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff9b006caa0 0x7ff9b006ef60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff9bc004f10 tx=0x7ff9bc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.343+0000 7ff9affff700 1 -- 172.21.15.152:0/3397348286 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7ff9b8059bb0 con 0x7ff9c80fc7f0 2024-04-06T12:32:50.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.550+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9c8108700 con 0x7ff9b006caa0 2024-04-06T12:32:50.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.551+0000 7ff9affff700 1 -- 172.21.15.152:0/3397348286 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff9c8108700 con 0x7ff9b006caa0 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:45cbf7e6d38f79ab874661480485370918610a7e9a2761c03c5b2e736405702e", 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: "osd", 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr", 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: "crash" 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2024-04-06T12:32:50.549 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "14/21 daemons upgraded", 2024-04-06T12:32:50.550 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading mds daemons", 2024-04-06T12:32:50.550 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:32:50.550 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:32:50.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff9b006caa0 msgr2=0x7ff9b006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff9b006caa0 0x7ff9b006ef60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff9bc004f10 tx=0x7ff9bc00b040).stop 2024-04-06T12:32:50.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fc7f0 msgr2=0x7ff9c810cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fc7f0 0x7ff9c810cf70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7ff9b800c740 tx=0x7ff9b8007ef0).stop 2024-04-06T12:32:50.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 shutdown_connections 2024-04-06T12:32:50.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff9b006caa0 0x7ff9b006ef60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9c80fc7f0 0x7ff9c810cf70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 --2- 172.21.15.152:0/3397348286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c80fd150 0x7ff9c810d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 >> 172.21.15.152:0/3397348286 conn(0x7ff9c80f23b0 msgr2=0x7ff9c80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:50.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 shutdown_connections 2024-04-06T12:32:50.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.553+0000 7ff9cd35d700 1 -- 172.21.15.152:0/3397348286 wait complete. 2024-04-06T12:32:50.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 -- 172.21.15.152:0/2204145949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fd180 msgr2=0x7fd6640f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 --2- 172.21.15.152:0/2204145949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fd180 0x7fd6640f6960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fd6540047f0 tx=0x7fd654009cb0).stop 2024-04-06T12:32:50.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 -- 172.21.15.152:0/2204145949 shutdown_connections 2024-04-06T12:32:50.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 --2- 172.21.15.152:0/2204145949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fd180 0x7fd6640f6960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 --2- 172.21.15.152:0/2204145949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6640fc820 0x7fd6640fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 -- 172.21.15.152:0/2204145949 >> 172.21.15.152:0/2204145949 conn(0x7fd6640f2400 msgr2=0x7fd6640f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:50.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 -- 172.21.15.152:0/2204145949 shutdown_connections 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 -- 172.21.15.152:0/2204145949 wait complete. 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 Processor -- start 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.653+0000 7fd66b6d0700 1 -- start start 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66b6d0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fc820 0x7fd664109290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66b6d0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6640fd180 0x7fd664109780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66b6d0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd664109c70 con 0x7fd6640fc820 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66b6d0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd664109db0 con 0x7fd6640fd180 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66946c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fc820 0x7fd664109290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66946c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fc820 0x7fd664109290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36466/0 (socket says 172.21.15.152:36466) 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66946c700 1 -- 172.21.15.152:0/4127693354 learned_addr learned my addr 172.21.15.152:0/4127693354 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:32:50.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd668c6b700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6640fd180 0x7fd664109780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:50.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66946c700 1 -- 172.21.15.152:0/4127693354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6640fd180 msgr2=0x7fd664109780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66946c700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6640fd180 0x7fd664109780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66946c700 1 -- 172.21.15.152:0/4127693354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654005040 con 0x7fd6640fc820 2024-04-06T12:32:50.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66946c700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fc820 0x7fd664109290 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fd66000e8f0 tx=0x7fd66000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:50.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd65a7fc700 1 -- 172.21.15.152:0/4127693354 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd660007b40 con 0x7fd6640fc820 2024-04-06T12:32:50.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd65a7fc700 1 -- 172.21.15.152:0/4127693354 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd66000f040 con 0x7fd6640fc820 2024-04-06T12:32:50.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66410a060 con 0x7fd6640fc820 2024-04-06T12:32:50.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd65a7fc700 1 -- 172.21.15.152:0/4127693354 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd660014880 con 0x7fd6640fc820 2024-04-06T12:32:50.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.654+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd664112600 con 0x7fd6640fc820 2024-04-06T12:32:50.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.655+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66405f510 con 0x7fd6640fc820 2024-04-06T12:32:50.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.656+0000 7fd65a7fc700 1 -- 172.21.15.152:0/4127693354 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd660014b00 con 0x7fd6640fc820 2024-04-06T12:32:50.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.656+0000 7fd65a7fc700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd65006caa0 0x7fd65006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:32:50.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.656+0000 7fd65a7fc700 1 -- 172.21.15.152:0/4127693354 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6426+0+0 (secure 0 0 0) 0x7fd66008bab0 con 0x7fd6640fc820 2024-04-06T12:32:50.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.656+0000 7fd668c6b700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd65006caa0 0x7fd65006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:32:50.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.656+0000 7fd668c6b700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd65006caa0 0x7fd65006ef60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd664060f60 tx=0x7fd654009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:32:50.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.660+0000 7fd65a7fc700 1 -- 172.21.15.152:0/4127693354 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fd660055ab0 con 0x7fd6640fc820 2024-04-06T12:32:50.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.924+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd6640febb0 con 0x7fd6640fc820 2024-04-06T12:32:50.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.925+0000 7fd65a7fc700 1 -- 172.21.15.152:0/4127693354 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7fd6600590d0 con 0x7fd6640fc820 2024-04-06T12:32:50.923 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-04-06T12:32:50.923 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-06T12:32:50.923 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs is degraded 2024-04-06T12:32:50.923 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:32:50.923 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd65006caa0 msgr2=0x7fd65006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd65006caa0 0x7fd65006ef60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd664060f60 tx=0x7fd654009cb0).stop 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fc820 msgr2=0x7fd664109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fc820 0x7fd664109290 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fd66000e8f0 tx=0x7fd66000b040).stop 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 shutdown_connections 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd65006caa0 0x7fd65006ef60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640fc820 0x7fd664109290 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 --2- 172.21.15.152:0/4127693354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6640fd180 0x7fd664109780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 >> 172.21.15.152:0/4127693354 conn(0x7fd6640f2400 msgr2=0x7fd6640fabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 shutdown_connections 2024-04-06T12:32:50.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:32:50.927+0000 7fd66b6d0700 1 -- 172.21.15.152:0/4127693354 wait complete. 2024-04-06T12:32:51.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:50 smithi152 ceph-mon[104634]: reconnect by client.24333 192.168.0.1:0/2299992592 after 0.000999981 2024-04-06T12:32:51.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:50 smithi152 ceph-mon[104634]: reconnect by client.14496 192.168.0.1:0/1847732670 after 0.000999981 2024-04-06T12:32:51.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:50 smithi152 ceph-mon[104634]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:51.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:50 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1014024784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:51.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:50 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] up:rejoin 2024-04-06T12:32:51.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:50 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi195.ttgcpp=up:rejoin} 3 up:standby 2024-04-06T12:32:51.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:50 smithi152 ceph-mon[104634]: daemon mds.cephfs.smithi195.ttgcpp is now active in filesystem cephfs as rank 0 2024-04-06T12:32:51.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:50 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3851044431' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:32:51.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:50 smithi195 ceph-mon[85980]: reconnect by client.24333 192.168.0.1:0/2299992592 after 0.000999981 2024-04-06T12:32:51.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:50 smithi195 ceph-mon[85980]: reconnect by client.14496 192.168.0.1:0/1847732670 after 0.000999981 2024-04-06T12:32:51.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:50 smithi195 ceph-mon[85980]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:51.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:50 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1014024784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:51.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:50 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] up:rejoin 2024-04-06T12:32:51.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:50 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi195.ttgcpp=up:rejoin} 3 up:standby 2024-04-06T12:32:51.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:50 smithi195 ceph-mon[85980]: daemon mds.cephfs.smithi195.ttgcpp is now active in filesystem cephfs as rank 0 2024-04-06T12:32:51.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:50 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3851044431' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:32:52.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:51 smithi152 ceph-mon[104634]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:52.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:51 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/4127693354' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:32:52.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:51 smithi152 ceph-mon[104634]: pgmap v202: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-06T12:32:52.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:51 smithi152 ceph-mon[104634]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-06T12:32:52.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:51 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] up:active 2024-04-06T12:32:52.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:51 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi195.ttgcpp=up:active} 3 up:standby 2024-04-06T12:32:52.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:51 smithi195 ceph-mon[85980]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:32:52.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:51 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/4127693354' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:32:52.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:51 smithi195 ceph-mon[85980]: pgmap v202: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-06T12:32:52.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:51 smithi195 ceph-mon[85980]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-06T12:32:52.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:51 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.195:6826/3193759698,v1:172.21.15.195:6827/3193759698] up:active 2024-04-06T12:32:52.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:51 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi195.ttgcpp=up:active} 3 up:standby 2024-04-06T12:32:53.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:32:53.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:53.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:53.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:53.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:53.297 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:32:53.297 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:53.297 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:53.297 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:53.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:54.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:53 smithi152 ceph-mon[104634]: pgmap v203: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 7 op/s 2024-04-06T12:32:54.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:53 smithi195 ceph-mon[85980]: pgmap v203: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 7 op/s 2024-04-06T12:32:56.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:56 smithi195 ceph-mon[85980]: pgmap v204: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-04-06T12:32:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:56 smithi152 ceph-mon[104634]: pgmap v204: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-04-06T12:32:57.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:57.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:57 smithi152 ceph-mon[104634]: pgmap v205: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-06T12:32:57.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:57.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:57.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:57.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:32:57.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:57.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:32:57.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:57.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:57.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:57.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:32:57.799 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:57 smithi195 ceph-mon[85980]: pgmap v205: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-06T12:32:59.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:59 smithi152 ceph-mon[104634]: Upgrade: Updating mds.cephfs.smithi195.ttgcpp 2024-04-06T12:32:59.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:59 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:59.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:59 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.ttgcpp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:32:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:59 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:59.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:32:59 smithi152 ceph-mon[104634]: Deploying daemon mds.cephfs.smithi195.ttgcpp on smithi195 2024-04-06T12:32:59.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:59 smithi195 ceph-mon[85980]: Upgrade: Updating mds.cephfs.smithi195.ttgcpp 2024-04-06T12:32:59.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:59 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:32:59.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:59 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.ttgcpp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-06T12:32:59.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:59 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:32:59.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:32:59 smithi195 ceph-mon[85980]: Deploying daemon mds.cephfs.smithi195.ttgcpp on smithi195 2024-04-06T12:33:00.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:00 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[104611]: 2024-04-06T12:33:00.179+0000 7f56deaae700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:33:00.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:00 smithi152 ceph-mon[104634]: pgmap v206: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-06T12:33:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:00 smithi152 ceph-mon[104634]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-06T12:33:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:00 smithi152 ceph-mon[104634]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:33:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:00 smithi152 ceph-mon[104634]: osdmap e92: 6 total, 6 up, 6 in 2024-04-06T12:33:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:00 smithi152 ceph-mon[104634]: Standby daemon mds.cephfs.smithi152.spbxnv assigned to filesystem cephfs as rank 0 2024-04-06T12:33:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:00 smithi152 ceph-mon[104634]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-06T12:33:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:00 smithi152 ceph-mon[104634]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-06T12:33:00.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:00 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi152.spbxnv=up:replay} 2 up:standby 2024-04-06T12:33:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:00 smithi195 ceph-mon[85980]: pgmap v206: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-06T12:33:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:00 smithi195 ceph-mon[85980]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-06T12:33:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:00 smithi195 ceph-mon[85980]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-06T12:33:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:00 smithi195 ceph-mon[85980]: osdmap e92: 6 total, 6 up, 6 in 2024-04-06T12:33:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:00 smithi195 ceph-mon[85980]: Standby daemon mds.cephfs.smithi152.spbxnv assigned to filesystem cephfs as rank 0 2024-04-06T12:33:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:00 smithi195 ceph-mon[85980]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-06T12:33:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:00 smithi195 ceph-mon[85980]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-06T12:33:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:00 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi152.spbxnv=up:replay} 2 up:standby 2024-04-06T12:33:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:02 smithi152 ceph-mon[104634]: pgmap v208: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-04-06T12:33:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:02 smithi195 ceph-mon[85980]: pgmap v208: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-04-06T12:33:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:04 smithi152 ceph-mon[104634]: pgmap v209: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 5.1 KiB/s wr, 7 op/s 2024-04-06T12:33:04.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:04 smithi195 ceph-mon[85980]: pgmap v209: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 5.1 KiB/s wr, 7 op/s 2024-04-06T12:33:06.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:06 smithi152 ceph-mon[104634]: pgmap v210: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-04-06T12:33:06.537 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:06 smithi195 ceph-mon[85980]: pgmap v210: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-04-06T12:33:08.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:08.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:33:08.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:08 smithi152 ceph-mon[104634]: pgmap v211: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-04-06T12:33:08.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:08.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:08.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:08 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:33:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:33:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:08 smithi195 ceph-mon[85980]: pgmap v211: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-04-06T12:33:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:08.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:08 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:33:09.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:09 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.195:6826/1415350806,v1:172.21.15.195:6827/1415350806] up:boot 2024-04-06T12:33:09.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:09 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi152.spbxnv=up:replay} 3 up:standby 2024-04-06T12:33:09.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:09 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:33:09.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:09 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.195:6826/1415350806,v1:172.21.15.195:6827/1415350806] up:boot 2024-04-06T12:33:09.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:09 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi152.spbxnv=up:replay} 3 up:standby 2024-04-06T12:33:09.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:09 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:33:10.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:10 smithi152 ceph-mon[104634]: pgmap v212: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 0 B/s wr, 7 op/s 2024-04-06T12:33:10.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:10 smithi195 ceph-mon[85980]: pgmap v212: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 0 B/s wr, 7 op/s 2024-04-06T12:33:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:11 smithi152 ceph-mon[104634]: reconnect by client.14496 192.168.0.1:0/1847732670 after 0 2024-04-06T12:33:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:11 smithi152 ceph-mon[104634]: reconnect by client.24333 192.168.0.1:0/2299992592 after 0.000999988 2024-04-06T12:33:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:11 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] up:reconnect 2024-04-06T12:33:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:11 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi152.spbxnv=up:reconnect} 3 up:standby 2024-04-06T12:33:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:11 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:11 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:11.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:11 smithi195 ceph-mon[85980]: reconnect by client.14496 192.168.0.1:0/1847732670 after 0 2024-04-06T12:33:11.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:11 smithi195 ceph-mon[85980]: reconnect by client.24333 192.168.0.1:0/2299992592 after 0.000999988 2024-04-06T12:33:11.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:11 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] up:reconnect 2024-04-06T12:33:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:11 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi152.spbxnv=up:reconnect} 3 up:standby 2024-04-06T12:33:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:11 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:11.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:11 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:12.338 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:12 smithi195 ceph-mon[85980]: pgmap v213: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 0 B/s wr, 7 op/s 2024-04-06T12:33:12.338 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:12 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] up:rejoin 2024-04-06T12:33:12.338 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:12 smithi195 ceph-mon[85980]: fsmap cephfs:1/1 {0=cephfs.smithi152.spbxnv=up:rejoin} 3 up:standby 2024-04-06T12:33:12.338 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:12 smithi195 ceph-mon[85980]: daemon mds.cephfs.smithi152.spbxnv is now active in filesystem cephfs as rank 0 2024-04-06T12:33:12.338 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:12 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:12.338 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:12 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:12.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:12 smithi152 ceph-mon[104634]: pgmap v213: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 0 B/s wr, 7 op/s 2024-04-06T12:33:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:12 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] up:rejoin 2024-04-06T12:33:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:12 smithi152 ceph-mon[104634]: fsmap cephfs:1/1 {0=cephfs.smithi152.spbxnv=up:rejoin} 3 up:standby 2024-04-06T12:33:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:12 smithi152 ceph-mon[104634]: daemon mds.cephfs.smithi152.spbxnv is now active in filesystem cephfs as rank 0 2024-04-06T12:33:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:12 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:12.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:12 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:13.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:13 smithi195 ceph-mon[85980]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-06T12:33:13.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:13 smithi195 ceph-mon[85980]: mds.? [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] up:active 2024-04-06T12:33:13.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:13 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 3 up:standby 2024-04-06T12:33:13.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:13 smithi152 ceph-mon[104634]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-06T12:33:13.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:13 smithi152 ceph-mon[104634]: mds.? [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] up:active 2024-04-06T12:33:13.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:13 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 3 up:standby 2024-04-06T12:33:14.459 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:14 smithi195 ceph-mon[85980]: pgmap v214: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 8 op/s 2024-04-06T12:33:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:14 smithi152 ceph-mon[104634]: pgmap v214: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 8 op/s 2024-04-06T12:33:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:33:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:33:16.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: pgmap v215: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all mds 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.mxtfph"}]': finished 2024-04-06T12:33:16.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:33:16.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.spbxnv"}]': finished 2024-04-06T12:33:16.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:33:16.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.akamqf"}]': finished 2024-04-06T12:33:16.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:33:16.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.ttgcpp"}]': finished 2024-04-06T12:33:16.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: Upgrade: Setting filesystem cephfs Joinable 2024-04-06T12:33:16.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:16 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-06T12:33:16.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: pgmap v215: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all mds 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.mxtfph"}]: dispatch 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.mxtfph"}]': finished 2024-04-06T12:33:16.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.spbxnv"}]: dispatch 2024-04-06T12:33:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.spbxnv"}]': finished 2024-04-06T12:33:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.akamqf"}]: dispatch 2024-04-06T12:33:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.akamqf"}]': finished 2024-04-06T12:33:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.ttgcpp"}]: dispatch 2024-04-06T12:33:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.ttgcpp"}]': finished 2024-04-06T12:33:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: Upgrade: Setting filesystem cephfs Joinable 2024-04-06T12:33:16.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:16 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-06T12:33:17.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:17 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-06T12:33:17.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:17 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 3 up:standby 2024-04-06T12:33:17.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:17 smithi152 ceph-mon[104634]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-06T12:33:17.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:17 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-06T12:33:17.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:17 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-06T12:33:17.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:17 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 3 up:standby 2024-04-06T12:33:17.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:17 smithi195 ceph-mon[85980]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-06T12:33:17.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:17 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-06T12:33:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: pgmap v216: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-06T12:33:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-06T12:33:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 3 up:standby 2024-04-06T12:33:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:33:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all rgw 2024-04-06T12:33:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all rbd-mirror 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all ceph-exporter 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-06T12:33:18.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-06T12:33:18.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:33:18.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:33:18.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:33:18.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: pgmap v216: 65 pgs: 65 active+clean; 259 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 3 up:standby 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: fsmap cephfs:1 {0=cephfs.smithi152.spbxnv=up:active} 1 up:standby-replay 2 up:standby 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all rgw 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all rbd-mirror 2024-04-06T12:33:18.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all ceph-exporter 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.550 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-06T12:33:18.551 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-06T12:33:18.552 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:33:18.553 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:33:18.554 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:33:18.554 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:19 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all iscsi 2024-04-06T12:33:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:19 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all nfs 2024-04-06T12:33:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:19 smithi152 ceph-mon[104634]: Upgrade: Setting container_image for all nvmeof 2024-04-06T12:33:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:19 smithi152 ceph-mon[104634]: Upgrade: Finalizing container_image settings 2024-04-06T12:33:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:19 smithi152 ceph-mon[104634]: Upgrade: Complete! 2024-04-06T12:33:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:19 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all iscsi 2024-04-06T12:33:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:19 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all nfs 2024-04-06T12:33:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:19 smithi195 ceph-mon[85980]: Upgrade: Setting container_image for all nvmeof 2024-04-06T12:33:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:19 smithi195 ceph-mon[85980]: Upgrade: Finalizing container_image settings 2024-04-06T12:33:19.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:19 smithi195 ceph-mon[85980]: Upgrade: Complete! 2024-04-06T12:33:20.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:20 smithi152 ceph-mon[104634]: pgmap v217: 65 pgs: 65 active+clean; 259 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-06T12:33:20.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:20 smithi195 ceph-mon[85980]: pgmap v217: 65 pgs: 65 active+clean; 259 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-06T12:33:21.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.038+0000 7fc4fee4e700 1 -- 172.21.15.152:0/2629769394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 msgr2=0x7fc4f8101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:21.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.038+0000 7fc4fee4e700 1 --2- 172.21.15.152:0/2629769394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 0x7fc4f8101930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fc4e40047f0 tx=0x7fc4e4009cb0).stop 2024-04-06T12:33:21.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 -- 172.21.15.152:0/2629769394 shutdown_connections 2024-04-06T12:33:21.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 --2- 172.21.15.152:0/2629769394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 0x7fc4f8101930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:21.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 --2- 172.21.15.152:0/2629769394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4f80f88c0 0x7fc4f80f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:21.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 -- 172.21.15.152:0/2629769394 >> 172.21.15.152:0/2629769394 conn(0x7fc4f80f2410 msgr2=0x7fc4f80f4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:21.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 -- 172.21.15.152:0/2629769394 shutdown_connections 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 -- 172.21.15.152:0/2629769394 wait complete. 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 Processor -- start 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 -- start start 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4f80f88c0 0x7fc4f810e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 0x7fc4f810e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f810eb40 con 0x7fc4f80f9220 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.039+0000 7fc4fee4e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f810ec80 con 0x7fc4f80f88c0 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 0x7fc4f810e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 0x7fc4f810e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52844/0 (socket says 172.21.15.152:52844) 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f7fff700 1 -- 172.21.15.152:0/1590848667 learned_addr learned my addr 172.21.15.152:0/1590848667 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4fcbea700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4f80f88c0 0x7fc4f810e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f7fff700 1 -- 172.21.15.152:0/1590848667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4f80f88c0 msgr2=0x7fc4f810e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f7fff700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4f80f88c0 0x7fc4f810e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:21.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f7fff700 1 -- 172.21.15.152:0/1590848667 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e4005040 con 0x7fc4f80f9220 2024-04-06T12:33:21.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f7fff700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 0x7fc4f810e540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc4e400b120 tx=0x7fc4e4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:21.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f5ffb700 1 -- 172.21.15.152:0/1590848667 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4e400e030 con 0x7fc4f80f9220 2024-04-06T12:33:21.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f5ffb700 1 -- 172.21.15.152:0/1590848667 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4e4007e90 con 0x7fc4f80f9220 2024-04-06T12:33:21.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f81082b0 con 0x7fc4f80f9220 2024-04-06T12:33:21.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.040+0000 7fc4f5ffb700 1 -- 172.21.15.152:0/1590848667 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4e4018070 con 0x7fc4f80f9220 2024-04-06T12:33:21.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.041+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f8108790 con 0x7fc4f80f9220 2024-04-06T12:33:21.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.042+0000 7fc4f5ffb700 1 -- 172.21.15.152:0/1590848667 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc4e401c570 con 0x7fc4f80f9220 2024-04-06T12:33:21.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.042+0000 7fc4f5ffb700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc4e806caa0 0x7fc4e806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:21.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.042+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f805f4f0 con 0x7fc4f80f9220 2024-04-06T12:33:21.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.043+0000 7fc4f5ffb700 1 -- 172.21.15.152:0/1590848667 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fc4e408d320 con 0x7fc4f80f9220 2024-04-06T12:33:21.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.043+0000 7fc4fcbea700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc4e806caa0 0x7fc4e806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:21.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.043+0000 7fc4fcbea700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc4e806caa0 0x7fc4e806ef60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc4ec004b60 tx=0x7fc4ec009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:21.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.047+0000 7fc4f5ffb700 1 -- 172.21.15.152:0/1590848667 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fc4e405ad70 con 0x7fc4f80f9220 2024-04-06T12:33:21.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.274+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4f81096d0 con 0x7fc4e806caa0 2024-04-06T12:33:21.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.276+0000 7fc4f5ffb700 1 -- 172.21.15.152:0/1590848667 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc4f81096d0 con 0x7fc4e806caa0 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc4e806caa0 msgr2=0x7fc4e806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc4e806caa0 0x7fc4e806ef60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc4ec004b60 tx=0x7fc4ec009040).stop 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 msgr2=0x7fc4f810e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 0x7fc4f810e540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc4e400b120 tx=0x7fc4e4009cb0).stop 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 shutdown_connections 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc4e806caa0 0x7fc4e806ef60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4f80f88c0 0x7fc4f810e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 --2- 172.21.15.152:0/1590848667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f80f9220 0x7fc4f810e540 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 >> 172.21.15.152:0/1590848667 conn(0x7fc4f80f2410 msgr2=0x7fc4f80fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 shutdown_connections 2024-04-06T12:33:21.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:21.279+0000 7fc4fee4e700 1 -- 172.21.15.152:0/1590848667 wait complete. 2024-04-06T12:33:22.135 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph orch ps' 2024-04-06T12:33:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:22 smithi152 ceph-mon[104634]: pgmap v218: 65 pgs: 65 active+clean; 259 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-06T12:33:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:22 smithi152 ceph-mon[104634]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:33:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:33:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:22 smithi195 ceph-mon[85980]: pgmap v218: 65 pgs: 65 active+clean; 259 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-06T12:33:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:22 smithi195 ceph-mon[85980]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:33:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:33:22.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:33:24.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.211+0000 7ff29099d700 1 -- 172.21.15.152:0/4032897073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 msgr2=0x7ff28c101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:24.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.211+0000 7ff29099d700 1 --2- 172.21.15.152:0/4032897073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 0x7ff28c101a80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7ff2740047f0 tx=0x7ff274009cb0).stop 2024-04-06T12:33:24.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.211+0000 7ff29099d700 1 -- 172.21.15.152:0/4032897073 shutdown_connections 2024-04-06T12:33:24.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.211+0000 7ff29099d700 1 --2- 172.21.15.152:0/4032897073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 0x7ff28c101a80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:24.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.211+0000 7ff29099d700 1 --2- 172.21.15.152:0/4032897073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28c0f8a10 0x7ff28c0f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.211+0000 7ff29099d700 1 -- 172.21.15.152:0/4032897073 >> 172.21.15.152:0/4032897073 conn(0x7ff28c06c760 msgr2=0x7ff28c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.211+0000 7ff29099d700 1 -- 172.21.15.152:0/4032897073 shutdown_connections 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.211+0000 7ff29099d700 1 -- 172.21.15.152:0/4032897073 wait complete. 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.211+0000 7ff29099d700 1 Processor -- start 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff29099d700 1 -- start start 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff29099d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28c0f8a10 0x7ff28c10e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff29099d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 0x7ff28c10e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff29099d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c10eb30 con 0x7ff28c0f92e0 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff29099d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c10ec70 con 0x7ff28c0f8a10 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff283fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 0x7ff28c10e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff283fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 0x7ff28c10e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33162/0 (socket says 172.21.15.152:33162) 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff283fff700 1 -- 172.21.15.152:0/4202100385 learned_addr learned my addr 172.21.15.152:0/4202100385 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:33:24.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff28a59c700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28c0f8a10 0x7ff28c10e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff283fff700 1 -- 172.21.15.152:0/4202100385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28c0f8a10 msgr2=0x7ff28c10e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff283fff700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28c0f8a10 0x7ff28c10e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff283fff700 1 -- 172.21.15.152:0/4202100385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274005040 con 0x7ff28c0f92e0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.212+0000 7ff283fff700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 0x7ff28c10e530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff274005010 tx=0x7ff274009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.213+0000 7ff2837fe700 1 -- 172.21.15.152:0/4202100385 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27400e030 con 0x7ff28c0f92e0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.213+0000 7ff2837fe700 1 -- 172.21.15.152:0/4202100385 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff274007e90 con 0x7ff28c0f92e0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.213+0000 7ff2837fe700 1 -- 172.21.15.152:0/4202100385 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff274018070 con 0x7ff28c0f92e0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.213+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c1082a0 con 0x7ff28c0f92e0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.213+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c108780 con 0x7ff28c0f92e0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.214+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c05f550 con 0x7ff28c0f92e0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.214+0000 7ff2837fe700 1 -- 172.21.15.152:0/4202100385 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff27401d600 con 0x7ff28c0f92e0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.215+0000 7ff2837fe700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff27806caa0 0x7ff27806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.215+0000 7ff2837fe700 1 -- 172.21.15.152:0/4202100385 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7ff27408d0a0 con 0x7ff28c0f92e0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.215+0000 7ff28a59c700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff27806caa0 0x7ff27806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:24.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.215+0000 7ff28a59c700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff27806caa0 0x7ff27806ef60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff27c004dc0 tx=0x7ff27c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:24.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.223+0000 7ff2837fe700 1 -- 172.21.15.152:0/4202100385 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7ff27405aae0 con 0x7ff28c0f92e0 2024-04-06T12:33:24.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.450+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff28c1097a0 con 0x7ff27806caa0 2024-04-06T12:33:24.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.469+0000 7ff2837fe700 1 -- 172.21.15.152:0/4202100385 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff28c1097a0 con 0x7ff27806caa0 2024-04-06T12:33:24.466 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (7m) 53s ago 18m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (4m) 53s ago 18m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (4m) 13s ago 17m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (6m) 53s ago 18m 93.9M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (57s) 53s ago 13m 14.6M - 18.2.2-1086-g052adcad 87261d5ece5a f51d76bed558 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (76s) 53s ago 13m 14.7M - 18.2.2-1086-g052adcad 87261d5ece5a 90254d845be3 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (38s) 13s ago 13m 12.5M - 18.2.2-1086-g052adcad 87261d5ece5a 351db91864f6 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (17s) 13s ago 13m 14.9M - 18.2.2-1086-g052adcad 87261d5ece5a bc4226be48d6 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (8m) 53s ago 19m 504M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (8m) 13s ago 17m 450M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (5m) 53s ago 20m 59.0M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (5m) 13s ago 17m 45.4M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (7m) 53s ago 18m 17.2M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 13s ago 17m 17.2M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (4m) 53s ago 17m 99.3M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (3m) 53s ago 16m 103M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 4e01281def3c 2024-04-06T12:33:24.467 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (3m) 53s ago 16m 104M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 36456f3aa1eb 2024-04-06T12:33:24.468 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (2m) 13s ago 15m 130M 2251M 18.2.2-1086-g052adcad 87261d5ece5a b41c5ddebdba 2024-04-06T12:33:24.468 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (2m) 13s ago 15m 88.7M 2251M 18.2.2-1086-g052adcad 87261d5ece5a 887060bd04bc 2024-04-06T12:33:24.468 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (97s) 13s ago 14m 88.0M 2251M 18.2.2-1086-g052adcad 87261d5ece5a f0ce150c2bbd 2024-04-06T12:33:24.468 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (7m) 13s ago 17m 60.0M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:33:24.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff27806caa0 msgr2=0x7ff27806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff27806caa0 0x7ff27806ef60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff27c004dc0 tx=0x7ff27c00b040).stop 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 msgr2=0x7ff28c10e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 0x7ff28c10e530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff274005010 tx=0x7ff274009cb0).stop 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 shutdown_connections 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff27806caa0 0x7ff27806ef60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff28c0f8a10 0x7ff28c10e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 --2- 172.21.15.152:0/4202100385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0f92e0 0x7ff28c10e530 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 >> 172.21.15.152:0/4202100385 conn(0x7ff28c06c760 msgr2=0x7ff28c0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 shutdown_connections 2024-04-06T12:33:24.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:24.472+0000 7ff29099d700 1 -- 172.21.15.152:0/4202100385 wait complete. 2024-04-06T12:33:24.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:24 smithi152 ceph-mon[104634]: pgmap v219: 65 pgs: 65 active+clean; 255 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-04-06T12:33:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:24 smithi195 ceph-mon[85980]: pgmap v219: 65 pgs: 65 active+clean; 255 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-04-06T12:33:25.235 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph orch upgrade status' 2024-04-06T12:33:26.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:26 smithi152 ceph-mon[104634]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:33:26.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:26 smithi152 ceph-mon[104634]: pgmap v220: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-04-06T12:33:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:26 smithi195 ceph-mon[85980]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:33:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:26 smithi195 ceph-mon[85980]: pgmap v220: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.306+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/3449875976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 msgr2=0x7f0c980fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.306+0000 7f0c9f2b8700 1 --2- 172.21.15.152:0/3449875976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 0x7f0c980fcbd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f0c940047f0 tx=0x7f0c94009cb0).stop 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.306+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/3449875976 shutdown_connections 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.306+0000 7f0c9f2b8700 1 --2- 172.21.15.152:0/3449875976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c980fd150 0x7f0c980f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.306+0000 7f0c9f2b8700 1 --2- 172.21.15.152:0/3449875976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 0x7f0c980fcbd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.306+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/3449875976 >> 172.21.15.152:0/3449875976 conn(0x7f0c98070590 msgr2=0x7f0c980f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.307+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/3449875976 shutdown_connections 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.307+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/3449875976 wait complete. 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.307+0000 7f0c9f2b8700 1 Processor -- start 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.307+0000 7f0c9f2b8700 1 -- start start 2024-04-06T12:33:27.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.307+0000 7f0c9f2b8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 0x7f0c9810cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.307+0000 7f0c9f2b8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c980fd150 0x7f0c9810d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.307+0000 7f0c9f2b8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9810d9f0 con 0x7f0c980fc7f0 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.307+0000 7f0c9f2b8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9810db30 con 0x7f0c980fd150 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.307+0000 7f0c9d054700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 0x7f0c9810cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c9d054700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 0x7f0c9810cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33190/0 (socket says 172.21.15.152:33190) 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c9d054700 1 -- 172.21.15.152:0/239592070 learned_addr learned my addr 172.21.15.152:0/239592070 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c9c853700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c980fd150 0x7f0c9810d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c9d054700 1 -- 172.21.15.152:0/239592070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c980fd150 msgr2=0x7f0c9810d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c9d054700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c980fd150 0x7f0c9810d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c9d054700 1 -- 172.21.15.152:0/239592070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c94005040 con 0x7f0c980fc7f0 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c9d054700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 0x7f0c9810cf00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f0c9400b120 tx=0x7f0c94009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c8e777700 1 -- 172.21.15.152:0/239592070 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9400e030 con 0x7f0c980fc7f0 2024-04-06T12:33:27.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c8e777700 1 -- 172.21.15.152:0/239592070 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c94007e90 con 0x7f0c980fc7f0 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c98107160 con 0x7f0c980fc7f0 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c8e777700 1 -- 172.21.15.152:0/239592070 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c94018070 con 0x7f0c980fc7f0 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.308+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c981076c0 con 0x7f0c980fc7f0 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.309+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9805f590 con 0x7f0c980fc7f0 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.309+0000 7f0c8e777700 1 -- 172.21.15.152:0/239592070 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0c9401d420 con 0x7f0c980fc7f0 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.310+0000 7f0c8e777700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0c8406caa0 0x7f0c8406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.310+0000 7f0c9c853700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0c8406caa0 0x7f0c8406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.310+0000 7f0c8e777700 1 -- 172.21.15.152:0/239592070 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f0c9408d370 con 0x7f0c980fc7f0 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.310+0000 7f0c9c853700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0c8406caa0 0x7f0c8406ef60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0c98108840 tx=0x7f0c88009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:27.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.314+0000 7f0c8e777700 1 -- 172.21.15.152:0/239592070 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f0c9405adb0 con 0x7f0c980fc7f0 2024-04-06T12:33:27.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.518+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c980feb40 con 0x7f0c8406caa0 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.519+0000 7f0c8e777700 1 -- 172.21.15.152:0/239592070 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f0c980feb40 con 0x7f0c8406caa0 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": null, 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": false, 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "", 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": null, 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2024-04-06T12:33:27.517 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:33:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0c8406caa0 msgr2=0x7f0c8406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0c8406caa0 0x7f0c8406ef60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0c98108840 tx=0x7f0c88009040).stop 2024-04-06T12:33:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 msgr2=0x7f0c9810cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 0x7f0c9810cf00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f0c9400b120 tx=0x7f0c94009cb0).stop 2024-04-06T12:33:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 shutdown_connections 2024-04-06T12:33:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0c8406caa0 0x7f0c8406ef60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c980fc7f0 0x7f0c9810cf00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 --2- 172.21.15.152:0/239592070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c980fd150 0x7f0c9810d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 >> 172.21.15.152:0/239592070 conn(0x7f0c98070590 msgr2=0x7f0c980fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:27.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 shutdown_connections 2024-04-06T12:33:27.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:27.521+0000 7f0c9f2b8700 1 -- 172.21.15.152:0/239592070 wait complete. 2024-04-06T12:33:28.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph health detail' 2024-04-06T12:33:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:28 smithi152 ceph-mon[104634]: pgmap v221: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-04-06T12:33:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:28 smithi195 ceph-mon[85980]: pgmap v221: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-04-06T12:33:29.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:29 smithi152 ceph-mon[104634]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:33:29.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:29 smithi195 ceph-mon[85980]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.516+0000 7f0f3924d700 1 -- 172.21.15.152:0/112927904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fe250 msgr2=0x7f0f340f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.516+0000 7f0f3924d700 1 --2- 172.21.15.152:0/112927904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fe250 0x7f0f340f7a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f0f240047f0 tx=0x7f0f24009cb0).stop 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.516+0000 7f0f3924d700 1 -- 172.21.15.152:0/112927904 shutdown_connections 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.516+0000 7f0f3924d700 1 --2- 172.21.15.152:0/112927904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fe250 0x7f0f340f7a30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.516+0000 7f0f3924d700 1 --2- 172.21.15.152:0/112927904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f340fd8f0 0x7f0f340fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.516+0000 7f0f3924d700 1 -- 172.21.15.152:0/112927904 >> 172.21.15.152:0/112927904 conn(0x7f0f340f34b0 msgr2=0x7f0f340f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.516+0000 7f0f3924d700 1 -- 172.21.15.152:0/112927904 shutdown_connections 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.516+0000 7f0f3924d700 1 -- 172.21.15.152:0/112927904 wait complete. 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.516+0000 7f0f3924d700 1 Processor -- start 2024-04-06T12:33:30.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f3924d700 1 -- start start 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f3924d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fd8f0 0x7f0f3410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f3924d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f340fe250 0x7f0f3410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f3924d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3410ebb0 con 0x7f0f340fd8f0 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f3924d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341081d0 con 0x7f0f340fe250 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f32d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fd8f0 0x7f0f3410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f32d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fd8f0 0x7f0f3410e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33212/0 (socket says 172.21.15.152:33212) 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f32d9d700 1 -- 172.21.15.152:0/2109012190 learned_addr learned my addr 172.21.15.152:0/2109012190 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f3259c700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f340fe250 0x7f0f3410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f32d9d700 1 -- 172.21.15.152:0/2109012190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f340fe250 msgr2=0x7f0f3410e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f32d9d700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f340fe250 0x7f0f3410e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f32d9d700 1 -- 172.21.15.152:0/2109012190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24005040 con 0x7f0f340fd8f0 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f32d9d700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fd8f0 0x7f0f3410e030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0f1c00b4b0 tx=0x7f0f1c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:30.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.517+0000 7f0f2bfff700 1 -- 172.21.15.152:0/2109012190 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f1c002500 con 0x7f0f340fd8f0 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.518+0000 7f0f2bfff700 1 -- 172.21.15.152:0/2109012190 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f1c002b10 con 0x7f0f340fd8f0 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.518+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f34108480 con 0x7f0f340fd8f0 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.518+0000 7f0f2bfff700 1 -- 172.21.15.152:0/2109012190 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f1c012cb0 con 0x7f0f340fd8f0 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.518+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f341089c0 con 0x7f0f340fd8f0 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.518+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3405f590 con 0x7f0f340fd8f0 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.519+0000 7f0f2bfff700 1 -- 172.21.15.152:0/2109012190 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0f1c002660 con 0x7f0f340fd8f0 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.519+0000 7f0f2bfff700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0f2006caa0 0x7f0f2006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.520+0000 7f0f3259c700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0f2006caa0 0x7f0f2006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.520+0000 7f0f2bfff700 1 -- 172.21.15.152:0/2109012190 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f0f1c08bfa0 con 0x7f0f340fd8f0 2024-04-06T12:33:30.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.520+0000 7f0f3259c700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0f2006caa0 0x7f0f2006ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f0f34109970 tx=0x7f0f2400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:30.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.524+0000 7f0f2bfff700 1 -- 172.21.15.152:0/2109012190 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f0f1c059940 con 0x7f0f340fd8f0 2024-04-06T12:33:30.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:30 smithi152 ceph-mon[104634]: pgmap v222: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-04-06T12:33:30.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:30 smithi195 ceph-mon[85980]: pgmap v222: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-04-06T12:33:30.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.790+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0f34047540 con 0x7f0f340fd8f0 2024-04-06T12:33:30.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.790+0000 7f0f2bfff700 1 -- 172.21.15.152:0/2109012190 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0f34047540 con 0x7f0f340fd8f0 2024-04-06T12:33:30.787 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:33:30.788 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-06T12:33:30.788 INFO:teuthology.orchestra.run.smithi152.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-06T12:33:30.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.792+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0f2006caa0 msgr2=0x7f0f2006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:30.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.792+0000 7f0f3924d700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0f2006caa0 0x7f0f2006ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f0f34109970 tx=0x7f0f2400b040).stop 2024-04-06T12:33:30.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.792+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fd8f0 msgr2=0x7f0f3410e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:30.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.792+0000 7f0f3924d700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fd8f0 0x7f0f3410e030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0f1c00b4b0 tx=0x7f0f1c0090f0).stop 2024-04-06T12:33:30.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.793+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 shutdown_connections 2024-04-06T12:33:30.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.793+0000 7f0f3924d700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0f2006caa0 0x7f0f2006ef60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:30.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.793+0000 7f0f3924d700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f340fd8f0 0x7f0f3410e030 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:30.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.793+0000 7f0f3924d700 1 --2- 172.21.15.152:0/2109012190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f340fe250 0x7f0f3410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:30.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.793+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 >> 172.21.15.152:0/2109012190 conn(0x7f0f340f34b0 msgr2=0x7f0f340fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:30.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.793+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 shutdown_connections 2024-04-06T12:33:30.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:30.793+0000 7f0f3924d700 1 -- 172.21.15.152:0/2109012190 wait complete. 2024-04-06T12:33:31.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:31 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2109012190' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:33:31.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:31 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2109012190' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-06T12:33:31.558 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph versions' 2024-04-06T12:33:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:32 smithi152 ceph-mon[104634]: pgmap v223: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 4 op/s 2024-04-06T12:33:32.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:32 smithi195 ceph-mon[85980]: pgmap v223: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 4 op/s 2024-04-06T12:33:33.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.461+0000 7f1b43721700 1 -- 172.21.15.152:0/175114642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 msgr2=0x7f1b3c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:33.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.461+0000 7f1b43721700 1 --2- 172.21.15.152:0/175114642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 0x7f1b3c0f6930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f1b380047f0 tx=0x7f1b38009cb0).stop 2024-04-06T12:33:33.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.461+0000 7f1b43721700 1 -- 172.21.15.152:0/175114642 shutdown_connections 2024-04-06T12:33:33.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.461+0000 7f1b43721700 1 --2- 172.21.15.152:0/175114642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 0x7f1b3c0f6930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.461+0000 7f1b43721700 1 --2- 172.21.15.152:0/175114642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b3c0fc7f0 0x7f1b3c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.461+0000 7f1b43721700 1 -- 172.21.15.152:0/175114642 >> 172.21.15.152:0/175114642 conn(0x7f1b3c070590 msgr2=0x7f1b3c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.462+0000 7f1b43721700 1 -- 172.21.15.152:0/175114642 shutdown_connections 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.462+0000 7f1b43721700 1 -- 172.21.15.152:0/175114642 wait complete. 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.462+0000 7f1b43721700 1 Processor -- start 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.462+0000 7f1b43721700 1 -- start start 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.462+0000 7f1b43721700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b3c0fc7f0 0x7f1b3c10ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.462+0000 7f1b43721700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 0x7f1b3c10d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.462+0000 7f1b43721700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c10d9c0 con 0x7f1b3c0fd150 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.462+0000 7f1b43721700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c10db00 con 0x7f1b3c0fc7f0 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.462+0000 7f1b40cbc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 0x7f1b3c10d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:33.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b40cbc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 0x7f1b3c10d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47510/0 (socket says 172.21.15.152:47510) 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b40cbc700 1 -- 172.21.15.152:0/1575979368 learned_addr learned my addr 172.21.15.152:0/1575979368 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b40cbc700 1 -- 172.21.15.152:0/1575979368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b3c0fc7f0 msgr2=0x7f1b3c10ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b40cbc700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b3c0fc7f0 0x7f1b3c10ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b40cbc700 1 -- 172.21.15.152:0/1575979368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38005040 con 0x7f1b3c0fd150 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b40cbc700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 0x7f1b3c10d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f1b380099f0 tx=0x7f1b38009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b327fc700 1 -- 172.21.15.152:0/1575979368 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b3800e030 con 0x7f1b3c0fd150 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b327fc700 1 -- 172.21.15.152:0/1575979368 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b38007e90 con 0x7f1b3c0fd150 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c107130 con 0x7f1b3c0fd150 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b327fc700 1 -- 172.21.15.152:0/1575979368 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b38018070 con 0x7f1b3c0fd150 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.463+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c107690 con 0x7f1b3c0fd150 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.464+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c05f590 con 0x7f1b3c0fd150 2024-04-06T12:33:33.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.464+0000 7f1b327fc700 1 -- 172.21.15.152:0/1575979368 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1b3801d420 con 0x7f1b3c0fd150 2024-04-06T12:33:33.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.465+0000 7f1b327fc700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1b2806caa0 0x7f1b2806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:33:33.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.465+0000 7f1b327fc700 1 -- 172.21.15.152:0/1575979368 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f1b3808d360 con 0x7f1b3c0fd150 2024-04-06T12:33:33.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.465+0000 7f1b414bd700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1b2806caa0 0x7f1b2806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:33:33.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.465+0000 7f1b414bd700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1b2806caa0 0x7f1b2806ef60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1b2c004950 tx=0x7f1b2c007bc0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:33:33.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.469+0000 7f1b327fc700 1 -- 172.21.15.152:0/1575979368 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f1b3805ada0 con 0x7f1b3c0fd150 2024-04-06T12:33:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.735+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1b3c0feb40 con 0x7f1b3c0fd150 2024-04-06T12:33:33.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.735+0000 7f1b327fc700 1 -- 172.21.15.152:0/1575979368 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f1b3805a930 con 0x7f1b3c0fd150 2024-04-06T12:33:33.733 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:33:33.733 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:33:33.733 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:33:33.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 6 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 4 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 14 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:33:33.734 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:33:33.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.737+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1b2806caa0 msgr2=0x7f1b2806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:33.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.737+0000 7f1b43721700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1b2806caa0 0x7f1b2806ef60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1b2c004950 tx=0x7f1b2c007bc0).stop 2024-04-06T12:33:33.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.737+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 msgr2=0x7f1b3c10d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:33:33.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.737+0000 7f1b43721700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 0x7f1b3c10d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f1b380099f0 tx=0x7f1b38009cb0).stop 2024-04-06T12:33:33.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.737+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 shutdown_connections 2024-04-06T12:33:33.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.737+0000 7f1b43721700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1b2806caa0 0x7f1b2806ef60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:33.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.737+0000 7f1b43721700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b3c0fc7f0 0x7f1b3c10ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:33:33.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.737+0000 7f1b43721700 1 --2- 172.21.15.152:0/1575979368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b3c0fd150 0x7f1b3c10d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:33:33.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.737+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 >> 172.21.15.152:0/1575979368 conn(0x7f1b3c070590 msgr2=0x7f1b3c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:33:33.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.738+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 shutdown_connections 2024-04-06T12:33:33.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:33:33.738+0000 7f1b43721700 1 -- 172.21.15.152:0/1575979368 wait complete. 2024-04-06T12:33:34.410 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:34 smithi152 ceph-mon[104634]: pgmap v224: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-06T12:33:34.411 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:34 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1575979368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:34.431 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-06T12:33:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:34 smithi195 ceph-mon[85980]: pgmap v224: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-06T12:33:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:34 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1575979368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:33:36.505 INFO:teuthology.orchestra.run.smithi152.stdout:wait for servicemap items w/ changing names to refresh 2024-04-06T12:33:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:36 smithi152 ceph-mon[104634]: pgmap v225: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 9.3 MiB/s rd, 3 op/s 2024-04-06T12:33:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:36 smithi195 ceph-mon[85980]: pgmap v225: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 9.3 MiB/s rd, 3 op/s 2024-04-06T12:33:37.240 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'sleep 60' 2024-04-06T12:33:37.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:33:37.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:33:38.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:38 smithi195 ceph-mon[85980]: pgmap v226: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s 2024-04-06T12:33:38.666 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:38 smithi152 ceph-mon[104634]: pgmap v226: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s 2024-04-06T12:33:40.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:39 smithi152 ceph-mon[104634]: pgmap v227: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 2 op/s 2024-04-06T12:33:40.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:39 smithi195 ceph-mon[85980]: pgmap v227: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 2 op/s 2024-04-06T12:33:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:42 smithi152 ceph-mon[104634]: pgmap v228: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:42.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:42 smithi195 ceph-mon[85980]: pgmap v228: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:44 smithi152 ceph-mon[104634]: pgmap v229: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:33:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:44 smithi195 ceph-mon[85980]: pgmap v229: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:33:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:46 smithi152 ceph-mon[104634]: pgmap v230: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:46.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:46 smithi195 ceph-mon[85980]: pgmap v230: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:48 smithi152 ceph-mon[104634]: pgmap v231: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:48.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:48 smithi195 ceph-mon[85980]: pgmap v231: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:50.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:49 smithi152 ceph-mon[104634]: pgmap v232: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:33:50.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:49 smithi195 ceph-mon[85980]: pgmap v232: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:33:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:52 smithi152 ceph-mon[104634]: pgmap v233: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:33:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:52 smithi195 ceph-mon[85980]: pgmap v233: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:33:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:54 smithi152 ceph-mon[104634]: pgmap v234: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:33:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:54 smithi195 ceph-mon[85980]: pgmap v234: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:33:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:56 smithi152 ceph-mon[104634]: pgmap v235: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:56 smithi195 ceph-mon[85980]: pgmap v235: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:58.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:58 smithi152 ceph-mon[104634]: pgmap v236: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:33:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:58 smithi195 ceph-mon[85980]: pgmap v236: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:33:59 smithi152 ceph-mon[104634]: pgmap v237: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:00.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:33:59 smithi195 ceph-mon[85980]: pgmap v237: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:02 smithi152 ceph-mon[104634]: pgmap v238: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:02 smithi195 ceph-mon[85980]: pgmap v238: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:04 smithi152 ceph-mon[104634]: pgmap v239: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:04 smithi195 ceph-mon[85980]: pgmap v239: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:06.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:06 smithi152 ceph-mon[104634]: pgmap v240: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:06 smithi195 ceph-mon[85980]: pgmap v240: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:34:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:34:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:08 smithi152 ceph-mon[104634]: pgmap v241: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:08 smithi195 ceph-mon[85980]: pgmap v241: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:10.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:09 smithi152 ceph-mon[104634]: pgmap v242: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:10.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:09 smithi195 ceph-mon[85980]: pgmap v242: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:12.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:12 smithi152 ceph-mon[104634]: pgmap v243: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:12.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:12 smithi195 ceph-mon[85980]: pgmap v243: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:14 smithi152 ceph-mon[104634]: pgmap v244: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:14 smithi195 ceph-mon[85980]: pgmap v244: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:16.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:16 smithi152 ceph-mon[104634]: pgmap v245: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:16.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:16 smithi195 ceph-mon[85980]: pgmap v245: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:18 smithi152 ceph-mon[104634]: pgmap v246: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:34:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:34:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:34:18.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:18 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:34:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:18 smithi195 ceph-mon[85980]: pgmap v246: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:34:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:34:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:34:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:18 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:34:20.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:19 smithi152 ceph-mon[104634]: pgmap v247: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:19 smithi195 ceph-mon[85980]: pgmap v247: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:22 smithi152 ceph-mon[104634]: pgmap v248: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:34:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:22 smithi195 ceph-mon[85980]: pgmap v248: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:34:24.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:24 smithi152 ceph-mon[104634]: pgmap v249: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:24 smithi195 ceph-mon[85980]: pgmap v249: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:26.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:26 smithi152 ceph-mon[104634]: pgmap v250: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:26 smithi195 ceph-mon[85980]: pgmap v250: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:28 smithi152 ceph-mon[104634]: pgmap v251: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:28 smithi195 ceph-mon[85980]: pgmap v251: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:29 smithi152 ceph-mon[104634]: pgmap v252: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:30.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:29 smithi195 ceph-mon[85980]: pgmap v252: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:32 smithi152 ceph-mon[104634]: pgmap v253: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:32.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:32 smithi195 ceph-mon[85980]: pgmap v253: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:34.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:34 smithi152 ceph-mon[104634]: pgmap v254: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:34 smithi195 ceph-mon[85980]: pgmap v254: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:36 smithi152 ceph-mon[104634]: pgmap v255: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:36 smithi195 ceph-mon[85980]: pgmap v255: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:37.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:34:37.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:34:38.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:38 smithi152 ceph-mon[104634]: pgmap v256: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:38.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:38 smithi195 ceph-mon[85980]: pgmap v256: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:39.935 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph orch ps' 2024-04-06T12:34:40.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:39 smithi152 ceph-mon[104634]: pgmap v257: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:40.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:39 smithi195 ceph-mon[85980]: pgmap v257: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.992+0000 7fbcd9a32700 1 -- 172.21.15.152:0/3108665285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fd150 msgr2=0x7fbcd40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.992+0000 7fbcd9a32700 1 --2- 172.21.15.152:0/3108665285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fd150 0x7fbcd40f6930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fbcc80047f0 tx=0x7fbcc8009cb0).stop 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.992+0000 7fbcd9a32700 1 -- 172.21.15.152:0/3108665285 shutdown_connections 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.992+0000 7fbcd9a32700 1 --2- 172.21.15.152:0/3108665285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fd150 0x7fbcd40f6930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.992+0000 7fbcd9a32700 1 --2- 172.21.15.152:0/3108665285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd40fc7f0 0x7fbcd40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.992+0000 7fbcd9a32700 1 -- 172.21.15.152:0/3108665285 >> 172.21.15.152:0/3108665285 conn(0x7fbcd4070590 msgr2=0x7fbcd40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.992+0000 7fbcd9a32700 1 -- 172.21.15.152:0/3108665285 shutdown_connections 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.992+0000 7fbcd9a32700 1 -- 172.21.15.152:0/3108665285 wait complete. 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.993+0000 7fbcd9a32700 1 Processor -- start 2024-04-06T12:34:42.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.993+0000 7fbcd9a32700 1 -- start start 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.993+0000 7fbcd9a32700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fc7f0 0x7fbcd410ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.993+0000 7fbcd9a32700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd40fd150 0x7fbcd410d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.993+0000 7fbcd9a32700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd410d9c0 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.993+0000 7fbcd9a32700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd410db00 con 0x7fbcd40fd150 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.993+0000 7fbcd2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fc7f0 0x7fbcd410ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.993+0000 7fbcd2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fc7f0 0x7fbcd410ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44614/0 (socket says 172.21.15.152:44614) 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.993+0000 7fbcd2ffd700 1 -- 172.21.15.152:0/4560896 learned_addr learned my addr 172.21.15.152:0/4560896 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcd27fc700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd40fd150 0x7fbcd410d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcd2ffd700 1 -- 172.21.15.152:0/4560896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd40fd150 msgr2=0x7fbcd410d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcd2ffd700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd40fd150 0x7fbcd410d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcd2ffd700 1 -- 172.21.15.152:0/4560896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8005040 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcd2ffd700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fc7f0 0x7fbcd410ced0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fbccc00dad0 tx=0x7fbccc004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcbbfff700 1 -- 172.21.15.152:0/4560896 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbccc00b750 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd4107190 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcbbfff700 1 -- 172.21.15.152:0/4560896 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbccc00f040 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcbbfff700 1 -- 172.21.15.152:0/4560896 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbccc013ce0 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.994+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd4107750 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.995+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd405f590 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.995+0000 7fbcbbfff700 1 -- 172.21.15.152:0/4560896 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbccc00b8b0 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.996+0000 7fbcbbfff700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbcbc06caa0 0x7fbcbc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.996+0000 7fbcbbfff700 1 -- 172.21.15.152:0/4560896 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fbccc08b960 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.996+0000 7fbcd27fc700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbcbc06caa0 0x7fbcbc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:41.996+0000 7fbcd27fc700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbcbc06caa0 0x7fbcbc06ef60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbcc8004f10 tx=0x7fbcc800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:42.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.000+0000 7fbcbbfff700 1 -- 172.21.15.152:0/4560896 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fbccc059450 con 0x7fbcd40fc7f0 2024-04-06T12:34:42.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.200+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 --> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcd4108660 con 0x7fbcbc06caa0 2024-04-06T12:34:42.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.210+0000 7fbcbbfff700 1 -- 172.21.15.152:0/4560896 <== mgr.34104 v2:172.21.15.152:6800/2261466975 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fbcd4108660 con 0x7fbcbc06caa0 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (8m) 2m ago 19m 28.4M - 0.25.0 c8568f914cd2 11b7527d6212 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (6m) 2m ago 19m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a 60eacf446463 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi195 smithi195 running (6m) 91s ago 19m 6656k - 18.2.2-1086-g052adcad 87261d5ece5a c6ecf25aa9ac 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (8m) 2m ago 19m 93.9M - 9.4.7 954c08fa6188 a6c53093106e 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.mxtfph smithi152 running (2m) 2m ago 14m 14.6M - 18.2.2-1086-g052adcad 87261d5ece5a f51d76bed558 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.spbxnv smithi152 running (2m) 2m ago 14m 14.7M - 18.2.2-1086-g052adcad 87261d5ece5a 90254d845be3 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.akamqf smithi195 running (116s) 91s ago 14m 12.5M - 18.2.2-1086-g052adcad 87261d5ece5a 351db91864f6 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi195.ttgcpp smithi195 running (94s) 91s ago 14m 14.9M - 18.2.2-1086-g052adcad 87261d5ece5a bc4226be48d6 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.lynahm smithi152 *:8443,9283,8765 running (10m) 2m ago 21m 504M - 18.2.2-1086-g052adcad 87261d5ece5a 1da6a4c0285b 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi195.ausetj smithi195 *:8443,9283,8765 running (9m) 91s ago 19m 450M - 18.2.2-1086-g052adcad 87261d5ece5a 8f2651a9455d 2024-04-06T12:34:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (7m) 2m ago 21m 59.0M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 7ba55ae8d3b1 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi195 smithi195 running (6m) 91s ago 19m 45.4M 2048M 18.2.2-1086-g052adcad 87261d5ece5a 4e919860905a 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (9m) 2m ago 19m 17.2M - 1.5.0 0da6a335fe13 af18d95c77e3 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi195 smithi195 *:9100 running (8m) 91s ago 18m 17.2M - 1.5.0 0da6a335fe13 0cfa76b73d36 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (5m) 2m ago 18m 99.3M 1910M 18.2.2-1086-g052adcad 87261d5ece5a f7dc11131ce5 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (5m) 2m ago 17m 103M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 4e01281def3c 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (4m) 2m ago 17m 104M 1910M 18.2.2-1086-g052adcad 87261d5ece5a 36456f3aa1eb 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi195 running (4m) 91s ago 17m 130M 2251M 18.2.2-1086-g052adcad 87261d5ece5a b41c5ddebdba 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi195 running (3m) 91s ago 16m 88.7M 2251M 18.2.2-1086-g052adcad 87261d5ece5a 887060bd04bc 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi195 running (2m) 91s ago 16m 88.0M 2251M 18.2.2-1086-g052adcad 87261d5ece5a f0ce150c2bbd 2024-04-06T12:34:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi195 smithi195 *:9095 running (8m) 91s ago 18m 60.0M - 2.43.0 a07b618ecd1d 14f46f381ca6 2024-04-06T12:34:42.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbcbc06caa0 msgr2=0x7fbcbc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:42.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbcbc06caa0 0x7fbcbc06ef60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbcc8004f10 tx=0x7fbcc800b040).stop 2024-04-06T12:34:42.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fc7f0 msgr2=0x7fbcd410ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:42.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fc7f0 0x7fbcd410ced0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fbccc00dad0 tx=0x7fbccc004ee0).stop 2024-04-06T12:34:42.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 shutdown_connections 2024-04-06T12:34:42.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fbcbc06caa0 0x7fbcbc06ef60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:42.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcd40fc7f0 0x7fbcd410ced0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:42.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 --2- 172.21.15.152:0/4560896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd40fd150 0x7fbcd410d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:42.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 >> 172.21.15.152:0/4560896 conn(0x7fbcd4070590 msgr2=0x7fbcd40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:42.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 shutdown_connections 2024-04-06T12:34:42.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:42.212+0000 7fbcd9a32700 1 -- 172.21.15.152:0/4560896 wait complete. 2024-04-06T12:34:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:42 smithi152 ceph-mon[104634]: pgmap v258: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:42.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:42 smithi195 ceph-mon[85980]: pgmap v258: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:42.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph versions' 2024-04-06T12:34:43.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:43 smithi152 ceph-mon[104634]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:34:43.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:43 smithi195 ceph-mon[85980]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-06T12:34:44.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:44 smithi152 ceph-mon[104634]: pgmap v259: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:44 smithi195 ceph-mon[85980]: pgmap v259: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.004+0000 7f454bb4a700 1 -- 172.21.15.152:0/3600430951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fd150 msgr2=0x7f45440f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.004+0000 7f454bb4a700 1 --2- 172.21.15.152:0/3600430951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fd150 0x7f45440f6930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f45340047f0 tx=0x7f4534009cb0).stop 2024-04-06T12:34:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 -- 172.21.15.152:0/3600430951 shutdown_connections 2024-04-06T12:34:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 --2- 172.21.15.152:0/3600430951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fd150 0x7f45440f6930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 --2- 172.21.15.152:0/3600430951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45440fc7f0 0x7f45440fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 -- 172.21.15.152:0/3600430951 >> 172.21.15.152:0/3600430951 conn(0x7f4544070590 msgr2=0x7f45440f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 -- 172.21.15.152:0/3600430951 shutdown_connections 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 -- 172.21.15.152:0/3600430951 wait complete. 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 Processor -- start 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 -- start start 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fc7f0 0x7f45441090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45440fd150 0x7f45441095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.005+0000 7f454bb4a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544109aa0 con 0x7f45440fc7f0 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f454bb4a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544109be0 con 0x7f45440fd150 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f45498e6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fc7f0 0x7f45441090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f45498e6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fc7f0 0x7f45441090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54754/0 (socket says 172.21.15.152:54754) 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f45498e6700 1 -- 172.21.15.152:0/852764888 learned_addr learned my addr 172.21.15.152:0/852764888 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f45498e6700 1 -- 172.21.15.152:0/852764888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45440fd150 msgr2=0x7f45441095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f45498e6700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45440fd150 0x7f45441095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f45498e6700 1 -- 172.21.15.152:0/852764888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534005040 con 0x7f45440fc7f0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f45498e6700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fc7f0 0x7f45441090c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f45400041d0 tx=0x7f4540009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f453affd700 1 -- 172.21.15.152:0/852764888 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4540007b40 con 0x7f45440fc7f0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4544109e90 con 0x7f45440fc7f0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f453affd700 1 -- 172.21.15.152:0/852764888 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f454000f040 con 0x7f45440fc7f0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f453affd700 1 -- 172.21.15.152:0/852764888 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454000d800 con 0x7f45440fc7f0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.006+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45441124b0 con 0x7f45440fc7f0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.007+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454405f590 con 0x7f45440fc7f0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.008+0000 7f453affd700 1 -- 172.21.15.152:0/852764888 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4540007ca0 con 0x7f45440fc7f0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.008+0000 7f453affd700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f453006caa0 0x7f453006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.008+0000 7f453affd700 1 -- 172.21.15.152:0/852764888 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f454008b9f0 con 0x7f45440fc7f0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.008+0000 7f45490e5700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f453006caa0 0x7f453006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.008+0000 7f45490e5700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f453006caa0 0x7f453006ef60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4544060f00 tx=0x7f4534009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.012+0000 7f453affd700 1 -- 172.21.15.152:0/852764888 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f454008de60 con 0x7f45440fc7f0 2024-04-06T12:34:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.282+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4544060d40 con 0x7f45440fc7f0 2024-04-06T12:34:45.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.283+0000 7f453affd700 1 -- 172.21.15.152:0/852764888 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f4544060d40 con 0x7f45440fc7f0 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 2 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 6 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 4 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-06T12:34:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2024-04-06T12:34:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)": 14 2024-04-06T12:34:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-06T12:34:45.282 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f453006caa0 msgr2=0x7f453006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f453006caa0 0x7f453006ef60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4544060f00 tx=0x7f4534009cb0).stop 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fc7f0 msgr2=0x7f45441090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fc7f0 0x7f45441090c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f45400041d0 tx=0x7f4540009f60).stop 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 shutdown_connections 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f453006caa0 0x7f453006ef60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45440fc7f0 0x7f45441090c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 --2- 172.21.15.152:0/852764888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45440fd150 0x7f45441095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 >> 172.21.15.152:0/852764888 conn(0x7f4544070590 msgr2=0x7f45440fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 shutdown_connections 2024-04-06T12:34:45.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:45.285+0000 7f454bb4a700 1 -- 172.21.15.152:0/852764888 wait complete. 2024-04-06T12:34:46.018 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-06T12:34:46.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:46 smithi152 ceph-mon[104634]: pgmap v260: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:46.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:46 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/852764888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:34:46.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:46 smithi195 ceph-mon[85980]: pgmap v260: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:46.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:46 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/852764888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:34:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.038+0000 7f472db4f700 1 -- 172.21.15.152:0/1274882565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fd150 msgr2=0x7f47280f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.038+0000 7f472db4f700 1 --2- 172.21.15.152:0/1274882565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fd150 0x7f47280f6930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f471c0047f0 tx=0x7f471c009cb0).stop 2024-04-06T12:34:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.038+0000 7f472db4f700 1 -- 172.21.15.152:0/1274882565 shutdown_connections 2024-04-06T12:34:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.038+0000 7f472db4f700 1 --2- 172.21.15.152:0/1274882565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fd150 0x7f47280f6930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.038+0000 7f472db4f700 1 --2- 172.21.15.152:0/1274882565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fc7f0 0x7f47280fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:34:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.038+0000 7f472db4f700 1 -- 172.21.15.152:0/1274882565 >> 172.21.15.152:0/1274882565 conn(0x7f4728070590 msgr2=0x7f47280f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.038+0000 7f472db4f700 1 -- 172.21.15.152:0/1274882565 shutdown_connections 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.038+0000 7f472db4f700 1 -- 172.21.15.152:0/1274882565 wait complete. 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f472db4f700 1 Processor -- start 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f472db4f700 1 -- start start 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f472db4f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fc7f0 0x7f472810cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f472db4f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fd150 0x7f472810d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f472db4f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472810db00 con 0x7f47280fc7f0 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f472db4f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4728107120 con 0x7f47280fd150 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f47277fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fc7f0 0x7f472810cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f47277fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fc7f0 0x7f472810cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54774/0 (socket says 172.21.15.152:54774) 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f47277fe700 1 -- 172.21.15.152:0/3290052476 learned_addr learned my addr 172.21.15.152:0/3290052476 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f4726ffd700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fd150 0x7f472810d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f47277fe700 1 -- 172.21.15.152:0/3290052476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fd150 msgr2=0x7f472810d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.039+0000 7f47277fe700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fd150 0x7f472810d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.040+0000 7f47277fe700 1 -- 172.21.15.152:0/3290052476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c005040 con 0x7f47280fc7f0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.040+0000 7f47277fe700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fc7f0 0x7f472810cf80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f471800b4b0 tx=0x7f47180090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.040+0000 7f4724ff9700 1 -- 172.21.15.152:0/3290052476 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4718002500 con 0x7f47280fc7f0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.040+0000 7f4724ff9700 1 -- 172.21.15.152:0/3290052476 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4718002b10 con 0x7f47280fc7f0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.040+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47281073d0 con 0x7f47280fc7f0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.040+0000 7f4724ff9700 1 -- 172.21.15.152:0/3290052476 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4718012cf0 con 0x7f47280fc7f0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.040+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4728107910 con 0x7f47280fc7f0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.041+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472805f590 con 0x7f47280fc7f0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.041+0000 7f4724ff9700 1 -- 172.21.15.152:0/3290052476 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4718002660 con 0x7f47280fc7f0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.042+0000 7f4724ff9700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f471006caa0 0x7f471006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.042+0000 7f4726ffd700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f471006caa0 0x7f471006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.042+0000 7f4724ff9700 1 -- 172.21.15.152:0/3290052476 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f471808c040 con 0x7f47280fc7f0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.042+0000 7f4726ffd700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f471006caa0 0x7f471006ef60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f471c000c00 tx=0x7f471c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.046+0000 7f4724ff9700 1 -- 172.21.15.152:0/3290052476 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f47180599e0 con 0x7f47280fc7f0 2024-04-06T12:34:48.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.315+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4728108600 con 0x7f47280fc7f0 2024-04-06T12:34:48.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.315+0000 7f4724ff9700 1 -- 172.21.15.152:0/3290052476 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f4718059570 con 0x7f47280fc7f0 2024-04-06T12:34:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f471006caa0 msgr2=0x7f471006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f471006caa0 0x7f471006ef60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f471c000c00 tx=0x7f471c00b040).stop 2024-04-06T12:34:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fc7f0 msgr2=0x7f472810cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fc7f0 0x7f472810cf80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f471800b4b0 tx=0x7f47180090f0).stop 2024-04-06T12:34:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 shutdown_connections 2024-04-06T12:34:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f471006caa0 0x7f471006ef60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47280fc7f0 0x7f472810cf80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 --2- 172.21.15.152:0/3290052476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fd150 0x7f472810d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:48.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 >> 172.21.15.152:0/3290052476 conn(0x7f4728070590 msgr2=0x7f47280fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:48.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 shutdown_connections 2024-04-06T12:34:48.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:48.317+0000 7f472db4f700 1 -- 172.21.15.152:0/3290052476 wait complete. 2024-04-06T12:34:48.325 INFO:teuthology.orchestra.run.smithi152.stdout:true 2024-04-06T12:34:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:48 smithi152 ceph-mon[104634]: pgmap v261: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:48.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:48 smithi195 ceph-mon[85980]: pgmap v261: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:49.067 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -e sha1=052adcadd0534eddb0d73c5afbc083a84cd9dc46 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-06T12:34:49.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:49 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3290052476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:34:49.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:49 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3290052476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:34:50.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:50 smithi152 ceph-mon[104634]: pgmap v262: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:50.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:50 smithi195 ceph-mon[85980]: pgmap v262: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.164+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/3740397398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 msgr2=0x7fb7f00fcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.164+0000 7fb7f4ac4700 1 --2- 172.21.15.152:0/3740397398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 0x7fb7f00fcaf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fb7e00047f0 tx=0x7fb7e0009cb0).stop 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.164+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/3740397398 shutdown_connections 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.164+0000 7fb7f4ac4700 1 --2- 172.21.15.152:0/3740397398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00fd070 0x7fb7f00f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.164+0000 7fb7f4ac4700 1 --2- 172.21.15.152:0/3740397398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 0x7fb7f00fcaf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.164+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/3740397398 >> 172.21.15.152:0/3740397398 conn(0x7fb7f00f2310 msgr2=0x7fb7f00f4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.164+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/3740397398 shutdown_connections 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.164+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/3740397398 wait complete. 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.165+0000 7fb7f4ac4700 1 Processor -- start 2024-04-06T12:34:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.165+0000 7fb7f4ac4700 1 -- start start 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.165+0000 7fb7f4ac4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 0x7fb7f010d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.165+0000 7fb7f4ac4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00fd070 0x7fb7f010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.165+0000 7fb7f4ac4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f010dbe0 con 0x7fb7f00fc710 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.165+0000 7fb7f4ac4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f010dd20 con 0x7fb7f00fd070 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.165+0000 7fb7ee59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 0x7fb7f010d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7ee59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 0x7fb7f010d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54780/0 (socket says 172.21.15.152:54780) 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7ee59c700 1 -- 172.21.15.152:0/1640713329 learned_addr learned my addr 172.21.15.152:0/1640713329 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7edd9b700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00fd070 0x7fb7f010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7ee59c700 1 -- 172.21.15.152:0/1640713329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00fd070 msgr2=0x7fb7f010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7ee59c700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00fd070 0x7fb7f010d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7ee59c700 1 -- 172.21.15.152:0/1640713329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0005040 con 0x7fb7f00fc710 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7ee59c700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 0x7fb7f010d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb7e0009380 tx=0x7fb7e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7df7fe700 1 -- 172.21.15.152:0/1640713329 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e0018070 con 0x7fb7f00fc710 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7df7fe700 1 -- 172.21.15.152:0/1640713329 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7e0007e90 con 0x7fb7f00fc710 2024-04-06T12:34:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f0107140 con 0x7fb7f00fc710 2024-04-06T12:34:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7df7fe700 1 -- 172.21.15.152:0/1640713329 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e00123c0 con 0x7fb7f00fc710 2024-04-06T12:34:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.166+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f01076a0 con 0x7fb7f00fc710 2024-04-06T12:34:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.167+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f0060160 con 0x7fb7f00fc710 2024-04-06T12:34:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.168+0000 7fb7df7fe700 1 -- 172.21.15.152:0/1640713329 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb7e001d420 con 0x7fb7f00fc710 2024-04-06T12:34:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.168+0000 7fb7df7fe700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb7d806caf0 0x7fb7d806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.168+0000 7fb7df7fe700 1 -- 172.21.15.152:0/1640713329 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fb7e008cb60 con 0x7fb7f00fc710 2024-04-06T12:34:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.168+0000 7fb7edd9b700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb7d806caf0 0x7fb7d806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.168+0000 7fb7edd9b700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb7d806caf0 0x7fb7d806efb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb7e4009f20 tx=0x7fb7e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.172+0000 7fb7df7fe700 1 -- 172.21.15.152:0/1640713329 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fb7e005a5a0 con 0x7fb7f00fc710 2024-04-06T12:34:51.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.440+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb7f0108770 con 0x7fb7f00fc710 2024-04-06T12:34:51.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.441+0000 7fb7df7fe700 1 -- 172.21.15.152:0/1640713329 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb7e005a130 con 0x7fb7f00fc710 2024-04-06T12:34:51.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.443+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb7d806caf0 msgr2=0x7fb7d806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:51.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.443+0000 7fb7f4ac4700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb7d806caf0 0x7fb7d806efb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb7e4009f20 tx=0x7fb7e400b040).stop 2024-04-06T12:34:51.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.443+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 msgr2=0x7fb7f010d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:51.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.443+0000 7fb7f4ac4700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 0x7fb7f010d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb7e0009380 tx=0x7fb7e0009cb0).stop 2024-04-06T12:34:51.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.443+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 shutdown_connections 2024-04-06T12:34:51.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.443+0000 7fb7f4ac4700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fb7d806caf0 0x7fb7d806efb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:51.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.443+0000 7fb7f4ac4700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7f00fc710 0x7fb7f010d0f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:51.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.443+0000 7fb7f4ac4700 1 --2- 172.21.15.152:0/1640713329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7f00fd070 0x7fb7f010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:51.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.443+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 >> 172.21.15.152:0/1640713329 conn(0x7fb7f00f2310 msgr2=0x7fb7f00faad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:51.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.444+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 shutdown_connections 2024-04-06T12:34:51.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:51.444+0000 7fb7f4ac4700 1 -- 172.21.15.152:0/1640713329 wait complete. 2024-04-06T12:34:51.451 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 18.2.2-1086-g052adcad (052adcadd0534eddb0d73c5afbc083a84cd9dc46) reef (stable)" 2024-04-06T12:34:52.081 DEBUG:teuthology.parallel:result is None 2024-04-06T12:34:52.081 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-06T12:34:52.093 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:34:52.093 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 -- bash -c 'ceph fs dump' 2024-04-06T12:34:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:52 smithi152 ceph-mon[104634]: pgmap v263: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:52 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1640713329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:34:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:34:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:52 smithi195 ceph-mon[85980]: pgmap v263: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:52 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1640713329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-06T12:34:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:34:54.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3632900103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fe270 msgr2=0x7f1be00f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:54.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 --2- 172.21.15.152:0/3632900103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fe270 0x7f1be00f7a50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f1bdc0047f0 tx=0x7f1bdc009cb0).stop 2024-04-06T12:34:54.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3632900103 shutdown_connections 2024-04-06T12:34:54.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 --2- 172.21.15.152:0/3632900103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fe270 0x7f1be00f7a50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:54.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 --2- 172.21.15.152:0/3632900103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be00fd910 0x7f1be00fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3632900103 >> 172.21.15.152:0/3632900103 conn(0x7f1be00f3530 msgr2=0x7f1be00f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3632900103 shutdown_connections 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3632900103 wait complete. 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 Processor -- start 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.095+0000 7f1be7ca0700 1 -- start start 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be7ca0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fd910 0x7f1be006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be7ca0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be00fe270 0x7f1be006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be7ca0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be006bab0 con 0x7f1be00fd910 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be7ca0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be006bbf0 con 0x7f1be00fe270 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be5a3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fd910 0x7f1be006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be5a3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fd910 0x7f1be006b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39774/0 (socket says 172.21.15.152:39774) 2024-04-06T12:34:54.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be5a3c700 1 -- 172.21.15.152:0/3881067975 learned_addr learned my addr 172.21.15.152:0/3881067975 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be5a3c700 1 -- 172.21.15.152:0/3881067975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be00fe270 msgr2=0x7f1be006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be523b700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be00fe270 0x7f1be006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be5a3c700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be00fe270 0x7f1be006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be5a3c700 1 -- 172.21.15.152:0/3881067975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc005040 con 0x7f1be00fd910 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be5a3c700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fd910 0x7f1be006b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f1bd000c790 tx=0x7f1bd0004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1bd6ffd700 1 -- 172.21.15.152:0/3881067975 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd00106f0 con 0x7f1be00fd910 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be006bea0 con 0x7f1be00fd910 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1bd6ffd700 1 -- 172.21.15.152:0/3881067975 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1bd0010d00 con 0x7f1be00fd910 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1bd6ffd700 1 -- 172.21.15.152:0/3881067975 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd0012da0 con 0x7f1be00fd910 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.096+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be01146d0 con 0x7f1be00fd910 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.097+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be005f570 con 0x7f1be00fd910 2024-04-06T12:34:54.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.098+0000 7f1bd6ffd700 1 -- 172.21.15.152:0/3881067975 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1bd0012400 con 0x7f1be00fd910 2024-04-06T12:34:54.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.098+0000 7f1bd6ffd700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1bcc06caa0 0x7f1bcc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:54.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.098+0000 7f1bd6ffd700 1 -- 172.21.15.152:0/3881067975 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f1bd008b7c0 con 0x7f1be00fd910 2024-04-06T12:34:54.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.098+0000 7f1be523b700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1bcc06caa0 0x7f1bcc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:54.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.098+0000 7f1be523b700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1bcc06caa0 0x7f1bcc06ef60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1bdc000c00 tx=0x7f1bdc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:54.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.103+0000 7f1bd6ffd700 1 -- 172.21.15.152:0/3881067975 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f1bd0055770 con 0x7f1be00fd910 2024-04-06T12:34:54.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.332+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1be006c6b0 con 0x7f1be00fd910 2024-04-06T12:34:54.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.333+0000 7f1bd6ffd700 1 -- 172.21.15.152:0/3881067975 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1877 (secure 0 0 0) 0x7f1bd0058d90 con 0x7f1be00fd910 2024-04-06T12:34:54.329 INFO:teuthology.orchestra.run.smithi152.stdout:e35 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 35 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-06T12:20:00.340806+0000 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2024-04-06T12:33:17.250095+0000 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2024-04-06T12:34:54.330 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 92 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:in 0 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=34382} 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2024-04-06T12:34:54.331 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data enabled 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.spbxnv{0:34382} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.152:6826/754565867,v1:172.21.15.152:6827/754565867] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.mxtfph{0:34414} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6828/367125625,v1:172.21.15.152:6829/367125625] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:Standby daemons: 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.akamqf{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/2930845511,v1:172.21.15.195:6825/2930845511] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:34:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi195.ttgcpp{-1:44353} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/1415350806,v1:172.21.15.195:6827/1415350806] compat {c=[1],r=[1],i=[7ff]}] 2024-04-06T12:34:54.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1bcc06caa0 msgr2=0x7f1bcc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:54.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1bcc06caa0 0x7f1bcc06ef60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1bdc000c00 tx=0x7f1bdc00b040).stop 2024-04-06T12:34:54.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fd910 msgr2=0x7f1be006b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:54.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fd910 0x7f1be006b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f1bd000c790 tx=0x7f1bd0004330).stop 2024-04-06T12:34:54.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 shutdown_connections 2024-04-06T12:34:54.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1bcc06caa0 0x7f1bcc06ef60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:54.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1be00fd910 0x7f1be006b0d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:54.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 --2- 172.21.15.152:0/3881067975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be00fe270 0x7f1be006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:54.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 >> 172.21.15.152:0/3881067975 conn(0x7f1be00f3530 msgr2=0x7f1be00fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:54.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 shutdown_connections 2024-04-06T12:34:54.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:54.335+0000 7f1be7ca0700 1 -- 172.21.15.152:0/3881067975 wait complete. 2024-04-06T12:34:54.334 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 35 2024-04-06T12:34:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:54 smithi152 ceph-mon[104634]: pgmap v264: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:54 smithi195 ceph-mon[85980]: pgmap v264: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:34:54.936 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-06T12:34:54.948 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-06T12:34:55.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.071+0000 7f61ce368700 1 -- 172.21.15.152:0/4184370820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 msgr2=0x7f61c80fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.071+0000 7f61ce368700 1 --2- 172.21.15.152:0/4184370820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 0x7f61c80fcb10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f61bc0047f0 tx=0x7f61bc009cb0).stop 2024-04-06T12:34:55.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.071+0000 7f61ce368700 1 -- 172.21.15.152:0/4184370820 shutdown_connections 2024-04-06T12:34:55.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.071+0000 7f61ce368700 1 --2- 172.21.15.152:0/4184370820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c80fd090 0x7f61c80f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.071+0000 7f61ce368700 1 --2- 172.21.15.152:0/4184370820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 0x7f61c80fcb10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.071+0000 7f61ce368700 1 -- 172.21.15.152:0/4184370820 >> 172.21.15.152:0/4184370820 conn(0x7f61c806c760 msgr2=0x7f61c806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:55.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.071+0000 7f61ce368700 1 -- 172.21.15.152:0/4184370820 shutdown_connections 2024-04-06T12:34:55.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.071+0000 7f61ce368700 1 -- 172.21.15.152:0/4184370820 wait complete. 2024-04-06T12:34:55.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61ce368700 1 Processor -- start 2024-04-06T12:34:55.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61ce368700 1 -- start start 2024-04-06T12:34:55.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61ce368700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 0x7f61c810ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:55.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61ce368700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c80fd090 0x7f61c810d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:55.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61ce368700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c810d900 con 0x7f61c80fc730 2024-04-06T12:34:55.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61ce368700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c810da40 con 0x7f61c80fd090 2024-04-06T12:34:55.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61c7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 0x7f61c810ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:55.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61c7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 0x7f61c810ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39780/0 (socket says 172.21.15.152:39780) 2024-04-06T12:34:55.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61c7fff700 1 -- 172.21.15.152:0/682764176 learned_addr learned my addr 172.21.15.152:0/682764176 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:55.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61c77fe700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c80fd090 0x7f61c810d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61c7fff700 1 -- 172.21.15.152:0/682764176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c80fd090 msgr2=0x7f61c810d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61c7fff700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c80fd090 0x7f61c810d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61c7fff700 1 -- 172.21.15.152:0/682764176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc005040 con 0x7f61c80fc730 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.072+0000 7f61c7fff700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 0x7f61c810ce10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f61bc005010 tx=0x7f61bc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.073+0000 7f61c57fa700 1 -- 172.21.15.152:0/682764176 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61bc00e030 con 0x7f61c80fc730 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.073+0000 7f61c57fa700 1 -- 172.21.15.152:0/682764176 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61bc007e90 con 0x7f61c80fc730 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.073+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c8107070 con 0x7f61c80fc730 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.073+0000 7f61c57fa700 1 -- 172.21.15.152:0/682764176 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61bc018070 con 0x7f61c80fc730 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.073+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c81075d0 con 0x7f61c80fc730 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.074+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c805f380 con 0x7f61c80fc730 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.074+0000 7f61c57fa700 1 -- 172.21.15.152:0/682764176 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f61bc01d6e0 con 0x7f61c80fc730 2024-04-06T12:34:55.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.075+0000 7f61c57fa700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f61b006ca30 0x7f61b006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:55.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.075+0000 7f61c57fa700 1 -- 172.21.15.152:0/682764176 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f61bc08d170 con 0x7f61c80fc730 2024-04-06T12:34:55.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.075+0000 7f61c77fe700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f61b006ca30 0x7f61b006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:55.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.075+0000 7f61c77fe700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f61b006ca30 0x7f61b006eef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f61c8108750 tx=0x7f61b8009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:55.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.079+0000 7f61c57fa700 1 -- 172.21.15.152:0/682764176 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f61bc05a920 con 0x7f61c80fc730 2024-04-06T12:34:55.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.270+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61c805eec0 con 0x7f61c80fc730 2024-04-06T12:34:55.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.271+0000 7f61c57fa700 1 -- 172.21.15.152:0/682764176 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16639 (secure 0 0 0) 0x7f61bc05a740 con 0x7f61c80fc730 2024-04-06T12:34:55.268 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:55.268 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":92,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","created":"2024-04-06T12:13:16.768469+0000","modified":"2024-04-06T12:33:00.179732+0000","last_up_change":"2024-04-06T12:31:57.863057+0000","last_in_change":"2024-04-06T12:18:18.562700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-06T12:17:21.824734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-06T12:19:59.272151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-06T12:19:59.568441+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb0a62c1-5f47-450c-8e9e-4e02c899eda3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":87,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6803","nonce":2874592048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6805","nonce":2874592048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6809","nonce":2874592048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6807","nonce":2874592048}]},"public_addr":"172.21.15.152:6803/2874592048","cluster_addr":"172.21.15.152:6805/2874592048","heartbeat_back_addr":"172.21.15.152:6809/2874592048","heartbeat_front_addr":"172.21.15.152:6807/2874592048","state":["exists","up"]},{"osd":1,"uuid":"f9490187-6df1-4d4f-bfd3-a2da32d3a669","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":87,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6811","nonce":697648342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6813","nonce":697648342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6817","nonce":697648342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6815","nonce":697648342}]},"public_addr":"172.21.15.152:6811/697648342","cluster_addr":"172.21.15.152:6813/697648342","heartbeat_back_addr":"172.21.15.152:6817/697648342","heartbeat_front_addr":"172.21.15.152:6815/697648342","state":["exists","up"]},{"osd":2,"uuid":"4a279284-26fa-436f-a830-abda13b40713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":87,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6819","nonce":426029450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6821","nonce":426029450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6825","nonce":426029450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6823","nonce":426029450}]},"public_addr":"172.21.15.152:6819/426029450","cluster_addr":"172.21.15.152:6821/426029450","heartbeat_back_addr":"172.21.15.152:6825/426029450","heartbeat_front_addr":"172.21.15.152:6823/426029450","state":["exists","up"]},{"osd":3,"uuid":"64e8942a-1121-44fd-9ed2-cbb5176df587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":72,"up_thru":87,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6801","nonce":2677078036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6803","nonce":2677078036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6807","nonce":2677078036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6805","nonce":2677078036}]},"public_addr":"172.21.15.195:6801/2677078036","cluster_addr":"172.21.15.195:6803/2677078036","heartbeat_back_addr":"172.21.15.195:6807/2677078036","heartbeat_front_addr":"172.21.15.195:6805/2677078036","state":["exists","up"]},{"osd":4,"uuid":"378a7c45-9887-4e48-b004-0f3b470af912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":77,"up_from":81,"up_thru":87,"down_at":78,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6809","nonce":4141179082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6811","nonce":4141179082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6815","nonce":4141179082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6813","nonce":4141179082}]},"public_addr":"172.21.15.195:6809/4141179082","cluster_addr":"172.21.15.195:6811/4141179082","heartbeat_back_addr":"172.21.15.195:6815/4141179082","heartbeat_front_addr":"172.21.15.195:6813/4141179082","state":["exists","up"]},{"osd":5,"uuid":"2608627e-47c5-446a-b13e-699aaaea81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":82,"up_from":87,"up_thru":87,"down_at":83,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6817","nonce":666904784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6819","nonce":666904784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6823","nonce":666904784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6821","nonce":666904784}]},"public_addr":"172.21.15.195:6817/666904784","cluster_addr":"172.21.15.195:6819/666904784","heartbeat_back_addr":"172.21.15.195:6823/666904784","heartbeat_front_addr":"172.21.15.195:6821/666904784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:18.549757+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:51.020120+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:20.272551+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:44.651165+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:09.828133+0000","dead_epoch":77},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:35.929735+0000","dead_epoch":82}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":0,"to":2}]},{"pgid":"2.8","mappings":[{"from":0,"to":2}]},{"pgid":"2.e","mappings":[{"from":0,"to":5}]},{"pgid":"3.0","mappings":[{"from":1,"to":3}]},{"pgid":"3.15","mappings":[{"from":4,"to":2}]},{"pgid":"3.18","mappings":[{"from":1,"to":3}]},{"pgid":"3.1d","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6827/3193759698":"2024-04-07T12:33:00.179702+0000","172.21.15.195:6826/3193759698":"2024-04-07T12:33:00.179702+0000","172.21.15.152:6826/3429506423":"2024-04-07T12:32:01.574018+0000","172.21.15.152:0/1001505472":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6801/2887118719":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6800/2887118719":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6800/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6801/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:6801/3059779308":"2024-04-07T12:22:14.581351+0000","172.21.15.195:6828/929884390":"2024-04-07T12:24:53.099048+0000","172.21.15.152:0/2556143500":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/1200342064":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/496247839":"2024-04-07T12:27:36.998356+0000","172.21.15.152:0/378420270":"2024-04-07T12:14:19.995122+0000","172.21.15.195:6825/3550026836":"2024-04-07T12:32:38.699104+0000","172.21.15.152:6800/3059779308":"2024-04-07T12:22:14.581351+0000","172.21.15.152:6800/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.195:6824/3550026836":"2024-04-07T12:32:38.699104+0000","172.21.15.152:0/2583442237":"2024-04-07T12:13:49.213100+0000","172.21.15.152:0/3513201934":"2024-04-07T12:27:36.998356+0000","172.21.15.152:0/2930097039":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/944313623":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6800/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/2646133243":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6801/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.195:0/705319294":"2024-04-07T12:24:53.099048+0000","172.21.15.152:0/1500470379":"2024-04-07T12:22:14.581351+0000","172.21.15.152:6801/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6827/3429506423":"2024-04-07T12:32:01.574018+0000","172.21.15.195:0/4169384300":"2024-04-07T12:24:53.099048+0000","172.21.15.152:0/2875093102":"2024-04-07T12:22:14.581351+0000","172.21.15.195:0/2368565634":"2024-04-07T12:24:53.099048+0000","172.21.15.195:6829/929884390":"2024-04-07T12:24:53.099048+0000","172.21.15.195:0/3242451589":"2024-04-07T12:24:53.099048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T12:34:55.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.273+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f61b006ca30 msgr2=0x7f61b006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.273+0000 7f61ce368700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f61b006ca30 0x7f61b006eef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f61c8108750 tx=0x7f61b8009da0).stop 2024-04-06T12:34:55.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.273+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 msgr2=0x7f61c810ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.273+0000 7f61ce368700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 0x7f61c810ce10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f61bc005010 tx=0x7f61bc009cb0).stop 2024-04-06T12:34:55.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.274+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 shutdown_connections 2024-04-06T12:34:55.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.274+0000 7f61ce368700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f61b006ca30 0x7f61b006eef0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.274+0000 7f61ce368700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61c80fc730 0x7f61c810ce10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.274+0000 7f61ce368700 1 --2- 172.21.15.152:0/682764176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61c80fd090 0x7f61c810d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.274+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 >> 172.21.15.152:0/682764176 conn(0x7f61c806c760 msgr2=0x7f61c80faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:55.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.274+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 shutdown_connections 2024-04-06T12:34:55.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.274+0000 7f61ce368700 1 -- 172.21.15.152:0/682764176 wait complete. 2024-04-06T12:34:55.283 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-06T12:17:21.824734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-06T12:19:59.272151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-06T12:19:59.568441+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-06T12:34:55.283 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 -- 172.21.15.152:0/2889812632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 msgr2=0x7fc8ec0fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 --2- 172.21.15.152:0/2889812632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 0x7fc8ec0fcc70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fc8e00047f0 tx=0x7fc8e0009cb0).stop 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 -- 172.21.15.152:0/2889812632 shutdown_connections 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 --2- 172.21.15.152:0/2889812632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec0fd1f0 0x7fc8ec0f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 --2- 172.21.15.152:0/2889812632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 0x7fc8ec0fcc70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 -- 172.21.15.152:0/2889812632 >> 172.21.15.152:0/2889812632 conn(0x7fc8ec0f2490 msgr2=0x7fc8ec0f48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 -- 172.21.15.152:0/2889812632 shutdown_connections 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 -- 172.21.15.152:0/2889812632 wait complete. 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 Processor -- start 2024-04-06T12:34:55.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.406+0000 7fc8f216b700 1 -- start start 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8f216b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 0x7fc8ec0fa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8f216b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec0fd1f0 0x7fc8ec0f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8f216b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0f8b20 con 0x7fc8ec0fc890 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8f216b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0f8c60 con 0x7fc8ec0fd1f0 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8eb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 0x7fc8ec0fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8eb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 0x7fc8ec0fa040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39808/0 (socket says 172.21.15.152:39808) 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8eb7fe700 1 -- 172.21.15.152:0/659626406 learned_addr learned my addr 172.21.15.152:0/659626406 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8eb7fe700 1 -- 172.21.15.152:0/659626406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec0fd1f0 msgr2=0x7fc8ec0f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8eaffd700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec0fd1f0 0x7fc8ec0f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8eb7fe700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec0fd1f0 0x7fc8ec0f85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8eb7fe700 1 -- 172.21.15.152:0/659626406 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e0005040 con 0x7fc8ec0fc890 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8eb7fe700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 0x7fc8ec0fa040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fc8e0009380 tx=0x7fc8e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8e8ff9700 1 -- 172.21.15.152:0/659626406 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e0018070 con 0x7fc8ec0fc890 2024-04-06T12:34:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8e8ff9700 1 -- 172.21.15.152:0/659626406 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8e0007e90 con 0x7fc8ec0fc890 2024-04-06T12:34:55.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec0f8ee0 con 0x7fc8ec0fc890 2024-04-06T12:34:55.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8e8ff9700 1 -- 172.21.15.152:0/659626406 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e00123c0 con 0x7fc8ec0fc890 2024-04-06T12:34:55.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.407+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec0f93c0 con 0x7fc8ec0fc890 2024-04-06T12:34:55.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.408+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec05f2e0 con 0x7fc8ec0fc890 2024-04-06T12:34:55.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.409+0000 7fc8e8ff9700 1 -- 172.21.15.152:0/659626406 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc8e001d420 con 0x7fc8ec0fc890 2024-04-06T12:34:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.409+0000 7fc8e8ff9700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc8d406caa0 0x7fc8d406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.409+0000 7fc8e8ff9700 1 -- 172.21.15.152:0/659626406 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fc8e008cc30 con 0x7fc8ec0fc890 2024-04-06T12:34:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.409+0000 7fc8eaffd700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc8d406caa0 0x7fc8d406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.410+0000 7fc8eaffd700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc8d406caa0 0x7fc8d406ef60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc8dc009f20 tx=0x7fc8dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:55.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.414+0000 7fc8e8ff9700 1 -- 172.21.15.152:0/659626406 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fc8e005a5d0 con 0x7fc8ec0fc890 2024-04-06T12:34:55.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:55 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3881067975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:34:55.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:55 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3881067975' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-06T12:34:55.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.601+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8ec119140 con 0x7fc8ec0fc890 2024-04-06T12:34:55.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.601+0000 7fc8e8ff9700 1 -- 172.21.15.152:0/659626406 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8e005a160 con 0x7fc8ec0fc890 2024-04-06T12:34:55.598 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-06T12:34:55.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.603+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc8d406caa0 msgr2=0x7fc8d406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.603+0000 7fc8f216b700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc8d406caa0 0x7fc8d406ef60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc8dc009f20 tx=0x7fc8dc00b040).stop 2024-04-06T12:34:55.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.603+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 msgr2=0x7fc8ec0fa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.603+0000 7fc8f216b700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 0x7fc8ec0fa040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fc8e0009380 tx=0x7fc8e0009cb0).stop 2024-04-06T12:34:55.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.603+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 shutdown_connections 2024-04-06T12:34:55.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.603+0000 7fc8f216b700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc8d406caa0 0x7fc8d406ef60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.603+0000 7fc8f216b700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8ec0fc890 0x7fc8ec0fa040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.603+0000 7fc8f216b700 1 --2- 172.21.15.152:0/659626406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec0fd1f0 0x7fc8ec0f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.604+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 >> 172.21.15.152:0/659626406 conn(0x7fc8ec0f2490 msgr2=0x7fc8ec060e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:55.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.604+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 shutdown_connections 2024-04-06T12:34:55.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.604+0000 7fc8f216b700 1 -- 172.21.15.152:0/659626406 wait complete. 2024-04-06T12:34:55.612 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-06T12:34:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.735+0000 7f92a8ab4700 1 -- 172.21.15.152:0/1752190158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f9420 msgr2=0x7f92a4101b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.735+0000 7f92a8ab4700 1 --2- 172.21.15.152:0/1752190158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f9420 0x7f92a4101b30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f92940047f0 tx=0x7f9294009cb0).stop 2024-04-06T12:34:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.735+0000 7f92a8ab4700 1 -- 172.21.15.152:0/1752190158 shutdown_connections 2024-04-06T12:34:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.735+0000 7f92a8ab4700 1 --2- 172.21.15.152:0/1752190158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f9420 0x7f92a4101b30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.735+0000 7f92a8ab4700 1 --2- 172.21.15.152:0/1752190158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a40f8ac0 0x7f92a40f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.735+0000 7f92a8ab4700 1 -- 172.21.15.152:0/1752190158 >> 172.21.15.152:0/1752190158 conn(0x7f92a40f25d0 msgr2=0x7f92a40f49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.735+0000 7f92a8ab4700 1 -- 172.21.15.152:0/1752190158 shutdown_connections 2024-04-06T12:34:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.735+0000 7f92a8ab4700 1 -- 172.21.15.152:0/1752190158 wait complete. 2024-04-06T12:34:55.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a8ab4700 1 Processor -- start 2024-04-06T12:34:55.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a8ab4700 1 -- start start 2024-04-06T12:34:55.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a8ab4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f8ac0 0x7f92a410e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a8ab4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a40f9420 0x7f92a410e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a8ab4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a410ee30 con 0x7f92a40f8ac0 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a8ab4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a410ef70 con 0x7f92a40f9420 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f8ac0 0x7f92a410e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f8ac0 0x7f92a410e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39824/0 (socket says 172.21.15.152:39824) 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a259c700 1 -- 172.21.15.152:0/2896792762 learned_addr learned my addr 172.21.15.152:0/2896792762 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a1d9b700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a40f9420 0x7f92a410e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a259c700 1 -- 172.21.15.152:0/2896792762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a40f9420 msgr2=0x7f92a410e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a259c700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a40f9420 0x7f92a410e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a259c700 1 -- 172.21.15.152:0/2896792762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294005040 con 0x7f92a40f8ac0 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.736+0000 7f92a259c700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f8ac0 0x7f92a410e340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f928c0041d0 tx=0x7f928c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.737+0000 7f929b7fe700 1 -- 172.21.15.152:0/2896792762 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928c002d90 con 0x7f92a40f8ac0 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.737+0000 7f929b7fe700 1 -- 172.21.15.152:0/2896792762 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f928c00f040 con 0x7f92a40f8ac0 2024-04-06T12:34:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.737+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a4108600 con 0x7f92a40f8ac0 2024-04-06T12:34:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.737+0000 7f929b7fe700 1 -- 172.21.15.152:0/2896792762 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928c00d800 con 0x7f92a40f8ac0 2024-04-06T12:34:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.737+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a4108b40 con 0x7f92a40f8ac0 2024-04-06T12:34:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.738+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a40603b0 con 0x7f92a40f8ac0 2024-04-06T12:34:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.738+0000 7f929b7fe700 1 -- 172.21.15.152:0/2896792762 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f928c00dac0 con 0x7f92a40f8ac0 2024-04-06T12:34:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.738+0000 7f929b7fe700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f929006caa0 0x7f929006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.739+0000 7f929b7fe700 1 -- 172.21.15.152:0/2896792762 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f928c08bf10 con 0x7f92a40f8ac0 2024-04-06T12:34:55.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.739+0000 7f92a1d9b700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f929006caa0 0x7f929006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:55.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.739+0000 7f92a1d9b700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f929006caa0 0x7f929006ef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9294004f10 tx=0x7f929400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:55.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.743+0000 7f929b7fe700 1 -- 172.21.15.152:0/2896792762 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f928c059950 con 0x7f92a40f8ac0 2024-04-06T12:34:55.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.928+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f92a405f0f0 con 0x7f92a40f8ac0 2024-04-06T12:34:55.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.929+0000 7f929b7fe700 1 -- 172.21.15.152:0/2896792762 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f928c0594e0 con 0x7f92a40f8ac0 2024-04-06T12:34:55.925 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-06T12:34:55.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f929006caa0 msgr2=0x7f929006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f929006caa0 0x7f929006ef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9294004f10 tx=0x7f929400b040).stop 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f8ac0 msgr2=0x7f92a410e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f8ac0 0x7f92a410e340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f928c0041d0 tx=0x7f928c009f60).stop 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 shutdown_connections 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f929006caa0 0x7f929006ef60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a40f8ac0 0x7f92a410e340 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 --2- 172.21.15.152:0/2896792762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a40f9420 0x7f92a410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 >> 172.21.15.152:0/2896792762 conn(0x7f92a40f25d0 msgr2=0x7f92a40ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 shutdown_connections 2024-04-06T12:34:55.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:55.931+0000 7f92a8ab4700 1 -- 172.21.15.152:0/2896792762 wait complete. 2024-04-06T12:34:55.939 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-06T12:34:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.061+0000 7f4780fa0700 1 -- 172.21.15.152:0/524442058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 msgr2=0x7f477c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.061+0000 7f4780fa0700 1 --2- 172.21.15.152:0/524442058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 0x7f477c101a60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f47700047f0 tx=0x7f4770009cb0).stop 2024-04-06T12:34:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.061+0000 7f4780fa0700 1 -- 172.21.15.152:0/524442058 shutdown_connections 2024-04-06T12:34:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.061+0000 7f4780fa0700 1 --2- 172.21.15.152:0/524442058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 0x7f477c101a60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.061+0000 7f4780fa0700 1 --2- 172.21.15.152:0/524442058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c0f89f0 0x7f477c0f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.061+0000 7f4780fa0700 1 -- 172.21.15.152:0/524442058 >> 172.21.15.152:0/524442058 conn(0x7f477c06c760 msgr2=0x7f477c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.061+0000 7f4780fa0700 1 -- 172.21.15.152:0/524442058 shutdown_connections 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.061+0000 7f4780fa0700 1 -- 172.21.15.152:0/524442058 wait complete. 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4780fa0700 1 Processor -- start 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4780fa0700 1 -- start start 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4780fa0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c0f89f0 0x7f477c10df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4780fa0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 0x7f477c10e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4780fa0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c10ea50 con 0x7f477c0f92c0 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4780fa0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c10eb90 con 0x7f477c0f89f0 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4779d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 0x7f477c10e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4779d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 0x7f477c10e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39830/0 (socket says 172.21.15.152:39830) 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4779d9b700 1 -- 172.21.15.152:0/3546919467 learned_addr learned my addr 172.21.15.152:0/3546919467 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f477a59c700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c0f89f0 0x7f477c10df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:56.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4779d9b700 1 -- 172.21.15.152:0/3546919467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c0f89f0 msgr2=0x7f477c10df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4779d9b700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c0f89f0 0x7f477c10df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4779d9b700 1 -- 172.21.15.152:0/3546919467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770005040 con 0x7f477c0f92c0 2024-04-06T12:34:56.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.062+0000 7f4779d9b700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 0x7f477c10e450 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f4770009380 tx=0x7f4770009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:56.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.063+0000 7f476b7fe700 1 -- 172.21.15.152:0/3546919467 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f477000e070 con 0x7f477c0f92c0 2024-04-06T12:34:56.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.063+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c108220 con 0x7f477c0f92c0 2024-04-06T12:34:56.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.063+0000 7f476b7fe700 1 -- 172.21.15.152:0/3546919467 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4770007e90 con 0x7f477c0f92c0 2024-04-06T12:34:56.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.063+0000 7f476b7fe700 1 -- 172.21.15.152:0/3546919467 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4770018070 con 0x7f477c0f92c0 2024-04-06T12:34:56.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.063+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c108760 con 0x7f477c0f92c0 2024-04-06T12:34:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.064+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c05f380 con 0x7f477c0f92c0 2024-04-06T12:34:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.064+0000 7f476b7fe700 1 -- 172.21.15.152:0/3546919467 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f477001d420 con 0x7f477c0f92c0 2024-04-06T12:34:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.064+0000 7f476b7fe700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f476406caa0 0x7f476406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.064+0000 7f476b7fe700 1 -- 172.21.15.152:0/3546919467 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f477008c9c0 con 0x7f477c0f92c0 2024-04-06T12:34:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.065+0000 7f477a59c700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f476406caa0 0x7f476406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.065+0000 7f477a59c700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f476406caa0 0x7f476406ef60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4774004e60 tx=0x7f477400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:56.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.069+0000 7f476b7fe700 1 -- 172.21.15.152:0/3546919467 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f477005a400 con 0x7f477c0f92c0 2024-04-06T12:34:56.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.256+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f477c05eec0 con 0x7f477c0f92c0 2024-04-06T12:34:56.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.256+0000 7f476b7fe700 1 -- 172.21.15.152:0/3546919467 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4770059f90 con 0x7f477c0f92c0 2024-04-06T12:34:56.254 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-06T12:34:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f476406caa0 msgr2=0x7f476406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f476406caa0 0x7f476406ef60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4774004e60 tx=0x7f477400b040).stop 2024-04-06T12:34:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 msgr2=0x7f477c10e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 0x7f477c10e450 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f4770009380 tx=0x7f4770009cb0).stop 2024-04-06T12:34:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 shutdown_connections 2024-04-06T12:34:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f476406caa0 0x7f476406ef60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c0f89f0 0x7f477c10df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 --2- 172.21.15.152:0/3546919467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f477c0f92c0 0x7f477c10e450 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 >> 172.21.15.152:0/3546919467 conn(0x7f477c06c760 msgr2=0x7f477c0fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 shutdown_connections 2024-04-06T12:34:56.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.258+0000 7f4780fa0700 1 -- 172.21.15.152:0/3546919467 wait complete. 2024-04-06T12:34:56.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-06T12:34:56.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.387+0000 7f3c6330f700 1 -- 172.21.15.152:0/1978270139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fd090 msgr2=0x7f3c5c0f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.387+0000 7f3c6330f700 1 --2- 172.21.15.152:0/1978270139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fd090 0x7f3c5c0f6870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f3c4c0047f0 tx=0x7f3c4c009cb0).stop 2024-04-06T12:34:56.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.387+0000 7f3c6330f700 1 -- 172.21.15.152:0/1978270139 shutdown_connections 2024-04-06T12:34:56.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.387+0000 7f3c6330f700 1 --2- 172.21.15.152:0/1978270139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fd090 0x7f3c5c0f6870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.387+0000 7f3c6330f700 1 --2- 172.21.15.152:0/1978270139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c5c0fc730 0x7f3c5c0fcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.387+0000 7f3c6330f700 1 -- 172.21.15.152:0/1978270139 >> 172.21.15.152:0/1978270139 conn(0x7f3c5c06c760 msgr2=0x7f3c5c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:56.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.387+0000 7f3c6330f700 1 -- 172.21.15.152:0/1978270139 shutdown_connections 2024-04-06T12:34:56.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.387+0000 7f3c6330f700 1 -- 172.21.15.152:0/1978270139 wait complete. 2024-04-06T12:34:56.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c6330f700 1 Processor -- start 2024-04-06T12:34:56.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c6330f700 1 -- start start 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c6330f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc730 0x7f3c5c10ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c6330f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c5c0fd090 0x7f3c5c10d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c6330f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c10d980 con 0x7f3c5c0fc730 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c6330f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c10dac0 con 0x7f3c5c0fd090 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c610ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc730 0x7f3c5c10ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c610ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc730 0x7f3c5c10ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39854/0 (socket says 172.21.15.152:39854) 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c610ab700 1 -- 172.21.15.152:0/2554289343 learned_addr learned my addr 172.21.15.152:0/2554289343 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c608aa700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c5c0fd090 0x7f3c5c10d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c610ab700 1 -- 172.21.15.152:0/2554289343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c5c0fd090 msgr2=0x7f3c5c10d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c610ab700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c5c0fd090 0x7f3c5c10d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.388+0000 7f3c610ab700 1 -- 172.21.15.152:0/2554289343 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c005040 con 0x7f3c5c0fc730 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.389+0000 7f3c608aa700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c5c0fd090 0x7f3c5c10d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.389+0000 7f3c610ab700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc730 0x7f3c5c10ce90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f3c5800e970 tx=0x7f3c5800ed30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.389+0000 7f3c527fc700 1 -- 172.21.15.152:0/2554289343 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c5800cb90 con 0x7f3c5c0fc730 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.389+0000 7f3c527fc700 1 -- 172.21.15.152:0/2554289343 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3c5800ccf0 con 0x7f3c5c0fc730 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.389+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c107150 con 0x7f3c5c0fc730 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.389+0000 7f3c527fc700 1 -- 172.21.15.152:0/2554289343 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c58010610 con 0x7f3c5c0fc730 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.389+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c107690 con 0x7f3c5c0fc730 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.390+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c05f380 con 0x7f3c5c0fc730 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.390+0000 7f3c527fc700 1 -- 172.21.15.152:0/2554289343 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3c58011470 con 0x7f3c5c0fc730 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.390+0000 7f3c527fc700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3c4806caa0 0x7f3c4806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.391+0000 7f3c527fc700 1 -- 172.21.15.152:0/2554289343 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f3c5808e860 con 0x7f3c5c0fc730 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.391+0000 7f3c608aa700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3c4806caa0 0x7f3c4806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:56.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.391+0000 7f3c608aa700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3c4806caa0 0x7f3c4806ef60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3c4c0043d0 tx=0x7f3c4c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:56.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.395+0000 7f3c527fc700 1 -- 172.21.15.152:0/2554289343 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f3c5805c2a0 con 0x7f3c5c0fc730 2024-04-06T12:34:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:56 smithi152 ceph-mon[104634]: pgmap v265: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:56 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/682764176' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:34:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:56 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/659626406' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-06T12:34:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:56 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2896792762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-06T12:34:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:56 smithi195 ceph-mon[85980]: pgmap v265: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:56 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/682764176' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:34:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:56 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/659626406' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-06T12:34:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:56 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2896792762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-06T12:34:56.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.626+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c5c05eec0 con 0x7f3c5c0fc730 2024-04-06T12:34:56.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.627+0000 7f3c527fc700 1 -- 172.21.15.152:0/2554289343 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4840 (secure 0 0 0) 0x7f3c5805be30 con 0x7f3c5c0fc730 2024-04-06T12:34:56.625 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:56.625 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44353,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/1415350806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1415350806},{"type":"v1","addr":"172.21.15.195:6827","nonce":1415350806}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:33:17.250095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":28,"state":"up:active","state_seq":19,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34414":{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:56.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3c4806caa0 msgr2=0x7f3c4806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3c4806caa0 0x7f3c4806ef60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3c4c0043d0 tx=0x7f3c4c00b040).stop 2024-04-06T12:34:56.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc730 msgr2=0x7f3c5c10ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc730 0x7f3c5c10ce90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f3c5800e970 tx=0x7f3c5800ed30).stop 2024-04-06T12:34:56.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 shutdown_connections 2024-04-06T12:34:56.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3c4806caa0 0x7f3c4806ef60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc730 0x7f3c5c10ce90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 --2- 172.21.15.152:0/2554289343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c5c0fd090 0x7f3c5c10d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 >> 172.21.15.152:0/2554289343 conn(0x7f3c5c06c760 msgr2=0x7f3c5c0faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:56.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 shutdown_connections 2024-04-06T12:34:56.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.629+0000 7f3c6330f700 1 -- 172.21.15.152:0/2554289343 wait complete. 2024-04-06T12:34:56.628 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 35 2024-04-06T12:34:56.639 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 1, 'flags': 50} 2024-04-06T12:34:56.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 12 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.759+0000 7fd39aa22700 1 -- 172.21.15.152:0/1721866654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f89f0 msgr2=0x7fd3940f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.759+0000 7fd39aa22700 1 --2- 172.21.15.152:0/1721866654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f89f0 0x7fd3940f8dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fd3880047f0 tx=0x7fd388009cb0).stop 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.759+0000 7fd39aa22700 1 -- 172.21.15.152:0/1721866654 shutdown_connections 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.759+0000 7fd39aa22700 1 --2- 172.21.15.152:0/1721866654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3940f92c0 0x7fd394101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.759+0000 7fd39aa22700 1 --2- 172.21.15.152:0/1721866654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f89f0 0x7fd3940f8dd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.759+0000 7fd39aa22700 1 -- 172.21.15.152:0/1721866654 >> 172.21.15.152:0/1721866654 conn(0x7fd39406c760 msgr2=0x7fd39406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.759+0000 7fd39aa22700 1 -- 172.21.15.152:0/1721866654 shutdown_connections 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.759+0000 7fd39aa22700 1 -- 172.21.15.152:0/1721866654 wait complete. 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd39aa22700 1 Processor -- start 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd39aa22700 1 -- start start 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd39aa22700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3940f89f0 0x7fd39410dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:56.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd39aa22700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f92c0 0x7fd39410e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd39aa22700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39410eb20 con 0x7fd3940f92c0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd39aa22700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394108140 con 0x7fd3940f89f0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd3937fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f92c0 0x7fd39410e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd3937fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f92c0 0x7fd39410e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39872/0 (socket says 172.21.15.152:39872) 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd3937fe700 1 -- 172.21.15.152:0/3400146394 learned_addr learned my addr 172.21.15.152:0/3400146394 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd393fff700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3940f89f0 0x7fd39410dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd3937fe700 1 -- 172.21.15.152:0/3400146394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3940f89f0 msgr2=0x7fd39410dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd3937fe700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3940f89f0 0x7fd39410dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.760+0000 7fd3937fe700 1 -- 172.21.15.152:0/3400146394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388005040 con 0x7fd3940f92c0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.761+0000 7fd3937fe700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f92c0 0x7fd39410e490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fd38400b4b0 tx=0x7fd3840090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.761+0000 7fd3917fa700 1 -- 172.21.15.152:0/3400146394 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd384002500 con 0x7fd3940f92c0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.761+0000 7fd3917fa700 1 -- 172.21.15.152:0/3400146394 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd384002b10 con 0x7fd3940f92c0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.761+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3941083f0 con 0x7fd3940f92c0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.761+0000 7fd3917fa700 1 -- 172.21.15.152:0/3400146394 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd384012cb0 con 0x7fd3940f92c0 2024-04-06T12:34:56.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.761+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd394108930 con 0x7fd3940f92c0 2024-04-06T12:34:56.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.762+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39405f380 con 0x7fd3940f92c0 2024-04-06T12:34:56.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.762+0000 7fd3917fa700 1 -- 172.21.15.152:0/3400146394 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd384002660 con 0x7fd3940f92c0 2024-04-06T12:34:56.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.762+0000 7fd3917fa700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd37c06caa0 0x7fd37c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:56.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.763+0000 7fd3917fa700 1 -- 172.21.15.152:0/3400146394 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fd38408bf00 con 0x7fd3940f92c0 2024-04-06T12:34:56.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.763+0000 7fd393fff700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd37c06caa0 0x7fd37c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:56.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.763+0000 7fd393fff700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd37c06caa0 0x7fd37c06ef60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd3880047c0 tx=0x7fd38800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:56.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.767+0000 7fd3917fa700 1 -- 172.21.15.152:0/3400146394 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fd384059940 con 0x7fd3940f92c0 2024-04-06T12:34:56.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.996+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 12, "format": "json"} v 0) v1 -- 0x7fd394109620 con 0x7fd3940f92c0 2024-04-06T12:34:56.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.996+0000 7fd3917fa700 1 -- 172.21.15.152:0/3400146394 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 12, "format": "json"}]=0 dumped fsmap epoch 12 v35) v1 ==== 107+0+4054 (secure 0 0 0) 0x7fd3840594d0 con 0x7fd3940f92c0 2024-04-06T12:34:56.994 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:56.994 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:31:57.858085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14434":{"gid":14434,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.152:6827/3429506423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3429506423},{"type":"v1","addr":"172.21.15.152:6827","nonce":3429506423}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:56.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.998+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd37c06caa0 msgr2=0x7fd37c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.998+0000 7fd39aa22700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd37c06caa0 0x7fd37c06ef60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd3880047c0 tx=0x7fd38800b040).stop 2024-04-06T12:34:56.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.998+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f92c0 msgr2=0x7fd39410e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:56.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.998+0000 7fd39aa22700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f92c0 0x7fd39410e490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fd38400b4b0 tx=0x7fd3840090f0).stop 2024-04-06T12:34:56.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.999+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 shutdown_connections 2024-04-06T12:34:56.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.999+0000 7fd39aa22700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd37c06caa0 0x7fd37c06ef60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.999+0000 7fd39aa22700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3940f89f0 0x7fd39410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.999+0000 7fd39aa22700 1 --2- 172.21.15.152:0/3400146394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3940f92c0 0x7fd39410e490 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:56.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.999+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 >> 172.21.15.152:0/3400146394 conn(0x7fd39406c760 msgr2=0x7fd3940fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:56.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.999+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 shutdown_connections 2024-04-06T12:34:56.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:56.999+0000 7fd39aa22700 1 -- 172.21.15.152:0/3400146394 wait complete. 2024-04-06T12:34:56.997 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 12 2024-04-06T12:34:57.008 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 12 2024-04-06T12:34:57.008 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 13 2024-04-06T12:34:57.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.127+0000 7f5602d34700 1 -- 172.21.15.152:0/3052108508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 msgr2=0x7f55fc0f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.127+0000 7f5602d34700 1 --2- 172.21.15.152:0/3052108508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 0x7f55fc0f8dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f55f00047f0 tx=0x7f55f0009cb0).stop 2024-04-06T12:34:57.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.128+0000 7f5602d34700 1 -- 172.21.15.152:0/3052108508 shutdown_connections 2024-04-06T12:34:57.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.128+0000 7f5602d34700 1 --2- 172.21.15.152:0/3052108508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc0f92c0 0x7f55fc101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.128+0000 7f5602d34700 1 --2- 172.21.15.152:0/3052108508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 0x7f55fc0f8dd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.128+0000 7f5602d34700 1 -- 172.21.15.152:0/3052108508 >> 172.21.15.152:0/3052108508 conn(0x7f55fc06c760 msgr2=0x7f55fc06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:57.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.128+0000 7f5602d34700 1 -- 172.21.15.152:0/3052108508 shutdown_connections 2024-04-06T12:34:57.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.128+0000 7f5602d34700 1 -- 172.21.15.152:0/3052108508 wait complete. 2024-04-06T12:34:57.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.128+0000 7f5602d34700 1 Processor -- start 2024-04-06T12:34:57.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.128+0000 7f5602d34700 1 -- start start 2024-04-06T12:34:57.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5602d34700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 0x7f55fc10dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:57.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5602d34700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc0f92c0 0x7f55fc10e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:57.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5602d34700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc10eac0 con 0x7f55fc0f89f0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5602d34700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc10ec00 con 0x7f55fc0f92c0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5600ad0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 0x7f55fc10dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5600ad0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 0x7f55fc10dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39890/0 (socket says 172.21.15.152:39890) 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5600ad0700 1 -- 172.21.15.152:0/2920506730 learned_addr learned my addr 172.21.15.152:0/2920506730 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5600ad0700 1 -- 172.21.15.152:0/2920506730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc0f92c0 msgr2=0x7f55fc10e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5600ad0700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc0f92c0 0x7f55fc10e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5600ad0700 1 -- 172.21.15.152:0/2920506730 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0005040 con 0x7f55fc0f89f0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5600ad0700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 0x7f55fc10dfd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f55f0009380 tx=0x7f55f0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f55f9ffb700 1 -- 172.21.15.152:0/2920506730 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f000e070 con 0x7f55fc0f89f0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f55f9ffb700 1 -- 172.21.15.152:0/2920506730 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f55f0007e90 con 0x7f55fc0f89f0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc108290 con 0x7f55fc0f89f0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.129+0000 7f55f9ffb700 1 -- 172.21.15.152:0/2920506730 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f0018070 con 0x7f55fc0f89f0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.130+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc1087d0 con 0x7f55fc0f89f0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.131+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc05f380 con 0x7f55fc0f89f0 2024-04-06T12:34:57.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.131+0000 7f55f9ffb700 1 -- 172.21.15.152:0/2920506730 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f55f001d420 con 0x7f55fc0f89f0 2024-04-06T12:34:57.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.131+0000 7f55f9ffb700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f55ec06caa0 0x7f55ec06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:57.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.131+0000 7f55f9ffb700 1 -- 172.21.15.152:0/2920506730 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f55f008cae0 con 0x7f55fc0f89f0 2024-04-06T12:34:57.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.132+0000 7f55fbfff700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f55ec06caa0 0x7f55ec06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:57.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.132+0000 7f55fbfff700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f55ec06caa0 0x7f55ec06ef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f55fc109910 tx=0x7f55e8009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:57.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.136+0000 7f55f9ffb700 1 -- 172.21.15.152:0/2920506730 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f55f005a480 con 0x7f55fc0f89f0 2024-04-06T12:34:57.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:57 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3546919467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-06T12:34:57.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:57 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2554289343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-06T12:34:57.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:57 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3400146394' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 12, "format": "json"}]: dispatch 2024-04-06T12:34:57.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.382+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) v1 -- 0x7f55fc0fef60 con 0x7f55fc0f89f0 2024-04-06T12:34:57.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.383+0000 7f55f9ffb700 1 -- 172.21.15.152:0/2920506730 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v35) v1 ==== 107+0+4836 (secure 0 0 0) 0x7f55f005a010 con 0x7f55fc0f89f0 2024-04-06T12:34:57.381 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:57.381 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34378,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/1788558838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1788558838},{"type":"v1","addr":"172.21.15.152:6829","nonce":1788558838}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:31:57.858085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14434":{"gid":14434,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.152:6827/3429506423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3429506423},{"type":"v1","addr":"172.21.15.152:6827","nonce":3429506423}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:57.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f55ec06caa0 msgr2=0x7f55ec06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f55ec06caa0 0x7f55ec06ef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f55fc109910 tx=0x7f55e8009b60).stop 2024-04-06T12:34:57.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 msgr2=0x7f55fc10dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 0x7f55fc10dfd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f55f0009380 tx=0x7f55f0009cb0).stop 2024-04-06T12:34:57.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 shutdown_connections 2024-04-06T12:34:57.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f55ec06caa0 0x7f55ec06ef60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55fc0f89f0 0x7f55fc10dfd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 --2- 172.21.15.152:0/2920506730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55fc0f92c0 0x7f55fc10e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:34:57.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 >> 172.21.15.152:0/2920506730 conn(0x7f55fc06c760 msgr2=0x7f55fc0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:57.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 shutdown_connections 2024-04-06T12:34:57.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.385+0000 7f5602d34700 1 -- 172.21.15.152:0/2920506730 wait complete. 2024-04-06T12:34:57.385 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 13 2024-04-06T12:34:57.395 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 13 2024-04-06T12:34:57.395 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-04-06T12:34:57.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.516+0000 7f0d0588b700 1 -- 172.21.15.152:0/4129232863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fd8d0 msgr2=0x7f0d000fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.516+0000 7f0d0588b700 1 --2- 172.21.15.152:0/4129232863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fd8d0 0x7f0d000fdcb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f0cf4004730 tx=0x7f0cf4009cb0).stop 2024-04-06T12:34:57.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.516+0000 7f0d0588b700 1 -- 172.21.15.152:0/4129232863 shutdown_connections 2024-04-06T12:34:57.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.516+0000 7f0d0588b700 1 --2- 172.21.15.152:0/4129232863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d000fe230 0x7f0d000f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.516+0000 7f0d0588b700 1 --2- 172.21.15.152:0/4129232863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fd8d0 0x7f0d000fdcb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.516+0000 7f0d0588b700 1 -- 172.21.15.152:0/4129232863 >> 172.21.15.152:0/4129232863 conn(0x7f0d000f3490 msgr2=0x7f0d000f58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.516+0000 7f0d0588b700 1 -- 172.21.15.152:0/4129232863 shutdown_connections 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.516+0000 7f0d0588b700 1 -- 172.21.15.152:0/4129232863 wait complete. 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.516+0000 7f0d0588b700 1 Processor -- start 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0d0588b700 1 -- start start 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0d0588b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d000fd8d0 0x7f0d0010e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0d0588b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fe230 0x7f0d0010e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0d0588b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0010eb10 con 0x7f0d000fe230 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0d0588b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0010ec50 con 0x7f0d000fd8d0 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0cfe7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fe230 0x7f0d0010e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0cfe7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fe230 0x7f0d0010e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39910/0 (socket says 172.21.15.152:39910) 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0cfe7fc700 1 -- 172.21.15.152:0/1810357081 learned_addr learned my addr 172.21.15.152:0/1810357081 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0cfeffd700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d000fd8d0 0x7f0d0010e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0cfe7fc700 1 -- 172.21.15.152:0/1810357081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d000fd8d0 msgr2=0x7f0d0010e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0cfe7fc700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d000fd8d0 0x7f0d0010e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0cfe7fc700 1 -- 172.21.15.152:0/1810357081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4005040 con 0x7f0d000fe230 2024-04-06T12:34:57.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0cfe7fc700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fe230 0x7f0d0010e510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f0cf000e8c0 tx=0x7f0cf000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:57.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0ce7fff700 1 -- 172.21.15.152:0/1810357081 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf0007b40 con 0x7f0d000fe230 2024-04-06T12:34:57.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0ce7fff700 1 -- 172.21.15.152:0/1810357081 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cf000f040 con 0x7f0d000fe230 2024-04-06T12:34:57.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d001082e0 con 0x7f0d000fe230 2024-04-06T12:34:57.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.517+0000 7f0ce7fff700 1 -- 172.21.15.152:0/1810357081 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf0014810 con 0x7f0d000fe230 2024-04-06T12:34:57.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.518+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d001088a0 con 0x7f0d000fe230 2024-04-06T12:34:57.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.518+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d000606d0 con 0x7f0d000fe230 2024-04-06T12:34:57.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.519+0000 7f0ce7fff700 1 -- 172.21.15.152:0/1810357081 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0cf0014a80 con 0x7f0d000fe230 2024-04-06T12:34:57.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.519+0000 7f0ce7fff700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ce806caa0 0x7f0ce806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:57.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.519+0000 7f0ce7fff700 1 -- 172.21.15.152:0/1810357081 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f0cf008b930 con 0x7f0d000fe230 2024-04-06T12:34:57.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.519+0000 7f0cfeffd700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ce806caa0 0x7f0ce806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:57.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.520+0000 7f0cfeffd700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ce806caa0 0x7f0ce806ef60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0cf4004da0 tx=0x7f0cf4016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:57.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.523+0000 7f0ce7fff700 1 -- 172.21.15.152:0/1810357081 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f0cf0059370 con 0x7f0d000fe230 2024-04-06T12:34:57.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:57 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3546919467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-06T12:34:57.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:57 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2554289343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-06T12:34:57.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:57 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3400146394' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 12, "format": "json"}]: dispatch 2024-04-06T12:34:57.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.752+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7f0d000ffc60 con 0x7f0d000fe230 2024-04-06T12:34:57.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.753+0000 7f0ce7fff700 1 -- 172.21.15.152:0/1810357081 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v35) v1 ==== 107+0+4045 (secure 0 0 0) 0x7f0cf0058f00 con 0x7f0d000fe230 2024-04-06T12:34:57.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:57.751 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34378,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/1788558838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1788558838},{"type":"v1","addr":"172.21.15.152:6829","nonce":1788558838}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:01.574511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:57.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ce806caa0 msgr2=0x7f0ce806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ce806caa0 0x7f0ce806ef60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0cf4004da0 tx=0x7f0cf4016040).stop 2024-04-06T12:34:57.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fe230 msgr2=0x7f0d0010e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fe230 0x7f0d0010e510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f0cf000e8c0 tx=0x7f0cf000b040).stop 2024-04-06T12:34:57.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 shutdown_connections 2024-04-06T12:34:57.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ce806caa0 0x7f0ce806ef60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d000fd8d0 0x7f0d0010e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 --2- 172.21.15.152:0/1810357081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d000fe230 0x7f0d0010e510 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 >> 172.21.15.152:0/1810357081 conn(0x7f0d000f3490 msgr2=0x7f0d000fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:57.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 shutdown_connections 2024-04-06T12:34:57.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.755+0000 7f0d0588b700 1 -- 172.21.15.152:0/1810357081 wait complete. 2024-04-06T12:34:57.754 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 14 2024-04-06T12:34:57.765 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 14 2024-04-06T12:34:57.765 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-04-06T12:34:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.884+0000 7fc4038c8700 1 -- 172.21.15.152:0/1192230035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fd170 msgr2=0x7fc3fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.884+0000 7fc4038c8700 1 --2- 172.21.15.152:0/1192230035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fd170 0x7fc3fc0f6950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fc3f80047f0 tx=0x7fc3f8009cb0).stop 2024-04-06T12:34:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.884+0000 7fc4038c8700 1 -- 172.21.15.152:0/1192230035 shutdown_connections 2024-04-06T12:34:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.884+0000 7fc4038c8700 1 --2- 172.21.15.152:0/1192230035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fd170 0x7fc3fc0f6950 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.884+0000 7fc4038c8700 1 --2- 172.21.15.152:0/1192230035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0fc810 0x7fc3fc0fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.884+0000 7fc4038c8700 1 -- 172.21.15.152:0/1192230035 >> 172.21.15.152:0/1192230035 conn(0x7fc3fc0f23f0 msgr2=0x7fc3fc0f4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.884+0000 7fc4038c8700 1 -- 172.21.15.152:0/1192230035 shutdown_connections 2024-04-06T12:34:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.884+0000 7fc4038c8700 1 -- 172.21.15.152:0/1192230035 wait complete. 2024-04-06T12:34:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc4038c8700 1 Processor -- start 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc4038c8700 1 -- start start 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc4038c8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fc810 0x7fc3fc1091c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc4038c8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0fd170 0x7fc3fc1096b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc4038c8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc109ba0 con 0x7fc3fc0fc810 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc4038c8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc109ce0 con 0x7fc3fc0fd170 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc401664700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fc810 0x7fc3fc1091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc401664700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fc810 0x7fc3fc1091c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39924/0 (socket says 172.21.15.152:39924) 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc401664700 1 -- 172.21.15.152:0/366613088 learned_addr learned my addr 172.21.15.152:0/366613088 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.885+0000 7fc400e63700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0fd170 0x7fc3fc1096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc401664700 1 -- 172.21.15.152:0/366613088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0fd170 msgr2=0x7fc3fc1096b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc401664700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0fd170 0x7fc3fc1096b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc401664700 1 -- 172.21.15.152:0/366613088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f8005040 con 0x7fc3fc0fc810 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc400e63700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0fd170 0x7fc3fc1096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:34:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc401664700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fc810 0x7fc3fc1091c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc3ec00e8f0 tx=0x7fc3ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:57.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc3f27fc700 1 -- 172.21.15.152:0/366613088 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ec00ee90 con 0x7fc3fc0fc810 2024-04-06T12:34:57.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc3f27fc700 1 -- 172.21.15.152:0/366613088 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3ec00f040 con 0x7fc3fc0fc810 2024-04-06T12:34:57.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc3f27fc700 1 -- 172.21.15.152:0/366613088 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ec00c8a0 con 0x7fc3fc0fc810 2024-04-06T12:34:57.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc109f90 con 0x7fc3fc0fc810 2024-04-06T12:34:57.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.886+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc1125b0 con 0x7fc3fc0fc810 2024-04-06T12:34:57.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.887+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc05f2e0 con 0x7fc3fc0fc810 2024-04-06T12:34:57.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.887+0000 7fc3f27fc700 1 -- 172.21.15.152:0/366613088 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc3ec007b40 con 0x7fc3fc0fc810 2024-04-06T12:34:57.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.888+0000 7fc3f27fc700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc3e806caa0 0x7fc3e806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:57.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.888+0000 7fc400e63700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc3e806caa0 0x7fc3e806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:57.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.888+0000 7fc3f27fc700 1 -- 172.21.15.152:0/366613088 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fc3ec08bb80 con 0x7fc3fc0fc810 2024-04-06T12:34:57.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.888+0000 7fc400e63700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc3e806caa0 0x7fc3e806ef60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fc3f8004e60 tx=0x7fc3f800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:57.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:57.892+0000 7fc3f27fc700 1 -- 172.21.15.152:0/366613088 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fc3ec055b30 con 0x7fc3fc0fc810 2024-04-06T12:34:58.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.123+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7fc3fc0feba0 con 0x7fc3fc0fc810 2024-04-06T12:34:58.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.124+0000 7fc3f27fc700 1 -- 172.21.15.152:0/366613088 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v35) v1 ==== 107+0+4057 (secure 0 0 0) 0x7fc3ec059150 con 0x7fc3fc0fc810 2024-04-06T12:34:58.121 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:58.121 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34378,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/1788558838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1788558838},{"type":"v1","addr":"172.21.15.152:6829","nonce":1788558838}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:01.581627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":0,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:58.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc3e806caa0 msgr2=0x7fc3e806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc3e806caa0 0x7fc3e806ef60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fc3f8004e60 tx=0x7fc3f800b040).stop 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fc810 msgr2=0x7fc3fc1091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fc810 0x7fc3fc1091c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc3ec00e8f0 tx=0x7fc3ec00b040).stop 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 shutdown_connections 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc3e806caa0 0x7fc3e806ef60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3fc0fc810 0x7fc3fc1091c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 --2- 172.21.15.152:0/366613088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3fc0fd170 0x7fc3fc1096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 >> 172.21.15.152:0/366613088 conn(0x7fc3fc0f23f0 msgr2=0x7fc3fc0fabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 shutdown_connections 2024-04-06T12:34:58.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.126+0000 7fc4038c8700 1 -- 172.21.15.152:0/366613088 wait complete. 2024-04-06T12:34:58.125 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 15 2024-04-06T12:34:58.135 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 15 2024-04-06T12:34:58.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-04-06T12:34:58.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.256+0000 7f3d1fda7700 1 -- 172.21.15.152:0/1037126353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fc080 msgr2=0x7f3d180f6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.256+0000 7f3d1fda7700 1 --2- 172.21.15.152:0/1037126353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fc080 0x7f3d180f6f40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f3d080047f0 tx=0x7f3d08009cb0).stop 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.257+0000 7f3d1fda7700 1 -- 172.21.15.152:0/1037126353 shutdown_connections 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.257+0000 7f3d1fda7700 1 --2- 172.21.15.152:0/1037126353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fc080 0x7f3d180f6f40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.257+0000 7f3d1fda7700 1 --2- 172.21.15.152:0/1037126353 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d180fb720 0x7f3d180fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.257+0000 7f3d1fda7700 1 -- 172.21.15.152:0/1037126353 >> 172.21.15.152:0/1037126353 conn(0x7f3d1806cb60 msgr2=0x7f3d180f3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.257+0000 7f3d1fda7700 1 -- 172.21.15.152:0/1037126353 shutdown_connections 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.257+0000 7f3d1fda7700 1 -- 172.21.15.152:0/1037126353 wait complete. 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.257+0000 7f3d1fda7700 1 Processor -- start 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.257+0000 7f3d1fda7700 1 -- start start 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1fda7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fb720 0x7f3d1810d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1fda7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d180fc080 0x7f3d1810d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1fda7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1810daf0 con 0x7f3d180fb720 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1fda7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1810dc30 con 0x7f3d180fc080 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1db43700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fb720 0x7f3d1810d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1db43700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fb720 0x7f3d1810d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39940/0 (socket says 172.21.15.152:39940) 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1db43700 1 -- 172.21.15.152:0/676622431 learned_addr learned my addr 172.21.15.152:0/676622431 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1db43700 1 -- 172.21.15.152:0/676622431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d180fc080 msgr2=0x7f3d1810d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1d342700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d180fc080 0x7f3d1810d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1db43700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d180fc080 0x7f3d1810d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1db43700 1 -- 172.21.15.152:0/676622431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08005040 con 0x7f3d180fb720 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1db43700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fb720 0x7f3d1810d000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f3d1400c740 tx=0x7f3d14007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d0effd700 1 -- 172.21.15.152:0/676622431 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d1400e680 con 0x7f3d180fb720 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d0effd700 1 -- 172.21.15.152:0/676622431 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d1400ec90 con 0x7f3d180fb720 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d18107300 con 0x7f3d180fb720 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d0effd700 1 -- 172.21.15.152:0/676622431 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d14013d60 con 0x7f3d180fb720 2024-04-06T12:34:58.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.258+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d18107840 con 0x7f3d180fb720 2024-04-06T12:34:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.259+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d180606f0 con 0x7f3d180fb720 2024-04-06T12:34:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.260+0000 7f3d0effd700 1 -- 172.21.15.152:0/676622431 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3d1400e7e0 con 0x7f3d180fb720 2024-04-06T12:34:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.260+0000 7f3d0effd700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3d0406caa0 0x7f3d0406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.260+0000 7f3d0effd700 1 -- 172.21.15.152:0/676622431 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f3d1408c1c0 con 0x7f3d180fb720 2024-04-06T12:34:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.260+0000 7f3d1d342700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3d0406caa0 0x7f3d0406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.261+0000 7f3d1d342700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3d0406caa0 0x7f3d0406ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3d18108980 tx=0x7f3d0800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.265+0000 7f3d0effd700 1 -- 172.21.15.152:0/676622431 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f3d14056170 con 0x7f3d180fb720 2024-04-06T12:34:58.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.496+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f3d181086c0 con 0x7f3d180fb720 2024-04-06T12:34:58.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.497+0000 7f3d0effd700 1 -- 172.21.15.152:0/676622431 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v35) v1 ==== 107+0+4836 (secure 0 0 0) 0x7f3d14059790 con 0x7f3d180fb720 2024-04-06T12:34:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:58.495 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34378,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/1788558838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1788558838},{"type":"v1","addr":"172.21.15.152:6829","nonce":1788558838}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:01.581627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":0,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:58.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3d0406caa0 msgr2=0x7f3d0406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3d0406caa0 0x7f3d0406ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3d18108980 tx=0x7f3d0800b040).stop 2024-04-06T12:34:58.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fb720 msgr2=0x7f3d1810d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fb720 0x7f3d1810d000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f3d1400c740 tx=0x7f3d14007ef0).stop 2024-04-06T12:34:58.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 shutdown_connections 2024-04-06T12:34:58.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f3d0406caa0 0x7f3d0406ef60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d180fb720 0x7f3d1810d000 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 --2- 172.21.15.152:0/676622431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d180fc080 0x7f3d1810d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 >> 172.21.15.152:0/676622431 conn(0x7f3d1806cb60 msgr2=0x7f3d1806db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:58.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 shutdown_connections 2024-04-06T12:34:58.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.499+0000 7f3d1fda7700 1 -- 172.21.15.152:0/676622431 wait complete. 2024-04-06T12:34:58.498 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 16 2024-04-06T12:34:58.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:58 smithi152 ceph-mon[104634]: pgmap v266: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:58.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:58 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2920506730' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-04-06T12:34:58.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:58 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1810357081' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-06T12:34:58.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:58 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/366613088' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-06T12:34:58.509 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 16 2024-04-06T12:34:58.509 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-06T12:34:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:58 smithi195 ceph-mon[85980]: pgmap v266: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:34:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:58 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2920506730' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-04-06T12:34:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:58 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1810357081' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-06T12:34:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:58 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/366613088' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-06T12:34:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.629+0000 7fde9611b700 1 -- 172.21.15.152:0/2647775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 msgr2=0x7fde900f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.629+0000 7fde9611b700 1 --2- 172.21.15.152:0/2647775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 0x7fde900f8dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fde780047f0 tx=0x7fde78009cb0).stop 2024-04-06T12:34:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.629+0000 7fde9611b700 1 -- 172.21.15.152:0/2647775 shutdown_connections 2024-04-06T12:34:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.629+0000 7fde9611b700 1 --2- 172.21.15.152:0/2647775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde900f92c0 0x7fde90101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.629+0000 7fde9611b700 1 --2- 172.21.15.152:0/2647775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 0x7fde900f8dd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.629+0000 7fde9611b700 1 -- 172.21.15.152:0/2647775 >> 172.21.15.152:0/2647775 conn(0x7fde9006c760 msgr2=0x7fde9006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.629+0000 7fde9611b700 1 -- 172.21.15.152:0/2647775 shutdown_connections 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.629+0000 7fde9611b700 1 -- 172.21.15.152:0/2647775 wait complete. 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.629+0000 7fde9611b700 1 Processor -- start 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde9611b700 1 -- start start 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde9611b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 0x7fde9010dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde9611b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde900f92c0 0x7fde9010e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde9611b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9010eac0 con 0x7fde900f89f0 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde9611b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9010ec00 con 0x7fde900f92c0 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde8f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 0x7fde9010dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde8f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 0x7fde9010dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39950/0 (socket says 172.21.15.152:39950) 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde8f7fe700 1 -- 172.21.15.152:0/2322561670 learned_addr learned my addr 172.21.15.152:0/2322561670 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde8effd700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde900f92c0 0x7fde9010e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde8f7fe700 1 -- 172.21.15.152:0/2322561670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde900f92c0 msgr2=0x7fde9010e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde8f7fe700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde900f92c0 0x7fde9010e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde8f7fe700 1 -- 172.21.15.152:0/2322561670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78005040 con 0x7fde900f89f0 2024-04-06T12:34:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde8f7fe700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 0x7fde9010dfd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fde78009380 tx=0x7fde78009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.630+0000 7fde8cff9700 1 -- 172.21.15.152:0/2322561670 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde7800e070 con 0x7fde900f89f0 2024-04-06T12:34:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.631+0000 7fde8cff9700 1 -- 172.21.15.152:0/2322561670 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde78007e90 con 0x7fde900f89f0 2024-04-06T12:34:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.631+0000 7fde8cff9700 1 -- 172.21.15.152:0/2322561670 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde78018070 con 0x7fde900f89f0 2024-04-06T12:34:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.631+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde90108290 con 0x7fde900f89f0 2024-04-06T12:34:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.631+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde901087d0 con 0x7fde900f89f0 2024-04-06T12:34:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.632+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9005f380 con 0x7fde900f89f0 2024-04-06T12:34:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.632+0000 7fde8cff9700 1 -- 172.21.15.152:0/2322561670 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fde7801d420 con 0x7fde900f89f0 2024-04-06T12:34:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.633+0000 7fde8cff9700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde7c06caa0 0x7fde7c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.633+0000 7fde8cff9700 1 -- 172.21.15.152:0/2322561670 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fde7808c9c0 con 0x7fde900f89f0 2024-04-06T12:34:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.633+0000 7fde8effd700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde7c06caa0 0x7fde7c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.633+0000 7fde8effd700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde7c06caa0 0x7fde7c06ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fde90109910 tx=0x7fde8000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:58.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.639+0000 7fde8cff9700 1 -- 172.21.15.152:0/2322561670 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fde7805a400 con 0x7fde900f89f0 2024-04-06T12:34:58.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.869+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fde90109750 con 0x7fde900f89f0 2024-04-06T12:34:58.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.869+0000 7fde8cff9700 1 -- 172.21.15.152:0/2322561670 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) v1 ==== 107+0+4841 (secure 0 0 0) 0x7fde78059f90 con 0x7fde900f89f0 2024-04-06T12:34:58.867 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:58.867 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34378,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/1788558838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1788558838},{"type":"v1","addr":"172.21.15.152:6829","nonce":1788558838}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:12.133380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":0,"incarnation":15,"state":"up:reconnect","state_seq":183,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:58.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.871+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde7c06caa0 msgr2=0x7fde7c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.871+0000 7fde9611b700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde7c06caa0 0x7fde7c06ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fde90109910 tx=0x7fde8000b040).stop 2024-04-06T12:34:58.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.871+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 msgr2=0x7fde9010dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.871+0000 7fde9611b700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 0x7fde9010dfd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fde78009380 tx=0x7fde78009cb0).stop 2024-04-06T12:34:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.871+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 shutdown_connections 2024-04-06T12:34:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.871+0000 7fde9611b700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde7c06caa0 0x7fde7c06ef60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.872+0000 7fde9611b700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde900f89f0 0x7fde9010dfd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.872+0000 7fde9611b700 1 --2- 172.21.15.152:0/2322561670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde900f92c0 0x7fde9010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.872+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 >> 172.21.15.152:0/2322561670 conn(0x7fde9006c760 msgr2=0x7fde900fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.872+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 shutdown_connections 2024-04-06T12:34:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:58.872+0000 7fde9611b700 1 -- 172.21.15.152:0/2322561670 wait complete. 2024-04-06T12:34:58.870 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 17 2024-04-06T12:34:58.881 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-04-06T12:34:58.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-06T12:34:59.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.001+0000 7f8874b8c700 1 -- 172.21.15.152:0/952238420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fc830 msgr2=0x7f88700fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.001+0000 7f8874b8c700 1 --2- 172.21.15.152:0/952238420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fc830 0x7f88700fcc10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f88640047f0 tx=0x7f8864009cb0).stop 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.001+0000 7f8874b8c700 1 -- 172.21.15.152:0/952238420 shutdown_connections 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.001+0000 7f8874b8c700 1 --2- 172.21.15.152:0/952238420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88700fd100 0x7f88700f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.001+0000 7f8874b8c700 1 --2- 172.21.15.152:0/952238420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fc830 0x7f88700fcc10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.001+0000 7f8874b8c700 1 -- 172.21.15.152:0/952238420 >> 172.21.15.152:0/952238420 conn(0x7f887006c760 msgr2=0x7f887006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.001+0000 7f8874b8c700 1 -- 172.21.15.152:0/952238420 shutdown_connections 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.001+0000 7f8874b8c700 1 -- 172.21.15.152:0/952238420 wait complete. 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f8874b8c700 1 Processor -- start 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f8874b8c700 1 -- start start 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f8874b8c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88700fc830 0x7f887010ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f8874b8c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fd100 0x7f887010d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f8874b8c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887010d970 con 0x7f88700fd100 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f8874b8c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887010dab0 con 0x7f88700fc830 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f886dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fd100 0x7f887010d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f886dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fd100 0x7f887010d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39978/0 (socket says 172.21.15.152:39978) 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f886dd9b700 1 -- 172.21.15.152:0/3424240322 learned_addr learned my addr 172.21.15.152:0/3424240322 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f886e59c700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88700fc830 0x7f887010ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f886dd9b700 1 -- 172.21.15.152:0/3424240322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88700fc830 msgr2=0x7f887010ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f886dd9b700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88700fc830 0x7f887010ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f886dd9b700 1 -- 172.21.15.152:0/3424240322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864005040 con 0x7f88700fd100 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f886dd9b700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fd100 0x7f887010d370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f886000e970 tx=0x7f886000ec80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f885f7fe700 1 -- 172.21.15.152:0/3424240322 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f886000cb90 con 0x7f88700fd100 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.002+0000 7f885f7fe700 1 -- 172.21.15.152:0/3424240322 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f886000ccf0 con 0x7f88700fd100 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.003+0000 7f885f7fe700 1 -- 172.21.15.152:0/3424240322 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8860010630 con 0x7f88700fd100 2024-04-06T12:34:59.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.003+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8870107140 con 0x7f88700fd100 2024-04-06T12:34:59.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.003+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8870107700 con 0x7f88700fd100 2024-04-06T12:34:59.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.003+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887005f380 con 0x7f88700fd100 2024-04-06T12:34:59.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.004+0000 7f885f7fe700 1 -- 172.21.15.152:0/3424240322 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8860011470 con 0x7f88700fd100 2024-04-06T12:34:59.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.004+0000 7f885f7fe700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f885806caa0 0x7f885806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:59.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.004+0000 7f885f7fe700 1 -- 172.21.15.152:0/3424240322 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f886008e6f0 con 0x7f88700fd100 2024-04-06T12:34:59.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.004+0000 7f886e59c700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f885806caa0 0x7f885806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:59.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.005+0000 7f886e59c700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f885806caa0 0x7f885806ef60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8864004f10 tx=0x7f886400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:59.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.009+0000 7f885f7fe700 1 -- 172.21.15.152:0/3424240322 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f886005c130 con 0x7f88700fd100 2024-04-06T12:34:59.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.242+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f887005eec0 con 0x7f88700fd100 2024-04-06T12:34:59.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.242+0000 7f885f7fe700 1 -- 172.21.15.152:0/3424240322 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) v1 ==== 107+0+4838 (secure 0 0 0) 0x7f886005bcc0 con 0x7f88700fd100 2024-04-06T12:34:59.240 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:59.240 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34378,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/1788558838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1788558838},{"type":"v1","addr":"172.21.15.152:6829","nonce":1788558838}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:13.137787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":0,"incarnation":15,"state":"up:rejoin","state_seq":184,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:59.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.244+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f885806caa0 msgr2=0x7f885806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.244+0000 7f8874b8c700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f885806caa0 0x7f885806ef60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8864004f10 tx=0x7f886400b040).stop 2024-04-06T12:34:59.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.244+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fd100 msgr2=0x7f887010d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.244+0000 7f8874b8c700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fd100 0x7f887010d370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f886000e970 tx=0x7f886000ec80).stop 2024-04-06T12:34:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.244+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 shutdown_connections 2024-04-06T12:34:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.244+0000 7f8874b8c700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f885806caa0 0x7f885806ef60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.244+0000 7f8874b8c700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88700fc830 0x7f887010ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.244+0000 7f8874b8c700 1 --2- 172.21.15.152:0/3424240322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88700fd100 0x7f887010d370 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.244+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 >> 172.21.15.152:0/3424240322 conn(0x7f887006c760 msgr2=0x7f88700ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.245+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 shutdown_connections 2024-04-06T12:34:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.245+0000 7f8874b8c700 1 -- 172.21.15.152:0/3424240322 wait complete. 2024-04-06T12:34:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 18 2024-04-06T12:34:59.254 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-04-06T12:34:59.254 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-06T12:34:59.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.374+0000 7fc9430bb700 1 -- 172.21.15.152:0/3920184807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f89f0 msgr2=0x7fc93c0f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.374+0000 7fc9430bb700 1 --2- 172.21.15.152:0/3920184807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f89f0 0x7fc93c0f8dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fc9300047f0 tx=0x7fc930009cb0).stop 2024-04-06T12:34:59.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.374+0000 7fc9430bb700 1 -- 172.21.15.152:0/3920184807 shutdown_connections 2024-04-06T12:34:59.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.374+0000 7fc9430bb700 1 --2- 172.21.15.152:0/3920184807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0f92c0 0x7fc93c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.374+0000 7fc9430bb700 1 --2- 172.21.15.152:0/3920184807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f89f0 0x7fc93c0f8dd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.374+0000 7fc9430bb700 1 -- 172.21.15.152:0/3920184807 >> 172.21.15.152:0/3920184807 conn(0x7fc93c06c760 msgr2=0x7fc93c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:59.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.374+0000 7fc9430bb700 1 -- 172.21.15.152:0/3920184807 shutdown_connections 2024-04-06T12:34:59.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.374+0000 7fc9430bb700 1 -- 172.21.15.152:0/3920184807 wait complete. 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc9430bb700 1 Processor -- start 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc9430bb700 1 -- start start 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc9430bb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0f89f0 0x7fc93c0f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc9430bb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f92c0 0x7fc93c0f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc9430bb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0f7380 con 0x7fc93c0f92c0 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc9430bb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0f74c0 con 0x7fc93c0f89f0 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc93bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f92c0 0x7fc93c0f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc93bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f92c0 0x7fc93c0f6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40006/0 (socket says 172.21.15.152:40006) 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc93bfff700 1 -- 172.21.15.152:0/3963504500 learned_addr learned my addr 172.21.15.152:0/3963504500 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc940e57700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0f89f0 0x7fc93c0f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc93bfff700 1 -- 172.21.15.152:0/3963504500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0f89f0 msgr2=0x7fc93c0f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc93bfff700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0f89f0 0x7fc93c0f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc93bfff700 1 -- 172.21.15.152:0/3963504500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc930005040 con 0x7fc93c0f92c0 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc940e57700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0f89f0 0x7fc93c0f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:34:59.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc93bfff700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f92c0 0x7fc93c0f6e90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fc92800c740 tx=0x7fc928007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc939ffb700 1 -- 172.21.15.152:0/3963504500 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92800e680 con 0x7fc93c0f92c0 2024-04-06T12:34:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.375+0000 7fc939ffb700 1 -- 172.21.15.152:0/3963504500 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc92800ec90 con 0x7fc93c0f92c0 2024-04-06T12:34:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.376+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c0f7770 con 0x7fc93c0f92c0 2024-04-06T12:34:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.376+0000 7fc939ffb700 1 -- 172.21.15.152:0/3963504500 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc928013d60 con 0x7fc93c0f92c0 2024-04-06T12:34:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.376+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c114630 con 0x7fc93c0f92c0 2024-04-06T12:34:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.377+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c05f380 con 0x7fc93c0f92c0 2024-04-06T12:34:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.377+0000 7fc939ffb700 1 -- 172.21.15.152:0/3963504500 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc92800e7e0 con 0x7fc93c0f92c0 2024-04-06T12:34:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.377+0000 7fc939ffb700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92c06caa0 0x7fc92c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.378+0000 7fc939ffb700 1 -- 172.21.15.152:0/3963504500 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fc92808c1a0 con 0x7fc93c0f92c0 2024-04-06T12:34:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.378+0000 7fc940e57700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92c06caa0 0x7fc92c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.378+0000 7fc940e57700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92c06caa0 0x7fc92c06ef60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc930000c00 tx=0x7fc93000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:59.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.382+0000 7fc939ffb700 1 -- 172.21.15.152:0/3963504500 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fc928056150 con 0x7fc93c0f92c0 2024-04-06T12:34:59.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:59 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/676622431' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-06T12:34:59.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:34:59 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2322561670' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-06T12:34:59.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:59 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/676622431' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-06T12:34:59.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:34:59 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2322561670' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-06T12:34:59.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.614+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fc93c05eec0 con 0x7fc93c0f92c0 2024-04-06T12:34:59.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.614+0000 7fc939ffb700 1 -- 172.21.15.152:0/3963504500 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) v1 ==== 107+0+4838 (secure 0 0 0) 0x7fc928059770 con 0x7fc93c0f92c0 2024-04-06T12:34:59.612 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:59.612 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34378,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/1788558838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1788558838},{"type":"v1","addr":"172.21.15.152:6829","nonce":1788558838}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:14.142274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":0,"incarnation":15,"state":"up:active","state_seq":185,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:59.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92c06caa0 msgr2=0x7fc92c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92c06caa0 0x7fc92c06ef60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc930000c00 tx=0x7fc93000b040).stop 2024-04-06T12:34:59.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f92c0 msgr2=0x7fc93c0f6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f92c0 0x7fc93c0f6e90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fc92800c740 tx=0x7fc928007ef0).stop 2024-04-06T12:34:59.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 shutdown_connections 2024-04-06T12:34:59.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fc92c06caa0 0x7fc92c06ef60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc93c0f89f0 0x7fc93c0f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 --2- 172.21.15.152:0/3963504500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c0f92c0 0x7fc93c0f6e90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 >> 172.21.15.152:0/3963504500 conn(0x7fc93c06c760 msgr2=0x7fc93c0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:59.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 shutdown_connections 2024-04-06T12:34:59.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.616+0000 7fc9430bb700 1 -- 172.21.15.152:0/3963504500 wait complete. 2024-04-06T12:34:59.615 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 19 2024-04-06T12:34:59.626 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-04-06T12:34:59.626 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-06T12:34:59.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.745+0000 7fb007f87700 1 -- 172.21.15.152:0/584997406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f70b0 msgr2=0x7fb000103e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.745+0000 7fb007f87700 1 --2- 172.21.15.152:0/584997406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f70b0 0x7fb000103e50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7faffc0047f0 tx=0x7faffc009cb0).stop 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.745+0000 7fb007f87700 1 -- 172.21.15.152:0/584997406 shutdown_connections 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.745+0000 7fb007f87700 1 --2- 172.21.15.152:0/584997406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f70b0 0x7fb000103e50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.745+0000 7fb007f87700 1 --2- 172.21.15.152:0/584997406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0000f67e0 0x7fb0000f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.745+0000 7fb007f87700 1 -- 172.21.15.152:0/584997406 >> 172.21.15.152:0/584997406 conn(0x7fb00006c760 msgr2=0x7fb00006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.745+0000 7fb007f87700 1 -- 172.21.15.152:0/584997406 shutdown_connections 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.745+0000 7fb007f87700 1 -- 172.21.15.152:0/584997406 wait complete. 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb007f87700 1 Processor -- start 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb007f87700 1 -- start start 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb007f87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f67e0 0x7fb000110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb007f87700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0000f70b0 0x7fb000110670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:59.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb007f87700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb000110c70 con 0x7fb0000f67e0 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb007f87700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb000110db0 con 0x7fb0000f70b0 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb005d23700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f67e0 0x7fb000110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb005d23700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f67e0 0x7fb000110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40018/0 (socket says 172.21.15.152:40018) 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb005d23700 1 -- 172.21.15.152:0/1429927877 learned_addr learned my addr 172.21.15.152:0/1429927877 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb005522700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0000f70b0 0x7fb000110670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb005d23700 1 -- 172.21.15.152:0/1429927877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0000f70b0 msgr2=0x7fb000110670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb005d23700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0000f70b0 0x7fb000110670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.746+0000 7fb005d23700 1 -- 172.21.15.152:0/1429927877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc005040 con 0x7fb0000f67e0 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.747+0000 7fb005d23700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f67e0 0x7fb000110180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7faff000c740 tx=0x7faff0007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.747+0000 7faff6ffd700 1 -- 172.21.15.152:0/1429927877 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faff000e680 con 0x7fb0000f67e0 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.747+0000 7faff6ffd700 1 -- 172.21.15.152:0/1429927877 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faff000ec90 con 0x7fb0000f67e0 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.747+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00010a440 con 0x7fb0000f67e0 2024-04-06T12:34:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.747+0000 7faff6ffd700 1 -- 172.21.15.152:0/1429927877 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faff0013d60 con 0x7fb0000f67e0 2024-04-06T12:34:59.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.747+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00010aa00 con 0x7fb0000f67e0 2024-04-06T12:34:59.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.748+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00005f380 con 0x7fb0000f67e0 2024-04-06T12:34:59.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.748+0000 7faff6ffd700 1 -- 172.21.15.152:0/1429927877 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7faff000e7e0 con 0x7fb0000f67e0 2024-04-06T12:34:59.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.748+0000 7faff6ffd700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fafec06caa0 0x7fafec06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:34:59.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.749+0000 7faff6ffd700 1 -- 172.21.15.152:0/1429927877 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7faff008c170 con 0x7fb0000f67e0 2024-04-06T12:34:59.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.749+0000 7fb005522700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fafec06caa0 0x7fafec06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:34:59.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.749+0000 7fb005522700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fafec06caa0 0x7fafec06ef60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faffc009ee0 tx=0x7faffc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:34:59.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.753+0000 7faff6ffd700 1 -- 172.21.15.152:0/1429927877 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7faff0059bb0 con 0x7fb0000f67e0 2024-04-06T12:34:59.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.984+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fb00010b8a0 con 0x7fb0000f67e0 2024-04-06T12:34:59.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.984+0000 7faff6ffd700 1 -- 172.21.15.152:0/1429927877 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) v1 ==== 107+0+4056 (secure 0 0 0) 0x7faff0059740 con 0x7fb0000f67e0 2024-04-06T12:34:59.982 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:34:59.982 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:14.142274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":0,"incarnation":15,"state":"up:active","state_seq":185,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fafec06caa0 msgr2=0x7fafec06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fafec06caa0 0x7fafec06ef60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faffc009ee0 tx=0x7faffc00b040).stop 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f67e0 msgr2=0x7fb000110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f67e0 0x7fb000110180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7faff000c740 tx=0x7faff0007ef0).stop 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 shutdown_connections 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fafec06caa0 0x7fafec06ef60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0000f67e0 0x7fb000110180 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 --2- 172.21.15.152:0/1429927877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0000f70b0 0x7fb000110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 >> 172.21.15.152:0/1429927877 conn(0x7fb00006c760 msgr2=0x7fb0000f57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:34:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 shutdown_connections 2024-04-06T12:34:59.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:34:59.986+0000 7fb007f87700 1 -- 172.21.15.152:0/1429927877 wait complete. 2024-04-06T12:34:59.985 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 20 2024-04-06T12:34:59.996 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-04-06T12:34:59.996 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-06T12:35:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.115+0000 7efc5c361700 1 -- 172.21.15.152:0/1855627994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fca00 msgr2=0x7efc540fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.115+0000 7efc5c361700 1 --2- 172.21.15.152:0/1855627994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fca00 0x7efc540fcde0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7efc440047f0 tx=0x7efc44009cb0).stop 2024-04-06T12:35:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.115+0000 7efc5c361700 1 -- 172.21.15.152:0/1855627994 shutdown_connections 2024-04-06T12:35:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.115+0000 7efc5c361700 1 --2- 172.21.15.152:0/1855627994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc540fd360 0x7efc540f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.115+0000 7efc5c361700 1 --2- 172.21.15.152:0/1855627994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fca00 0x7efc540fcde0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.115+0000 7efc5c361700 1 -- 172.21.15.152:0/1855627994 >> 172.21.15.152:0/1855627994 conn(0x7efc540f2540 msgr2=0x7efc540f4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.115+0000 7efc5c361700 1 -- 172.21.15.152:0/1855627994 shutdown_connections 2024-04-06T12:35:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.115+0000 7efc5c361700 1 -- 172.21.15.152:0/1855627994 wait complete. 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.116+0000 7efc5c361700 1 Processor -- start 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.116+0000 7efc5c361700 1 -- start start 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.116+0000 7efc5c361700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc540fca00 0x7efc5410d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.116+0000 7efc5c361700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fd360 0x7efc5410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.116+0000 7efc5c361700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5410dbb0 con 0x7efc540fd360 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc5c361700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5410dcf0 con 0x7efc540fca00 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc598fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fd360 0x7efc5410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc598fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fd360 0x7efc5410d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40038/0 (socket says 172.21.15.152:40038) 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc598fc700 1 -- 172.21.15.152:0/2080556549 learned_addr learned my addr 172.21.15.152:0/2080556549 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc5a0fd700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc540fca00 0x7efc5410d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc598fc700 1 -- 172.21.15.152:0/2080556549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc540fca00 msgr2=0x7efc5410d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc598fc700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc540fca00 0x7efc5410d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc598fc700 1 -- 172.21.15.152:0/2080556549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc44005040 con 0x7efc540fd360 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc5a0fd700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc540fca00 0x7efc5410d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc598fc700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fd360 0x7efc5410d5b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7efc50002750 tx=0x7efc50009ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc4b7fe700 1 -- 172.21.15.152:0/2080556549 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc50007b40 con 0x7efc540fd360 2024-04-06T12:35:00.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc4b7fe700 1 -- 172.21.15.152:0/2080556549 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc5000f040 con 0x7efc540fd360 2024-04-06T12:35:00.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc541073f0 con 0x7efc540fd360 2024-04-06T12:35:00.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc4b7fe700 1 -- 172.21.15.152:0/2080556549 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc500147d0 con 0x7efc540fd360 2024-04-06T12:35:00.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.117+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc541079b0 con 0x7efc540fd360 2024-04-06T12:35:00.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.118+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc540603f0 con 0x7efc540fd360 2024-04-06T12:35:00.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.119+0000 7efc4b7fe700 1 -- 172.21.15.152:0/2080556549 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7efc50009110 con 0x7efc540fd360 2024-04-06T12:35:00.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.119+0000 7efc4b7fe700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc4006caa0 0x7efc4006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:00.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.119+0000 7efc5a0fd700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc4006caa0 0x7efc4006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:00.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.119+0000 7efc4b7fe700 1 -- 172.21.15.152:0/2080556549 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7efc5008bea0 con 0x7efc540fd360 2024-04-06T12:35:00.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.119+0000 7efc5a0fd700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc4006caa0 0x7efc4006ef60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efc440043d0 tx=0x7efc4400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:00.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.124+0000 7efc4b7fe700 1 -- 172.21.15.152:0/2080556549 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7efc500598e0 con 0x7efc540fd360 2024-04-06T12:35:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:00 smithi152 ceph-mon[104634]: pgmap v267: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:00 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3424240322' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-06T12:35:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:00 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3963504500' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-06T12:35:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:00 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1429927877' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-06T12:35:00.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.359+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7efc5405fb30 con 0x7efc540fd360 2024-04-06T12:35:00.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.360+0000 7efc4b7fe700 1 -- 172.21.15.152:0/2080556549 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) v1 ==== 107+0+4835 (secure 0 0 0) 0x7efc500093c0 con 0x7efc540fd360 2024-04-06T12:35:00.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:00.357 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:14.142274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi195.akamqf","rank":0,"incarnation":15,"state":"up:active","state_seq":185,"addr":"172.21.15.195:6825/3550026836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3550026836},{"type":"v1","addr":"172.21.15.195:6825","nonce":3550026836}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc4006caa0 msgr2=0x7efc4006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc4006caa0 0x7efc4006ef60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efc440043d0 tx=0x7efc4400b040).stop 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fd360 msgr2=0x7efc5410d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fd360 0x7efc5410d5b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7efc50002750 tx=0x7efc50009ec0).stop 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 shutdown_connections 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc4006caa0 0x7efc4006ef60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc540fca00 0x7efc5410d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 --2- 172.21.15.152:0/2080556549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc540fd360 0x7efc5410d5b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 >> 172.21.15.152:0/2080556549 conn(0x7efc540f2540 msgr2=0x7efc540f3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 shutdown_connections 2024-04-06T12:35:00.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.362+0000 7efc5c361700 1 -- 172.21.15.152:0/2080556549 wait complete. 2024-04-06T12:35:00.361 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 21 2024-04-06T12:35:00.372 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-04-06T12:35:00.372 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.492+0000 7f85b31f6700 1 -- 172.21.15.152:0/164125638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f92c0 msgr2=0x7f85ac101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.492+0000 7f85b31f6700 1 --2- 172.21.15.152:0/164125638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f92c0 0x7f85ac101a60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f85980047f0 tx=0x7f8598009cb0).stop 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.492+0000 7f85b31f6700 1 -- 172.21.15.152:0/164125638 shutdown_connections 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.492+0000 7f85b31f6700 1 --2- 172.21.15.152:0/164125638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f92c0 0x7f85ac101a60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.492+0000 7f85b31f6700 1 --2- 172.21.15.152:0/164125638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0f89f0 0x7f85ac0f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.492+0000 7f85b31f6700 1 -- 172.21.15.152:0/164125638 >> 172.21.15.152:0/164125638 conn(0x7f85ac06c760 msgr2=0x7f85ac06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.492+0000 7f85b31f6700 1 -- 172.21.15.152:0/164125638 shutdown_connections 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.492+0000 7f85b31f6700 1 -- 172.21.15.152:0/164125638 wait complete. 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b31f6700 1 Processor -- start 2024-04-06T12:35:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b31f6700 1 -- start start 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b31f6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f89f0 0x7f85ac10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b31f6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0f92c0 0x7f85ac10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b31f6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac10eae0 con 0x7f85ac0f89f0 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b31f6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac10ec20 con 0x7f85ac0f92c0 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b0f92700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f89f0 0x7f85ac10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b0f92700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f89f0 0x7f85ac10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40056/0 (socket says 172.21.15.152:40056) 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b0f92700 1 -- 172.21.15.152:0/3326809341 learned_addr learned my addr 172.21.15.152:0/3326809341 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85abfff700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0f92c0 0x7f85ac10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.493+0000 7f85b0f92700 1 -- 172.21.15.152:0/3326809341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0f92c0 msgr2=0x7f85ac10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.494+0000 7f85b0f92700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0f92c0 0x7f85ac10e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.494+0000 7f85b0f92700 1 -- 172.21.15.152:0/3326809341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598005040 con 0x7f85ac0f89f0 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.494+0000 7f85abfff700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0f92c0 0x7f85ac10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.494+0000 7f85b0f92700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f89f0 0x7f85ac10dff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f85a00041d0 tx=0x7f85a0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:00.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.494+0000 7f85a9ffb700 1 -- 172.21.15.152:0/3326809341 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a0007b40 con 0x7f85ac0f89f0 2024-04-06T12:35:00.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.494+0000 7f85a9ffb700 1 -- 172.21.15.152:0/3326809341 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85a000f040 con 0x7f85ac0f89f0 2024-04-06T12:35:00.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.494+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac1082b0 con 0x7f85ac0f89f0 2024-04-06T12:35:00.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.494+0000 7f85a9ffb700 1 -- 172.21.15.152:0/3326809341 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a000d800 con 0x7f85ac0f89f0 2024-04-06T12:35:00.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.494+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac1087f0 con 0x7f85ac0f89f0 2024-04-06T12:35:00.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.495+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac05f380 con 0x7f85ac0f89f0 2024-04-06T12:35:00.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.495+0000 7f85a9ffb700 1 -- 172.21.15.152:0/3326809341 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f85a0007ca0 con 0x7f85ac0f89f0 2024-04-06T12:35:00.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.496+0000 7f85a9ffb700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f859c06caa0 0x7f859c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:00.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.496+0000 7f85a9ffb700 1 -- 172.21.15.152:0/3326809341 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f85a008b9c0 con 0x7f85ac0f89f0 2024-04-06T12:35:00.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.496+0000 7f85abfff700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f859c06caa0 0x7f859c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:00.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.496+0000 7f85abfff700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f859c06caa0 0x7f859c06ef60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f8598000c00 tx=0x7f859800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:00.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.500+0000 7f85a9ffb700 1 -- 172.21.15.152:0/3326809341 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f85a0059400 con 0x7f85ac0f89f0 2024-04-06T12:35:00.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:00 smithi195 ceph-mon[85980]: pgmap v267: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:00.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:00 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3424240322' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-06T12:35:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:00 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3963504500' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-06T12:35:00.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:00 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1429927877' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-06T12:35:00.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.731+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f85ac109770 con 0x7f85ac0f89f0 2024-04-06T12:35:00.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.732+0000 7f85a9ffb700 1 -- 172.21.15.152:0/3326809341 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) v1 ==== 107+0+4040 (secure 0 0 0) 0x7f85a0058f90 con 0x7f85ac0f89f0 2024-04-06T12:35:00.729 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:00.729 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:38.699655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f859c06caa0 msgr2=0x7f859c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f859c06caa0 0x7f859c06ef60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f8598000c00 tx=0x7f859800b040).stop 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f89f0 msgr2=0x7f85ac10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f89f0 0x7f85ac10dff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f85a00041d0 tx=0x7f85a0009f60).stop 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 shutdown_connections 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f859c06caa0 0x7f859c06ef60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85ac0f89f0 0x7f85ac10dff0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 --2- 172.21.15.152:0/3326809341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0f92c0 0x7f85ac10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 >> 172.21.15.152:0/3326809341 conn(0x7f85ac06c760 msgr2=0x7f85ac0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 shutdown_connections 2024-04-06T12:35:00.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.734+0000 7f85b31f6700 1 -- 172.21.15.152:0/3326809341 wait complete. 2024-04-06T12:35:00.733 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 22 2024-04-06T12:35:00.744 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-04-06T12:35:00.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-06T12:35:00.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.863+0000 7f36c5441700 1 -- 172.21.15.152:0/3996308630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 msgr2=0x7f36c00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.863+0000 7f36c5441700 1 --2- 172.21.15.152:0/3996308630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 0x7f36c00f6b30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f36b00047f0 tx=0x7f36b0009cb0).stop 2024-04-06T12:35:00.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.863+0000 7f36c5441700 1 -- 172.21.15.152:0/3996308630 shutdown_connections 2024-04-06T12:35:00.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.863+0000 7f36c5441700 1 --2- 172.21.15.152:0/3996308630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 0x7f36c00f6b30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.863+0000 7f36c5441700 1 --2- 172.21.15.152:0/3996308630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c00fca10 0x7f36c00fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.863+0000 7f36c5441700 1 -- 172.21.15.152:0/3996308630 >> 172.21.15.152:0/3996308630 conn(0x7f36c00f2590 msgr2=0x7f36c00f49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:00.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.863+0000 7f36c5441700 1 -- 172.21.15.152:0/3996308630 shutdown_connections 2024-04-06T12:35:00.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.863+0000 7f36c5441700 1 -- 172.21.15.152:0/3996308630 wait complete. 2024-04-06T12:35:00.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36c5441700 1 Processor -- start 2024-04-06T12:35:00.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36c5441700 1 -- start start 2024-04-06T12:35:00.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36c5441700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c00fca10 0x7f36c00f8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:00.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36c5441700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 0x7f36c00f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:00.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36c5441700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00f90e0 con 0x7f36c00fd370 2024-04-06T12:35:00.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36c5441700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00f9220 con 0x7f36c00fca10 2024-04-06T12:35:00.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36be7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 0x7f36c00f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36be7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 0x7f36c00f8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40080/0 (socket says 172.21.15.152:40080) 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36be7fc700 1 -- 172.21.15.152:0/1417343853 learned_addr learned my addr 172.21.15.152:0/1417343853 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36beffd700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c00fca10 0x7f36c00f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36be7fc700 1 -- 172.21.15.152:0/1417343853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c00fca10 msgr2=0x7f36c00f8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36be7fc700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c00fca10 0x7f36c00f8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.864+0000 7f36be7fc700 1 -- 172.21.15.152:0/1417343853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b0005040 con 0x7f36c00fd370 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.865+0000 7f36be7fc700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 0x7f36c00f8bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f36b0000c00 tx=0x7f36b0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.865+0000 7f36a7fff700 1 -- 172.21.15.152:0/1417343853 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b000e030 con 0x7f36c00fd370 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.865+0000 7f36a7fff700 1 -- 172.21.15.152:0/1417343853 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36b0007e90 con 0x7f36c00fd370 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.865+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c00f9470 con 0x7f36c00fd370 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.865+0000 7f36a7fff700 1 -- 172.21.15.152:0/1417343853 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b0018070 con 0x7f36c00fd370 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.865+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c01147b0 con 0x7f36c00fd370 2024-04-06T12:35:00.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.866+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c00603b0 con 0x7f36c00fd370 2024-04-06T12:35:00.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.866+0000 7f36a7fff700 1 -- 172.21.15.152:0/1417343853 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f36b001d590 con 0x7f36c00fd370 2024-04-06T12:35:00.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.867+0000 7f36a7fff700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f36a806caa0 0x7f36a806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:00.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.867+0000 7f36beffd700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f36a806caa0 0x7f36a806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:00.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.867+0000 7f36a7fff700 1 -- 172.21.15.152:0/1417343853 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f36b008d1e0 con 0x7f36c00fd370 2024-04-06T12:35:00.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.867+0000 7f36beffd700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f36a806caa0 0x7f36a806ef60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f36b4004dc0 tx=0x7f36b400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:00.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:00.871+0000 7f36a7fff700 1 -- 172.21.15.152:0/1417343853 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f36b0057190 con 0x7f36c00fd370 2024-04-06T12:35:01.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.102+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f36c00f9be0 con 0x7f36c00fd370 2024-04-06T12:35:01.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.102+0000 7f36a7fff700 1 -- 172.21.15.152:0/1417343853 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) v1 ==== 107+0+4051 (secure 0 0 0) 0x7f36b005a7b0 con 0x7f36c00fd370 2024-04-06T12:35:01.100 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:01.100 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:38.706823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":0,"incarnation":23,"state":"up:replay","state_seq":1,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:01.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.104+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f36a806caa0 msgr2=0x7f36a806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.104+0000 7f36c5441700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f36a806caa0 0x7f36a806ef60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f36b4004dc0 tx=0x7f36b400b040).stop 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.104+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 msgr2=0x7f36c00f8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.104+0000 7f36c5441700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 0x7f36c00f8bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f36b0000c00 tx=0x7f36b0009cb0).stop 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.105+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 shutdown_connections 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.105+0000 7f36c5441700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f36a806caa0 0x7f36a806ef60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.105+0000 7f36c5441700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36c00fca10 0x7f36c00f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.105+0000 7f36c5441700 1 --2- 172.21.15.152:0/1417343853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c00fd370 0x7f36c00f8bf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.105+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 >> 172.21.15.152:0/1417343853 conn(0x7f36c00f2590 msgr2=0x7f36c0060c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.105+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 shutdown_connections 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.105+0000 7f36c5441700 1 -- 172.21.15.152:0/1417343853 wait complete. 2024-04-06T12:35:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 23 2024-04-06T12:35:01.114 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-04-06T12:35:01.114 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-06T12:35:01.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.235+0000 7fe288e15700 1 -- 172.21.15.152:0/1360639623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 msgr2=0x7fe2840fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.235+0000 7fe288e15700 1 --2- 172.21.15.152:0/1360639623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 0x7fe2840fcc10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fe2780047f0 tx=0x7fe278009cb0).stop 2024-04-06T12:35:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.235+0000 7fe288e15700 1 -- 172.21.15.152:0/1360639623 shutdown_connections 2024-04-06T12:35:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.235+0000 7fe288e15700 1 --2- 172.21.15.152:0/1360639623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2840fd100 0x7fe2840f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.235+0000 7fe288e15700 1 --2- 172.21.15.152:0/1360639623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 0x7fe2840fcc10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.235+0000 7fe288e15700 1 -- 172.21.15.152:0/1360639623 >> 172.21.15.152:0/1360639623 conn(0x7fe28406c760 msgr2=0x7fe28406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.235+0000 7fe288e15700 1 -- 172.21.15.152:0/1360639623 shutdown_connections 2024-04-06T12:35:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.235+0000 7fe288e15700 1 -- 172.21.15.152:0/1360639623 wait complete. 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe288e15700 1 Processor -- start 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe288e15700 1 -- start start 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe288e15700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 0x7fe28410cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe288e15700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2840fd100 0x7fe28410d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe288e15700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28410d990 con 0x7fe2840fc830 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe288e15700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28410dad0 con 0x7fe2840fd100 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe28259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 0x7fe28410cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe28259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 0x7fe28410cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40108/0 (socket says 172.21.15.152:40108) 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe28259c700 1 -- 172.21.15.152:0/2040575328 learned_addr learned my addr 172.21.15.152:0/2040575328 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe28259c700 1 -- 172.21.15.152:0/2040575328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2840fd100 msgr2=0x7fe28410d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe28259c700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2840fd100 0x7fe28410d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:35:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.236+0000 7fe28259c700 1 -- 172.21.15.152:0/2040575328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278005040 con 0x7fe2840fc830 2024-04-06T12:35:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.237+0000 7fe28259c700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 0x7fe28410cea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fe27800b120 tx=0x7fe278009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.237+0000 7fe2737fe700 1 -- 172.21.15.152:0/2040575328 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe27800e030 con 0x7fe2840fc830 2024-04-06T12:35:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.237+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe284107100 con 0x7fe2840fc830 2024-04-06T12:35:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.237+0000 7fe2737fe700 1 -- 172.21.15.152:0/2040575328 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe278007e90 con 0x7fe2840fc830 2024-04-06T12:35:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.237+0000 7fe2737fe700 1 -- 172.21.15.152:0/2040575328 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe278018070 con 0x7fe2840fc830 2024-04-06T12:35:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.237+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe284107660 con 0x7fe2840fc830 2024-04-06T12:35:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.238+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28405f380 con 0x7fe2840fc830 2024-04-06T12:35:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.238+0000 7fe2737fe700 1 -- 172.21.15.152:0/2040575328 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe278009710 con 0x7fe2840fc830 2024-04-06T12:35:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.239+0000 7fe2737fe700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe26c06caf0 0x7fe26c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.239+0000 7fe2737fe700 1 -- 172.21.15.152:0/2040575328 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fe27808d4a0 con 0x7fe2840fc830 2024-04-06T12:35:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.239+0000 7fe281d9b700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe26c06caf0 0x7fe26c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.239+0000 7fe281d9b700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe26c06caf0 0x7fe26c06efb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe2841087e0 tx=0x7fe274007bc0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:01.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.243+0000 7fe2737fe700 1 -- 172.21.15.152:0/2040575328 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fe27805ae40 con 0x7fe2840fc830 2024-04-06T12:35:01.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.477+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fe2840f9920 con 0x7fe2840fc830 2024-04-06T12:35:01.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.477+0000 7fe2737fe700 1 -- 172.21.15.152:0/2040575328 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) v1 ==== 107+0+4838 (secure 0 0 0) 0x7fe27805a9d0 con 0x7fe2840fc830 2024-04-06T12:35:01.475 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:01.475 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:49.153618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":0,"incarnation":23,"state":"up:reconnect","state_seq":191,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:01.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.479+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe26c06caf0 msgr2=0x7fe26c06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.479+0000 7fe288e15700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe26c06caf0 0x7fe26c06efb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe2841087e0 tx=0x7fe274007bc0).stop 2024-04-06T12:35:01.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.479+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 msgr2=0x7fe28410cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.480+0000 7fe288e15700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 0x7fe28410cea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fe27800b120 tx=0x7fe278009cb0).stop 2024-04-06T12:35:01.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.480+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 shutdown_connections 2024-04-06T12:35:01.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.480+0000 7fe288e15700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe26c06caf0 0x7fe26c06efb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.480+0000 7fe288e15700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2840fc830 0x7fe28410cea0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.480+0000 7fe288e15700 1 --2- 172.21.15.152:0/2040575328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2840fd100 0x7fe28410d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:35:01.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.480+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 >> 172.21.15.152:0/2040575328 conn(0x7fe28406c760 msgr2=0x7fe2840ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:01.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.480+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 shutdown_connections 2024-04-06T12:35:01.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.480+0000 7fe288e15700 1 -- 172.21.15.152:0/2040575328 wait complete. 2024-04-06T12:35:01.478 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 24 2024-04-06T12:35:01.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:01 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2080556549' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-06T12:35:01.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:01 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3326809341' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-06T12:35:01.488 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:01 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1417343853' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-06T12:35:01.489 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-04-06T12:35:01.489 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-06T12:35:01.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:01 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2080556549' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-06T12:35:01.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:01 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3326809341' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-06T12:35:01.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:01 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1417343853' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-06T12:35:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.609+0000 7fcb1c747700 1 -- 172.21.15.152:0/2004002457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 msgr2=0x7fcb140fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.609+0000 7fcb1c747700 1 --2- 172.21.15.152:0/2004002457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 0x7fcb140fcc10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fcb040047f0 tx=0x7fcb04009cb0).stop 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.609+0000 7fcb1c747700 1 -- 172.21.15.152:0/2004002457 shutdown_connections 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.609+0000 7fcb1c747700 1 --2- 172.21.15.152:0/2004002457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb140fd100 0x7fcb140f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.609+0000 7fcb1c747700 1 --2- 172.21.15.152:0/2004002457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 0x7fcb140fcc10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.609+0000 7fcb1c747700 1 -- 172.21.15.152:0/2004002457 >> 172.21.15.152:0/2004002457 conn(0x7fcb1406c760 msgr2=0x7fcb1406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.609+0000 7fcb1c747700 1 -- 172.21.15.152:0/2004002457 shutdown_connections 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.609+0000 7fcb1c747700 1 -- 172.21.15.152:0/2004002457 wait complete. 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1c747700 1 Processor -- start 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1c747700 1 -- start start 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1c747700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 0x7fcb1410cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1c747700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb140fd100 0x7fcb1410d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:01.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1c747700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1410daa0 con 0x7fcb140fc830 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1c747700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1410dbe0 con 0x7fcb140fd100 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1a4e3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 0x7fcb1410cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1a4e3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 0x7fcb1410cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40128/0 (socket says 172.21.15.152:40128) 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1a4e3700 1 -- 172.21.15.152:0/1981375433 learned_addr learned my addr 172.21.15.152:0/1981375433 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb19ce2700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb140fd100 0x7fcb1410d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1a4e3700 1 -- 172.21.15.152:0/1981375433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb140fd100 msgr2=0x7fcb1410d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1a4e3700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb140fd100 0x7fcb1410d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1a4e3700 1 -- 172.21.15.152:0/1981375433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04005040 con 0x7fcb140fc830 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1a4e3700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 0x7fcb1410cfb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fcb04009380 tx=0x7fcb04009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb0b7fe700 1 -- 172.21.15.152:0/1981375433 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb04018070 con 0x7fcb140fc830 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb0b7fe700 1 -- 172.21.15.152:0/1981375433 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb04007e90 con 0x7fcb140fc830 2024-04-06T12:35:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.610+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb14107210 con 0x7fcb140fc830 2024-04-06T12:35:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.611+0000 7fcb0b7fe700 1 -- 172.21.15.152:0/1981375433 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb0401c380 con 0x7fcb140fc830 2024-04-06T12:35:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.611+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb14107770 con 0x7fcb140fc830 2024-04-06T12:35:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.612+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1405f380 con 0x7fcb140fc830 2024-04-06T12:35:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.612+0000 7fcb0b7fe700 1 -- 172.21.15.152:0/1981375433 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fcb040123c0 con 0x7fcb140fc830 2024-04-06T12:35:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.613+0000 7fcb0b7fe700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcb0006cab0 0x7fcb0006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.613+0000 7fcb19ce2700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcb0006cab0 0x7fcb0006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.613+0000 7fcb0b7fe700 1 -- 172.21.15.152:0/1981375433 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fcb0408cc00 con 0x7fcb140fc830 2024-04-06T12:35:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.613+0000 7fcb19ce2700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcb0006cab0 0x7fcb0006ef70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fcb141088f0 tx=0x7fcb1000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:01.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.617+0000 7fcb0b7fe700 1 -- 172.21.15.152:0/1981375433 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fcb04092020 con 0x7fcb140fc830 2024-04-06T12:35:01.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.854+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fcb14108730 con 0x7fcb140fc830 2024-04-06T12:35:01.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.855+0000 7fcb0b7fe700 1 -- 172.21.15.152:0/1981375433 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) v1 ==== 107+0+4835 (secure 0 0 0) 0x7fcb0405a640 con 0x7fcb140fc830 2024-04-06T12:35:01.853 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:01.853 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:50.154920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":192,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcb0006cab0 msgr2=0x7fcb0006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcb0006cab0 0x7fcb0006ef70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fcb141088f0 tx=0x7fcb1000b040).stop 2024-04-06T12:35:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 msgr2=0x7fcb1410cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 0x7fcb1410cfb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fcb04009380 tx=0x7fcb04009cb0).stop 2024-04-06T12:35:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 shutdown_connections 2024-04-06T12:35:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcb0006cab0 0x7fcb0006ef70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb140fc830 0x7fcb1410cfb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 --2- 172.21.15.152:0/1981375433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb140fd100 0x7fcb1410d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 >> 172.21.15.152:0/1981375433 conn(0x7fcb1406c760 msgr2=0x7fcb140ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:01.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 shutdown_connections 2024-04-06T12:35:01.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.857+0000 7fcb1c747700 1 -- 172.21.15.152:0/1981375433 wait complete. 2024-04-06T12:35:01.856 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 25 2024-04-06T12:35:01.867 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-04-06T12:35:01.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-06T12:35:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.987+0000 7fe4f05d0700 1 -- 172.21.15.152:0/3411198337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 msgr2=0x7fe4e80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.987+0000 7fe4f05d0700 1 --2- 172.21.15.152:0/3411198337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 0x7fe4e80fcc10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fe4d80047f0 tx=0x7fe4d8009cb0).stop 2024-04-06T12:35:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.987+0000 7fe4f05d0700 1 -- 172.21.15.152:0/3411198337 shutdown_connections 2024-04-06T12:35:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.987+0000 7fe4f05d0700 1 --2- 172.21.15.152:0/3411198337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4e80fd100 0x7fe4e80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.987+0000 7fe4f05d0700 1 --2- 172.21.15.152:0/3411198337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 0x7fe4e80fcc10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.987+0000 7fe4f05d0700 1 -- 172.21.15.152:0/3411198337 >> 172.21.15.152:0/3411198337 conn(0x7fe4e806c760 msgr2=0x7fe4e806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.987+0000 7fe4f05d0700 1 -- 172.21.15.152:0/3411198337 shutdown_connections 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.987+0000 7fe4f05d0700 1 -- 172.21.15.152:0/3411198337 wait complete. 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.987+0000 7fe4f05d0700 1 Processor -- start 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4f05d0700 1 -- start start 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4f05d0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 0x7fe4e810ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4f05d0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4e80fd100 0x7fe4e810d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4f05d0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e810d970 con 0x7fe4e80fc830 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4f05d0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e810dab0 con 0x7fe4e80fd100 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4ee36c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 0x7fe4e810ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4ee36c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 0x7fe4e810ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40148/0 (socket says 172.21.15.152:40148) 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4ee36c700 1 -- 172.21.15.152:0/1979060860 learned_addr learned my addr 172.21.15.152:0/1979060860 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4edb6b700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4e80fd100 0x7fe4e810d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4ee36c700 1 -- 172.21.15.152:0/1979060860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4e80fd100 msgr2=0x7fe4e810d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4ee36c700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4e80fd100 0x7fe4e810d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4ee36c700 1 -- 172.21.15.152:0/1979060860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8005040 con 0x7fe4e80fc830 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4edb6b700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4e80fd100 0x7fe4e810d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4ee36c700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 0x7fe4e810ce80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe4d8005010 tx=0x7fe4d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4df7fe700 1 -- 172.21.15.152:0/1979060860 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d800e030 con 0x7fe4e80fc830 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e81070e0 con 0x7fe4e80fc830 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4df7fe700 1 -- 172.21.15.152:0/1979060860 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe4d8007e90 con 0x7fe4e80fc830 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4df7fe700 1 -- 172.21.15.152:0/1979060860 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d8018070 con 0x7fe4e80fc830 2024-04-06T12:35:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.988+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e81075c0 con 0x7fe4e80fc830 2024-04-06T12:35:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.989+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e805f380 con 0x7fe4e80fc830 2024-04-06T12:35:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.990+0000 7fe4df7fe700 1 -- 172.21.15.152:0/1979060860 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe4d801d420 con 0x7fe4e80fc830 2024-04-06T12:35:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.990+0000 7fe4df7fe700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe4d406ca30 0x7fe4d406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.990+0000 7fe4df7fe700 1 -- 172.21.15.152:0/1979060860 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fe4d808d2e0 con 0x7fe4e80fc830 2024-04-06T12:35:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.990+0000 7fe4edb6b700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe4d406ca30 0x7fe4d406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:01.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.991+0000 7fe4edb6b700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe4d406ca30 0x7fe4d406eef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe4e4009a00 tx=0x7fe4e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:01.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:01.995+0000 7fe4df7fe700 1 -- 172.21.15.152:0/1979060860 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fe4d805ad20 con 0x7fe4e80fc830 2024-04-06T12:35:02.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.226+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fe4e81085a0 con 0x7fe4e80fc830 2024-04-06T12:35:02.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.227+0000 7fe4df7fe700 1 -- 172.21.15.152:0/1979060860 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) v1 ==== 107+0+4835 (secure 0 0 0) 0x7fe4d805a8b0 con 0x7fe4e80fc830 2024-04-06T12:35:02.225 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:02.225 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:32:51.156049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi195.ttgcpp","rank":0,"incarnation":23,"state":"up:active","state_seq":193,"addr":"172.21.15.195:6827/3193759698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3193759698},{"type":"v1","addr":"172.21.15.195:6827","nonce":3193759698}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:02.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe4d406ca30 msgr2=0x7fe4d406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe4d406ca30 0x7fe4d406eef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe4e4009a00 tx=0x7fe4e400b040).stop 2024-04-06T12:35:02.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 msgr2=0x7fe4e810ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 0x7fe4e810ce80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe4d8005010 tx=0x7fe4d8009cb0).stop 2024-04-06T12:35:02.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 shutdown_connections 2024-04-06T12:35:02.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe4d406ca30 0x7fe4d406eef0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4e80fc830 0x7fe4e810ce80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 --2- 172.21.15.152:0/1979060860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4e80fd100 0x7fe4e810d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 >> 172.21.15.152:0/1979060860 conn(0x7fe4e806c760 msgr2=0x7fe4e80ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:02.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 shutdown_connections 2024-04-06T12:35:02.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.229+0000 7fe4f05d0700 1 -- 172.21.15.152:0/1979060860 wait complete. 2024-04-06T12:35:02.228 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 26 2024-04-06T12:35:02.239 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-04-06T12:35:02.239 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-06T12:35:02.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.359+0000 7f1bfe58c700 1 -- 172.21.15.152:0/1565321792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 msgr2=0x7f1bf80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.359+0000 7f1bfe58c700 1 --2- 172.21.15.152:0/1565321792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 0x7f1bf80f6930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f1bec0047f0 tx=0x7f1bec009cb0).stop 2024-04-06T12:35:02.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.359+0000 7f1bfe58c700 1 -- 172.21.15.152:0/1565321792 shutdown_connections 2024-04-06T12:35:02.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.359+0000 7f1bfe58c700 1 --2- 172.21.15.152:0/1565321792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 0x7f1bf80f6930 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.359+0000 7f1bfe58c700 1 --2- 172.21.15.152:0/1565321792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf80fc830 0x7f1bf80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.359+0000 7f1bfe58c700 1 -- 172.21.15.152:0/1565321792 >> 172.21.15.152:0/1565321792 conn(0x7f1bf806c760 msgr2=0x7f1bf806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:02.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.359+0000 7f1bfe58c700 1 -- 172.21.15.152:0/1565321792 shutdown_connections 2024-04-06T12:35:02.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.359+0000 7f1bfe58c700 1 -- 172.21.15.152:0/1565321792 wait complete. 2024-04-06T12:35:02.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bfe58c700 1 Processor -- start 2024-04-06T12:35:02.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bfe58c700 1 -- start start 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bfe58c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf80fc830 0x7f1bf81090b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bfe58c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 0x7f1bf81095a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bfe58c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8109a90 con 0x7f1bf80fd100 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bfe58c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8109bd0 con 0x7f1bf80fc830 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bf77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 0x7f1bf81095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bf77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 0x7f1bf81095a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32800/0 (socket says 172.21.15.152:32800) 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bf77fe700 1 -- 172.21.15.152:0/3064488297 learned_addr learned my addr 172.21.15.152:0/3064488297 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bf7fff700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf80fc830 0x7f1bf81090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bf77fe700 1 -- 172.21.15.152:0/3064488297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf80fc830 msgr2=0x7f1bf81090b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bf77fe700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf80fc830 0x7f1bf81090b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bf77fe700 1 -- 172.21.15.152:0/3064488297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec005040 con 0x7f1bf80fd100 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.360+0000 7f1bf77fe700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 0x7f1bf81095a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f1bec005010 tx=0x7f1bec009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.361+0000 7f1bf57fa700 1 -- 172.21.15.152:0/3064488297 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bec00e030 con 0x7f1bf80fd100 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.361+0000 7f1bf57fa700 1 -- 172.21.15.152:0/3064488297 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1bec007e90 con 0x7f1bf80fd100 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.361+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf8109e20 con 0x7f1bf80fd100 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.361+0000 7f1bf57fa700 1 -- 172.21.15.152:0/3064488297 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bec018070 con 0x7f1bf80fd100 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.361+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf8112410 con 0x7f1bf80fd100 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.362+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf805f380 con 0x7f1bf80fd100 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.362+0000 7f1bf57fa700 1 -- 172.21.15.152:0/3064488297 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1bec01d420 con 0x7f1bf80fd100 2024-04-06T12:35:02.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.363+0000 7f1bf57fa700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1be006ca30 0x7f1be006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:02.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.363+0000 7f1bf7fff700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1be006ca30 0x7f1be006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:02.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.363+0000 7f1bf57fa700 1 -- 172.21.15.152:0/3064488297 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f1bec08d2e0 con 0x7f1bf80fd100 2024-04-06T12:35:02.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.363+0000 7f1bf7fff700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1be006ca30 0x7f1be006eef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1be8009170 tx=0x7f1be8009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:02.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.367+0000 7f1bf57fa700 1 -- 172.21.15.152:0/3064488297 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f1bec057290 con 0x7f1bf80fd100 2024-04-06T12:35:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:02 smithi152 ceph-mon[104634]: pgmap v268: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:02 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2040575328' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-06T12:35:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:02 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1981375433' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-06T12:35:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:02 smithi195 ceph-mon[85980]: pgmap v268: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:02 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2040575328' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-06T12:35:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:02 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1981375433' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-06T12:35:02.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.596+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f1bf8103590 con 0x7f1bf80fd100 2024-04-06T12:35:02.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.597+0000 7f1bf57fa700 1 -- 172.21.15.152:0/3064488297 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) v1 ==== 107+0+4040 (secure 0 0 0) 0x7f1bec05a8b0 con 0x7f1bf80fd100 2024-04-06T12:35:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:02.595 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:33:00.180229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:02.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1be006ca30 msgr2=0x7f1be006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1be006ca30 0x7f1be006eef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1be8009170 tx=0x7f1be8009da0).stop 2024-04-06T12:35:02.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 msgr2=0x7f1bf81095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 0x7f1bf81095a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f1bec005010 tx=0x7f1bec009cb0).stop 2024-04-06T12:35:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 shutdown_connections 2024-04-06T12:35:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1be006ca30 0x7f1be006eef0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf80fc830 0x7f1bf81090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 --2- 172.21.15.152:0/3064488297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bf80fd100 0x7f1bf81095a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 >> 172.21.15.152:0/3064488297 conn(0x7f1bf806c760 msgr2=0x7f1bf80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 shutdown_connections 2024-04-06T12:35:02.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.599+0000 7f1bfe58c700 1 -- 172.21.15.152:0/3064488297 wait complete. 2024-04-06T12:35:02.599 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 27 2024-04-06T12:35:02.609 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-04-06T12:35:02.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-06T12:35:02.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.729+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/2642063946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f92c0 msgr2=0x7f5cc4101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.729+0000 7f5cc8aeb700 1 --2- 172.21.15.152:0/2642063946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f92c0 0x7f5cc4101a60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f5cb40047f0 tx=0x7f5cb4009cb0).stop 2024-04-06T12:35:02.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.729+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/2642063946 shutdown_connections 2024-04-06T12:35:02.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.729+0000 7f5cc8aeb700 1 --2- 172.21.15.152:0/2642063946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f92c0 0x7f5cc4101a60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.729+0000 7f5cc8aeb700 1 --2- 172.21.15.152:0/2642063946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cc40f89f0 0x7f5cc40f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.729+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/2642063946 >> 172.21.15.152:0/2642063946 conn(0x7f5cc406c760 msgr2=0x7f5cc406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:02.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.729+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/2642063946 shutdown_connections 2024-04-06T12:35:02.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.729+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/2642063946 wait complete. 2024-04-06T12:35:02.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc8aeb700 1 Processor -- start 2024-04-06T12:35:02.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc8aeb700 1 -- start start 2024-04-06T12:35:02.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc8aeb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f89f0 0x7f5cc410e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:02.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc8aeb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cc40f92c0 0x7f5cc410e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:02.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc8aeb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc410eb60 con 0x7f5cc40f89f0 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc8aeb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc410eca0 con 0x7f5cc40f92c0 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f89f0 0x7f5cc410e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f89f0 0x7f5cc410e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32826/0 (socket says 172.21.15.152:32826) 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc259c700 1 -- 172.21.15.152:0/1810610129 learned_addr learned my addr 172.21.15.152:0/1810610129 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.730+0000 7f5cc1d9b700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cc40f92c0 0x7f5cc410e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cc259c700 1 -- 172.21.15.152:0/1810610129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cc40f92c0 msgr2=0x7f5cc410e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cc259c700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cc40f92c0 0x7f5cc410e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cc259c700 1 -- 172.21.15.152:0/1810610129 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4005040 con 0x7f5cc40f89f0 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cc1d9b700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cc40f92c0 0x7f5cc410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cc259c700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f89f0 0x7f5cc410e070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5cb800e910 tx=0x7f5cb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cb37fe700 1 -- 172.21.15.152:0/1810610129 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb800eeb0 con 0x7f5cc40f89f0 2024-04-06T12:35:02.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cb37fe700 1 -- 172.21.15.152:0/1810610129 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5cb800f040 con 0x7f5cc40f89f0 2024-04-06T12:35:02.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cb37fe700 1 -- 172.21.15.152:0/1810610129 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb800c8a0 con 0x7f5cc40f89f0 2024-04-06T12:35:02.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc41082d0 con 0x7f5cc40f89f0 2024-04-06T12:35:02.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.731+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc4108810 con 0x7f5cc40f89f0 2024-04-06T12:35:02.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.732+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc405f380 con 0x7f5cc40f89f0 2024-04-06T12:35:02.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.732+0000 7f5cb37fe700 1 -- 172.21.15.152:0/1810610129 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5cb80090d0 con 0x7f5cc40f89f0 2024-04-06T12:35:02.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.733+0000 7f5cb37fe700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cac06caa0 0x7f5cac06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:02.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.733+0000 7f5cb37fe700 1 -- 172.21.15.152:0/1810610129 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f5cb808b990 con 0x7f5cc40f89f0 2024-04-06T12:35:02.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.733+0000 7f5cc1d9b700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cac06caa0 0x7f5cac06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:02.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.733+0000 7f5cc1d9b700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cac06caa0 0x7f5cac06ef60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f5cb4004540 tx=0x7f5cb400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:02.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.737+0000 7f5cb37fe700 1 -- 172.21.15.152:0/1810610129 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f5cb80593d0 con 0x7f5cc40f89f0 2024-04-06T12:35:02.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.971+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f5cc4109790 con 0x7f5cc40f89f0 2024-04-06T12:35:02.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.972+0000 7f5cb37fe700 1 -- 172.21.15.152:0/1810610129 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) v1 ==== 107+0+4051 (secure 0 0 0) 0x7f5cb8058f60 con 0x7f5cc40f89f0 2024-04-06T12:35:02.969 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:02.970 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:33:00.193842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:02.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cac06caa0 msgr2=0x7f5cac06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cac06caa0 0x7f5cac06ef60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f5cb4004540 tx=0x7f5cb400b040).stop 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f89f0 msgr2=0x7f5cc410e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f89f0 0x7f5cc410e070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5cb800e910 tx=0x7f5cb800b040).stop 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 shutdown_connections 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f5cac06caa0 0x7f5cac06ef60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cc40f89f0 0x7f5cc410e070 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 --2- 172.21.15.152:0/1810610129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5cc40f92c0 0x7f5cc410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 >> 172.21.15.152:0/1810610129 conn(0x7f5cc406c760 msgr2=0x7f5cc41003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 shutdown_connections 2024-04-06T12:35:02.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:02.974+0000 7f5cc8aeb700 1 -- 172.21.15.152:0/1810610129 wait complete. 2024-04-06T12:35:02.973 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 28 2024-04-06T12:35:02.983 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-04-06T12:35:02.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-06T12:35:03.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 -- 172.21.15.152:0/127658781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 msgr2=0x7f0ae80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 --2- 172.21.15.152:0/127658781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 0x7f0ae80f6930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f0ad40047f0 tx=0x7f0ad4009cb0).stop 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 -- 172.21.15.152:0/127658781 shutdown_connections 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 --2- 172.21.15.152:0/127658781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 0x7f0ae80f6930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 --2- 172.21.15.152:0/127658781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ae80fc830 0x7f0ae80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 -- 172.21.15.152:0/127658781 >> 172.21.15.152:0/127658781 conn(0x7f0ae806c760 msgr2=0x7f0ae806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 -- 172.21.15.152:0/127658781 shutdown_connections 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 -- 172.21.15.152:0/127658781 wait complete. 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 Processor -- start 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.103+0000 7f0aeea70700 1 -- start start 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0aeea70700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ae80fc830 0x7f0ae8109050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0aeea70700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 0x7f0ae8109540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:03.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0aeea70700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8109a80 con 0x7f0ae80fd100 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0aeea70700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8109bc0 con 0x7f0ae80fc830 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 0x7f0ae8109540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 0x7f0ae8109540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32844/0 (socket says 172.21.15.152:32844) 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae7fff700 1 -- 172.21.15.152:0/3372630748 learned_addr learned my addr 172.21.15.152:0/3372630748 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0aec80c700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ae80fc830 0x7f0ae8109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae7fff700 1 -- 172.21.15.152:0/3372630748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ae80fc830 msgr2=0x7f0ae8109050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae7fff700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ae80fc830 0x7f0ae8109050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae7fff700 1 -- 172.21.15.152:0/3372630748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4005040 con 0x7f0ae80fd100 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae7fff700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 0x7f0ae8109540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f0ad4005010 tx=0x7f0ad4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae5f76700 1 -- 172.21.15.152:0/3372630748 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ad400e030 con 0x7f0ae80fd100 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae5f76700 1 -- 172.21.15.152:0/3372630748 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ad4007e90 con 0x7f0ae80fd100 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae8109e10 con 0x7f0ae80fd100 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.104+0000 7f0ae5f76700 1 -- 172.21.15.152:0/3372630748 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ad4018070 con 0x7f0ae80fd100 2024-04-06T12:35:03.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.105+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae81123b0 con 0x7f0ae80fd100 2024-04-06T12:35:03.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.106+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae805f380 con 0x7f0ae80fd100 2024-04-06T12:35:03.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.106+0000 7f0ae5f76700 1 -- 172.21.15.152:0/3372630748 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0ad401d420 con 0x7f0ae80fd100 2024-04-06T12:35:03.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.106+0000 7f0ae5f76700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ad806ca80 0x7f0ad806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:03.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.107+0000 7f0aec80c700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ad806ca80 0x7f0ad806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:03.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.107+0000 7f0ae5f76700 1 -- 172.21.15.152:0/3372630748 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f0ad408d230 con 0x7f0ae80fd100 2024-04-06T12:35:03.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.107+0000 7f0aec80c700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ad806ca80 0x7f0ad806ef40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0adc004de0 tx=0x7f0adc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:03.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.111+0000 7f0ae5f76700 1 -- 172.21.15.152:0/3372630748 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f0ad4057140 con 0x7f0ae80fd100 2024-04-06T12:35:03.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:03 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1979060860' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-06T12:35:03.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:03 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3064488297' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-06T12:35:03.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:03 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1810610129' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-06T12:35:03.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.347+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f0ae80feb60 con 0x7f0ae80fd100 2024-04-06T12:35:03.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.347+0000 7f0ae5f76700 1 -- 172.21.15.152:0/3372630748 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) v1 ==== 107+0+4833 (secure 0 0 0) 0x7f0ad401d6d0 con 0x7f0ae80fd100 2024-04-06T12:35:03.345 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:03.345 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44353,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/1415350806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1415350806},{"type":"v1","addr":"172.21.15.195:6827","nonce":1415350806}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:33:00.193842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.349+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ad806ca80 msgr2=0x7f0ad806ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.349+0000 7f0aeea70700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ad806ca80 0x7f0ad806ef40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0adc004de0 tx=0x7f0adc00b040).stop 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.349+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 msgr2=0x7f0ae8109540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.349+0000 7f0aeea70700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 0x7f0ae8109540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f0ad4005010 tx=0x7f0ad4009cb0).stop 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.350+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 shutdown_connections 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.350+0000 7f0aeea70700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f0ad806ca80 0x7f0ad806ef40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.350+0000 7f0aeea70700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ae80fc830 0x7f0ae8109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.350+0000 7f0aeea70700 1 --2- 172.21.15.152:0/3372630748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae80fd100 0x7f0ae8109540 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.350+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 >> 172.21.15.152:0/3372630748 conn(0x7f0ae806c760 msgr2=0x7f0ae80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.350+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 shutdown_connections 2024-04-06T12:35:03.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.350+0000 7f0aeea70700 1 -- 172.21.15.152:0/3372630748 wait complete. 2024-04-06T12:35:03.349 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 29 2024-04-06T12:35:03.359 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-04-06T12:35:03.359 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-06T12:35:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.479+0000 7f49bd76a700 1 -- 172.21.15.152:0/4234966715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 msgr2=0x7f49b80fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.479+0000 7f49bd76a700 1 --2- 172.21.15.152:0/4234966715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 0x7f49b80fcbf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f49a80047f0 tx=0x7f49a8009cb0).stop 2024-04-06T12:35:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.479+0000 7f49bd76a700 1 -- 172.21.15.152:0/4234966715 shutdown_connections 2024-04-06T12:35:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.479+0000 7f49bd76a700 1 --2- 172.21.15.152:0/4234966715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49b80fd170 0x7f49b80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.479+0000 7f49bd76a700 1 --2- 172.21.15.152:0/4234966715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 0x7f49b80fcbf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.479+0000 7f49bd76a700 1 -- 172.21.15.152:0/4234966715 >> 172.21.15.152:0/4234966715 conn(0x7f49b80f23f0 msgr2=0x7f49b80f4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.479+0000 7f49bd76a700 1 -- 172.21.15.152:0/4234966715 shutdown_connections 2024-04-06T12:35:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.479+0000 7f49bd76a700 1 -- 172.21.15.152:0/4234966715 wait complete. 2024-04-06T12:35:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.480+0000 7f49bd76a700 1 Processor -- start 2024-04-06T12:35:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.480+0000 7f49bd76a700 1 -- start start 2024-04-06T12:35:03.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49bd76a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 0x7f49b810cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:03.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49bd76a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49b80fd170 0x7f49b810d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:03.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49bd76a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b810da50 con 0x7f49b80fc810 2024-04-06T12:35:03.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49bd76a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b810db90 con 0x7f49b80fd170 2024-04-06T12:35:03.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49b6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 0x7f49b810cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:03.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49b6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 0x7f49b810cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32856/0 (socket says 172.21.15.152:32856) 2024-04-06T12:35:03.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49b6ffd700 1 -- 172.21.15.152:0/4044955545 learned_addr learned my addr 172.21.15.152:0/4044955545 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:03.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49b6ffd700 1 -- 172.21.15.152:0/4044955545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49b80fd170 msgr2=0x7f49b810d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49b6ffd700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49b80fd170 0x7f49b810d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49b6ffd700 1 -- 172.21.15.152:0/4044955545 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8005040 con 0x7f49b80fc810 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49b6ffd700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 0x7f49b810cf60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f49a8005010 tx=0x7f49a8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f499ffff700 1 -- 172.21.15.152:0/4044955545 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a800e030 con 0x7f49b80fc810 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b8107210 con 0x7f49b80fc810 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f499ffff700 1 -- 172.21.15.152:0/4044955545 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49a8007e90 con 0x7f49b80fc810 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f499ffff700 1 -- 172.21.15.152:0/4044955545 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a8018070 con 0x7f49b80fc810 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.481+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b81076f0 con 0x7f49b80fc810 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.482+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b805f2e0 con 0x7f49b80fc810 2024-04-06T12:35:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.483+0000 7f499ffff700 1 -- 172.21.15.152:0/4044955545 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f49a801d6e0 con 0x7f49b80fc810 2024-04-06T12:35:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.483+0000 7f499ffff700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f49a006ca30 0x7f49a006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.483+0000 7f499ffff700 1 -- 172.21.15.152:0/4044955545 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f49a808d170 con 0x7f49b80fc810 2024-04-06T12:35:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.483+0000 7f49b67fc700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f49a006ca30 0x7f49a006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.483+0000 7f49b67fc700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f49a006ca30 0x7f49a006eef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f49b81088a0 tx=0x7f49ac009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:03.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.487+0000 7f499ffff700 1 -- 172.21.15.152:0/4044955545 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f49a805a920 con 0x7f49b80fc810 2024-04-06T12:35:03.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:03 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1979060860' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-06T12:35:03.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:03 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3064488297' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-06T12:35:03.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:03 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1810610129' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-06T12:35:03.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.720+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f49b80feb60 con 0x7f49b80fc810 2024-04-06T12:35:03.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.720+0000 7f499ffff700 1 -- 172.21.15.152:0/4044955545 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) v1 ==== 107+0+4837 (secure 0 0 0) 0x7f49a805a740 con 0x7f49b80fc810 2024-04-06T12:35:03.718 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:03.718 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44353,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/1415350806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1415350806},{"type":"v1","addr":"172.21.15.195:6827","nonce":1415350806}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:33:10.095353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:03.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.722+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f49a006ca30 msgr2=0x7f49a006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.722+0000 7f49bd76a700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f49a006ca30 0x7f49a006eef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f49b81088a0 tx=0x7f49ac009b60).stop 2024-04-06T12:35:03.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.722+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 msgr2=0x7f49b810cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.722+0000 7f49bd76a700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 0x7f49b810cf60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f49a8005010 tx=0x7f49a8009cb0).stop 2024-04-06T12:35:03.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.722+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 shutdown_connections 2024-04-06T12:35:03.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.722+0000 7f49bd76a700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f49a006ca30 0x7f49a006eef0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.722+0000 7f49bd76a700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b80fc810 0x7f49b810cf60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.722+0000 7f49bd76a700 1 --2- 172.21.15.152:0/4044955545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49b80fd170 0x7f49b810d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:35:03.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.722+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 >> 172.21.15.152:0/4044955545 conn(0x7f49b80f23f0 msgr2=0x7f49b80fabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:03.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.723+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 shutdown_connections 2024-04-06T12:35:03.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.723+0000 7f49bd76a700 1 -- 172.21.15.152:0/4044955545 wait complete. 2024-04-06T12:35:03.722 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 30 2024-04-06T12:35:03.732 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-04-06T12:35:03.732 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-06T12:35:03.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.852+0000 7f025b524700 1 -- 172.21.15.152:0/2063027332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 msgr2=0x7f02540f6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.852+0000 7f025b524700 1 --2- 172.21.15.152:0/2063027332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 0x7f02540f6b50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f02500047f0 tx=0x7f0250009cb0).stop 2024-04-06T12:35:03.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.852+0000 7f025b524700 1 -- 172.21.15.152:0/2063027332 shutdown_connections 2024-04-06T12:35:03.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.852+0000 7f025b524700 1 --2- 172.21.15.152:0/2063027332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 0x7f02540f6b50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.852+0000 7f025b524700 1 --2- 172.21.15.152:0/2063027332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02540fca30 0x7f02540fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.852+0000 7f025b524700 1 -- 172.21.15.152:0/2063027332 >> 172.21.15.152:0/2063027332 conn(0x7f02540f25d0 msgr2=0x7f02540f49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:03.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.852+0000 7f025b524700 1 -- 172.21.15.152:0/2063027332 shutdown_connections 2024-04-06T12:35:03.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.852+0000 7f025b524700 1 -- 172.21.15.152:0/2063027332 wait complete. 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f025b524700 1 Processor -- start 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f025b524700 1 -- start start 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f025b524700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02540fca30 0x7f025410d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f025b524700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 0x7f025410d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f025b524700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025410dc60 con 0x7f02540fd390 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f025b524700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025410dda0 con 0x7f02540fca30 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f0258abf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 0x7f025410d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f0258abf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 0x7f025410d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32862/0 (socket says 172.21.15.152:32862) 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f0258abf700 1 -- 172.21.15.152:0/1248463762 learned_addr learned my addr 172.21.15.152:0/1248463762 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f02592c0700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02540fca30 0x7f025410d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f0258abf700 1 -- 172.21.15.152:0/1248463762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02540fca30 msgr2=0x7f025410d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f0258abf700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02540fca30 0x7f025410d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:03.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.853+0000 7f0258abf700 1 -- 172.21.15.152:0/1248463762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250005040 con 0x7f02540fd390 2024-04-06T12:35:03.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.854+0000 7f0258abf700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 0x7f025410d660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0250000c00 tx=0x7f0250009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:03.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.854+0000 7f024a7fc700 1 -- 172.21.15.152:0/1248463762 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025000e030 con 0x7f02540fd390 2024-04-06T12:35:03.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.854+0000 7f024a7fc700 1 -- 172.21.15.152:0/1248463762 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0250007e90 con 0x7f02540fd390 2024-04-06T12:35:03.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.854+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02541073d0 con 0x7f02540fd390 2024-04-06T12:35:03.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.854+0000 7f024a7fc700 1 -- 172.21.15.152:0/1248463762 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0250018070 con 0x7f02540fd390 2024-04-06T12:35:03.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.854+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02541078b0 con 0x7f02540fd390 2024-04-06T12:35:03.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.855+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02540603b0 con 0x7f02540fd390 2024-04-06T12:35:03.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.855+0000 7f024a7fc700 1 -- 172.21.15.152:0/1248463762 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f025001d420 con 0x7f02540fd390 2024-04-06T12:35:03.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.856+0000 7f024a7fc700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f024006cab0 0x7f024006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:03.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.856+0000 7f024a7fc700 1 -- 172.21.15.152:0/1248463762 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f025008d030 con 0x7f02540fd390 2024-04-06T12:35:03.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.856+0000 7f02592c0700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f024006cab0 0x7f024006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:03.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.856+0000 7f02592c0700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f024006cab0 0x7f024006ef70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0244009250 tx=0x7f0244009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:03.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:03.860+0000 7f024a7fc700 1 -- 172.21.15.152:0/1248463762 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f025005aa70 con 0x7f02540fd390 2024-04-06T12:35:04.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.089+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f025405fb30 con 0x7f02540fd390 2024-04-06T12:35:04.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.090+0000 7f024a7fc700 1 -- 172.21.15.152:0/1248463762 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) v1 ==== 107+0+4834 (secure 0 0 0) 0x7f025005a600 con 0x7f02540fd390 2024-04-06T12:35:04.088 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:04.088 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44353,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/1415350806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1415350806},{"type":"v1","addr":"172.21.15.195:6827","nonce":1415350806}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:33:11.101990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":18,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:04.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.092+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f024006cab0 msgr2=0x7f024006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.092+0000 7f025b524700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f024006cab0 0x7f024006ef70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0244009250 tx=0x7f0244009de0).stop 2024-04-06T12:35:04.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.092+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 msgr2=0x7f025410d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.092+0000 7f025b524700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 0x7f025410d660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0250000c00 tx=0x7f0250009cb0).stop 2024-04-06T12:35:04.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.092+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 shutdown_connections 2024-04-06T12:35:04.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.092+0000 7f025b524700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f024006cab0 0x7f024006ef70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.092+0000 7f025b524700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02540fca30 0x7f025410d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.092+0000 7f025b524700 1 --2- 172.21.15.152:0/1248463762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02540fd390 0x7f025410d660 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.093+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 >> 172.21.15.152:0/1248463762 conn(0x7f02540f25d0 msgr2=0x7f02540f3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:04.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.093+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 shutdown_connections 2024-04-06T12:35:04.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.093+0000 7f025b524700 1 -- 172.21.15.152:0/1248463762 wait complete. 2024-04-06T12:35:04.092 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 31 2024-04-06T12:35:04.102 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-04-06T12:35:04.103 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-06T12:35:04.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.222+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/2271113515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 msgr2=0x7fd5e80f60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.222+0000 7fd5ed7f0700 1 --2- 172.21.15.152:0/2271113515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 0x7fd5e80f60b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd5d80047f0 tx=0x7fd5d8009cb0).stop 2024-04-06T12:35:04.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.222+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/2271113515 shutdown_connections 2024-04-06T12:35:04.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.222+0000 7fd5ed7f0700 1 --2- 172.21.15.152:0/2271113515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 0x7fd5e80f60b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.222+0000 7fd5ed7f0700 1 --2- 172.21.15.152:0/2271113515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5e80fbfa0 0x7fd5e80fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.222+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/2271113515 >> 172.21.15.152:0/2271113515 conn(0x7fd5e806bdc0 msgr2=0x7fd5e806c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:04.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.222+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/2271113515 shutdown_connections 2024-04-06T12:35:04.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.222+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/2271113515 wait complete. 2024-04-06T12:35:04.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5ed7f0700 1 Processor -- start 2024-04-06T12:35:04.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5ed7f0700 1 -- start start 2024-04-06T12:35:04.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5ed7f0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5e80fbfa0 0x7fd5e8109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:04.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5ed7f0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 0x7fd5e8109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:04.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5ed7f0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8109b20 con 0x7fd5e80fc870 2024-04-06T12:35:04.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5ed7f0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8109c60 con 0x7fd5e80fbfa0 2024-04-06T12:35:04.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5e67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 0x7fd5e8109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:04.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5e67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 0x7fd5e8109630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32880/0 (socket says 172.21.15.152:32880) 2024-04-06T12:35:04.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5e67fc700 1 -- 172.21.15.152:0/1571654784 learned_addr learned my addr 172.21.15.152:0/1571654784 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5e6ffd700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5e80fbfa0 0x7fd5e8109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5e67fc700 1 -- 172.21.15.152:0/1571654784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5e80fbfa0 msgr2=0x7fd5e8109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5e67fc700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5e80fbfa0 0x7fd5e8109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5e67fc700 1 -- 172.21.15.152:0/1571654784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d8005040 con 0x7fd5e80fc870 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.223+0000 7fd5e67fc700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 0x7fd5e8109630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd5d8009380 tx=0x7fd5d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.224+0000 7fd5cffff700 1 -- 172.21.15.152:0/1571654784 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d8018070 con 0x7fd5e80fc870 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.224+0000 7fd5cffff700 1 -- 172.21.15.152:0/1571654784 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5d8007e90 con 0x7fd5e80fc870 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.224+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e8109e60 con 0x7fd5e80fc870 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.224+0000 7fd5cffff700 1 -- 172.21.15.152:0/1571654784 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d80123c0 con 0x7fd5e80fc870 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.224+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e8112440 con 0x7fd5e80fc870 2024-04-06T12:35:04.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.225+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e805fb30 con 0x7fd5e80fc870 2024-04-06T12:35:04.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.226+0000 7fd5cffff700 1 -- 172.21.15.152:0/1571654784 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd5d801d420 con 0x7fd5e80fc870 2024-04-06T12:35:04.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.226+0000 7fd5cffff700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd5d006caa0 0x7fd5d006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:04.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.226+0000 7fd5e6ffd700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd5d006caa0 0x7fd5d006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:04.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.227+0000 7fd5e6ffd700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd5d006caa0 0x7fd5d006ef60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd5dc004ee0 tx=0x7fd5dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:04.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.227+0000 7fd5cffff700 1 -- 172.21.15.152:0/1571654784 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fd5d8013410 con 0x7fd5e80fc870 2024-04-06T12:35:04.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.232+0000 7fd5cffff700 1 -- 172.21.15.152:0/1571654784 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fd5d8056dc0 con 0x7fd5e80fc870 2024-04-06T12:35:04.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.463+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fd5e8112a80 con 0x7fd5e80fc870 2024-04-06T12:35:04.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.464+0000 7fd5cffff700 1 -- 172.21.15.152:0/1571654784 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) v1 ==== 107+0+4834 (secure 0 0 0) 0x7fd5d801d6d0 con 0x7fd5e80fc870 2024-04-06T12:35:04.461 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:04.462 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44353,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/1415350806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1415350806},{"type":"v1","addr":"172.21.15.195:6827","nonce":1415350806}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:33:12.110634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":28,"state":"up:active","state_seq":19,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:04.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd5d006caa0 msgr2=0x7fd5d006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd5d006caa0 0x7fd5d006ef60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd5dc004ee0 tx=0x7fd5dc00b040).stop 2024-04-06T12:35:04.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 msgr2=0x7fd5e8109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 0x7fd5e8109630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd5d8009380 tx=0x7fd5d8009cb0).stop 2024-04-06T12:35:04.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 shutdown_connections 2024-04-06T12:35:04.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fd5d006caa0 0x7fd5d006ef60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5e80fbfa0 0x7fd5e8109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 --2- 172.21.15.152:0/1571654784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80fc870 0x7fd5e8109630 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 >> 172.21.15.152:0/1571654784 conn(0x7fd5e806bdc0 msgr2=0x7fd5e80fac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:04.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 shutdown_connections 2024-04-06T12:35:04.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.466+0000 7fd5ed7f0700 1 -- 172.21.15.152:0/1571654784 wait complete. 2024-04-06T12:35:04.465 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 32 2024-04-06T12:35:04.475 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:04 smithi152 ceph-mon[104634]: pgmap v269: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:04.475 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:04 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3372630748' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-06T12:35:04.475 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:04 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/4044955545' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-06T12:35:04.475 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:04 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1248463762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-06T12:35:04.476 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-04-06T12:35:04.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-06T12:35:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:04 smithi195 ceph-mon[85980]: pgmap v269: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:04 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3372630748' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-06T12:35:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:04 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/4044955545' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-06T12:35:04.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:04 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1248463762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-06T12:35:04.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.595+0000 7f8129dde700 1 -- 172.21.15.152:0/1231826854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 msgr2=0x7f81240f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.595+0000 7f8129dde700 1 --2- 172.21.15.152:0/1231826854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 0x7f81240f6930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f8114009b60 tx=0x7f8114004d10).stop 2024-04-06T12:35:04.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.595+0000 7f8129dde700 1 -- 172.21.15.152:0/1231826854 shutdown_connections 2024-04-06T12:35:04.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.595+0000 7f8129dde700 1 --2- 172.21.15.152:0/1231826854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 0x7f81240f6930 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.595+0000 7f8129dde700 1 --2- 172.21.15.152:0/1231826854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81240fc830 0x7f81240fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.596+0000 7f8129dde700 1 -- 172.21.15.152:0/1231826854 >> 172.21.15.152:0/1231826854 conn(0x7f812406c760 msgr2=0x7f812406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.596+0000 7f8129dde700 1 -- 172.21.15.152:0/1231826854 shutdown_connections 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.596+0000 7f8129dde700 1 -- 172.21.15.152:0/1231826854 wait complete. 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.596+0000 7f8129dde700 1 Processor -- start 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.596+0000 7f8129dde700 1 -- start start 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.596+0000 7f8129dde700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81240fc830 0x7f81241101c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.596+0000 7f8129dde700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 0x7f81241106b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.596+0000 7f8129dde700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8124110cb0 con 0x7f81240fd100 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.596+0000 7f8129dde700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8124110df0 con 0x7f81240fc830 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8122ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 0x7f81241106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:04.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8122ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 0x7f81241106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32894/0 (socket says 172.21.15.152:32894) 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8122ffd700 1 -- 172.21.15.152:0/3539119933 learned_addr learned my addr 172.21.15.152:0/3539119933 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f81237fe700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81240fc830 0x7f81241101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8122ffd700 1 -- 172.21.15.152:0/3539119933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81240fc830 msgr2=0x7f81241101c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8122ffd700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81240fc830 0x7f81241101c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8122ffd700 1 -- 172.21.15.152:0/3539119933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140097c0 con 0x7f81240fd100 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8122ffd700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 0x7f81241106b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f8114009040 tx=0x7f8114004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8120ff9700 1 -- 172.21.15.152:0/3539119933 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f811400e070 con 0x7f81240fd100 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812410a420 con 0x7f81240fd100 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8120ff9700 1 -- 172.21.15.152:0/3539119933 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f811400bec0 con 0x7f81240fd100 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8120ff9700 1 -- 172.21.15.152:0/3539119933 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8114019070 con 0x7f81240fd100 2024-04-06T12:35:04.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.597+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812410a980 con 0x7f81240fd100 2024-04-06T12:35:04.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.598+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812405f380 con 0x7f81240fd100 2024-04-06T12:35:04.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.599+0000 7f8120ff9700 1 -- 172.21.15.152:0/3539119933 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f811401e9d0 con 0x7f81240fd100 2024-04-06T12:35:04.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.599+0000 7f8120ff9700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f811006caa0 0x7f811006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:04.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.599+0000 7f8120ff9700 1 -- 172.21.15.152:0/3539119933 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f811408d310 con 0x7f81240fd100 2024-04-06T12:35:04.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.599+0000 7f81237fe700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f811006caa0 0x7f811006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:04.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.599+0000 7f81237fe700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f811006caa0 0x7f811006ef60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f810c004de0 tx=0x7f810c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:04.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.603+0000 7f8120ff9700 1 -- 172.21.15.152:0/3539119933 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f811405ae10 con 0x7f81240fd100 2024-04-06T12:35:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.835+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f812405eec0 con 0x7f81240fd100 2024-04-06T12:35:04.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.836+0000 7f8120ff9700 1 -- 172.21.15.152:0/3539119933 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) v1 ==== 107+0+4834 (secure 0 0 0) 0x7f811405a9a0 con 0x7f81240fd100 2024-04-06T12:35:04.833 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44353,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/1415350806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1415350806},{"type":"v1","addr":"172.21.15.195:6827","nonce":1415350806}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:33:16.240632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":28,"state":"up:active","state_seq":19,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.838+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f811006caa0 msgr2=0x7f811006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.838+0000 7f8129dde700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f811006caa0 0x7f811006ef60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f810c004de0 tx=0x7f810c00b040).stop 2024-04-06T12:35:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.838+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 msgr2=0x7f81241106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.838+0000 7f8129dde700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 0x7f81241106b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f8114009040 tx=0x7f8114004d10).stop 2024-04-06T12:35:04.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.838+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 shutdown_connections 2024-04-06T12:35:04.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.838+0000 7f8129dde700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f811006caa0 0x7f811006ef60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.838+0000 7f8129dde700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81240fc830 0x7f81241101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.838+0000 7f8129dde700 1 --2- 172.21.15.152:0/3539119933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81240fd100 0x7f81241106b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.838+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 >> 172.21.15.152:0/3539119933 conn(0x7f812406c760 msgr2=0x7f8124060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:04.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.839+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 shutdown_connections 2024-04-06T12:35:04.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.839+0000 7f8129dde700 1 -- 172.21.15.152:0/3539119933 wait complete. 2024-04-06T12:35:04.837 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 33 2024-04-06T12:35:04.848 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-04-06T12:35:04.848 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-06T12:35:04.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.968+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/1976091939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 msgr2=0x7fe0d40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.968+0000 7fe0d8fa7700 1 --2- 172.21.15.152:0/1976091939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 0x7fe0d40f6930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fe0c40047f0 tx=0x7fe0c4009cb0).stop 2024-04-06T12:35:04.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.969+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/1976091939 shutdown_connections 2024-04-06T12:35:04.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.969+0000 7fe0d8fa7700 1 --2- 172.21.15.152:0/1976091939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 0x7fe0d40f6930 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.969+0000 7fe0d8fa7700 1 --2- 172.21.15.152:0/1976091939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d40fc830 0x7fe0d40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.969+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/1976091939 >> 172.21.15.152:0/1976091939 conn(0x7fe0d406c760 msgr2=0x7fe0d406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:04.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.969+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/1976091939 shutdown_connections 2024-04-06T12:35:04.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.969+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/1976091939 wait complete. 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.969+0000 7fe0d8fa7700 1 Processor -- start 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.969+0000 7fe0d8fa7700 1 -- start start 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d8fa7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d40fc830 0x7fe0d40f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d8fa7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 0x7fe0d40f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d8fa7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40f9740 con 0x7fe0d40fd100 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d8fa7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40f9880 con 0x7fe0d40fc830 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d1d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 0x7fe0d40f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d1d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 0x7fe0d40f9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32904/0 (socket says 172.21.15.152:32904) 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d1d9b700 1 -- 172.21.15.152:0/3648681509 learned_addr learned my addr 172.21.15.152:0/3648681509 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:04.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d1d9b700 1 -- 172.21.15.152:0/3648681509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d40fc830 msgr2=0x7fe0d40f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d259c700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d40fc830 0x7fe0d40f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d1d9b700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d40fc830 0x7fe0d40f8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d1d9b700 1 -- 172.21.15.152:0/3648681509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4005040 con 0x7fe0d40fd100 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d259c700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d40fc830 0x7fe0d40f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d1d9b700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 0x7fe0d40f9250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fe0c400b120 tx=0x7fe0c4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0c37fe700 1 -- 172.21.15.152:0/3648681509 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0c400e030 con 0x7fe0d40fd100 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d40f9ad0 con 0x7fe0d40fd100 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0c37fe700 1 -- 172.21.15.152:0/3648681509 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0c4007e90 con 0x7fe0d40fd100 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0c37fe700 1 -- 172.21.15.152:0/3648681509 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0c4018070 con 0x7fe0d40fd100 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.970+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d41145d0 con 0x7fe0d40fd100 2024-04-06T12:35:04.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.971+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d405f380 con 0x7fe0d40fd100 2024-04-06T12:35:04.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.972+0000 7fe0c37fe700 1 -- 172.21.15.152:0/3648681509 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe0c4009710 con 0x7fe0d40fd100 2024-04-06T12:35:04.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.972+0000 7fe0c37fe700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe0bc06caa0 0x7fe0bc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:04.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.972+0000 7fe0c37fe700 1 -- 172.21.15.152:0/3648681509 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fe0c408d410 con 0x7fe0d40fd100 2024-04-06T12:35:04.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.972+0000 7fe0d259c700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe0bc06caa0 0x7fe0bc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:04.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.973+0000 7fe0d259c700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe0bc06caa0 0x7fe0bc06ef60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe0c8004ba0 tx=0x7fe0c8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:04.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:04.977+0000 7fe0c37fe700 1 -- 172.21.15.152:0/3648681509 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fe0c40573c0 con 0x7fe0d40fd100 2024-04-06T12:35:05.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.208+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fe0d405eec0 con 0x7fe0d40fd100 2024-04-06T12:35:05.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.208+0000 7fe0c37fe700 1 -- 172.21.15.152:0/3648681509 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) v1 ==== 107+0+4833 (secure 0 0 0) 0x7fe0c405a9e0 con 0x7fe0d40fd100 2024-04-06T12:35:05.206 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:05.206 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi152.mxtfph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6829/367125625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":367125625},{"type":"v1","addr":"172.21.15.152:6829","nonce":367125625}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44325,"name":"cephfs.smithi195.akamqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2930845511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2930845511},{"type":"v1","addr":"172.21.15.195:6825","nonce":2930845511}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44353,"name":"cephfs.smithi195.ttgcpp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/1415350806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1415350806},{"type":"v1","addr":"172.21.15.195:6827","nonce":1415350806}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-06T12:20:00.340806+0000","modified":"2024-04-06T12:33:17.242386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi152.spbxnv","rank":0,"incarnation":28,"state":"up:active","state_seq":19,"addr":"172.21.15.152:6827/754565867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":754565867},{"type":"v1","addr":"172.21.15.152:6827","nonce":754565867}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-06T12:35:05.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.210+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe0bc06caa0 msgr2=0x7fe0bc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.210+0000 7fe0d8fa7700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe0bc06caa0 0x7fe0bc06ef60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe0c8004ba0 tx=0x7fe0c8009040).stop 2024-04-06T12:35:05.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.210+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 msgr2=0x7fe0d40f9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.210+0000 7fe0d8fa7700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 0x7fe0d40f9250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fe0c400b120 tx=0x7fe0c4009cb0).stop 2024-04-06T12:35:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.210+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 shutdown_connections 2024-04-06T12:35:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.210+0000 7fe0d8fa7700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fe0bc06caa0 0x7fe0bc06ef60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.210+0000 7fe0d8fa7700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d40fc830 0x7fe0d40f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.210+0000 7fe0d8fa7700 1 --2- 172.21.15.152:0/3648681509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0d40fd100 0x7fe0d40f9250 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.210+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 >> 172.21.15.152:0/3648681509 conn(0x7fe0d406c760 msgr2=0x7fe0d40605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.211+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 shutdown_connections 2024-04-06T12:35:05.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.211+0000 7fe0d8fa7700 1 -- 172.21.15.152:0/3648681509 wait complete. 2024-04-06T12:35:05.210 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 34 2024-04-06T12:35:05.221 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-06T12:35:05.232 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-06T12:35:05.233 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:35:05.233 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-06T12:35:05.252 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:35:05.252 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-06T12:35:05.312 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-06T12:35:05.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.472+0000 7f123c3b7700 1 -- 172.21.15.152:0/4065254523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fd1a0 msgr2=0x7f12340f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.472+0000 7f123c3b7700 1 --2- 172.21.15.152:0/4065254523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fd1a0 0x7f12340f6980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f12300047f0 tx=0x7f1230009cb0).stop 2024-04-06T12:35:05.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.472+0000 7f123c3b7700 1 -- 172.21.15.152:0/4065254523 shutdown_connections 2024-04-06T12:35:05.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.472+0000 7f123c3b7700 1 --2- 172.21.15.152:0/4065254523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fd1a0 0x7f12340f6980 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.472+0000 7f123c3b7700 1 --2- 172.21.15.152:0/4065254523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12340fc840 0x7f12340fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.472+0000 7f123c3b7700 1 -- 172.21.15.152:0/4065254523 >> 172.21.15.152:0/4065254523 conn(0x7f12340f2440 msgr2=0x7f12340f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:05.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.472+0000 7f123c3b7700 1 -- 172.21.15.152:0/4065254523 shutdown_connections 2024-04-06T12:35:05.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.472+0000 7f123c3b7700 1 -- 172.21.15.152:0/4065254523 wait complete. 2024-04-06T12:35:05.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123c3b7700 1 Processor -- start 2024-04-06T12:35:05.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123c3b7700 1 -- start start 2024-04-06T12:35:05.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123c3b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fc840 0x7f12340f8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:05.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123c3b7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12340fd1a0 0x7f12340f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:05.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123c3b7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340f8f70 con 0x7f12340fc840 2024-04-06T12:35:05.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123c3b7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340f90b0 con 0x7f12340fd1a0 2024-04-06T12:35:05.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123a153700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fc840 0x7f12340f8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:05.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123a153700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fc840 0x7f12340f8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32912/0 (socket says 172.21.15.152:32912) 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123a153700 1 -- 172.21.15.152:0/4008632736 learned_addr learned my addr 172.21.15.152:0/4008632736 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f1239952700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12340fd1a0 0x7f12340f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123a153700 1 -- 172.21.15.152:0/4008632736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12340fd1a0 msgr2=0x7f12340f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123a153700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12340fd1a0 0x7f12340f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123a153700 1 -- 172.21.15.152:0/4008632736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1230005040 con 0x7f12340fc840 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123a153700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fc840 0x7f12340f8590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f122400c790 tx=0x7f122400cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f122b7fe700 1 -- 172.21.15.152:0/4008632736 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12240106f0 con 0x7f12340fc840 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f122b7fe700 1 -- 172.21.15.152:0/4008632736 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1224010d00 con 0x7f12340fc840 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340f9360 con 0x7f12340fc840 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f122b7fe700 1 -- 172.21.15.152:0/4008632736 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1224012e50 con 0x7f12340fc840 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.473+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12341145d0 con 0x7f12340fc840 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.474+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123405f2e0 con 0x7f12340fc840 2024-04-06T12:35:05.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.475+0000 7f122b7fe700 1 -- 172.21.15.152:0/4008632736 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1224010850 con 0x7f12340fc840 2024-04-06T12:35:05.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.475+0000 7f122b7fe700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f122006caa0 0x7f122006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:05.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.475+0000 7f122b7fe700 1 -- 172.21.15.152:0/4008632736 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f122408b800 con 0x7f12340fc840 2024-04-06T12:35:05.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.475+0000 7f1239952700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f122006caa0 0x7f122006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:05.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.476+0000 7f1239952700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f122006caa0 0x7f122006ef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f12340f9d30 tx=0x7f123000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:05.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.480+0000 7f122b7fe700 1 -- 172.21.15.152:0/4008632736 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f12240557b0 con 0x7f12340fc840 2024-04-06T12:35:05.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:05 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1571654784' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-06T12:35:05.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:05 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3539119933' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-06T12:35:05.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:05 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3648681509' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-06T12:35:05.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:05 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1571654784' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-06T12:35:05.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:05 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3539119933' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-06T12:35:05.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:05 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3648681509' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-06T12:35:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.669+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f123405eec0 con 0x7f12340fc840 2024-04-06T12:35:05.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.670+0000 7f122b7fe700 1 -- 172.21.15.152:0/4008632736 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16639 (secure 0 0 0) 0x7f1224058dd0 con 0x7f12340fc840 2024-04-06T12:35:05.668 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:05.668 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":92,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","created":"2024-04-06T12:13:16.768469+0000","modified":"2024-04-06T12:33:00.179732+0000","last_up_change":"2024-04-06T12:31:57.863057+0000","last_in_change":"2024-04-06T12:18:18.562700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-06T12:17:21.824734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-06T12:19:59.272151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-06T12:19:59.568441+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb0a62c1-5f47-450c-8e9e-4e02c899eda3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":87,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6803","nonce":2874592048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6805","nonce":2874592048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6809","nonce":2874592048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6807","nonce":2874592048}]},"public_addr":"172.21.15.152:6803/2874592048","cluster_addr":"172.21.15.152:6805/2874592048","heartbeat_back_addr":"172.21.15.152:6809/2874592048","heartbeat_front_addr":"172.21.15.152:6807/2874592048","state":["exists","up"]},{"osd":1,"uuid":"f9490187-6df1-4d4f-bfd3-a2da32d3a669","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":87,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6811","nonce":697648342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6813","nonce":697648342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6817","nonce":697648342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6815","nonce":697648342}]},"public_addr":"172.21.15.152:6811/697648342","cluster_addr":"172.21.15.152:6813/697648342","heartbeat_back_addr":"172.21.15.152:6817/697648342","heartbeat_front_addr":"172.21.15.152:6815/697648342","state":["exists","up"]},{"osd":2,"uuid":"4a279284-26fa-436f-a830-abda13b40713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":87,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6819","nonce":426029450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6821","nonce":426029450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6825","nonce":426029450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6823","nonce":426029450}]},"public_addr":"172.21.15.152:6819/426029450","cluster_addr":"172.21.15.152:6821/426029450","heartbeat_back_addr":"172.21.15.152:6825/426029450","heartbeat_front_addr":"172.21.15.152:6823/426029450","state":["exists","up"]},{"osd":3,"uuid":"64e8942a-1121-44fd-9ed2-cbb5176df587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":72,"up_thru":87,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6801","nonce":2677078036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6803","nonce":2677078036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6807","nonce":2677078036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6805","nonce":2677078036}]},"public_addr":"172.21.15.195:6801/2677078036","cluster_addr":"172.21.15.195:6803/2677078036","heartbeat_back_addr":"172.21.15.195:6807/2677078036","heartbeat_front_addr":"172.21.15.195:6805/2677078036","state":["exists","up"]},{"osd":4,"uuid":"378a7c45-9887-4e48-b004-0f3b470af912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":77,"up_from":81,"up_thru":87,"down_at":78,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6809","nonce":4141179082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6811","nonce":4141179082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6815","nonce":4141179082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6813","nonce":4141179082}]},"public_addr":"172.21.15.195:6809/4141179082","cluster_addr":"172.21.15.195:6811/4141179082","heartbeat_back_addr":"172.21.15.195:6815/4141179082","heartbeat_front_addr":"172.21.15.195:6813/4141179082","state":["exists","up"]},{"osd":5,"uuid":"2608627e-47c5-446a-b13e-699aaaea81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":82,"up_from":87,"up_thru":87,"down_at":83,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6817","nonce":666904784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6819","nonce":666904784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6823","nonce":666904784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6821","nonce":666904784}]},"public_addr":"172.21.15.195:6817/666904784","cluster_addr":"172.21.15.195:6819/666904784","heartbeat_back_addr":"172.21.15.195:6823/666904784","heartbeat_front_addr":"172.21.15.195:6821/666904784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:18.549757+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:51.020120+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:20.272551+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:44.651165+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:09.828133+0000","dead_epoch":77},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:35.929735+0000","dead_epoch":82}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":0,"to":2}]},{"pgid":"2.8","mappings":[{"from":0,"to":2}]},{"pgid":"2.e","mappings":[{"from":0,"to":5}]},{"pgid":"3.0","mappings":[{"from":1,"to":3}]},{"pgid":"3.15","mappings":[{"from":4,"to":2}]},{"pgid":"3.18","mappings":[{"from":1,"to":3}]},{"pgid":"3.1d","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6827/3193759698":"2024-04-07T12:33:00.179702+0000","172.21.15.195:6826/3193759698":"2024-04-07T12:33:00.179702+0000","172.21.15.152:6826/3429506423":"2024-04-07T12:32:01.574018+0000","172.21.15.152:0/1001505472":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6801/2887118719":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6800/2887118719":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6800/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6801/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:6801/3059779308":"2024-04-07T12:22:14.581351+0000","172.21.15.195:6828/929884390":"2024-04-07T12:24:53.099048+0000","172.21.15.152:0/2556143500":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/1200342064":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/496247839":"2024-04-07T12:27:36.998356+0000","172.21.15.152:0/378420270":"2024-04-07T12:14:19.995122+0000","172.21.15.195:6825/3550026836":"2024-04-07T12:32:38.699104+0000","172.21.15.152:6800/3059779308":"2024-04-07T12:22:14.581351+0000","172.21.15.152:6800/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.195:6824/3550026836":"2024-04-07T12:32:38.699104+0000","172.21.15.152:0/2583442237":"2024-04-07T12:13:49.213100+0000","172.21.15.152:0/3513201934":"2024-04-07T12:27:36.998356+0000","172.21.15.152:0/2930097039":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/944313623":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6800/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/2646133243":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6801/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.195:0/705319294":"2024-04-07T12:24:53.099048+0000","172.21.15.152:0/1500470379":"2024-04-07T12:22:14.581351+0000","172.21.15.152:6801/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6827/3429506423":"2024-04-07T12:32:01.574018+0000","172.21.15.195:0/4169384300":"2024-04-07T12:24:53.099048+0000","172.21.15.152:0/2875093102":"2024-04-07T12:22:14.581351+0000","172.21.15.195:0/2368565634":"2024-04-07T12:24:53.099048+0000","172.21.15.195:6829/929884390":"2024-04-07T12:24:53.099048+0000","172.21.15.195:0/3242451589":"2024-04-07T12:24:53.099048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T12:35:05.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f122006caa0 msgr2=0x7f122006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f122006caa0 0x7f122006ef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f12340f9d30 tx=0x7f123000b040).stop 2024-04-06T12:35:05.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fc840 msgr2=0x7f12340f8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fc840 0x7f12340f8590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f122400c790 tx=0x7f122400cb50).stop 2024-04-06T12:35:05.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 shutdown_connections 2024-04-06T12:35:05.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f122006caa0 0x7f122006ef60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12340fc840 0x7f12340f8590 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 --2- 172.21.15.152:0/4008632736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12340fd1a0 0x7f12340f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 >> 172.21.15.152:0/4008632736 conn(0x7f12340f2440 msgr2=0x7f1234060e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:05.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 shutdown_connections 2024-04-06T12:35:05.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.672+0000 7f123c3b7700 1 -- 172.21.15.152:0/4008632736 wait complete. 2024-04-06T12:35:05.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-06T12:17:21.824734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-06T12:19:59.272151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-06T12:19:59.568441+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-06T12:35:05.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-06T12:35:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.804+0000 7f423629c700 1 -- 172.21.15.152:0/766184466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fc890 msgr2=0x7f42300fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.804+0000 7f423629c700 1 --2- 172.21.15.152:0/766184466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fc890 0x7f42300fcc70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f42200047f0 tx=0x7f4220009cb0).stop 2024-04-06T12:35:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.804+0000 7f423629c700 1 -- 172.21.15.152:0/766184466 shutdown_connections 2024-04-06T12:35:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.804+0000 7f423629c700 1 --2- 172.21.15.152:0/766184466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42300fd1f0 0x7f42300f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.804+0000 7f423629c700 1 --2- 172.21.15.152:0/766184466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fc890 0x7f42300fcc70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.804+0000 7f423629c700 1 -- 172.21.15.152:0/766184466 >> 172.21.15.152:0/766184466 conn(0x7f42300f2490 msgr2=0x7f42300f48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.804+0000 7f423629c700 1 -- 172.21.15.152:0/766184466 shutdown_connections 2024-04-06T12:35:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.804+0000 7f423629c700 1 -- 172.21.15.152:0/766184466 wait complete. 2024-04-06T12:35:05.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f423629c700 1 Processor -- start 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f423629c700 1 -- start start 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f423629c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42300fc890 0x7f423010d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f423629c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fd1f0 0x7f423010d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f423629c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423010db10 con 0x7f42300fd1f0 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f423629c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423010dc50 con 0x7f42300fc890 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f4227fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fd1f0 0x7f423010d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f4227fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fd1f0 0x7f423010d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32922/0 (socket says 172.21.15.152:32922) 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f4227fff700 1 -- 172.21.15.152:0/3301013430 learned_addr learned my addr 172.21.15.152:0/3301013430 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f422ffff700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42300fc890 0x7f423010d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f4227fff700 1 -- 172.21.15.152:0/3301013430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42300fc890 msgr2=0x7f423010d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f4227fff700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42300fc890 0x7f423010d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f4227fff700 1 -- 172.21.15.152:0/3301013430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4220005040 con 0x7f42300fd1f0 2024-04-06T12:35:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.805+0000 7f4227fff700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fd1f0 0x7f423010d510 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f421800e940 tx=0x7f421800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.806+0000 7f422df76700 1 -- 172.21.15.152:0/3301013430 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4218007b40 con 0x7f42300fd1f0 2024-04-06T12:35:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.806+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4230107280 con 0x7f42300fd1f0 2024-04-06T12:35:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.806+0000 7f422df76700 1 -- 172.21.15.152:0/3301013430 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f421800f040 con 0x7f42300fd1f0 2024-04-06T12:35:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.806+0000 7f422df76700 1 -- 172.21.15.152:0/3301013430 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42180148e0 con 0x7f42300fd1f0 2024-04-06T12:35:05.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.806+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4230107840 con 0x7f42300fd1f0 2024-04-06T12:35:05.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.807+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423005f2e0 con 0x7f42300fd1f0 2024-04-06T12:35:05.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.807+0000 7f422df76700 1 -- 172.21.15.152:0/3301013430 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4218007ca0 con 0x7f42300fd1f0 2024-04-06T12:35:05.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.807+0000 7f422df76700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f421c06caa0 0x7f421c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:05.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.807+0000 7f422df76700 1 -- 172.21.15.152:0/3301013430 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f421808b8d0 con 0x7f42300fd1f0 2024-04-06T12:35:05.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.808+0000 7f422ffff700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f421c06caa0 0x7f421c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:05.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.808+0000 7f422ffff700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f421c06caa0 0x7f421c06ef60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f42200047c0 tx=0x7f4220009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:05.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.812+0000 7f422df76700 1 -- 172.21.15.152:0/3301013430 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f4218059310 con 0x7f42300fd1f0 2024-04-06T12:35:05.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.998+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42300febe0 con 0x7f42300fd1f0 2024-04-06T12:35:05.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:05.999+0000 7f422df76700 1 -- 172.21.15.152:0/3301013430 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4218058ea0 con 0x7f42300fd1f0 2024-04-06T12:35:05.997 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-06T12:35:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f421c06caa0 msgr2=0x7f421c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f421c06caa0 0x7f421c06ef60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f42200047c0 tx=0x7f4220009cb0).stop 2024-04-06T12:35:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fd1f0 msgr2=0x7f423010d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fd1f0 0x7f423010d510 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f421800e940 tx=0x7f421800b040).stop 2024-04-06T12:35:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 shutdown_connections 2024-04-06T12:35:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f421c06caa0 0x7f421c06ef60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42300fc890 0x7f423010d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 --2- 172.21.15.152:0/3301013430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42300fd1f0 0x7f423010d510 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 >> 172.21.15.152:0/3301013430 conn(0x7f42300f2490 msgr2=0x7f42300fac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:06.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 shutdown_connections 2024-04-06T12:35:06.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.001+0000 7f423629c700 1 -- 172.21.15.152:0/3301013430 wait complete. 2024-04-06T12:35:06.011 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-06T12:35:06.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.132+0000 7f1aa5668700 1 -- 172.21.15.152:0/1761712644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 msgr2=0x7f1aa00f7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.132+0000 7f1aa5668700 1 --2- 172.21.15.152:0/1761712644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 0x7f1aa00f7c10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f1a940047f0 tx=0x7f1a94009cb0).stop 2024-04-06T12:35:06.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.132+0000 7f1aa5668700 1 -- 172.21.15.152:0/1761712644 shutdown_connections 2024-04-06T12:35:06.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.132+0000 7f1aa5668700 1 --2- 172.21.15.152:0/1761712644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 0x7f1aa00f7c10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.132+0000 7f1aa5668700 1 --2- 172.21.15.152:0/1761712644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa00fda80 0x7f1aa00fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.132+0000 7f1aa5668700 1 -- 172.21.15.152:0/1761712644 >> 172.21.15.152:0/1761712644 conn(0x7f1aa00f3690 msgr2=0x7f1aa00f5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.132+0000 7f1aa5668700 1 -- 172.21.15.152:0/1761712644 shutdown_connections 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.132+0000 7f1aa5668700 1 -- 172.21.15.152:0/1761712644 wait complete. 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.133+0000 7f1aa5668700 1 Processor -- start 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.133+0000 7f1aa5668700 1 -- start start 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.133+0000 7f1aa5668700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa00fda80 0x7f1aa010e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.133+0000 7f1aa5668700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 0x7f1aa010e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.133+0000 7f1aa5668700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa010ed10 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.133+0000 7f1aa5668700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa010ee50 con 0x7f1aa00fda80 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.133+0000 7f1a9e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 0x7f1aa010e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.133+0000 7f1a9e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 0x7f1aa010e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32928/0 (socket says 172.21.15.152:32928) 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.133+0000 7f1a9e7fc700 1 -- 172.21.15.152:0/3993603715 learned_addr learned my addr 172.21.15.152:0/3993603715 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1a9effd700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa00fda80 0x7f1aa010e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1a9e7fc700 1 -- 172.21.15.152:0/3993603715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa00fda80 msgr2=0x7f1aa010e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1a9e7fc700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa00fda80 0x7f1aa010e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1a9e7fc700 1 -- 172.21.15.152:0/3993603715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a94005040 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1a9effd700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa00fda80 0x7f1aa010e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:35:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1a9e7fc700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 0x7f1aa010e710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1a94005010 tx=0x7f1a94009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1a87fff700 1 -- 172.21.15.152:0/3993603715 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a9400e030 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa0108480 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1a87fff700 1 -- 172.21.15.152:0/3993603715 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a94007e90 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1a87fff700 1 -- 172.21.15.152:0/3993603715 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a94018070 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.134+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa0108960 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.135+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa0060410 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.135+0000 7f1a87fff700 1 -- 172.21.15.152:0/3993603715 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1a9401d6e0 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.136+0000 7f1a87fff700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1a8806ca30 0x7f1a8806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.136+0000 7f1a87fff700 1 -- 172.21.15.152:0/3993603715 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f1a9408d170 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.136+0000 7f1a9effd700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1a8806ca30 0x7f1a8806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.136+0000 7f1a9effd700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1a8806ca30 0x7f1a8806eef0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f1a90004c80 tx=0x7f1a9000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:06.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.140+0000 7f1a87fff700 1 -- 172.21.15.152:0/3993603715 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f1a9405a920 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:06 smithi152 ceph-mon[104634]: pgmap v270: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:06.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:06 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/4008632736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:35:06.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:06 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3301013430' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-06T12:35:06.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.329+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1aa005fb30 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.329+0000 7f1a87fff700 1 -- 172.21.15.152:0/3993603715 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1a9405a740 con 0x7f1aa00fe3e0 2024-04-06T12:35:06.327 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-06T12:35:06.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1a8806ca30 msgr2=0x7f1a8806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1a8806ca30 0x7f1a8806eef0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f1a90004c80 tx=0x7f1a9000b040).stop 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 msgr2=0x7f1aa010e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 0x7f1aa010e710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1a94005010 tx=0x7f1a94009cb0).stop 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 shutdown_connections 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f1a8806ca30 0x7f1a8806eef0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa00fda80 0x7f1aa010e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 --2- 172.21.15.152:0/3993603715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa00fe3e0 0x7f1aa010e710 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 >> 172.21.15.152:0/3993603715 conn(0x7f1aa00f3690 msgr2=0x7f1aa00fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 shutdown_connections 2024-04-06T12:35:06.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.332+0000 7f1aa5668700 1 -- 172.21.15.152:0/3993603715 wait complete. 2024-04-06T12:35:06.341 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-06T12:35:06.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.463+0000 7f838d314700 1 -- 172.21.15.152:0/3043777921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f9400 msgr2=0x7f8388101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.463+0000 7f838d314700 1 --2- 172.21.15.152:0/3043777921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f9400 0x7f8388101b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f83780047f0 tx=0x7f8378009cb0).stop 2024-04-06T12:35:06.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.463+0000 7f838d314700 1 -- 172.21.15.152:0/3043777921 shutdown_connections 2024-04-06T12:35:06.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.463+0000 7f838d314700 1 --2- 172.21.15.152:0/3043777921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f9400 0x7f8388101b10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.463+0000 7f838d314700 1 --2- 172.21.15.152:0/3043777921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83880f8aa0 0x7f83880f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.463+0000 7f838d314700 1 -- 172.21.15.152:0/3043777921 >> 172.21.15.152:0/3043777921 conn(0x7f83880f25b0 msgr2=0x7f83880f49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:06.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.463+0000 7f838d314700 1 -- 172.21.15.152:0/3043777921 shutdown_connections 2024-04-06T12:35:06.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.463+0000 7f838d314700 1 -- 172.21.15.152:0/3043777921 wait complete. 2024-04-06T12:35:06.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f838d314700 1 Processor -- start 2024-04-06T12:35:06.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f838d314700 1 -- start start 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f838d314700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f8aa0 0x7f838810e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f838d314700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83880f9400 0x7f838810e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f838d314700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838810ee30 con 0x7f83880f8aa0 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f838d314700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838810ef70 con 0x7f83880f9400 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f8386ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f8aa0 0x7f838810e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f8386ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f8aa0 0x7f838810e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32948/0 (socket says 172.21.15.152:32948) 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f8386ffd700 1 -- 172.21.15.152:0/2906089893 learned_addr learned my addr 172.21.15.152:0/2906089893 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f83867fc700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83880f9400 0x7f838810e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f8386ffd700 1 -- 172.21.15.152:0/2906089893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83880f9400 msgr2=0x7f838810e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f8386ffd700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83880f9400 0x7f838810e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.464+0000 7f8386ffd700 1 -- 172.21.15.152:0/2906089893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378005040 con 0x7f83880f8aa0 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.465+0000 7f8386ffd700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f8aa0 0x7f838810e340 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f837c0041d0 tx=0x7f837c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:06.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.465+0000 7f836ffff700 1 -- 172.21.15.152:0/2906089893 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837c007b40 con 0x7f83880f8aa0 2024-04-06T12:35:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.465+0000 7f836ffff700 1 -- 172.21.15.152:0/2906089893 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f837c00f040 con 0x7f83880f8aa0 2024-04-06T12:35:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.465+0000 7f836ffff700 1 -- 172.21.15.152:0/2906089893 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837c00d800 con 0x7f83880f8aa0 2024-04-06T12:35:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.465+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8388108600 con 0x7f83880f8aa0 2024-04-06T12:35:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.465+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8388108b40 con 0x7f83880f8aa0 2024-04-06T12:35:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.466+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83880603b0 con 0x7f83880f8aa0 2024-04-06T12:35:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.466+0000 7f836ffff700 1 -- 172.21.15.152:0/2906089893 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f837c007ca0 con 0x7f83880f8aa0 2024-04-06T12:35:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.466+0000 7f836ffff700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f837006caa0 0x7f837006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.467+0000 7f836ffff700 1 -- 172.21.15.152:0/2906089893 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f837c08b8e0 con 0x7f83880f8aa0 2024-04-06T12:35:06.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.467+0000 7f83867fc700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f837006caa0 0x7f837006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:06.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.467+0000 7f83867fc700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f837006caa0 0x7f837006ef60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f8378004f10 tx=0x7f837800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:06.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.471+0000 7f836ffff700 1 -- 172.21.15.152:0/2906089893 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f837c059320 con 0x7f83880f8aa0 2024-04-06T12:35:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:06 smithi195 ceph-mon[85980]: pgmap v270: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:06 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/4008632736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:35:06.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:06 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3301013430' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-06T12:35:06.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.658+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f838805fb30 con 0x7f83880f8aa0 2024-04-06T12:35:06.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.658+0000 7f836ffff700 1 -- 172.21.15.152:0/2906089893 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f838805fb30 con 0x7f83880f8aa0 2024-04-06T12:35:06.656 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-06T12:35:06.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f837006caa0 msgr2=0x7f837006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f837006caa0 0x7f837006ef60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f8378004f10 tx=0x7f837800b040).stop 2024-04-06T12:35:06.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f8aa0 msgr2=0x7f838810e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f8aa0 0x7f838810e340 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f837c0041d0 tx=0x7f837c009f60).stop 2024-04-06T12:35:06.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 shutdown_connections 2024-04-06T12:35:06.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f837006caa0 0x7f837006ef60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83880f8aa0 0x7f838810e340 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 --2- 172.21.15.152:0/2906089893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83880f9400 0x7f838810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 >> 172.21.15.152:0/2906089893 conn(0x7f83880f25b0 msgr2=0x7f83880ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:06.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 shutdown_connections 2024-04-06T12:35:06.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.660+0000 7f838d314700 1 -- 172.21.15.152:0/2906089893 wait complete. 2024-04-06T12:35:06.670 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 -- 172.21.15.152:0/4042449388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 msgr2=0x7fdeac0fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 --2- 172.21.15.152:0/4042449388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 0x7fdeac0fcc70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fdea80047f0 tx=0x7fdea8009cb0).stop 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 -- 172.21.15.152:0/4042449388 shutdown_connections 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 --2- 172.21.15.152:0/4042449388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdeac0fd1f0 0x7fdeac0f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 --2- 172.21.15.152:0/4042449388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 0x7fdeac0fcc70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 -- 172.21.15.152:0/4042449388 >> 172.21.15.152:0/4042449388 conn(0x7fdeac0f2490 msgr2=0x7fdeac0f48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 -- 172.21.15.152:0/4042449388 shutdown_connections 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 -- 172.21.15.152:0/4042449388 wait complete. 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 Processor -- start 2024-04-06T12:35:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.790+0000 7fdeb4626700 1 -- start start 2024-04-06T12:35:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb4626700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 0x7fdeac110220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb4626700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdeac0fd1f0 0x7fdeac110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb4626700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac110d10 con 0x7fdeac0fc890 2024-04-06T12:35:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb4626700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac110e50 con 0x7fdeac0fd1f0 2024-04-06T12:35:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb23c2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 0x7fdeac110220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb23c2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 0x7fdeac110220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32968/0 (socket says 172.21.15.152:32968) 2024-04-06T12:35:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb23c2700 1 -- 172.21.15.152:0/2549427590 learned_addr learned my addr 172.21.15.152:0/2549427590 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb23c2700 1 -- 172.21.15.152:0/2549427590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdeac0fd1f0 msgr2=0x7fdeac110710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb23c2700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdeac0fd1f0 0x7fdeac110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb23c2700 1 -- 172.21.15.152:0/2549427590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea8005040 con 0x7fdeac0fc890 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb23c2700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 0x7fdeac110220 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fdea8005010 tx=0x7fdea8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdea37fe700 1 -- 172.21.15.152:0/2549427590 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea800e030 con 0x7fdeac0fc890 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdea37fe700 1 -- 172.21.15.152:0/2549427590 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdea8007e90 con 0x7fdeac0fc890 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac10a480 con 0x7fdeac0fc890 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdea37fe700 1 -- 172.21.15.152:0/2549427590 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea8018070 con 0x7fdeac0fc890 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.791+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac10a9e0 con 0x7fdeac0fc890 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.792+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac05f2e0 con 0x7fdeac0fc890 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.793+0000 7fdea37fe700 1 -- 172.21.15.152:0/2549427590 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fdea801d6e0 con 0x7fdeac0fc890 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.793+0000 7fdea37fe700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde9806ca30 0x7fde9806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.793+0000 7fdeb1bc1700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde9806ca30 0x7fde9806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.793+0000 7fdea37fe700 1 -- 172.21.15.152:0/2549427590 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fdea808d170 con 0x7fdeac0fc890 2024-04-06T12:35:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.794+0000 7fdeb1bc1700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde9806ca30 0x7fde9806eef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fdeac10bb60 tx=0x7fde9c009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:06.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.798+0000 7fdea37fe700 1 -- 172.21.15.152:0/2549427590 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fdea805a920 con 0x7fdeac0fc890 2024-04-06T12:35:06.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:06.999+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdeac05eec0 con 0x7fdeac0fc890 2024-04-06T12:35:06.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.000+0000 7fdea37fe700 1 -- 172.21.15.152:0/2549427590 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 34 entries v92) v1 ==== 81+0+2054 (secure 0 0 0) 0x7fdea805a740 con 0x7fdeac0fc890 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6827/3193759698 2024-04-07T12:33:00.179702+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6826/3193759698 2024-04-07T12:33:00.179702+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6826/3429506423 2024-04-07T12:32:01.574018+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1001505472 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/2887118719 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/2887118719 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3532590768 2024-04-07T12:13:49.213100+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/1790713151 2024-04-07T12:14:19.995122+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3059779308 2024-04-07T12:22:14.581351+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6828/929884390 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2556143500 2024-04-07T12:14:19.995122+0000 2024-04-06T12:35:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1200342064 2024-04-07T12:15:15.483801+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/496247839 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/378420270 2024-04-07T12:14:19.995122+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6825/3550026836 2024-04-07T12:32:38.699104+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3059779308 2024-04-07T12:22:14.581351+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/1790713151 2024-04-07T12:14:19.995122+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6824/3550026836 2024-04-07T12:32:38.699104+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2583442237 2024-04-07T12:13:49.213100+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/3513201934 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2930097039 2024-04-07T12:15:15.483801+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/944313623 2024-04-07T12:13:49.213100+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3882192194 2024-04-07T12:15:15.483801+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2646133243 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3532590768 2024-04-07T12:13:49.213100+0000 2024-04-06T12:35:06.999 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:0/705319294 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:07.000 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1500470379 2024-04-07T12:22:14.581351+0000 2024-04-06T12:35:07.000 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3882192194 2024-04-07T12:15:15.483801+0000 2024-04-06T12:35:07.000 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6827/3429506423 2024-04-07T12:32:01.574018+0000 2024-04-06T12:35:07.000 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:0/4169384300 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:07.000 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2875093102 2024-04-07T12:22:14.581351+0000 2024-04-06T12:35:07.000 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:0/2368565634 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:07.000 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6829/929884390 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:07.000 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:0/3242451589 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:07.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde9806ca30 msgr2=0x7fde9806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde9806ca30 0x7fde9806eef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fdeac10bb60 tx=0x7fde9c009b60).stop 2024-04-06T12:35:07.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 msgr2=0x7fdeac110220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 0x7fdeac110220 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fdea8005010 tx=0x7fdea8009cb0).stop 2024-04-06T12:35:07.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 shutdown_connections 2024-04-06T12:35:07.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fde9806ca30 0x7fde9806eef0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdeac0fc890 0x7fdeac110220 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 --2- 172.21.15.152:0/2549427590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdeac0fd1f0 0x7fdeac110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-06T12:35:07.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 >> 172.21.15.152:0/2549427590 conn(0x7fdeac0f2490 msgr2=0x7fdeac060e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:07.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 shutdown_connections 2024-04-06T12:35:07.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.002+0000 7fdeb4626700 1 -- 172.21.15.152:0/2549427590 wait complete. 2024-04-06T12:35:07.002 INFO:teuthology.orchestra.run.smithi152.stderr:listed 34 entries 2024-04-06T12:35:07.012 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-06T12:35:07.012 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-06T12:35:07.031 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-06T12:35:07.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.192+0000 7efc24800700 1 -- 172.21.15.152:0/817977187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 msgr2=0x7efc1c0fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.192+0000 7efc24800700 1 --2- 172.21.15.152:0/817977187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 0x7efc1c0fcb10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7efc100047f0 tx=0x7efc10009cb0).stop 2024-04-06T12:35:07.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.192+0000 7efc24800700 1 -- 172.21.15.152:0/817977187 shutdown_connections 2024-04-06T12:35:07.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.192+0000 7efc24800700 1 --2- 172.21.15.152:0/817977187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c0fd090 0x7efc1c0f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.192+0000 7efc24800700 1 --2- 172.21.15.152:0/817977187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 0x7efc1c0fcb10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.192+0000 7efc24800700 1 -- 172.21.15.152:0/817977187 >> 172.21.15.152:0/817977187 conn(0x7efc1c06c760 msgr2=0x7efc1c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:07.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.192+0000 7efc24800700 1 -- 172.21.15.152:0/817977187 shutdown_connections 2024-04-06T12:35:07.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.192+0000 7efc24800700 1 -- 172.21.15.152:0/817977187 wait complete. 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc24800700 1 Processor -- start 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc24800700 1 -- start start 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc24800700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 0x7efc1c108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc24800700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c0fd090 0x7efc1c1094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc24800700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c1099c0 con 0x7efc1c0fc730 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc24800700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c109b00 con 0x7efc1c0fd090 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc2259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 0x7efc1c108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc2259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 0x7efc1c108fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32982/0 (socket says 172.21.15.152:32982) 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc2259c700 1 -- 172.21.15.152:0/3049665798 learned_addr learned my addr 172.21.15.152:0/3049665798 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc21d9b700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c0fd090 0x7efc1c1094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc2259c700 1 -- 172.21.15.152:0/3049665798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c0fd090 msgr2=0x7efc1c1094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.193+0000 7efc2259c700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c0fd090 0x7efc1c1094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.194+0000 7efc2259c700 1 -- 172.21.15.152:0/3049665798 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10005040 con 0x7efc1c0fc730 2024-04-06T12:35:07.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.194+0000 7efc21d9b700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c0fd090 0x7efc1c1094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-06T12:35:07.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.194+0000 7efc2259c700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 0x7efc1c108fe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7efc10005010 tx=0x7efc10009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:07.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.194+0000 7efc0f7fe700 1 -- 172.21.15.152:0/3049665798 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc1000e030 con 0x7efc1c0fc730 2024-04-06T12:35:07.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.194+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c109d50 con 0x7efc1c0fc730 2024-04-06T12:35:07.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.194+0000 7efc0f7fe700 1 -- 172.21.15.152:0/3049665798 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc10007e90 con 0x7efc1c0fc730 2024-04-06T12:35:07.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.194+0000 7efc0f7fe700 1 -- 172.21.15.152:0/3049665798 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc10018070 con 0x7efc1c0fc730 2024-04-06T12:35:07.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.194+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c112340 con 0x7efc1c0fc730 2024-04-06T12:35:07.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.195+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c05f380 con 0x7efc1c0fc730 2024-04-06T12:35:07.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.195+0000 7efc0f7fe700 1 -- 172.21.15.152:0/3049665798 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7efc1001d6e0 con 0x7efc1c0fc730 2024-04-06T12:35:07.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.196+0000 7efc0f7fe700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc0806ca30 0x7efc0806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:07.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.196+0000 7efc0f7fe700 1 -- 172.21.15.152:0/3049665798 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7efc1008d1e0 con 0x7efc1c0fc730 2024-04-06T12:35:07.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.196+0000 7efc21d9b700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc0806ca30 0x7efc0806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:07.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.196+0000 7efc21d9b700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc0806ca30 0x7efc0806eef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7efc1c060f20 tx=0x7efc14009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:07.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.200+0000 7efc0f7fe700 1 -- 172.21.15.152:0/3049665798 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7efc10057190 con 0x7efc1c0fc730 2024-04-06T12:35:07.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:07 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3993603715' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-06T12:35:07.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:07 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2906089893' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-06T12:35:07.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:07 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2549427590' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-06T12:35:07.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:35:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.391+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc1c0feac0 con 0x7efc1c0fc730 2024-04-06T12:35:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.392+0000 7efc0f7fe700 1 -- 172.21.15.152:0/3049665798 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16639 (secure 0 0 0) 0x7efc1005a7b0 con 0x7efc1c0fc730 2024-04-06T12:35:07.390 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-06T12:35:07.390 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":92,"fsid":"f2af90de-f40e-11ee-b649-cb9ed24678a4","created":"2024-04-06T12:13:16.768469+0000","modified":"2024-04-06T12:33:00.179732+0000","last_up_change":"2024-04-06T12:31:57.863057+0000","last_in_change":"2024-04-06T12:18:18.562700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-06T12:17:21.824734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-06T12:19:59.272151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-06T12:19:59.568441+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb0a62c1-5f47-450c-8e9e-4e02c899eda3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":87,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6803","nonce":2874592048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6805","nonce":2874592048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6809","nonce":2874592048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":2874592048},{"type":"v1","addr":"172.21.15.152:6807","nonce":2874592048}]},"public_addr":"172.21.15.152:6803/2874592048","cluster_addr":"172.21.15.152:6805/2874592048","heartbeat_back_addr":"172.21.15.152:6809/2874592048","heartbeat_front_addr":"172.21.15.152:6807/2874592048","state":["exists","up"]},{"osd":1,"uuid":"f9490187-6df1-4d4f-bfd3-a2da32d3a669","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":87,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6811","nonce":697648342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6813","nonce":697648342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6817","nonce":697648342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":697648342},{"type":"v1","addr":"172.21.15.152:6815","nonce":697648342}]},"public_addr":"172.21.15.152:6811/697648342","cluster_addr":"172.21.15.152:6813/697648342","heartbeat_back_addr":"172.21.15.152:6817/697648342","heartbeat_front_addr":"172.21.15.152:6815/697648342","state":["exists","up"]},{"osd":2,"uuid":"4a279284-26fa-436f-a830-abda13b40713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":87,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6819","nonce":426029450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6821","nonce":426029450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6825","nonce":426029450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":426029450},{"type":"v1","addr":"172.21.15.152:6823","nonce":426029450}]},"public_addr":"172.21.15.152:6819/426029450","cluster_addr":"172.21.15.152:6821/426029450","heartbeat_back_addr":"172.21.15.152:6825/426029450","heartbeat_front_addr":"172.21.15.152:6823/426029450","state":["exists","up"]},{"osd":3,"uuid":"64e8942a-1121-44fd-9ed2-cbb5176df587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":72,"up_thru":87,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6801","nonce":2677078036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6803","nonce":2677078036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6807","nonce":2677078036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2677078036},{"type":"v1","addr":"172.21.15.195:6805","nonce":2677078036}]},"public_addr":"172.21.15.195:6801/2677078036","cluster_addr":"172.21.15.195:6803/2677078036","heartbeat_back_addr":"172.21.15.195:6807/2677078036","heartbeat_front_addr":"172.21.15.195:6805/2677078036","state":["exists","up"]},{"osd":4,"uuid":"378a7c45-9887-4e48-b004-0f3b470af912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":77,"up_from":81,"up_thru":87,"down_at":78,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6809","nonce":4141179082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6811","nonce":4141179082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6815","nonce":4141179082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4141179082},{"type":"v1","addr":"172.21.15.195:6813","nonce":4141179082}]},"public_addr":"172.21.15.195:6809/4141179082","cluster_addr":"172.21.15.195:6811/4141179082","heartbeat_back_addr":"172.21.15.195:6815/4141179082","heartbeat_front_addr":"172.21.15.195:6813/4141179082","state":["exists","up"]},{"osd":5,"uuid":"2608627e-47c5-446a-b13e-699aaaea81bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":82,"up_from":87,"up_thru":87,"down_at":83,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6817","nonce":666904784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6819","nonce":666904784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6823","nonce":666904784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":666904784},{"type":"v1","addr":"172.21.15.195:6821","nonce":666904784}]},"public_addr":"172.21.15.195:6817/666904784","cluster_addr":"172.21.15.195:6819/666904784","heartbeat_back_addr":"172.21.15.195:6823/666904784","heartbeat_front_addr":"172.21.15.195:6821/666904784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:18.549757+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:16:51.020120+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:20.272551+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:17:44.651165+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:09.828133+0000","dead_epoch":77},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-06T12:18:35.929735+0000","dead_epoch":82}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":0,"to":2}]},{"pgid":"2.8","mappings":[{"from":0,"to":2}]},{"pgid":"2.e","mappings":[{"from":0,"to":5}]},{"pgid":"3.0","mappings":[{"from":1,"to":3}]},{"pgid":"3.15","mappings":[{"from":4,"to":2}]},{"pgid":"3.18","mappings":[{"from":1,"to":3}]},{"pgid":"3.1d","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6827/3193759698":"2024-04-07T12:33:00.179702+0000","172.21.15.195:6826/3193759698":"2024-04-07T12:33:00.179702+0000","172.21.15.152:6826/3429506423":"2024-04-07T12:32:01.574018+0000","172.21.15.152:0/1001505472":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6801/2887118719":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6800/2887118719":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6800/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6801/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.152:6801/3059779308":"2024-04-07T12:22:14.581351+0000","172.21.15.195:6828/929884390":"2024-04-07T12:24:53.099048+0000","172.21.15.152:0/2556143500":"2024-04-07T12:14:19.995122+0000","172.21.15.152:0/1200342064":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/496247839":"2024-04-07T12:27:36.998356+0000","172.21.15.152:0/378420270":"2024-04-07T12:14:19.995122+0000","172.21.15.195:6825/3550026836":"2024-04-07T12:32:38.699104+0000","172.21.15.152:6800/3059779308":"2024-04-07T12:22:14.581351+0000","172.21.15.152:6800/1790713151":"2024-04-07T12:14:19.995122+0000","172.21.15.195:6824/3550026836":"2024-04-07T12:32:38.699104+0000","172.21.15.152:0/2583442237":"2024-04-07T12:13:49.213100+0000","172.21.15.152:0/3513201934":"2024-04-07T12:27:36.998356+0000","172.21.15.152:0/2930097039":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/944313623":"2024-04-07T12:13:49.213100+0000","172.21.15.152:6800/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:0/2646133243":"2024-04-07T12:27:36.998356+0000","172.21.15.152:6801/3532590768":"2024-04-07T12:13:49.213100+0000","172.21.15.195:0/705319294":"2024-04-07T12:24:53.099048+0000","172.21.15.152:0/1500470379":"2024-04-07T12:22:14.581351+0000","172.21.15.152:6801/3882192194":"2024-04-07T12:15:15.483801+0000","172.21.15.152:6827/3429506423":"2024-04-07T12:32:01.574018+0000","172.21.15.195:0/4169384300":"2024-04-07T12:24:53.099048+0000","172.21.15.152:0/2875093102":"2024-04-07T12:22:14.581351+0000","172.21.15.195:0/2368565634":"2024-04-07T12:24:53.099048+0000","172.21.15.195:6829/929884390":"2024-04-07T12:24:53.099048+0000","172.21.15.195:0/3242451589":"2024-04-07T12:24:53.099048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-06T12:35:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc0806ca30 msgr2=0x7efc0806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc0806ca30 0x7efc0806eef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7efc1c060f20 tx=0x7efc14009da0).stop 2024-04-06T12:35:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 msgr2=0x7efc1c108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 0x7efc1c108fe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7efc10005010 tx=0x7efc10009cb0).stop 2024-04-06T12:35:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 shutdown_connections 2024-04-06T12:35:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7efc0806ca30 0x7efc0806eef0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc1c0fc730 0x7efc1c108fe0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 --2- 172.21.15.152:0/3049665798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c0fd090 0x7efc1c1094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 >> 172.21.15.152:0/3049665798 conn(0x7efc1c06c760 msgr2=0x7efc1c0faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 shutdown_connections 2024-04-06T12:35:07.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.394+0000 7efc24800700 1 -- 172.21.15.152:0/3049665798 wait complete. 2024-04-06T12:35:07.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-06T12:17:21.824734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-06T12:19:59.272151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-06T12:19:59.568441+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-06T12:35:07.405 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-06T12:35:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 -- 172.21.15.152:0/3778968775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fc9c0 msgr2=0x7fcf540fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 --2- 172.21.15.152:0/3778968775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fc9c0 0x7fcf540fcda0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fcf440047f0 tx=0x7fcf44009cb0).stop 2024-04-06T12:35:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 -- 172.21.15.152:0/3778968775 shutdown_connections 2024-04-06T12:35:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 --2- 172.21.15.152:0/3778968775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540fd320 0x7fcf540f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:35:07.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 --2- 172.21.15.152:0/3778968775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fc9c0 0x7fcf540fcda0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 -- 172.21.15.152:0/3778968775 >> 172.21.15.152:0/3778968775 conn(0x7fcf540f2560 msgr2=0x7fcf540f4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 -- 172.21.15.152:0/3778968775 shutdown_connections 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 -- 172.21.15.152:0/3778968775 wait complete. 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 Processor -- start 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.526+0000 7fcf5bad3700 1 -- start start 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5bad3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540fc9c0 0x7fcf5410d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5bad3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fd320 0x7fcf5410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5bad3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5410dca0 con 0x7fcf540fd320 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5bad3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf541072c0 con 0x7fcf540fc9c0 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5906e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fd320 0x7fcf5410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5906e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fd320 0x7fcf5410d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32998/0 (socket says 172.21.15.152:32998) 2024-04-06T12:35:07.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5906e700 1 -- 172.21.15.152:0/1619207942 learned_addr learned my addr 172.21.15.152:0/1619207942 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5986f700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540fc9c0 0x7fcf5410d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5906e700 1 -- 172.21.15.152:0/1619207942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540fc9c0 msgr2=0x7fcf5410d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5906e700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540fc9c0 0x7fcf5410d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5906e700 1 -- 172.21.15.152:0/1619207942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44005040 con 0x7fcf540fd320 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5986f700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540fc9c0 0x7fcf5410d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5906e700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fd320 0x7fcf5410d610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fcf5000b480 tx=0x7fcf500090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf4af78700 1 -- 172.21.15.152:0/1619207942 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf50002500 con 0x7fcf540fd320 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf4af78700 1 -- 172.21.15.152:0/1619207942 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf50002b10 con 0x7fcf540fd320 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf54107570 con 0x7fcf540fd320 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf4af78700 1 -- 172.21.15.152:0/1619207942 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf50012c90 con 0x7fcf540fd320 2024-04-06T12:35:07.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.527+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf54107ab0 con 0x7fcf540fd320 2024-04-06T12:35:07.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.528+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf54060410 con 0x7fcf540fd320 2024-04-06T12:35:07.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.529+0000 7fcf4af78700 1 -- 172.21.15.152:0/1619207942 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fcf50002660 con 0x7fcf540fd320 2024-04-06T12:35:07.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.529+0000 7fcf4af78700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcf4006caa0 0x7fcf4006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:07.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.529+0000 7fcf4af78700 1 -- 172.21.15.152:0/1619207942 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fcf5008be90 con 0x7fcf540fd320 2024-04-06T12:35:07.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.529+0000 7fcf5986f700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcf4006caa0 0x7fcf4006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:07.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.529+0000 7fcf5986f700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcf4006caa0 0x7fcf4006ef60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fcf440043d0 tx=0x7fcf4400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:07.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.533+0000 7fcf4af78700 1 -- 172.21.15.152:0/1619207942 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fcf500598d0 con 0x7fcf540fd320 2024-04-06T12:35:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:07 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3993603715' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-06T12:35:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:07 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2906089893' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-06T12:35:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:07 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2549427590' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-06T12:35:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:35:07.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.720+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf5405f0f0 con 0x7fcf540fd320 2024-04-06T12:35:07.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.720+0000 7fcf4af78700 1 -- 172.21.15.152:0/1619207942 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf50059460 con 0x7fcf540fd320 2024-04-06T12:35:07.718 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-06T12:35:07.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcf4006caa0 msgr2=0x7fcf4006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcf4006caa0 0x7fcf4006ef60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fcf440043d0 tx=0x7fcf4400b040).stop 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fd320 msgr2=0x7fcf5410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fd320 0x7fcf5410d610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fcf5000b480 tx=0x7fcf500090f0).stop 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 shutdown_connections 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fcf4006caa0 0x7fcf4006ef60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540fc9c0 0x7fcf5410d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 --2- 172.21.15.152:0/1619207942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf540fd320 0x7fcf5410d610 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 >> 172.21.15.152:0/1619207942 conn(0x7fcf540f2560 msgr2=0x7fcf540fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 shutdown_connections 2024-04-06T12:35:07.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.723+0000 7fcf5bad3700 1 -- 172.21.15.152:0/1619207942 wait complete. 2024-04-06T12:35:07.732 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-06T12:35:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.855+0000 7fcea179c700 1 -- 172.21.15.152:0/325968209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 msgr2=0x7fce9c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.855+0000 7fcea179c700 1 --2- 172.21.15.152:0/325968209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 0x7fce9c0fcc80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fce8c0047f0 tx=0x7fce8c009cb0).stop 2024-04-06T12:35:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.855+0000 7fcea179c700 1 -- 172.21.15.152:0/325968209 shutdown_connections 2024-04-06T12:35:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.855+0000 7fcea179c700 1 --2- 172.21.15.152:0/325968209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9c0fd200 0x7fce9c0f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-06T12:35:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.855+0000 7fcea179c700 1 --2- 172.21.15.152:0/325968209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 0x7fce9c0fcc80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.855+0000 7fcea179c700 1 -- 172.21.15.152:0/325968209 >> 172.21.15.152:0/325968209 conn(0x7fce9c06cea0 msgr2=0x7fce9c06d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:07.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.855+0000 7fcea179c700 1 -- 172.21.15.152:0/325968209 shutdown_connections 2024-04-06T12:35:07.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.855+0000 7fcea179c700 1 -- 172.21.15.152:0/325968209 wait complete. 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.856+0000 7fcea179c700 1 Processor -- start 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.856+0000 7fcea179c700 1 -- start start 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fcea179c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 0x7fce9c10d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fcea179c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9c0fd200 0x7fce9c10d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fcea179c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c10dbe0 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fcea179c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c107200 con 0x7fce9c0fd200 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce9affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 0x7fce9c10d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce9affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 0x7fce9c10d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33014/0 (socket says 172.21.15.152:33014) 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce9affd700 1 -- 172.21.15.152:0/1736790974 learned_addr learned my addr 172.21.15.152:0/1736790974 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce9affd700 1 -- 172.21.15.152:0/1736790974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9c0fd200 msgr2=0x7fce9c10d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce9a7fc700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9c0fd200 0x7fce9c10d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce9affd700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9c0fd200 0x7fce9c10d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:07.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce9affd700 1 -- 172.21.15.152:0/1736790974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c005040 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce9affd700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 0x7fce9c10d060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fce8c00b120 tx=0x7fce8c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:07.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce83fff700 1 -- 172.21.15.152:0/1736790974 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c00e030 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c107450 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce83fff700 1 -- 172.21.15.152:0/1736790974 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce8c007e90 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fce83fff700 1 -- 172.21.15.152:0/1736790974 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c018070 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.857+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c107930 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.858+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c05fb30 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.859+0000 7fce83fff700 1 -- 172.21.15.152:0/1736790974 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fce8c01d420 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.859+0000 7fce83fff700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fce8406caa0 0x7fce8406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:07.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.859+0000 7fce83fff700 1 -- 172.21.15.152:0/1736790974 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fce8c08d2d0 con 0x7fce9c0fc8a0 2024-04-06T12:35:07.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.859+0000 7fce9a7fc700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fce8406caa0 0x7fce8406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:07.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.860+0000 7fce9a7fc700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fce8406caa0 0x7fce8406ef60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fce9c1089a0 tx=0x7fce90008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:07.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:07.863+0000 7fce83fff700 1 -- 172.21.15.152:0/1736790974 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7fce8c05ad10 con 0x7fce9c0fc8a0 2024-04-06T12:35:08.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.050+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fce9c1036f0 con 0x7fce9c0fc8a0 2024-04-06T12:35:08.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.050+0000 7fce83fff700 1 -- 172.21.15.152:0/1736790974 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7fce9c1036f0 con 0x7fce9c0fc8a0 2024-04-06T12:35:08.048 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-06T12:35:08.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.052+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fce8406caa0 msgr2=0x7fce8406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.052+0000 7fcea179c700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fce8406caa0 0x7fce8406ef60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fce9c1089a0 tx=0x7fce90008040).stop 2024-04-06T12:35:08.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.053+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 msgr2=0x7fce9c10d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.053+0000 7fcea179c700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 0x7fce9c10d060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fce8c00b120 tx=0x7fce8c009cb0).stop 2024-04-06T12:35:08.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.053+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 shutdown_connections 2024-04-06T12:35:08.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.053+0000 7fcea179c700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7fce8406caa0 0x7fce8406ef60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.053+0000 7fcea179c700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce9c0fc8a0 0x7fce9c10d060 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.053+0000 7fcea179c700 1 --2- 172.21.15.152:0/1736790974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce9c0fd200 0x7fce9c10d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.053+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 >> 172.21.15.152:0/1736790974 conn(0x7fce9c06cea0 msgr2=0x7fce9c0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:08.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.053+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 shutdown_connections 2024-04-06T12:35:08.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.053+0000 7fcea179c700 1 -- 172.21.15.152:0/1736790974 wait complete. 2024-04-06T12:35:08.062 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-06T12:35:08.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.185+0000 7ff7fbf32700 1 -- 172.21.15.152:0/531220062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f89f0 msgr2=0x7ff7f40f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.185+0000 7ff7fbf32700 1 --2- 172.21.15.152:0/531220062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f89f0 0x7ff7f40f8dd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7ff7e40047f0 tx=0x7ff7e4009cb0).stop 2024-04-06T12:35:08.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.185+0000 7ff7fbf32700 1 -- 172.21.15.152:0/531220062 shutdown_connections 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.185+0000 7ff7fbf32700 1 --2- 172.21.15.152:0/531220062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f40f92c0 0x7ff7f4101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.185+0000 7ff7fbf32700 1 --2- 172.21.15.152:0/531220062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f89f0 0x7ff7f40f8dd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.185+0000 7ff7fbf32700 1 -- 172.21.15.152:0/531220062 >> 172.21.15.152:0/531220062 conn(0x7ff7f406c760 msgr2=0x7ff7f406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.185+0000 7ff7fbf32700 1 -- 172.21.15.152:0/531220062 shutdown_connections 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.185+0000 7ff7fbf32700 1 -- 172.21.15.152:0/531220062 wait complete. 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7fbf32700 1 Processor -- start 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7fbf32700 1 -- start start 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7fbf32700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f40f89f0 0x7ff7f410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7fbf32700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f92c0 0x7ff7f410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7fbf32700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f410eae0 con 0x7ff7f40f92c0 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7fbf32700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f410ec20 con 0x7ff7f40f89f0 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7f94cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f92c0 0x7ff7f410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7f94cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f92c0 0x7ff7f410e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33032/0 (socket says 172.21.15.152:33032) 2024-04-06T12:35:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7f94cd700 1 -- 172.21.15.152:0/3324137848 learned_addr learned my addr 172.21.15.152:0/3324137848 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7f9cce700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f40f89f0 0x7ff7f410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7f94cd700 1 -- 172.21.15.152:0/3324137848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f40f89f0 msgr2=0x7ff7f410dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7f94cd700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f40f89f0 0x7ff7f410dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7f94cd700 1 -- 172.21.15.152:0/3324137848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4005040 con 0x7ff7f40f92c0 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7f94cd700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f92c0 0x7ff7f410e4e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7ff7f00041d0 tx=0x7ff7f0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7eaffd700 1 -- 172.21.15.152:0/3324137848 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f0007b40 con 0x7ff7f40f92c0 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7eaffd700 1 -- 172.21.15.152:0/3324137848 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff7f000f040 con 0x7ff7f40f92c0 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f41082b0 con 0x7ff7f40f92c0 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7eaffd700 1 -- 172.21.15.152:0/3324137848 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f00137d0 con 0x7ff7f40f92c0 2024-04-06T12:35:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.186+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f41087f0 con 0x7ff7f40f92c0 2024-04-06T12:35:08.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.187+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f405f380 con 0x7ff7f40f92c0 2024-04-06T12:35:08.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.188+0000 7ff7eaffd700 1 -- 172.21.15.152:0/3324137848 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff7f0007ca0 con 0x7ff7f40f92c0 2024-04-06T12:35:08.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.188+0000 7ff7eaffd700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff7e006caa0 0x7ff7e006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:08.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.188+0000 7ff7f9cce700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff7e006caa0 0x7ff7e006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:08.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.188+0000 7ff7eaffd700 1 -- 172.21.15.152:0/3324137848 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7ff7f008b8d0 con 0x7ff7f40f92c0 2024-04-06T12:35:08.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.189+0000 7ff7f9cce700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff7e006caa0 0x7ff7e006ef60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff7e4009ee0 tx=0x7ff7e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:08.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.193+0000 7ff7eaffd700 1 -- 172.21.15.152:0/3324137848 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7ff7f0059310 con 0x7ff7f40f92c0 2024-04-06T12:35:08.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.383+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ff7f405eec0 con 0x7ff7f40f92c0 2024-04-06T12:35:08.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.384+0000 7ff7eaffd700 1 -- 172.21.15.152:0/3324137848 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff7f0058ea0 con 0x7ff7f40f92c0 2024-04-06T12:35:08.382 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff7e006caa0 msgr2=0x7ff7e006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff7e006caa0 0x7ff7e006ef60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff7e4009ee0 tx=0x7ff7e400b040).stop 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f92c0 msgr2=0x7ff7f410e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f92c0 0x7ff7f410e4e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7ff7f00041d0 tx=0x7ff7f0009f60).stop 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 shutdown_connections 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7ff7e006caa0 0x7ff7e006ef60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f40f89f0 0x7ff7f410dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 --2- 172.21.15.152:0/3324137848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f40f92c0 0x7ff7f410e4e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 >> 172.21.15.152:0/3324137848 conn(0x7ff7f406c760 msgr2=0x7ff7f40fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 shutdown_connections 2024-04-06T12:35:08.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.386+0000 7ff7fbf32700 1 -- 172.21.15.152:0/3324137848 wait complete. 2024-04-06T12:35:08.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:08 smithi152 ceph-mon[104634]: pgmap v271: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:08.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:08 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3049665798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:35:08.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:08 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1619207942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-06T12:35:08.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:08 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/1736790974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-06T12:35:08.395 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-06T12:35:08.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 -- 172.21.15.152:0/1366313716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 msgr2=0x7f79bc0f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 --2- 172.21.15.152:0/1366313716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 0x7f79bc0f5d70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f79ac0047f0 tx=0x7f79ac009cb0).stop 2024-04-06T12:35:08.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 -- 172.21.15.152:0/1366313716 shutdown_connections 2024-04-06T12:35:08.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 --2- 172.21.15.152:0/1366313716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 0x7f79bc0f5d70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 --2- 172.21.15.152:0/1366313716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79bc0fd890 0x7f79bc0fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 -- 172.21.15.152:0/1366313716 >> 172.21.15.152:0/1366313716 conn(0x7f79bc06cb60 msgr2=0x7f79bc0f3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:08.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 -- 172.21.15.152:0/1366313716 shutdown_connections 2024-04-06T12:35:08.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 -- 172.21.15.152:0/1366313716 wait complete. 2024-04-06T12:35:08.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 Processor -- start 2024-04-06T12:35:08.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.516+0000 7f79c25c1700 1 -- start start 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79c25c1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79bc0fd890 0x7f79bc0f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79c25c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 0x7f79bc0f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79c25c1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0f7a20 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79c25c1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0f7b60 con 0x7f79bc0fd890 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79bb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 0x7f79bc0f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79bb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 0x7f79bc0f7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33040/0 (socket says 172.21.15.152:33040) 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79bb7fe700 1 -- 172.21.15.152:0/2333160413 learned_addr learned my addr 172.21.15.152:0/2333160413 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79bbfff700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79bc0fd890 0x7f79bc0f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79bb7fe700 1 -- 172.21.15.152:0/2333160413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79bc0fd890 msgr2=0x7f79bc0f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79bb7fe700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79bc0fd890 0x7f79bc0f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79bb7fe700 1 -- 172.21.15.152:0/2333160413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac005040 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79bb7fe700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 0x7f79bc0f7530 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f79ac009380 tx=0x7f79ac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:08.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79b97fa700 1 -- 172.21.15.152:0/2333160413 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79ac018070 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc0f7db0 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79b97fa700 1 -- 172.21.15.152:0/2333160413 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f79ac007e90 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79b97fa700 1 -- 172.21.15.152:0/2333160413 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79ac0123c0 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.517+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc1146d0 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.519+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc0606f0 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.519+0000 7f79b97fa700 1 -- 172.21.15.152:0/2333160413 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f79ac01d420 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.519+0000 7f79b97fa700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f79a406caa0 0x7f79a406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.519+0000 7f79b97fa700 1 -- 172.21.15.152:0/2333160413 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f79ac08ca50 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.519+0000 7f79bbfff700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f79a406caa0 0x7f79a406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-06T12:35:08.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.520+0000 7f79bbfff700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f79a406caa0 0x7f79a406ef60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f79b0004ee0 tx=0x7f79b000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-06T12:35:08.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.524+0000 7f79b97fa700 1 -- 172.21.15.152:0/2333160413 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180903 (secure 0 0 0) 0x7f79ac056a00 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:08 smithi195 ceph-mon[85980]: pgmap v271: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:08 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3049665798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-06T12:35:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:08 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1619207942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-06T12:35:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:08 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/1736790974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-06T12:35:08.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.729+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f79bc0fab00 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.730+0000 7f79b97fa700 1 -- 172.21.15.152:0/2333160413 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 34 entries v92) v1 ==== 81+0+2054 (secure 0 0 0) 0x7f79ac05a020 con 0x7f79bc0fe1f0 2024-04-06T12:35:08.727 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6827/3193759698 2024-04-07T12:33:00.179702+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6826/3193759698 2024-04-07T12:33:00.179702+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6826/3429506423 2024-04-07T12:32:01.574018+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1001505472 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/2887118719 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/2887118719 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3532590768 2024-04-07T12:13:49.213100+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/1790713151 2024-04-07T12:14:19.995122+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3059779308 2024-04-07T12:22:14.581351+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6828/929884390 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2556143500 2024-04-07T12:14:19.995122+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1200342064 2024-04-07T12:15:15.483801+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/496247839 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:08.728 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/378420270 2024-04-07T12:14:19.995122+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6825/3550026836 2024-04-07T12:32:38.699104+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3059779308 2024-04-07T12:22:14.581351+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/1790713151 2024-04-07T12:14:19.995122+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6824/3550026836 2024-04-07T12:32:38.699104+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2583442237 2024-04-07T12:13:49.213100+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/3513201934 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2930097039 2024-04-07T12:15:15.483801+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/944313623 2024-04-07T12:13:49.213100+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3882192194 2024-04-07T12:15:15.483801+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2646133243 2024-04-07T12:27:36.998356+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3532590768 2024-04-07T12:13:49.213100+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:0/705319294 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1500470379 2024-04-07T12:22:14.581351+0000 2024-04-06T12:35:08.729 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3882192194 2024-04-07T12:15:15.483801+0000 2024-04-06T12:35:08.730 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6827/3429506423 2024-04-07T12:32:01.574018+0000 2024-04-06T12:35:08.730 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:0/4169384300 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:08.730 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2875093102 2024-04-07T12:22:14.581351+0000 2024-04-06T12:35:08.730 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:0/2368565634 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:08.730 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:6829/929884390 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:08.730 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.195:0/3242451589 2024-04-07T12:24:53.099048+0000 2024-04-06T12:35:08.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f79a406caa0 msgr2=0x7f79a406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f79a406caa0 0x7f79a406ef60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f79b0004ee0 tx=0x7f79b000b040).stop 2024-04-06T12:35:08.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 msgr2=0x7f79bc0f7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-06T12:35:08.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 0x7f79bc0f7530 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f79ac009380 tx=0x7f79ac009cb0).stop 2024-04-06T12:35:08.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 shutdown_connections 2024-04-06T12:35:08.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:6800/2261466975,v1:172.21.15.152:6801/2261466975] conn(0x7f79a406caa0 0x7f79a406ef60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79bc0fd890 0x7f79bc0f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 --2- 172.21.15.152:0/2333160413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79bc0fe1f0 0x7f79bc0f7530 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-06T12:35:08.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 >> 172.21.15.152:0/2333160413 conn(0x7f79bc06cb60 msgr2=0x7f79bc100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-06T12:35:08.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 shutdown_connections 2024-04-06T12:35:08.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-06T12:35:08.732+0000 7f79c25c1700 1 -- 172.21.15.152:0/2333160413 wait complete. 2024-04-06T12:35:08.732 INFO:teuthology.orchestra.run.smithi152.stderr:listed 34 entries 2024-04-06T12:35:08.742 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2024-04-06T12:35:08.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-06T12:35:08.742 DEBUG:teuthology.orchestra.run.smithi152:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-06T12:35:08.783 INFO:teuthology.orchestra.run:waiting for 300 2024-04-06T12:35:09.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:09 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/3324137848' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-06T12:35:09.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:09 smithi152 ceph-mon[104634]: from='client.? 172.21.15.152:0/2333160413' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-06T12:35:09.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:09 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/3324137848' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-06T12:35:09.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:09 smithi195 ceph-mon[85980]: from='client.? 172.21.15.152:0/2333160413' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-06T12:35:10.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:10 smithi152 ceph-mon[104634]: pgmap v272: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:10.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:10 smithi195 ceph-mon[85980]: pgmap v272: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:12.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:12 smithi152 ceph-mon[104634]: pgmap v273: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:12.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:12 smithi195 ceph-mon[85980]: pgmap v273: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:14 smithi152 ceph-mon[104634]: pgmap v274: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:14 smithi195 ceph-mon[85980]: pgmap v274: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:16.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:16 smithi152 ceph-mon[104634]: pgmap v275: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:16.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:16 smithi195 ceph-mon[85980]: pgmap v275: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:18 smithi152 ceph-mon[104634]: pgmap v276: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:18 smithi195 ceph-mon[85980]: pgmap v276: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:19.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:35:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:35:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:35:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:35:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:35:19.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:35:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:35:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:35:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:35:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:35:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:35:19.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:35:20.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:20 smithi152 ceph-mon[104634]: pgmap v277: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:20.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:20 smithi195 ceph-mon[85980]: pgmap v277: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:22 smithi152 ceph-mon[104634]: pgmap v278: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:35:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:22 smithi195 ceph-mon[85980]: pgmap v278: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:35:24.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:24 smithi152 ceph-mon[104634]: pgmap v279: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:24 smithi195 ceph-mon[85980]: pgmap v279: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:26.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:26 smithi152 ceph-mon[104634]: pgmap v280: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:26 smithi195 ceph-mon[85980]: pgmap v280: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:28 smithi152 ceph-mon[104634]: pgmap v281: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:28 smithi195 ceph-mon[85980]: pgmap v281: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:29 smithi152 ceph-mon[104634]: pgmap v282: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:30.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:29 smithi195 ceph-mon[85980]: pgmap v282: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:32 smithi152 ceph-mon[104634]: pgmap v283: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:32.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:32 smithi195 ceph-mon[85980]: pgmap v283: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:34.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:34 smithi152 ceph-mon[104634]: pgmap v284: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:34 smithi195 ceph-mon[85980]: pgmap v284: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:36 smithi152 ceph-mon[104634]: pgmap v285: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:36 smithi195 ceph-mon[85980]: pgmap v285: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:37.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:35:37.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:35:38.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:38 smithi152 ceph-mon[104634]: pgmap v286: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:38.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:38 smithi195 ceph-mon[85980]: pgmap v286: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:40.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:39 smithi152 ceph-mon[104634]: pgmap v287: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:40.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:39 smithi195 ceph-mon[85980]: pgmap v287: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:42 smithi152 ceph-mon[104634]: pgmap v288: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:42.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:42 smithi195 ceph-mon[85980]: pgmap v288: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:44 smithi152 ceph-mon[104634]: pgmap v289: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:44 smithi195 ceph-mon[85980]: pgmap v289: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:46 smithi152 ceph-mon[104634]: pgmap v290: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:46.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:46 smithi195 ceph-mon[85980]: pgmap v290: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:48 smithi152 ceph-mon[104634]: pgmap v291: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:48.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:48 smithi195 ceph-mon[85980]: pgmap v291: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:50.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:49 smithi152 ceph-mon[104634]: pgmap v292: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:50.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:49 smithi195 ceph-mon[85980]: pgmap v292: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:52 smithi152 ceph-mon[104634]: pgmap v293: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:35:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:52 smithi195 ceph-mon[85980]: pgmap v293: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:35:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:54 smithi152 ceph-mon[104634]: pgmap v294: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:54.549 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:54 smithi195 ceph-mon[85980]: pgmap v294: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:35:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:56 smithi152 ceph-mon[104634]: pgmap v295: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:56 smithi195 ceph-mon[85980]: pgmap v295: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:58.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:58 smithi152 ceph-mon[104634]: pgmap v296: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:35:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:58 smithi195 ceph-mon[85980]: pgmap v296: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:35:59 smithi152 ceph-mon[104634]: pgmap v297: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:00.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:35:59 smithi195 ceph-mon[85980]: pgmap v297: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:02 smithi152 ceph-mon[104634]: pgmap v298: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:02 smithi195 ceph-mon[85980]: pgmap v298: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:04 smithi152 ceph-mon[104634]: pgmap v299: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:04 smithi195 ceph-mon[85980]: pgmap v299: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:06.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:06 smithi152 ceph-mon[104634]: pgmap v300: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:06 smithi195 ceph-mon[85980]: pgmap v300: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:36:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:36:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:08 smithi152 ceph-mon[104634]: pgmap v301: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:08 smithi195 ceph-mon[85980]: pgmap v301: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:10.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:09 smithi152 ceph-mon[104634]: pgmap v302: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:10.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:09 smithi195 ceph-mon[85980]: pgmap v302: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:12.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:12 smithi152 ceph-mon[104634]: pgmap v303: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:12.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:12 smithi195 ceph-mon[85980]: pgmap v303: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:14 smithi152 ceph-mon[104634]: pgmap v304: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:14 smithi195 ceph-mon[85980]: pgmap v304: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:16.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:16 smithi152 ceph-mon[104634]: pgmap v305: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:16.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:16 smithi195 ceph-mon[85980]: pgmap v305: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:18 smithi152 ceph-mon[104634]: pgmap v306: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:18 smithi195 ceph-mon[85980]: pgmap v306: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:20.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:19 smithi152 ceph-mon[104634]: pgmap v307: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:20.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:36:20.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:36:20.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:19 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:36:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:19 smithi195 ceph-mon[85980]: pgmap v307: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:36:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:36:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:19 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:36:21.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:36:21.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:36:21.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:36:21.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:36:21.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:36:21.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:36:22.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:21 smithi152 ceph-mon[104634]: pgmap v308: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:22.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:21 smithi195 ceph-mon[85980]: pgmap v308: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:23.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:36:23.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:36:24.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:23 smithi152 ceph-mon[104634]: pgmap v309: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:24.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:23 smithi195 ceph-mon[85980]: pgmap v309: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:26.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:26 smithi152 ceph-mon[104634]: pgmap v310: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:26 smithi195 ceph-mon[85980]: pgmap v310: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:28 smithi152 ceph-mon[104634]: pgmap v311: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:28 smithi195 ceph-mon[85980]: pgmap v311: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:29 smithi152 ceph-mon[104634]: pgmap v312: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:30.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:29 smithi195 ceph-mon[85980]: pgmap v312: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:32 smithi152 ceph-mon[104634]: pgmap v313: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:32.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:32 smithi195 ceph-mon[85980]: pgmap v313: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:34.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:34 smithi152 ceph-mon[104634]: pgmap v314: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:34 smithi195 ceph-mon[85980]: pgmap v314: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:36 smithi152 ceph-mon[104634]: pgmap v315: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:36 smithi195 ceph-mon[85980]: pgmap v315: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:37.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:36:37.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:36:38.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:38 smithi152 ceph-mon[104634]: pgmap v316: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:38.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:38 smithi195 ceph-mon[85980]: pgmap v316: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:40.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:39 smithi152 ceph-mon[104634]: pgmap v317: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:40.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:39 smithi195 ceph-mon[85980]: pgmap v317: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:42 smithi152 ceph-mon[104634]: pgmap v318: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:42.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:42 smithi195 ceph-mon[85980]: pgmap v318: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:44 smithi152 ceph-mon[104634]: pgmap v319: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:44 smithi195 ceph-mon[85980]: pgmap v319: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:46 smithi152 ceph-mon[104634]: pgmap v320: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:46.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:46 smithi195 ceph-mon[85980]: pgmap v320: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:48 smithi152 ceph-mon[104634]: pgmap v321: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:48.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:48 smithi195 ceph-mon[85980]: pgmap v321: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:50.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:49 smithi152 ceph-mon[104634]: pgmap v322: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:50.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:49 smithi195 ceph-mon[85980]: pgmap v322: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:52 smithi152 ceph-mon[104634]: pgmap v323: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:36:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:52 smithi195 ceph-mon[85980]: pgmap v323: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:36:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:54 smithi152 ceph-mon[104634]: pgmap v324: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:54 smithi195 ceph-mon[85980]: pgmap v324: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:36:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:56 smithi152 ceph-mon[104634]: pgmap v325: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:56 smithi195 ceph-mon[85980]: pgmap v325: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:58.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:58 smithi152 ceph-mon[104634]: pgmap v326: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:36:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:58 smithi195 ceph-mon[85980]: pgmap v326: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:36:59 smithi152 ceph-mon[104634]: pgmap v327: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:00.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:36:59 smithi195 ceph-mon[85980]: pgmap v327: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:02.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:02 smithi152 ceph-mon[104634]: pgmap v328: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:02 smithi195 ceph-mon[85980]: pgmap v328: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:04 smithi152 ceph-mon[104634]: pgmap v329: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:04 smithi195 ceph-mon[85980]: pgmap v329: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:06.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:06 smithi152 ceph-mon[104634]: pgmap v330: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:06 smithi195 ceph-mon[85980]: pgmap v330: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:37:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:37:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:08 smithi152 ceph-mon[104634]: pgmap v331: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:08 smithi195 ceph-mon[85980]: pgmap v331: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:10.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:09 smithi152 ceph-mon[104634]: pgmap v332: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:10.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:09 smithi195 ceph-mon[85980]: pgmap v332: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:12.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:12 smithi152 ceph-mon[104634]: pgmap v333: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:12.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:12 smithi195 ceph-mon[85980]: pgmap v333: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:14 smithi152 ceph-mon[104634]: pgmap v334: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:14 smithi195 ceph-mon[85980]: pgmap v334: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:16.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:16 smithi152 ceph-mon[104634]: pgmap v335: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:16.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:16 smithi195 ceph-mon[85980]: pgmap v335: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:18 smithi152 ceph-mon[104634]: pgmap v336: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:18 smithi195 ceph-mon[85980]: pgmap v336: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:20.277 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:19 smithi152 ceph-mon[104634]: pgmap v337: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:19 smithi195 ceph-mon[85980]: pgmap v337: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:21.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:37:21.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:37:21.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:37:21.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:37:21.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:37:21.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:37:21.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:37:21.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:37:22.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:21 smithi152 ceph-mon[104634]: pgmap v338: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:22.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:21 smithi195 ceph-mon[85980]: pgmap v338: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:23.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:37:23.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:37:24.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:23 smithi152 ceph-mon[104634]: pgmap v339: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:24.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:23 smithi195 ceph-mon[85980]: pgmap v339: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:26.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:26 smithi152 ceph-mon[104634]: pgmap v340: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:26 smithi195 ceph-mon[85980]: pgmap v340: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:28 smithi152 ceph-mon[104634]: pgmap v341: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:28 smithi195 ceph-mon[85980]: pgmap v341: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:29 smithi152 ceph-mon[104634]: pgmap v342: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:30.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:29 smithi195 ceph-mon[85980]: pgmap v342: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:32 smithi152 ceph-mon[104634]: pgmap v343: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:32.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:32 smithi195 ceph-mon[85980]: pgmap v343: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:34.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:34 smithi152 ceph-mon[104634]: pgmap v344: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:34 smithi195 ceph-mon[85980]: pgmap v344: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:36 smithi152 ceph-mon[104634]: pgmap v345: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:36 smithi195 ceph-mon[85980]: pgmap v345: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:37.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:37:37.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:37:38.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:38 smithi152 ceph-mon[104634]: pgmap v346: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:38.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:38 smithi195 ceph-mon[85980]: pgmap v346: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:40.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:39 smithi152 ceph-mon[104634]: pgmap v347: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:40.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:39 smithi195 ceph-mon[85980]: pgmap v347: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:42 smithi152 ceph-mon[104634]: pgmap v348: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:42.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:42 smithi195 ceph-mon[85980]: pgmap v348: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:44 smithi152 ceph-mon[104634]: pgmap v349: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:44 smithi195 ceph-mon[85980]: pgmap v349: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:46 smithi152 ceph-mon[104634]: pgmap v350: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:46.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:46 smithi195 ceph-mon[85980]: pgmap v350: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:48 smithi152 ceph-mon[104634]: pgmap v351: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:48.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:48 smithi195 ceph-mon[85980]: pgmap v351: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:50.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:49 smithi152 ceph-mon[104634]: pgmap v352: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:50.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:49 smithi195 ceph-mon[85980]: pgmap v352: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:52 smithi152 ceph-mon[104634]: pgmap v353: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:37:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:52 smithi195 ceph-mon[85980]: pgmap v353: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:37:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:54 smithi152 ceph-mon[104634]: pgmap v354: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:54 smithi195 ceph-mon[85980]: pgmap v354: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:37:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:56 smithi152 ceph-mon[104634]: pgmap v355: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:56 smithi195 ceph-mon[85980]: pgmap v355: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:58.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:58 smithi152 ceph-mon[104634]: pgmap v356: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:37:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:58 smithi195 ceph-mon[85980]: pgmap v356: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:37:59 smithi152 ceph-mon[104634]: pgmap v357: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:00.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:37:59 smithi195 ceph-mon[85980]: pgmap v357: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:02 smithi152 ceph-mon[104634]: pgmap v358: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:02 smithi195 ceph-mon[85980]: pgmap v358: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:04 smithi152 ceph-mon[104634]: pgmap v359: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:04 smithi195 ceph-mon[85980]: pgmap v359: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:06.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:06 smithi152 ceph-mon[104634]: pgmap v360: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:06 smithi195 ceph-mon[85980]: pgmap v360: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:38:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:38:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:08 smithi152 ceph-mon[104634]: pgmap v361: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:08 smithi195 ceph-mon[85980]: pgmap v361: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:10.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:09 smithi152 ceph-mon[104634]: pgmap v362: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:10.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:09 smithi195 ceph-mon[85980]: pgmap v362: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:12.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:12 smithi152 ceph-mon[104634]: pgmap v363: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:12.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:12 smithi195 ceph-mon[85980]: pgmap v363: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:14 smithi152 ceph-mon[104634]: pgmap v364: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:14 smithi195 ceph-mon[85980]: pgmap v364: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:16.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:16 smithi152 ceph-mon[104634]: pgmap v365: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:16.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:16 smithi195 ceph-mon[85980]: pgmap v365: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:18 smithi152 ceph-mon[104634]: pgmap v366: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:18 smithi195 ceph-mon[85980]: pgmap v366: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:20.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:19 smithi152 ceph-mon[104634]: pgmap v367: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:19 smithi195 ceph-mon[85980]: pgmap v367: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:21.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:20 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:38:21.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:20 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:38:22.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:21 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:38:22.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:21 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:38:22.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:21 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:38:22.276 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:21 smithi152 ceph-mon[104634]: pgmap v368: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:22.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:21 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:38:22.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:21 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:38:22.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:21 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:38:22.299 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:21 smithi195 ceph-mon[85980]: pgmap v368: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:23.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:38:23.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:38:24.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:23 smithi152 ceph-mon[104634]: pgmap v369: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:24.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:23 smithi195 ceph-mon[85980]: pgmap v369: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:26.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:26 smithi152 ceph-mon[104634]: pgmap v370: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:26 smithi195 ceph-mon[85980]: pgmap v370: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:28 smithi152 ceph-mon[104634]: pgmap v371: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:28 smithi195 ceph-mon[85980]: pgmap v371: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:29 smithi152 ceph-mon[104634]: pgmap v372: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:30.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:29 smithi195 ceph-mon[85980]: pgmap v372: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:32 smithi152 ceph-mon[104634]: pgmap v373: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:32.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:32 smithi195 ceph-mon[85980]: pgmap v373: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:34.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:34 smithi152 ceph-mon[104634]: pgmap v374: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:34 smithi195 ceph-mon[85980]: pgmap v374: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:36 smithi152 ceph-mon[104634]: pgmap v375: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:36 smithi195 ceph-mon[85980]: pgmap v375: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:37.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:38:37.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:38:38.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:38 smithi152 ceph-mon[104634]: pgmap v376: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:38.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:38 smithi195 ceph-mon[85980]: pgmap v376: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:40.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:39 smithi152 ceph-mon[104634]: pgmap v377: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:40.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:39 smithi195 ceph-mon[85980]: pgmap v377: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:42 smithi152 ceph-mon[104634]: pgmap v378: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:42.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:42 smithi195 ceph-mon[85980]: pgmap v378: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:44 smithi152 ceph-mon[104634]: pgmap v379: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:44 smithi195 ceph-mon[85980]: pgmap v379: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:46 smithi152 ceph-mon[104634]: pgmap v380: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:46.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:46 smithi195 ceph-mon[85980]: pgmap v380: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:48 smithi152 ceph-mon[104634]: pgmap v381: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:48.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:48 smithi195 ceph-mon[85980]: pgmap v381: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:50.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:49 smithi152 ceph-mon[104634]: pgmap v382: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:50.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:49 smithi195 ceph-mon[85980]: pgmap v382: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:52 smithi152 ceph-mon[104634]: pgmap v383: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:38:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:52 smithi195 ceph-mon[85980]: pgmap v383: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:38:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:54 smithi152 ceph-mon[104634]: pgmap v384: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:54 smithi195 ceph-mon[85980]: pgmap v384: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:38:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:56 smithi152 ceph-mon[104634]: pgmap v385: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:56 smithi195 ceph-mon[85980]: pgmap v385: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:58.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:58 smithi152 ceph-mon[104634]: pgmap v386: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:38:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:58 smithi195 ceph-mon[85980]: pgmap v386: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:38:59 smithi152 ceph-mon[104634]: pgmap v387: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:00.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:38:59 smithi195 ceph-mon[85980]: pgmap v387: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:02.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:02 smithi152 ceph-mon[104634]: pgmap v388: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:02.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:02 smithi195 ceph-mon[85980]: pgmap v388: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:04 smithi152 ceph-mon[104634]: pgmap v389: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:04 smithi195 ceph-mon[85980]: pgmap v389: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:06.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:06 smithi152 ceph-mon[104634]: pgmap v390: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:06 smithi195 ceph-mon[85980]: pgmap v390: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:39:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:39:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:08 smithi152 ceph-mon[104634]: pgmap v391: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:08 smithi195 ceph-mon[85980]: pgmap v391: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:10.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:09 smithi152 ceph-mon[104634]: pgmap v392: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:10.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:09 smithi195 ceph-mon[85980]: pgmap v392: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:12.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:12 smithi152 ceph-mon[104634]: pgmap v393: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:12.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:12 smithi195 ceph-mon[85980]: pgmap v393: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:14.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:14 smithi152 ceph-mon[104634]: pgmap v394: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:14.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:14 smithi195 ceph-mon[85980]: pgmap v394: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:16.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:16 smithi152 ceph-mon[104634]: pgmap v395: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:16.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:16 smithi195 ceph-mon[85980]: pgmap v395: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:18.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:18 smithi152 ceph-mon[104634]: pgmap v396: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:18.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:18 smithi195 ceph-mon[85980]: pgmap v396: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:20.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:19 smithi152 ceph-mon[104634]: pgmap v397: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:20.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:19 smithi195 ceph-mon[85980]: pgmap v397: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:22 smithi152 ceph-mon[104634]: pgmap v398: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:39:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:39:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:39:22.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:39:22.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:22 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:39:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:22 smithi195 ceph-mon[85980]: pgmap v398: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-06T12:39:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-06T12:39:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-06T12:39:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' 2024-04-06T12:39:22.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:22 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:39:24.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:24 smithi152 ceph-mon[104634]: pgmap v399: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:24.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:24 smithi195 ceph-mon[85980]: pgmap v399: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:26.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:26 smithi152 ceph-mon[104634]: pgmap v400: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:26.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:26 smithi195 ceph-mon[85980]: pgmap v400: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:28.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:28 smithi152 ceph-mon[104634]: pgmap v401: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:28.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:28 smithi195 ceph-mon[85980]: pgmap v401: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:30.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:29 smithi152 ceph-mon[104634]: pgmap v402: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:30.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:29 smithi195 ceph-mon[85980]: pgmap v402: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:32.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:32 smithi152 ceph-mon[104634]: pgmap v403: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:32.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:32 smithi195 ceph-mon[85980]: pgmap v403: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:34.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:34 smithi152 ceph-mon[104634]: pgmap v404: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:34.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:34 smithi195 ceph-mon[85980]: pgmap v404: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:36.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:36 smithi152 ceph-mon[104634]: pgmap v405: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:36.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:36 smithi195 ceph-mon[85980]: pgmap v405: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:37.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:37 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:39:37.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:37 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:39:38.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:38 smithi152 ceph-mon[104634]: pgmap v406: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:38.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:38 smithi195 ceph-mon[85980]: pgmap v406: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:40.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:39 smithi152 ceph-mon[104634]: pgmap v407: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:40.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:39 smithi195 ceph-mon[85980]: pgmap v407: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:42.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:42 smithi152 ceph-mon[104634]: pgmap v408: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:42.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:42 smithi195 ceph-mon[85980]: pgmap v408: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:44.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:44 smithi152 ceph-mon[104634]: pgmap v409: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:44.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:44 smithi195 ceph-mon[85980]: pgmap v409: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:46.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:46 smithi152 ceph-mon[104634]: pgmap v410: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:46.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:46 smithi195 ceph-mon[85980]: pgmap v410: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:48.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:48 smithi152 ceph-mon[104634]: pgmap v411: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:48.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:48 smithi195 ceph-mon[85980]: pgmap v411: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:50.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:49 smithi152 ceph-mon[104634]: pgmap v412: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:50.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:49 smithi195 ceph-mon[85980]: pgmap v412: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:52 smithi152 ceph-mon[104634]: pgmap v413: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:52.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:52 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:39:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:52 smithi195 ceph-mon[85980]: pgmap v413: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:52.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:52 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:39:54.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:54 smithi152 ceph-mon[104634]: pgmap v414: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:54.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:54 smithi195 ceph-mon[85980]: pgmap v414: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:39:56.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:56 smithi152 ceph-mon[104634]: pgmap v415: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:56.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:56 smithi195 ceph-mon[85980]: pgmap v415: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:58.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:58 smithi152 ceph-mon[104634]: pgmap v416: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:39:58.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:58 smithi195 ceph-mon[85980]: pgmap v416: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:40:00.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:39:59 smithi152 ceph-mon[104634]: pgmap v417: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:40:00.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:39:59 smithi195 ceph-mon[85980]: pgmap v417: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:40:01.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:00 smithi152 ceph-mon[104634]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:40:01.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:00 smithi195 ceph-mon[85980]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-06T12:40:02.275 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:01 smithi152 ceph-mon[104634]: pgmap v418: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:40:02.298 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:01 smithi195 ceph-mon[85980]: pgmap v418: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:40:04.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:04 smithi152 ceph-mon[104634]: pgmap v419: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:40:04.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:04 smithi195 ceph-mon[85980]: pgmap v419: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-06T12:40:06.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:06 smithi152 ceph-mon[104634]: pgmap v420: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:40:06.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:06 smithi195 ceph-mon[85980]: pgmap v420: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:40:07.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:07 smithi152 ceph-mon[104634]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:40:07.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:07 smithi195 ceph-mon[85980]: from='mgr.34104 172.21.15.152:0/966128730' entity='mgr.smithi152.lynahm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-06T12:40:07.853 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-04-06T12:40:07.854 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-06T12:40:07.855 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-06T12:40:07.866 INFO:tasks.cephadm:Teardown begin 2024-04-06T12:40:07.867 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks/cephadm.py", line 1750, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-06T12:40:07.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-06T12:40:07.906 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-06T12:40:07.946 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-06T12:40:07.947 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-06T12:40:07.968 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-06T12:40:08.007 INFO:tasks.cephadm:Stopping all daemons... 2024-04-06T12:40:08.007 INFO:tasks.cephadm.mon.smithi152:Stopping mon.smithi152... 2024-04-06T12:40:08.007 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi152 2024-04-06T12:40:08.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:08 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:40:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:08 smithi152 ceph-mon[104634]: pgmap v421: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:40:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[104611]: 2024-04-06T12:40:08.311+0000 7f56e42b9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T12:40:08.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:08 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152[104611]: 2024-04-06T12:40:08.311+0000 7f56e42b9700 -1 mon.smithi152@0(leader) e3 *** Got Signal Terminated *** 2024-04-06T12:40:08.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:08 smithi195 ceph-mon[85980]: pgmap v421: 65 pgs: 65 active+clean; 255 MiB data, 1000 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-06T12:40:09.026 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Apr 06 12:40:08 smithi152 bash[155122]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi152 2024-04-06T12:40:09.222 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi152.service' 2024-04-06T12:40:09.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T12:40:09.267 INFO:tasks.cephadm.mon.smithi152:Stopped mon.smithi152 2024-04-06T12:40:09.267 INFO:tasks.cephadm.mon.smithi195:Stopping mon.smithi195... 2024-04-06T12:40:09.267 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi195 2024-04-06T12:40:09.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:09 smithi195 systemd[1]: Stopping Ceph mon.smithi195 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:40:10.048 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[85957]: 2024-04-06T12:40:09.578+0000 7f341538b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi195 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T12:40:10.049 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:09 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195[85957]: 2024-04-06T12:40:09.578+0000 7f341538b700 -1 mon.smithi195@1(peon) e3 *** Got Signal Terminated *** 2024-04-06T12:40:10.548 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Apr 06 12:40:10 smithi195 bash[129845]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-mon-smithi195 2024-04-06T12:40:10.752 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@mon.smithi195.service' 2024-04-06T12:40:10.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T12:40:10.815 INFO:tasks.cephadm.mon.smithi195:Stopped mon.smithi195 2024-04-06T12:40:10.815 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-06T12:40:10.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.0 2024-04-06T12:40:11.122 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:40:10 smithi152 systemd[1]: Stopping Ceph osd.0 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:40:11.525 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:40:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[118858]: 2024-04-06T12:40:11.124+0000 7fe18bdf9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T12:40:11.525 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:40:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[118858]: 2024-04-06T12:40:11.124+0000 7fe18bdf9700 -1 osd.0 92 *** Got signal Terminated *** 2024-04-06T12:40:11.525 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:40:11 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0[118858]: 2024-04-06T12:40:11.124+0000 7fe18bdf9700 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:40:17.275 INFO:journalctl@ceph.osd.0.smithi152.stdout:Apr 06 12:40:17 smithi152 bash[155281]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-0 2024-04-06T12:40:18.900 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.0.service' 2024-04-06T12:40:18.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T12:40:18.940 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-06T12:40:18.940 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-06T12:40:18.940 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.1 2024-04-06T12:40:19.263 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:40:19 smithi152 systemd[1]: Stopping Ceph osd.1 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:40:19.525 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:40:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[126127]: 2024-04-06T12:40:19.265+0000 7f688f93c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T12:40:19.525 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:40:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[126127]: 2024-04-06T12:40:19.265+0000 7f688f93c700 -1 osd.1 92 *** Got signal Terminated *** 2024-04-06T12:40:19.525 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:40:19 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1[126127]: 2024-04-06T12:40:19.265+0000 7f688f93c700 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:40:25.275 INFO:journalctl@ceph.osd.1.smithi152.stdout:Apr 06 12:40:25 smithi152 bash[155560]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-1 2024-04-06T12:40:26.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.1.service' 2024-04-06T12:40:26.929 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T12:40:26.929 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-06T12:40:26.930 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-06T12:40:26.930 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.2 2024-04-06T12:40:27.250 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:40:27 smithi152 systemd[1]: Stopping Ceph osd.2 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:40:27.525 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:40:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[132860]: 2024-04-06T12:40:27.252+0000 7f2eb99a9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T12:40:27.525 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:40:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[132860]: 2024-04-06T12:40:27.252+0000 7f2eb99a9700 -1 osd.2 92 *** Got signal Terminated *** 2024-04-06T12:40:27.525 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:40:27 smithi152 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2[132860]: 2024-04-06T12:40:27.252+0000 7f2eb99a9700 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:40:33.275 INFO:journalctl@ceph.osd.2.smithi152.stdout:Apr 06 12:40:32 smithi152 bash[155829]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-2 2024-04-06T12:40:34.864 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.2.service' 2024-04-06T12:40:34.908 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T12:40:34.908 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-06T12:40:34.908 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-06T12:40:34.909 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.3 2024-04-06T12:40:35.298 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:40:34 smithi195 systemd[1]: Stopping Ceph osd.3 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:40:35.299 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:40:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[98622]: 2024-04-06T12:40:35.187+0000 7f0727f10700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T12:40:35.299 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:40:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[98622]: 2024-04-06T12:40:35.187+0000 7f0727f10700 -1 osd.3 92 *** Got signal Terminated *** 2024-04-06T12:40:35.299 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:40:35 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[98622]: 2024-04-06T12:40:35.187+0000 7f0727f10700 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:40:39.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:39.393+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:40.298 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:40:39 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3[98622]: 2024-04-06T12:40:39.950+0000 7f0720cff700 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:12.150626+0000 front 2024-04-06T12:40:12.150607+0000 (oldest deadline 2024-04-06T12:40:39.750847+0000) 2024-04-06T12:40:40.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:40 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:40.423+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:41.298 INFO:journalctl@ceph.osd.3.smithi195.stdout:Apr 06 12:40:40 smithi195 bash[130004]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-3 2024-04-06T12:40:41.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:41 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:41.379+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:42.298 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:40:42.268+0000 7f867c094700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:15.695548+0000 front 2024-04-06T12:40:15.695491+0000 (oldest deadline 2024-04-06T12:40:41.595460+0000) 2024-04-06T12:40:42.731 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:42 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:42.379+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:42.739 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.3.service' 2024-04-06T12:40:42.783 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T12:40:42.783 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-06T12:40:42.783 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-06T12:40:42.783 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.4 2024-04-06T12:40:43.048 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:42 smithi195 systemd[1]: Stopping Ceph osd.4 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:40:43.426 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:40:43.114+0000 7f867f29d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T12:40:43.426 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:40:43.114+0000 7f867f29d700 -1 osd.4 92 *** Got signal Terminated *** 2024-04-06T12:40:43.426 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:40:43.114+0000 7f867f29d700 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:40:43.426 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:40:43.278+0000 7f867c094700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:15.695548+0000 front 2024-04-06T12:40:15.695491+0000 (oldest deadline 2024-04-06T12:40:41.595460+0000) 2024-04-06T12:40:43.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:43 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:43.429+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:44.548 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:40:44.231+0000 7f867c094700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:15.695548+0000 front 2024-04-06T12:40:15.695491+0000 (oldest deadline 2024-04-06T12:40:41.595460+0000) 2024-04-06T12:40:44.549 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:44 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:44.400+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:45.548 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:40:45.261+0000 7f867c094700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:15.695548+0000 front 2024-04-06T12:40:15.695491+0000 (oldest deadline 2024-04-06T12:40:41.595460+0000) 2024-04-06T12:40:45.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:45.368+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:45.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:45 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:45.368+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:46.548 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:40:46.276+0000 7f867c094700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:15.695548+0000 front 2024-04-06T12:40:15.695491+0000 (oldest deadline 2024-04-06T12:40:41.595460+0000) 2024-04-06T12:40:46.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:46.388+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:46.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:46 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:46.388+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:47.548 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4[104858]: 2024-04-06T12:40:47.281+0000 7f867c094700 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:15.695548+0000 front 2024-04-06T12:40:15.695491+0000 (oldest deadline 2024-04-06T12:40:41.595460+0000) 2024-04-06T12:40:47.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:47.427+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:47.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:47 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:47.427+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:48.724 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:48.386+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:48.724 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:48 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:48.386+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:49.048 INFO:journalctl@ceph.osd.4.smithi195.stdout:Apr 06 12:40:48 smithi195 bash[130275]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-4 2024-04-06T12:40:49.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:49 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:49.387+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:49.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:49 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:49.387+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:50.632 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:50.351+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:50.632 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:50.351+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:50.640 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.4.service' 2024-04-06T12:40:50.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T12:40:50.681 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-06T12:40:50.681 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-06T12:40:50.681 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.5 2024-04-06T12:40:50.965 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:50 smithi195 systemd[1]: Stopping Ceph osd.5 for f2af90de-f40e-11ee-b649-cb9ed24678a4... 2024-04-06T12:40:51.298 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:50.967+0000 7f966c0c1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-06T12:40:51.298 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:50.967+0000 7f966c0c1700 -1 osd.5 92 *** Got signal Terminated *** 2024-04-06T12:40:51.298 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:50 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:50.967+0000 7f966c0c1700 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-06T12:40:51.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:51.361+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:51.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:51 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:51.361+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:52.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:52.317+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:52.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:52 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:52.317+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:53.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:53.341+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:53.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:53 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:53.341+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:54.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:54.296+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:54.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:54.296+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:54.548 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:54 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:54.296+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6822 osd.2 since back 2024-04-06T12:40:29.534325+0000 front 2024-04-06T12:40:29.534348+0000 (oldest deadline 2024-04-06T12:40:54.234144+0000) 2024-04-06T12:40:55.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:55 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:55.312+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2024-04-06T12:40:13.132446+0000 front 2024-04-06T12:40:13.132367+0000 (oldest deadline 2024-04-06T12:40:38.432346+0000) 2024-04-06T12:40:55.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:55 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:55.312+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2024-04-06T12:40:21.933198+0000 front 2024-04-06T12:40:21.933231+0000 (oldest deadline 2024-04-06T12:40:44.833135+0000) 2024-04-06T12:40:55.798 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:55 smithi195 ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5[111839]: 2024-04-06T12:40:55.312+0000 7f9668eb8700 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.152:6822 osd.2 since back 2024-04-06T12:40:29.534325+0000 front 2024-04-06T12:40:29.534348+0000 (oldest deadline 2024-04-06T12:40:54.234144+0000) 2024-04-06T12:40:57.048 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 06 12:40:56 smithi195 bash[130542]: ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4-osd-5 2024-04-06T12:40:58.591 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2af90de-f40e-11ee-b649-cb9ed24678a4@osd.5.service' 2024-04-06T12:40:58.631 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-06T12:40:58.631 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-06T12:40:58.631 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 --force --keep-logs 2024-04-06T12:41:04.045 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[78255]: fuse finished with error 0 and tester_r 0 2024-04-06T12:41:16.289 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 --force --keep-logs 2024-04-06T12:41:28.904 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-06T12:41:28.942 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-06T12:41:28.973 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-06T12:41:28.975 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948/remote/smithi152/crash 2024-04-06T12:41:28.976 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/crash -- . 2024-04-06T12:41:29.014 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-06T12:41:29.014 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2024-04-06T12:41:29.015 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948/remote/smithi195/crash 2024-04-06T12:41:29.016 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/crash -- . 2024-04-06T12:41:29.042 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-06T12:41:29.043 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now 2024-04-06T12:41:29.043 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-06T12:41:29.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-04-06T12:41:29.087 INFO:teuthology.orchestra.run.smithi152.stderr:grep: /var/log/ceph/f2af90de-f40e-11ee-b649-cb9ed24678a4/ceph.log: No such file or directory 2024-04-06T12:41:29.090 INFO:tasks.cephadm:Compressing logs... 2024-04-06T12:41:29.090 DEBUG:teuthology.orchestra.run.smithi152:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-06T12:41:29.133 DEBUG:teuthology.orchestra.run.smithi195:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-06T12:41:29.158 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-06T12:41:29.159 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-06T12:41:45.665 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-06T12:44:00.802 INFO:tasks.cephadm:Archiving logs... 2024-04-06T12:44:00.803 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948/remote/smithi152/log 2024-04-06T12:44:00.805 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-06T12:44:18.459 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948/remote/smithi195/log 2024-04-06T12:44:18.461 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-06T12:44:23.667 INFO:tasks.cephadm:Removing cluster... 2024-04-06T12:44:23.668 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 --force 2024-04-06T12:44:24.262 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2af90de-f40e-11ee-b649-cb9ed24678a4 --force 2024-04-06T12:44:24.748 INFO:tasks.cephadm:Removing cephadm ... 2024-04-06T12:44:24.748 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-06T12:44:24.768 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-06T12:44:24.787 INFO:tasks.cephadm:Teardown complete 2024-04-06T12:44:24.787 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-06T12:44:24.800 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-06T12:44:24.800 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-06T12:44:24.801 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-06T12:44:24.810 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-06T12:44:24.905 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-06T12:44:24.916 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-06T12:44:24.916 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-06T12:44:24.919 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-06T12:44:24.933 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2024-04-06T12:44:24.935 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2024-04-06T12:44:24.938 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-06T12:44:24.938 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-04-06T12:44:24.938 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 -563us[ -562us] +/- 77ms 2024-04-06T12:44:24.939 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -365us[ -365us] +/- 51ms 2024-04-06T12:44:24.939 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 94 +1007us[+1008us] +/- 69ms 2024-04-06T12:44:24.939 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:44:24.940 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-06T12:44:24.940 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-06T12:44:24.940 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 -562us[ -566us] +/- 77ms 2024-04-06T12:44:24.941 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 -376us[ -379us] +/- 51ms 2024-04-06T12:44:24.941 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +966us[ +966us] +/- 70ms 2024-04-06T12:44:24.941 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-06T12:44:24.941 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-06T12:44:24.953 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-06T12:44:24.953 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-06T12:44:24.981 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-06T12:44:25.053 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-06T12:44:25.119 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-06T12:44:25.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T12:44:25.150 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-06T12:44:25.180 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T12:44:25.180 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-06T12:44:25.191 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-06T12:44:25.232 INFO:teuthology.task.internal:Duration was 2454.912269 seconds 2024-04-06T12:44:25.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-06T12:44:25.264 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-06T12:44:25.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-06T12:44:25.267 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-06T12:44:25.311 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-06T12:44:25.313 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-06T12:44:25.537 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-06T12:44:25.537 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-04-06T12:44:25.537 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-06T12:44:25.560 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-04-06T12:44:25.560 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-06T12:44:25.582 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-06T12:44:25.582 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-06T12:44:25.602 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-06T12:44:25.681 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-06T12:44:25.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-06T12:44:25.684 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-06T12:44:25.808 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-06T12:44:25.821 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-06T12:44:25.821 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-06T12:44:25.848 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-06T12:44:25.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-06T12:44:25.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-06T12:44:25.890 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-06T12:44:25.914 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-04-06T12:44:25.942 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-04-06T12:44:25.973 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-06T12:44:25.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T12:44:25.992 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-06T12:44:26.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T12:44:26.030 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-06T12:44:26.043 INFO:teuthology.task.internal:Transferring archived files... 2024-04-06T12:44:26.044 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948/remote/smithi152 2024-04-06T12:44:26.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-06T12:44:26.089 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948/remote/smithi195 2024-04-06T12:44:26.090 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-06T12:44:26.132 INFO:teuthology.task.internal:Removing archive directory... 2024-04-06T12:44:26.132 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-06T12:44:26.134 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-06T12:44:26.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-06T12:44:26.196 INFO:teuthology.task.internal:Not uploading archives. 2024-04-06T12:44:26.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-06T12:44:26.291 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-06T12:44:26.291 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-06T12:44:26.294 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-06T12:44:26.309 INFO:teuthology.orchestra.run.smithi152.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 6 12:44 /home/ubuntu/cephtest 2024-04-06T12:44:26.310 INFO:teuthology.orchestra.run.smithi152.stdout: 395757 4 d--------- 2 ubuntu ubuntu 4096 Apr 6 12:20 /home/ubuntu/cephtest/mnt.0 2024-04-06T12:44:26.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-06T12:44:26.311 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-04-06T12:44:26.311 INFO:teuthology.orchestra.run.smithi152.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-06T12:44:26.311 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_800ec6d64a7fa0648ad53edfc6e50b41fc4cd674/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-06T12:44:26.312 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-06T12:44:26.336 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-06T12:44:26.367 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-06T12:44:26.367 INFO:teuthology.nuke:Checking targets against current locks 2024-04-06T12:44:26.393 DEBUG:teuthology.nuke:shortname: smithi152 2024-04-06T12:44:26.394 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-06T12:44:26.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-06 11:54:20.509822', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG0ZE6RtwwSo6p8HLaMoC1J5aLse6I4LubuFJ+ln4Yzco0itQRDDrNJwDF2QV7q4GTv3fuDj6agfYzTa/4E0tGA='} 2024-04-06T12:44:26.419 DEBUG:teuthology.nuke:shortname: smithi195 2024-04-06T12:44:26.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-06T12:44:26.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_22:24:02-fs-reef-distro-default-smithi/7638948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-06 11:54:20.511545', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKelDZDzSpoPGpF/Z7ah+k4H++JSMNI6zUbgmTkEaX8udFK9Cxm/VcVrFPHC0sKu1jOHncs9GovOq4zg0SWCqKk='} 2024-04-06T12:44:26.471 INFO:teuthology.orchestra.console.smithi152:Power off 2024-04-06T12:44:26.471 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-06T12:44:26.494 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-04-06T12:44:26.494 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T12:44:26.509 INFO:teuthology.orchestra.console.smithi195:Power off 2024-04-06T12:44:26.509 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-06T12:44:26.518 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-04-06T12:44:26.531 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-04-06T12:44:26.531 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T12:44:26.555 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-06T12:44:30.519 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T12:44:30.556 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T12:44:30.629 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-04-06T12:44:30.665 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-06T12:44:34.633 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T12:44:34.666 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T12:44:34.743 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-04-06T12:44:34.774 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-04-06T12:44:34.875 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-04-06T12:44:38.748 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-06T12:44:38.858 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-04-06T12:44:38.959 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-04-06T12:44:39.063 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2454.9122693538666 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-06T12:44:39.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-06T12:44:39.149 INFO:teuthology.run:FAIL